2026-03-27 10:35:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-27 10:35:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-27 10:35:05 [auto1.de] INFO: Batch mode enabled: batch 2/2
2026-03-27 10:35:05 [auto1.de] INFO: Starting spider auto1.de
2026-03-27 10:35:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-27 10:35:05 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-27 10:35:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-27 10:35:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-27 10:35:05 [scrapy.extensions.telnet] INFO: Telnet Password: 7bb62a8bf0bfb4fe
2026-03-27 10:35:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-27 10:35:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.de/task_18_2026-03-27T10_35_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-27 10:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 10:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 10:35:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-27 10:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-27 10:35:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-27 10:35:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-27 10:35:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-27 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-27 10:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-27 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-27 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-27 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-27 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-27 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-27 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-27 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-27 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-27 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-27 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-27 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-27 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-27 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-27 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-27 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-27 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-27 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-27 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-27 10:35:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-27 10:35:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-27 10:35:06 [scrapy.core.engine] INFO: Spider opened
2026-03-27 10:35:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-27 10:35:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-27 10:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-27 10:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 10:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 10:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-27 10:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-27 10:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-27 10:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-27 10:35:17 [auto1.de] INFO: Channel: 24h | Page: 0 | totalHits: 10493 | hits on page: 40
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: UW78098
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: VV99941
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: BY90710
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY90710%27 HTTP/1.1" 200 None
2026-03-27 10:35:17 [auto1.de] INFO: Scrape type for BY90710: 1
2026-03-27 10:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: KV84804
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV84804%27 HTTP/1.1" 200 None
2026-03-27 10:35:17 [auto1.de] INFO: Scrape type for KV84804: 1
2026-03-27 10:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: VA07254
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: CR70146
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR70146%27 HTTP/1.1" 200 None
2026-03-27 10:35:17 [auto1.de] INFO: Scrape type for CR70146: 1
2026-03-27 10:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: MT40428
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: YJ47160
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: HZ16106
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: GL07101
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: JX91895
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: JM16548
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM16548%27 HTTP/1.1" 200 None
2026-03-27 10:35:17 [auto1.de] INFO: Scrape type for JM16548: 1
2026-03-27 10:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: HT61440
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: NL88078
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: GX89038
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: KL79607
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL79607%27 HTTP/1.1" 200 None
2026-03-27 10:35:17 [auto1.de] INFO: Scrape type for KL79607: 1
2026-03-27 10:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: VZ21746
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ21746%27 HTTP/1.1" 200 None
2026-03-27 10:35:17 [auto1.de] INFO: Scrape type for VZ21746: 1
2026-03-27 10:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: DC30039
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC30039%27 HTTP/1.1" 200 None
2026-03-27 10:35:17 [auto1.de] INFO: Scrape type for DC30039: 1
2026-03-27 10:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: PD92865
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72953%27 HTTP/1.1" 200 None
2026-03-27 10:35:17 [auto1.de] INFO: Scrape type for CK72953: 1
2026-03-27 10:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: TR81409
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR81409%27 HTTP/1.1" 200 None
2026-03-27 10:35:17 [auto1.de] INFO: Scrape type for TR81409: 1
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: MN30127
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: GC04938
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC04938%27 HTTP/1.1" 200 None
2026-03-27 10:35:17 [auto1.de] INFO: Scrape type for GC04938: 1
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: TF66313
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV94610%27 HTTP/1.1" 200 None
2026-03-27 10:35:17 [auto1.de] INFO: Scrape type for FV94610: 1
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: SM54936
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM54936%27 HTTP/1.1" 200 None
2026-03-27 10:35:17 [auto1.de] INFO: Scrape type for SM54936: 1
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: CZ12085
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: EA80690
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA80690%27 HTTP/1.1" 200 None
2026-03-27 10:35:17 [auto1.de] INFO: Scrape type for EA80690: 1
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV26500%27 HTTP/1.1" 200 None
2026-03-27 10:35:17 [auto1.de] INFO: Scrape type for RV26500: 1
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: YA08912
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: CJ52783
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: NG80154
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG80154%27 HTTP/1.1" 200 None
2026-03-27 10:35:17 [auto1.de] INFO: Scrape type for NG80154: 1
2026-03-27 10:35:17 [auto1.de] INFO: Found listing with ID: WT06572
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06572%27 HTTP/1.1" 200 None
2026-03-27 10:35:17 [auto1.de] INFO: Scrape type for WT06572: 2
2026-03-27 10:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cde659ec-0fb7-5057-af9d-5776be325a82 with identifier: WT06572
2026-03-27 10:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cde659ec-0fb7-5057-af9d-5776be325a82 with scrape type 2
2026-03-27 10:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cde659ec-0fb7-5057-af9d-5776be325a82 with scrape type 2
2026-03-27 10:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cde659ec-0fb7-5057-af9d-5776be325a82, identifier: WT06572
2026-03-27 10:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cde659ec-0fb7-5057-af9d-5776be325a82 with identifier: WT06572
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-27 10:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-27 10:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cde659ec-0fb7-5057-af9d-5776be325a82 with identifier: WT06572
2026-03-27 10:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cde659ec-0fb7-5057-af9d-5776be325a82 with identifier: WT06572 to the API
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:14:50Z',
 'fuel_type': 'diesel',
 'id': 'cde659ec-0fb7-5057-af9d-5776be325a82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT06572',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 205087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-29',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2012}
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06572%27 HTTP/1.1" 200 None
2026-03-27 10:35:18 [auto1.de] INFO: Saving data for WT06572: {'auction_closing_time': 1774714490.0, 'created_time': 1773230220.791237, 'last_price_update_time': 1774607718.592892}
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT06572') HTTP/1.1" 204 0
2026-03-27 10:35:18 [auto1.de] INFO: Found listing with ID: EH62859
2026-03-27 10:35:18 [auto1.de] INFO: Found listing with ID: FY64526
2026-03-27 10:35:18 [auto1.de] INFO: Found listing with ID: GX15527
2026-03-27 10:35:18 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-27 10:35:18 [auto1.de] INFO: Found listing with ID: WG78869
2026-03-27 10:35:18 [auto1.de] INFO: Found listing with ID: BX52233
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX52233%27 HTTP/1.1" 200 None
2026-03-27 10:35:18 [auto1.de] INFO: Scrape type for BX52233: 1
2026-03-27 10:35:18 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-27 10:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:19 [auto1.de] INFO: Channel: 24h | Page: 1 | totalHits: 10493 | hits on page: 40
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: UW78098
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: VV99941
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: BY90710
2026-03-27 10:35:19 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/BY90710/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: KV84804
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: VA07254
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: CR70146
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: MT40428
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: YJ47160
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: HZ16106
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: GL07101
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: JX91895
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: JM16548
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: HT61440
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: NL88078
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: GX89038
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: KL79607
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: VZ21746
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: DC30039
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: PD92865
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: TR81409
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: MN30127
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: GC04938
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: TF66313
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: SM54936
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: CZ12085
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: EA80690
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: YA08912
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: CJ52783
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: NG80154
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: WT06572
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06572%27 HTTP/1.1" 200 None
2026-03-27 10:35:19 [auto1.de] INFO: Scrape type for WT06572: 0
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: EH62859
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: FY64526
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: GX15527
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: WG78869
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: BX52233
2026-03-27 10:35:19 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-27 10:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BY90710/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM16548/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ21746/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DC30039/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV84804/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL79607/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CK72953/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR81409/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM54936/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FV94610/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA80690/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RV26500/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BX52233/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:20 [auto1.de] INFO: Channel: 24h | Page: 2 | totalHits: 10493 | hits on page: 40
2026-03-27 10:35:20 [auto1.de] INFO: Found listing with ID: VH10355
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH10355%27 HTTP/1.1" 200 None
2026-03-27 10:35:20 [auto1.de] INFO: Scrape type for VH10355: 1
2026-03-27 10:35:20 [auto1.de] INFO: Found listing with ID: NK83819
2026-03-27 10:35:20 [auto1.de] INFO: Found listing with ID: MG37810
2026-03-27 10:35:20 [auto1.de] INFO: Found listing with ID: SV13508
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV13508%27 HTTP/1.1" 200 None
2026-03-27 10:35:20 [auto1.de] INFO: Scrape type for SV13508: 1
2026-03-27 10:35:20 [auto1.de] INFO: Found listing with ID: UP84428
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP84428%27 HTTP/1.1" 200 None
2026-03-27 10:35:20 [auto1.de] INFO: Scrape type for UP84428: 2
2026-03-27 10:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7887e963-f9ff-5927-94de-77b242b6e6b1 with identifier: UP84428
2026-03-27 10:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7887e963-f9ff-5927-94de-77b242b6e6b1 with scrape type 2
2026-03-27 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7887e963-f9ff-5927-94de-77b242b6e6b1 with scrape type 2
2026-03-27 10:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7887e963-f9ff-5927-94de-77b242b6e6b1, identifier: UP84428
2026-03-27 10:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7887e963-f9ff-5927-94de-77b242b6e6b1 with identifier: UP84428
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-27 10:35:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7887e963-f9ff-5927-94de-77b242b6e6b1 with identifier: UP84428
2026-03-27 10:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7887e963-f9ff-5927-94de-77b242b6e6b1 with identifier: UP84428 to the API
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:26:05Z',
 'fuel_type': 'diesel',
 'id': '7887e963-f9ff-5927-94de-77b242b6e6b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP84428',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 196034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'GTD BlueMotion Tech',
 'year': 2015}
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP84428%27 HTTP/1.1" 200 None
2026-03-27 10:35:21 [auto1.de] INFO: Saving data for UP84428: {'auction_closing_time': 1774715165.0, 'created_time': 1774002241.427034, 'last_price_update_time': 1774607721.640332}
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP84428') HTTP/1.1" 204 0
2026-03-27 10:35:21 [auto1.de] INFO: Found listing with ID: TE41931
2026-03-27 10:35:21 [auto1.de] INFO: Found listing with ID: PD33755
2026-03-27 10:35:21 [auto1.de] INFO: Found listing with ID: BN83173
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN83173%27 HTTP/1.1" 200 None
2026-03-27 10:35:21 [auto1.de] INFO: Scrape type for BN83173: 1
2026-03-27 10:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM16548> (referer: https://www.auto1.com/v1/car-details-view/JM16548/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:21 [auto1.de] INFO: Found listing with ID: MW31978
2026-03-27 10:35:21 [auto1.de] INFO: Found listing with ID: CS48399
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS48399%27 HTTP/1.1" 200 None
2026-03-27 10:35:21 [auto1.de] INFO: Scrape type for CS48399: 2
2026-03-27 10:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 507b67bd-ce04-58e7-80ac-0ce91872a85c with identifier: CS48399
2026-03-27 10:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 507b67bd-ce04-58e7-80ac-0ce91872a85c with scrape type 2
2026-03-27 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 507b67bd-ce04-58e7-80ac-0ce91872a85c with scrape type 2
2026-03-27 10:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 507b67bd-ce04-58e7-80ac-0ce91872a85c, identifier: CS48399
2026-03-27 10:35:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BY90710> (referer: https://www.auto1.com/v1/car-details-view/BY90710/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV84804> (referer: https://www.auto1.com/v1/car-details-view/KV84804/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 507b67bd-ce04-58e7-80ac-0ce91872a85c with identifier: CS48399
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:35:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-27 10:35:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-27 10:35:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 507b67bd-ce04-58e7-80ac-0ce91872a85c with identifier: CS48399
2026-03-27 10:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 507b67bd-ce04-58e7-80ac-0ce91872a85c with identifier: CS48399 to the API
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 207,
 'expiration_date': '2026-03-28T16:55:13Z',
 'fuel_type': 'petrol',
 'id': '507b67bd-ce04-58e7-80ac-0ce91872a85c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS48399',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 69908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-11',
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2022}
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS48399%27 HTTP/1.1" 200 None
2026-03-27 10:35:22 [auto1.de] INFO: Saving data for CS48399: {'auction_closing_time': 1774716913.0, 'created_time': 1773382503.097293, 'last_price_update_time': 1774607722.553327}
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS48399') HTTP/1.1" 204 0
2026-03-27 10:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DC30039> (referer: https://www.auto1.com/v1/car-details-view/DC30039/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:22 [auto1.de] INFO: Found listing with ID: WM50806
2026-03-27 10:35:22 [auto1.de] INFO: Found listing with ID: VM88505
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM88505%27 HTTP/1.1" 200 None
2026-03-27 10:35:22 [auto1.de] INFO: Scrape type for VM88505: 1
2026-03-27 10:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:22 [auto1.de] INFO: Found listing with ID: FJ71041
2026-03-27 10:35:22 [auto1.de] INFO: Found listing with ID: RT27360
2026-03-27 10:35:22 [auto1.de] INFO: Found listing with ID: RP72323
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP72323%27 HTTP/1.1" 200 None
2026-03-27 10:35:22 [auto1.de] INFO: Scrape type for RP72323: 2
2026-03-27 10:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a6804a-4c22-514c-9e80-c2d2723e112b with identifier: RP72323
2026-03-27 10:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a6804a-4c22-514c-9e80-c2d2723e112b with scrape type 2
2026-03-27 10:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2a6804a-4c22-514c-9e80-c2d2723e112b with scrape type 2
2026-03-27 10:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2a6804a-4c22-514c-9e80-c2d2723e112b, identifier: RP72323
2026-03-27 10:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC04938/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2a6804a-4c22-514c-9e80-c2d2723e112b with identifier: RP72323
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-27 10:35:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2a6804a-4c22-514c-9e80-c2d2723e112b with identifier: RP72323
2026-03-27 10:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2a6804a-4c22-514c-9e80-c2d2723e112b with identifier: RP72323 to the API
2026-03-27 10:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:41:02Z',
 'fuel_type': 'diesel',
 'id': 'd2a6804a-4c22-514c-9e80-c2d2723e112b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP72323',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 217250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-24',
 'seller_name': None,
 'title': 'BMW 3er 320d xDrive Advantage',
 'transmission': 'automatic',
 'trim': 'xDrive Advantage',
 'year': 2015}
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP72323%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [auto1.de] INFO: Saving data for RP72323: {'auction_closing_time': 1774716062.0, 'created_time': 1773401592.100677, 'last_price_update_time': 1774607723.199065}
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP72323') HTTP/1.1" 204 0
2026-03-27 10:35:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8049887e-e6ec-5ec0-b934-32ee67f4586a with identifier: JM16548
2026-03-27 10:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8049887e-e6ec-5ec0-b934-32ee67f4586a with scrape type 1
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8049887e-e6ec-5ec0-b934-32ee67f4586a
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F95%252F3e95111e6d12aed932064814fedf789b%252Fpa%252FJM16548_28e93a3e33ae68493b92d9cb2ef5d6bb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_28e93a3e33ae68493b92d9cb2ef5d6bb.jpg not downloaded yet
2026-03-27 10:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30986627-4795-5964-a386-2181452c2a6e with identifier: BY90710
2026-03-27 10:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30986627-4795-5964-a386-2181452c2a6e with scrape type 1
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30986627-4795-5964-a386-2181452c2a6e
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F5331d13314a0b54db64ac2f75f2df8ce%252Fpa%252FBY90710_2182d85258c776bbd88e810c619f39ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_2182d85258c776bbd88e810c619f39ea.jpg not downloaded yet
2026-03-27 10:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c218447f-2f05-5fb8-b352-abe4d5938aad with identifier: KV84804
2026-03-27 10:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c218447f-2f05-5fb8-b352-abe4d5938aad with scrape type 1
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c218447f-2f05-5fb8-b352-abe4d5938aad
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7a%252F4d7a76cf71d17ec266e8856f3c6a5e25%252Fpa%252FKV84804_632aafca6ea526673bab13c262ecbdc2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_632aafca6ea526673bab13c262ecbdc2.jpg not downloaded yet
2026-03-27 10:35:23 [auto1.de] INFO: Found listing with ID: MW80784
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW80784%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [auto1.de] INFO: Scrape type for MW80784: 1
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F95%252F3e95111e6d12aed932064814fedf789b%252Fpa%252FJM16548_ff71d6db09cca8966254ce7d5e68f2b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_ff71d6db09cca8966254ce7d5e68f2b1.jpg not downloaded yet
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F5331d13314a0b54db64ac2f75f2df8ce%252Fpa%252FBY90710_f3098f0368d0d6a01db58094e1d700a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_f3098f0368d0d6a01db58094e1d700a3.jpg not downloaded yet
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7a%252F4d7a76cf71d17ec266e8856f3c6a5e25%252Fpa%252FKV84804_4d449ab612bae0959009c64f92994d2c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_4d449ab612bae0959009c64f92994d2c.jpg not downloaded yet
2026-03-27 10:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ21746> (referer: https://www.auto1.com/v1/car-details-view/VZ21746/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb25c12a-97b7-5649-ac29-b32a9302172d with identifier: DC30039
2026-03-27 10:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb25c12a-97b7-5649-ac29-b32a9302172d with scrape type 1
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item bb25c12a-97b7-5649-ac29-b32a9302172d
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F33%252Fd133584e32ab31311010e09990a94ca0%252Fpa%252FDC30039_d0be6c6a33d24b516869598775b09da6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/33/d133584e32ab31311010e09990a94ca0/pa/DC30039_d0be6c6a33d24b516869598775b09da6.jpg not downloaded yet
2026-03-27 10:35:23 [auto1.de] INFO: Found listing with ID: LA39027
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA39027%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [auto1.de] INFO: Scrape type for LA39027: 1
2026-03-27 10:35:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CR70146/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F95%252F3e95111e6d12aed932064814fedf789b%252Fpa%252FJM16548_9c792e468a8d80a3795f299e2b827be0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_9c792e468a8d80a3795f299e2b827be0.jpg not downloaded yet
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F5331d13314a0b54db64ac2f75f2df8ce%252Fpa%252FBY90710_ce2484226ea62b63c593c7446957fb33.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_ce2484226ea62b63c593c7446957fb33.jpg not downloaded yet
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7a%252F4d7a76cf71d17ec266e8856f3c6a5e25%252Fpa%252FKV84804_0b8501db71e53964f72e6fb399961d4c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_0b8501db71e53964f72e6fb399961d4c.jpg not downloaded yet
2026-03-27 10:35:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F33%252Fd133584e32ab31311010e09990a94ca0%252Fpa%252FDC30039_8324e5a2a9374e4a34a724b65e0b1681.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/33/d133584e32ab31311010e09990a94ca0/pa/DC30039_8324e5a2a9374e4a34a724b65e0b1681.jpg not downloaded yet
2026-03-27 10:35:23 [auto1.de] INFO: Found listing with ID: EM63340
2026-03-27 10:35:23 [auto1.de] INFO: Found listing with ID: TL42173
2026-03-27 10:35:23 [auto1.de] INFO: Found listing with ID: HB95489
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB95489%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [auto1.de] INFO: Scrape type for HB95489: 1
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F95%252F3e95111e6d12aed932064814fedf789b%252Fpa%252FJM16548_953658ca41ae7779d4abb905731ff225.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_953658ca41ae7779d4abb905731ff225.jpg not downloaded yet
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F5331d13314a0b54db64ac2f75f2df8ce%252Fpa%252FBY90710_c8fcb25c09e30c4adbedf36691262dca.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_c8fcb25c09e30c4adbedf36691262dca.jpg not downloaded yet
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7a%252F4d7a76cf71d17ec266e8856f3c6a5e25%252Fpa%252FKV84804_5a063aafbe9f95071d8f9da8bfb4ecba.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_5a063aafbe9f95071d8f9da8bfb4ecba.jpg not downloaded yet
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F33%252Fd133584e32ab31311010e09990a94ca0%252Fpa%252FDC30039_9162482463956c6e96b934bbbf0b88d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/33/d133584e32ab31311010e09990a94ca0/pa/DC30039_9162482463956c6e96b934bbbf0b88d8.jpg not downloaded yet
2026-03-27 10:35:23 [auto1.de] INFO: Found listing with ID: DZ70756
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ70756%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [auto1.de] INFO: Scrape type for DZ70756: 2
2026-03-27 10:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b20238c3-58c1-5329-ad11-23c265dac4e5 with identifier: DZ70756
2026-03-27 10:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b20238c3-58c1-5329-ad11-23c265dac4e5 with scrape type 2
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b20238c3-58c1-5329-ad11-23c265dac4e5 with scrape type 2
2026-03-27 10:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b20238c3-58c1-5329-ad11-23c265dac4e5, identifier: DZ70756
2026-03-27 10:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c325213c-98d7-5b02-b0dd-1fcc571aa207 with identifier: VZ21746
2026-03-27 10:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c325213c-98d7-5b02-b0dd-1fcc571aa207 with scrape type 1
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c325213c-98d7-5b02-b0dd-1fcc571aa207
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F3b%252F383b91974caca5b2a78d21f118a302dc%252Fpa%252FVZ21746_49b1a22626bee50e48560dcf42be5c2b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_49b1a22626bee50e48560dcf42be5c2b.jpg not downloaded yet
2026-03-27 10:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b20238c3-58c1-5329-ad11-23c265dac4e5 with identifier: DZ70756
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-27 10:35:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b20238c3-58c1-5329-ad11-23c265dac4e5 with identifier: DZ70756
2026-03-27 10:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b20238c3-58c1-5329-ad11-23c265dac4e5 with identifier: DZ70756 to the API
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:36:58Z',
 'fuel_type': 'diesel',
 'id': 'b20238c3-58c1-5329-ad11-23c265dac4e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ70756',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 182385,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-28',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.9 TDI Tour',
 'transmission': 'automatic',
 'trim': 'Tour',
 'year': 2007}
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ70756%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [auto1.de] INFO: Saving data for DZ70756: {'auction_closing_time': 1774715818.0, 'created_time': 1773131948.902892, 'last_price_update_time': 1774607724.244127}
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ70756') HTTP/1.1" 204 0
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F95%252F3e95111e6d12aed932064814fedf789b%252Fpa%252FJM16548_36ae7af45ce6fd93701f9d397913dc12.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_36ae7af45ce6fd93701f9d397913dc12.jpg not downloaded yet
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F5331d13314a0b54db64ac2f75f2df8ce%252Fpa%252FBY90710_b898119c4ba8933ed85cd93c84f7b83d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_b898119c4ba8933ed85cd93c84f7b83d.jpg not downloaded yet
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7a%252F4d7a76cf71d17ec266e8856f3c6a5e25%252Fpa%252FKV84804_4704305d9c650b867393407b39cddcaa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_4704305d9c650b867393407b39cddcaa.jpg not downloaded yet
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F33%252Fd133584e32ab31311010e09990a94ca0%252Fpa%252FDC30039_eb060fa7831d7fe5731bb19bf21f0d97.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/33/d133584e32ab31311010e09990a94ca0/pa/DC30039_eb060fa7831d7fe5731bb19bf21f0d97.jpg not downloaded yet
2026-03-27 10:35:24 [auto1.de] INFO: Found listing with ID: MB94614
2026-03-27 10:35:24 [auto1.de] INFO: Found listing with ID: TG96584
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG96584%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [auto1.de] INFO: Scrape type for TG96584: 1
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F3b%252F383b91974caca5b2a78d21f118a302dc%252Fpa%252FVZ21746_0bbd8aea8d14ac9782e01276394cfa33.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_0bbd8aea8d14ac9782e01276394cfa33.jpg not downloaded yet
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F95%252F3e95111e6d12aed932064814fedf789b%252Fpa%252FJM16548_87dac738be14526db7562e9680f4b4b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_87dac738be14526db7562e9680f4b4b5.jpg not downloaded yet
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F5331d13314a0b54db64ac2f75f2df8ce%252Fpa%252FBY90710_2e37570cd8331dc8459d977687a9f1ba.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_2e37570cd8331dc8459d977687a9f1ba.jpg not downloaded yet
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7a%252F4d7a76cf71d17ec266e8856f3c6a5e25%252Fpa%252FKV84804_45176928420d21403a2dea48e2aadebb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_45176928420d21403a2dea48e2aadebb.jpg not downloaded yet
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F33%252Fd133584e32ab31311010e09990a94ca0%252Fpa%252FDC30039_bd2e272f1ed12217ae9ef70873d9bb61.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/33/d133584e32ab31311010e09990a94ca0/pa/DC30039_bd2e272f1ed12217ae9ef70873d9bb61.jpg not downloaded yet
2026-03-27 10:35:24 [auto1.de] INFO: Found listing with ID: KY59799
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY59799%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [auto1.de] INFO: Scrape type for KY59799: 1
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F3b%252F383b91974caca5b2a78d21f118a302dc%252Fpa%252FVZ21746_e0ba3eae689401bce52327155d330afb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_e0ba3eae689401bce52327155d330afb.jpg not downloaded yet
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F5331d13314a0b54db64ac2f75f2df8ce%252Fpa%252FBY90710_c0f15395a837ae551696ccbc2a80c9a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_c0f15395a837ae551696ccbc2a80c9a7.jpg not downloaded yet
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7a%252F4d7a76cf71d17ec266e8856f3c6a5e25%252Fpa%252FKV84804_ac0d1f5b9cd314cfacea960f6aeba169.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_ac0d1f5b9cd314cfacea960f6aeba169.jpg not downloaded yet
2026-03-27 10:35:24 [auto1.de] INFO: Found listing with ID: NG10221
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG10221%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [auto1.de] INFO: Scrape type for NG10221: 1
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F3b%252F383b91974caca5b2a78d21f118a302dc%252Fpa%252FVZ21746_e2ea2699e7b36f88e2cb33d72140b5a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_e2ea2699e7b36f88e2cb33d72140b5a3.jpg not downloaded yet
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F5331d13314a0b54db64ac2f75f2df8ce%252Fpa%252FBY90710_9d7b235c29c3010bf64b641c2ebf43e6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_9d7b235c29c3010bf64b641c2ebf43e6.jpg not downloaded yet
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7a%252F4d7a76cf71d17ec266e8856f3c6a5e25%252Fpa%252FKV84804_b34df8658de0c45378cfdba0ada53d80.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_b34df8658de0c45378cfdba0ada53d80.jpg not downloaded yet
2026-03-27 10:35:24 [auto1.de] INFO: Found listing with ID: ZK28238
2026-03-27 10:35:24 [auto1.de] INFO: Found listing with ID: RE17232
2026-03-27 10:35:24 [auto1.de] INFO: Found listing with ID: YW88691
2026-03-27 10:35:24 [auto1.de] INFO: Found listing with ID: HK36179
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK36179%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [auto1.de] INFO: Scrape type for HK36179: 1
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F3b%252F383b91974caca5b2a78d21f118a302dc%252Fpa%252FVZ21746_a1394d6e027ade4b93b322f3e66b3681.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_a1394d6e027ade4b93b322f3e66b3681.jpg not downloaded yet
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F5331d13314a0b54db64ac2f75f2df8ce%252Fpa%252FBY90710_45c9a01b8b3fc445b83d53c420a9c9e6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_45c9a01b8b3fc445b83d53c420a9c9e6.jpg not downloaded yet
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7a%252F4d7a76cf71d17ec266e8856f3c6a5e25%252Fpa%252FKV84804_0cf204f4de60fc3de9b9539d9d7cce7a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_0cf204f4de60fc3de9b9539d9d7cce7a.jpg not downloaded yet
2026-03-27 10:35:24 [auto1.de] INFO: Found listing with ID: UE30876
2026-03-27 10:35:24 [auto1.de] INFO: Found listing with ID: DF69059
2026-03-27 10:35:24 [auto1.de] INFO: Found listing with ID: HV45616
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV45616%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [auto1.de] INFO: Scrape type for HV45616: 1
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F3b%252F383b91974caca5b2a78d21f118a302dc%252Fpa%252FVZ21746_8c72c390b82486fcae13c799e1f16a35.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_8c72c390b82486fcae13c799e1f16a35.jpg not downloaded yet
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F5331d13314a0b54db64ac2f75f2df8ce%252Fpa%252FBY90710_6b8727a3450b866cc248a1292810bc2f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_6b8727a3450b866cc248a1292810bc2f.jpg not downloaded yet
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7a%252F4d7a76cf71d17ec266e8856f3c6a5e25%252Fpa%252FKV84804_698fc9a55e03743af0dcfa76ae10627b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_698fc9a55e03743af0dcfa76ae10627b.jpg not downloaded yet
2026-03-27 10:35:24 [auto1.de] INFO: Found listing with ID: XT42199
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT42199%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [auto1.de] INFO: Scrape type for XT42199: 1
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F3b%252F383b91974caca5b2a78d21f118a302dc%252Fpa%252FVZ21746_d4896dc6cd7de5f1ba6137220c285d6a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_d4896dc6cd7de5f1ba6137220c285d6a.jpg not downloaded yet
2026-03-27 10:35:24 [auto1.de] INFO: Found listing with ID: WG00954
2026-03-27 10:35:24 [auto1.de] INFO: Found listing with ID: ZK69536
2026-03-27 10:35:24 [auto1.de] INFO: Found listing with ID: AW78451
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW78451%27 HTTP/1.1" 200 None
2026-03-27 10:35:24 [auto1.de] INFO: Scrape type for AW78451: 2
2026-03-27 10:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c77a6e79-b54a-5afc-ab84-67ab178c8d85 with identifier: AW78451
2026-03-27 10:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c77a6e79-b54a-5afc-ab84-67ab178c8d85 with scrape type 2
2026-03-27 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c77a6e79-b54a-5afc-ab84-67ab178c8d85 with scrape type 2
2026-03-27 10:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c77a6e79-b54a-5afc-ab84-67ab178c8d85, identifier: AW78451
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F3b%252F383b91974caca5b2a78d21f118a302dc%252Fpa%252FVZ21746_9a6affea61516b6dd6cf3d8d4fafbfd9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_9a6affea61516b6dd6cf3d8d4fafbfd9.jpg not downloaded yet
2026-03-27 10:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c77a6e79-b54a-5afc-ab84-67ab178c8d85 with identifier: AW78451
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-27 10:35:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c77a6e79-b54a-5afc-ab84-67ab178c8d85 with identifier: AW78451
2026-03-27 10:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c77a6e79-b54a-5afc-ab84-67ab178c8d85 with identifier: AW78451 to the API
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:26:32Z',
 'fuel_type': 'diesel',
 'id': 'c77a6e79-b54a-5afc-ab84-67ab178c8d85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW78451',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 181887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-08',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2016}
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW78451%27 HTTP/1.1" 200 None
2026-03-27 10:35:25 [auto1.de] INFO: Saving data for AW78451: {'auction_closing_time': 1774715192.0, 'created_time': 1773917427.303254, 'last_price_update_time': 1774607725.750209}
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW78451') HTTP/1.1" 204 0
2026-03-27 10:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/33/d133584e32ab31311010e09990a94ca0/pa/DC30039_d0be6c6a33d24b516869598775b09da6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:25 [auto1.de] INFO: Found listing with ID: BD44201
2026-03-27 10:35:25 [auto1.de] INFO: Found listing with ID: SV60739
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV60739%27 HTTP/1.1" 200 None
2026-03-27 10:35:25 [auto1.de] INFO: Scrape type for SV60739: 1
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F3b%252F383b91974caca5b2a78d21f118a302dc%252Fpa%252FVZ21746_9bc3e0fbeae63b10e4a0c97950482c5e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_9bc3e0fbeae63b10e4a0c97950482c5e.jpg not downloaded yet
2026-03-27 10:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_4d449ab612bae0959009c64f92994d2c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:25 [auto1.de] INFO: Found listing with ID: SZ69357
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ69357%27 HTTP/1.1" 200 None
2026-03-27 10:35:25 [auto1.de] INFO: Scrape type for SZ69357: 1
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F3b%252F383b91974caca5b2a78d21f118a302dc%252Fpa%252FVZ21746_65097d6a10aaff17e8bbd2a3a5ca69d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_65097d6a10aaff17e8bbd2a3a5ca69d4.jpg not downloaded yet
2026-03-27 10:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FV94610> (referer: https://www.auto1.com/v1/car-details-view/FV94610/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL79607> (referer: https://www.auto1.com/v1/car-details-view/KL79607/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CK72953> (referer: https://www.auto1.com/v1/car-details-view/CK72953/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SM54936> (referer: https://www.auto1.com/v1/car-details-view/SM54936/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA80690> (referer: https://www.auto1.com/v1/car-details-view/EA80690/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR81409> (referer: https://www.auto1.com/v1/car-details-view/TR81409/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:25 [auto1.de] INFO: Found listing with ID: EN83370
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN83370%27 HTTP/1.1" 200 None
2026-03-27 10:35:25 [auto1.de] INFO: Scrape type for EN83370: 1
2026-03-27 10:35:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-27 10:35:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-27 10:35:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503d84190>
2026-03-27 10:35:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb25c12a-97b7-5649-ac29-b32a9302172d/bb25c12a-97b7-5649-ac29-b32a9302172d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F33%252Fd133584e32ab31311010e09990a94ca0%252Fpa%252FDC30039_d0be6c6a33d24b516869598775b09da6.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/33/d133584e32ab31311010e09990a94ca0/pa/DC30039_d0be6c6a33d24b516869598775b09da6.jpg saved to cache
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb25c12a-97b7-5649-ac29-b32a9302172d
2026-03-27 10:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_d4896dc6cd7de5f1ba6137220c285d6a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017525d0>
2026-03-27 10:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c218447f-2f05-5fb8-b352-abe4d5938aad/c218447f-2f05-5fb8-b352-abe4d5938aad_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7a%252F4d7a76cf71d17ec266e8856f3c6a5e25%252Fpa%252FKV84804_4d449ab612bae0959009c64f92994d2c.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_4d449ab612bae0959009c64f92994d2c.jpg saved to cache
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c218447f-2f05-5fb8-b352-abe4d5938aad
2026-03-27 10:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c019b7c-8204-52b8-bc97-8858d94ee509 with identifier: FV94610
2026-03-27 10:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c019b7c-8204-52b8-bc97-8858d94ee509 with scrape type 1
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c019b7c-8204-52b8-bc97-8858d94ee509
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb4%252F19b40c11ad2459d02f64f9b768dfe164%252Fpa%252FFV94610_7d65e72a7c3796dec073d209d25e2630.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_7d65e72a7c3796dec073d209d25e2630.jpg not downloaded yet
2026-03-27 10:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4cc6305-3dc3-5963-9880-cd5df1c48e9b with identifier: KL79607
2026-03-27 10:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4cc6305-3dc3-5963-9880-cd5df1c48e9b with scrape type 1
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item c4cc6305-3dc3-5963-9880-cd5df1c48e9b
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Ff2%252F80f29e4761941991526616a566c4efe0%252Fpa%252FKL79607_0cd4e29ace29614e5ce809d3da69fa3d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f2/80f29e4761941991526616a566c4efe0/pa/KL79607_0cd4e29ace29614e5ce809d3da69fa3d.jpg not downloaded yet
2026-03-27 10:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f297e0e-9dbb-5272-a8f5-138589e5994b with identifier: CK72953
2026-03-27 10:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f297e0e-9dbb-5272-a8f5-138589e5994b with scrape type 1
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f297e0e-9dbb-5272-a8f5-138589e5994b
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3a%252F2e3a289ec2450be73880f54f88868917%252Fpa%252FCK72953_4701dd1a4ac49ff9304b8f99884fe018.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_4701dd1a4ac49ff9304b8f99884fe018.jpg not downloaded yet
2026-03-27 10:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 659f7e39-f36d-592e-8b4e-18ed268e3373 with identifier: SM54936
2026-03-27 10:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 659f7e39-f36d-592e-8b4e-18ed268e3373 with scrape type 1
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 659f7e39-f36d-592e-8b4e-18ed268e3373
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F79%252Fbf7975b6dfae6143b4d567e572327806%252Fpa%252FSM54936_0977c16f9083cea91bf4facfc64d1a84.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/79/bf7975b6dfae6143b4d567e572327806/pa/SM54936_0977c16f9083cea91bf4facfc64d1a84.jpg not downloaded yet
2026-03-27 10:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4fb6605-c81f-5419-ba64-705d43223fb1 with identifier: EA80690
2026-03-27 10:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4fb6605-c81f-5419-ba64-705d43223fb1 with scrape type 1
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4fb6605-c81f-5419-ba64-705d43223fb1
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fec%252Ffbec04a34a856b304dfe666028957ed8%252Fpa%252FEA80690_b1d82f96d373da37dc6157c397f7a6f4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_b1d82f96d373da37dc6157c397f7a6f4.jpg not downloaded yet
2026-03-27 10:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e57cc188-5e66-5ad7-b6ab-22277c30e36f with identifier: TR81409
2026-03-27 10:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e57cc188-5e66-5ad7-b6ab-22277c30e36f with scrape type 1
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e57cc188-5e66-5ad7-b6ab-22277c30e36f
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F01%252F1c0150e2a1951cd922cee15e1922baba%252Fpa%252FTR81409_0e30f62bc4b4c02c06bbf1f41b4dae8b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/01/1c0150e2a1951cd922cee15e1922baba/pa/TR81409_0e30f62bc4b4c02c06bbf1f41b4dae8b.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb4%252F19b40c11ad2459d02f64f9b768dfe164%252Fpa%252FFV94610_f7bcd9961800aa527543398eeacf439f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_f7bcd9961800aa527543398eeacf439f.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Ff2%252F80f29e4761941991526616a566c4efe0%252Fpa%252FKL79607_3c20511a19b8a27271685adcf7e1396f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f2/80f29e4761941991526616a566c4efe0/pa/KL79607_3c20511a19b8a27271685adcf7e1396f.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3a%252F2e3a289ec2450be73880f54f88868917%252Fpa%252FCK72953_4acf2ffa020cb77a4bed8d40501c448e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_4acf2ffa020cb77a4bed8d40501c448e.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F79%252Fbf7975b6dfae6143b4d567e572327806%252Fpa%252FSM54936_fa56782ec1aab55faa4b261885ce062c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/79/bf7975b6dfae6143b4d567e572327806/pa/SM54936_fa56782ec1aab55faa4b261885ce062c.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fec%252Ffbec04a34a856b304dfe666028957ed8%252Fpa%252FEA80690_b02b6052b0f958729cd528077d20c8c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_b02b6052b0f958729cd528077d20c8c5.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F01%252F1c0150e2a1951cd922cee15e1922baba%252Fpa%252FTR81409_bb827fe9d9682067bfaeeb06a9c375dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/01/1c0150e2a1951cd922cee15e1922baba/pa/TR81409_bb827fe9d9682067bfaeeb06a9c375dd.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb4%252F19b40c11ad2459d02f64f9b768dfe164%252Fpa%252FFV94610_0039ac29e1430091dccc37572fda6924.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_0039ac29e1430091dccc37572fda6924.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Ff2%252F80f29e4761941991526616a566c4efe0%252Fpa%252FKL79607_c743bdff9d0d2956ec8e6fae8375506e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f2/80f29e4761941991526616a566c4efe0/pa/KL79607_c743bdff9d0d2956ec8e6fae8375506e.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3a%252F2e3a289ec2450be73880f54f88868917%252Fpa%252FCK72953_109624e5fec41726f40380a72724bc98.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_109624e5fec41726f40380a72724bc98.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F79%252Fbf7975b6dfae6143b4d567e572327806%252Fpa%252FSM54936_09b81ba6c7e5b707dbd19f56b96af6af.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/79/bf7975b6dfae6143b4d567e572327806/pa/SM54936_09b81ba6c7e5b707dbd19f56b96af6af.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fec%252Ffbec04a34a856b304dfe666028957ed8%252Fpa%252FEA80690_5ffcc93086260dcf36eb2fc38386baf6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_5ffcc93086260dcf36eb2fc38386baf6.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F01%252F1c0150e2a1951cd922cee15e1922baba%252Fpa%252FTR81409_769aa99b02ff17a61e9215fc01f71ff4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/01/1c0150e2a1951cd922cee15e1922baba/pa/TR81409_769aa99b02ff17a61e9215fc01f71ff4.jpg not downloaded yet
2026-03-27 10:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004edb50>
2026-03-27 10:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c325213c-98d7-5b02-b0dd-1fcc571aa207/c325213c-98d7-5b02-b0dd-1fcc571aa207_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F3b%252F383b91974caca5b2a78d21f118a302dc%252Fpa%252FVZ21746_d4896dc6cd7de5f1ba6137220c285d6a.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_d4896dc6cd7de5f1ba6137220c285d6a.jpg saved to cache
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c325213c-98d7-5b02-b0dd-1fcc571aa207
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb4%252F19b40c11ad2459d02f64f9b768dfe164%252Fpa%252FFV94610_5cb160a51ea272a26d57d86ddb9bd163.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_5cb160a51ea272a26d57d86ddb9bd163.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Ff2%252F80f29e4761941991526616a566c4efe0%252Fpa%252FKL79607_74040746e8c86b17568e4b6acfe2ae98.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f2/80f29e4761941991526616a566c4efe0/pa/KL79607_74040746e8c86b17568e4b6acfe2ae98.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3a%252F2e3a289ec2450be73880f54f88868917%252Fpa%252FCK72953_4430a97ff2da6479b0feb6a2385668f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_4430a97ff2da6479b0feb6a2385668f8.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F79%252Fbf7975b6dfae6143b4d567e572327806%252Fpa%252FSM54936_8680f85e904fe21978586965e1574225.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/79/bf7975b6dfae6143b4d567e572327806/pa/SM54936_8680f85e904fe21978586965e1574225.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fec%252Ffbec04a34a856b304dfe666028957ed8%252Fpa%252FEA80690_0018c5975011af585804446d20386352.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_0018c5975011af585804446d20386352.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F01%252F1c0150e2a1951cd922cee15e1922baba%252Fpa%252FTR81409_5641266397bf3d61fe8fbf0b81b80ea9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/01/1c0150e2a1951cd922cee15e1922baba/pa/TR81409_5641266397bf3d61fe8fbf0b81b80ea9.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb4%252F19b40c11ad2459d02f64f9b768dfe164%252Fpa%252FFV94610_9874580cace6170ecaaf4612af1abcc5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_9874580cace6170ecaaf4612af1abcc5.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Ff2%252F80f29e4761941991526616a566c4efe0%252Fpa%252FKL79607_e782abba63f8b113c67eadd3ebbd641a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f2/80f29e4761941991526616a566c4efe0/pa/KL79607_e782abba63f8b113c67eadd3ebbd641a.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3a%252F2e3a289ec2450be73880f54f88868917%252Fpa%252FCK72953_ceac36d427c4cb339f1ab46185b71376.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_ceac36d427c4cb339f1ab46185b71376.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F79%252Fbf7975b6dfae6143b4d567e572327806%252Fpa%252FSM54936_9b999e9635df65d41ad5a3028f6077cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/79/bf7975b6dfae6143b4d567e572327806/pa/SM54936_9b999e9635df65d41ad5a3028f6077cc.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fec%252Ffbec04a34a856b304dfe666028957ed8%252Fpa%252FEA80690_1849962cee8a435ec4c630aea28e4ed6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_1849962cee8a435ec4c630aea28e4ed6.jpg not downloaded yet
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F01%252F1c0150e2a1951cd922cee15e1922baba%252Fpa%252FTR81409_6e22d14f4487d08d488d1cfd747e505f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/01/1c0150e2a1951cd922cee15e1922baba/pa/TR81409_6e22d14f4487d08d488d1cfd747e505f.jpg not downloaded yet
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb4%252F19b40c11ad2459d02f64f9b768dfe164%252Fpa%252FFV94610_b4992e6248db243a60cd028ae9fe5c7a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_b4992e6248db243a60cd028ae9fe5c7a.jpg not downloaded yet
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3a%252F2e3a289ec2450be73880f54f88868917%252Fpa%252FCK72953_20bf217e56ee54158e9961e7f6fb4632.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_20bf217e56ee54158e9961e7f6fb4632.jpg not downloaded yet
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fec%252Ffbec04a34a856b304dfe666028957ed8%252Fpa%252FEA80690_985502ff0c6ae8518f9619b5249c02a4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_985502ff0c6ae8518f9619b5249c02a4.jpg not downloaded yet
2026-03-27 10:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_65097d6a10aaff17e8bbd2a3a5ca69d4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VM88505/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_9bc3e0fbeae63b10e4a0c97950482c5e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb4%252F19b40c11ad2459d02f64f9b768dfe164%252Fpa%252FFV94610_2234f9c857376ddaa1191d2b9c632407.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_2234f9c857376ddaa1191d2b9c632407.jpg not downloaded yet
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3a%252F2e3a289ec2450be73880f54f88868917%252Fpa%252FCK72953_b5acd947dcb2d860c09209a971fddf5b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_b5acd947dcb2d860c09209a971fddf5b.jpg not downloaded yet
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fec%252Ffbec04a34a856b304dfe666028957ed8%252Fpa%252FEA80690_0da8a250973466bcb30b74b3b8d948da.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_0da8a250973466bcb30b74b3b8d948da.jpg not downloaded yet
2026-03-27 10:35:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN83173/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb4%252F19b40c11ad2459d02f64f9b768dfe164%252Fpa%252FFV94610_5c56ba55901d32d343a4cfd9a1f9afc4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_5c56ba55901d32d343a4cfd9a1f9afc4.jpg not downloaded yet
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3a%252F2e3a289ec2450be73880f54f88868917%252Fpa%252FCK72953_2e9d83bfcf5dfc76862f993898d9db07.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_2e9d83bfcf5dfc76862f993898d9db07.jpg not downloaded yet
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fec%252Ffbec04a34a856b304dfe666028957ed8%252Fpa%252FEA80690_92c0b5662ba96bcfce5bc092ed8bf955.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_92c0b5662ba96bcfce5bc092ed8bf955.jpg not downloaded yet
2026-03-27 10:35:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VH10355/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb4%252F19b40c11ad2459d02f64f9b768dfe164%252Fpa%252FFV94610_65619fbd325bd330821d3d09d532acfd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_65619fbd325bd330821d3d09d532acfd.jpg not downloaded yet
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3a%252F2e3a289ec2450be73880f54f88868917%252Fpa%252FCK72953_c5f1bbade8b6235e7752fa29dfa7551e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_c5f1bbade8b6235e7752fa29dfa7551e.jpg not downloaded yet
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fec%252Ffbec04a34a856b304dfe666028957ed8%252Fpa%252FEA80690_1b6161d29b486810db4f004a5574fcad.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_1b6161d29b486810db4f004a5574fcad.jpg not downloaded yet
2026-03-27 10:35:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV13508/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501766f50>
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c325213c-98d7-5b02-b0dd-1fcc571aa207/c325213c-98d7-5b02-b0dd-1fcc571aa207_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F3b%252F383b91974caca5b2a78d21f118a302dc%252Fpa%252FVZ21746_65097d6a10aaff17e8bbd2a3a5ca69d4.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_65097d6a10aaff17e8bbd2a3a5ca69d4.jpg saved to cache
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c325213c-98d7-5b02-b0dd-1fcc571aa207
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016f6910>
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c325213c-98d7-5b02-b0dd-1fcc571aa207/c325213c-98d7-5b02-b0dd-1fcc571aa207_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F3b%252F383b91974caca5b2a78d21f118a302dc%252Fpa%252FVZ21746_9bc3e0fbeae63b10e4a0c97950482c5e.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_9bc3e0fbeae63b10e4a0c97950482c5e.jpg saved to cache
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c325213c-98d7-5b02-b0dd-1fcc571aa207
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb4%252F19b40c11ad2459d02f64f9b768dfe164%252Fpa%252FFV94610_2d9554323ae3156bd9fa5a30864fe8fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_2d9554323ae3156bd9fa5a30864fe8fa.jpg not downloaded yet
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3a%252F2e3a289ec2450be73880f54f88868917%252Fpa%252FCK72953_c6cd7428d1c36f83b317fe79951fb07c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_c6cd7428d1c36f83b317fe79951fb07c.jpg not downloaded yet
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fec%252Ffbec04a34a856b304dfe666028957ed8%252Fpa%252FEA80690_aecb7d081391805d89abba955e64abf3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_aecb7d081391805d89abba955e64abf3.jpg not downloaded yet
2026-03-27 10:35:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_20bf217e56ee54158e9961e7f6fb4632.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/01/1c0150e2a1951cd922cee15e1922baba/pa/TR81409_6e22d14f4487d08d488d1cfd747e505f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_9a6affea61516b6dd6cf3d8d4fafbfd9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_698fc9a55e03743af0dcfa76ae10627b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_985502ff0c6ae8518f9619b5249c02a4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BX52233> (referer: https://www.auto1.com/v1/car-details-view/BX52233/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501840910>
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f297e0e-9dbb-5272-a8f5-138589e5994b/2f297e0e-9dbb-5272-a8f5-138589e5994b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3a%252F2e3a289ec2450be73880f54f88868917%252Fpa%252FCK72953_20bf217e56ee54158e9961e7f6fb4632.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_20bf217e56ee54158e9961e7f6fb4632.jpg saved to cache
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2f297e0e-9dbb-5272-a8f5-138589e5994b
2026-03-27 10:35:27 [auto1.de] INFO: Channel: 24h | Page: 3 | totalHits: 10493 | hits on page: 40
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019453d0>
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e57cc188-5e66-5ad7-b6ab-22277c30e36f/e57cc188-5e66-5ad7-b6ab-22277c30e36f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F01%252F1c0150e2a1951cd922cee15e1922baba%252Fpa%252FTR81409_6e22d14f4487d08d488d1cfd747e505f.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/01/1c0150e2a1951cd922cee15e1922baba/pa/TR81409_6e22d14f4487d08d488d1cfd747e505f.jpg saved to cache
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e57cc188-5e66-5ad7-b6ab-22277c30e36f
2026-03-27 10:35:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501616e50>
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c325213c-98d7-5b02-b0dd-1fcc571aa207/c325213c-98d7-5b02-b0dd-1fcc571aa207_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F3b%252F383b91974caca5b2a78d21f118a302dc%252Fpa%252FVZ21746_9a6affea61516b6dd6cf3d8d4fafbfd9.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_9a6affea61516b6dd6cf3d8d4fafbfd9.jpg saved to cache
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c325213c-98d7-5b02-b0dd-1fcc571aa207
2026-03-27 10:35:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501872190>
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c218447f-2f05-5fb8-b352-abe4d5938aad/c218447f-2f05-5fb8-b352-abe4d5938aad_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7a%252F4d7a76cf71d17ec266e8856f3c6a5e25%252Fpa%252FKV84804_698fc9a55e03743af0dcfa76ae10627b.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_698fc9a55e03743af0dcfa76ae10627b.jpg saved to cache
2026-03-27 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c218447f-2f05-5fb8-b352-abe4d5938aad
2026-03-27 10:35:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018953d0>
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4fb6605-c81f-5419-ba64-705d43223fb1/e4fb6605-c81f-5419-ba64-705d43223fb1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fec%252Ffbec04a34a856b304dfe666028957ed8%252Fpa%252FEA80690_985502ff0c6ae8518f9619b5249c02a4.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_985502ff0c6ae8518f9619b5249c02a4.jpg saved to cache
2026-03-27 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4fb6605-c81f-5419-ba64-705d43223fb1
2026-03-27 10:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63a13579-1684-5820-a755-629853006931 with identifier: BX52233
2026-03-27 10:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63a13579-1684-5820-a755-629853006931 with scrape type 1
2026-03-27 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 63a13579-1684-5820-a755-629853006931
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F8e%252F988e53ac85628113ed3bbf4d01a32efc%252Fpa%252FBX52233_1ba1b12cfe3f46f1676e0df154d4cf45.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/8e/988e53ac85628113ed3bbf4d01a32efc/pa/BX52233_1ba1b12cfe3f46f1676e0df154d4cf45.jpg not downloaded yet
2026-03-27 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_1b6161d29b486810db4f004a5574fcad.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:28 [auto1.de] INFO: Found listing with ID: YU03537
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU03537%27 HTTP/1.1" 200 None
2026-03-27 10:35:28 [auto1.de] INFO: Scrape type for YU03537: 1
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F8e%252F988e53ac85628113ed3bbf4d01a32efc%252Fpa%252FBX52233_cc4cda057f327a4946fc14a8786eaedc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/8e/988e53ac85628113ed3bbf4d01a32efc/pa/BX52233_cc4cda057f327a4946fc14a8786eaedc.jpg not downloaded yet
2026-03-27 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_aecb7d081391805d89abba955e64abf3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:28 [auto1.de] INFO: Found listing with ID: NG01563
2026-03-27 10:35:28 [auto1.de] INFO: Found listing with ID: NB27251
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB27251%27 HTTP/1.1" 200 None
2026-03-27 10:35:28 [auto1.de] INFO: Scrape type for NB27251: 2
2026-03-27 10:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e49f55e-218f-56a0-bab7-cb2796f14128 with identifier: NB27251
2026-03-27 10:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e49f55e-218f-56a0-bab7-cb2796f14128 with scrape type 2
2026-03-27 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e49f55e-218f-56a0-bab7-cb2796f14128 with scrape type 2
2026-03-27 10:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e49f55e-218f-56a0-bab7-cb2796f14128, identifier: NB27251
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F8e%252F988e53ac85628113ed3bbf4d01a32efc%252Fpa%252FBX52233_f086d3ba9d13df3ebd18ca7e9b39c7e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/8e/988e53ac85628113ed3bbf4d01a32efc/pa/BX52233_f086d3ba9d13df3ebd18ca7e9b39c7e2.jpg not downloaded yet
2026-03-27 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SZ69357/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e49f55e-218f-56a0-bab7-cb2796f14128 with identifier: NB27251
2026-03-27 10:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e49f55e-218f-56a0-bab7-cb2796f14128 with identifier: NB27251
2026-03-27 10:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e49f55e-218f-56a0-bab7-cb2796f14128 with identifier: NB27251 to the API
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 398,
 'expiration_date': '2026-03-28T16:33:48Z',
 'fuel_type': 'petrol',
 'id': '3e49f55e-218f-56a0-bab7-cb2796f14128',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB27251',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 18642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-06-22',
 'seller_name': None,
 'title': 'BMW X3 M50 Mild-Hybrid M Performance xDrive',
 'transmission': 'automatic',
 'trim': 'M Performance xDrive',
 'year': 2025}
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB27251%27 HTTP/1.1" 200 None
2026-03-27 10:35:28 [auto1.de] INFO: Saving data for NB27251: {'auction_closing_time': 1774715628.0, 'created_time': 1773917434.791458, 'last_price_update_time': 1774607728.780858}
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB27251') HTTP/1.1" 204 0
2026-03-27 10:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:28 [auto1.de] INFO: Found listing with ID: XX11179
2026-03-27 10:35:28 [auto1.de] INFO: Found listing with ID: YP91741
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP91741%27 HTTP/1.1" 200 None
2026-03-27 10:35:28 [auto1.de] INFO: Scrape type for YP91741: 1
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F8e%252F988e53ac85628113ed3bbf4d01a32efc%252Fpa%252FBX52233_f426a048b6fac3132595b20f39f0d482.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/8e/988e53ac85628113ed3bbf4d01a32efc/pa/BX52233_f426a048b6fac3132595b20f39f0d482.jpg not downloaded yet
2026-03-27 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV60739/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:28 [auto1.de] INFO: Found listing with ID: LS95970
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS95970%27 HTTP/1.1" 200 None
2026-03-27 10:35:28 [auto1.de] INFO: Scrape type for LS95970: 1
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F8e%252F988e53ac85628113ed3bbf4d01a32efc%252Fpa%252FBX52233_18b720404f3771bd0e7fd18664abb7f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/8e/988e53ac85628113ed3bbf4d01a32efc/pa/BX52233_18b720404f3771bd0e7fd18664abb7f1.jpg not downloaded yet
2026-03-27 10:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG80154/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501895dd0>
2026-03-27 10:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4fb6605-c81f-5419-ba64-705d43223fb1/e4fb6605-c81f-5419-ba64-705d43223fb1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fec%252Ffbec04a34a856b304dfe666028957ed8%252Fpa%252FEA80690_1b6161d29b486810db4f004a5574fcad.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_1b6161d29b486810db4f004a5574fcad.jpg saved to cache
2026-03-27 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e4fb6605-c81f-5419-ba64-705d43223fb1
2026-03-27 10:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017d7450>
2026-03-27 10:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4fb6605-c81f-5419-ba64-705d43223fb1/e4fb6605-c81f-5419-ba64-705d43223fb1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fec%252Ffbec04a34a856b304dfe666028957ed8%252Fpa%252FEA80690_aecb7d081391805d89abba955e64abf3.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_aecb7d081391805d89abba955e64abf3.jpg saved to cache
2026-03-27 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e4fb6605-c81f-5419-ba64-705d43223fb1
2026-03-27 10:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:28 [auto1.de] INFO: Found listing with ID: ML63417
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML63417%27 HTTP/1.1" 200 None
2026-03-27 10:35:28 [auto1.de] INFO: Scrape type for ML63417: 1
2026-03-27 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/8e/988e53ac85628113ed3bbf4d01a32efc/pa/BX52233_1ba1b12cfe3f46f1676e0df154d4cf45.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/8e/988e53ac85628113ed3bbf4d01a32efc/pa/BX52233_cc4cda057f327a4946fc14a8786eaedc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:29 [auto1.de] INFO: Found listing with ID: HK63697
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK63697%27 HTTP/1.1" 200 None
2026-03-27 10:35:29 [auto1.de] INFO: Scrape type for HK63697: 1
2026-03-27 10:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/8e/988e53ac85628113ed3bbf4d01a32efc/pa/BX52233_f426a048b6fac3132595b20f39f0d482.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:29 [auto1.de] INFO: Found listing with ID: ZB26924
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB26924%27 HTTP/1.1" 200 None
2026-03-27 10:35:29 [auto1.de] INFO: Scrape type for ZB26924: 2
2026-03-27 10:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 592720dc-d255-5ef9-9ad6-0d05d74c0385 with identifier: ZB26924
2026-03-27 10:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 592720dc-d255-5ef9-9ad6-0d05d74c0385 with scrape type 2
2026-03-27 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 592720dc-d255-5ef9-9ad6-0d05d74c0385 with scrape type 2
2026-03-27 10:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 592720dc-d255-5ef9-9ad6-0d05d74c0385, identifier: ZB26924
2026-03-27 10:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 592720dc-d255-5ef9-9ad6-0d05d74c0385 with identifier: ZB26924
2026-03-27 10:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 592720dc-d255-5ef9-9ad6-0d05d74c0385 with identifier: ZB26924
2026-03-27 10:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 592720dc-d255-5ef9-9ad6-0d05d74c0385 with identifier: ZB26924 to the API
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:19:59Z',
 'fuel_type': 'diesel',
 'id': '592720dc-d255-5ef9-9ad6-0d05d74c0385',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB26924',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 184222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-01',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB26924%27 HTTP/1.1" 200 None
2026-03-27 10:35:29 [auto1.de] INFO: Saving data for ZB26924: {'auction_closing_time': 1774714799.0, 'created_time': 1773304552.381397, 'last_price_update_time': 1774607729.565373}
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB26924') HTTP/1.1" 204 0
2026-03-27 10:35:29 [auto1.de] INFO: Found listing with ID: AN46464
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN46464%27 HTTP/1.1" 200 None
2026-03-27 10:35:29 [auto1.de] INFO: Scrape type for AN46464: 1
2026-03-27 10:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RV26500> (referer: https://www.auto1.com/v1/car-details-view/RV26500/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:29 [auto1.de] INFO: Found listing with ID: AU27688
2026-03-27 10:35:29 [auto1.de] INFO: Found listing with ID: RM96597
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM96597%27 HTTP/1.1" 200 None
2026-03-27 10:35:29 [auto1.de] INFO: Scrape type for RM96597: 1
2026-03-27 10:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501694d50>
2026-03-27 10:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63a13579-1684-5820-a755-629853006931/63a13579-1684-5820-a755-629853006931_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F8e%252F988e53ac85628113ed3bbf4d01a32efc%252Fpa%252FBX52233_1ba1b12cfe3f46f1676e0df154d4cf45.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/8e/988e53ac85628113ed3bbf4d01a32efc/pa/BX52233_1ba1b12cfe3f46f1676e0df154d4cf45.jpg saved to cache
2026-03-27 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63a13579-1684-5820-a755-629853006931
2026-03-27 10:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019b1f90>
2026-03-27 10:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63a13579-1684-5820-a755-629853006931/63a13579-1684-5820-a755-629853006931_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F8e%252F988e53ac85628113ed3bbf4d01a32efc%252Fpa%252FBX52233_cc4cda057f327a4946fc14a8786eaedc.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/8e/988e53ac85628113ed3bbf4d01a32efc/pa/BX52233_cc4cda057f327a4946fc14a8786eaedc.jpg saved to cache
2026-03-27 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63a13579-1684-5820-a755-629853006931
2026-03-27 10:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015d0750>
2026-03-27 10:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63a13579-1684-5820-a755-629853006931/63a13579-1684-5820-a755-629853006931_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F8e%252F988e53ac85628113ed3bbf4d01a32efc%252Fpa%252FBX52233_f426a048b6fac3132595b20f39f0d482.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/8e/988e53ac85628113ed3bbf4d01a32efc/pa/BX52233_f426a048b6fac3132595b20f39f0d482.jpg saved to cache
2026-03-27 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63a13579-1684-5820-a755-629853006931
2026-03-27 10:35:29 [auto1.de] INFO: Found listing with ID: JU23189
2026-03-27 10:35:29 [auto1.de] INFO: Found listing with ID: LW83066
2026-03-27 10:35:29 [auto1.de] INFO: Found listing with ID: LX68947
2026-03-27 10:35:29 [auto1.de] INFO: Found listing with ID: CT44889
2026-03-27 10:35:29 [auto1.de] INFO: Found listing with ID: LN38152
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN38152%27 HTTP/1.1" 200 None
2026-03-27 10:35:29 [auto1.de] INFO: Scrape type for LN38152: 2
2026-03-27 10:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7 with identifier: LN38152
2026-03-27 10:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7 with scrape type 2
2026-03-27 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7 with scrape type 2
2026-03-27 10:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7, identifier: LN38152
2026-03-27 10:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7 with identifier: LN38152
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-27 10:35:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7 with identifier: LN38152
2026-03-27 10:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7 with identifier: LN38152 to the API
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:22:36Z',
 'fuel_type': 'petrol',
 'id': 'c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN38152',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 110118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-28',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN38152%27 HTTP/1.1" 200 None
2026-03-27 10:35:30 [auto1.de] INFO: Saving data for LN38152: {'auction_closing_time': 1774714956.0, 'created_time': 1773229484.027555, 'last_price_update_time': 1774607730.580608}
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN38152') HTTP/1.1" 204 0
2026-03-27 10:35:30 [auto1.de] INFO: Found listing with ID: GS69685
2026-03-27 10:35:30 [auto1.de] INFO: Found listing with ID: AE12757
2026-03-27 10:35:30 [auto1.de] INFO: Found listing with ID: ZE90376
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE90376%27 HTTP/1.1" 200 None
2026-03-27 10:35:30 [auto1.de] INFO: Scrape type for ZE90376: 2
2026-03-27 10:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aac36263-1b24-5c0a-8dc9-5ff1b48eef21 with identifier: ZE90376
2026-03-27 10:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aac36263-1b24-5c0a-8dc9-5ff1b48eef21 with scrape type 2
2026-03-27 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aac36263-1b24-5c0a-8dc9-5ff1b48eef21 with scrape type 2
2026-03-27 10:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aac36263-1b24-5c0a-8dc9-5ff1b48eef21, identifier: ZE90376
2026-03-27 10:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aac36263-1b24-5c0a-8dc9-5ff1b48eef21 with identifier: ZE90376
2026-03-27 10:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aac36263-1b24-5c0a-8dc9-5ff1b48eef21 with identifier: ZE90376
2026-03-27 10:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aac36263-1b24-5c0a-8dc9-5ff1b48eef21 with identifier: ZE90376 to the API
2026-03-27 10:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:52:03Z',
 'fuel_type': 'petrol',
 'id': 'aac36263-1b24-5c0a-8dc9-5ff1b48eef21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE90376',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 13000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-13',
 'seller_name': None,
 'title': 'Skoda Karoq 2.0 TSI Sportline 4x4',
 'transmission': 'automatic',
 'trim': 'Sportline 4x4',
 'year': 2024}
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE90376%27 HTTP/1.1" 200 None
2026-03-27 10:35:31 [auto1.de] INFO: Saving data for ZE90376: {'auction_closing_time': 1774716723.0, 'created_time': 1772728480.041797, 'last_price_update_time': 1774607731.416579}
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE90376') HTTP/1.1" 204 0
2026-03-27 10:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3f8f6a2-a744-5295-96bd-003625d9e42d with identifier: RV26500
2026-03-27 10:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3f8f6a2-a744-5295-96bd-003625d9e42d with scrape type 1
2026-03-27 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3f8f6a2-a744-5295-96bd-003625d9e42d
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ff2%252F05f24be41fcea8f3c63150c2a7318649%252Fpa%252FRV26500_3e562740a5c0809ba366bbb45244880e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_3e562740a5c0809ba366bbb45244880e.jpg not downloaded yet
2026-03-27 10:35:31 [auto1.de] INFO: Found listing with ID: TS36559
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS36559%27 HTTP/1.1" 200 None
2026-03-27 10:35:31 [auto1.de] INFO: Scrape type for TS36559: 1
2026-03-27 10:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN83173> (referer: https://www.auto1.com/v1/car-details-view/BN83173/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ff2%252F05f24be41fcea8f3c63150c2a7318649%252Fpa%252FRV26500_eb7b83e7d8e53ec290336ea3418b8d06.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_eb7b83e7d8e53ec290336ea3418b8d06.jpg not downloaded yet
2026-03-27 10:35:31 [auto1.de] INFO: Found listing with ID: EU51889
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU51889%27 HTTP/1.1" 200 None
2026-03-27 10:35:31 [auto1.de] INFO: Scrape type for EU51889: 1
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ff2%252F05f24be41fcea8f3c63150c2a7318649%252Fpa%252FRV26500_9d10e07a8e6f5122ef5e1e10c2cec3a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_9d10e07a8e6f5122ef5e1e10c2cec3a5.jpg not downloaded yet
2026-03-27 10:35:31 [auto1.de] INFO: Found listing with ID: AU97195
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97195%27 HTTP/1.1" 200 None
2026-03-27 10:35:31 [auto1.de] INFO: Scrape type for AU97195: 1
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ff2%252F05f24be41fcea8f3c63150c2a7318649%252Fpa%252FRV26500_15f47a61748000ebd44f342ec2f6bc79.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_15f47a61748000ebd44f342ec2f6bc79.jpg not downloaded yet
2026-03-27 10:35:31 [auto1.de] INFO: Found listing with ID: NC61336
2026-03-27 10:35:31 [auto1.de] INFO: Found listing with ID: FZ16195
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ16195%27 HTTP/1.1" 200 None
2026-03-27 10:35:31 [auto1.de] INFO: Scrape type for FZ16195: 1
2026-03-27 10:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_3e562740a5c0809ba366bbb45244880e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ff2%252F05f24be41fcea8f3c63150c2a7318649%252Fpa%252FRV26500_2681236a6f6a62258067cee47170fe4b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_2681236a6f6a62258067cee47170fe4b.jpg not downloaded yet
2026-03-27 10:35:31 [auto1.de] INFO: Found listing with ID: BP38143
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP38143%27 HTTP/1.1" 200 None
2026-03-27 10:35:31 [auto1.de] INFO: Scrape type for BP38143: 2
2026-03-27 10:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec4c00af-b029-594d-889c-17500baaea76 with identifier: BP38143
2026-03-27 10:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec4c00af-b029-594d-889c-17500baaea76 with scrape type 2
2026-03-27 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec4c00af-b029-594d-889c-17500baaea76 with scrape type 2
2026-03-27 10:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec4c00af-b029-594d-889c-17500baaea76, identifier: BP38143
2026-03-27 10:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8 with identifier: BN83173
2026-03-27 10:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8 with scrape type 1
2026-03-27 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fa9%252F99a95f42f97b7ce5bfcb25dfa4efaafb%252Fpa%252FBN83173_c370f1a44d0ef6c7c1fdf0b7a8c4ab13.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/a9/99a95f42f97b7ce5bfcb25dfa4efaafb/pa/BN83173_c370f1a44d0ef6c7c1fdf0b7a8c4ab13.jpg not downloaded yet
2026-03-27 10:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec4c00af-b029-594d-889c-17500baaea76 with identifier: BP38143
2026-03-27 10:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec4c00af-b029-594d-889c-17500baaea76 with identifier: BP38143
2026-03-27 10:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec4c00af-b029-594d-889c-17500baaea76 with identifier: BP38143 to the API
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:30:44Z',
 'fuel_type': 'petrol',
 'id': 'ec4c00af-b029-594d-889c-17500baaea76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP38143',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 72173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-30',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2016}
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP38143%27 HTTP/1.1" 200 None
2026-03-27 10:35:32 [auto1.de] INFO: Saving data for BP38143: {'auction_closing_time': 1774715444.0, 'created_time': 1773138586.995264, 'last_price_update_time': 1774607732.339427}
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP38143') HTTP/1.1" 204 0
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ff2%252F05f24be41fcea8f3c63150c2a7318649%252Fpa%252FRV26500_9f2ae5930e8e2cb839087a21539770d1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_9f2ae5930e8e2cb839087a21539770d1.jpg not downloaded yet
2026-03-27 10:35:32 [auto1.de] INFO: Found listing with ID: HV64790
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV64790%27 HTTP/1.1" 200 None
2026-03-27 10:35:32 [auto1.de] INFO: Scrape type for HV64790: 1
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fa9%252F99a95f42f97b7ce5bfcb25dfa4efaafb%252Fpa%252FBN83173_b7bb44c48bcf63976c5357751c72dcc6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/a9/99a95f42f97b7ce5bfcb25dfa4efaafb/pa/BN83173_b7bb44c48bcf63976c5357751c72dcc6.jpg not downloaded yet
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ff2%252F05f24be41fcea8f3c63150c2a7318649%252Fpa%252FRV26500_fe4d456df60717b0f50e6f2cf5d1cd78.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_fe4d456df60717b0f50e6f2cf5d1cd78.jpg not downloaded yet
2026-03-27 10:35:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501633490>
2026-03-27 10:35:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3f8f6a2-a744-5295-96bd-003625d9e42d/d3f8f6a2-a744-5295-96bd-003625d9e42d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ff2%252F05f24be41fcea8f3c63150c2a7318649%252Fpa%252FRV26500_3e562740a5c0809ba366bbb45244880e.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_3e562740a5c0809ba366bbb45244880e.jpg saved to cache
2026-03-27 10:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3f8f6a2-a744-5295-96bd-003625d9e42d
2026-03-27 10:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_92c0b5662ba96bcfce5bc092ed8bf955.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:32 [auto1.de] INFO: Found listing with ID: BT35414
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT35414%27 HTTP/1.1" 200 None
2026-03-27 10:35:32 [auto1.de] INFO: Scrape type for BT35414: 1
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fa9%252F99a95f42f97b7ce5bfcb25dfa4efaafb%252Fpa%252FBN83173_0eb825d2e626eb09f590eec20bdf7368.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/a9/99a95f42f97b7ce5bfcb25dfa4efaafb/pa/BN83173_0eb825d2e626eb09f590eec20bdf7368.jpg not downloaded yet
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ff2%252F05f24be41fcea8f3c63150c2a7318649%252Fpa%252FRV26500_9babface7c4d27f7923a01f2179b05f9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_9babface7c4d27f7923a01f2179b05f9.jpg not downloaded yet
2026-03-27 10:35:32 [auto1.de] INFO: Found listing with ID: TT67708
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67708%27 HTTP/1.1" 200 None
2026-03-27 10:35:32 [auto1.de] INFO: Scrape type for TT67708: 2
2026-03-27 10:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5e2a440-ab5f-5aac-b6b5-b1a3aa158d29 with identifier: TT67708
2026-03-27 10:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5e2a440-ab5f-5aac-b6b5-b1a3aa158d29 with scrape type 2
2026-03-27 10:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5e2a440-ab5f-5aac-b6b5-b1a3aa158d29 with scrape type 2
2026-03-27 10:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5e2a440-ab5f-5aac-b6b5-b1a3aa158d29, identifier: TT67708
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fa9%252F99a95f42f97b7ce5bfcb25dfa4efaafb%252Fpa%252FBN83173_265c8a35995834300072f3b6fa216e30.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/a9/99a95f42f97b7ce5bfcb25dfa4efaafb/pa/BN83173_265c8a35995834300072f3b6fa216e30.jpg not downloaded yet
2026-03-27 10:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5e2a440-ab5f-5aac-b6b5-b1a3aa158d29 with identifier: TT67708
2026-03-27 10:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5e2a440-ab5f-5aac-b6b5-b1a3aa158d29 with identifier: TT67708
2026-03-27 10:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5e2a440-ab5f-5aac-b6b5-b1a3aa158d29 with identifier: TT67708 to the API
2026-03-27 10:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:33:43Z',
 'fuel_type': 'petrol',
 'id': 'd5e2a440-ab5f-5aac-b6b5-b1a3aa158d29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT67708',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 146568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-03',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2011}
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67708%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [auto1.de] INFO: Saving data for TT67708: {'auction_closing_time': 1774715623.0, 'created_time': 1773380656.297527, 'last_price_update_time': 1774607733.130296}
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT67708') HTTP/1.1" 204 0
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ff2%252F05f24be41fcea8f3c63150c2a7318649%252Fpa%252FRV26500_0bbc92ffeeedede21b42a8967fd52256.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_0bbc92ffeeedede21b42a8967fd52256.jpg not downloaded yet
2026-03-27 10:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_0da8a250973466bcb30b74b3b8d948da.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:33 [auto1.de] INFO: Found listing with ID: BY27711
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY27711%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [auto1.de] INFO: Scrape type for BY27711: 1
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fa9%252F99a95f42f97b7ce5bfcb25dfa4efaafb%252Fpa%252FBN83173_f0003cc52c7eba1eeb22c3967403f7df.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/a9/99a95f42f97b7ce5bfcb25dfa4efaafb/pa/BN83173_f0003cc52c7eba1eeb22c3967403f7df.jpg not downloaded yet
2026-03-27 10:35:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501872490>
2026-03-27 10:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4fb6605-c81f-5419-ba64-705d43223fb1/e4fb6605-c81f-5419-ba64-705d43223fb1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fec%252Ffbec04a34a856b304dfe666028957ed8%252Fpa%252FEA80690_92c0b5662ba96bcfce5bc092ed8bf955.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_92c0b5662ba96bcfce5bc092ed8bf955.jpg saved to cache
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e4fb6605-c81f-5419-ba64-705d43223fb1
2026-03-27 10:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_fe4d456df60717b0f50e6f2cf5d1cd78.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ff2%252F05f24be41fcea8f3c63150c2a7318649%252Fpa%252FRV26500_d9451871306c935d2d610a66b8aa4087.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_d9451871306c935d2d610a66b8aa4087.jpg not downloaded yet
2026-03-27 10:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_c6cd7428d1c36f83b317fe79951fb07c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:33 [auto1.de] INFO: Found listing with ID: UZ82929
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ82929%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [auto1.de] INFO: Scrape type for UZ82929: 1
2026-03-27 10:35:33 [auto1.de] INFO: Found listing with ID: NE15652
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE15652%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [auto1.de] INFO: Scrape type for NE15652: 1
2026-03-27 10:35:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501631190>
2026-03-27 10:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4fb6605-c81f-5419-ba64-705d43223fb1/e4fb6605-c81f-5419-ba64-705d43223fb1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fec%252Ffbec04a34a856b304dfe666028957ed8%252Fpa%252FEA80690_0da8a250973466bcb30b74b3b8d948da.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_0da8a250973466bcb30b74b3b8d948da.jpg saved to cache
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e4fb6605-c81f-5419-ba64-705d43223fb1
2026-03-27 10:35:33 [auto1.de] INFO: Found listing with ID: EC33750
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33750%27 HTTP/1.1" 200 None
2026-03-27 10:35:33 [auto1.de] INFO: Scrape type for EC33750: 2
2026-03-27 10:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f15e52c7-f347-5b54-90a2-8994327b9a7d with identifier: EC33750
2026-03-27 10:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f15e52c7-f347-5b54-90a2-8994327b9a7d with scrape type 2
2026-03-27 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f15e52c7-f347-5b54-90a2-8994327b9a7d with scrape type 2
2026-03-27 10:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f15e52c7-f347-5b54-90a2-8994327b9a7d, identifier: EC33750
2026-03-27 10:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f15e52c7-f347-5b54-90a2-8994327b9a7d with identifier: EC33750
2026-03-27 10:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f15e52c7-f347-5b54-90a2-8994327b9a7d with identifier: EC33750
2026-03-27 10:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f15e52c7-f347-5b54-90a2-8994327b9a7d with identifier: EC33750 to the API
2026-03-27 10:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:52:22Z',
 'fuel_type': 'diesel',
 'id': 'f15e52c7-f347-5b54-90a2-8994327b9a7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC33750',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 149514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-14',
 'seller_name': None,
 'title': 'Mitsubishi ASX 2.2 DI-D Edition 100+ 4WD',
 'transmission': 'automatic',
 'trim': 'Edition 100+ 4WD',
 'year': 2017}
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33750%27 HTTP/1.1" 200 None
2026-03-27 10:35:34 [auto1.de] INFO: Saving data for EC33750: {'auction_closing_time': 1774716742.0, 'created_time': 1774350446.49065, 'last_price_update_time': 1774607734.635038}
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC33750') HTTP/1.1" 204 0
2026-03-27 10:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019b2310>
2026-03-27 10:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3f8f6a2-a744-5295-96bd-003625d9e42d/d3f8f6a2-a744-5295-96bd-003625d9e42d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ff2%252F05f24be41fcea8f3c63150c2a7318649%252Fpa%252FRV26500_fe4d456df60717b0f50e6f2cf5d1cd78.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_fe4d456df60717b0f50e6f2cf5d1cd78.jpg saved to cache
2026-03-27 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3f8f6a2-a744-5295-96bd-003625d9e42d
2026-03-27 10:35:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015d0bd0>
2026-03-27 10:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f297e0e-9dbb-5272-a8f5-138589e5994b/2f297e0e-9dbb-5272-a8f5-138589e5994b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3a%252F2e3a289ec2450be73880f54f88868917%252Fpa%252FCK72953_c6cd7428d1c36f83b317fe79951fb07c.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_c6cd7428d1c36f83b317fe79951fb07c.jpg saved to cache
2026-03-27 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2f297e0e-9dbb-5272-a8f5-138589e5994b
2026-03-27 10:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_d9451871306c935d2d610a66b8aa4087.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:34 [auto1.de] INFO: Found listing with ID: LH67751
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH67751%27 HTTP/1.1" 200 None
2026-03-27 10:35:34 [auto1.de] INFO: Scrape type for LH67751: 1
2026-03-27 10:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/a9/99a95f42f97b7ce5bfcb25dfa4efaafb/pa/BN83173_f0003cc52c7eba1eeb22c3967403f7df.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:34 [auto1.de] INFO: Found listing with ID: CK79873
2026-03-27 10:35:34 [auto1.de] INFO: Found listing with ID: TS01373
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS01373%27 HTTP/1.1" 200 None
2026-03-27 10:35:34 [auto1.de] INFO: Scrape type for TS01373: 1
2026-03-27 10:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP91741/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VM88505> (referer: https://www.auto1.com/v1/car-details-view/VM88505/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT42199/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:34 [auto1.de] INFO: Found listing with ID: FX17488
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX17488%27 HTTP/1.1" 200 None
2026-03-27 10:35:34 [auto1.de] INFO: Scrape type for FX17488: 2
2026-03-27 10:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84cd7975-bae1-561f-9649-3a0e1ba3e1ce with identifier: FX17488
2026-03-27 10:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84cd7975-bae1-561f-9649-3a0e1ba3e1ce with scrape type 2
2026-03-27 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84cd7975-bae1-561f-9649-3a0e1ba3e1ce with scrape type 2
2026-03-27 10:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84cd7975-bae1-561f-9649-3a0e1ba3e1ce, identifier: FX17488
2026-03-27 10:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84cd7975-bae1-561f-9649-3a0e1ba3e1ce with identifier: FX17488
2026-03-27 10:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84cd7975-bae1-561f-9649-3a0e1ba3e1ce with identifier: FX17488
2026-03-27 10:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84cd7975-bae1-561f-9649-3a0e1ba3e1ce with identifier: FX17488 to the API
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 400,
 'expiration_date': '2026-03-28T16:26:16Z',
 'fuel_type': 'petrol',
 'id': '84cd7975-bae1-561f-9649-3a0e1ba3e1ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX17488',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS Q3 Sportback',
 'odometer': 92066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-21',
 'seller_name': None,
 'title': 'Audi RS Q3 Sportback 2.5 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX17488%27 HTTP/1.1" 200 None
2026-03-27 10:35:35 [auto1.de] INFO: Saving data for FX17488: {'auction_closing_time': 1774715176.0, 'created_time': 1773917376.402283, 'last_price_update_time': 1774607735.559959}
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX17488') HTTP/1.1" 204 0
2026-03-27 10:35:35 [auto1.de] INFO: Found listing with ID: JG50197
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG50197%27 HTTP/1.1" 200 None
2026-03-27 10:35:35 [auto1.de] INFO: Scrape type for JG50197: 1
2026-03-27 10:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a2bd0>
2026-03-27 10:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3f8f6a2-a744-5295-96bd-003625d9e42d/d3f8f6a2-a744-5295-96bd-003625d9e42d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ff2%252F05f24be41fcea8f3c63150c2a7318649%252Fpa%252FRV26500_d9451871306c935d2d610a66b8aa4087.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_d9451871306c935d2d610a66b8aa4087.jpg saved to cache
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3f8f6a2-a744-5295-96bd-003625d9e42d
2026-03-27 10:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016ad290>
2026-03-27 10:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8/f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fa9%252F99a95f42f97b7ce5bfcb25dfa4efaafb%252Fpa%252FBN83173_f0003cc52c7eba1eeb22c3967403f7df.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/a9/99a95f42f97b7ce5bfcb25dfa4efaafb/pa/BN83173_f0003cc52c7eba1eeb22c3967403f7df.jpg saved to cache
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8
2026-03-27 10:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 593556e9-6717-55c2-b669-5dd70abc3ced with identifier: VM88505
2026-03-27 10:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 593556e9-6717-55c2-b669-5dd70abc3ced with scrape type 1
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 593556e9-6717-55c2-b669-5dd70abc3ced
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F86%252F2d866cd020021a3413704f004e3333c3%252Fpa%252FVM88505_a778cdd559a85a46b49692f085f57127.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_a778cdd559a85a46b49692f085f57127.jpg not downloaded yet
2026-03-27 10:35:35 [auto1.de] INFO: Found listing with ID: CD24001
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD24001%27 HTTP/1.1" 200 None
2026-03-27 10:35:35 [auto1.de] INFO: Scrape type for CD24001: 1
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F86%252F2d866cd020021a3413704f004e3333c3%252Fpa%252FVM88505_4d2485d25343751142d5599848a019b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_4d2485d25343751142d5599848a019b8.jpg not downloaded yet
2026-03-27 10:35:35 [auto1.de] INFO: Found listing with ID: MV69505
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F86%252F2d866cd020021a3413704f004e3333c3%252Fpa%252FVM88505_8a6f5cc4da7e5dbbc978afc0a204862f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_8a6f5cc4da7e5dbbc978afc0a204862f.jpg not downloaded yet
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F86%252F2d866cd020021a3413704f004e3333c3%252Fpa%252FVM88505_60b2a54f73806a6ea3f6c6803c38d173.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_60b2a54f73806a6ea3f6c6803c38d173.jpg not downloaded yet
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F86%252F2d866cd020021a3413704f004e3333c3%252Fpa%252FVM88505_e1e365f04b3e3080e1d6dc1f5af7dbd0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_e1e365f04b3e3080e1d6dc1f5af7dbd0.jpg not downloaded yet
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F86%252F2d866cd020021a3413704f004e3333c3%252Fpa%252FVM88505_5a0b958b3a06fb5f06f0fb2a31ed0947.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_5a0b958b3a06fb5f06f0fb2a31ed0947.jpg not downloaded yet
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F86%252F2d866cd020021a3413704f004e3333c3%252Fpa%252FVM88505_f649f2cd3038f9507f12339ec6bcb3a9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_f649f2cd3038f9507f12339ec6bcb3a9.jpg not downloaded yet
2026-03-27 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F86%252F2d866cd020021a3413704f004e3333c3%252Fpa%252FVM88505_01f47608db03b85c35cc20ce9e19f662.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_01f47608db03b85c35cc20ce9e19f662.jpg not downloaded yet
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F86%252F2d866cd020021a3413704f004e3333c3%252Fpa%252FVM88505_1461b331882119e46e31e6fb99ea335f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_1461b331882119e46e31e6fb99ea335f.jpg not downloaded yet
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F86%252F2d866cd020021a3413704f004e3333c3%252Fpa%252FVM88505_2477389c79e445c1c79fe16aa60df89d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_2477389c79e445c1c79fe16aa60df89d.jpg not downloaded yet
2026-03-27 10:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_0bbc92ffeeedede21b42a8967fd52256.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50196aa50>
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3f8f6a2-a744-5295-96bd-003625d9e42d/d3f8f6a2-a744-5295-96bd-003625d9e42d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ff2%252F05f24be41fcea8f3c63150c2a7318649%252Fpa%252FRV26500_0bbc92ffeeedede21b42a8967fd52256.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_0bbc92ffeeedede21b42a8967fd52256.jpg saved to cache
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3f8f6a2-a744-5295-96bd-003625d9e42d
2026-03-27 10:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_2477389c79e445c1c79fe16aa60df89d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN83370/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501841450>
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593556e9-6717-55c2-b669-5dd70abc3ced/593556e9-6717-55c2-b669-5dd70abc3ced_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F86%252F2d866cd020021a3413704f004e3333c3%252Fpa%252FVM88505_2477389c79e445c1c79fe16aa60df89d.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_2477389c79e445c1c79fe16aa60df89d.jpg saved to cache
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 593556e9-6717-55c2-b669-5dd70abc3ced
2026-03-27 10:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_1461b331882119e46e31e6fb99ea335f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503c06d50>
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593556e9-6717-55c2-b669-5dd70abc3ced/593556e9-6717-55c2-b669-5dd70abc3ced_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F86%252F2d866cd020021a3413704f004e3333c3%252Fpa%252FVM88505_1461b331882119e46e31e6fb99ea335f.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_1461b331882119e46e31e6fb99ea335f.jpg saved to cache
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 593556e9-6717-55c2-b669-5dd70abc3ced
2026-03-27 10:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_f649f2cd3038f9507f12339ec6bcb3a9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_01f47608db03b85c35cc20ce9e19f662.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV13508> (referer: https://www.auto1.com/v1/car-details-view/SV13508/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5036e0dd0>
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593556e9-6717-55c2-b669-5dd70abc3ced/593556e9-6717-55c2-b669-5dd70abc3ced_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F86%252F2d866cd020021a3413704f004e3333c3%252Fpa%252FVM88505_f649f2cd3038f9507f12339ec6bcb3a9.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_f649f2cd3038f9507f12339ec6bcb3a9.jpg saved to cache
2026-03-27 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 593556e9-6717-55c2-b669-5dd70abc3ced
2026-03-27 10:35:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50176a550>
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593556e9-6717-55c2-b669-5dd70abc3ced/593556e9-6717-55c2-b669-5dd70abc3ced_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F86%252F2d866cd020021a3413704f004e3333c3%252Fpa%252FVM88505_01f47608db03b85c35cc20ce9e19f662.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_01f47608db03b85c35cc20ce9e19f662.jpg saved to cache
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 593556e9-6717-55c2-b669-5dd70abc3ced
2026-03-27 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_e1e365f04b3e3080e1d6dc1f5af7dbd0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d453b8a3-059e-559b-b7ec-9fa99a243447 with identifier: SV13508
2026-03-27 10:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d453b8a3-059e-559b-b7ec-9fa99a243447 with scrape type 1
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d453b8a3-059e-559b-b7ec-9fa99a243447
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F60%252F8160f483c73924e043577efa0bba0e1d%252Fpa%252FSV13508_cc6b361c941fc33e487ed0b01910d1f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_cc6b361c941fc33e487ed0b01910d1f0.jpg not downloaded yet
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F60%252F8160f483c73924e043577efa0bba0e1d%252Fpa%252FSV13508_9f5f963b2f409d1b00221d554bcee0bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_9f5f963b2f409d1b00221d554bcee0bf.jpg not downloaded yet
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F60%252F8160f483c73924e043577efa0bba0e1d%252Fpa%252FSV13508_c31fea7f61fb714c6d4752cb50d4a64c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_c31fea7f61fb714c6d4752cb50d4a64c.jpg not downloaded yet
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F60%252F8160f483c73924e043577efa0bba0e1d%252Fpa%252FSV13508_c6af5bec29882f51b01901e12eab6066.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_c6af5bec29882f51b01901e12eab6066.jpg not downloaded yet
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F60%252F8160f483c73924e043577efa0bba0e1d%252Fpa%252FSV13508_058160646092bcc5e858c57196269952.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_058160646092bcc5e858c57196269952.jpg not downloaded yet
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F60%252F8160f483c73924e043577efa0bba0e1d%252Fpa%252FSV13508_5b959a975a7535aa1e113c3c97e0113f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_5b959a975a7535aa1e113c3c97e0113f.jpg not downloaded yet
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016cd3d0>
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593556e9-6717-55c2-b669-5dd70abc3ced/593556e9-6717-55c2-b669-5dd70abc3ced_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F86%252F2d866cd020021a3413704f004e3333c3%252Fpa%252FVM88505_e1e365f04b3e3080e1d6dc1f5af7dbd0.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_e1e365f04b3e3080e1d6dc1f5af7dbd0.jpg saved to cache
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 593556e9-6717-55c2-b669-5dd70abc3ced
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F60%252F8160f483c73924e043577efa0bba0e1d%252Fpa%252FSV13508_d64318821e2b65a4a70fa6902eaf60a9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_d64318821e2b65a4a70fa6902eaf60a9.jpg not downloaded yet
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F60%252F8160f483c73924e043577efa0bba0e1d%252Fpa%252FSV13508_3b90cb49a321a2b2ad0a3b21765659cd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_3b90cb49a321a2b2ad0a3b21765659cd.jpg not downloaded yet
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F60%252F8160f483c73924e043577efa0bba0e1d%252Fpa%252FSV13508_efeb499deab14c757e20b5454dc2045b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_efeb499deab14c757e20b5454dc2045b.jpg not downloaded yet
2026-03-27 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_60b2a54f73806a6ea3f6c6803c38d173.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F60%252F8160f483c73924e043577efa0bba0e1d%252Fpa%252FSV13508_91bd8de72586aa886c3f6a2968eda644.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_91bd8de72586aa886c3f6a2968eda644.jpg not downloaded yet
2026-03-27 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_5a0b958b3a06fb5f06f0fb2a31ed0947.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500501010>
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593556e9-6717-55c2-b669-5dd70abc3ced/593556e9-6717-55c2-b669-5dd70abc3ced_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F86%252F2d866cd020021a3413704f004e3333c3%252Fpa%252FVM88505_60b2a54f73806a6ea3f6c6803c38d173.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_60b2a54f73806a6ea3f6c6803c38d173.jpg saved to cache
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 593556e9-6717-55c2-b669-5dd70abc3ced
2026-03-27 10:35:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501846210>
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593556e9-6717-55c2-b669-5dd70abc3ced/593556e9-6717-55c2-b669-5dd70abc3ced_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F86%252F2d866cd020021a3413704f004e3333c3%252Fpa%252FVM88505_5a0b958b3a06fb5f06f0fb2a31ed0947.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_5a0b958b3a06fb5f06f0fb2a31ed0947.jpg saved to cache
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 593556e9-6717-55c2-b669-5dd70abc3ced
2026-03-27 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_91bd8de72586aa886c3f6a2968eda644.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_efeb499deab14c757e20b5454dc2045b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML63417/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_3b90cb49a321a2b2ad0a3b21765659cd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016cc250>
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d453b8a3-059e-559b-b7ec-9fa99a243447/d453b8a3-059e-559b-b7ec-9fa99a243447_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F60%252F8160f483c73924e043577efa0bba0e1d%252Fpa%252FSV13508_91bd8de72586aa886c3f6a2968eda644.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_91bd8de72586aa886c3f6a2968eda644.jpg saved to cache
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d453b8a3-059e-559b-b7ec-9fa99a243447
2026-03-27 10:35:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d1750>
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d453b8a3-059e-559b-b7ec-9fa99a243447/d453b8a3-059e-559b-b7ec-9fa99a243447_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F60%252F8160f483c73924e043577efa0bba0e1d%252Fpa%252FSV13508_efeb499deab14c757e20b5454dc2045b.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_efeb499deab14c757e20b5454dc2045b.jpg saved to cache
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d453b8a3-059e-559b-b7ec-9fa99a243447
2026-03-27 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_d64318821e2b65a4a70fa6902eaf60a9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50189b550>
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d453b8a3-059e-559b-b7ec-9fa99a243447/d453b8a3-059e-559b-b7ec-9fa99a243447_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F60%252F8160f483c73924e043577efa0bba0e1d%252Fpa%252FSV13508_3b90cb49a321a2b2ad0a3b21765659cd.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_3b90cb49a321a2b2ad0a3b21765659cd.jpg saved to cache
2026-03-27 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d453b8a3-059e-559b-b7ec-9fa99a243447
2026-03-27 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV60739> (referer: https://www.auto1.com/v1/car-details-view/SV60739/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016a80d0>
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d453b8a3-059e-559b-b7ec-9fa99a243447/d453b8a3-059e-559b-b7ec-9fa99a243447_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F60%252F8160f483c73924e043577efa0bba0e1d%252Fpa%252FSV13508_d64318821e2b65a4a70fa6902eaf60a9.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_d64318821e2b65a4a70fa6902eaf60a9.jpg saved to cache
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d453b8a3-059e-559b-b7ec-9fa99a243447
2026-03-27 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_5b959a975a7535aa1e113c3c97e0113f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bec28c5-1c2b-5132-b3c4-e1281ca87221 with identifier: SV60739
2026-03-27 10:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bec28c5-1c2b-5132-b3c4-e1281ca87221 with scrape type 1
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4bec28c5-1c2b-5132-b3c4-e1281ca87221
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F5c%252F775cd089272398646fea44d9acd12938%252Fpa%252FSV60739_23b1e980c02978524e50f102fcba9707.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_23b1e980c02978524e50f102fcba9707.jpg not downloaded yet
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F5c%252F775cd089272398646fea44d9acd12938%252Fpa%252FSV60739_115c6444a768219d74ddd25109d791e8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_115c6444a768219d74ddd25109d791e8.jpg not downloaded yet
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F5c%252F775cd089272398646fea44d9acd12938%252Fpa%252FSV60739_6b5dae8596f5011ff0c954011312a2c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_6b5dae8596f5011ff0c954011312a2c0.jpg not downloaded yet
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F5c%252F775cd089272398646fea44d9acd12938%252Fpa%252FSV60739_b9967d3bdb545406711e073fcc060113.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_b9967d3bdb545406711e073fcc060113.jpg not downloaded yet
2026-03-27 10:35:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5039ec690>
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d453b8a3-059e-559b-b7ec-9fa99a243447/d453b8a3-059e-559b-b7ec-9fa99a243447_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F60%252F8160f483c73924e043577efa0bba0e1d%252Fpa%252FSV13508_5b959a975a7535aa1e113c3c97e0113f.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_5b959a975a7535aa1e113c3c97e0113f.jpg saved to cache
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d453b8a3-059e-559b-b7ec-9fa99a243447
2026-03-27 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_c6af5bec29882f51b01901e12eab6066.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F5c%252F775cd089272398646fea44d9acd12938%252Fpa%252FSV60739_c8cc3ac158b1ba4d9c93cdd3b1da7df2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_c8cc3ac158b1ba4d9c93cdd3b1da7df2.jpg not downloaded yet
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F5c%252F775cd089272398646fea44d9acd12938%252Fpa%252FSV60739_e399be83f23fd5abd2a387712f4d8e01.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_e399be83f23fd5abd2a387712f4d8e01.jpg not downloaded yet
2026-03-27 10:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F5c%252F775cd089272398646fea44d9acd12938%252Fpa%252FSV60739_5f23f4ac70fed011fd887c3fafaaea84.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_5f23f4ac70fed011fd887c3fafaaea84.jpg not downloaded yet
2026-03-27 10:35:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F5c%252F775cd089272398646fea44d9acd12938%252Fpa%252FSV60739_5054ba213cf48a440e7bacdf802760b3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_5054ba213cf48a440e7bacdf802760b3.jpg not downloaded yet
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F5c%252F775cd089272398646fea44d9acd12938%252Fpa%252FSV60739_9ae9b8db22220a8b00942dac15721d2b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_9ae9b8db22220a8b00942dac15721d2b.jpg not downloaded yet
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F5c%252F775cd089272398646fea44d9acd12938%252Fpa%252FSV60739_3973b6b7e91d364ab639ba76dd90dcb4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_3973b6b7e91d364ab639ba76dd90dcb4.jpg not downloaded yet
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004dd150>
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d453b8a3-059e-559b-b7ec-9fa99a243447/d453b8a3-059e-559b-b7ec-9fa99a243447_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F60%252F8160f483c73924e043577efa0bba0e1d%252Fpa%252FSV13508_c6af5bec29882f51b01901e12eab6066.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_c6af5bec29882f51b01901e12eab6066.jpg saved to cache
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d453b8a3-059e-559b-b7ec-9fa99a243447
2026-03-27 10:35:38 [auto1.de] INFO: Channel: 24h | Page: 4 | totalHits: 10495 | hits on page: 40
2026-03-27 10:35:38 [auto1.de] INFO: Found listing with ID: CD24001
2026-03-27 10:35:38 [auto1.de] INFO: Found listing with ID: MV69505
2026-03-27 10:35:38 [auto1.de] INFO: Found listing with ID: JJ72083
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ72083%27 HTTP/1.1" 200 None
2026-03-27 10:35:38 [auto1.de] INFO: Scrape type for JJ72083: 2
2026-03-27 10:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c34afeef-5117-56ec-9dae-070513927659 with identifier: JJ72083
2026-03-27 10:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c34afeef-5117-56ec-9dae-070513927659 with scrape type 2
2026-03-27 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c34afeef-5117-56ec-9dae-070513927659 with scrape type 2
2026-03-27 10:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c34afeef-5117-56ec-9dae-070513927659, identifier: JJ72083
2026-03-27 10:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c34afeef-5117-56ec-9dae-070513927659 with identifier: JJ72083
2026-03-27 10:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c34afeef-5117-56ec-9dae-070513927659 with identifier: JJ72083
2026-03-27 10:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c34afeef-5117-56ec-9dae-070513927659 with identifier: JJ72083 to the API
2026-03-27 10:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:21:30Z',
 'fuel_type': 'diesel',
 'id': 'c34afeef-5117-56ec-9dae-070513927659',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ72083',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 154163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-28',
 'seller_name': None,
 'title': 'BMW 5er 535d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2015}
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ72083%27 HTTP/1.1" 200 None
2026-03-27 10:35:39 [auto1.de] INFO: Saving data for JJ72083: {'auction_closing_time': 1774714890.0, 'created_time': 1774350245.897141, 'last_price_update_time': 1774607739.795427}
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ72083') HTTP/1.1" 204 0
2026-03-27 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_b9967d3bdb545406711e073fcc060113.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:39 [auto1.de] INFO: Found listing with ID: GB33155
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB33155%27 HTTP/1.1" 200 None
2026-03-27 10:35:39 [auto1.de] INFO: Scrape type for GB33155: 1
2026-03-27 10:35:39 [auto1.de] INFO: Found listing with ID: FR69790
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR69790%27 HTTP/1.1" 200 None
2026-03-27 10:35:39 [auto1.de] INFO: Scrape type for FR69790: 1
2026-03-27 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FZ16195/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:39 [auto1.de] INFO: Found listing with ID: KS26285
2026-03-27 10:35:39 [auto1.de] INFO: Found listing with ID: NH03698
2026-03-27 10:35:39 [auto1.de] INFO: Found listing with ID: SC33158
2026-03-27 10:35:39 [auto1.de] INFO: Found listing with ID: WY54008
2026-03-27 10:35:39 [auto1.de] INFO: Found listing with ID: WE78461
2026-03-27 10:35:39 [auto1.de] INFO: Found listing with ID: XX31314
2026-03-27 10:35:39 [auto1.de] INFO: Found listing with ID: ZA85073
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA85073%27 HTTP/1.1" 200 None
2026-03-27 10:35:39 [auto1.de] INFO: Scrape type for ZA85073: 1
2026-03-27 10:35:39 [auto1.de] INFO: Found listing with ID: SM20101
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM20101%27 HTTP/1.1" 200 None
2026-03-27 10:35:39 [auto1.de] INFO: Scrape type for SM20101: 1
2026-03-27 10:35:39 [auto1.de] INFO: Found listing with ID: UK16576
2026-03-27 10:35:39 [auto1.de] INFO: Found listing with ID: BR69139
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR69139%27 HTTP/1.1" 200 None
2026-03-27 10:35:39 [auto1.de] INFO: Scrape type for BR69139: 1
2026-03-27 10:35:39 [auto1.de] INFO: Found listing with ID: HL17570
2026-03-27 10:35:39 [auto1.de] INFO: Found listing with ID: JW75116
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW75116%27 HTTP/1.1" 200 None
2026-03-27 10:35:39 [auto1.de] INFO: Scrape type for JW75116: 2
2026-03-27 10:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40d94085-8df5-5065-b83a-9b9cf820ab25 with identifier: JW75116
2026-03-27 10:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40d94085-8df5-5065-b83a-9b9cf820ab25 with scrape type 2
2026-03-27 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40d94085-8df5-5065-b83a-9b9cf820ab25 with scrape type 2
2026-03-27 10:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40d94085-8df5-5065-b83a-9b9cf820ab25, identifier: JW75116
2026-03-27 10:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40d94085-8df5-5065-b83a-9b9cf820ab25 with identifier: JW75116
2026-03-27 10:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40d94085-8df5-5065-b83a-9b9cf820ab25 with identifier: JW75116
2026-03-27 10:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40d94085-8df5-5065-b83a-9b9cf820ab25 with identifier: JW75116 to the API
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-28T16:47:35Z',
 'fuel_type': 'petrol',
 'id': '40d94085-8df5-5065-b83a-9b9cf820ab25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW75116',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLS-Klasse',
 'odometer': 219046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-05',
 'seller_name': None,
 'title': 'Mercedes-Benz GLS-Klasse GLS 400 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW75116%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [auto1.de] INFO: Saving data for JW75116: {'auction_closing_time': 1774716455.0, 'created_time': 1773917488.120116, 'last_price_update_time': 1774607740.440938}
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW75116') HTTP/1.1" 204 0
2026-03-27 10:35:40 [auto1.de] INFO: Found listing with ID: PH87632
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH87632%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [auto1.de] INFO: Scrape type for PH87632: 1
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a7550>
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bec28c5-1c2b-5132-b3c4-e1281ca87221/4bec28c5-1c2b-5132-b3c4-e1281ca87221_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F5c%252F775cd089272398646fea44d9acd12938%252Fpa%252FSV60739_b9967d3bdb545406711e073fcc060113.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_b9967d3bdb545406711e073fcc060113.jpg saved to cache
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4bec28c5-1c2b-5132-b3c4-e1281ca87221
2026-03-27 10:35:40 [auto1.de] INFO: Found listing with ID: BZ40542
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ40542%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [auto1.de] INFO: Scrape type for BZ40542: 1
2026-03-27 10:35:40 [auto1.de] INFO: Found listing with ID: KP27245
2026-03-27 10:35:40 [auto1.de] INFO: Found listing with ID: LG79841
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG79841%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [auto1.de] INFO: Scrape type for LG79841: 1
2026-03-27 10:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_058160646092bcc5e858c57196269952.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:40 [auto1.de] INFO: Found listing with ID: GC84828
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC84828%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [auto1.de] INFO: Scrape type for GC84828: 1
2026-03-27 10:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_c31fea7f61fb714c6d4752cb50d4a64c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:40 [auto1.de] INFO: Found listing with ID: LF68869
2026-03-27 10:35:40 [auto1.de] INFO: Found listing with ID: NU23717
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23717%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [auto1.de] INFO: Scrape type for NU23717: 1
2026-03-27 10:35:40 [auto1.de] INFO: Found listing with ID: HF06660
2026-03-27 10:35:40 [auto1.de] INFO: Found listing with ID: UB26055
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB26055%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [auto1.de] INFO: Scrape type for UB26055: 1
2026-03-27 10:35:40 [auto1.de] INFO: Found listing with ID: JC58786
2026-03-27 10:35:40 [auto1.de] INFO: Found listing with ID: LG85121
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG85121%27 HTTP/1.1" 200 None
2026-03-27 10:35:40 [auto1.de] INFO: Scrape type for LG85121: 2
2026-03-27 10:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9585bbde-b3a0-52ac-929a-11474f11909b with identifier: LG85121
2026-03-27 10:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9585bbde-b3a0-52ac-929a-11474f11909b with scrape type 2
2026-03-27 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9585bbde-b3a0-52ac-929a-11474f11909b with scrape type 2
2026-03-27 10:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9585bbde-b3a0-52ac-929a-11474f11909b, identifier: LG85121
2026-03-27 10:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9585bbde-b3a0-52ac-929a-11474f11909b with identifier: LG85121
2026-03-27 10:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9585bbde-b3a0-52ac-929a-11474f11909b with identifier: LG85121
2026-03-27 10:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9585bbde-b3a0-52ac-929a-11474f11909b with identifier: LG85121 to the API
2026-03-27 10:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:48:22Z',
 'fuel_type': 'diesel',
 'id': '9585bbde-b3a0-52ac-929a-11474f11909b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG85121',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 91626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-31',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Energy BOSE-Edition',
 'transmission': 'automatic',
 'trim': 'BOSE-Edition',
 'year': 2017}
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG85121%27 HTTP/1.1" 200 None
2026-03-27 10:35:41 [auto1.de] INFO: Saving data for LG85121: {'auction_closing_time': 1774716502.0, 'created_time': 1773136202.743044, 'last_price_update_time': 1774607741.247016}
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG85121') HTTP/1.1" 204 0
2026-03-27 10:35:41 [auto1.de] INFO: Found listing with ID: CR88792
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR88792%27 HTTP/1.1" 200 None
2026-03-27 10:35:41 [auto1.de] INFO: Scrape type for CR88792: 1
2026-03-27 10:35:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016cd390>
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d453b8a3-059e-559b-b7ec-9fa99a243447/d453b8a3-059e-559b-b7ec-9fa99a243447_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F60%252F8160f483c73924e043577efa0bba0e1d%252Fpa%252FSV13508_058160646092bcc5e858c57196269952.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_058160646092bcc5e858c57196269952.jpg saved to cache
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d453b8a3-059e-559b-b7ec-9fa99a243447
2026-03-27 10:35:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a6e90>
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d453b8a3-059e-559b-b7ec-9fa99a243447/d453b8a3-059e-559b-b7ec-9fa99a243447_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F60%252F8160f483c73924e043577efa0bba0e1d%252Fpa%252FSV13508_c31fea7f61fb714c6d4752cb50d4a64c.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_c31fea7f61fb714c6d4752cb50d4a64c.jpg saved to cache
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d453b8a3-059e-559b-b7ec-9fa99a243447
2026-03-27 10:35:41 [auto1.de] INFO: Found listing with ID: RF57736
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF57736%27 HTTP/1.1" 200 None
2026-03-27 10:35:41 [auto1.de] INFO: Scrape type for RF57736: 1
2026-03-27 10:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ82929/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:41 [auto1.de] INFO: Found listing with ID: GY26864
2026-03-27 10:35:41 [auto1.de] INFO: Found listing with ID: JL47940
2026-03-27 10:35:41 [auto1.de] INFO: Found listing with ID: VT76935
2026-03-27 10:35:41 [auto1.de] INFO: Found listing with ID: ZD23716
2026-03-27 10:35:41 [auto1.de] INFO: Found listing with ID: ZG00412
2026-03-27 10:35:41 [auto1.de] INFO: Found listing with ID: XL45586
2026-03-27 10:35:41 [auto1.de] INFO: Found listing with ID: PH94566
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH94566%27 HTTP/1.1" 200 None
2026-03-27 10:35:41 [auto1.de] INFO: Scrape type for PH94566: 1
2026-03-27 10:35:41 [auto1.de] INFO: Found listing with ID: MC50567
2026-03-27 10:35:41 [auto1.de] INFO: Found listing with ID: RG24592
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG24592%27 HTTP/1.1" 200 None
2026-03-27 10:35:41 [auto1.de] INFO: Scrape type for RG24592: 1
2026-03-27 10:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_e399be83f23fd5abd2a387712f4d8e01.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:41 [auto1.de] INFO: Found listing with ID: MK74159
2026-03-27 10:35:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501846d10>
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bec28c5-1c2b-5132-b3c4-e1281ca87221/4bec28c5-1c2b-5132-b3c4-e1281ca87221_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F5c%252F775cd089272398646fea44d9acd12938%252Fpa%252FSV60739_e399be83f23fd5abd2a387712f4d8e01.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_e399be83f23fd5abd2a387712f4d8e01.jpg saved to cache
2026-03-27 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4bec28c5-1c2b-5132-b3c4-e1281ca87221
2026-03-27 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AN46464/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SZ69357> (referer: https://www.auto1.com/v1/car-details-view/SZ69357/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea77ddc3-e24b-5693-bbcc-61718932a5cc with identifier: SZ69357
2026-03-27 10:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea77ddc3-e24b-5693-bbcc-61718932a5cc with scrape type 1
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea77ddc3-e24b-5693-bbcc-61718932a5cc
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9d%252Fea9dba8780dad00c678d4832e5104559%252Fpa%252FSZ69357_8228cb96fea2ecee2a0ced04f4a66f45.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_8228cb96fea2ecee2a0ced04f4a66f45.jpg not downloaded yet
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9d%252Fea9dba8780dad00c678d4832e5104559%252Fpa%252FSZ69357_20a5593320a7c475e1377929385540be.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_20a5593320a7c475e1377929385540be.jpg not downloaded yet
2026-03-27 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LH67751/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9d%252Fea9dba8780dad00c678d4832e5104559%252Fpa%252FSZ69357_6a69c16fbfb4ef5c5db1d67d45def4e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_6a69c16fbfb4ef5c5db1d67d45def4e1.jpg not downloaded yet
2026-03-27 10:35:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9d%252Fea9dba8780dad00c678d4832e5104559%252Fpa%252FSZ69357_b0aec0fa6b9194ba848c7888ef2ccf76.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_b0aec0fa6b9194ba848c7888ef2ccf76.jpg not downloaded yet
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9d%252Fea9dba8780dad00c678d4832e5104559%252Fpa%252FSZ69357_aaaa474722db19634ac79051c3645e40.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_aaaa474722db19634ac79051c3645e40.jpg not downloaded yet
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9d%252Fea9dba8780dad00c678d4832e5104559%252Fpa%252FSZ69357_e86d6a9654609744279002a2b5997510.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_e86d6a9654609744279002a2b5997510.jpg not downloaded yet
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9d%252Fea9dba8780dad00c678d4832e5104559%252Fpa%252FSZ69357_d9ceaf8424b5cb3e5aa1c46ce774c93a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_d9ceaf8424b5cb3e5aa1c46ce774c93a.jpg not downloaded yet
2026-03-27 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_20a5593320a7c475e1377929385540be.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9d%252Fea9dba8780dad00c678d4832e5104559%252Fpa%252FSZ69357_6057f6537c26d0bf086b3bf1b328a60c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_6057f6537c26d0bf086b3bf1b328a60c.jpg not downloaded yet
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9d%252Fea9dba8780dad00c678d4832e5104559%252Fpa%252FSZ69357_9232f665a75786af9f0cf7126d272b0b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_9232f665a75786af9f0cf7126d272b0b.jpg not downloaded yet
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9d%252Fea9dba8780dad00c678d4832e5104559%252Fpa%252FSZ69357_20089905745d816788601cdb60782b53.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_20089905745d816788601cdb60782b53.jpg not downloaded yet
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501847910>
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea77ddc3-e24b-5693-bbcc-61718932a5cc/ea77ddc3-e24b-5693-bbcc-61718932a5cc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9d%252Fea9dba8780dad00c678d4832e5104559%252Fpa%252FSZ69357_20a5593320a7c475e1377929385540be.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_20a5593320a7c475e1377929385540be.jpg saved to cache
2026-03-27 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea77ddc3-e24b-5693-bbcc-61718932a5cc
2026-03-27 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_d9ceaf8424b5cb3e5aa1c46ce774c93a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017d7610>
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea77ddc3-e24b-5693-bbcc-61718932a5cc/ea77ddc3-e24b-5693-bbcc-61718932a5cc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9d%252Fea9dba8780dad00c678d4832e5104559%252Fpa%252FSZ69357_d9ceaf8424b5cb3e5aa1c46ce774c93a.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_d9ceaf8424b5cb3e5aa1c46ce774c93a.jpg saved to cache
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea77ddc3-e24b-5693-bbcc-61718932a5cc
2026-03-27 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN83370> (referer: https://www.auto1.com/v1/car-details-view/EN83370/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_20089905745d816788601cdb60782b53.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c74ef32a-1a46-5836-9cd9-536cb191af33 with identifier: EN83370
2026-03-27 10:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c74ef32a-1a46-5836-9cd9-536cb191af33 with scrape type 1
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c74ef32a-1a46-5836-9cd9-536cb191af33
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F4d%252Fd44d3f4703a17d64d32fd8b7e51b2da1%252Fpa%252FEN83370_b16ec51e387bf226a1646cf72bf5d341.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_b16ec51e387bf226a1646cf72bf5d341.jpg not downloaded yet
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F4d%252Fd44d3f4703a17d64d32fd8b7e51b2da1%252Fpa%252FEN83370_c31c378d36a029da55dd71f8a6589859.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_c31c378d36a029da55dd71f8a6589859.jpg not downloaded yet
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F4d%252Fd44d3f4703a17d64d32fd8b7e51b2da1%252Fpa%252FEN83370_fdab8dcd84053cb26131bf24444e3b63.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_fdab8dcd84053cb26131bf24444e3b63.jpg not downloaded yet
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F4d%252Fd44d3f4703a17d64d32fd8b7e51b2da1%252Fpa%252FEN83370_e751c101c777b6eea773fb88da7df396.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_e751c101c777b6eea773fb88da7df396.jpg not downloaded yet
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F4d%252Fd44d3f4703a17d64d32fd8b7e51b2da1%252Fpa%252FEN83370_8781f0edc6ab771868d8223638083e30.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_8781f0edc6ab771868d8223638083e30.jpg not downloaded yet
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501643b10>
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea77ddc3-e24b-5693-bbcc-61718932a5cc/ea77ddc3-e24b-5693-bbcc-61718932a5cc_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9d%252Fea9dba8780dad00c678d4832e5104559%252Fpa%252FSZ69357_20089905745d816788601cdb60782b53.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_20089905745d816788601cdb60782b53.jpg saved to cache
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ea77ddc3-e24b-5693-bbcc-61718932a5cc
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F4d%252Fd44d3f4703a17d64d32fd8b7e51b2da1%252Fpa%252FEN83370_ce02e9d8b1f2dc548d4a295096454fdc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_ce02e9d8b1f2dc548d4a295096454fdc.jpg not downloaded yet
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F4d%252Fd44d3f4703a17d64d32fd8b7e51b2da1%252Fpa%252FEN83370_cb7b2fe29f746951cb05b905ce201c7f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_cb7b2fe29f746951cb05b905ce201c7f.jpg not downloaded yet
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F4d%252Fd44d3f4703a17d64d32fd8b7e51b2da1%252Fpa%252FEN83370_66829ee5884880a224e0dd8ecd4b300b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_66829ee5884880a224e0dd8ecd4b300b.jpg not downloaded yet
2026-03-27 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_9232f665a75786af9f0cf7126d272b0b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F4d%252Fd44d3f4703a17d64d32fd8b7e51b2da1%252Fpa%252FEN83370_92356dba72f53b1477a43d448bf3c429.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_92356dba72f53b1477a43d448bf3c429.jpg not downloaded yet
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F4d%252Fd44d3f4703a17d64d32fd8b7e51b2da1%252Fpa%252FEN83370_b28cc4b65915e41b46caf020ef7b86cb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_b28cc4b65915e41b46caf020ef7b86cb.jpg not downloaded yet
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50186c550>
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea77ddc3-e24b-5693-bbcc-61718932a5cc/ea77ddc3-e24b-5693-bbcc-61718932a5cc_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9d%252Fea9dba8780dad00c678d4832e5104559%252Fpa%252FSZ69357_9232f665a75786af9f0cf7126d272b0b.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_9232f665a75786af9f0cf7126d272b0b.jpg saved to cache
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea77ddc3-e24b-5693-bbcc-61718932a5cc
2026-03-27 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_66829ee5884880a224e0dd8ecd4b300b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50191e3d0>
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c74ef32a-1a46-5836-9cd9-536cb191af33/c74ef32a-1a46-5836-9cd9-536cb191af33_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F4d%252Fd44d3f4703a17d64d32fd8b7e51b2da1%252Fpa%252FEN83370_66829ee5884880a224e0dd8ecd4b300b.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_66829ee5884880a224e0dd8ecd4b300b.jpg saved to cache
2026-03-27 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c74ef32a-1a46-5836-9cd9-536cb191af33
2026-03-27 10:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GB33155/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU03537/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_b28cc4b65915e41b46caf020ef7b86cb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_92356dba72f53b1477a43d448bf3c429.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50171c310>
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c74ef32a-1a46-5836-9cd9-536cb191af33/c74ef32a-1a46-5836-9cd9-536cb191af33_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F4d%252Fd44d3f4703a17d64d32fd8b7e51b2da1%252Fpa%252FEN83370_b28cc4b65915e41b46caf020ef7b86cb.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_b28cc4b65915e41b46caf020ef7b86cb.jpg saved to cache
2026-03-27 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c74ef32a-1a46-5836-9cd9-536cb191af33
2026-03-27 10:35:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50377a9d0>
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c74ef32a-1a46-5836-9cd9-536cb191af33/c74ef32a-1a46-5836-9cd9-536cb191af33_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F4d%252Fd44d3f4703a17d64d32fd8b7e51b2da1%252Fpa%252FEN83370_92356dba72f53b1477a43d448bf3c429.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_92356dba72f53b1477a43d448bf3c429.jpg saved to cache
2026-03-27 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c74ef32a-1a46-5836-9cd9-536cb191af33
2026-03-27 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_cb7b2fe29f746951cb05b905ce201c7f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50171fd90>
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c74ef32a-1a46-5836-9cd9-536cb191af33/c74ef32a-1a46-5836-9cd9-536cb191af33_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F4d%252Fd44d3f4703a17d64d32fd8b7e51b2da1%252Fpa%252FEN83370_cb7b2fe29f746951cb05b905ce201c7f.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_cb7b2fe29f746951cb05b905ce201c7f.jpg saved to cache
2026-03-27 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c74ef32a-1a46-5836-9cd9-536cb191af33
2026-03-27 10:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_ce02e9d8b1f2dc548d4a295096454fdc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a5590>
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c74ef32a-1a46-5836-9cd9-536cb191af33/c74ef32a-1a46-5836-9cd9-536cb191af33_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F4d%252Fd44d3f4703a17d64d32fd8b7e51b2da1%252Fpa%252FEN83370_ce02e9d8b1f2dc548d4a295096454fdc.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_ce02e9d8b1f2dc548d4a295096454fdc.jpg saved to cache
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c74ef32a-1a46-5836-9cd9-536cb191af33
2026-03-27 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_8781f0edc6ab771868d8223638083e30.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb502611d90>
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c74ef32a-1a46-5836-9cd9-536cb191af33/c74ef32a-1a46-5836-9cd9-536cb191af33_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F4d%252Fd44d3f4703a17d64d32fd8b7e51b2da1%252Fpa%252FEN83370_8781f0edc6ab771868d8223638083e30.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_8781f0edc6ab771868d8223638083e30.jpg saved to cache
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c74ef32a-1a46-5836-9cd9-536cb191af33
2026-03-27 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_e751c101c777b6eea773fb88da7df396.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501643b50>
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c74ef32a-1a46-5836-9cd9-536cb191af33/c74ef32a-1a46-5836-9cd9-536cb191af33_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F4d%252Fd44d3f4703a17d64d32fd8b7e51b2da1%252Fpa%252FEN83370_e751c101c777b6eea773fb88da7df396.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_e751c101c777b6eea773fb88da7df396.jpg saved to cache
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c74ef32a-1a46-5836-9cd9-536cb191af33
2026-03-27 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VH10355> (referer: https://www.auto1.com/v1/car-details-view/VH10355/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_fdab8dcd84053cb26131bf24444e3b63.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG79841/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02ff7c2b-7573-5561-bfb9-331d69ba5436 with identifier: VH10355
2026-03-27 10:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02ff7c2b-7573-5561-bfb9-331d69ba5436 with scrape type 1
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 02ff7c2b-7573-5561-bfb9-331d69ba5436
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffa%252F7afa6df02895e9f4dd224cb48ecd074e%252Fpa%252FVH10355_30ca0c8325297733b510fdddaf19ec18.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_30ca0c8325297733b510fdddaf19ec18.jpg already downloaded
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffa%252F7afa6df02895e9f4dd224cb48ecd074e%252Fpa%252FVH10355_27a2c6e9b8732ca912d468965271e333.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_27a2c6e9b8732ca912d468965271e333.jpg already downloaded
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffa%252F7afa6df02895e9f4dd224cb48ecd074e%252Fpa%252FVH10355_3db7e4c097295ac445952c21ee0f6582.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_3db7e4c097295ac445952c21ee0f6582.jpg already downloaded
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffa%252F7afa6df02895e9f4dd224cb48ecd074e%252Fpa%252FVH10355_ed08a9299fc9b07c77c6bb7c50ba3e11.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_ed08a9299fc9b07c77c6bb7c50ba3e11.jpg already downloaded
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffa%252F7afa6df02895e9f4dd224cb48ecd074e%252Fpa%252FVH10355_2a7480ab701746c8c59591bb7bf36615.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_2a7480ab701746c8c59591bb7bf36615.jpg already downloaded
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffa%252F7afa6df02895e9f4dd224cb48ecd074e%252Fpa%252FVH10355_636b7f08f3f7f34f764e082b064cef61.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_636b7f08f3f7f34f764e082b064cef61.jpg already downloaded
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffa%252F7afa6df02895e9f4dd224cb48ecd074e%252Fpa%252FVH10355_c49a2a18ea56822d986fe67ae1912f72.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_c49a2a18ea56822d986fe67ae1912f72.jpg already downloaded
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffa%252F7afa6df02895e9f4dd224cb48ecd074e%252Fpa%252FVH10355_7f402c63d7d19649fd0bc41ef6743abf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_7f402c63d7d19649fd0bc41ef6743abf.jpg already downloaded
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffa%252F7afa6df02895e9f4dd224cb48ecd074e%252Fpa%252FVH10355_5577de273a9e2d73b375f6bb99714a8b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_5577de273a9e2d73b375f6bb99714a8b.jpg already downloaded
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffa%252F7afa6df02895e9f4dd224cb48ecd074e%252Fpa%252FVH10355_1c3fb6ad8bf8a06e8e54056151c6d199.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_1c3fb6ad8bf8a06e8e54056151c6d199.jpg already downloaded
2026-03-27 10:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02ff7c2b-7573-5561-bfb9-331d69ba5436, identifier: VH10355
2026-03-27 10:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02ff7c2b-7573-5561-bfb9-331d69ba5436 with identifier: VH10355
2026-03-27 10:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02ff7c2b-7573-5561-bfb9-331d69ba5436 with identifier: VH10355
2026-03-27 10:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02ff7c2b-7573-5561-bfb9-331d69ba5436 with identifier: VH10355 to the API
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VH10355>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:50:18Z',
 'fuel_type': 'diesel',
 'id': '02ff7c2b-7573-5561-bfb9-331d69ba5436',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH10355',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 136448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_30ca0c8325297733b510fdddaf19ec18.jpg',
                'https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_27a2c6e9b8732ca912d468965271e333.jpg',
                'https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_3db7e4c097295ac445952c21ee0f6582.jpg',
                'https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_ed08a9299fc9b07c77c6bb7c50ba3e11.jpg',
                'https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_2a7480ab701746c8c59591bb7bf36615.jpg',
                'https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_636b7f08f3f7f34f764e082b064cef61.jpg',
                'https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_c49a2a18ea56822d986fe67ae1912f72.jpg',
                'https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_7f402c63d7d19649fd0bc41ef6743abf.jpg',
                'https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_5577de273a9e2d73b375f6bb99714a8b.jpg',
                'https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_1c3fb6ad8bf8a06e8e54056151c6d199.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ff7c2b-7573-5561-bfb9-331d69ba5436/02ff7c2b-7573-5561-bfb9-331d69ba5436_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3021275,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_30ca0c8325297733b510fdddaf19ec18.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ff7c2b-7573-5561-bfb9-331d69ba5436/02ff7c2b-7573-5561-bfb9-331d69ba5436_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_27a2c6e9b8732ca912d468965271e333.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ff7c2b-7573-5561-bfb9-331d69ba5436/02ff7c2b-7573-5561-bfb9-331d69ba5436_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2745811,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_3db7e4c097295ac445952c21ee0f6582.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ff7c2b-7573-5561-bfb9-331d69ba5436/02ff7c2b-7573-5561-bfb9-331d69ba5436_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_ed08a9299fc9b07c77c6bb7c50ba3e11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ff7c2b-7573-5561-bfb9-331d69ba5436/02ff7c2b-7573-5561-bfb9-331d69ba5436_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_2a7480ab701746c8c59591bb7bf36615.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ff7c2b-7573-5561-bfb9-331d69ba5436/02ff7c2b-7573-5561-bfb9-331d69ba5436_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_636b7f08f3f7f34f764e082b064cef61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ff7c2b-7573-5561-bfb9-331d69ba5436/02ff7c2b-7573-5561-bfb9-331d69ba5436_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_c49a2a18ea56822d986fe67ae1912f72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ff7c2b-7573-5561-bfb9-331d69ba5436/02ff7c2b-7573-5561-bfb9-331d69ba5436_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_7f402c63d7d19649fd0bc41ef6743abf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ff7c2b-7573-5561-bfb9-331d69ba5436/02ff7c2b-7573-5561-bfb9-331d69ba5436_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_5577de273a9e2d73b375f6bb99714a8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ff7c2b-7573-5561-bfb9-331d69ba5436/02ff7c2b-7573-5561-bfb9-331d69ba5436_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fa/7afa6df02895e9f4dd224cb48ecd074e/pa/VH10355_1c3fb6ad8bf8a06e8e54056151c6d199.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Sports-Line AWD',
 'transmission': 'automatic',
 'trim': 'Sports-Line AWD',
 'year': 2012}
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH10355%27 HTTP/1.1" 200 None
2026-03-27 10:35:47 [auto1.de] INFO: Saving data for VH10355: {'created_time': 1774607747.407943, 'last_price_update_time': 1774607747.407957, 'auction_closing_time': 1774716618.0}
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH10355') HTTP/1.1" 204 0
2026-03-27 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_6057f6537c26d0bf086b3bf1b328a60c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_c31c378d36a029da55dd71f8a6589859.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF57736/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50166f9d0>
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c74ef32a-1a46-5836-9cd9-536cb191af33/c74ef32a-1a46-5836-9cd9-536cb191af33_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F4d%252Fd44d3f4703a17d64d32fd8b7e51b2da1%252Fpa%252FEN83370_fdab8dcd84053cb26131bf24444e3b63.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_fdab8dcd84053cb26131bf24444e3b63.jpg saved to cache
2026-03-27 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c74ef32a-1a46-5836-9cd9-536cb191af33
2026-03-27 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_b16ec51e387bf226a1646cf72bf5d341.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_e86d6a9654609744279002a2b5997510.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004dc850>
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea77ddc3-e24b-5693-bbcc-61718932a5cc/ea77ddc3-e24b-5693-bbcc-61718932a5cc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9d%252Fea9dba8780dad00c678d4832e5104559%252Fpa%252FSZ69357_6057f6537c26d0bf086b3bf1b328a60c.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_6057f6537c26d0bf086b3bf1b328a60c.jpg saved to cache
2026-03-27 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea77ddc3-e24b-5693-bbcc-61718932a5cc
2026-03-27 10:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_aaaa474722db19634ac79051c3645e40.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501681890>
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c74ef32a-1a46-5836-9cd9-536cb191af33/c74ef32a-1a46-5836-9cd9-536cb191af33_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F4d%252Fd44d3f4703a17d64d32fd8b7e51b2da1%252Fpa%252FEN83370_c31c378d36a029da55dd71f8a6589859.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_c31c378d36a029da55dd71f8a6589859.jpg saved to cache
2026-03-27 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c74ef32a-1a46-5836-9cd9-536cb191af33
2026-03-27 10:35:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50189b110>
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c74ef32a-1a46-5836-9cd9-536cb191af33/c74ef32a-1a46-5836-9cd9-536cb191af33_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F4d%252Fd44d3f4703a17d64d32fd8b7e51b2da1%252Fpa%252FEN83370_b16ec51e387bf226a1646cf72bf5d341.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_b16ec51e387bf226a1646cf72bf5d341.jpg saved to cache
2026-03-27 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c74ef32a-1a46-5836-9cd9-536cb191af33
2026-03-27 10:35:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c74ef32a-1a46-5836-9cd9-536cb191af33, skipping ID generation
2026-03-27 10:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c74ef32a-1a46-5836-9cd9-536cb191af33 with scrape type 1
2026-03-27 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c74ef32a-1a46-5836-9cd9-536cb191af33 sending to next pipeline
2026-03-27 10:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c74ef32a-1a46-5836-9cd9-536cb191af33, identifier: EN83370
2026-03-27 10:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c74ef32a-1a46-5836-9cd9-536cb191af33 with identifier: EN83370
2026-03-27 10:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c74ef32a-1a46-5836-9cd9-536cb191af33 with identifier: EN83370
2026-03-27 10:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c74ef32a-1a46-5836-9cd9-536cb191af33 with identifier: EN83370 to the API
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_b16ec51e387bf226a1646cf72bf5d341.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:42:02Z',
 'fuel_type': 'petrol',
 'id': 'c74ef32a-1a46-5836-9cd9-536cb191af33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN83370',
 'listing': 'auction',
 'location': 'DE, Bremen',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 114215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c74ef32a-1a46-5836-9cd9-536cb191af33/c74ef32a-1a46-5836-9cd9-536cb191af33_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3100904,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_b16ec51e387bf226a1646cf72bf5d341.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c74ef32a-1a46-5836-9cd9-536cb191af33/c74ef32a-1a46-5836-9cd9-536cb191af33_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_c31c378d36a029da55dd71f8a6589859.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c74ef32a-1a46-5836-9cd9-536cb191af33/c74ef32a-1a46-5836-9cd9-536cb191af33_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_fdab8dcd84053cb26131bf24444e3b63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c74ef32a-1a46-5836-9cd9-536cb191af33/c74ef32a-1a46-5836-9cd9-536cb191af33_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2857118,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_e751c101c777b6eea773fb88da7df396.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c74ef32a-1a46-5836-9cd9-536cb191af33/c74ef32a-1a46-5836-9cd9-536cb191af33_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_8781f0edc6ab771868d8223638083e30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c74ef32a-1a46-5836-9cd9-536cb191af33/c74ef32a-1a46-5836-9cd9-536cb191af33_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2468426,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_ce02e9d8b1f2dc548d4a295096454fdc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c74ef32a-1a46-5836-9cd9-536cb191af33/c74ef32a-1a46-5836-9cd9-536cb191af33_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2533715,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_cb7b2fe29f746951cb05b905ce201c7f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c74ef32a-1a46-5836-9cd9-536cb191af33/c74ef32a-1a46-5836-9cd9-536cb191af33_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_66829ee5884880a224e0dd8ecd4b300b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c74ef32a-1a46-5836-9cd9-536cb191af33/c74ef32a-1a46-5836-9cd9-536cb191af33_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2970932,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_92356dba72f53b1477a43d448bf3c429.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c74ef32a-1a46-5836-9cd9-536cb191af33/c74ef32a-1a46-5836-9cd9-536cb191af33_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3130334,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/4d/d44d3f4703a17d64d32fd8b7e51b2da1/pa/EN83370_b28cc4b65915e41b46caf020ef7b86cb.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN83370%27 HTTP/1.1" 200 None
2026-03-27 10:35:48 [auto1.de] INFO: Saving data for EN83370: {'created_time': 1774607748.40188, 'last_price_update_time': 1774607748.401891, 'auction_closing_time': 1774716122.0}
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN83370') HTTP/1.1" 204 0
2026-03-27 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_b0aec0fa6b9194ba848c7888ef2ccf76.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_6a69c16fbfb4ef5c5db1d67d45def4e1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_8228cb96fea2ecee2a0ced04f4a66f45.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RG24592/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb502611090>
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea77ddc3-e24b-5693-bbcc-61718932a5cc/ea77ddc3-e24b-5693-bbcc-61718932a5cc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9d%252Fea9dba8780dad00c678d4832e5104559%252Fpa%252FSZ69357_e86d6a9654609744279002a2b5997510.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_e86d6a9654609744279002a2b5997510.jpg saved to cache
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea77ddc3-e24b-5693-bbcc-61718932a5cc
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017858d0>
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea77ddc3-e24b-5693-bbcc-61718932a5cc/ea77ddc3-e24b-5693-bbcc-61718932a5cc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9d%252Fea9dba8780dad00c678d4832e5104559%252Fpa%252FSZ69357_aaaa474722db19634ac79051c3645e40.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_aaaa474722db19634ac79051c3645e40.jpg saved to cache
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea77ddc3-e24b-5693-bbcc-61718932a5cc
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016cd650>
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea77ddc3-e24b-5693-bbcc-61718932a5cc/ea77ddc3-e24b-5693-bbcc-61718932a5cc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9d%252Fea9dba8780dad00c678d4832e5104559%252Fpa%252FSZ69357_b0aec0fa6b9194ba848c7888ef2ccf76.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_b0aec0fa6b9194ba848c7888ef2ccf76.jpg saved to cache
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea77ddc3-e24b-5693-bbcc-61718932a5cc
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017d5f90>
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea77ddc3-e24b-5693-bbcc-61718932a5cc/ea77ddc3-e24b-5693-bbcc-61718932a5cc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9d%252Fea9dba8780dad00c678d4832e5104559%252Fpa%252FSZ69357_6a69c16fbfb4ef5c5db1d67d45def4e1.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_6a69c16fbfb4ef5c5db1d67d45def4e1.jpg saved to cache
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea77ddc3-e24b-5693-bbcc-61718932a5cc
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50373f1d0>
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea77ddc3-e24b-5693-bbcc-61718932a5cc/ea77ddc3-e24b-5693-bbcc-61718932a5cc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F9d%252Fea9dba8780dad00c678d4832e5104559%252Fpa%252FSZ69357_8228cb96fea2ecee2a0ced04f4a66f45.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_8228cb96fea2ecee2a0ced04f4a66f45.jpg saved to cache
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea77ddc3-e24b-5693-bbcc-61718932a5cc
2026-03-27 10:35:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea77ddc3-e24b-5693-bbcc-61718932a5cc, skipping ID generation
2026-03-27 10:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea77ddc3-e24b-5693-bbcc-61718932a5cc with scrape type 1
2026-03-27 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea77ddc3-e24b-5693-bbcc-61718932a5cc sending to next pipeline
2026-03-27 10:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea77ddc3-e24b-5693-bbcc-61718932a5cc, identifier: SZ69357
2026-03-27 10:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea77ddc3-e24b-5693-bbcc-61718932a5cc with identifier: SZ69357
2026-03-27 10:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea77ddc3-e24b-5693-bbcc-61718932a5cc with identifier: SZ69357
2026-03-27 10:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea77ddc3-e24b-5693-bbcc-61718932a5cc with identifier: SZ69357 to the API
2026-03-27 10:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_8228cb96fea2ecee2a0ced04f4a66f45.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:43:23Z',
 'fuel_type': 'petrol',
 'id': 'ea77ddc3-e24b-5693-bbcc-61718932a5cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ69357',
 'listing': 'auction',
 'location': 'DE',
 'make': 'DS Automobiles',
 'model': 'DS3 Crossback',
 'odometer': 45548,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea77ddc3-e24b-5693-bbcc-61718932a5cc/ea77ddc3-e24b-5693-bbcc-61718932a5cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_8228cb96fea2ecee2a0ced04f4a66f45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea77ddc3-e24b-5693-bbcc-61718932a5cc/ea77ddc3-e24b-5693-bbcc-61718932a5cc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_20a5593320a7c475e1377929385540be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea77ddc3-e24b-5693-bbcc-61718932a5cc/ea77ddc3-e24b-5693-bbcc-61718932a5cc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_6a69c16fbfb4ef5c5db1d67d45def4e1.jpg',
             'Width': 768},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea77ddc3-e24b-5693-bbcc-61718932a5cc/ea77ddc3-e24b-5693-bbcc-61718932a5cc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83613,
             'Height': 571,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_b0aec0fa6b9194ba848c7888ef2ccf76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea77ddc3-e24b-5693-bbcc-61718932a5cc/ea77ddc3-e24b-5693-bbcc-61718932a5cc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_aaaa474722db19634ac79051c3645e40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea77ddc3-e24b-5693-bbcc-61718932a5cc/ea77ddc3-e24b-5693-bbcc-61718932a5cc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_e86d6a9654609744279002a2b5997510.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea77ddc3-e24b-5693-bbcc-61718932a5cc/ea77ddc3-e24b-5693-bbcc-61718932a5cc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_d9ceaf8424b5cb3e5aa1c46ce774c93a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea77ddc3-e24b-5693-bbcc-61718932a5cc/ea77ddc3-e24b-5693-bbcc-61718932a5cc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_6057f6537c26d0bf086b3bf1b328a60c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea77ddc3-e24b-5693-bbcc-61718932a5cc/ea77ddc3-e24b-5693-bbcc-61718932a5cc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_9232f665a75786af9f0cf7126d272b0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea77ddc3-e24b-5693-bbcc-61718932a5cc/ea77ddc3-e24b-5693-bbcc-61718932a5cc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/9d/ea9dba8780dad00c678d4832e5104559/pa/SZ69357_20089905745d816788601cdb60782b53.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS3 Crossback 1.2 PureTech So Chic',
 'transmission': 'manual',
 'trim': 'So Chic',
 'year': 2020}
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ69357%27 HTTP/1.1" 200 None
2026-03-27 10:35:49 [auto1.de] INFO: Saving data for SZ69357: {'created_time': 1774607749.196827, 'last_price_update_time': 1774607749.196839, 'auction_closing_time': 1774716203.0}
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ69357') HTTP/1.1" 204 0
2026-03-27 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS01373/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LH67751> (referer: https://www.auto1.com/v1/car-details-view/LH67751/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE15652/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baeb855d-c619-571d-8227-3504a3316b6a with identifier: LH67751
2026-03-27 10:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baeb855d-c619-571d-8227-3504a3316b6a with scrape type 1
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item baeb855d-c619-571d-8227-3504a3316b6a
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F7f%252F637fa7854170f3d48d6f7a0cfd19cb04%252Fpa%252FLH67751_4517175ecd8595ebfa30d21168fe04bb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_4517175ecd8595ebfa30d21168fe04bb.jpg not downloaded yet
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F7f%252F637fa7854170f3d48d6f7a0cfd19cb04%252Fpa%252FLH67751_b6d99bc214b66c904e82fa6d6acb9a7c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_b6d99bc214b66c904e82fa6d6acb9a7c.jpg not downloaded yet
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F7f%252F637fa7854170f3d48d6f7a0cfd19cb04%252Fpa%252FLH67751_951af2390d3f225bd87e4172494cf056.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_951af2390d3f225bd87e4172494cf056.jpg not downloaded yet
2026-03-27 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CR88792/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F7f%252F637fa7854170f3d48d6f7a0cfd19cb04%252Fpa%252FLH67751_dd10c6ec69e67243b7f23a7bcbccf290.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_dd10c6ec69e67243b7f23a7bcbccf290.jpg not downloaded yet
2026-03-27 10:35:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F7f%252F637fa7854170f3d48d6f7a0cfd19cb04%252Fpa%252FLH67751_012738705aeee4ba6f321cc8223d437d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_012738705aeee4ba6f321cc8223d437d.jpg not downloaded yet
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F7f%252F637fa7854170f3d48d6f7a0cfd19cb04%252Fpa%252FLH67751_913da465ad7f0f9e04d0741dfc95da27.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_913da465ad7f0f9e04d0741dfc95da27.jpg not downloaded yet
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F7f%252F637fa7854170f3d48d6f7a0cfd19cb04%252Fpa%252FLH67751_5ef5f345b86e28f8d914eb4066f4d245.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_5ef5f345b86e28f8d914eb4066f4d245.jpg not downloaded yet
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F7f%252F637fa7854170f3d48d6f7a0cfd19cb04%252Fpa%252FLH67751_58aabe4cc635a2f9c0e935510bf6c0ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_58aabe4cc635a2f9c0e935510bf6c0ca.jpg not downloaded yet
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F7f%252F637fa7854170f3d48d6f7a0cfd19cb04%252Fpa%252FLH67751_cb63fff881bdad45658ff86898617053.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_cb63fff881bdad45658ff86898617053.jpg not downloaded yet
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F7f%252F637fa7854170f3d48d6f7a0cfd19cb04%252Fpa%252FLH67751_8f42b7c490184e4703310d05862eff52.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_8f42b7c490184e4703310d05862eff52.jpg not downloaded yet
2026-03-27 10:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:51 [auto1.de] INFO: Channel: 24h | Page: 5 | totalHits: 10495 | hits on page: 40
2026-03-27 10:35:51 [auto1.de] INFO: Found listing with ID: BE15343
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE15343%27 HTTP/1.1" 200 None
2026-03-27 10:35:51 [auto1.de] INFO: Scrape type for BE15343: 1
2026-03-27 10:35:51 [auto1.de] INFO: Found listing with ID: JZ96778
2026-03-27 10:35:51 [auto1.de] INFO: Found listing with ID: CK62580
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62580%27 HTTP/1.1" 200 None
2026-03-27 10:35:51 [auto1.de] INFO: Scrape type for CK62580: 1
2026-03-27 10:35:51 [auto1.de] INFO: Found listing with ID: GB74339
2026-03-27 10:35:51 [auto1.de] INFO: Found listing with ID: ZP86837
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP86837%27 HTTP/1.1" 200 None
2026-03-27 10:35:51 [auto1.de] INFO: Scrape type for ZP86837: 1
2026-03-27 10:35:51 [auto1.de] INFO: Found listing with ID: YS13064
2026-03-27 10:35:51 [auto1.de] INFO: Found listing with ID: DW23670
2026-03-27 10:35:51 [auto1.de] INFO: Found listing with ID: TL45864
2026-03-27 10:35:51 [auto1.de] INFO: Found listing with ID: BD42318
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD42318%27 HTTP/1.1" 200 None
2026-03-27 10:35:51 [auto1.de] INFO: Scrape type for BD42318: 2
2026-03-27 10:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc54d6a4-0fb1-5961-bd3c-16f3cb81a875 with identifier: BD42318
2026-03-27 10:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc54d6a4-0fb1-5961-bd3c-16f3cb81a875 with scrape type 2
2026-03-27 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc54d6a4-0fb1-5961-bd3c-16f3cb81a875 with scrape type 2
2026-03-27 10:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc54d6a4-0fb1-5961-bd3c-16f3cb81a875, identifier: BD42318
2026-03-27 10:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc54d6a4-0fb1-5961-bd3c-16f3cb81a875 with identifier: BD42318
2026-03-27 10:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc54d6a4-0fb1-5961-bd3c-16f3cb81a875 with identifier: BD42318
2026-03-27 10:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc54d6a4-0fb1-5961-bd3c-16f3cb81a875 with identifier: BD42318 to the API
2026-03-27 10:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:17:59Z',
 'fuel_type': 'diesel',
 'id': 'fc54d6a4-0fb1-5961-bd3c-16f3cb81a875',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD42318',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 237268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-13',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 d T 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': 'T 4Matic AMG Line',
 'year': 2018}
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD42318%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [auto1.de] INFO: Saving data for BD42318: {'auction_closing_time': 1774714679.0, 'created_time': 1773228097.361381, 'last_price_update_time': 1774607752.218147}
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD42318') HTTP/1.1" 204 0
2026-03-27 10:35:52 [auto1.de] INFO: Found listing with ID: KH43158
2026-03-27 10:35:52 [auto1.de] INFO: Found listing with ID: BE44691
2026-03-27 10:35:52 [auto1.de] INFO: Found listing with ID: WR03810
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR03810%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [auto1.de] INFO: Scrape type for WR03810: 1
2026-03-27 10:35:52 [auto1.de] INFO: Found listing with ID: JM99769
2026-03-27 10:35:52 [auto1.de] INFO: Found listing with ID: YR74432
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR74432%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [auto1.de] INFO: Scrape type for YR74432: 1
2026-03-27 10:35:52 [auto1.de] INFO: Found listing with ID: PR23937
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23937%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [auto1.de] INFO: Scrape type for PR23937: 1
2026-03-27 10:35:52 [auto1.de] INFO: Found listing with ID: GB59587
2026-03-27 10:35:52 [auto1.de] INFO: Found listing with ID: WN28352
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN28352%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [auto1.de] INFO: Scrape type for WN28352: 1
2026-03-27 10:35:52 [auto1.de] INFO: Found listing with ID: FX80624
2026-03-27 10:35:52 [auto1.de] INFO: Found listing with ID: AF42457
2026-03-27 10:35:52 [auto1.de] INFO: Found listing with ID: WZ14073
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ14073%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [auto1.de] INFO: Scrape type for WZ14073: 1
2026-03-27 10:35:52 [auto1.de] INFO: Found listing with ID: JD23896
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD23896%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [auto1.de] INFO: Scrape type for JD23896: 1
2026-03-27 10:35:52 [auto1.de] INFO: Found listing with ID: ES42650
2026-03-27 10:35:52 [auto1.de] INFO: Found listing with ID: JB03726
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB03726%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [auto1.de] INFO: Scrape type for JB03726: 2
2026-03-27 10:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb7cb431-cfe0-5600-9637-9f23e580151b with identifier: JB03726
2026-03-27 10:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb7cb431-cfe0-5600-9637-9f23e580151b with scrape type 2
2026-03-27 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb7cb431-cfe0-5600-9637-9f23e580151b with scrape type 2
2026-03-27 10:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb7cb431-cfe0-5600-9637-9f23e580151b, identifier: JB03726
2026-03-27 10:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb7cb431-cfe0-5600-9637-9f23e580151b with identifier: JB03726
2026-03-27 10:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb7cb431-cfe0-5600-9637-9f23e580151b with identifier: JB03726
2026-03-27 10:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb7cb431-cfe0-5600-9637-9f23e580151b with identifier: JB03726 to the API
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:38:14Z',
 'fuel_type': 'diesel',
 'id': 'bb7cb431-cfe0-5600-9637-9f23e580151b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB03726',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 149175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-25',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB03726%27 HTTP/1.1" 200 None
2026-03-27 10:35:52 [auto1.de] INFO: Saving data for JB03726: {'auction_closing_time': 1774715894.0, 'created_time': 1773341203.426903, 'last_price_update_time': 1774607752.960597}
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB03726') HTTP/1.1" 204 0
2026-03-27 10:35:53 [auto1.de] INFO: Found listing with ID: EA13561
2026-03-27 10:35:53 [auto1.de] INFO: Found listing with ID: GJ05712
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ05712%27 HTTP/1.1" 200 None
2026-03-27 10:35:53 [auto1.de] INFO: Scrape type for GJ05712: 2
2026-03-27 10:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 229e9702-9c5e-5161-a439-cf962bb05127 with identifier: GJ05712
2026-03-27 10:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 229e9702-9c5e-5161-a439-cf962bb05127 with scrape type 2
2026-03-27 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 229e9702-9c5e-5161-a439-cf962bb05127 with scrape type 2
2026-03-27 10:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 229e9702-9c5e-5161-a439-cf962bb05127, identifier: GJ05712
2026-03-27 10:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 229e9702-9c5e-5161-a439-cf962bb05127 with identifier: GJ05712
2026-03-27 10:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 229e9702-9c5e-5161-a439-cf962bb05127 with identifier: GJ05712
2026-03-27 10:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 229e9702-9c5e-5161-a439-cf962bb05127 with identifier: GJ05712 to the API
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:24:58Z',
 'fuel_type': 'petrol',
 'id': '229e9702-9c5e-5161-a439-cf962bb05127',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ05712',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 199160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Style',
 'year': 2013}
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ05712%27 HTTP/1.1" 200 None
2026-03-27 10:35:53 [auto1.de] INFO: Saving data for GJ05712: {'auction_closing_time': 1774715098.0, 'created_time': 1773383453.145624, 'last_price_update_time': 1774607753.619678}
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ05712') HTTP/1.1" 204 0
2026-03-27 10:35:53 [auto1.de] INFO: Found listing with ID: KK06519
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK06519%27 HTTP/1.1" 200 None
2026-03-27 10:35:53 [auto1.de] INFO: Scrape type for KK06519: 2
2026-03-27 10:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0146879-0287-542e-b052-34b9c77493ae with identifier: KK06519
2026-03-27 10:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0146879-0287-542e-b052-34b9c77493ae with scrape type 2
2026-03-27 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0146879-0287-542e-b052-34b9c77493ae with scrape type 2
2026-03-27 10:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0146879-0287-542e-b052-34b9c77493ae, identifier: KK06519
2026-03-27 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AN46464> (referer: https://www.auto1.com/v1/car-details-view/AN46464/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0146879-0287-542e-b052-34b9c77493ae with identifier: KK06519
2026-03-27 10:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0146879-0287-542e-b052-34b9c77493ae with identifier: KK06519
2026-03-27 10:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0146879-0287-542e-b052-34b9c77493ae with identifier: KK06519 to the API
2026-03-27 10:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:33:15Z',
 'fuel_type': 'diesel',
 'id': 'c0146879-0287-542e-b052-34b9c77493ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK06519',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XE',
 'odometer': 112733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-30',
 'seller_name': None,
 'title': 'Jaguar XE 20d Prestige',
 'transmission': 'automatic',
 'trim': 'Prestige',
 'year': 2015}
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK06519%27 HTTP/1.1" 200 None
2026-03-27 10:35:54 [auto1.de] INFO: Saving data for KK06519: {'auction_closing_time': 1774715595.0, 'created_time': 1774034603.13968, 'last_price_update_time': 1774607754.283485}
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK06519') HTTP/1.1" 204 0
2026-03-27 10:35:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:54 [auto1.de] INFO: Found listing with ID: AB35938
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB35938%27 HTTP/1.1" 200 None
2026-03-27 10:35:54 [auto1.de] INFO: Scrape type for AB35938: 1
2026-03-27 10:35:54 [auto1.de] INFO: Found listing with ID: KT29520
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT29520%27 HTTP/1.1" 200 None
2026-03-27 10:35:54 [auto1.de] INFO: Scrape type for KT29520: 1
2026-03-27 10:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6351d24-e791-578a-85a9-ad351bd10293 with identifier: AN46464
2026-03-27 10:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6351d24-e791-578a-85a9-ad351bd10293 with scrape type 1
2026-03-27 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a6351d24-e791-578a-85a9-ad351bd10293
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F96%252F1f96d15169bddcf952a580498b4ee8f7%252Fpa%252FAN46464_905f79ec563f19f3cec307975b18ee79.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_905f79ec563f19f3cec307975b18ee79.jpg not downloaded yet
2026-03-27 10:35:54 [auto1.de] INFO: Found listing with ID: TR96754
2026-03-27 10:35:54 [auto1.de] INFO: Found listing with ID: GH02109
2026-03-27 10:35:54 [auto1.de] INFO: Found listing with ID: RP70991
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP70991%27 HTTP/1.1" 200 None
2026-03-27 10:35:54 [auto1.de] INFO: Scrape type for RP70991: 1
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F96%252F1f96d15169bddcf952a580498b4ee8f7%252Fpa%252FAN46464_874c43e1b62944cbad8297b82f75dfdd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_874c43e1b62944cbad8297b82f75dfdd.jpg not downloaded yet
2026-03-27 10:35:54 [auto1.de] INFO: Found listing with ID: SS89253
2026-03-27 10:35:54 [auto1.de] INFO: Found listing with ID: TX63688
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX63688%27 HTTP/1.1" 200 None
2026-03-27 10:35:54 [auto1.de] INFO: Scrape type for TX63688: 1
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F96%252F1f96d15169bddcf952a580498b4ee8f7%252Fpa%252FAN46464_e32831fed2b5e1205b9ea0f3cd8d16d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_e32831fed2b5e1205b9ea0f3cd8d16d5.jpg not downloaded yet
2026-03-27 10:35:54 [auto1.de] INFO: Found listing with ID: SM09769
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09769%27 HTTP/1.1" 200 None
2026-03-27 10:35:54 [auto1.de] INFO: Scrape type for SM09769: 1
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F96%252F1f96d15169bddcf952a580498b4ee8f7%252Fpa%252FAN46464_cc5515a8904e47012b87ab17f380612f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_cc5515a8904e47012b87ab17f380612f.jpg not downloaded yet
2026-03-27 10:35:54 [auto1.de] INFO: Found listing with ID: HY59950
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY59950%27 HTTP/1.1" 200 None
2026-03-27 10:35:54 [auto1.de] INFO: Scrape type for HY59950: 1
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F96%252F1f96d15169bddcf952a580498b4ee8f7%252Fpa%252FAN46464_b5e1851e82fd596d6eb300959627818e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_b5e1851e82fd596d6eb300959627818e.jpg not downloaded yet
2026-03-27 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_8f42b7c490184e4703310d05862eff52.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:54 [auto1.de] INFO: Found listing with ID: JN13946
2026-03-27 10:35:54 [auto1.de] INFO: Found listing with ID: TP66547
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP66547%27 HTTP/1.1" 200 None
2026-03-27 10:35:54 [auto1.de] INFO: Scrape type for TP66547: 2
2026-03-27 10:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fce11b67-18e3-52af-b042-c85f648a1906 with identifier: TP66547
2026-03-27 10:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fce11b67-18e3-52af-b042-c85f648a1906 with scrape type 2
2026-03-27 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fce11b67-18e3-52af-b042-c85f648a1906 with scrape type 2
2026-03-27 10:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fce11b67-18e3-52af-b042-c85f648a1906, identifier: TP66547
2026-03-27 10:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fce11b67-18e3-52af-b042-c85f648a1906 with identifier: TP66547
2026-03-27 10:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fce11b67-18e3-52af-b042-c85f648a1906 with identifier: TP66547
2026-03-27 10:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fce11b67-18e3-52af-b042-c85f648a1906 with identifier: TP66547 to the API
2026-03-27 10:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:32:15Z',
 'fuel_type': 'diesel',
 'id': 'fce11b67-18e3-52af-b042-c85f648a1906',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP66547',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Grandis',
 'odometer': 204619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-04',
 'seller_name': None,
 'title': 'Mitsubishi Grandis 2.0 DI-D Intense',
 'transmission': 'manual',
 'trim': 'Intense',
 'year': 2008}
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP66547%27 HTTP/1.1" 200 None
2026-03-27 10:35:55 [auto1.de] INFO: Saving data for TP66547: {'auction_closing_time': 1774715535.0, 'created_time': 1773380910.472055, 'last_price_update_time': 1774607755.340872}
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP66547') HTTP/1.1" 204 0
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F96%252F1f96d15169bddcf952a580498b4ee8f7%252Fpa%252FAN46464_d7e0307e9dad80044ab665888e1d1457.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_d7e0307e9dad80044ab665888e1d1457.jpg not downloaded yet
2026-03-27 10:35:55 [auto1.de] INFO: Found listing with ID: JS13151
2026-03-27 10:35:55 [auto1.de] INFO: Found listing with ID: PV56207
2026-03-27 10:35:55 [auto1.de] INFO: Found listing with ID: WR99181
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F96%252F1f96d15169bddcf952a580498b4ee8f7%252Fpa%252FAN46464_6fb94872dfc8645bef58c8a301cc7df3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_6fb94872dfc8645bef58c8a301cc7df3.jpg not downloaded yet
2026-03-27 10:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BY27711/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a19d90>
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baeb855d-c619-571d-8227-3504a3316b6a/baeb855d-c619-571d-8227-3504a3316b6a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F7f%252F637fa7854170f3d48d6f7a0cfd19cb04%252Fpa%252FLH67751_8f42b7c490184e4703310d05862eff52.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_8f42b7c490184e4703310d05862eff52.jpg saved to cache
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item baeb855d-c619-571d-8227-3504a3316b6a
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F96%252F1f96d15169bddcf952a580498b4ee8f7%252Fpa%252FAN46464_b67b16a6b46df55c459b739c7fd55b52.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_b67b16a6b46df55c459b739c7fd55b52.jpg not downloaded yet
2026-03-27 10:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_b5e1851e82fd596d6eb300959627818e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F96%252F1f96d15169bddcf952a580498b4ee8f7%252Fpa%252FAN46464_784d64df59cd77928c75ced006d207ee.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_784d64df59cd77928c75ced006d207ee.jpg not downloaded yet
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F96%252F1f96d15169bddcf952a580498b4ee8f7%252Fpa%252FAN46464_571daa28f9c8c61a3ec47efccff3bb6f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_571daa28f9c8c61a3ec47efccff3bb6f.jpg not downloaded yet
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c0610>
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6351d24-e791-578a-85a9-ad351bd10293/a6351d24-e791-578a-85a9-ad351bd10293_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F96%252F1f96d15169bddcf952a580498b4ee8f7%252Fpa%252FAN46464_b5e1851e82fd596d6eb300959627818e.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_b5e1851e82fd596d6eb300959627818e.jpg saved to cache
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6351d24-e791-578a-85a9-ad351bd10293
2026-03-27 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_b67b16a6b46df55c459b739c7fd55b52.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50378f550>
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6351d24-e791-578a-85a9-ad351bd10293/a6351d24-e791-578a-85a9-ad351bd10293_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F96%252F1f96d15169bddcf952a580498b4ee8f7%252Fpa%252FAN46464_b67b16a6b46df55c459b739c7fd55b52.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_b67b16a6b46df55c459b739c7fd55b52.jpg saved to cache
2026-03-27 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6351d24-e791-578a-85a9-ad351bd10293
2026-03-27 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_571daa28f9c8c61a3ec47efccff3bb6f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_6fb94872dfc8645bef58c8a301cc7df3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50169a450>
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6351d24-e791-578a-85a9-ad351bd10293/a6351d24-e791-578a-85a9-ad351bd10293_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F96%252F1f96d15169bddcf952a580498b4ee8f7%252Fpa%252FAN46464_571daa28f9c8c61a3ec47efccff3bb6f.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_571daa28f9c8c61a3ec47efccff3bb6f.jpg saved to cache
2026-03-27 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a6351d24-e791-578a-85a9-ad351bd10293
2026-03-27 10:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB26055/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d0650>
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6351d24-e791-578a-85a9-ad351bd10293/a6351d24-e791-578a-85a9-ad351bd10293_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F96%252F1f96d15169bddcf952a580498b4ee8f7%252Fpa%252FAN46464_6fb94872dfc8645bef58c8a301cc7df3.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_6fb94872dfc8645bef58c8a301cc7df3.jpg saved to cache
2026-03-27 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6351d24-e791-578a-85a9-ad351bd10293
2026-03-27 10:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_784d64df59cd77928c75ced006d207ee.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501891d50>
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6351d24-e791-578a-85a9-ad351bd10293/a6351d24-e791-578a-85a9-ad351bd10293_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F96%252F1f96d15169bddcf952a580498b4ee8f7%252Fpa%252FAN46464_784d64df59cd77928c75ced006d207ee.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_784d64df59cd77928c75ced006d207ee.jpg saved to cache
2026-03-27 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a6351d24-e791-578a-85a9-ad351bd10293
2026-03-27 10:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_d7e0307e9dad80044ab665888e1d1457.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f2690>
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6351d24-e791-578a-85a9-ad351bd10293/a6351d24-e791-578a-85a9-ad351bd10293_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F96%252F1f96d15169bddcf952a580498b4ee8f7%252Fpa%252FAN46464_d7e0307e9dad80044ab665888e1d1457.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_d7e0307e9dad80044ab665888e1d1457.jpg saved to cache
2026-03-27 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6351d24-e791-578a-85a9-ad351bd10293
2026-03-27 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NU23717/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_cc5515a8904e47012b87ab17f380612f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501899110>
2026-03-27 10:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6351d24-e791-578a-85a9-ad351bd10293/a6351d24-e791-578a-85a9-ad351bd10293_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F96%252F1f96d15169bddcf952a580498b4ee8f7%252Fpa%252FAN46464_cc5515a8904e47012b87ab17f380612f.jpg') HTTP/1.1" 204 0
2026-03-27 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_cc5515a8904e47012b87ab17f380612f.jpg saved to cache
2026-03-27 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6351d24-e791-578a-85a9-ad351bd10293
2026-03-27 10:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ82929> (referer: https://www.auto1.com/v1/car-details-view/UZ82929/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27bb1249-b18c-5c8c-9e08-9cae316cae5c with identifier: UZ82929
2026-03-27 10:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27bb1249-b18c-5c8c-9e08-9cae316cae5c with scrape type 1
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27bb1249-b18c-5c8c-9e08-9cae316cae5c
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F40%252F61406a856cf8418342667d2e8557da56%252Fpa%252FUZ82929_170230c8ca8b790a3cb40994ac5e5f0b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_170230c8ca8b790a3cb40994ac5e5f0b.jpg not downloaded yet
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F40%252F61406a856cf8418342667d2e8557da56%252Fpa%252FUZ82929_9aeed37faa6ad9eb14241c89c405d6f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_9aeed37faa6ad9eb14241c89c405d6f6.jpg not downloaded yet
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F40%252F61406a856cf8418342667d2e8557da56%252Fpa%252FUZ82929_db34a43bde279e32a5afee3ac4941771.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_db34a43bde279e32a5afee3ac4941771.jpg not downloaded yet
2026-03-27 10:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU03537> (referer: https://www.auto1.com/v1/car-details-view/YU03537/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F40%252F61406a856cf8418342667d2e8557da56%252Fpa%252FUZ82929_cfc663ad6ed371973c27a120c26cbdf0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_cfc663ad6ed371973c27a120c26cbdf0.jpg not downloaded yet
2026-03-27 10:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F40%252F61406a856cf8418342667d2e8557da56%252Fpa%252FUZ82929_1e5d1a7cd44d8d6f08c798de3d44cb3c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_1e5d1a7cd44d8d6f08c798de3d44cb3c.jpg not downloaded yet
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F40%252F61406a856cf8418342667d2e8557da56%252Fpa%252FUZ82929_abc481ae7ee59f73fab63b9bbb71e64d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_abc481ae7ee59f73fab63b9bbb71e64d.jpg not downloaded yet
2026-03-27 10:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF57736> (referer: https://www.auto1.com/v1/car-details-view/RF57736/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F40%252F61406a856cf8418342667d2e8557da56%252Fpa%252FUZ82929_1620ee5ba9ea1e19e2fe8a2bd184bd2f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_1620ee5ba9ea1e19e2fe8a2bd184bd2f.jpg not downloaded yet
2026-03-27 10:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F40%252F61406a856cf8418342667d2e8557da56%252Fpa%252FUZ82929_e9d6a04666e3c3d83fa4fa65ce11c6e8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_e9d6a04666e3c3d83fa4fa65ce11c6e8.jpg not downloaded yet
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F40%252F61406a856cf8418342667d2e8557da56%252Fpa%252FUZ82929_3860a25ee51ef75d9f3589b4d514ace6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_3860a25ee51ef75d9f3589b4d514ace6.jpg not downloaded yet
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F40%252F61406a856cf8418342667d2e8557da56%252Fpa%252FUZ82929_c9626d898e16c6d06a7d04bfd9ba4405.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_c9626d898e16c6d06a7d04bfd9ba4405.jpg not downloaded yet
2026-03-27 10:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 747ae73a-61b7-58de-b89c-2d8d5ea910c3 with identifier: YU03537
2026-03-27 10:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747ae73a-61b7-58de-b89c-2d8d5ea910c3 with scrape type 1
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 747ae73a-61b7-58de-b89c-2d8d5ea910c3
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd3%252Fecd3657146580e8ce7d53d68d13016ec%252Fpa%252FYU03537_4fd4c5bbe52226dab5c3d19c472f9d6f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_4fd4c5bbe52226dab5c3d19c472f9d6f.jpg not downloaded yet
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd3%252Fecd3657146580e8ce7d53d68d13016ec%252Fpa%252FYU03537_3045e249025cd8c939b9528e68db9507.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_3045e249025cd8c939b9528e68db9507.jpg not downloaded yet
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd3%252Fecd3657146580e8ce7d53d68d13016ec%252Fpa%252FYU03537_862095bd9f9542ea689a08093a273390.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_862095bd9f9542ea689a08093a273390.jpg not downloaded yet
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd3%252Fecd3657146580e8ce7d53d68d13016ec%252Fpa%252FYU03537_f0397fdfa055a1fabb07faf36316b093.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_f0397fdfa055a1fabb07faf36316b093.jpg not downloaded yet
2026-03-27 10:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a85389bb-8ff1-5858-9efd-d645ce49dcd6 with identifier: RF57736
2026-03-27 10:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a85389bb-8ff1-5858-9efd-d645ce49dcd6 with scrape type 1
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a85389bb-8ff1-5858-9efd-d645ce49dcd6
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0e30892676ac59d6a6cd4d3101c2b%252Fpa%252FRF57736_69b362fa39df3f5b708b17cc200a3c0d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_69b362fa39df3f5b708b17cc200a3c0d.jpg not downloaded yet
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd3%252Fecd3657146580e8ce7d53d68d13016ec%252Fpa%252FYU03537_f1b2fe876448fe80645fb15058123523.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_f1b2fe876448fe80645fb15058123523.jpg not downloaded yet
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0e30892676ac59d6a6cd4d3101c2b%252Fpa%252FRF57736_c7392592ff0734ba4cf45ca007713da3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_c7392592ff0734ba4cf45ca007713da3.jpg not downloaded yet
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd3%252Fecd3657146580e8ce7d53d68d13016ec%252Fpa%252FYU03537_a477246c79b5d51d7ab21b85707a689e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_a477246c79b5d51d7ab21b85707a689e.jpg not downloaded yet
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0e30892676ac59d6a6cd4d3101c2b%252Fpa%252FRF57736_f6547d4d9567c8246ee65cdbebe39739.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_f6547d4d9567c8246ee65cdbebe39739.jpg not downloaded yet
2026-03-27 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_abc481ae7ee59f73fab63b9bbb71e64d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd3%252Fecd3657146580e8ce7d53d68d13016ec%252Fpa%252FYU03537_3761ab61f60d17bbfd554257cc28f19f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_3761ab61f60d17bbfd554257cc28f19f.jpg not downloaded yet
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0e30892676ac59d6a6cd4d3101c2b%252Fpa%252FRF57736_ee5d7de18b21d55d34e8d71a5028038b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_ee5d7de18b21d55d34e8d71a5028038b.jpg not downloaded yet
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd3%252Fecd3657146580e8ce7d53d68d13016ec%252Fpa%252FYU03537_b894e9cfc6c68715c11b9484cf45916d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_b894e9cfc6c68715c11b9484cf45916d.jpg not downloaded yet
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0e30892676ac59d6a6cd4d3101c2b%252Fpa%252FRF57736_c2745fbf47718f19583c61ae19951f67.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_c2745fbf47718f19583c61ae19951f67.jpg not downloaded yet
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd3%252Fecd3657146580e8ce7d53d68d13016ec%252Fpa%252FYU03537_6abd9a5678139eaeaad6bee99fc2dc22.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_6abd9a5678139eaeaad6bee99fc2dc22.jpg not downloaded yet
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0e30892676ac59d6a6cd4d3101c2b%252Fpa%252FRF57736_661451769906b9ec7c86291f8e3541fe.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_661451769906b9ec7c86291f8e3541fe.jpg not downloaded yet
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd3%252Fecd3657146580e8ce7d53d68d13016ec%252Fpa%252FYU03537_961aa9d7758a416ace8afea691a87bb0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_961aa9d7758a416ace8afea691a87bb0.jpg not downloaded yet
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0e30892676ac59d6a6cd4d3101c2b%252Fpa%252FRF57736_f437452347a31512f416a740fe6a3f1e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_f437452347a31512f416a740fe6a3f1e.jpg not downloaded yet
2026-03-27 10:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50373fd10>
2026-03-27 10:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27bb1249-b18c-5c8c-9e08-9cae316cae5c/27bb1249-b18c-5c8c-9e08-9cae316cae5c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F40%252F61406a856cf8418342667d2e8557da56%252Fpa%252FUZ82929_abc481ae7ee59f73fab63b9bbb71e64d.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_abc481ae7ee59f73fab63b9bbb71e64d.jpg saved to cache
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27bb1249-b18c-5c8c-9e08-9cae316cae5c
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0e30892676ac59d6a6cd4d3101c2b%252Fpa%252FRF57736_687fff93c3b437b72e984c3ddd91de0b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_687fff93c3b437b72e984c3ddd91de0b.jpg not downloaded yet
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0e30892676ac59d6a6cd4d3101c2b%252Fpa%252FRF57736_a0da89b13ab9f7e963fbef25a49538d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_a0da89b13ab9f7e963fbef25a49538d6.jpg not downloaded yet
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0e30892676ac59d6a6cd4d3101c2b%252Fpa%252FRF57736_874c4ec8edac5ba15bc7cc8c75f2435d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_874c4ec8edac5ba15bc7cc8c75f2435d.jpg not downloaded yet
2026-03-27 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_db34a43bde279e32a5afee3ac4941771.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_f6547d4d9567c8246ee65cdbebe39739.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501787bd0>
2026-03-27 10:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27bb1249-b18c-5c8c-9e08-9cae316cae5c/27bb1249-b18c-5c8c-9e08-9cae316cae5c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F40%252F61406a856cf8418342667d2e8557da56%252Fpa%252FUZ82929_db34a43bde279e32a5afee3ac4941771.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_db34a43bde279e32a5afee3ac4941771.jpg saved to cache
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27bb1249-b18c-5c8c-9e08-9cae316cae5c
2026-03-27 10:36:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016416d0>
2026-03-27 10:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a85389bb-8ff1-5858-9efd-d645ce49dcd6/a85389bb-8ff1-5858-9efd-d645ce49dcd6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0e30892676ac59d6a6cd4d3101c2b%252Fpa%252FRF57736_f6547d4d9567c8246ee65cdbebe39739.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_f6547d4d9567c8246ee65cdbebe39739.jpg saved to cache
2026-03-27 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a85389bb-8ff1-5858-9efd-d645ce49dcd6
2026-03-27 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC84828/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_874c4ec8edac5ba15bc7cc8c75f2435d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE15652> (referer: https://www.auto1.com/v1/car-details-view/NE15652/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_a0da89b13ab9f7e963fbef25a49538d6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50181a150>
2026-03-27 10:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a85389bb-8ff1-5858-9efd-d645ce49dcd6/a85389bb-8ff1-5858-9efd-d645ce49dcd6_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0e30892676ac59d6a6cd4d3101c2b%252Fpa%252FRF57736_874c4ec8edac5ba15bc7cc8c75f2435d.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_874c4ec8edac5ba15bc7cc8c75f2435d.jpg saved to cache
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a85389bb-8ff1-5858-9efd-d645ce49dcd6
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_687fff93c3b437b72e984c3ddd91de0b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bfbccf7-7c56-5133-902d-fff59677f178 with identifier: NE15652
2026-03-27 10:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bfbccf7-7c56-5133-902d-fff59677f178 with scrape type 1
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1bfbccf7-7c56-5133-902d-fff59677f178
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F33%252Fff33bf30c645c8ca1aa57270caf63934%252Fpa%252FNE15652_05a8c7b5126aae54a0ffce97155ec763.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_05a8c7b5126aae54a0ffce97155ec763.jpg not downloaded yet
2026-03-27 10:36:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501787510>
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a85389bb-8ff1-5858-9efd-d645ce49dcd6/a85389bb-8ff1-5858-9efd-d645ce49dcd6_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0e30892676ac59d6a6cd4d3101c2b%252Fpa%252FRF57736_a0da89b13ab9f7e963fbef25a49538d6.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_a0da89b13ab9f7e963fbef25a49538d6.jpg saved to cache
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a85389bb-8ff1-5858-9efd-d645ce49dcd6
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_961aa9d7758a416ace8afea691a87bb0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F33%252Fff33bf30c645c8ca1aa57270caf63934%252Fpa%252FNE15652_99bb9f02f683ad1bcf1949d6ced3d7cd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_99bb9f02f683ad1bcf1949d6ced3d7cd.jpg not downloaded yet
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F33%252Fff33bf30c645c8ca1aa57270caf63934%252Fpa%252FNE15652_c24cd564a11572271a8cb8a31bba7bde.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_c24cd564a11572271a8cb8a31bba7bde.jpg not downloaded yet
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501819c50>
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a85389bb-8ff1-5858-9efd-d645ce49dcd6/a85389bb-8ff1-5858-9efd-d645ce49dcd6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0e30892676ac59d6a6cd4d3101c2b%252Fpa%252FRF57736_687fff93c3b437b72e984c3ddd91de0b.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_687fff93c3b437b72e984c3ddd91de0b.jpg saved to cache
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a85389bb-8ff1-5858-9efd-d645ce49dcd6
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F33%252Fff33bf30c645c8ca1aa57270caf63934%252Fpa%252FNE15652_862b7ebd5849f0beb7bd33050eb03c2f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_862b7ebd5849f0beb7bd33050eb03c2f.jpg not downloaded yet
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F33%252Fff33bf30c645c8ca1aa57270caf63934%252Fpa%252FNE15652_aa9a2e9d3e020c39b4a9d16ef080c21c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_aa9a2e9d3e020c39b4a9d16ef080c21c.jpg not downloaded yet
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_05a8c7b5126aae54a0ffce97155ec763.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F33%252Fff33bf30c645c8ca1aa57270caf63934%252Fpa%252FNE15652_d917f8c1bb808528daad7df055df1b8a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_d917f8c1bb808528daad7df055df1b8a.jpg not downloaded yet
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F33%252Fff33bf30c645c8ca1aa57270caf63934%252Fpa%252FNE15652_bd92fbe7afcc168c5a70cee166bc4674.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_bd92fbe7afcc168c5a70cee166bc4674.jpg not downloaded yet
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a62d0>
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747ae73a-61b7-58de-b89c-2d8d5ea910c3/747ae73a-61b7-58de-b89c-2d8d5ea910c3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd3%252Fecd3657146580e8ce7d53d68d13016ec%252Fpa%252FYU03537_961aa9d7758a416ace8afea691a87bb0.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_961aa9d7758a416ace8afea691a87bb0.jpg saved to cache
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 747ae73a-61b7-58de-b89c-2d8d5ea910c3
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_661451769906b9ec7c86291f8e3541fe.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F33%252Fff33bf30c645c8ca1aa57270caf63934%252Fpa%252FNE15652_85a15f89cc69dbe6ac0de14d3233a84c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_85a15f89cc69dbe6ac0de14d3233a84c.jpg not downloaded yet
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F33%252Fff33bf30c645c8ca1aa57270caf63934%252Fpa%252FNE15652_bbd31b860df7b03c9428d99261f1150f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_bbd31b860df7b03c9428d99261f1150f.jpg not downloaded yet
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F33%252Fff33bf30c645c8ca1aa57270caf63934%252Fpa%252FNE15652_cd76ffb1efe551c08d86253bac2a205e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_cd76ffb1efe551c08d86253bac2a205e.jpg not downloaded yet
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501650dd0>
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bfbccf7-7c56-5133-902d-fff59677f178/1bfbccf7-7c56-5133-902d-fff59677f178_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F33%252Fff33bf30c645c8ca1aa57270caf63934%252Fpa%252FNE15652_05a8c7b5126aae54a0ffce97155ec763.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_05a8c7b5126aae54a0ffce97155ec763.jpg saved to cache
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1bfbccf7-7c56-5133-902d-fff59677f178
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JD23896/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501768a90>
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a85389bb-8ff1-5858-9efd-d645ce49dcd6/a85389bb-8ff1-5858-9efd-d645ce49dcd6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0e30892676ac59d6a6cd4d3101c2b%252Fpa%252FRF57736_661451769906b9ec7c86291f8e3541fe.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_661451769906b9ec7c86291f8e3541fe.jpg saved to cache
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a85389bb-8ff1-5858-9efd-d645ce49dcd6
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_aa9a2e9d3e020c39b4a9d16ef080c21c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_f437452347a31512f416a740fe6a3f1e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_bd92fbe7afcc168c5a70cee166bc4674.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH94566/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS01373> (referer: https://www.auto1.com/v1/car-details-view/TS01373/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50199aa50>
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bfbccf7-7c56-5133-902d-fff59677f178/1bfbccf7-7c56-5133-902d-fff59677f178_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F33%252Fff33bf30c645c8ca1aa57270caf63934%252Fpa%252FNE15652_aa9a2e9d3e020c39b4a9d16ef080c21c.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_aa9a2e9d3e020c39b4a9d16ef080c21c.jpg saved to cache
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1bfbccf7-7c56-5133-902d-fff59677f178
2026-03-27 10:36:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501680150>
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a85389bb-8ff1-5858-9efd-d645ce49dcd6/a85389bb-8ff1-5858-9efd-d645ce49dcd6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0e30892676ac59d6a6cd4d3101c2b%252Fpa%252FRF57736_f437452347a31512f416a740fe6a3f1e.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_f437452347a31512f416a740fe6a3f1e.jpg saved to cache
2026-03-27 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a85389bb-8ff1-5858-9efd-d645ce49dcd6
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c9190>
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bfbccf7-7c56-5133-902d-fff59677f178/1bfbccf7-7c56-5133-902d-fff59677f178_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F33%252Fff33bf30c645c8ca1aa57270caf63934%252Fpa%252FNE15652_bd92fbe7afcc168c5a70cee166bc4674.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_bd92fbe7afcc168c5a70cee166bc4674.jpg saved to cache
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1bfbccf7-7c56-5133-902d-fff59677f178
2026-03-27 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_cd76ffb1efe551c08d86253bac2a205e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_862b7ebd5849f0beb7bd33050eb03c2f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_85a15f89cc69dbe6ac0de14d3233a84c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_bbd31b860df7b03c9428d99261f1150f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_d917f8c1bb808528daad7df055df1b8a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GB33155> (referer: https://www.auto1.com/v1/car-details-view/GB33155/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fe319b1-9968-5a96-9201-ef26ae508395 with identifier: TS01373
2026-03-27 10:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fe319b1-9968-5a96-9201-ef26ae508395 with scrape type 1
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5fe319b1-9968-5a96-9201-ef26ae508395
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F24%252F79249799f01f8d504b11674faeee834f%252Fpa%252FTS01373_1d62ebfca5d3678bb53a497c7f84dfa9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_1d62ebfca5d3678bb53a497c7f84dfa9.jpg not downloaded yet
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F24%252F79249799f01f8d504b11674faeee834f%252Fpa%252FTS01373_993b7ea124ded310fe37a1622796684b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_993b7ea124ded310fe37a1622796684b.jpg not downloaded yet
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F24%252F79249799f01f8d504b11674faeee834f%252Fpa%252FTS01373_db7fa79574d80fc280995c7a1cecea0f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_db7fa79574d80fc280995c7a1cecea0f.jpg not downloaded yet
2026-03-27 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_c24cd564a11572271a8cb8a31bba7bde.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_6abd9a5678139eaeaad6bee99fc2dc22.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F24%252F79249799f01f8d504b11674faeee834f%252Fpa%252FTS01373_5193dcd7f776705c87398234b55b93fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_5193dcd7f776705c87398234b55b93fc.jpg not downloaded yet
2026-03-27 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_99bb9f02f683ad1bcf1949d6ced3d7cd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F24%252F79249799f01f8d504b11674faeee834f%252Fpa%252FTS01373_4294d3d1258d86e417085083a400dae6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_4294d3d1258d86e417085083a400dae6.jpg not downloaded yet
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F24%252F79249799f01f8d504b11674faeee834f%252Fpa%252FTS01373_1709c813abf78252c48b19a0c74518d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_1709c813abf78252c48b19a0c74518d5.jpg not downloaded yet
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500501f50>
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bfbccf7-7c56-5133-902d-fff59677f178/1bfbccf7-7c56-5133-902d-fff59677f178_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F33%252Fff33bf30c645c8ca1aa57270caf63934%252Fpa%252FNE15652_cd76ffb1efe551c08d86253bac2a205e.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_cd76ffb1efe551c08d86253bac2a205e.jpg saved to cache
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1bfbccf7-7c56-5133-902d-fff59677f178
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016b1c50>
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bfbccf7-7c56-5133-902d-fff59677f178/1bfbccf7-7c56-5133-902d-fff59677f178_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F33%252Fff33bf30c645c8ca1aa57270caf63934%252Fpa%252FNE15652_862b7ebd5849f0beb7bd33050eb03c2f.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_862b7ebd5849f0beb7bd33050eb03c2f.jpg saved to cache
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1bfbccf7-7c56-5133-902d-fff59677f178
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a2790>
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bfbccf7-7c56-5133-902d-fff59677f178/1bfbccf7-7c56-5133-902d-fff59677f178_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F33%252Fff33bf30c645c8ca1aa57270caf63934%252Fpa%252FNE15652_85a15f89cc69dbe6ac0de14d3233a84c.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_85a15f89cc69dbe6ac0de14d3233a84c.jpg saved to cache
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1bfbccf7-7c56-5133-902d-fff59677f178
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501730290>
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bfbccf7-7c56-5133-902d-fff59677f178/1bfbccf7-7c56-5133-902d-fff59677f178_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F33%252Fff33bf30c645c8ca1aa57270caf63934%252Fpa%252FNE15652_bbd31b860df7b03c9428d99261f1150f.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_bbd31b860df7b03c9428d99261f1150f.jpg saved to cache
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1bfbccf7-7c56-5133-902d-fff59677f178
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50032c810>
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bfbccf7-7c56-5133-902d-fff59677f178/1bfbccf7-7c56-5133-902d-fff59677f178_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F33%252Fff33bf30c645c8ca1aa57270caf63934%252Fpa%252FNE15652_d917f8c1bb808528daad7df055df1b8a.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_d917f8c1bb808528daad7df055df1b8a.jpg saved to cache
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1bfbccf7-7c56-5133-902d-fff59677f178
2026-03-27 10:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4513884a-a292-5c24-86ce-a6b7efa1127a with identifier: GB33155
2026-03-27 10:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4513884a-a292-5c24-86ce-a6b7efa1127a with scrape type 1
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4513884a-a292-5c24-86ce-a6b7efa1127a
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fda%252Fbfdad1bbf786fef655e2046abd2375e4%252Fpa%252FGB33155_090e2040e7bd17cd3b6bcec7774c63d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_090e2040e7bd17cd3b6bcec7774c63d4.jpg not downloaded yet
2026-03-27 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_ee5d7de18b21d55d34e8d71a5028038b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F24%252F79249799f01f8d504b11674faeee834f%252Fpa%252FTS01373_51e219dc9c81c873a8050ade65312042.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_51e219dc9c81c873a8050ade65312042.jpg not downloaded yet
2026-03-27 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_5193dcd7f776705c87398234b55b93fc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_1d62ebfca5d3678bb53a497c7f84dfa9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fda%252Fbfdad1bbf786fef655e2046abd2375e4%252Fpa%252FGB33155_5cf652331132b77cb30bed22942ac6d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_5cf652331132b77cb30bed22942ac6d4.jpg not downloaded yet
2026-03-27 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_b894e9cfc6c68715c11b9484cf45916d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_993b7ea124ded310fe37a1622796684b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F24%252F79249799f01f8d504b11674faeee834f%252Fpa%252FTS01373_a3967fc34e8636c46599683483f20dd7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_a3967fc34e8636c46599683483f20dd7.jpg not downloaded yet
2026-03-27 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RG24592> (referer: https://www.auto1.com/v1/car-details-view/RG24592/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fda%252Fbfdad1bbf786fef655e2046abd2375e4%252Fpa%252FGB33155_584e002f2d76ae6c5282eeb948dca1ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_584e002f2d76ae6c5282eeb948dca1ea.jpg not downloaded yet
2026-03-27 10:36:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a0cd0>
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bfbccf7-7c56-5133-902d-fff59677f178/1bfbccf7-7c56-5133-902d-fff59677f178_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F33%252Fff33bf30c645c8ca1aa57270caf63934%252Fpa%252FNE15652_c24cd564a11572271a8cb8a31bba7bde.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_c24cd564a11572271a8cb8a31bba7bde.jpg saved to cache
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1bfbccf7-7c56-5133-902d-fff59677f178
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a0b50>
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747ae73a-61b7-58de-b89c-2d8d5ea910c3/747ae73a-61b7-58de-b89c-2d8d5ea910c3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd3%252Fecd3657146580e8ce7d53d68d13016ec%252Fpa%252FYU03537_6abd9a5678139eaeaad6bee99fc2dc22.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_6abd9a5678139eaeaad6bee99fc2dc22.jpg saved to cache
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 747ae73a-61b7-58de-b89c-2d8d5ea910c3
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501712010>
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bfbccf7-7c56-5133-902d-fff59677f178/1bfbccf7-7c56-5133-902d-fff59677f178_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F33%252Fff33bf30c645c8ca1aa57270caf63934%252Fpa%252FNE15652_99bb9f02f683ad1bcf1949d6ced3d7cd.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_99bb9f02f683ad1bcf1949d6ced3d7cd.jpg saved to cache
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1bfbccf7-7c56-5133-902d-fff59677f178
2026-03-27 10:36:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1bfbccf7-7c56-5133-902d-fff59677f178, skipping ID generation
2026-03-27 10:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bfbccf7-7c56-5133-902d-fff59677f178 with scrape type 1
2026-03-27 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1bfbccf7-7c56-5133-902d-fff59677f178 sending to next pipeline
2026-03-27 10:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1bfbccf7-7c56-5133-902d-fff59677f178, identifier: NE15652
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F24%252F79249799f01f8d504b11674faeee834f%252Fpa%252FTS01373_04013415fb73bef982a659bc257c131c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_04013415fb73bef982a659bc257c131c.jpg not downloaded yet
2026-03-27 10:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1bfbccf7-7c56-5133-902d-fff59677f178 with identifier: NE15652
2026-03-27 10:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1bfbccf7-7c56-5133-902d-fff59677f178 with identifier: NE15652
2026-03-27 10:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1bfbccf7-7c56-5133-902d-fff59677f178 with identifier: NE15652 to the API
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_99bb9f02f683ad1bcf1949d6ced3d7cd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 67,
 'expiration_date': '2026-03-28T16:09:15Z',
 'fuel_type': 'petrol',
 'id': '1bfbccf7-7c56-5133-902d-fff59677f178',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE15652',
 'listing': 'auction',
 'location': 'DE, Freiburg im Breisgau',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 166645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bfbccf7-7c56-5133-902d-fff59677f178/1bfbccf7-7c56-5133-902d-fff59677f178_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_05a8c7b5126aae54a0ffce97155ec763.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bfbccf7-7c56-5133-902d-fff59677f178/1bfbccf7-7c56-5133-902d-fff59677f178_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_99bb9f02f683ad1bcf1949d6ced3d7cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bfbccf7-7c56-5133-902d-fff59677f178/1bfbccf7-7c56-5133-902d-fff59677f178_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_c24cd564a11572271a8cb8a31bba7bde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bfbccf7-7c56-5133-902d-fff59677f178/1bfbccf7-7c56-5133-902d-fff59677f178_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_862b7ebd5849f0beb7bd33050eb03c2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bfbccf7-7c56-5133-902d-fff59677f178/1bfbccf7-7c56-5133-902d-fff59677f178_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_aa9a2e9d3e020c39b4a9d16ef080c21c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bfbccf7-7c56-5133-902d-fff59677f178/1bfbccf7-7c56-5133-902d-fff59677f178_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_d917f8c1bb808528daad7df055df1b8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bfbccf7-7c56-5133-902d-fff59677f178/1bfbccf7-7c56-5133-902d-fff59677f178_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_bd92fbe7afcc168c5a70cee166bc4674.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bfbccf7-7c56-5133-902d-fff59677f178/1bfbccf7-7c56-5133-902d-fff59677f178_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_85a15f89cc69dbe6ac0de14d3233a84c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bfbccf7-7c56-5133-902d-fff59677f178/1bfbccf7-7c56-5133-902d-fff59677f178_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_bbd31b860df7b03c9428d99261f1150f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bfbccf7-7c56-5133-902d-fff59677f178/1bfbccf7-7c56-5133-902d-fff59677f178_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/33/ff33bf30c645c8ca1aa57270caf63934/pa/NE15652_cd76ffb1efe551c08d86253bac2a205e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Pure',
 'transmission': 'manual',
 'trim': 'Pure',
 'year': 2019}
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE15652%27 HTTP/1.1" 200 None
2026-03-27 10:36:03 [auto1.de] INFO: Saving data for NE15652: {'created_time': 1774607763.861742, 'last_price_update_time': 1774607763.861752, 'auction_closing_time': 1774714155.0}
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE15652') HTTP/1.1" 204 0
2026-03-27 10:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_4294d3d1258d86e417085083a400dae6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_1709c813abf78252c48b19a0c74518d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fda%252Fbfdad1bbf786fef655e2046abd2375e4%252Fpa%252FGB33155_a7d6288c813a97b3071a7284141b35db.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_a7d6288c813a97b3071a7284141b35db.jpg not downloaded yet
2026-03-27 10:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_51e219dc9c81c873a8050ade65312042.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F24%252F79249799f01f8d504b11674faeee834f%252Fpa%252FTS01373_95ce61f968ac2ef3f788e1ad16470b3f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_95ce61f968ac2ef3f788e1ad16470b3f.jpg not downloaded yet
2026-03-27 10:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a06d0>
2026-03-27 10:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a85389bb-8ff1-5858-9efd-d645ce49dcd6/a85389bb-8ff1-5858-9efd-d645ce49dcd6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0e30892676ac59d6a6cd4d3101c2b%252Fpa%252FRF57736_ee5d7de18b21d55d34e8d71a5028038b.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_ee5d7de18b21d55d34e8d71a5028038b.jpg saved to cache
2026-03-27 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a85389bb-8ff1-5858-9efd-d645ce49dcd6
2026-03-27 10:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017afcd0>
2026-03-27 10:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe319b1-9968-5a96-9201-ef26ae508395/5fe319b1-9968-5a96-9201-ef26ae508395_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F24%252F79249799f01f8d504b11674faeee834f%252Fpa%252FTS01373_5193dcd7f776705c87398234b55b93fc.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_5193dcd7f776705c87398234b55b93fc.jpg saved to cache
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5fe319b1-9968-5a96-9201-ef26ae508395
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016df190>
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe319b1-9968-5a96-9201-ef26ae508395/5fe319b1-9968-5a96-9201-ef26ae508395_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F24%252F79249799f01f8d504b11674faeee834f%252Fpa%252FTS01373_1d62ebfca5d3678bb53a497c7f84dfa9.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_1d62ebfca5d3678bb53a497c7f84dfa9.jpg saved to cache
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5fe319b1-9968-5a96-9201-ef26ae508395
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501947c50>
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747ae73a-61b7-58de-b89c-2d8d5ea910c3/747ae73a-61b7-58de-b89c-2d8d5ea910c3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd3%252Fecd3657146580e8ce7d53d68d13016ec%252Fpa%252FYU03537_b894e9cfc6c68715c11b9484cf45916d.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_b894e9cfc6c68715c11b9484cf45916d.jpg saved to cache
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 747ae73a-61b7-58de-b89c-2d8d5ea910c3
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002ff4d0>
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe319b1-9968-5a96-9201-ef26ae508395/5fe319b1-9968-5a96-9201-ef26ae508395_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F24%252F79249799f01f8d504b11674faeee834f%252Fpa%252FTS01373_993b7ea124ded310fe37a1622796684b.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_993b7ea124ded310fe37a1622796684b.jpg saved to cache
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5fe319b1-9968-5a96-9201-ef26ae508395
2026-03-27 10:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8030f373-9224-5af6-91df-0fd2caf4c796 with identifier: RG24592
2026-03-27 10:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8030f373-9224-5af6-91df-0fd2caf4c796 with scrape type 1
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8030f373-9224-5af6-91df-0fd2caf4c796
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a3982d5d4671029ed277a3fd5ab4e13%252Fpa%252FRG24592_ee2be7c8ceaf40417f75a69fada5b65c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_ee2be7c8ceaf40417f75a69fada5b65c.jpg not downloaded yet
2026-03-27 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_db7fa79574d80fc280995c7a1cecea0f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fda%252Fbfdad1bbf786fef655e2046abd2375e4%252Fpa%252FGB33155_3a938366b06d330f5acd80da280ee013.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_3a938366b06d330f5acd80da280ee013.jpg not downloaded yet
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a3982d5d4671029ed277a3fd5ab4e13%252Fpa%252FRG24592_8b89fc646b538ac8ff4736f964b8ed66.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_8b89fc646b538ac8ff4736f964b8ed66.jpg not downloaded yet
2026-03-27 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_5cf652331132b77cb30bed22942ac6d4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fda%252Fbfdad1bbf786fef655e2046abd2375e4%252Fpa%252FGB33155_054094ca0d73f69e5d0b16b124d291c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_054094ca0d73f69e5d0b16b124d291c5.jpg not downloaded yet
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015d1ed0>
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe319b1-9968-5a96-9201-ef26ae508395/5fe319b1-9968-5a96-9201-ef26ae508395_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F24%252F79249799f01f8d504b11674faeee834f%252Fpa%252FTS01373_4294d3d1258d86e417085083a400dae6.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_4294d3d1258d86e417085083a400dae6.jpg saved to cache
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5fe319b1-9968-5a96-9201-ef26ae508395
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f8850>
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe319b1-9968-5a96-9201-ef26ae508395/5fe319b1-9968-5a96-9201-ef26ae508395_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F24%252F79249799f01f8d504b11674faeee834f%252Fpa%252FTS01373_1709c813abf78252c48b19a0c74518d5.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_1709c813abf78252c48b19a0c74518d5.jpg saved to cache
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5fe319b1-9968-5a96-9201-ef26ae508395
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f0ed0>
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe319b1-9968-5a96-9201-ef26ae508395/5fe319b1-9968-5a96-9201-ef26ae508395_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F24%252F79249799f01f8d504b11674faeee834f%252Fpa%252FTS01373_51e219dc9c81c873a8050ade65312042.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_51e219dc9c81c873a8050ade65312042.jpg saved to cache
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5fe319b1-9968-5a96-9201-ef26ae508395
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a3982d5d4671029ed277a3fd5ab4e13%252Fpa%252FRG24592_5535c6f151f4f9987373a85d0c5ed00d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_5535c6f151f4f9987373a85d0c5ed00d.jpg not downloaded yet
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fda%252Fbfdad1bbf786fef655e2046abd2375e4%252Fpa%252FGB33155_ae199b7563c3f8f8a787bfb6d8ba39fd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_ae199b7563c3f8f8a787bfb6d8ba39fd.jpg not downloaded yet
2026-03-27 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_a3967fc34e8636c46599683483f20dd7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_04013415fb73bef982a659bc257c131c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_584e002f2d76ae6c5282eeb948dca1ea.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a3982d5d4671029ed277a3fd5ab4e13%252Fpa%252FRG24592_39883995f2463b5589dcb56dee197072.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_39883995f2463b5589dcb56dee197072.jpg not downloaded yet
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501787bd0>
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe319b1-9968-5a96-9201-ef26ae508395/5fe319b1-9968-5a96-9201-ef26ae508395_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F24%252F79249799f01f8d504b11674faeee834f%252Fpa%252FTS01373_db7fa79574d80fc280995c7a1cecea0f.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_db7fa79574d80fc280995c7a1cecea0f.jpg saved to cache
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5fe319b1-9968-5a96-9201-ef26ae508395
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017690d0>
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4513884a-a292-5c24-86ce-a6b7efa1127a/4513884a-a292-5c24-86ce-a6b7efa1127a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fda%252Fbfdad1bbf786fef655e2046abd2375e4%252Fpa%252FGB33155_5cf652331132b77cb30bed22942ac6d4.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_5cf652331132b77cb30bed22942ac6d4.jpg saved to cache
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4513884a-a292-5c24-86ce-a6b7efa1127a
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fda%252Fbfdad1bbf786fef655e2046abd2375e4%252Fpa%252FGB33155_c0cd8e8220ecd5cd071d2420d02e6ceb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_c0cd8e8220ecd5cd071d2420d02e6ceb.jpg not downloaded yet
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a3982d5d4671029ed277a3fd5ab4e13%252Fpa%252FRG24592_0ec6329db1906632a6f3e3ce7a9b0a41.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_0ec6329db1906632a6f3e3ce7a9b0a41.jpg not downloaded yet
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fda%252Fbfdad1bbf786fef655e2046abd2375e4%252Fpa%252FGB33155_dbaee7f9612a56c3bfae9ac709e3b0ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_dbaee7f9612a56c3bfae9ac709e3b0ef.jpg not downloaded yet
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500348910>
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe319b1-9968-5a96-9201-ef26ae508395/5fe319b1-9968-5a96-9201-ef26ae508395_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F24%252F79249799f01f8d504b11674faeee834f%252Fpa%252FTS01373_a3967fc34e8636c46599683483f20dd7.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_a3967fc34e8636c46599683483f20dd7.jpg saved to cache
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5fe319b1-9968-5a96-9201-ef26ae508395
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016b0910>
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe319b1-9968-5a96-9201-ef26ae508395/5fe319b1-9968-5a96-9201-ef26ae508395_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F24%252F79249799f01f8d504b11674faeee834f%252Fpa%252FTS01373_04013415fb73bef982a659bc257c131c.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_04013415fb73bef982a659bc257c131c.jpg saved to cache
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5fe319b1-9968-5a96-9201-ef26ae508395
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017e5fd0>
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4513884a-a292-5c24-86ce-a6b7efa1127a/4513884a-a292-5c24-86ce-a6b7efa1127a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fda%252Fbfdad1bbf786fef655e2046abd2375e4%252Fpa%252FGB33155_584e002f2d76ae6c5282eeb948dca1ea.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_584e002f2d76ae6c5282eeb948dca1ea.jpg saved to cache
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4513884a-a292-5c24-86ce-a6b7efa1127a
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a3982d5d4671029ed277a3fd5ab4e13%252Fpa%252FRG24592_000796a5e517d009d4701f79f5ad07cd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_000796a5e517d009d4701f79f5ad07cd.jpg not downloaded yet
2026-03-27 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_8b89fc646b538ac8ff4736f964b8ed66.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fda%252Fbfdad1bbf786fef655e2046abd2375e4%252Fpa%252FGB33155_a37ba812b0169bf1b58df0e630972962.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_a37ba812b0169bf1b58df0e630972962.jpg not downloaded yet
2026-03-27 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_5535c6f151f4f9987373a85d0c5ed00d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a3982d5d4671029ed277a3fd5ab4e13%252Fpa%252FRG24592_4b9038d1c10fbaa099049e106e0c7447.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_4b9038d1c10fbaa099049e106e0c7447.jpg not downloaded yet
2026-03-27 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HY59950/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a3982d5d4671029ed277a3fd5ab4e13%252Fpa%252FRG24592_9b367bd8298fee2742d2888b1f261e44.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_9b367bd8298fee2742d2888b1f261e44.jpg not downloaded yet
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a3982d5d4671029ed277a3fd5ab4e13%252Fpa%252FRG24592_006e0632c196ba05121979ee70296eaa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_006e0632c196ba05121979ee70296eaa.jpg not downloaded yet
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a3982d5d4671029ed277a3fd5ab4e13%252Fpa%252FRG24592_08b64278e76c49bfcf48c8b305df98a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_08b64278e76c49bfcf48c8b305df98a1.jpg not downloaded yet
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500557f10>
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8030f373-9224-5af6-91df-0fd2caf4c796/8030f373-9224-5af6-91df-0fd2caf4c796_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a3982d5d4671029ed277a3fd5ab4e13%252Fpa%252FRG24592_8b89fc646b538ac8ff4736f964b8ed66.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_8b89fc646b538ac8ff4736f964b8ed66.jpg saved to cache
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8030f373-9224-5af6-91df-0fd2caf4c796
2026-03-27 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_000796a5e517d009d4701f79f5ad07cd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_c2745fbf47718f19583c61ae19951f67.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016fe550>
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8030f373-9224-5af6-91df-0fd2caf4c796/8030f373-9224-5af6-91df-0fd2caf4c796_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a3982d5d4671029ed277a3fd5ab4e13%252Fpa%252FRG24592_5535c6f151f4f9987373a85d0c5ed00d.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_5535c6f151f4f9987373a85d0c5ed00d.jpg saved to cache
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8030f373-9224-5af6-91df-0fd2caf4c796
2026-03-27 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_dbaee7f9612a56c3bfae9ac709e3b0ef.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BY27711> (referer: https://www.auto1.com/v1/car-details-view/BY27711/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_090e2040e7bd17cd3b6bcec7774c63d4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_a7d6288c813a97b3071a7284141b35db.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_a37ba812b0169bf1b58df0e630972962.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_3a938366b06d330f5acd80da280ee013.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_054094ca0d73f69e5d0b16b124d291c5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003407d0>
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8030f373-9224-5af6-91df-0fd2caf4c796/8030f373-9224-5af6-91df-0fd2caf4c796_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a3982d5d4671029ed277a3fd5ab4e13%252Fpa%252FRG24592_000796a5e517d009d4701f79f5ad07cd.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_000796a5e517d009d4701f79f5ad07cd.jpg saved to cache
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8030f373-9224-5af6-91df-0fd2caf4c796
2026-03-27 10:36:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501867bd0>
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a85389bb-8ff1-5858-9efd-d645ce49dcd6/a85389bb-8ff1-5858-9efd-d645ce49dcd6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0e30892676ac59d6a6cd4d3101c2b%252Fpa%252FRF57736_c2745fbf47718f19583c61ae19951f67.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_c2745fbf47718f19583c61ae19951f67.jpg saved to cache
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a85389bb-8ff1-5858-9efd-d645ce49dcd6
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50178cd90>
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4513884a-a292-5c24-86ce-a6b7efa1127a/4513884a-a292-5c24-86ce-a6b7efa1127a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fda%252Fbfdad1bbf786fef655e2046abd2375e4%252Fpa%252FGB33155_dbaee7f9612a56c3bfae9ac709e3b0ef.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_dbaee7f9612a56c3bfae9ac709e3b0ef.jpg saved to cache
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4513884a-a292-5c24-86ce-a6b7efa1127a
2026-03-27 10:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49f266ec-86ce-5b3f-9d5c-96c75ba2b041 with identifier: BY27711
2026-03-27 10:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49f266ec-86ce-5b3f-9d5c-96c75ba2b041 with scrape type 1
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49f266ec-86ce-5b3f-9d5c-96c75ba2b041
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F95%252Fb89588e6408e3e4dfbe2ebba00e2352b%252Fpa%252FBY27711_2cd5215e4dea7a7083a56984e9730d10.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_2cd5215e4dea7a7083a56984e9730d10.jpg not downloaded yet
2026-03-27 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_9b367bd8298fee2742d2888b1f261e44.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F95%252Fb89588e6408e3e4dfbe2ebba00e2352b%252Fpa%252FBY27711_78849118efc0815cefc511fa195471dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_78849118efc0815cefc511fa195471dd.jpg not downloaded yet
2026-03-27 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_08b64278e76c49bfcf48c8b305df98a1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NU23717> (referer: https://www.auto1.com/v1/car-details-view/NU23717/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F95%252Fb89588e6408e3e4dfbe2ebba00e2352b%252Fpa%252FBY27711_a15d09145f9a331cec162a9e7078d920.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_a15d09145f9a331cec162a9e7078d920.jpg not downloaded yet
2026-03-27 10:36:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501651c90>
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4513884a-a292-5c24-86ce-a6b7efa1127a/4513884a-a292-5c24-86ce-a6b7efa1127a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fda%252Fbfdad1bbf786fef655e2046abd2375e4%252Fpa%252FGB33155_090e2040e7bd17cd3b6bcec7774c63d4.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_090e2040e7bd17cd3b6bcec7774c63d4.jpg saved to cache
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4513884a-a292-5c24-86ce-a6b7efa1127a
2026-03-27 10:36:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004ef450>
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4513884a-a292-5c24-86ce-a6b7efa1127a/4513884a-a292-5c24-86ce-a6b7efa1127a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fda%252Fbfdad1bbf786fef655e2046abd2375e4%252Fpa%252FGB33155_a7d6288c813a97b3071a7284141b35db.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_a7d6288c813a97b3071a7284141b35db.jpg saved to cache
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4513884a-a292-5c24-86ce-a6b7efa1127a
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500597f50>
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4513884a-a292-5c24-86ce-a6b7efa1127a/4513884a-a292-5c24-86ce-a6b7efa1127a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fda%252Fbfdad1bbf786fef655e2046abd2375e4%252Fpa%252FGB33155_a37ba812b0169bf1b58df0e630972962.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_a37ba812b0169bf1b58df0e630972962.jpg saved to cache
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4513884a-a292-5c24-86ce-a6b7efa1127a
2026-03-27 10:36:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501751f50>
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4513884a-a292-5c24-86ce-a6b7efa1127a/4513884a-a292-5c24-86ce-a6b7efa1127a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fda%252Fbfdad1bbf786fef655e2046abd2375e4%252Fpa%252FGB33155_3a938366b06d330f5acd80da280ee013.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_3a938366b06d330f5acd80da280ee013.jpg saved to cache
2026-03-27 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4513884a-a292-5c24-86ce-a6b7efa1127a
2026-03-27 10:36:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50034a710>
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4513884a-a292-5c24-86ce-a6b7efa1127a/4513884a-a292-5c24-86ce-a6b7efa1127a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fda%252Fbfdad1bbf786fef655e2046abd2375e4%252Fpa%252FGB33155_054094ca0d73f69e5d0b16b124d291c5.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_054094ca0d73f69e5d0b16b124d291c5.jpg saved to cache
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4513884a-a292-5c24-86ce-a6b7efa1127a
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F95%252Fb89588e6408e3e4dfbe2ebba00e2352b%252Fpa%252FBY27711_3af26e356d209dbab4915e93ad8eca59.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_3af26e356d209dbab4915e93ad8eca59.jpg not downloaded yet
2026-03-27 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JD23896> (referer: https://www.auto1.com/v1/car-details-view/JD23896/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F95%252Fb89588e6408e3e4dfbe2ebba00e2352b%252Fpa%252FBY27711_a167f97c2c15c583e0dc9dc16eb290d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_a167f97c2c15c583e0dc9dc16eb290d4.jpg not downloaded yet
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500570d90>
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8030f373-9224-5af6-91df-0fd2caf4c796/8030f373-9224-5af6-91df-0fd2caf4c796_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a3982d5d4671029ed277a3fd5ab4e13%252Fpa%252FRG24592_9b367bd8298fee2742d2888b1f261e44.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_9b367bd8298fee2742d2888b1f261e44.jpg saved to cache
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8030f373-9224-5af6-91df-0fd2caf4c796
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017afe50>
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8030f373-9224-5af6-91df-0fd2caf4c796/8030f373-9224-5af6-91df-0fd2caf4c796_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a3982d5d4671029ed277a3fd5ab4e13%252Fpa%252FRG24592_08b64278e76c49bfcf48c8b305df98a1.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_08b64278e76c49bfcf48c8b305df98a1.jpg saved to cache
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8030f373-9224-5af6-91df-0fd2caf4c796
2026-03-27 10:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6 with identifier: NU23717
2026-03-27 10:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6 with scrape type 1
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F83%252Fac83a8cb10c01b0f005be97b6b69f5fa%252Fpa%252FNU23717_aa79ae9413579f9e979b7fcc68e87745.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/83/ac83a8cb10c01b0f005be97b6b69f5fa/pa/NU23717_aa79ae9413579f9e979b7fcc68e87745.jpg already downloaded
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F83%252Fac83a8cb10c01b0f005be97b6b69f5fa%252Fpa%252FNU23717_88f763f3c612aab7157cc329617d24cb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/83/ac83a8cb10c01b0f005be97b6b69f5fa/pa/NU23717_88f763f3c612aab7157cc329617d24cb.jpg already downloaded
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F83%252Fac83a8cb10c01b0f005be97b6b69f5fa%252Fpa%252FNU23717_6e5185b7bde4b5930ae64a25a8401f96.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/83/ac83a8cb10c01b0f005be97b6b69f5fa/pa/NU23717_6e5185b7bde4b5930ae64a25a8401f96.jpg already downloaded
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F83%252Fac83a8cb10c01b0f005be97b6b69f5fa%252Fpa%252FNU23717_9635a652a3d2a407e6502e0c8646506e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/83/ac83a8cb10c01b0f005be97b6b69f5fa/pa/NU23717_9635a652a3d2a407e6502e0c8646506e.jpg already downloaded
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F83%252Fac83a8cb10c01b0f005be97b6b69f5fa%252Fpa%252FNU23717_13590732df46c3ac6a62b07bc9ba293f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/83/ac83a8cb10c01b0f005be97b6b69f5fa/pa/NU23717_13590732df46c3ac6a62b07bc9ba293f.jpg already downloaded
2026-03-27 10:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6, identifier: NU23717
2026-03-27 10:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6 with identifier: NU23717
2026-03-27 10:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6 with identifier: NU23717
2026-03-27 10:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6 with identifier: NU23717 to the API
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NU23717>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:45:52Z',
 'fuel_type': 'diesel',
 'id': 'd66bebd9-b7da-5ea7-a09b-5597a0b9a6e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU23717',
 'listing': 'auction',
 'location': 'DE, München',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 215538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgac/83/ac83a8cb10c01b0f005be97b6b69f5fa/pa/NU23717_aa79ae9413579f9e979b7fcc68e87745.jpg',
                'https://img-pa.auto1.com/imgac/83/ac83a8cb10c01b0f005be97b6b69f5fa/pa/NU23717_88f763f3c612aab7157cc329617d24cb.jpg',
                'https://img-pa.auto1.com/imgac/83/ac83a8cb10c01b0f005be97b6b69f5fa/pa/NU23717_6e5185b7bde4b5930ae64a25a8401f96.jpg',
                'https://img-pa.auto1.com/imgac/83/ac83a8cb10c01b0f005be97b6b69f5fa/pa/NU23717_9635a652a3d2a407e6502e0c8646506e.jpg',
                'https://img-pa.auto1.com/imgac/83/ac83a8cb10c01b0f005be97b6b69f5fa/pa/NU23717_13590732df46c3ac6a62b07bc9ba293f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6/d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/83/ac83a8cb10c01b0f005be97b6b69f5fa/pa/NU23717_aa79ae9413579f9e979b7fcc68e87745.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6/d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/83/ac83a8cb10c01b0f005be97b6b69f5fa/pa/NU23717_88f763f3c612aab7157cc329617d24cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6/d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/83/ac83a8cb10c01b0f005be97b6b69f5fa/pa/NU23717_6e5185b7bde4b5930ae64a25a8401f96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6/d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/83/ac83a8cb10c01b0f005be97b6b69f5fa/pa/NU23717_9635a652a3d2a407e6502e0c8646506e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6/d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/83/ac83a8cb10c01b0f005be97b6b69f5fa/pa/NU23717_13590732df46c3ac6a62b07bc9ba293f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23717%27 HTTP/1.1" 200 None
2026-03-27 10:36:06 [auto1.de] INFO: Saving data for NU23717: {'created_time': 1774607766.965094, 'last_price_update_time': 1774607766.965106, 'auction_closing_time': 1774716352.0}
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU23717') HTTP/1.1" 204 0
2026-03-27 10:36:06 [scrapy.extensions.logstats] INFO: Crawled 86 pages (at 86 pages/min), scraped 27 items (at 27 items/min)
2026-03-27 10:36:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F95%252Fb89588e6408e3e4dfbe2ebba00e2352b%252Fpa%252FBY27711_cfd62ef4d5faa528a78d5c35f1abb7c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_cfd62ef4d5faa528a78d5c35f1abb7c5.jpg not downloaded yet
2026-03-27 10:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_39883995f2463b5589dcb56dee197072.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_2cd5215e4dea7a7083a56984e9730d10.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_c0cd8e8220ecd5cd071d2420d02e6ceb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F95%252Fb89588e6408e3e4dfbe2ebba00e2352b%252Fpa%252FBY27711_31a69dc538192a57c5b6f007cb76e8f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_31a69dc538192a57c5b6f007cb76e8f5.jpg not downloaded yet
2026-03-27 10:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM09769/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML63417> (referer: https://www.auto1.com/v1/car-details-view/ML63417/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ea31509-2755-54ef-b527-7af6b42eddcc with identifier: JD23896
2026-03-27 10:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ea31509-2755-54ef-b527-7af6b42eddcc with scrape type 1
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ea31509-2755-54ef-b527-7af6b42eddcc
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F21%252Fb0217bc495525d8f776f8350bc73faed%252Fpa%252FJD23896_6d924dee3ef47c89aa8a324f4a105631.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_6d924dee3ef47c89aa8a324f4a105631.jpg not downloaded yet
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F95%252Fb89588e6408e3e4dfbe2ebba00e2352b%252Fpa%252FBY27711_0b6b119dabac49ccd08df498a920b1ab.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_0b6b119dabac49ccd08df498a920b1ab.jpg not downloaded yet
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F21%252Fb0217bc495525d8f776f8350bc73faed%252Fpa%252FJD23896_a4dfc3576da60d0be1ccb8659f97322b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_a4dfc3576da60d0be1ccb8659f97322b.jpg not downloaded yet
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F95%252Fb89588e6408e3e4dfbe2ebba00e2352b%252Fpa%252FBY27711_87317b9c10408dc3573342a74826667f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_87317b9c10408dc3573342a74826667f.jpg not downloaded yet
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F21%252Fb0217bc495525d8f776f8350bc73faed%252Fpa%252FJD23896_bfa32e5478ebc2a596b31d228cba8ba7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_bfa32e5478ebc2a596b31d228cba8ba7.jpg not downloaded yet
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F95%252Fb89588e6408e3e4dfbe2ebba00e2352b%252Fpa%252FBY27711_dd9578d3dddb1c1cdae528241422ca81.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_dd9578d3dddb1c1cdae528241422ca81.jpg not downloaded yet
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F21%252Fb0217bc495525d8f776f8350bc73faed%252Fpa%252FJD23896_37852817cc7b7dc61ac509df4c6e479f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_37852817cc7b7dc61ac509df4c6e479f.jpg not downloaded yet
2026-03-27 10:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_ae199b7563c3f8f8a787bfb6d8ba39fd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50176a450>
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8030f373-9224-5af6-91df-0fd2caf4c796/8030f373-9224-5af6-91df-0fd2caf4c796_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a3982d5d4671029ed277a3fd5ab4e13%252Fpa%252FRG24592_39883995f2463b5589dcb56dee197072.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_39883995f2463b5589dcb56dee197072.jpg saved to cache
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8030f373-9224-5af6-91df-0fd2caf4c796
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50163ba50>
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49f266ec-86ce-5b3f-9d5c-96c75ba2b041/49f266ec-86ce-5b3f-9d5c-96c75ba2b041_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F95%252Fb89588e6408e3e4dfbe2ebba00e2352b%252Fpa%252FBY27711_2cd5215e4dea7a7083a56984e9730d10.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_2cd5215e4dea7a7083a56984e9730d10.jpg saved to cache
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49f266ec-86ce-5b3f-9d5c-96c75ba2b041
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501890810>
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4513884a-a292-5c24-86ce-a6b7efa1127a/4513884a-a292-5c24-86ce-a6b7efa1127a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fda%252Fbfdad1bbf786fef655e2046abd2375e4%252Fpa%252FGB33155_c0cd8e8220ecd5cd071d2420d02e6ceb.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_c0cd8e8220ecd5cd071d2420d02e6ceb.jpg saved to cache
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4513884a-a292-5c24-86ce-a6b7efa1127a
2026-03-27 10:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8c48f9e-1c72-5d99-bca9-2c24a87ff617 with identifier: ML63417
2026-03-27 10:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8c48f9e-1c72-5d99-bca9-2c24a87ff617 with scrape type 1
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8c48f9e-1c72-5d99-bca9-2c24a87ff617
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fb9%252F99b973abad2c10d393ed9c09f5aec6d2%252Fpa%252FML63417_f89767a2e1e3d89e3fefc0d970950cbd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_f89767a2e1e3d89e3fefc0d970950cbd.jpg not downloaded yet
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F21%252Fb0217bc495525d8f776f8350bc73faed%252Fpa%252FJD23896_f6075e85e6980f894c9495656ab68729.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_f6075e85e6980f894c9495656ab68729.jpg not downloaded yet
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fb9%252F99b973abad2c10d393ed9c09f5aec6d2%252Fpa%252FML63417_22186e4433bca6ded7173d69a727e68f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_22186e4433bca6ded7173d69a727e68f.jpg not downloaded yet
2026-03-27 10:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_a167f97c2c15c583e0dc9dc16eb290d4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_3af26e356d209dbab4915e93ad8eca59.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F21%252Fb0217bc495525d8f776f8350bc73faed%252Fpa%252FJD23896_5fc458e0448d51d68a50b08333d83c3f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_5fc458e0448d51d68a50b08333d83c3f.jpg not downloaded yet
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fb9%252F99b973abad2c10d393ed9c09f5aec6d2%252Fpa%252FML63417_2d9302cc94c330d584348eb68dee9cd7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_2d9302cc94c330d584348eb68dee9cd7.jpg not downloaded yet
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F21%252Fb0217bc495525d8f776f8350bc73faed%252Fpa%252FJD23896_457baa0226da241507ff31c93849c857.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_457baa0226da241507ff31c93849c857.jpg not downloaded yet
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501639410>
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4513884a-a292-5c24-86ce-a6b7efa1127a/4513884a-a292-5c24-86ce-a6b7efa1127a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fda%252Fbfdad1bbf786fef655e2046abd2375e4%252Fpa%252FGB33155_ae199b7563c3f8f8a787bfb6d8ba39fd.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_ae199b7563c3f8f8a787bfb6d8ba39fd.jpg saved to cache
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4513884a-a292-5c24-86ce-a6b7efa1127a
2026-03-27 10:36:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4513884a-a292-5c24-86ce-a6b7efa1127a, skipping ID generation
2026-03-27 10:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4513884a-a292-5c24-86ce-a6b7efa1127a with scrape type 1
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4513884a-a292-5c24-86ce-a6b7efa1127a sending to next pipeline
2026-03-27 10:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4513884a-a292-5c24-86ce-a6b7efa1127a, identifier: GB33155
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fb9%252F99b973abad2c10d393ed9c09f5aec6d2%252Fpa%252FML63417_26fd5a2dffc13c4df32f9dc83d500020.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_26fd5a2dffc13c4df32f9dc83d500020.jpg not downloaded yet
2026-03-27 10:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4513884a-a292-5c24-86ce-a6b7efa1127a with identifier: GB33155
2026-03-27 10:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4513884a-a292-5c24-86ce-a6b7efa1127a with identifier: GB33155
2026-03-27 10:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4513884a-a292-5c24-86ce-a6b7efa1127a with identifier: GB33155 to the API
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_ae199b7563c3f8f8a787bfb6d8ba39fd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 325,
 'expiration_date': '2026-03-28T16:47:25Z',
 'fuel_type': 'diesel',
 'id': '4513884a-a292-5c24-86ce-a6b7efa1127a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB33155',
 'listing': 'auction',
 'location': 'DE, Ludwigsburg',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 141542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4513884a-a292-5c24-86ce-a6b7efa1127a/4513884a-a292-5c24-86ce-a6b7efa1127a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3028013,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_090e2040e7bd17cd3b6bcec7774c63d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4513884a-a292-5c24-86ce-a6b7efa1127a/4513884a-a292-5c24-86ce-a6b7efa1127a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71072,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_5cf652331132b77cb30bed22942ac6d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4513884a-a292-5c24-86ce-a6b7efa1127a/4513884a-a292-5c24-86ce-a6b7efa1127a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_584e002f2d76ae6c5282eeb948dca1ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4513884a-a292-5c24-86ce-a6b7efa1127a/4513884a-a292-5c24-86ce-a6b7efa1127a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2731015,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_a7d6288c813a97b3071a7284141b35db.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4513884a-a292-5c24-86ce-a6b7efa1127a/4513884a-a292-5c24-86ce-a6b7efa1127a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2981931,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_3a938366b06d330f5acd80da280ee013.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4513884a-a292-5c24-86ce-a6b7efa1127a/4513884a-a292-5c24-86ce-a6b7efa1127a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2788784,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_054094ca0d73f69e5d0b16b124d291c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4513884a-a292-5c24-86ce-a6b7efa1127a/4513884a-a292-5c24-86ce-a6b7efa1127a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_ae199b7563c3f8f8a787bfb6d8ba39fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4513884a-a292-5c24-86ce-a6b7efa1127a/4513884a-a292-5c24-86ce-a6b7efa1127a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_c0cd8e8220ecd5cd071d2420d02e6ceb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4513884a-a292-5c24-86ce-a6b7efa1127a/4513884a-a292-5c24-86ce-a6b7efa1127a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_dbaee7f9612a56c3bfae9ac709e3b0ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4513884a-a292-5c24-86ce-a6b7efa1127a/4513884a-a292-5c24-86ce-a6b7efa1127a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/da/bfdad1bbf786fef655e2046abd2375e4/pa/GB33155_a37ba812b0169bf1b58df0e630972962.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2016}
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB33155%27 HTTP/1.1" 200 None
2026-03-27 10:36:08 [auto1.de] INFO: Saving data for GB33155: {'created_time': 1774607768.059367, 'last_price_update_time': 1774607768.059378, 'auction_closing_time': 1774716445.0}
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB33155') HTTP/1.1" 204 0
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F21%252Fb0217bc495525d8f776f8350bc73faed%252Fpa%252FJD23896_cad1c533da631b18e5698a195261f7d0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_cad1c533da631b18e5698a195261f7d0.jpg not downloaded yet
2026-03-27 10:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_ee2be7c8ceaf40417f75a69fada5b65c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_95ce61f968ac2ef3f788e1ad16470b3f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_cfd62ef4d5faa528a78d5c35f1abb7c5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fb9%252F99b973abad2c10d393ed9c09f5aec6d2%252Fpa%252FML63417_351b201998175e8bfc6bc230c839a1c4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_351b201998175e8bfc6bc230c839a1c4.jpg not downloaded yet
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F21%252Fb0217bc495525d8f776f8350bc73faed%252Fpa%252FJD23896_3b5ea3b4c94b328b965bfd9d3fbcfba4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_3b5ea3b4c94b328b965bfd9d3fbcfba4.jpg not downloaded yet
2026-03-27 10:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50372b050>
2026-03-27 10:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49f266ec-86ce-5b3f-9d5c-96c75ba2b041/49f266ec-86ce-5b3f-9d5c-96c75ba2b041_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F95%252Fb89588e6408e3e4dfbe2ebba00e2352b%252Fpa%252FBY27711_a167f97c2c15c583e0dc9dc16eb290d4.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_a167f97c2c15c583e0dc9dc16eb290d4.jpg saved to cache
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 49f266ec-86ce-5b3f-9d5c-96c75ba2b041
2026-03-27 10:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50057d910>
2026-03-27 10:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49f266ec-86ce-5b3f-9d5c-96c75ba2b041/49f266ec-86ce-5b3f-9d5c-96c75ba2b041_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F95%252Fb89588e6408e3e4dfbe2ebba00e2352b%252Fpa%252FBY27711_3af26e356d209dbab4915e93ad8eca59.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_3af26e356d209dbab4915e93ad8eca59.jpg saved to cache
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49f266ec-86ce-5b3f-9d5c-96c75ba2b041
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fb9%252F99b973abad2c10d393ed9c09f5aec6d2%252Fpa%252FML63417_03b6be5f9b7f093d46c508d9efd4e137.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_03b6be5f9b7f093d46c508d9efd4e137.jpg not downloaded yet
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F21%252Fb0217bc495525d8f776f8350bc73faed%252Fpa%252FJD23896_d65eb0c6cfcb1644cc0be7d787e767f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_d65eb0c6cfcb1644cc0be7d787e767f6.jpg not downloaded yet
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fb9%252F99b973abad2c10d393ed9c09f5aec6d2%252Fpa%252FML63417_d6c3f73cb17c469d3337be710d7e32cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_d6c3f73cb17c469d3337be710d7e32cf.jpg not downloaded yet
2026-03-27 10:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003767d0>
2026-03-27 10:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8030f373-9224-5af6-91df-0fd2caf4c796/8030f373-9224-5af6-91df-0fd2caf4c796_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a3982d5d4671029ed277a3fd5ab4e13%252Fpa%252FRG24592_ee2be7c8ceaf40417f75a69fada5b65c.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_ee2be7c8ceaf40417f75a69fada5b65c.jpg saved to cache
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8030f373-9224-5af6-91df-0fd2caf4c796
2026-03-27 10:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501717d50>
2026-03-27 10:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe319b1-9968-5a96-9201-ef26ae508395/5fe319b1-9968-5a96-9201-ef26ae508395_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F24%252F79249799f01f8d504b11674faeee834f%252Fpa%252FTS01373_95ce61f968ac2ef3f788e1ad16470b3f.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_95ce61f968ac2ef3f788e1ad16470b3f.jpg saved to cache
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5fe319b1-9968-5a96-9201-ef26ae508395
2026-03-27 10:36:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5fe319b1-9968-5a96-9201-ef26ae508395, skipping ID generation
2026-03-27 10:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fe319b1-9968-5a96-9201-ef26ae508395 with scrape type 1
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5fe319b1-9968-5a96-9201-ef26ae508395 sending to next pipeline
2026-03-27 10:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fe319b1-9968-5a96-9201-ef26ae508395, identifier: TS01373
2026-03-27 10:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501651810>
2026-03-27 10:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49f266ec-86ce-5b3f-9d5c-96c75ba2b041/49f266ec-86ce-5b3f-9d5c-96c75ba2b041_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F95%252Fb89588e6408e3e4dfbe2ebba00e2352b%252Fpa%252FBY27711_cfd62ef4d5faa528a78d5c35f1abb7c5.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_cfd62ef4d5faa528a78d5c35f1abb7c5.jpg saved to cache
2026-03-27 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 49f266ec-86ce-5b3f-9d5c-96c75ba2b041
2026-03-27 10:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fe319b1-9968-5a96-9201-ef26ae508395 with identifier: TS01373
2026-03-27 10:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fe319b1-9968-5a96-9201-ef26ae508395 with identifier: TS01373
2026-03-27 10:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fe319b1-9968-5a96-9201-ef26ae508395 with identifier: TS01373 to the API
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_95ce61f968ac2ef3f788e1ad16470b3f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 192,
 'expiration_date': '2026-03-28T16:59:30Z',
 'fuel_type': 'petrol',
 'id': '5fe319b1-9968-5a96-9201-ef26ae508395',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS01373',
 'listing': 'auction',
 'location': 'DE, Lahr',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 70434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe319b1-9968-5a96-9201-ef26ae508395/5fe319b1-9968-5a96-9201-ef26ae508395_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_1d62ebfca5d3678bb53a497c7f84dfa9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe319b1-9968-5a96-9201-ef26ae508395/5fe319b1-9968-5a96-9201-ef26ae508395_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_993b7ea124ded310fe37a1622796684b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe319b1-9968-5a96-9201-ef26ae508395/5fe319b1-9968-5a96-9201-ef26ae508395_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_db7fa79574d80fc280995c7a1cecea0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe319b1-9968-5a96-9201-ef26ae508395/5fe319b1-9968-5a96-9201-ef26ae508395_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_5193dcd7f776705c87398234b55b93fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe319b1-9968-5a96-9201-ef26ae508395/5fe319b1-9968-5a96-9201-ef26ae508395_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_4294d3d1258d86e417085083a400dae6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe319b1-9968-5a96-9201-ef26ae508395/5fe319b1-9968-5a96-9201-ef26ae508395_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_1709c813abf78252c48b19a0c74518d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe319b1-9968-5a96-9201-ef26ae508395/5fe319b1-9968-5a96-9201-ef26ae508395_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_51e219dc9c81c873a8050ade65312042.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe319b1-9968-5a96-9201-ef26ae508395/5fe319b1-9968-5a96-9201-ef26ae508395_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_a3967fc34e8636c46599683483f20dd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe319b1-9968-5a96-9201-ef26ae508395/5fe319b1-9968-5a96-9201-ef26ae508395_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_04013415fb73bef982a659bc257c131c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe319b1-9968-5a96-9201-ef26ae508395/5fe319b1-9968-5a96-9201-ef26ae508395_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/24/79249799f01f8d504b11674faeee834f/pa/TS01373_95ce61f968ac2ef3f788e1ad16470b3f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS01373%27 HTTP/1.1" 200 None
2026-03-27 10:36:09 [auto1.de] INFO: Saving data for TS01373: {'created_time': 1774607769.045483, 'last_price_update_time': 1774607769.045499, 'auction_closing_time': 1774717170.0}
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS01373') HTTP/1.1" 204 0
2026-03-27 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_f89767a2e1e3d89e3fefc0d970950cbd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fb9%252F99b973abad2c10d393ed9c09f5aec6d2%252Fpa%252FML63417_22b0c8ccbce127207105c9eb08f0d852.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_22b0c8ccbce127207105c9eb08f0d852.jpg not downloaded yet
2026-03-27 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_dd9578d3dddb1c1cdae528241422ca81.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_f6075e85e6980f894c9495656ab68729.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fb9%252F99b973abad2c10d393ed9c09f5aec6d2%252Fpa%252FML63417_dd54bcdec020d7d66ae389756cb12b27.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_dd54bcdec020d7d66ae389756cb12b27.jpg not downloaded yet
2026-03-27 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_006e0632c196ba05121979ee70296eaa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fb9%252F99b973abad2c10d393ed9c09f5aec6d2%252Fpa%252FML63417_70d6669deca5f6829454c0016a207b81.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_70d6669deca5f6829454c0016a207b81.jpg not downloaded yet
2026-03-27 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_4b9038d1c10fbaa099049e106e0c7447.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_0ec6329db1906632a6f3e3ce7a9b0a41.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_a15d09145f9a331cec162a9e7078d920.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_78849118efc0815cefc511fa195471dd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_26fd5a2dffc13c4df32f9dc83d500020.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501731cd0>
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c48f9e-1c72-5d99-bca9-2c24a87ff617/c8c48f9e-1c72-5d99-bca9-2c24a87ff617_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fb9%252F99b973abad2c10d393ed9c09f5aec6d2%252Fpa%252FML63417_f89767a2e1e3d89e3fefc0d970950cbd.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_f89767a2e1e3d89e3fefc0d970950cbd.jpg saved to cache
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8c48f9e-1c72-5d99-bca9-2c24a87ff617
2026-03-27 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_70d6669deca5f6829454c0016a207b81.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501617f90>
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49f266ec-86ce-5b3f-9d5c-96c75ba2b041/49f266ec-86ce-5b3f-9d5c-96c75ba2b041_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F95%252Fb89588e6408e3e4dfbe2ebba00e2352b%252Fpa%252FBY27711_dd9578d3dddb1c1cdae528241422ca81.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_dd9578d3dddb1c1cdae528241422ca81.jpg saved to cache
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 49f266ec-86ce-5b3f-9d5c-96c75ba2b041
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c01d0>
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ea31509-2755-54ef-b527-7af6b42eddcc/4ea31509-2755-54ef-b527-7af6b42eddcc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F21%252Fb0217bc495525d8f776f8350bc73faed%252Fpa%252FJD23896_f6075e85e6980f894c9495656ab68729.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_f6075e85e6980f894c9495656ab68729.jpg saved to cache
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ea31509-2755-54ef-b527-7af6b42eddcc
2026-03-27 10:36:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016df050>
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8030f373-9224-5af6-91df-0fd2caf4c796/8030f373-9224-5af6-91df-0fd2caf4c796_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a3982d5d4671029ed277a3fd5ab4e13%252Fpa%252FRG24592_006e0632c196ba05121979ee70296eaa.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_006e0632c196ba05121979ee70296eaa.jpg saved to cache
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8030f373-9224-5af6-91df-0fd2caf4c796
2026-03-27 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_457baa0226da241507ff31c93849c857.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_cad1c533da631b18e5698a195261f7d0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a1c6d0>
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8030f373-9224-5af6-91df-0fd2caf4c796/8030f373-9224-5af6-91df-0fd2caf4c796_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a3982d5d4671029ed277a3fd5ab4e13%252Fpa%252FRG24592_4b9038d1c10fbaa099049e106e0c7447.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_4b9038d1c10fbaa099049e106e0c7447.jpg saved to cache
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8030f373-9224-5af6-91df-0fd2caf4c796
2026-03-27 10:36:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500596490>
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8030f373-9224-5af6-91df-0fd2caf4c796/8030f373-9224-5af6-91df-0fd2caf4c796_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a3982d5d4671029ed277a3fd5ab4e13%252Fpa%252FRG24592_0ec6329db1906632a6f3e3ce7a9b0a41.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_0ec6329db1906632a6f3e3ce7a9b0a41.jpg saved to cache
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8030f373-9224-5af6-91df-0fd2caf4c796
2026-03-27 10:36:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8030f373-9224-5af6-91df-0fd2caf4c796, skipping ID generation
2026-03-27 10:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8030f373-9224-5af6-91df-0fd2caf4c796 with scrape type 1
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8030f373-9224-5af6-91df-0fd2caf4c796 sending to next pipeline
2026-03-27 10:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8030f373-9224-5af6-91df-0fd2caf4c796, identifier: RG24592
2026-03-27 10:36:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a7d50>
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49f266ec-86ce-5b3f-9d5c-96c75ba2b041/49f266ec-86ce-5b3f-9d5c-96c75ba2b041_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F95%252Fb89588e6408e3e4dfbe2ebba00e2352b%252Fpa%252FBY27711_a15d09145f9a331cec162a9e7078d920.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_a15d09145f9a331cec162a9e7078d920.jpg saved to cache
2026-03-27 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49f266ec-86ce-5b3f-9d5c-96c75ba2b041
2026-03-27 10:36:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017487d0>
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49f266ec-86ce-5b3f-9d5c-96c75ba2b041/49f266ec-86ce-5b3f-9d5c-96c75ba2b041_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F95%252Fb89588e6408e3e4dfbe2ebba00e2352b%252Fpa%252FBY27711_78849118efc0815cefc511fa195471dd.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_78849118efc0815cefc511fa195471dd.jpg saved to cache
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49f266ec-86ce-5b3f-9d5c-96c75ba2b041
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500375cd0>
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c48f9e-1c72-5d99-bca9-2c24a87ff617/c8c48f9e-1c72-5d99-bca9-2c24a87ff617_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fb9%252F99b973abad2c10d393ed9c09f5aec6d2%252Fpa%252FML63417_26fd5a2dffc13c4df32f9dc83d500020.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_26fd5a2dffc13c4df32f9dc83d500020.jpg saved to cache
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8c48f9e-1c72-5d99-bca9-2c24a87ff617
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d8d50>
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c48f9e-1c72-5d99-bca9-2c24a87ff617/c8c48f9e-1c72-5d99-bca9-2c24a87ff617_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fb9%252F99b973abad2c10d393ed9c09f5aec6d2%252Fpa%252FML63417_70d6669deca5f6829454c0016a207b81.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_70d6669deca5f6829454c0016a207b81.jpg saved to cache
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8c48f9e-1c72-5d99-bca9-2c24a87ff617
2026-03-27 10:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8030f373-9224-5af6-91df-0fd2caf4c796 with identifier: RG24592
2026-03-27 10:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8030f373-9224-5af6-91df-0fd2caf4c796 with identifier: RG24592
2026-03-27 10:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8030f373-9224-5af6-91df-0fd2caf4c796 with identifier: RG24592 to the API
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_0ec6329db1906632a6f3e3ce7a9b0a41.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:15:51Z',
 'fuel_type': 'diesel',
 'id': '8030f373-9224-5af6-91df-0fd2caf4c796',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG24592',
 'listing': 'auction',
 'location': 'DE, Neufahrn',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 168441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8030f373-9224-5af6-91df-0fd2caf4c796/8030f373-9224-5af6-91df-0fd2caf4c796_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_ee2be7c8ceaf40417f75a69fada5b65c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8030f373-9224-5af6-91df-0fd2caf4c796/8030f373-9224-5af6-91df-0fd2caf4c796_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_8b89fc646b538ac8ff4736f964b8ed66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8030f373-9224-5af6-91df-0fd2caf4c796/8030f373-9224-5af6-91df-0fd2caf4c796_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_5535c6f151f4f9987373a85d0c5ed00d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8030f373-9224-5af6-91df-0fd2caf4c796/8030f373-9224-5af6-91df-0fd2caf4c796_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_39883995f2463b5589dcb56dee197072.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8030f373-9224-5af6-91df-0fd2caf4c796/8030f373-9224-5af6-91df-0fd2caf4c796_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2322427,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_0ec6329db1906632a6f3e3ce7a9b0a41.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8030f373-9224-5af6-91df-0fd2caf4c796/8030f373-9224-5af6-91df-0fd2caf4c796_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_000796a5e517d009d4701f79f5ad07cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8030f373-9224-5af6-91df-0fd2caf4c796/8030f373-9224-5af6-91df-0fd2caf4c796_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1971782,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_4b9038d1c10fbaa099049e106e0c7447.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8030f373-9224-5af6-91df-0fd2caf4c796/8030f373-9224-5af6-91df-0fd2caf4c796_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_9b367bd8298fee2742d2888b1f261e44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8030f373-9224-5af6-91df-0fd2caf4c796/8030f373-9224-5af6-91df-0fd2caf4c796_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2514643,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_006e0632c196ba05121979ee70296eaa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8030f373-9224-5af6-91df-0fd2caf4c796/8030f373-9224-5af6-91df-0fd2caf4c796_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/39/0a3982d5d4671029ed277a3fd5ab4e13/pa/RG24592_08b64278e76c49bfcf48c8b305df98a1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-22',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2013}
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG24592%27 HTTP/1.1" 200 None
2026-03-27 10:36:10 [auto1.de] INFO: Saving data for RG24592: {'created_time': 1774607770.774253, 'last_price_update_time': 1774607770.774267, 'auction_closing_time': 1774714551.0}
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG24592') HTTP/1.1" 204 0
2026-03-27 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH94566> (referer: https://www.auto1.com/v1/car-details-view/PH94566/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016bb010>
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ea31509-2755-54ef-b527-7af6b42eddcc/4ea31509-2755-54ef-b527-7af6b42eddcc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F21%252Fb0217bc495525d8f776f8350bc73faed%252Fpa%252FJD23896_457baa0226da241507ff31c93849c857.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_457baa0226da241507ff31c93849c857.jpg saved to cache
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ea31509-2755-54ef-b527-7af6b42eddcc
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019a7890>
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ea31509-2755-54ef-b527-7af6b42eddcc/4ea31509-2755-54ef-b527-7af6b42eddcc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F21%252Fb0217bc495525d8f776f8350bc73faed%252Fpa%252FJD23896_cad1c533da631b18e5698a195261f7d0.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_cad1c533da631b18e5698a195261f7d0.jpg saved to cache
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ea31509-2755-54ef-b527-7af6b42eddcc
2026-03-27 10:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb26b4e4-6aee-589e-b527-ad56bc848121 with identifier: PH94566
2026-03-27 10:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb26b4e4-6aee-589e-b527-ad56bc848121 with scrape type 1
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb26b4e4-6aee-589e-b527-ad56bc848121
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F0c%252F2d0c84e9a6137047b62091db6e970cbb%252Fpa%252FPH94566_e83d689113a05558cace8377cfbab727.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_e83d689113a05558cace8377cfbab727.jpg not downloaded yet
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F0c%252F2d0c84e9a6137047b62091db6e970cbb%252Fpa%252FPH94566_8583343d92cbed71916dc03ba49ebc3b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_8583343d92cbed71916dc03ba49ebc3b.jpg not downloaded yet
2026-03-27 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_2d9302cc94c330d584348eb68dee9cd7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_351b201998175e8bfc6bc230c839a1c4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F0c%252F2d0c84e9a6137047b62091db6e970cbb%252Fpa%252FPH94566_552d2f941a29202c5115bd0406f887bb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_552d2f941a29202c5115bd0406f887bb.jpg not downloaded yet
2026-03-27 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_22b0c8ccbce127207105c9eb08f0d852.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F0c%252F2d0c84e9a6137047b62091db6e970cbb%252Fpa%252FPH94566_fc0be5ecba16caa0f3c2424317bf348c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_fc0be5ecba16caa0f3c2424317bf348c.jpg not downloaded yet
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F0c%252F2d0c84e9a6137047b62091db6e970cbb%252Fpa%252FPH94566_c90e5cbf870a1b0f34bea13e7652848b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_c90e5cbf870a1b0f34bea13e7652848b.jpg not downloaded yet
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_22186e4433bca6ded7173d69a727e68f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F0c%252F2d0c84e9a6137047b62091db6e970cbb%252Fpa%252FPH94566_771d03ebefbff1c03bddeb672d6a256f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_771d03ebefbff1c03bddeb672d6a256f.jpg not downloaded yet
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F0c%252F2d0c84e9a6137047b62091db6e970cbb%252Fpa%252FPH94566_a4cd242935c400ed29bed7640ab193e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_a4cd242935c400ed29bed7640ab193e1.jpg not downloaded yet
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F0c%252F2d0c84e9a6137047b62091db6e970cbb%252Fpa%252FPH94566_dd3a6a0e83f3fd42d248764487dcf190.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_dd3a6a0e83f3fd42d248764487dcf190.jpg not downloaded yet
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500573c10>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c48f9e-1c72-5d99-bca9-2c24a87ff617/c8c48f9e-1c72-5d99-bca9-2c24a87ff617_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fb9%252F99b973abad2c10d393ed9c09f5aec6d2%252Fpa%252FML63417_2d9302cc94c330d584348eb68dee9cd7.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_2d9302cc94c330d584348eb68dee9cd7.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8c48f9e-1c72-5d99-bca9-2c24a87ff617
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50039b790>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c48f9e-1c72-5d99-bca9-2c24a87ff617/c8c48f9e-1c72-5d99-bca9-2c24a87ff617_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fb9%252F99b973abad2c10d393ed9c09f5aec6d2%252Fpa%252FML63417_351b201998175e8bfc6bc230c839a1c4.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_351b201998175e8bfc6bc230c839a1c4.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8c48f9e-1c72-5d99-bca9-2c24a87ff617
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F0c%252F2d0c84e9a6137047b62091db6e970cbb%252Fpa%252FPH94566_83c2634b9fac7411ac6f20bd9fe1f78c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_83c2634b9fac7411ac6f20bd9fe1f78c.jpg not downloaded yet
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501998950>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c48f9e-1c72-5d99-bca9-2c24a87ff617/c8c48f9e-1c72-5d99-bca9-2c24a87ff617_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fb9%252F99b973abad2c10d393ed9c09f5aec6d2%252Fpa%252FML63417_22b0c8ccbce127207105c9eb08f0d852.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_22b0c8ccbce127207105c9eb08f0d852.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8c48f9e-1c72-5d99-bca9-2c24a87ff617
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_5fc458e0448d51d68a50b08333d83c3f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_8583343d92cbed71916dc03ba49ebc3b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F0c%252F2d0c84e9a6137047b62091db6e970cbb%252Fpa%252FPH94566_c5fddf80c82d01c3f431bf9354623e58.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_c5fddf80c82d01c3f431bf9354623e58.jpg not downloaded yet
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_dd54bcdec020d7d66ae389756cb12b27.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5036ddf50>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c48f9e-1c72-5d99-bca9-2c24a87ff617/c8c48f9e-1c72-5d99-bca9-2c24a87ff617_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fb9%252F99b973abad2c10d393ed9c09f5aec6d2%252Fpa%252FML63417_22186e4433bca6ded7173d69a727e68f.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_22186e4433bca6ded7173d69a727e68f.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8c48f9e-1c72-5d99-bca9-2c24a87ff617
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_37852817cc7b7dc61ac509df4c6e479f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_d6c3f73cb17c469d3337be710d7e32cf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_03b6be5f9b7f093d46c508d9efd4e137.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_d65eb0c6cfcb1644cc0be7d787e767f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_3b5ea3b4c94b328b965bfd9d3fbcfba4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016cd5d0>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ea31509-2755-54ef-b527-7af6b42eddcc/4ea31509-2755-54ef-b527-7af6b42eddcc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F21%252Fb0217bc495525d8f776f8350bc73faed%252Fpa%252FJD23896_5fc458e0448d51d68a50b08333d83c3f.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_5fc458e0448d51d68a50b08333d83c3f.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ea31509-2755-54ef-b527-7af6b42eddcc
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500502950>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb26b4e4-6aee-589e-b527-ad56bc848121/eb26b4e4-6aee-589e-b527-ad56bc848121_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F0c%252F2d0c84e9a6137047b62091db6e970cbb%252Fpa%252FPH94566_8583343d92cbed71916dc03ba49ebc3b.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_8583343d92cbed71916dc03ba49ebc3b.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb26b4e4-6aee-589e-b527-ad56bc848121
2026-03-27 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_e83d689113a05558cace8377cfbab727.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500572550>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c48f9e-1c72-5d99-bca9-2c24a87ff617/c8c48f9e-1c72-5d99-bca9-2c24a87ff617_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fb9%252F99b973abad2c10d393ed9c09f5aec6d2%252Fpa%252FML63417_dd54bcdec020d7d66ae389756cb12b27.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_dd54bcdec020d7d66ae389756cb12b27.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8c48f9e-1c72-5d99-bca9-2c24a87ff617
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50059ee50>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ea31509-2755-54ef-b527-7af6b42eddcc/4ea31509-2755-54ef-b527-7af6b42eddcc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F21%252Fb0217bc495525d8f776f8350bc73faed%252Fpa%252FJD23896_37852817cc7b7dc61ac509df4c6e479f.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_37852817cc7b7dc61ac509df4c6e479f.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ea31509-2755-54ef-b527-7af6b42eddcc
2026-03-27 10:36:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016fd390>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c48f9e-1c72-5d99-bca9-2c24a87ff617/c8c48f9e-1c72-5d99-bca9-2c24a87ff617_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fb9%252F99b973abad2c10d393ed9c09f5aec6d2%252Fpa%252FML63417_d6c3f73cb17c469d3337be710d7e32cf.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_d6c3f73cb17c469d3337be710d7e32cf.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8c48f9e-1c72-5d99-bca9-2c24a87ff617
2026-03-27 10:36:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016ae610>
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c48f9e-1c72-5d99-bca9-2c24a87ff617/c8c48f9e-1c72-5d99-bca9-2c24a87ff617_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fb9%252F99b973abad2c10d393ed9c09f5aec6d2%252Fpa%252FML63417_03b6be5f9b7f093d46c508d9efd4e137.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_03b6be5f9b7f093d46c508d9efd4e137.jpg saved to cache
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8c48f9e-1c72-5d99-bca9-2c24a87ff617
2026-03-27 10:36:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8c48f9e-1c72-5d99-bca9-2c24a87ff617, skipping ID generation
2026-03-27 10:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8c48f9e-1c72-5d99-bca9-2c24a87ff617 with scrape type 1
2026-03-27 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8c48f9e-1c72-5d99-bca9-2c24a87ff617 sending to next pipeline
2026-03-27 10:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8c48f9e-1c72-5d99-bca9-2c24a87ff617, identifier: ML63417
2026-03-27 10:36:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016b8350>
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ea31509-2755-54ef-b527-7af6b42eddcc/4ea31509-2755-54ef-b527-7af6b42eddcc_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F21%252Fb0217bc495525d8f776f8350bc73faed%252Fpa%252FJD23896_d65eb0c6cfcb1644cc0be7d787e767f6.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_d65eb0c6cfcb1644cc0be7d787e767f6.jpg saved to cache
2026-03-27 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ea31509-2755-54ef-b527-7af6b42eddcc
2026-03-27 10:36:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019a7c10>
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ea31509-2755-54ef-b527-7af6b42eddcc/4ea31509-2755-54ef-b527-7af6b42eddcc_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F21%252Fb0217bc495525d8f776f8350bc73faed%252Fpa%252FJD23896_3b5ea3b4c94b328b965bfd9d3fbcfba4.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_3b5ea3b4c94b328b965bfd9d3fbcfba4.jpg saved to cache
2026-03-27 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ea31509-2755-54ef-b527-7af6b42eddcc
2026-03-27 10:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_bfa32e5478ebc2a596b31d228cba8ba7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8c48f9e-1c72-5d99-bca9-2c24a87ff617 with identifier: ML63417
2026-03-27 10:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8c48f9e-1c72-5d99-bca9-2c24a87ff617 with identifier: ML63417
2026-03-27 10:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8c48f9e-1c72-5d99-bca9-2c24a87ff617 with identifier: ML63417 to the API
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_03b6be5f9b7f093d46c508d9efd4e137.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 224,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:59:19Z',
 'fuel_type': 'diesel',
 'id': 'c8c48f9e-1c72-5d99-bca9-2c24a87ff617',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML63417',
 'listing': 'auction',
 'location': 'DE, Bochum',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 183024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c48f9e-1c72-5d99-bca9-2c24a87ff617/c8c48f9e-1c72-5d99-bca9-2c24a87ff617_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_f89767a2e1e3d89e3fefc0d970950cbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c48f9e-1c72-5d99-bca9-2c24a87ff617/c8c48f9e-1c72-5d99-bca9-2c24a87ff617_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_22186e4433bca6ded7173d69a727e68f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c48f9e-1c72-5d99-bca9-2c24a87ff617/c8c48f9e-1c72-5d99-bca9-2c24a87ff617_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_2d9302cc94c330d584348eb68dee9cd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c48f9e-1c72-5d99-bca9-2c24a87ff617/c8c48f9e-1c72-5d99-bca9-2c24a87ff617_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_26fd5a2dffc13c4df32f9dc83d500020.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c48f9e-1c72-5d99-bca9-2c24a87ff617/c8c48f9e-1c72-5d99-bca9-2c24a87ff617_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_351b201998175e8bfc6bc230c839a1c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c48f9e-1c72-5d99-bca9-2c24a87ff617/c8c48f9e-1c72-5d99-bca9-2c24a87ff617_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2815271,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_03b6be5f9b7f093d46c508d9efd4e137.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c48f9e-1c72-5d99-bca9-2c24a87ff617/c8c48f9e-1c72-5d99-bca9-2c24a87ff617_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2801900,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_d6c3f73cb17c469d3337be710d7e32cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c48f9e-1c72-5d99-bca9-2c24a87ff617/c8c48f9e-1c72-5d99-bca9-2c24a87ff617_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_22b0c8ccbce127207105c9eb08f0d852.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c48f9e-1c72-5d99-bca9-2c24a87ff617/c8c48f9e-1c72-5d99-bca9-2c24a87ff617_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2577488,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_dd54bcdec020d7d66ae389756cb12b27.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c48f9e-1c72-5d99-bca9-2c24a87ff617/c8c48f9e-1c72-5d99-bca9-2c24a87ff617_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/b9/99b973abad2c10d393ed9c09f5aec6d2/pa/ML63417_70d6669deca5f6829454c0016a207b81.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-20',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 3.0 CDI kompakt BlueEfficiency Trend Edition',
 'transmission': 'automatic',
 'trim': 'kompakt BlueEfficiency Trend Edition',
 'year': 2011}
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML63417%27 HTTP/1.1" 200 None
2026-03-27 10:36:12 [auto1.de] INFO: Saving data for ML63417: {'created_time': 1774607772.857587, 'last_price_update_time': 1774607772.857597, 'auction_closing_time': 1774717159.0}
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML63417') HTTP/1.1" 204 0
2026-03-27 10:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_83c2634b9fac7411ac6f20bd9fe1f78c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC84828> (referer: https://www.auto1.com/v1/car-details-view/GC84828/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016f4690>
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb26b4e4-6aee-589e-b527-ad56bc848121/eb26b4e4-6aee-589e-b527-ad56bc848121_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F0c%252F2d0c84e9a6137047b62091db6e970cbb%252Fpa%252FPH94566_e83d689113a05558cace8377cfbab727.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_e83d689113a05558cace8377cfbab727.jpg saved to cache
2026-03-27 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb26b4e4-6aee-589e-b527-ad56bc848121
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015c5e10>
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ea31509-2755-54ef-b527-7af6b42eddcc/4ea31509-2755-54ef-b527-7af6b42eddcc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F21%252Fb0217bc495525d8f776f8350bc73faed%252Fpa%252FJD23896_bfa32e5478ebc2a596b31d228cba8ba7.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_bfa32e5478ebc2a596b31d228cba8ba7.jpg saved to cache
2026-03-27 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ea31509-2755-54ef-b527-7af6b42eddcc
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500348c50>
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb26b4e4-6aee-589e-b527-ad56bc848121/eb26b4e4-6aee-589e-b527-ad56bc848121_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F0c%252F2d0c84e9a6137047b62091db6e970cbb%252Fpa%252FPH94566_83c2634b9fac7411ac6f20bd9fe1f78c.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_83c2634b9fac7411ac6f20bd9fe1f78c.jpg saved to cache
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb26b4e4-6aee-589e-b527-ad56bc848121
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_a4cd242935c400ed29bed7640ab193e1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: befc586c-e755-5a3b-9eac-511e3c17da8e with identifier: GC84828
2026-03-27 10:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item befc586c-e755-5a3b-9eac-511e3c17da8e with scrape type 1
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item befc586c-e755-5a3b-9eac-511e3c17da8e
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6a%252Fae6a728e7dcdcd7565ba8ec07ce12163%252Fpa%252FGC84828_381e42b480b13ea4bb9a5207a2acc1c7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_381e42b480b13ea4bb9a5207a2acc1c7.jpg not downloaded yet
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_c90e5cbf870a1b0f34bea13e7652848b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_c5fddf80c82d01c3f431bf9354623e58.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6a%252Fae6a728e7dcdcd7565ba8ec07ce12163%252Fpa%252FGC84828_342bebd3716c7528f1ab6422dd9dbb26.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_342bebd3716c7528f1ab6422dd9dbb26.jpg not downloaded yet
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_dd3a6a0e83f3fd42d248764487dcf190.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6a%252Fae6a728e7dcdcd7565ba8ec07ce12163%252Fpa%252FGC84828_14db4fc96014333f2ca9e1b33ffd304d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_14db4fc96014333f2ca9e1b33ffd304d.jpg not downloaded yet
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6a%252Fae6a728e7dcdcd7565ba8ec07ce12163%252Fpa%252FGC84828_e1f69b4152a4184876fd46f7714f45b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_e1f69b4152a4184876fd46f7714f45b6.jpg not downloaded yet
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6a%252Fae6a728e7dcdcd7565ba8ec07ce12163%252Fpa%252FGC84828_e77b080d5f491a4cf3cf1dab384cde18.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_e77b080d5f491a4cf3cf1dab384cde18.jpg not downloaded yet
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_552d2f941a29202c5115bd0406f887bb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6a%252Fae6a728e7dcdcd7565ba8ec07ce12163%252Fpa%252FGC84828_ba8c37aa6e9e8022a31468480dc53d91.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_ba8c37aa6e9e8022a31468480dc53d91.jpg not downloaded yet
2026-03-27 10:36:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501698d90>
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb26b4e4-6aee-589e-b527-ad56bc848121/eb26b4e4-6aee-589e-b527-ad56bc848121_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F0c%252F2d0c84e9a6137047b62091db6e970cbb%252Fpa%252FPH94566_a4cd242935c400ed29bed7640ab193e1.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_a4cd242935c400ed29bed7640ab193e1.jpg saved to cache
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb26b4e4-6aee-589e-b527-ad56bc848121
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_fc0be5ecba16caa0f3c2424317bf348c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6a%252Fae6a728e7dcdcd7565ba8ec07ce12163%252Fpa%252FGC84828_ba02a3998782c9355bb22e622cc17d82.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_ba02a3998782c9355bb22e622cc17d82.jpg not downloaded yet
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_87317b9c10408dc3573342a74826667f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6a%252Fae6a728e7dcdcd7565ba8ec07ce12163%252Fpa%252FGC84828_6bb9e932349e4a38c1bda9ab5a235725.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_6bb9e932349e4a38c1bda9ab5a235725.jpg not downloaded yet
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6a%252Fae6a728e7dcdcd7565ba8ec07ce12163%252Fpa%252FGC84828_051964a25941040584c1e8a31076af63.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_051964a25941040584c1e8a31076af63.jpg not downloaded yet
2026-03-27 10:36:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003209d0>
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb26b4e4-6aee-589e-b527-ad56bc848121/eb26b4e4-6aee-589e-b527-ad56bc848121_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F0c%252F2d0c84e9a6137047b62091db6e970cbb%252Fpa%252FPH94566_c90e5cbf870a1b0f34bea13e7652848b.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_c90e5cbf870a1b0f34bea13e7652848b.jpg saved to cache
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb26b4e4-6aee-589e-b527-ad56bc848121
2026-03-27 10:36:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501750d90>
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb26b4e4-6aee-589e-b527-ad56bc848121/eb26b4e4-6aee-589e-b527-ad56bc848121_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F0c%252F2d0c84e9a6137047b62091db6e970cbb%252Fpa%252FPH94566_c5fddf80c82d01c3f431bf9354623e58.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_c5fddf80c82d01c3f431bf9354623e58.jpg saved to cache
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb26b4e4-6aee-589e-b527-ad56bc848121
2026-03-27 10:36:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015d29d0>
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb26b4e4-6aee-589e-b527-ad56bc848121/eb26b4e4-6aee-589e-b527-ad56bc848121_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F0c%252F2d0c84e9a6137047b62091db6e970cbb%252Fpa%252FPH94566_dd3a6a0e83f3fd42d248764487dcf190.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_dd3a6a0e83f3fd42d248764487dcf190.jpg saved to cache
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb26b4e4-6aee-589e-b527-ad56bc848121
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500393350>
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb26b4e4-6aee-589e-b527-ad56bc848121/eb26b4e4-6aee-589e-b527-ad56bc848121_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F0c%252F2d0c84e9a6137047b62091db6e970cbb%252Fpa%252FPH94566_552d2f941a29202c5115bd0406f887bb.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_552d2f941a29202c5115bd0406f887bb.jpg saved to cache
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb26b4e4-6aee-589e-b527-ad56bc848121
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6a%252Fae6a728e7dcdcd7565ba8ec07ce12163%252Fpa%252FGC84828_963d328b588c2071a95a36d7a1e9c4b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_963d328b588c2071a95a36d7a1e9c4b8.jpg not downloaded yet
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_3761ab61f60d17bbfd554257cc28f19f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018acb90>
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb26b4e4-6aee-589e-b527-ad56bc848121/eb26b4e4-6aee-589e-b527-ad56bc848121_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F0c%252F2d0c84e9a6137047b62091db6e970cbb%252Fpa%252FPH94566_fc0be5ecba16caa0f3c2424317bf348c.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_fc0be5ecba16caa0f3c2424317bf348c.jpg saved to cache
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb26b4e4-6aee-589e-b527-ad56bc848121
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500597dd0>
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49f266ec-86ce-5b3f-9d5c-96c75ba2b041/49f266ec-86ce-5b3f-9d5c-96c75ba2b041_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F95%252Fb89588e6408e3e4dfbe2ebba00e2352b%252Fpa%252FBY27711_87317b9c10408dc3573342a74826667f.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_87317b9c10408dc3573342a74826667f.jpg saved to cache
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 49f266ec-86ce-5b3f-9d5c-96c75ba2b041
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501955490>
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747ae73a-61b7-58de-b89c-2d8d5ea910c3/747ae73a-61b7-58de-b89c-2d8d5ea910c3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd3%252Fecd3657146580e8ce7d53d68d13016ec%252Fpa%252FYU03537_3761ab61f60d17bbfd554257cc28f19f.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_3761ab61f60d17bbfd554257cc28f19f.jpg saved to cache
2026-03-27 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 747ae73a-61b7-58de-b89c-2d8d5ea910c3
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_771d03ebefbff1c03bddeb672d6a256f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_a4dfc3576da60d0be1ccb8659f97322b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_0b6b119dabac49ccd08df498a920b1ab.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_6d924dee3ef47c89aa8a324f4a105631.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_14db4fc96014333f2ca9e1b33ffd304d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HY59950> (referer: https://www.auto1.com/v1/car-details-view/HY59950/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_31a69dc538192a57c5b6f007cb76e8f5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501689e10>
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb26b4e4-6aee-589e-b527-ad56bc848121/eb26b4e4-6aee-589e-b527-ad56bc848121_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F0c%252F2d0c84e9a6137047b62091db6e970cbb%252Fpa%252FPH94566_771d03ebefbff1c03bddeb672d6a256f.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_771d03ebefbff1c03bddeb672d6a256f.jpg saved to cache
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb26b4e4-6aee-589e-b527-ad56bc848121
2026-03-27 10:36:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb26b4e4-6aee-589e-b527-ad56bc848121, skipping ID generation
2026-03-27 10:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb26b4e4-6aee-589e-b527-ad56bc848121 with scrape type 1
2026-03-27 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb26b4e4-6aee-589e-b527-ad56bc848121 sending to next pipeline
2026-03-27 10:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb26b4e4-6aee-589e-b527-ad56bc848121, identifier: PH94566
2026-03-27 10:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb26b4e4-6aee-589e-b527-ad56bc848121 with identifier: PH94566
2026-03-27 10:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb26b4e4-6aee-589e-b527-ad56bc848121 with identifier: PH94566
2026-03-27 10:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb26b4e4-6aee-589e-b527-ad56bc848121 with identifier: PH94566 to the API
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_771d03ebefbff1c03bddeb672d6a256f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:07:34Z',
 'fuel_type': 'diesel',
 'id': 'eb26b4e4-6aee-589e-b527-ad56bc848121',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH94566',
 'listing': 'auction',
 'location': 'DE, Neumünster',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 304493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb26b4e4-6aee-589e-b527-ad56bc848121/eb26b4e4-6aee-589e-b527-ad56bc848121_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_e83d689113a05558cace8377cfbab727.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb26b4e4-6aee-589e-b527-ad56bc848121/eb26b4e4-6aee-589e-b527-ad56bc848121_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_8583343d92cbed71916dc03ba49ebc3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb26b4e4-6aee-589e-b527-ad56bc848121/eb26b4e4-6aee-589e-b527-ad56bc848121_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_552d2f941a29202c5115bd0406f887bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb26b4e4-6aee-589e-b527-ad56bc848121/eb26b4e4-6aee-589e-b527-ad56bc848121_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_fc0be5ecba16caa0f3c2424317bf348c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb26b4e4-6aee-589e-b527-ad56bc848121/eb26b4e4-6aee-589e-b527-ad56bc848121_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2540121,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_c90e5cbf870a1b0f34bea13e7652848b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb26b4e4-6aee-589e-b527-ad56bc848121/eb26b4e4-6aee-589e-b527-ad56bc848121_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2653671,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_771d03ebefbff1c03bddeb672d6a256f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb26b4e4-6aee-589e-b527-ad56bc848121/eb26b4e4-6aee-589e-b527-ad56bc848121_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2376749,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_a4cd242935c400ed29bed7640ab193e1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb26b4e4-6aee-589e-b527-ad56bc848121/eb26b4e4-6aee-589e-b527-ad56bc848121_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2598722,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_dd3a6a0e83f3fd42d248764487dcf190.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb26b4e4-6aee-589e-b527-ad56bc848121/eb26b4e4-6aee-589e-b527-ad56bc848121_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_83c2634b9fac7411ac6f20bd9fe1f78c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb26b4e4-6aee-589e-b527-ad56bc848121/eb26b4e4-6aee-589e-b527-ad56bc848121_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2521652,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/0c/2d0c84e9a6137047b62091db6e970cbb/pa/PH94566_c5fddf80c82d01c3f431bf9354623e58.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'quattro S line Sportpaket plus',
 'year': 2013}
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH94566%27 HTTP/1.1" 200 None
2026-03-27 10:36:15 [auto1.de] INFO: Saving data for PH94566: {'created_time': 1774607775.050051, 'last_price_update_time': 1774607775.050063, 'auction_closing_time': 1774714054.0}
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH94566') HTTP/1.1" 204 0
2026-03-27 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_ba02a3998782c9355bb22e622cc17d82.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_051964a25941040584c1e8a31076af63.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_6bb9e932349e4a38c1bda9ab5a235725.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_ba8c37aa6e9e8022a31468480dc53d91.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_e77b080d5f491a4cf3cf1dab384cde18.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_963d328b588c2071a95a36d7a1e9c4b8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016cc590>
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ea31509-2755-54ef-b527-7af6b42eddcc/4ea31509-2755-54ef-b527-7af6b42eddcc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F21%252Fb0217bc495525d8f776f8350bc73faed%252Fpa%252FJD23896_a4dfc3576da60d0be1ccb8659f97322b.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_a4dfc3576da60d0be1ccb8659f97322b.jpg saved to cache
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ea31509-2755-54ef-b527-7af6b42eddcc
2026-03-27 10:36:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016bb090>
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49f266ec-86ce-5b3f-9d5c-96c75ba2b041/49f266ec-86ce-5b3f-9d5c-96c75ba2b041_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F95%252Fb89588e6408e3e4dfbe2ebba00e2352b%252Fpa%252FBY27711_0b6b119dabac49ccd08df498a920b1ab.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_0b6b119dabac49ccd08df498a920b1ab.jpg saved to cache
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 49f266ec-86ce-5b3f-9d5c-96c75ba2b041
2026-03-27 10:36:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50037e890>
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ea31509-2755-54ef-b527-7af6b42eddcc/4ea31509-2755-54ef-b527-7af6b42eddcc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F21%252Fb0217bc495525d8f776f8350bc73faed%252Fpa%252FJD23896_6d924dee3ef47c89aa8a324f4a105631.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_6d924dee3ef47c89aa8a324f4a105631.jpg saved to cache
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ea31509-2755-54ef-b527-7af6b42eddcc
2026-03-27 10:36:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ea31509-2755-54ef-b527-7af6b42eddcc, skipping ID generation
2026-03-27 10:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ea31509-2755-54ef-b527-7af6b42eddcc with scrape type 1
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ea31509-2755-54ef-b527-7af6b42eddcc sending to next pipeline
2026-03-27 10:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ea31509-2755-54ef-b527-7af6b42eddcc, identifier: JD23896
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50057c190>
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc586c-e755-5a3b-9eac-511e3c17da8e/befc586c-e755-5a3b-9eac-511e3c17da8e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6a%252Fae6a728e7dcdcd7565ba8ec07ce12163%252Fpa%252FGC84828_14db4fc96014333f2ca9e1b33ffd304d.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_14db4fc96014333f2ca9e1b33ffd304d.jpg saved to cache
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item befc586c-e755-5a3b-9eac-511e3c17da8e
2026-03-27 10:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e06db99-904f-5866-97f1-b18f223595fa with identifier: HY59950
2026-03-27 10:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e06db99-904f-5866-97f1-b18f223595fa with scrape type 1
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e06db99-904f-5866-97f1-b18f223595fa
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc0%252F8cc0e3c373d014783342ef501115ff6c%252Fpa%252FHY59950_538a7dd4bc62e23346c466a1f7d84fb2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_538a7dd4bc62e23346c466a1f7d84fb2.jpg not downloaded yet
2026-03-27 10:36:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501653590>
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49f266ec-86ce-5b3f-9d5c-96c75ba2b041/49f266ec-86ce-5b3f-9d5c-96c75ba2b041_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F95%252Fb89588e6408e3e4dfbe2ebba00e2352b%252Fpa%252FBY27711_31a69dc538192a57c5b6f007cb76e8f5.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_31a69dc538192a57c5b6f007cb76e8f5.jpg saved to cache
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 49f266ec-86ce-5b3f-9d5c-96c75ba2b041
2026-03-27 10:36:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49f266ec-86ce-5b3f-9d5c-96c75ba2b041, skipping ID generation
2026-03-27 10:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49f266ec-86ce-5b3f-9d5c-96c75ba2b041 with scrape type 1
2026-03-27 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49f266ec-86ce-5b3f-9d5c-96c75ba2b041 sending to next pipeline
2026-03-27 10:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49f266ec-86ce-5b3f-9d5c-96c75ba2b041, identifier: BY27711
2026-03-27 10:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ea31509-2755-54ef-b527-7af6b42eddcc with identifier: JD23896
2026-03-27 10:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ea31509-2755-54ef-b527-7af6b42eddcc with identifier: JD23896
2026-03-27 10:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ea31509-2755-54ef-b527-7af6b42eddcc with identifier: JD23896 to the API
2026-03-27 10:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_6d924dee3ef47c89aa8a324f4a105631.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:39:35Z',
 'fuel_type': 'petrol',
 'id': '4ea31509-2755-54ef-b527-7af6b42eddcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD23896',
 'listing': 'auction',
 'location': 'DE, Magdeburg',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 76174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ea31509-2755-54ef-b527-7af6b42eddcc/4ea31509-2755-54ef-b527-7af6b42eddcc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2961768,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_6d924dee3ef47c89aa8a324f4a105631.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ea31509-2755-54ef-b527-7af6b42eddcc/4ea31509-2755-54ef-b527-7af6b42eddcc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2805389,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_a4dfc3576da60d0be1ccb8659f97322b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ea31509-2755-54ef-b527-7af6b42eddcc/4ea31509-2755-54ef-b527-7af6b42eddcc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_bfa32e5478ebc2a596b31d228cba8ba7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ea31509-2755-54ef-b527-7af6b42eddcc/4ea31509-2755-54ef-b527-7af6b42eddcc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_37852817cc7b7dc61ac509df4c6e479f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ea31509-2755-54ef-b527-7af6b42eddcc/4ea31509-2755-54ef-b527-7af6b42eddcc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_f6075e85e6980f894c9495656ab68729.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ea31509-2755-54ef-b527-7af6b42eddcc/4ea31509-2755-54ef-b527-7af6b42eddcc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_5fc458e0448d51d68a50b08333d83c3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ea31509-2755-54ef-b527-7af6b42eddcc/4ea31509-2755-54ef-b527-7af6b42eddcc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_457baa0226da241507ff31c93849c857.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ea31509-2755-54ef-b527-7af6b42eddcc/4ea31509-2755-54ef-b527-7af6b42eddcc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_cad1c533da631b18e5698a195261f7d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ea31509-2755-54ef-b527-7af6b42eddcc/4ea31509-2755-54ef-b527-7af6b42eddcc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2811264,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_3b5ea3b4c94b328b965bfd9d3fbcfba4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ea31509-2755-54ef-b527-7af6b42eddcc/4ea31509-2755-54ef-b527-7af6b42eddcc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3034424,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/21/b0217bc495525d8f776f8350bc73faed/pa/JD23896_d65eb0c6cfcb1644cc0be7d787e767f6.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Trend & Fun BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Trend & Fun BlueMotion Tech',
 'year': 2016}
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD23896%27 HTTP/1.1" 200 None
2026-03-27 10:36:16 [auto1.de] INFO: Saving data for JD23896: {'created_time': 1774607776.288624, 'last_price_update_time': 1774607776.288634, 'auction_closing_time': 1774715975.0}
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD23896') HTTP/1.1" 204 0
2026-03-27 10:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49f266ec-86ce-5b3f-9d5c-96c75ba2b041 with identifier: BY27711
2026-03-27 10:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49f266ec-86ce-5b3f-9d5c-96c75ba2b041 with identifier: BY27711
2026-03-27 10:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49f266ec-86ce-5b3f-9d5c-96c75ba2b041 with identifier: BY27711 to the API
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_31a69dc538192a57c5b6f007cb76e8f5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:05:20Z',
 'fuel_type': 'diesel',
 'id': '49f266ec-86ce-5b3f-9d5c-96c75ba2b041',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY27711',
 'listing': 'auction',
 'location': 'DE, Friedrichsdorf',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 163803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49f266ec-86ce-5b3f-9d5c-96c75ba2b041/49f266ec-86ce-5b3f-9d5c-96c75ba2b041_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_2cd5215e4dea7a7083a56984e9730d10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49f266ec-86ce-5b3f-9d5c-96c75ba2b041/49f266ec-86ce-5b3f-9d5c-96c75ba2b041_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3105858,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_78849118efc0815cefc511fa195471dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49f266ec-86ce-5b3f-9d5c-96c75ba2b041/49f266ec-86ce-5b3f-9d5c-96c75ba2b041_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2881571,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_a15d09145f9a331cec162a9e7078d920.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49f266ec-86ce-5b3f-9d5c-96c75ba2b041/49f266ec-86ce-5b3f-9d5c-96c75ba2b041_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_3af26e356d209dbab4915e93ad8eca59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49f266ec-86ce-5b3f-9d5c-96c75ba2b041/49f266ec-86ce-5b3f-9d5c-96c75ba2b041_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_a167f97c2c15c583e0dc9dc16eb290d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49f266ec-86ce-5b3f-9d5c-96c75ba2b041/49f266ec-86ce-5b3f-9d5c-96c75ba2b041_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_cfd62ef4d5faa528a78d5c35f1abb7c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49f266ec-86ce-5b3f-9d5c-96c75ba2b041/49f266ec-86ce-5b3f-9d5c-96c75ba2b041_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2846758,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_31a69dc538192a57c5b6f007cb76e8f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49f266ec-86ce-5b3f-9d5c-96c75ba2b041/49f266ec-86ce-5b3f-9d5c-96c75ba2b041_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3030658,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_0b6b119dabac49ccd08df498a920b1ab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49f266ec-86ce-5b3f-9d5c-96c75ba2b041/49f266ec-86ce-5b3f-9d5c-96c75ba2b041_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_87317b9c10408dc3573342a74826667f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49f266ec-86ce-5b3f-9d5c-96c75ba2b041/49f266ec-86ce-5b3f-9d5c-96c75ba2b041_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/95/b89588e6408e3e4dfbe2ebba00e2352b/pa/BY27711_dd9578d3dddb1c1cdae528241422ca81.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d BlueTEC AMG Line',
 'transmission': 'automatic',
 'trim': 'BlueTEC AMG Line',
 'year': 2018}
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY27711%27 HTTP/1.1" 200 None
2026-03-27 10:36:16 [auto1.de] INFO: Saving data for BY27711: {'created_time': 1774607776.701759, 'last_price_update_time': 1774607776.701773, 'auction_closing_time': 1774713920.0}
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY27711') HTTP/1.1" 204 0
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc0%252F8cc0e3c373d014783342ef501115ff6c%252Fpa%252FHY59950_9a8f10cfaf20485b56ca9acaa65bbece.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_9a8f10cfaf20485b56ca9acaa65bbece.jpg not downloaded yet
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a0810>
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc586c-e755-5a3b-9eac-511e3c17da8e/befc586c-e755-5a3b-9eac-511e3c17da8e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6a%252Fae6a728e7dcdcd7565ba8ec07ce12163%252Fpa%252FGC84828_ba02a3998782c9355bb22e622cc17d82.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_ba02a3998782c9355bb22e622cc17d82.jpg saved to cache
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item befc586c-e755-5a3b-9eac-511e3c17da8e
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016d3d10>
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc586c-e755-5a3b-9eac-511e3c17da8e/befc586c-e755-5a3b-9eac-511e3c17da8e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6a%252Fae6a728e7dcdcd7565ba8ec07ce12163%252Fpa%252FGC84828_051964a25941040584c1e8a31076af63.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_051964a25941040584c1e8a31076af63.jpg saved to cache
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item befc586c-e755-5a3b-9eac-511e3c17da8e
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016a9110>
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc586c-e755-5a3b-9eac-511e3c17da8e/befc586c-e755-5a3b-9eac-511e3c17da8e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6a%252Fae6a728e7dcdcd7565ba8ec07ce12163%252Fpa%252FGC84828_6bb9e932349e4a38c1bda9ab5a235725.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_6bb9e932349e4a38c1bda9ab5a235725.jpg saved to cache
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item befc586c-e755-5a3b-9eac-511e3c17da8e
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017aaed0>
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc586c-e755-5a3b-9eac-511e3c17da8e/befc586c-e755-5a3b-9eac-511e3c17da8e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6a%252Fae6a728e7dcdcd7565ba8ec07ce12163%252Fpa%252FGC84828_ba8c37aa6e9e8022a31468480dc53d91.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_ba8c37aa6e9e8022a31468480dc53d91.jpg saved to cache
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item befc586c-e755-5a3b-9eac-511e3c17da8e
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d1bd0>
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc586c-e755-5a3b-9eac-511e3c17da8e/befc586c-e755-5a3b-9eac-511e3c17da8e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6a%252Fae6a728e7dcdcd7565ba8ec07ce12163%252Fpa%252FGC84828_e77b080d5f491a4cf3cf1dab384cde18.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_e77b080d5f491a4cf3cf1dab384cde18.jpg saved to cache
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item befc586c-e755-5a3b-9eac-511e3c17da8e
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501715fd0>
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc586c-e755-5a3b-9eac-511e3c17da8e/befc586c-e755-5a3b-9eac-511e3c17da8e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6a%252Fae6a728e7dcdcd7565ba8ec07ce12163%252Fpa%252FGC84828_963d328b588c2071a95a36d7a1e9c4b8.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_963d328b588c2071a95a36d7a1e9c4b8.jpg saved to cache
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item befc586c-e755-5a3b-9eac-511e3c17da8e
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc0%252F8cc0e3c373d014783342ef501115ff6c%252Fpa%252FHY59950_c1fbe25045997209573fb691105ee3b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_c1fbe25045997209573fb691105ee3b2.jpg not downloaded yet
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc0%252F8cc0e3c373d014783342ef501115ff6c%252Fpa%252FHY59950_dcc8aa080e22543d0047265435f6cd25.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_dcc8aa080e22543d0047265435f6cd25.jpg not downloaded yet
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc0%252F8cc0e3c373d014783342ef501115ff6c%252Fpa%252FHY59950_3867011444ed6175eb6e16f3fe8a8e37.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_3867011444ed6175eb6e16f3fe8a8e37.jpg not downloaded yet
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc0%252F8cc0e3c373d014783342ef501115ff6c%252Fpa%252FHY59950_43b6ade5bff7459fcfa647a04b073ad6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_43b6ade5bff7459fcfa647a04b073ad6.jpg not downloaded yet
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc0%252F8cc0e3c373d014783342ef501115ff6c%252Fpa%252FHY59950_8222c0d8b124c4050c8e8b7a5661ff7f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_8222c0d8b124c4050c8e8b7a5661ff7f.jpg not downloaded yet
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc0%252F8cc0e3c373d014783342ef501115ff6c%252Fpa%252FHY59950_944ae8d9515efbe7524ff8127b7ff773.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_944ae8d9515efbe7524ff8127b7ff773.jpg not downloaded yet
2026-03-27 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_9a8f10cfaf20485b56ca9acaa65bbece.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc0%252F8cc0e3c373d014783342ef501115ff6c%252Fpa%252FHY59950_0f41987683feb043d83a3fce977c03e6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_0f41987683feb043d83a3fce977c03e6.jpg not downloaded yet
2026-03-27 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_381e42b480b13ea4bb9a5207a2acc1c7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_538a7dd4bc62e23346c466a1f7d84fb2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc0%252F8cc0e3c373d014783342ef501115ff6c%252Fpa%252FHY59950_f85915117a7df8ed328bab2bec64cdd7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_f85915117a7df8ed328bab2bec64cdd7.jpg not downloaded yet
2026-03-27 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_e1f69b4152a4184876fd46f7714f45b6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_a477246c79b5d51d7ab21b85707a689e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c9950>
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e06db99-904f-5866-97f1-b18f223595fa/1e06db99-904f-5866-97f1-b18f223595fa_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc0%252F8cc0e3c373d014783342ef501115ff6c%252Fpa%252FHY59950_9a8f10cfaf20485b56ca9acaa65bbece.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_9a8f10cfaf20485b56ca9acaa65bbece.jpg saved to cache
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e06db99-904f-5866-97f1-b18f223595fa
2026-03-27 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_f1b2fe876448fe80645fb15058123523.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_4fd4c5bbe52226dab5c3d19c472f9d6f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019446d0>
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc586c-e755-5a3b-9eac-511e3c17da8e/befc586c-e755-5a3b-9eac-511e3c17da8e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6a%252Fae6a728e7dcdcd7565ba8ec07ce12163%252Fpa%252FGC84828_381e42b480b13ea4bb9a5207a2acc1c7.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_381e42b480b13ea4bb9a5207a2acc1c7.jpg saved to cache
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item befc586c-e755-5a3b-9eac-511e3c17da8e
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501867750>
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e06db99-904f-5866-97f1-b18f223595fa/1e06db99-904f-5866-97f1-b18f223595fa_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc0%252F8cc0e3c373d014783342ef501115ff6c%252Fpa%252FHY59950_538a7dd4bc62e23346c466a1f7d84fb2.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_538a7dd4bc62e23346c466a1f7d84fb2.jpg saved to cache
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e06db99-904f-5866-97f1-b18f223595fa
2026-03-27 10:36:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500596010>
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc586c-e755-5a3b-9eac-511e3c17da8e/befc586c-e755-5a3b-9eac-511e3c17da8e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6a%252Fae6a728e7dcdcd7565ba8ec07ce12163%252Fpa%252FGC84828_e1f69b4152a4184876fd46f7714f45b6.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_e1f69b4152a4184876fd46f7714f45b6.jpg saved to cache
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item befc586c-e755-5a3b-9eac-511e3c17da8e
2026-03-27 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_342bebd3716c7528f1ab6422dd9dbb26.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_3045e249025cd8c939b9528e68db9507.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_0f41987683feb043d83a3fce977c03e6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_f0397fdfa055a1fabb07faf36316b093.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_944ae8d9515efbe7524ff8127b7ff773.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_862095bd9f9542ea689a08093a273390.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501696f90>
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747ae73a-61b7-58de-b89c-2d8d5ea910c3/747ae73a-61b7-58de-b89c-2d8d5ea910c3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd3%252Fecd3657146580e8ce7d53d68d13016ec%252Fpa%252FYU03537_a477246c79b5d51d7ab21b85707a689e.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_a477246c79b5d51d7ab21b85707a689e.jpg saved to cache
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 747ae73a-61b7-58de-b89c-2d8d5ea910c3
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50167d150>
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747ae73a-61b7-58de-b89c-2d8d5ea910c3/747ae73a-61b7-58de-b89c-2d8d5ea910c3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd3%252Fecd3657146580e8ce7d53d68d13016ec%252Fpa%252FYU03537_f1b2fe876448fe80645fb15058123523.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_f1b2fe876448fe80645fb15058123523.jpg saved to cache
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 747ae73a-61b7-58de-b89c-2d8d5ea910c3
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017ef9d0>
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747ae73a-61b7-58de-b89c-2d8d5ea910c3/747ae73a-61b7-58de-b89c-2d8d5ea910c3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd3%252Fecd3657146580e8ce7d53d68d13016ec%252Fpa%252FYU03537_4fd4c5bbe52226dab5c3d19c472f9d6f.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_4fd4c5bbe52226dab5c3d19c472f9d6f.jpg saved to cache
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 747ae73a-61b7-58de-b89c-2d8d5ea910c3
2026-03-27 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_f85915117a7df8ed328bab2bec64cdd7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50035c410>
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc586c-e755-5a3b-9eac-511e3c17da8e/befc586c-e755-5a3b-9eac-511e3c17da8e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F6a%252Fae6a728e7dcdcd7565ba8ec07ce12163%252Fpa%252FGC84828_342bebd3716c7528f1ab6422dd9dbb26.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_342bebd3716c7528f1ab6422dd9dbb26.jpg saved to cache
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item befc586c-e755-5a3b-9eac-511e3c17da8e
2026-03-27 10:36:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: befc586c-e755-5a3b-9eac-511e3c17da8e, skipping ID generation
2026-03-27 10:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item befc586c-e755-5a3b-9eac-511e3c17da8e with scrape type 1
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item befc586c-e755-5a3b-9eac-511e3c17da8e sending to next pipeline
2026-03-27 10:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: befc586c-e755-5a3b-9eac-511e3c17da8e, identifier: GC84828
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004dbd90>
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747ae73a-61b7-58de-b89c-2d8d5ea910c3/747ae73a-61b7-58de-b89c-2d8d5ea910c3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd3%252Fecd3657146580e8ce7d53d68d13016ec%252Fpa%252FYU03537_3045e249025cd8c939b9528e68db9507.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_3045e249025cd8c939b9528e68db9507.jpg saved to cache
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 747ae73a-61b7-58de-b89c-2d8d5ea910c3
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d6110>
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e06db99-904f-5866-97f1-b18f223595fa/1e06db99-904f-5866-97f1-b18f223595fa_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc0%252F8cc0e3c373d014783342ef501115ff6c%252Fpa%252FHY59950_0f41987683feb043d83a3fce977c03e6.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_0f41987683feb043d83a3fce977c03e6.jpg saved to cache
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e06db99-904f-5866-97f1-b18f223595fa
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501652950>
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747ae73a-61b7-58de-b89c-2d8d5ea910c3/747ae73a-61b7-58de-b89c-2d8d5ea910c3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd3%252Fecd3657146580e8ce7d53d68d13016ec%252Fpa%252FYU03537_f0397fdfa055a1fabb07faf36316b093.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_f0397fdfa055a1fabb07faf36316b093.jpg saved to cache
2026-03-27 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 747ae73a-61b7-58de-b89c-2d8d5ea910c3
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f9f10>
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e06db99-904f-5866-97f1-b18f223595fa/1e06db99-904f-5866-97f1-b18f223595fa_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc0%252F8cc0e3c373d014783342ef501115ff6c%252Fpa%252FHY59950_944ae8d9515efbe7524ff8127b7ff773.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_944ae8d9515efbe7524ff8127b7ff773.jpg saved to cache
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e06db99-904f-5866-97f1-b18f223595fa
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500595790>
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747ae73a-61b7-58de-b89c-2d8d5ea910c3/747ae73a-61b7-58de-b89c-2d8d5ea910c3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fd3%252Fecd3657146580e8ce7d53d68d13016ec%252Fpa%252FYU03537_862095bd9f9542ea689a08093a273390.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_862095bd9f9542ea689a08093a273390.jpg saved to cache
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 747ae73a-61b7-58de-b89c-2d8d5ea910c3
2026-03-27 10:36:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 747ae73a-61b7-58de-b89c-2d8d5ea910c3, skipping ID generation
2026-03-27 10:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747ae73a-61b7-58de-b89c-2d8d5ea910c3 with scrape type 1
2026-03-27 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 747ae73a-61b7-58de-b89c-2d8d5ea910c3 sending to next pipeline
2026-03-27 10:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 747ae73a-61b7-58de-b89c-2d8d5ea910c3, identifier: YU03537
2026-03-27 10:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: befc586c-e755-5a3b-9eac-511e3c17da8e with identifier: GC84828
2026-03-27 10:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: befc586c-e755-5a3b-9eac-511e3c17da8e with identifier: GC84828
2026-03-27 10:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: befc586c-e755-5a3b-9eac-511e3c17da8e with identifier: GC84828 to the API
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_342bebd3716c7528f1ab6422dd9dbb26.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:37:09Z',
 'fuel_type': 'petrol',
 'id': 'befc586c-e755-5a3b-9eac-511e3c17da8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC84828',
 'listing': 'auction',
 'location': 'DE, Köln',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 22334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc586c-e755-5a3b-9eac-511e3c17da8e/befc586c-e755-5a3b-9eac-511e3c17da8e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_381e42b480b13ea4bb9a5207a2acc1c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc586c-e755-5a3b-9eac-511e3c17da8e/befc586c-e755-5a3b-9eac-511e3c17da8e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_342bebd3716c7528f1ab6422dd9dbb26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc586c-e755-5a3b-9eac-511e3c17da8e/befc586c-e755-5a3b-9eac-511e3c17da8e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_14db4fc96014333f2ca9e1b33ffd304d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc586c-e755-5a3b-9eac-511e3c17da8e/befc586c-e755-5a3b-9eac-511e3c17da8e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2644100,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_e1f69b4152a4184876fd46f7714f45b6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc586c-e755-5a3b-9eac-511e3c17da8e/befc586c-e755-5a3b-9eac-511e3c17da8e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_e77b080d5f491a4cf3cf1dab384cde18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc586c-e755-5a3b-9eac-511e3c17da8e/befc586c-e755-5a3b-9eac-511e3c17da8e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_ba8c37aa6e9e8022a31468480dc53d91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc586c-e755-5a3b-9eac-511e3c17da8e/befc586c-e755-5a3b-9eac-511e3c17da8e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_ba02a3998782c9355bb22e622cc17d82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc586c-e755-5a3b-9eac-511e3c17da8e/befc586c-e755-5a3b-9eac-511e3c17da8e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_6bb9e932349e4a38c1bda9ab5a235725.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc586c-e755-5a3b-9eac-511e3c17da8e/befc586c-e755-5a3b-9eac-511e3c17da8e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_051964a25941040584c1e8a31076af63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc586c-e755-5a3b-9eac-511e3c17da8e/befc586c-e755-5a3b-9eac-511e3c17da8e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/6a/ae6a728e7dcdcd7565ba8ec07ce12163/pa/GC84828_963d328b588c2071a95a36d7a1e9c4b8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2023}
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC84828%27 HTTP/1.1" 200 None
2026-03-27 10:36:18 [auto1.de] INFO: Saving data for GC84828: {'created_time': 1774607778.537597, 'last_price_update_time': 1774607778.537608, 'auction_closing_time': 1774715829.0}
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC84828') HTTP/1.1" 204 0
2026-03-27 10:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 747ae73a-61b7-58de-b89c-2d8d5ea910c3 with identifier: YU03537
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-27 10:36:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 747ae73a-61b7-58de-b89c-2d8d5ea910c3 with identifier: YU03537
2026-03-27 10:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 747ae73a-61b7-58de-b89c-2d8d5ea910c3 with identifier: YU03537 to the API
2026-03-27 10:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_862095bd9f9542ea689a08093a273390.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 33,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:39:09Z',
 'fuel_type': 'hybrid',
 'id': '747ae73a-61b7-58de-b89c-2d8d5ea910c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU03537',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 99222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747ae73a-61b7-58de-b89c-2d8d5ea910c3/747ae73a-61b7-58de-b89c-2d8d5ea910c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_4fd4c5bbe52226dab5c3d19c472f9d6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747ae73a-61b7-58de-b89c-2d8d5ea910c3/747ae73a-61b7-58de-b89c-2d8d5ea910c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_3045e249025cd8c939b9528e68db9507.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747ae73a-61b7-58de-b89c-2d8d5ea910c3/747ae73a-61b7-58de-b89c-2d8d5ea910c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_862095bd9f9542ea689a08093a273390.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747ae73a-61b7-58de-b89c-2d8d5ea910c3/747ae73a-61b7-58de-b89c-2d8d5ea910c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_f0397fdfa055a1fabb07faf36316b093.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747ae73a-61b7-58de-b89c-2d8d5ea910c3/747ae73a-61b7-58de-b89c-2d8d5ea910c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_f1b2fe876448fe80645fb15058123523.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747ae73a-61b7-58de-b89c-2d8d5ea910c3/747ae73a-61b7-58de-b89c-2d8d5ea910c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_a477246c79b5d51d7ab21b85707a689e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747ae73a-61b7-58de-b89c-2d8d5ea910c3/747ae73a-61b7-58de-b89c-2d8d5ea910c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_3761ab61f60d17bbfd554257cc28f19f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747ae73a-61b7-58de-b89c-2d8d5ea910c3/747ae73a-61b7-58de-b89c-2d8d5ea910c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_b894e9cfc6c68715c11b9484cf45916d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747ae73a-61b7-58de-b89c-2d8d5ea910c3/747ae73a-61b7-58de-b89c-2d8d5ea910c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_6abd9a5678139eaeaad6bee99fc2dc22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747ae73a-61b7-58de-b89c-2d8d5ea910c3/747ae73a-61b7-58de-b89c-2d8d5ea910c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/d3/ecd3657146580e8ce7d53d68d13016ec/pa/YU03537_961aa9d7758a416ace8afea691a87bb0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID VZ',
 'transmission': 'automatic',
 'trim': 'VZ',
 'year': 2022}
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU03537%27 HTTP/1.1" 200 None
2026-03-27 10:36:19 [auto1.de] INFO: Saving data for YU03537: {'created_time': 1774607779.146964, 'last_price_update_time': 1774607779.146975, 'auction_closing_time': 1774715949.0}
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU03537') HTTP/1.1" 204 0
2026-03-27 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_8222c0d8b124c4050c8e8b7a5661ff7f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_43b6ade5bff7459fcfa647a04b073ad6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_dcc8aa080e22543d0047265435f6cd25.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_c1fbe25045997209573fb691105ee3b2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_3867011444ed6175eb6e16f3fe8a8e37.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_c7392592ff0734ba4cf45ca007713da3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a12450>
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e06db99-904f-5866-97f1-b18f223595fa/1e06db99-904f-5866-97f1-b18f223595fa_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc0%252F8cc0e3c373d014783342ef501115ff6c%252Fpa%252FHY59950_f85915117a7df8ed328bab2bec64cdd7.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_f85915117a7df8ed328bab2bec64cdd7.jpg saved to cache
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e06db99-904f-5866-97f1-b18f223595fa
2026-03-27 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_69b362fa39df3f5b708b17cc200a3c0d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_c9626d898e16c6d06a7d04bfd9ba4405.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50183fa10>
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e06db99-904f-5866-97f1-b18f223595fa/1e06db99-904f-5866-97f1-b18f223595fa_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc0%252F8cc0e3c373d014783342ef501115ff6c%252Fpa%252FHY59950_8222c0d8b124c4050c8e8b7a5661ff7f.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_8222c0d8b124c4050c8e8b7a5661ff7f.jpg saved to cache
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e06db99-904f-5866-97f1-b18f223595fa
2026-03-27 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_3860a25ee51ef75d9f3589b4d514ace6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50182a990>
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e06db99-904f-5866-97f1-b18f223595fa/1e06db99-904f-5866-97f1-b18f223595fa_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc0%252F8cc0e3c373d014783342ef501115ff6c%252Fpa%252FHY59950_43b6ade5bff7459fcfa647a04b073ad6.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_43b6ade5bff7459fcfa647a04b073ad6.jpg saved to cache
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e06db99-904f-5866-97f1-b18f223595fa
2026-03-27 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_1e5d1a7cd44d8d6f08c798de3d44cb3c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50175fd90>
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e06db99-904f-5866-97f1-b18f223595fa/1e06db99-904f-5866-97f1-b18f223595fa_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc0%252F8cc0e3c373d014783342ef501115ff6c%252Fpa%252FHY59950_dcc8aa080e22543d0047265435f6cd25.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_dcc8aa080e22543d0047265435f6cd25.jpg saved to cache
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e06db99-904f-5866-97f1-b18f223595fa
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501653850>
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e06db99-904f-5866-97f1-b18f223595fa/1e06db99-904f-5866-97f1-b18f223595fa_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc0%252F8cc0e3c373d014783342ef501115ff6c%252Fpa%252FHY59950_c1fbe25045997209573fb691105ee3b2.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_c1fbe25045997209573fb691105ee3b2.jpg saved to cache
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e06db99-904f-5866-97f1-b18f223595fa
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f25d0>
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e06db99-904f-5866-97f1-b18f223595fa/1e06db99-904f-5866-97f1-b18f223595fa_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc0%252F8cc0e3c373d014783342ef501115ff6c%252Fpa%252FHY59950_3867011444ed6175eb6e16f3fe8a8e37.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_3867011444ed6175eb6e16f3fe8a8e37.jpg saved to cache
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e06db99-904f-5866-97f1-b18f223595fa
2026-03-27 10:36:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e06db99-904f-5866-97f1-b18f223595fa, skipping ID generation
2026-03-27 10:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e06db99-904f-5866-97f1-b18f223595fa with scrape type 1
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e06db99-904f-5866-97f1-b18f223595fa sending to next pipeline
2026-03-27 10:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e06db99-904f-5866-97f1-b18f223595fa, identifier: HY59950
2026-03-27 10:36:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50183c3d0>
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a85389bb-8ff1-5858-9efd-d645ce49dcd6/a85389bb-8ff1-5858-9efd-d645ce49dcd6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0e30892676ac59d6a6cd4d3101c2b%252Fpa%252FRF57736_c7392592ff0734ba4cf45ca007713da3.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_c7392592ff0734ba4cf45ca007713da3.jpg saved to cache
2026-03-27 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a85389bb-8ff1-5858-9efd-d645ce49dcd6
2026-03-27 10:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e06db99-904f-5866-97f1-b18f223595fa with identifier: HY59950
2026-03-27 10:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e06db99-904f-5866-97f1-b18f223595fa with identifier: HY59950
2026-03-27 10:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e06db99-904f-5866-97f1-b18f223595fa with identifier: HY59950 to the API
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_3867011444ed6175eb6e16f3fe8a8e37.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:28:56Z',
 'fuel_type': 'petrol',
 'id': '1e06db99-904f-5866-97f1-b18f223595fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY59950',
 'listing': 'auction',
 'location': 'DE, Mannheim',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 36782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e06db99-904f-5866-97f1-b18f223595fa/1e06db99-904f-5866-97f1-b18f223595fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95662,
             'Height': 599,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_538a7dd4bc62e23346c466a1f7d84fb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e06db99-904f-5866-97f1-b18f223595fa/1e06db99-904f-5866-97f1-b18f223595fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_9a8f10cfaf20485b56ca9acaa65bbece.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e06db99-904f-5866-97f1-b18f223595fa/1e06db99-904f-5866-97f1-b18f223595fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_c1fbe25045997209573fb691105ee3b2.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e06db99-904f-5866-97f1-b18f223595fa/1e06db99-904f-5866-97f1-b18f223595fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_dcc8aa080e22543d0047265435f6cd25.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e06db99-904f-5866-97f1-b18f223595fa/1e06db99-904f-5866-97f1-b18f223595fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93532,
             'Height': 599,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_3867011444ed6175eb6e16f3fe8a8e37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e06db99-904f-5866-97f1-b18f223595fa/1e06db99-904f-5866-97f1-b18f223595fa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_43b6ade5bff7459fcfa647a04b073ad6.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e06db99-904f-5866-97f1-b18f223595fa/1e06db99-904f-5866-97f1-b18f223595fa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_8222c0d8b124c4050c8e8b7a5661ff7f.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e06db99-904f-5866-97f1-b18f223595fa/1e06db99-904f-5866-97f1-b18f223595fa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_944ae8d9515efbe7524ff8127b7ff773.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e06db99-904f-5866-97f1-b18f223595fa/1e06db99-904f-5866-97f1-b18f223595fa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_0f41987683feb043d83a3fce977c03e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e06db99-904f-5866-97f1-b18f223595fa/1e06db99-904f-5866-97f1-b18f223595fa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c0/8cc0e3c373d014783342ef501115ff6c/pa/HY59950_f85915117a7df8ed328bab2bec64cdd7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2023}
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY59950%27 HTTP/1.1" 200 None
2026-03-27 10:36:20 [auto1.de] INFO: Saving data for HY59950: {'created_time': 1774607780.063269, 'last_price_update_time': 1774607780.063282, 'auction_closing_time': 1774715336.0}
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY59950') HTTP/1.1" 204 0
2026-03-27 10:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_cfc663ad6ed371973c27a120c26cbdf0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500348ad0>
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a85389bb-8ff1-5858-9efd-d645ce49dcd6/a85389bb-8ff1-5858-9efd-d645ce49dcd6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fe0%252Ffce0e30892676ac59d6a6cd4d3101c2b%252Fpa%252FRF57736_69b362fa39df3f5b708b17cc200a3c0d.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_69b362fa39df3f5b708b17cc200a3c0d.jpg saved to cache
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a85389bb-8ff1-5858-9efd-d645ce49dcd6
2026-03-27 10:36:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a85389bb-8ff1-5858-9efd-d645ce49dcd6, skipping ID generation
2026-03-27 10:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a85389bb-8ff1-5858-9efd-d645ce49dcd6 with scrape type 1
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a85389bb-8ff1-5858-9efd-d645ce49dcd6 sending to next pipeline
2026-03-27 10:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a85389bb-8ff1-5858-9efd-d645ce49dcd6, identifier: RF57736
2026-03-27 10:36:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500314e50>
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27bb1249-b18c-5c8c-9e08-9cae316cae5c/27bb1249-b18c-5c8c-9e08-9cae316cae5c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F40%252F61406a856cf8418342667d2e8557da56%252Fpa%252FUZ82929_c9626d898e16c6d06a7d04bfd9ba4405.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_c9626d898e16c6d06a7d04bfd9ba4405.jpg saved to cache
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 27bb1249-b18c-5c8c-9e08-9cae316cae5c
2026-03-27 10:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_874c43e1b62944cbad8297b82f75dfdd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a85389bb-8ff1-5858-9efd-d645ce49dcd6 with identifier: RF57736
2026-03-27 10:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a85389bb-8ff1-5858-9efd-d645ce49dcd6 with identifier: RF57736
2026-03-27 10:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a85389bb-8ff1-5858-9efd-d645ce49dcd6 with identifier: RF57736 to the API
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_69b362fa39df3f5b708b17cc200a3c0d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:21:14Z',
 'fuel_type': 'petrol',
 'id': 'a85389bb-8ff1-5858-9efd-d645ce49dcd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF57736',
 'listing': 'auction',
 'location': 'DE, Bünde',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 131030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a85389bb-8ff1-5858-9efd-d645ce49dcd6/a85389bb-8ff1-5858-9efd-d645ce49dcd6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2421915,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_69b362fa39df3f5b708b17cc200a3c0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a85389bb-8ff1-5858-9efd-d645ce49dcd6/a85389bb-8ff1-5858-9efd-d645ce49dcd6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2333988,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_c7392592ff0734ba4cf45ca007713da3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a85389bb-8ff1-5858-9efd-d645ce49dcd6/a85389bb-8ff1-5858-9efd-d645ce49dcd6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2359851,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_f6547d4d9567c8246ee65cdbebe39739.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a85389bb-8ff1-5858-9efd-d645ce49dcd6/a85389bb-8ff1-5858-9efd-d645ce49dcd6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_ee5d7de18b21d55d34e8d71a5028038b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a85389bb-8ff1-5858-9efd-d645ce49dcd6/a85389bb-8ff1-5858-9efd-d645ce49dcd6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2403752,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_c2745fbf47718f19583c61ae19951f67.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a85389bb-8ff1-5858-9efd-d645ce49dcd6/a85389bb-8ff1-5858-9efd-d645ce49dcd6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_661451769906b9ec7c86291f8e3541fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a85389bb-8ff1-5858-9efd-d645ce49dcd6/a85389bb-8ff1-5858-9efd-d645ce49dcd6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2253839,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_f437452347a31512f416a740fe6a3f1e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a85389bb-8ff1-5858-9efd-d645ce49dcd6/a85389bb-8ff1-5858-9efd-d645ce49dcd6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_687fff93c3b437b72e984c3ddd91de0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a85389bb-8ff1-5858-9efd-d645ce49dcd6/a85389bb-8ff1-5858-9efd-d645ce49dcd6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2391914,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_a0da89b13ab9f7e963fbef25a49538d6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a85389bb-8ff1-5858-9efd-d645ce49dcd6/a85389bb-8ff1-5858-9efd-d645ce49dcd6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2608414,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/e0/fce0e30892676ac59d6a6cd4d3101c2b/pa/RF57736_874c4ec8edac5ba15bc7cc8c75f2435d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Team',
 'transmission': 'automatic',
 'trim': 'Team',
 'year': 2011}
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF57736%27 HTTP/1.1" 200 None
2026-03-27 10:36:20 [auto1.de] INFO: Saving data for RF57736: {'created_time': 1774607780.926338, 'last_price_update_time': 1774607780.926358, 'auction_closing_time': 1774714874.0}
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF57736') HTTP/1.1" 204 0
2026-03-27 10:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_905f79ec563f19f3cec307975b18ee79.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018aaa10>
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27bb1249-b18c-5c8c-9e08-9cae316cae5c/27bb1249-b18c-5c8c-9e08-9cae316cae5c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F40%252F61406a856cf8418342667d2e8557da56%252Fpa%252FUZ82929_3860a25ee51ef75d9f3589b4d514ace6.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_3860a25ee51ef75d9f3589b4d514ace6.jpg saved to cache
2026-03-27 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27bb1249-b18c-5c8c-9e08-9cae316cae5c
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501865390>
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27bb1249-b18c-5c8c-9e08-9cae316cae5c/27bb1249-b18c-5c8c-9e08-9cae316cae5c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F40%252F61406a856cf8418342667d2e8557da56%252Fpa%252FUZ82929_1e5d1a7cd44d8d6f08c798de3d44cb3c.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_1e5d1a7cd44d8d6f08c798de3d44cb3c.jpg saved to cache
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27bb1249-b18c-5c8c-9e08-9cae316cae5c
2026-03-27 10:36:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500588a50>
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27bb1249-b18c-5c8c-9e08-9cae316cae5c/27bb1249-b18c-5c8c-9e08-9cae316cae5c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F40%252F61406a856cf8418342667d2e8557da56%252Fpa%252FUZ82929_cfc663ad6ed371973c27a120c26cbdf0.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_cfc663ad6ed371973c27a120c26cbdf0.jpg saved to cache
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27bb1249-b18c-5c8c-9e08-9cae316cae5c
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018ad0d0>
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6351d24-e791-578a-85a9-ad351bd10293/a6351d24-e791-578a-85a9-ad351bd10293_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F96%252F1f96d15169bddcf952a580498b4ee8f7%252Fpa%252FAN46464_874c43e1b62944cbad8297b82f75dfdd.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_874c43e1b62944cbad8297b82f75dfdd.jpg saved to cache
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6351d24-e791-578a-85a9-ad351bd10293
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501662e10>
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6351d24-e791-578a-85a9-ad351bd10293/a6351d24-e791-578a-85a9-ad351bd10293_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F96%252F1f96d15169bddcf952a580498b4ee8f7%252Fpa%252FAN46464_905f79ec563f19f3cec307975b18ee79.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_905f79ec563f19f3cec307975b18ee79.jpg saved to cache
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6351d24-e791-578a-85a9-ad351bd10293
2026-03-27 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_e9d6a04666e3c3d83fa4fa65ce11c6e8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_1620ee5ba9ea1e19e2fe8a2bd184bd2f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_170230c8ca8b790a3cb40994ac5e5f0b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_9aeed37faa6ad9eb14241c89c405d6f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_e32831fed2b5e1205b9ea0f3cd8d16d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016ffe10>
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27bb1249-b18c-5c8c-9e08-9cae316cae5c/27bb1249-b18c-5c8c-9e08-9cae316cae5c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F40%252F61406a856cf8418342667d2e8557da56%252Fpa%252FUZ82929_e9d6a04666e3c3d83fa4fa65ce11c6e8.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_e9d6a04666e3c3d83fa4fa65ce11c6e8.jpg saved to cache
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27bb1249-b18c-5c8c-9e08-9cae316cae5c
2026-03-27 10:36:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c3d50>
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27bb1249-b18c-5c8c-9e08-9cae316cae5c/27bb1249-b18c-5c8c-9e08-9cae316cae5c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F40%252F61406a856cf8418342667d2e8557da56%252Fpa%252FUZ82929_1620ee5ba9ea1e19e2fe8a2bd184bd2f.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_1620ee5ba9ea1e19e2fe8a2bd184bd2f.jpg saved to cache
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27bb1249-b18c-5c8c-9e08-9cae316cae5c
2026-03-27 10:36:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501615d50>
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27bb1249-b18c-5c8c-9e08-9cae316cae5c/27bb1249-b18c-5c8c-9e08-9cae316cae5c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F40%252F61406a856cf8418342667d2e8557da56%252Fpa%252FUZ82929_170230c8ca8b790a3cb40994ac5e5f0b.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_170230c8ca8b790a3cb40994ac5e5f0b.jpg saved to cache
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27bb1249-b18c-5c8c-9e08-9cae316cae5c
2026-03-27 10:36:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018aae50>
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27bb1249-b18c-5c8c-9e08-9cae316cae5c/27bb1249-b18c-5c8c-9e08-9cae316cae5c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F40%252F61406a856cf8418342667d2e8557da56%252Fpa%252FUZ82929_9aeed37faa6ad9eb14241c89c405d6f6.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_9aeed37faa6ad9eb14241c89c405d6f6.jpg saved to cache
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27bb1249-b18c-5c8c-9e08-9cae316cae5c
2026-03-27 10:36:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27bb1249-b18c-5c8c-9e08-9cae316cae5c, skipping ID generation
2026-03-27 10:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27bb1249-b18c-5c8c-9e08-9cae316cae5c with scrape type 1
2026-03-27 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27bb1249-b18c-5c8c-9e08-9cae316cae5c sending to next pipeline
2026-03-27 10:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27bb1249-b18c-5c8c-9e08-9cae316cae5c, identifier: UZ82929
2026-03-27 10:36:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50373fa10>
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6351d24-e791-578a-85a9-ad351bd10293/a6351d24-e791-578a-85a9-ad351bd10293_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F96%252F1f96d15169bddcf952a580498b4ee8f7%252Fpa%252FAN46464_e32831fed2b5e1205b9ea0f3cd8d16d5.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_e32831fed2b5e1205b9ea0f3cd8d16d5.jpg saved to cache
2026-03-27 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6351d24-e791-578a-85a9-ad351bd10293
2026-03-27 10:36:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6351d24-e791-578a-85a9-ad351bd10293, skipping ID generation
2026-03-27 10:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6351d24-e791-578a-85a9-ad351bd10293 with scrape type 1
2026-03-27 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6351d24-e791-578a-85a9-ad351bd10293 sending to next pipeline
2026-03-27 10:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6351d24-e791-578a-85a9-ad351bd10293, identifier: AN46464
2026-03-27 10:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27bb1249-b18c-5c8c-9e08-9cae316cae5c with identifier: UZ82929
2026-03-27 10:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27bb1249-b18c-5c8c-9e08-9cae316cae5c with identifier: UZ82929
2026-03-27 10:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27bb1249-b18c-5c8c-9e08-9cae316cae5c with identifier: UZ82929 to the API
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_9aeed37faa6ad9eb14241c89c405d6f6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:04:54Z',
 'fuel_type': 'diesel',
 'id': '27bb1249-b18c-5c8c-9e08-9cae316cae5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ82929',
 'listing': 'auction',
 'location': 'DE, Gummersbach',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 267160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27bb1249-b18c-5c8c-9e08-9cae316cae5c/27bb1249-b18c-5c8c-9e08-9cae316cae5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2552320,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_170230c8ca8b790a3cb40994ac5e5f0b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27bb1249-b18c-5c8c-9e08-9cae316cae5c/27bb1249-b18c-5c8c-9e08-9cae316cae5c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2482974,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_9aeed37faa6ad9eb14241c89c405d6f6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27bb1249-b18c-5c8c-9e08-9cae316cae5c/27bb1249-b18c-5c8c-9e08-9cae316cae5c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2287218,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_db34a43bde279e32a5afee3ac4941771.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27bb1249-b18c-5c8c-9e08-9cae316cae5c/27bb1249-b18c-5c8c-9e08-9cae316cae5c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_cfc663ad6ed371973c27a120c26cbdf0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27bb1249-b18c-5c8c-9e08-9cae316cae5c/27bb1249-b18c-5c8c-9e08-9cae316cae5c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_1e5d1a7cd44d8d6f08c798de3d44cb3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27bb1249-b18c-5c8c-9e08-9cae316cae5c/27bb1249-b18c-5c8c-9e08-9cae316cae5c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_abc481ae7ee59f73fab63b9bbb71e64d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27bb1249-b18c-5c8c-9e08-9cae316cae5c/27bb1249-b18c-5c8c-9e08-9cae316cae5c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2461522,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_1620ee5ba9ea1e19e2fe8a2bd184bd2f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27bb1249-b18c-5c8c-9e08-9cae316cae5c/27bb1249-b18c-5c8c-9e08-9cae316cae5c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2430734,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_e9d6a04666e3c3d83fa4fa65ce11c6e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27bb1249-b18c-5c8c-9e08-9cae316cae5c/27bb1249-b18c-5c8c-9e08-9cae316cae5c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_3860a25ee51ef75d9f3589b4d514ace6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27bb1249-b18c-5c8c-9e08-9cae316cae5c/27bb1249-b18c-5c8c-9e08-9cae316cae5c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2306402,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/40/61406a856cf8418342667d2e8557da56/pa/UZ82929_c9626d898e16c6d06a7d04bfd9ba4405.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Black Shadow 4x2',
 'transmission': 'manual',
 'trim': 'Black Shadow 4x2',
 'year': 2016}
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ82929%27 HTTP/1.1" 200 None
2026-03-27 10:36:22 [auto1.de] INFO: Saving data for UZ82929: {'created_time': 1774607782.625442, 'last_price_update_time': 1774607782.625455, 'auction_closing_time': 1774713894.0}
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ82929') HTTP/1.1" 204 0
2026-03-27 10:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6351d24-e791-578a-85a9-ad351bd10293 with identifier: AN46464
2026-03-27 10:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6351d24-e791-578a-85a9-ad351bd10293 with identifier: AN46464
2026-03-27 10:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6351d24-e791-578a-85a9-ad351bd10293 with identifier: AN46464 to the API
2026-03-27 10:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_e32831fed2b5e1205b9ea0f3cd8d16d5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:42:46Z',
 'fuel_type': 'diesel',
 'id': 'a6351d24-e791-578a-85a9-ad351bd10293',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN46464',
 'listing': 'auction',
 'location': 'DE, Neumarkt in der Oberpfalz',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 171218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6351d24-e791-578a-85a9-ad351bd10293/a6351d24-e791-578a-85a9-ad351bd10293_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_905f79ec563f19f3cec307975b18ee79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6351d24-e791-578a-85a9-ad351bd10293/a6351d24-e791-578a-85a9-ad351bd10293_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_874c43e1b62944cbad8297b82f75dfdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6351d24-e791-578a-85a9-ad351bd10293/a6351d24-e791-578a-85a9-ad351bd10293_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3026475,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_e32831fed2b5e1205b9ea0f3cd8d16d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6351d24-e791-578a-85a9-ad351bd10293/a6351d24-e791-578a-85a9-ad351bd10293_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_cc5515a8904e47012b87ab17f380612f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6351d24-e791-578a-85a9-ad351bd10293/a6351d24-e791-578a-85a9-ad351bd10293_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_b5e1851e82fd596d6eb300959627818e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6351d24-e791-578a-85a9-ad351bd10293/a6351d24-e791-578a-85a9-ad351bd10293_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2921836,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_d7e0307e9dad80044ab665888e1d1457.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6351d24-e791-578a-85a9-ad351bd10293/a6351d24-e791-578a-85a9-ad351bd10293_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3159588,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_6fb94872dfc8645bef58c8a301cc7df3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6351d24-e791-578a-85a9-ad351bd10293/a6351d24-e791-578a-85a9-ad351bd10293_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2944334,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_b67b16a6b46df55c459b739c7fd55b52.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6351d24-e791-578a-85a9-ad351bd10293/a6351d24-e791-578a-85a9-ad351bd10293_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_784d64df59cd77928c75ced006d207ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6351d24-e791-578a-85a9-ad351bd10293/a6351d24-e791-578a-85a9-ad351bd10293_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2996120,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1f/96/1f96d15169bddcf952a580498b4ee8f7/pa/AN46464_571daa28f9c8c61a3ec47efccff3bb6f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Lounge BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2015}
2026-03-27 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN46464%27 HTTP/1.1" 200 None
2026-03-27 10:36:23 [auto1.de] INFO: Saving data for AN46464: {'created_time': 1774607783.191696, 'last_price_update_time': 1774607783.191707, 'auction_closing_time': 1774716166.0}
2026-03-27 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN46464') HTTP/1.1" 204 0
2026-03-27 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KT29520/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG79841> (referer: https://www.auto1.com/v1/car-details-view/LG79841/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97b390d6-6612-5354-9f7e-3ffcd9a55653 with identifier: LG79841
2026-03-27 10:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97b390d6-6612-5354-9f7e-3ffcd9a55653 with scrape type 1
2026-03-27 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 97b390d6-6612-5354-9f7e-3ffcd9a55653
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3d%252F143d2ebe7259a9c659bc3072c4cdb6c2%252Fpa%252FLG79841_4c3a2540b2182d855e436f6ae72597fe.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_4c3a2540b2182d855e436f6ae72597fe.jpg not downloaded yet
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3d%252F143d2ebe7259a9c659bc3072c4cdb6c2%252Fpa%252FLG79841_670037fb5700d61409187160f8e2960a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_670037fb5700d61409187160f8e2960a.jpg not downloaded yet
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3d%252F143d2ebe7259a9c659bc3072c4cdb6c2%252Fpa%252FLG79841_48cc19c79e57921f833f8538f042e933.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_48cc19c79e57921f833f8538f042e933.jpg not downloaded yet
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3d%252F143d2ebe7259a9c659bc3072c4cdb6c2%252Fpa%252FLG79841_408d5800645806d5f069dcc53a4d8d66.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_408d5800645806d5f069dcc53a4d8d66.jpg not downloaded yet
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3d%252F143d2ebe7259a9c659bc3072c4cdb6c2%252Fpa%252FLG79841_1e19e46a79c58027bf4eef1a00ce7b76.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_1e19e46a79c58027bf4eef1a00ce7b76.jpg not downloaded yet
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3d%252F143d2ebe7259a9c659bc3072c4cdb6c2%252Fpa%252FLG79841_c36bf6736ff8dae5a8db780b0d077cc4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_c36bf6736ff8dae5a8db780b0d077cc4.jpg not downloaded yet
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3d%252F143d2ebe7259a9c659bc3072c4cdb6c2%252Fpa%252FLG79841_4fd040b62f178eeda85ed29c70a2f29f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_4fd040b62f178eeda85ed29c70a2f29f.jpg not downloaded yet
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3d%252F143d2ebe7259a9c659bc3072c4cdb6c2%252Fpa%252FLG79841_2576fb4698268bb587f0bf7382019321.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_2576fb4698268bb587f0bf7382019321.jpg not downloaded yet
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3d%252F143d2ebe7259a9c659bc3072c4cdb6c2%252Fpa%252FLG79841_7d33337bf748d332e3012c6ea12ec5b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_7d33337bf748d332e3012c6ea12ec5b1.jpg not downloaded yet
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3d%252F143d2ebe7259a9c659bc3072c4cdb6c2%252Fpa%252FLG79841_89578061e22c895c0ec073f30f5b506f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_89578061e22c895c0ec073f30f5b506f.jpg not downloaded yet
2026-03-27 10:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB35938/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_89578061e22c895c0ec073f30f5b506f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50032e9d0>
2026-03-27 10:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b390d6-6612-5354-9f7e-3ffcd9a55653/97b390d6-6612-5354-9f7e-3ffcd9a55653_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3d%252F143d2ebe7259a9c659bc3072c4cdb6c2%252Fpa%252FLG79841_89578061e22c895c0ec073f30f5b506f.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_89578061e22c895c0ec073f30f5b506f.jpg saved to cache
2026-03-27 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 97b390d6-6612-5354-9f7e-3ffcd9a55653
2026-03-27 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR23937/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_7d33337bf748d332e3012c6ea12ec5b1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50032e510>
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b390d6-6612-5354-9f7e-3ffcd9a55653/97b390d6-6612-5354-9f7e-3ffcd9a55653_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3d%252F143d2ebe7259a9c659bc3072c4cdb6c2%252Fpa%252FLG79841_7d33337bf748d332e3012c6ea12ec5b1.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_7d33337bf748d332e3012c6ea12ec5b1.jpg saved to cache
2026-03-27 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 97b390d6-6612-5354-9f7e-3ffcd9a55653
2026-03-27 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR74432/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_2576fb4698268bb587f0bf7382019321.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500340b50>
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b390d6-6612-5354-9f7e-3ffcd9a55653/97b390d6-6612-5354-9f7e-3ffcd9a55653_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3d%252F143d2ebe7259a9c659bc3072c4cdb6c2%252Fpa%252FLG79841_2576fb4698268bb587f0bf7382019321.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_2576fb4698268bb587f0bf7382019321.jpg saved to cache
2026-03-27 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97b390d6-6612-5354-9f7e-3ffcd9a55653
2026-03-27 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP86837/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_4fd040b62f178eeda85ed29c70a2f29f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50032fad0>
2026-03-27 10:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b390d6-6612-5354-9f7e-3ffcd9a55653/97b390d6-6612-5354-9f7e-3ffcd9a55653_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3d%252F143d2ebe7259a9c659bc3072c4cdb6c2%252Fpa%252FLG79841_4fd040b62f178eeda85ed29c70a2f29f.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_4fd040b62f178eeda85ed29c70a2f29f.jpg saved to cache
2026-03-27 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97b390d6-6612-5354-9f7e-3ffcd9a55653
2026-03-27 10:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CK62580/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_c36bf6736ff8dae5a8db780b0d077cc4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501940790>
2026-03-27 10:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b390d6-6612-5354-9f7e-3ffcd9a55653/97b390d6-6612-5354-9f7e-3ffcd9a55653_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3d%252F143d2ebe7259a9c659bc3072c4cdb6c2%252Fpa%252FLG79841_c36bf6736ff8dae5a8db780b0d077cc4.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_c36bf6736ff8dae5a8db780b0d077cc4.jpg saved to cache
2026-03-27 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97b390d6-6612-5354-9f7e-3ffcd9a55653
2026-03-27 10:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB26055> (referer: https://www.auto1.com/v1/car-details-view/UB26055/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f with identifier: UB26055
2026-03-27 10:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f with scrape type 1
2026-03-27 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F2f%252Feb2f9f4b438934a4ae448ab5ac7e455e%252Fpa%252FUB26055_279ca1f3bdb52fac727950c5f0243503.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_279ca1f3bdb52fac727950c5f0243503.jpg not downloaded yet
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F2f%252Feb2f9f4b438934a4ae448ab5ac7e455e%252Fpa%252FUB26055_b8c1ae849788b0f78a788f7effdff666.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_b8c1ae849788b0f78a788f7effdff666.jpg not downloaded yet
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F2f%252Feb2f9f4b438934a4ae448ab5ac7e455e%252Fpa%252FUB26055_df90632cf720ea733db5d6a9c8afc6d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_df90632cf720ea733db5d6a9c8afc6d6.jpg not downloaded yet
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F2f%252Feb2f9f4b438934a4ae448ab5ac7e455e%252Fpa%252FUB26055_648d009386eabdf1ae5a1cd7407ead21.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_648d009386eabdf1ae5a1cd7407ead21.jpg not downloaded yet
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F2f%252Feb2f9f4b438934a4ae448ab5ac7e455e%252Fpa%252FUB26055_1668db289e5d7d786973269ae6573cd0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_1668db289e5d7d786973269ae6573cd0.jpg not downloaded yet
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F2f%252Feb2f9f4b438934a4ae448ab5ac7e455e%252Fpa%252FUB26055_7f6111cf2b65a46cede64e60e6cb3122.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_7f6111cf2b65a46cede64e60e6cb3122.jpg not downloaded yet
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F2f%252Feb2f9f4b438934a4ae448ab5ac7e455e%252Fpa%252FUB26055_92294e76fc8a6cefacbd24b59db70dfc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_92294e76fc8a6cefacbd24b59db70dfc.jpg not downloaded yet
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F2f%252Feb2f9f4b438934a4ae448ab5ac7e455e%252Fpa%252FUB26055_d1dd7badeec5a7e06dd39b8c89c3e2b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_d1dd7badeec5a7e06dd39b8c89c3e2b4.jpg not downloaded yet
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F2f%252Feb2f9f4b438934a4ae448ab5ac7e455e%252Fpa%252FUB26055_5efc3ea189e20d2e0786f0bc30620a16.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_5efc3ea189e20d2e0786f0bc30620a16.jpg not downloaded yet
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F2f%252Feb2f9f4b438934a4ae448ab5ac7e455e%252Fpa%252FUB26055_70dd7b5935fba43ee467f54f81864132.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_70dd7b5935fba43ee467f54f81864132.jpg not downloaded yet
2026-03-27 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_1e19e46a79c58027bf4eef1a00ce7b76.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_70dd7b5935fba43ee467f54f81864132.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018ac090>
2026-03-27 10:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b390d6-6612-5354-9f7e-3ffcd9a55653/97b390d6-6612-5354-9f7e-3ffcd9a55653_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3d%252F143d2ebe7259a9c659bc3072c4cdb6c2%252Fpa%252FLG79841_1e19e46a79c58027bf4eef1a00ce7b76.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_1e19e46a79c58027bf4eef1a00ce7b76.jpg saved to cache
2026-03-27 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97b390d6-6612-5354-9f7e-3ffcd9a55653
2026-03-27 10:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500595090>
2026-03-27 10:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f/4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F2f%252Feb2f9f4b438934a4ae448ab5ac7e455e%252Fpa%252FUB26055_70dd7b5935fba43ee467f54f81864132.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_70dd7b5935fba43ee467f54f81864132.jpg saved to cache
2026-03-27 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f
2026-03-27 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_5efc3ea189e20d2e0786f0bc30620a16.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a29d0>
2026-03-27 10:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f/4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F2f%252Feb2f9f4b438934a4ae448ab5ac7e455e%252Fpa%252FUB26055_5efc3ea189e20d2e0786f0bc30620a16.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_5efc3ea189e20d2e0786f0bc30620a16.jpg saved to cache
2026-03-27 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f
2026-03-27 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_d1dd7badeec5a7e06dd39b8c89c3e2b4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501867210>
2026-03-27 10:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f/4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F2f%252Feb2f9f4b438934a4ae448ab5ac7e455e%252Fpa%252FUB26055_d1dd7badeec5a7e06dd39b8c89c3e2b4.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_d1dd7badeec5a7e06dd39b8c89c3e2b4.jpg saved to cache
2026-03-27 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f
2026-03-27 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_92294e76fc8a6cefacbd24b59db70dfc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5005956d0>
2026-03-27 10:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f/4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F2f%252Feb2f9f4b438934a4ae448ab5ac7e455e%252Fpa%252FUB26055_92294e76fc8a6cefacbd24b59db70dfc.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_92294e76fc8a6cefacbd24b59db70dfc.jpg saved to cache
2026-03-27 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f
2026-03-27 10:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_7f6111cf2b65a46cede64e60e6cb3122.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004c43d0>
2026-03-27 10:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f/4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F2f%252Feb2f9f4b438934a4ae448ab5ac7e455e%252Fpa%252FUB26055_7f6111cf2b65a46cede64e60e6cb3122.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_7f6111cf2b65a46cede64e60e6cb3122.jpg saved to cache
2026-03-27 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f
2026-03-27 10:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_1668db289e5d7d786973269ae6573cd0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5036e0090>
2026-03-27 10:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f/4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F2f%252Feb2f9f4b438934a4ae448ab5ac7e455e%252Fpa%252FUB26055_1668db289e5d7d786973269ae6573cd0.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_1668db289e5d7d786973269ae6573cd0.jpg saved to cache
2026-03-27 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f
2026-03-27 10:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_648d009386eabdf1ae5a1cd7407ead21.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50032d890>
2026-03-27 10:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f/4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F2f%252Feb2f9f4b438934a4ae448ab5ac7e455e%252Fpa%252FUB26055_648d009386eabdf1ae5a1cd7407ead21.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_648d009386eabdf1ae5a1cd7407ead21.jpg saved to cache
2026-03-27 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f
2026-03-27 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_df90632cf720ea733db5d6a9c8afc6d6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500395050>
2026-03-27 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f/4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F2f%252Feb2f9f4b438934a4ae448ab5ac7e455e%252Fpa%252FUB26055_df90632cf720ea733db5d6a9c8afc6d6.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_df90632cf720ea733db5d6a9c8afc6d6.jpg saved to cache
2026-03-27 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f
2026-03-27 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_b8c1ae849788b0f78a788f7effdff666.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501867590>
2026-03-27 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f/4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F2f%252Feb2f9f4b438934a4ae448ab5ac7e455e%252Fpa%252FUB26055_b8c1ae849788b0f78a788f7effdff666.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_b8c1ae849788b0f78a788f7effdff666.jpg saved to cache
2026-03-27 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f
2026-03-27 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_279ca1f3bdb52fac727950c5f0243503.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500397310>
2026-03-27 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f/4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F2f%252Feb2f9f4b438934a4ae448ab5ac7e455e%252Fpa%252FUB26055_279ca1f3bdb52fac727950c5f0243503.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_279ca1f3bdb52fac727950c5f0243503.jpg saved to cache
2026-03-27 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f
2026-03-27 10:36:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f, skipping ID generation
2026-03-27 10:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f with scrape type 1
2026-03-27 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f sending to next pipeline
2026-03-27 10:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f, identifier: UB26055
2026-03-27 10:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f with identifier: UB26055
2026-03-27 10:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f with identifier: UB26055
2026-03-27 10:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f with identifier: UB26055 to the API
2026-03-27 10:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_279ca1f3bdb52fac727950c5f0243503.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:22:04Z',
 'fuel_type': 'petrol',
 'id': '4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB26055',
 'listing': 'auction',
 'location': 'DE, Buchholz',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 120341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f/4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2459666,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_279ca1f3bdb52fac727950c5f0243503.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f/4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2522596,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_b8c1ae849788b0f78a788f7effdff666.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f/4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2529015,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_df90632cf720ea733db5d6a9c8afc6d6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f/4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2476708,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_648d009386eabdf1ae5a1cd7407ead21.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f/4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2431838,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_1668db289e5d7d786973269ae6573cd0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f/4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_7f6111cf2b65a46cede64e60e6cb3122.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f/4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_92294e76fc8a6cefacbd24b59db70dfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f/4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_d1dd7badeec5a7e06dd39b8c89c3e2b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f/4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2301865,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_5efc3ea189e20d2e0786f0bc30620a16.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f/4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/2f/eb2f9f4b438934a4ae448ab5ac7e455e/pa/UB26055_70dd7b5935fba43ee467f54f81864132.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2016}
2026-03-27 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB26055%27 HTTP/1.1" 200 None
2026-03-27 10:36:42 [auto1.de] INFO: Saving data for UB26055: {'created_time': 1774607802.946892, 'last_price_update_time': 1774607802.946904, 'auction_closing_time': 1774714924.0}
2026-03-27 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB26055') HTTP/1.1" 204 0
2026-03-27 10:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_408d5800645806d5f069dcc53a4d8d66.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f1cd0>
2026-03-27 10:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b390d6-6612-5354-9f7e-3ffcd9a55653/97b390d6-6612-5354-9f7e-3ffcd9a55653_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3d%252F143d2ebe7259a9c659bc3072c4cdb6c2%252Fpa%252FLG79841_408d5800645806d5f069dcc53a4d8d66.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_408d5800645806d5f069dcc53a4d8d66.jpg saved to cache
2026-03-27 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97b390d6-6612-5354-9f7e-3ffcd9a55653
2026-03-27 10:36:43 [auto1.de] INFO: Channel: 24h | Page: 6 | totalHits: 10499 | hits on page: 40
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: TP66547
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP66547%27 HTTP/1.1" 200 None
2026-03-27 10:36:43 [auto1.de] INFO: Scrape type for TP66547: 0
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: JS13151
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: PV56207
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: WR99181
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: HY06483
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY06483%27 HTTP/1.1" 200 None
2026-03-27 10:36:43 [auto1.de] INFO: Scrape type for HY06483: 2
2026-03-27 10:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd79f322-cc4e-53e8-bf86-779b1ab3d404 with identifier: HY06483
2026-03-27 10:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd79f322-cc4e-53e8-bf86-779b1ab3d404 with scrape type 2
2026-03-27 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd79f322-cc4e-53e8-bf86-779b1ab3d404 with scrape type 2
2026-03-27 10:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd79f322-cc4e-53e8-bf86-779b1ab3d404, identifier: HY06483
2026-03-27 10:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd79f322-cc4e-53e8-bf86-779b1ab3d404 with identifier: HY06483
2026-03-27 10:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd79f322-cc4e-53e8-bf86-779b1ab3d404 with identifier: HY06483
2026-03-27 10:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd79f322-cc4e-53e8-bf86-779b1ab3d404 with identifier: HY06483 to the API
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:06:37Z',
 'fuel_type': 'petrol',
 'id': 'fd79f322-cc4e-53e8-bf86-779b1ab3d404',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY06483',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 194321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-13',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2006}
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY06483%27 HTTP/1.1" 200 None
2026-03-27 10:36:43 [auto1.de] INFO: Saving data for HY06483: {'auction_closing_time': 1774713997.0, 'created_time': 1773137885.530848, 'last_price_update_time': 1774607803.70491}
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY06483') HTTP/1.1" 204 0
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: VT05460
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: LV46830
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: SJ46577
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: HR97485
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR97485%27 HTTP/1.1" 200 None
2026-03-27 10:36:43 [auto1.de] INFO: Scrape type for HR97485: 1
2026-03-27 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_48cc19c79e57921f833f8538f042e933.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_670037fb5700d61409187160f8e2960a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: FE22716
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: VM88719
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: BB84550
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB84550%27 HTTP/1.1" 200 None
2026-03-27 10:36:43 [auto1.de] INFO: Scrape type for BB84550: 1
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: BJ13428
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ13428%27 HTTP/1.1" 200 None
2026-03-27 10:36:43 [auto1.de] INFO: Scrape type for BJ13428: 1
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: MY92722
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY92722%27 HTTP/1.1" 200 None
2026-03-27 10:36:43 [auto1.de] INFO: Scrape type for MY92722: 1
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: YV97613
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: PT90816
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: ME89657
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME89657%27 HTTP/1.1" 200 None
2026-03-27 10:36:43 [auto1.de] INFO: Scrape type for ME89657: 1
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: JY33610
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: ZC71941
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC71941%27 HTTP/1.1" 200 None
2026-03-27 10:36:43 [auto1.de] INFO: Scrape type for ZC71941: 1
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: DW75956
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: RC49554
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC49554%27 HTTP/1.1" 200 None
2026-03-27 10:36:43 [auto1.de] INFO: Scrape type for RC49554: 1
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: XG24427
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG24427%27 HTTP/1.1" 200 None
2026-03-27 10:36:43 [auto1.de] INFO: Scrape type for XG24427: 1
2026-03-27 10:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501867f10>
2026-03-27 10:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b390d6-6612-5354-9f7e-3ffcd9a55653/97b390d6-6612-5354-9f7e-3ffcd9a55653_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3d%252F143d2ebe7259a9c659bc3072c4cdb6c2%252Fpa%252FLG79841_48cc19c79e57921f833f8538f042e933.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_48cc19c79e57921f833f8538f042e933.jpg saved to cache
2026-03-27 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97b390d6-6612-5354-9f7e-3ffcd9a55653
2026-03-27 10:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016b0990>
2026-03-27 10:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b390d6-6612-5354-9f7e-3ffcd9a55653/97b390d6-6612-5354-9f7e-3ffcd9a55653_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3d%252F143d2ebe7259a9c659bc3072c4cdb6c2%252Fpa%252FLG79841_670037fb5700d61409187160f8e2960a.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_670037fb5700d61409187160f8e2960a.jpg saved to cache
2026-03-27 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97b390d6-6612-5354-9f7e-3ffcd9a55653
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: RY74387
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY74387%27 HTTP/1.1" 200 None
2026-03-27 10:36:43 [auto1.de] INFO: Scrape type for RY74387: 1
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: JT94626
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: XK99060
2026-03-27 10:36:43 [auto1.de] INFO: Found listing with ID: YG21382
2026-03-27 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG21382%27 HTTP/1.1" 200 None
2026-03-27 10:36:44 [auto1.de] INFO: Scrape type for YG21382: 2
2026-03-27 10:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 400fa082-25ab-5be2-b8ec-8ee3cb9ba765 with identifier: YG21382
2026-03-27 10:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 400fa082-25ab-5be2-b8ec-8ee3cb9ba765 with scrape type 2
2026-03-27 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 400fa082-25ab-5be2-b8ec-8ee3cb9ba765 with scrape type 2
2026-03-27 10:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 400fa082-25ab-5be2-b8ec-8ee3cb9ba765, identifier: YG21382
2026-03-27 10:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 400fa082-25ab-5be2-b8ec-8ee3cb9ba765 with identifier: YG21382
2026-03-27 10:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 400fa082-25ab-5be2-b8ec-8ee3cb9ba765 with identifier: YG21382
2026-03-27 10:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 400fa082-25ab-5be2-b8ec-8ee3cb9ba765 with identifier: YG21382 to the API
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:39:12Z',
 'fuel_type': 'petrol',
 'id': '400fa082-25ab-5be2-b8ec-8ee3cb9ba765',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG21382',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 69089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-08',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TSI RS 245',
 'transmission': 'automatic',
 'trim': 'RS 245',
 'year': 2020}
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG21382%27 HTTP/1.1" 200 None
2026-03-27 10:36:44 [auto1.de] INFO: Saving data for YG21382: {'auction_closing_time': 1774715952.0, 'created_time': 1772726265.993264, 'last_price_update_time': 1774607804.462353}
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YG21382') HTTP/1.1" 204 0
2026-03-27 10:36:44 [auto1.de] INFO: Found listing with ID: DY27021
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY27021%27 HTTP/1.1" 200 None
2026-03-27 10:36:44 [auto1.de] INFO: Scrape type for DY27021: 1
2026-03-27 10:36:44 [auto1.de] INFO: Found listing with ID: SA10285
2026-03-27 10:36:44 [auto1.de] INFO: Found listing with ID: RA54991
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA54991%27 HTTP/1.1" 200 None
2026-03-27 10:36:44 [auto1.de] INFO: Scrape type for RA54991: 1
2026-03-27 10:36:44 [auto1.de] INFO: Found listing with ID: EN90928
2026-03-27 10:36:44 [auto1.de] INFO: Found listing with ID: LA44092
2026-03-27 10:36:44 [auto1.de] INFO: Found listing with ID: JL12737
2026-03-27 10:36:44 [auto1.de] INFO: Found listing with ID: GL18465
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL18465%27 HTTP/1.1" 200 None
2026-03-27 10:36:44 [auto1.de] INFO: Scrape type for GL18465: 1
2026-03-27 10:36:44 [auto1.de] INFO: Found listing with ID: AX51342
2026-03-27 10:36:44 [auto1.de] INFO: Found listing with ID: HJ55484
2026-03-27 10:36:44 [auto1.de] INFO: Found listing with ID: PB35846
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB35846%27 HTTP/1.1" 200 None
2026-03-27 10:36:44 [auto1.de] INFO: Scrape type for PB35846: 1
2026-03-27 10:36:44 [auto1.de] INFO: Found listing with ID: MW22662
2026-03-27 10:36:44 [auto1.de] INFO: Found listing with ID: HB69443
2026-03-27 10:36:44 [auto1.de] INFO: Found listing with ID: MV22283
2026-03-27 10:36:44 [auto1.de] INFO: Found listing with ID: LM85601
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85601%27 HTTP/1.1" 200 None
2026-03-27 10:36:44 [auto1.de] INFO: Scrape type for LM85601: 1
2026-03-27 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_4c3a2540b2182d855e436f6ae72597fe.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50058ae90>
2026-03-27 10:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97b390d6-6612-5354-9f7e-3ffcd9a55653/97b390d6-6612-5354-9f7e-3ffcd9a55653_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3d%252F143d2ebe7259a9c659bc3072c4cdb6c2%252Fpa%252FLG79841_4c3a2540b2182d855e436f6ae72597fe.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_4c3a2540b2182d855e436f6ae72597fe.jpg saved to cache
2026-03-27 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97b390d6-6612-5354-9f7e-3ffcd9a55653
2026-03-27 10:36:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97b390d6-6612-5354-9f7e-3ffcd9a55653, skipping ID generation
2026-03-27 10:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97b390d6-6612-5354-9f7e-3ffcd9a55653 with scrape type 1
2026-03-27 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97b390d6-6612-5354-9f7e-3ffcd9a55653 sending to next pipeline
2026-03-27 10:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97b390d6-6612-5354-9f7e-3ffcd9a55653, identifier: LG79841
2026-03-27 10:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97b390d6-6612-5354-9f7e-3ffcd9a55653 with identifier: LG79841
2026-03-27 10:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97b390d6-6612-5354-9f7e-3ffcd9a55653 with identifier: LG79841
2026-03-27 10:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97b390d6-6612-5354-9f7e-3ffcd9a55653 with identifier: LG79841 to the API
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_4c3a2540b2182d855e436f6ae72597fe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:44:17Z',
 'fuel_type': 'petrol',
 'id': '97b390d6-6612-5354-9f7e-3ffcd9a55653',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG79841',
 'listing': 'auction',
 'location': 'DE, Tradein',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 110816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b390d6-6612-5354-9f7e-3ffcd9a55653/97b390d6-6612-5354-9f7e-3ffcd9a55653_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2834128,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_4c3a2540b2182d855e436f6ae72597fe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b390d6-6612-5354-9f7e-3ffcd9a55653/97b390d6-6612-5354-9f7e-3ffcd9a55653_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_670037fb5700d61409187160f8e2960a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b390d6-6612-5354-9f7e-3ffcd9a55653/97b390d6-6612-5354-9f7e-3ffcd9a55653_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_48cc19c79e57921f833f8538f042e933.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b390d6-6612-5354-9f7e-3ffcd9a55653/97b390d6-6612-5354-9f7e-3ffcd9a55653_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_408d5800645806d5f069dcc53a4d8d66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b390d6-6612-5354-9f7e-3ffcd9a55653/97b390d6-6612-5354-9f7e-3ffcd9a55653_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2818501,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_1e19e46a79c58027bf4eef1a00ce7b76.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b390d6-6612-5354-9f7e-3ffcd9a55653/97b390d6-6612-5354-9f7e-3ffcd9a55653_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2842959,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_c36bf6736ff8dae5a8db780b0d077cc4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b390d6-6612-5354-9f7e-3ffcd9a55653/97b390d6-6612-5354-9f7e-3ffcd9a55653_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3051399,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_4fd040b62f178eeda85ed29c70a2f29f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b390d6-6612-5354-9f7e-3ffcd9a55653/97b390d6-6612-5354-9f7e-3ffcd9a55653_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_2576fb4698268bb587f0bf7382019321.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b390d6-6612-5354-9f7e-3ffcd9a55653/97b390d6-6612-5354-9f7e-3ffcd9a55653_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_7d33337bf748d332e3012c6ea12ec5b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97b390d6-6612-5354-9f7e-3ffcd9a55653/97b390d6-6612-5354-9f7e-3ffcd9a55653_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3d/143d2ebe7259a9c659bc3072c4cdb6c2/pa/LG79841_89578061e22c895c0ec073f30f5b506f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2020}
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG79841%27 HTTP/1.1" 200 None
2026-03-27 10:36:45 [auto1.de] INFO: Saving data for LG79841: {'created_time': 1774607805.399955, 'last_price_update_time': 1774607805.399969, 'auction_closing_time': 1774716257.0}
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG79841') HTTP/1.1" 204 0
2026-03-27 10:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WR03810/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KT29520> (referer: https://www.auto1.com/v1/car-details-view/KT29520/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eee42b4-2ad0-567f-a8dd-08305af2d577 with identifier: KT29520
2026-03-27 10:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eee42b4-2ad0-567f-a8dd-08305af2d577 with scrape type 1
2026-03-27 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6eee42b4-2ad0-567f-a8dd-08305af2d577
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb7%252F6bb76921dd9e6e8688e6c02dc9c7ea06%252Fpa%252FKT29520_c7ffb3496ccfd762b52d6da8cbcd54ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_c7ffb3496ccfd762b52d6da8cbcd54ea.jpg not downloaded yet
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb7%252F6bb76921dd9e6e8688e6c02dc9c7ea06%252Fpa%252FKT29520_c54884b699914fc1d836a02457c658bd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_c54884b699914fc1d836a02457c658bd.jpg not downloaded yet
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb7%252F6bb76921dd9e6e8688e6c02dc9c7ea06%252Fpa%252FKT29520_62d19dd3247fdf9b9d01b6465dd7704b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_62d19dd3247fdf9b9d01b6465dd7704b.jpg not downloaded yet
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb7%252F6bb76921dd9e6e8688e6c02dc9c7ea06%252Fpa%252FKT29520_cf07a85354c8297e0fed9cc56da910fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_cf07a85354c8297e0fed9cc56da910fa.jpg not downloaded yet
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb7%252F6bb76921dd9e6e8688e6c02dc9c7ea06%252Fpa%252FKT29520_9b88ed13344d8572b51db64679ce5f65.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_9b88ed13344d8572b51db64679ce5f65.jpg not downloaded yet
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb7%252F6bb76921dd9e6e8688e6c02dc9c7ea06%252Fpa%252FKT29520_fa765c1c1e7fe5262a2a24d100da7021.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_fa765c1c1e7fe5262a2a24d100da7021.jpg not downloaded yet
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb7%252F6bb76921dd9e6e8688e6c02dc9c7ea06%252Fpa%252FKT29520_8a61d076e6f33e0cc4ac0fe08f4aa68a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_8a61d076e6f33e0cc4ac0fe08f4aa68a.jpg not downloaded yet
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb7%252F6bb76921dd9e6e8688e6c02dc9c7ea06%252Fpa%252FKT29520_97347ca1ae5c105fda7f3a6594c98ff8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_97347ca1ae5c105fda7f3a6594c98ff8.jpg not downloaded yet
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb7%252F6bb76921dd9e6e8688e6c02dc9c7ea06%252Fpa%252FKT29520_a4efde609309fc966477ff229a7f35f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_a4efde609309fc966477ff229a7f35f5.jpg not downloaded yet
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb7%252F6bb76921dd9e6e8688e6c02dc9c7ea06%252Fpa%252FKT29520_edf3754f55577e299d4f353a9fb73519.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_edf3754f55577e299d4f353a9fb73519.jpg not downloaded yet
2026-03-27 10:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB35938> (referer: https://www.auto1.com/v1/car-details-view/AB35938/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b with identifier: AB35938
2026-03-27 10:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b with scrape type 1
2026-03-27 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F08%252F27082fde18b60b3760f71d13a6935f0c%252Fpa%252FAB35938_12a5c875e19c33ede6f06dbf6ffe43bd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_12a5c875e19c33ede6f06dbf6ffe43bd.jpg not downloaded yet
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F08%252F27082fde18b60b3760f71d13a6935f0c%252Fpa%252FAB35938_cf8018c0d7cd25c8a857663afc189435.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_cf8018c0d7cd25c8a857663afc189435.jpg not downloaded yet
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F08%252F27082fde18b60b3760f71d13a6935f0c%252Fpa%252FAB35938_263c725c5196bc603cb50ab707247462.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_263c725c5196bc603cb50ab707247462.jpg not downloaded yet
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F08%252F27082fde18b60b3760f71d13a6935f0c%252Fpa%252FAB35938_8a58896c11364f042c27a0702ee82869.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_8a58896c11364f042c27a0702ee82869.jpg not downloaded yet
2026-03-27 10:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_edf3754f55577e299d4f353a9fb73519.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F08%252F27082fde18b60b3760f71d13a6935f0c%252Fpa%252FAB35938_8f33efbb1441b10d118f49a2775d7883.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_8f33efbb1441b10d118f49a2775d7883.jpg not downloaded yet
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F08%252F27082fde18b60b3760f71d13a6935f0c%252Fpa%252FAB35938_ae09e6f56b8e8d19354edd807d5c11a9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_ae09e6f56b8e8d19354edd807d5c11a9.jpg not downloaded yet
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F08%252F27082fde18b60b3760f71d13a6935f0c%252Fpa%252FAB35938_e336d3ac9bb8808cb7afa292e6492111.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_e336d3ac9bb8808cb7afa292e6492111.jpg not downloaded yet
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F08%252F27082fde18b60b3760f71d13a6935f0c%252Fpa%252FAB35938_98dc98c8d3d48e5c4566b5e95440f17f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_98dc98c8d3d48e5c4566b5e95440f17f.jpg not downloaded yet
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F08%252F27082fde18b60b3760f71d13a6935f0c%252Fpa%252FAB35938_deee942deb4b4f651b742e4ebf8786a9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_deee942deb4b4f651b742e4ebf8786a9.jpg not downloaded yet
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F08%252F27082fde18b60b3760f71d13a6935f0c%252Fpa%252FAB35938_4fe297e30ed47475f7f1a1546ad1a3c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_4fe297e30ed47475f7f1a1546ad1a3c5.jpg not downloaded yet
2026-03-27 10:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50198b450>
2026-03-27 10:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eee42b4-2ad0-567f-a8dd-08305af2d577/6eee42b4-2ad0-567f-a8dd-08305af2d577_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb7%252F6bb76921dd9e6e8688e6c02dc9c7ea06%252Fpa%252FKT29520_edf3754f55577e299d4f353a9fb73519.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_edf3754f55577e299d4f353a9fb73519.jpg saved to cache
2026-03-27 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6eee42b4-2ad0-567f-a8dd-08305af2d577
2026-03-27 10:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE15343/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_8a58896c11364f042c27a0702ee82869.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_4fe297e30ed47475f7f1a1546ad1a3c5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501969d50>
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b/9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F08%252F27082fde18b60b3760f71d13a6935f0c%252Fpa%252FAB35938_8a58896c11364f042c27a0702ee82869.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_8a58896c11364f042c27a0702ee82869.jpg saved to cache
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500314f50>
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b/9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F08%252F27082fde18b60b3760f71d13a6935f0c%252Fpa%252FAB35938_4fe297e30ed47475f7f1a1546ad1a3c5.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_4fe297e30ed47475f7f1a1546ad1a3c5.jpg saved to cache
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b
2026-03-27 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_deee942deb4b4f651b742e4ebf8786a9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50373fd90>
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b/9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F08%252F27082fde18b60b3760f71d13a6935f0c%252Fpa%252FAB35938_deee942deb4b4f651b742e4ebf8786a9.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_deee942deb4b4f651b742e4ebf8786a9.jpg saved to cache
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b
2026-03-27 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_98dc98c8d3d48e5c4566b5e95440f17f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50165e210>
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b/9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F08%252F27082fde18b60b3760f71d13a6935f0c%252Fpa%252FAB35938_98dc98c8d3d48e5c4566b5e95440f17f.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_98dc98c8d3d48e5c4566b5e95440f17f.jpg saved to cache
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b
2026-03-27 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_e336d3ac9bb8808cb7afa292e6492111.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500314b90>
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b/9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F08%252F27082fde18b60b3760f71d13a6935f0c%252Fpa%252FAB35938_e336d3ac9bb8808cb7afa292e6492111.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_e336d3ac9bb8808cb7afa292e6492111.jpg saved to cache
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b
2026-03-27 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_ae09e6f56b8e8d19354edd807d5c11a9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501941090>
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b/9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F08%252F27082fde18b60b3760f71d13a6935f0c%252Fpa%252FAB35938_ae09e6f56b8e8d19354edd807d5c11a9.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_ae09e6f56b8e8d19354edd807d5c11a9.jpg saved to cache
2026-03-27 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b
2026-03-27 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_8f33efbb1441b10d118f49a2775d7883.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_263c725c5196bc603cb50ab707247462.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015d5f10>
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b/9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F08%252F27082fde18b60b3760f71d13a6935f0c%252Fpa%252FAB35938_8f33efbb1441b10d118f49a2775d7883.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_8f33efbb1441b10d118f49a2775d7883.jpg saved to cache
2026-03-27 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50196bc90>
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b/9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F08%252F27082fde18b60b3760f71d13a6935f0c%252Fpa%252FAB35938_263c725c5196bc603cb50ab707247462.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_263c725c5196bc603cb50ab707247462.jpg saved to cache
2026-03-27 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b
2026-03-27 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_cf8018c0d7cd25c8a857663afc189435.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500314c90>
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b/9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F08%252F27082fde18b60b3760f71d13a6935f0c%252Fpa%252FAB35938_cf8018c0d7cd25c8a857663afc189435.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_cf8018c0d7cd25c8a857663afc189435.jpg saved to cache
2026-03-27 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b
2026-03-27 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_12a5c875e19c33ede6f06dbf6ffe43bd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016b99d0>
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b/9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F08%252F27082fde18b60b3760f71d13a6935f0c%252Fpa%252FAB35938_12a5c875e19c33ede6f06dbf6ffe43bd.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_12a5c875e19c33ede6f06dbf6ffe43bd.jpg saved to cache
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b
2026-03-27 10:36:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b, skipping ID generation
2026-03-27 10:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b with scrape type 1
2026-03-27 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b sending to next pipeline
2026-03-27 10:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b, identifier: AB35938
2026-03-27 10:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b with identifier: AB35938
2026-03-27 10:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b with identifier: AB35938
2026-03-27 10:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b with identifier: AB35938 to the API
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_12a5c875e19c33ede6f06dbf6ffe43bd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:53:09Z',
 'fuel_type': 'petrol',
 'id': '9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB35938',
 'listing': 'auction',
 'location': 'DE, Bielefeld',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 127928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b/9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2574387,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_12a5c875e19c33ede6f06dbf6ffe43bd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b/9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_cf8018c0d7cd25c8a857663afc189435.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b/9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_263c725c5196bc603cb50ab707247462.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b/9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_8a58896c11364f042c27a0702ee82869.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b/9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2535951,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_8f33efbb1441b10d118f49a2775d7883.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b/9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_ae09e6f56b8e8d19354edd807d5c11a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b/9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_e336d3ac9bb8808cb7afa292e6492111.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b/9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_98dc98c8d3d48e5c4566b5e95440f17f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b/9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2534200,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_deee942deb4b4f651b742e4ebf8786a9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b/9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/08/27082fde18b60b3760f71d13a6935f0c/pa/AB35938_4fe297e30ed47475f7f1a1546ad1a3c5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Style Viva',
 'transmission': 'manual',
 'trim': 'Style Viva',
 'year': 2012}
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB35938%27 HTTP/1.1" 200 None
2026-03-27 10:36:50 [auto1.de] INFO: Saving data for AB35938: {'created_time': 1774607810.917283, 'last_price_update_time': 1774607810.917298, 'auction_closing_time': 1774716789.0}
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB35938') HTTP/1.1" 204 0
2026-03-27 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_a4efde609309fc966477ff229a7f35f5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50058b990>
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eee42b4-2ad0-567f-a8dd-08305af2d577/6eee42b4-2ad0-567f-a8dd-08305af2d577_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb7%252F6bb76921dd9e6e8688e6c02dc9c7ea06%252Fpa%252FKT29520_a4efde609309fc966477ff229a7f35f5.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_a4efde609309fc966477ff229a7f35f5.jpg saved to cache
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6eee42b4-2ad0-567f-a8dd-08305af2d577
2026-03-27 10:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_97347ca1ae5c105fda7f3a6594c98ff8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50175db10>
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eee42b4-2ad0-567f-a8dd-08305af2d577/6eee42b4-2ad0-567f-a8dd-08305af2d577_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb7%252F6bb76921dd9e6e8688e6c02dc9c7ea06%252Fpa%252FKT29520_97347ca1ae5c105fda7f3a6594c98ff8.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_97347ca1ae5c105fda7f3a6594c98ff8.jpg saved to cache
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6eee42b4-2ad0-567f-a8dd-08305af2d577
2026-03-27 10:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_8a61d076e6f33e0cc4ac0fe08f4aa68a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50057d390>
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eee42b4-2ad0-567f-a8dd-08305af2d577/6eee42b4-2ad0-567f-a8dd-08305af2d577_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb7%252F6bb76921dd9e6e8688e6c02dc9c7ea06%252Fpa%252FKT29520_8a61d076e6f33e0cc4ac0fe08f4aa68a.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_8a61d076e6f33e0cc4ac0fe08f4aa68a.jpg saved to cache
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6eee42b4-2ad0-567f-a8dd-08305af2d577
2026-03-27 10:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_fa765c1c1e7fe5262a2a24d100da7021.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_9b88ed13344d8572b51db64679ce5f65.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50175fbd0>
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eee42b4-2ad0-567f-a8dd-08305af2d577/6eee42b4-2ad0-567f-a8dd-08305af2d577_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb7%252F6bb76921dd9e6e8688e6c02dc9c7ea06%252Fpa%252FKT29520_fa765c1c1e7fe5262a2a24d100da7021.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_fa765c1c1e7fe5262a2a24d100da7021.jpg saved to cache
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6eee42b4-2ad0-567f-a8dd-08305af2d577
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50175db50>
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eee42b4-2ad0-567f-a8dd-08305af2d577/6eee42b4-2ad0-567f-a8dd-08305af2d577_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb7%252F6bb76921dd9e6e8688e6c02dc9c7ea06%252Fpa%252FKT29520_9b88ed13344d8572b51db64679ce5f65.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_9b88ed13344d8572b51db64679ce5f65.jpg saved to cache
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6eee42b4-2ad0-567f-a8dd-08305af2d577
2026-03-27 10:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_cf07a85354c8297e0fed9cc56da910fa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_62d19dd3247fdf9b9d01b6465dd7704b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015e34d0>
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eee42b4-2ad0-567f-a8dd-08305af2d577/6eee42b4-2ad0-567f-a8dd-08305af2d577_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb7%252F6bb76921dd9e6e8688e6c02dc9c7ea06%252Fpa%252FKT29520_cf07a85354c8297e0fed9cc56da910fa.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_cf07a85354c8297e0fed9cc56da910fa.jpg saved to cache
2026-03-27 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6eee42b4-2ad0-567f-a8dd-08305af2d577
2026-03-27 10:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_c54884b699914fc1d836a02457c658bd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015e0590>
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eee42b4-2ad0-567f-a8dd-08305af2d577/6eee42b4-2ad0-567f-a8dd-08305af2d577_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb7%252F6bb76921dd9e6e8688e6c02dc9c7ea06%252Fpa%252FKT29520_62d19dd3247fdf9b9d01b6465dd7704b.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_62d19dd3247fdf9b9d01b6465dd7704b.jpg saved to cache
2026-03-27 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6eee42b4-2ad0-567f-a8dd-08305af2d577
2026-03-27 10:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_c7ffb3496ccfd762b52d6da8cbcd54ea.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015d53d0>
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eee42b4-2ad0-567f-a8dd-08305af2d577/6eee42b4-2ad0-567f-a8dd-08305af2d577_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb7%252F6bb76921dd9e6e8688e6c02dc9c7ea06%252Fpa%252FKT29520_c54884b699914fc1d836a02457c658bd.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_c54884b699914fc1d836a02457c658bd.jpg saved to cache
2026-03-27 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6eee42b4-2ad0-567f-a8dd-08305af2d577
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017e7d10>
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eee42b4-2ad0-567f-a8dd-08305af2d577/6eee42b4-2ad0-567f-a8dd-08305af2d577_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb7%252F6bb76921dd9e6e8688e6c02dc9c7ea06%252Fpa%252FKT29520_c7ffb3496ccfd762b52d6da8cbcd54ea.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_c7ffb3496ccfd762b52d6da8cbcd54ea.jpg saved to cache
2026-03-27 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6eee42b4-2ad0-567f-a8dd-08305af2d577
2026-03-27 10:36:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6eee42b4-2ad0-567f-a8dd-08305af2d577, skipping ID generation
2026-03-27 10:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eee42b4-2ad0-567f-a8dd-08305af2d577 with scrape type 1
2026-03-27 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6eee42b4-2ad0-567f-a8dd-08305af2d577 sending to next pipeline
2026-03-27 10:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6eee42b4-2ad0-567f-a8dd-08305af2d577, identifier: KT29520
2026-03-27 10:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6eee42b4-2ad0-567f-a8dd-08305af2d577 with identifier: KT29520
2026-03-27 10:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6eee42b4-2ad0-567f-a8dd-08305af2d577 with identifier: KT29520
2026-03-27 10:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6eee42b4-2ad0-567f-a8dd-08305af2d577 with identifier: KT29520 to the API
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_c7ffb3496ccfd762b52d6da8cbcd54ea.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 299,
 'expiration_date': '2026-03-28T16:23:46Z',
 'fuel_type': 'hybrid',
 'id': '6eee42b4-2ad0-567f-a8dd-08305af2d577',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT29520',
 'listing': 'auction',
 'location': 'DE, Mannheim',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 40379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eee42b4-2ad0-567f-a8dd-08305af2d577/6eee42b4-2ad0-567f-a8dd-08305af2d577_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_c7ffb3496ccfd762b52d6da8cbcd54ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eee42b4-2ad0-567f-a8dd-08305af2d577/6eee42b4-2ad0-567f-a8dd-08305af2d577_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_c54884b699914fc1d836a02457c658bd.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eee42b4-2ad0-567f-a8dd-08305af2d577/6eee42b4-2ad0-567f-a8dd-08305af2d577_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_62d19dd3247fdf9b9d01b6465dd7704b.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eee42b4-2ad0-567f-a8dd-08305af2d577/6eee42b4-2ad0-567f-a8dd-08305af2d577_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_cf07a85354c8297e0fed9cc56da910fa.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eee42b4-2ad0-567f-a8dd-08305af2d577/6eee42b4-2ad0-567f-a8dd-08305af2d577_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_9b88ed13344d8572b51db64679ce5f65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eee42b4-2ad0-567f-a8dd-08305af2d577/6eee42b4-2ad0-567f-a8dd-08305af2d577_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_fa765c1c1e7fe5262a2a24d100da7021.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eee42b4-2ad0-567f-a8dd-08305af2d577/6eee42b4-2ad0-567f-a8dd-08305af2d577_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_8a61d076e6f33e0cc4ac0fe08f4aa68a.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eee42b4-2ad0-567f-a8dd-08305af2d577/6eee42b4-2ad0-567f-a8dd-08305af2d577_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_97347ca1ae5c105fda7f3a6594c98ff8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eee42b4-2ad0-567f-a8dd-08305af2d577/6eee42b4-2ad0-567f-a8dd-08305af2d577_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_a4efde609309fc966477ff229a7f35f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eee42b4-2ad0-567f-a8dd-08305af2d577/6eee42b4-2ad0-567f-a8dd-08305af2d577_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b7/6bb76921dd9e6e8688e6c02dc9c7ea06/pa/KT29520_edf3754f55577e299d4f353a9fb73519.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 4 300 GT',
 'transmission': 'automatic',
 'trim': '4 300 GT',
 'year': 2022}
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT29520%27 HTTP/1.1" 200 None
2026-03-27 10:36:52 [auto1.de] INFO: Saving data for KT29520: {'created_time': 1774607812.845102, 'last_price_update_time': 1774607812.845115, 'auction_closing_time': 1774715026.0}
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT29520') HTTP/1.1" 204 0
2026-03-27 10:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CR88792> (referer: https://www.auto1.com/v1/car-details-view/CR88792/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ade2caca-3bbf-512f-962d-1cfe8490ba3a with identifier: CR88792
2026-03-27 10:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ade2caca-3bbf-512f-962d-1cfe8490ba3a with scrape type 1
2026-03-27 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ade2caca-3bbf-512f-962d-1cfe8490ba3a
2026-03-27 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F47%252F1247947acc8e345af4a35ee6b4ab894e%252Fpa%252FCR88792_38360a42e8496ccb3c8721abb8d633ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_38360a42e8496ccb3c8721abb8d633ea.jpg already downloaded
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F47%252F1247947acc8e345af4a35ee6b4ab894e%252Fpa%252FCR88792_dc87c910a929107ba02f9a0b255a9da8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_dc87c910a929107ba02f9a0b255a9da8.jpg already downloaded
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F47%252F1247947acc8e345af4a35ee6b4ab894e%252Fpa%252FCR88792_986c7bc83e7ac43f8b0c4b6a3f7c054d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_986c7bc83e7ac43f8b0c4b6a3f7c054d.jpg already downloaded
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F47%252F1247947acc8e345af4a35ee6b4ab894e%252Fpa%252FCR88792_8ed6fca64040710275f3cbf6499e59b9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_8ed6fca64040710275f3cbf6499e59b9.jpg already downloaded
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F47%252F1247947acc8e345af4a35ee6b4ab894e%252Fpa%252FCR88792_ebb23c86357d96b24bf6c37055610b31.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_ebb23c86357d96b24bf6c37055610b31.jpg already downloaded
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F47%252F1247947acc8e345af4a35ee6b4ab894e%252Fpa%252FCR88792_dc77394dab3aaae643d5da6863856366.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_dc77394dab3aaae643d5da6863856366.jpg already downloaded
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F47%252F1247947acc8e345af4a35ee6b4ab894e%252Fpa%252FCR88792_111bc2de635f91383a10f35023e8fe03.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_111bc2de635f91383a10f35023e8fe03.jpg already downloaded
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F47%252F1247947acc8e345af4a35ee6b4ab894e%252Fpa%252FCR88792_9c3bdc78760ec3404f7544c9420f0238.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_9c3bdc78760ec3404f7544c9420f0238.jpg already downloaded
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F47%252F1247947acc8e345af4a35ee6b4ab894e%252Fpa%252FCR88792_781a628c2eebe558bb50b24ac02980fe.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_781a628c2eebe558bb50b24ac02980fe.jpg already downloaded
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F47%252F1247947acc8e345af4a35ee6b4ab894e%252Fpa%252FCR88792_fb8e056c684a52d45c3b52f6c44b4490.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_fb8e056c684a52d45c3b52f6c44b4490.jpg already downloaded
2026-03-27 10:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ade2caca-3bbf-512f-962d-1cfe8490ba3a, identifier: CR88792
2026-03-27 10:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ade2caca-3bbf-512f-962d-1cfe8490ba3a with identifier: CR88792
2026-03-27 10:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ade2caca-3bbf-512f-962d-1cfe8490ba3a with identifier: CR88792
2026-03-27 10:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ade2caca-3bbf-512f-962d-1cfe8490ba3a with identifier: CR88792 to the API
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CR88792>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:13:51Z',
 'fuel_type': 'petrol',
 'id': 'ade2caca-3bbf-512f-962d-1cfe8490ba3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR88792',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 144392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_38360a42e8496ccb3c8721abb8d633ea.jpg',
                'https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_dc87c910a929107ba02f9a0b255a9da8.jpg',
                'https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_986c7bc83e7ac43f8b0c4b6a3f7c054d.jpg',
                'https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_8ed6fca64040710275f3cbf6499e59b9.jpg',
                'https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_ebb23c86357d96b24bf6c37055610b31.jpg',
                'https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_dc77394dab3aaae643d5da6863856366.jpg',
                'https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_111bc2de635f91383a10f35023e8fe03.jpg',
                'https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_9c3bdc78760ec3404f7544c9420f0238.jpg',
                'https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_781a628c2eebe558bb50b24ac02980fe.jpg',
                'https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_fb8e056c684a52d45c3b52f6c44b4490.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ade2caca-3bbf-512f-962d-1cfe8490ba3a/ade2caca-3bbf-512f-962d-1cfe8490ba3a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2557581,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_38360a42e8496ccb3c8721abb8d633ea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ade2caca-3bbf-512f-962d-1cfe8490ba3a/ade2caca-3bbf-512f-962d-1cfe8490ba3a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_dc87c910a929107ba02f9a0b255a9da8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ade2caca-3bbf-512f-962d-1cfe8490ba3a/ade2caca-3bbf-512f-962d-1cfe8490ba3a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_986c7bc83e7ac43f8b0c4b6a3f7c054d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ade2caca-3bbf-512f-962d-1cfe8490ba3a/ade2caca-3bbf-512f-962d-1cfe8490ba3a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_8ed6fca64040710275f3cbf6499e59b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ade2caca-3bbf-512f-962d-1cfe8490ba3a/ade2caca-3bbf-512f-962d-1cfe8490ba3a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_ebb23c86357d96b24bf6c37055610b31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ade2caca-3bbf-512f-962d-1cfe8490ba3a/ade2caca-3bbf-512f-962d-1cfe8490ba3a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_dc77394dab3aaae643d5da6863856366.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ade2caca-3bbf-512f-962d-1cfe8490ba3a/ade2caca-3bbf-512f-962d-1cfe8490ba3a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2721568,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_111bc2de635f91383a10f35023e8fe03.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ade2caca-3bbf-512f-962d-1cfe8490ba3a/ade2caca-3bbf-512f-962d-1cfe8490ba3a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_9c3bdc78760ec3404f7544c9420f0238.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ade2caca-3bbf-512f-962d-1cfe8490ba3a/ade2caca-3bbf-512f-962d-1cfe8490ba3a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_781a628c2eebe558bb50b24ac02980fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ade2caca-3bbf-512f-962d-1cfe8490ba3a/ade2caca-3bbf-512f-962d-1cfe8490ba3a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2727063,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/47/1247947acc8e345af4a35ee6b4ab894e/pa/CR88792_fb8e056c684a52d45c3b52f6c44b4490.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2016}
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR88792%27 HTTP/1.1" 200 None
2026-03-27 10:36:53 [auto1.de] INFO: Saving data for CR88792: {'created_time': 1774607813.636578, 'last_price_update_time': 1774607813.636593, 'auction_closing_time': 1774714431.0}
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR88792') HTTP/1.1" 204 0
2026-03-27 10:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WZ14073/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR74432> (referer: https://www.auto1.com/v1/car-details-view/YR74432/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cc4cd8e-8bcf-5a22-bd34-30f574283794 with identifier: YR74432
2026-03-27 10:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cc4cd8e-8bcf-5a22-bd34-30f574283794 with scrape type 1
2026-03-27 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0cc4cd8e-8bcf-5a22-bd34-30f574283794
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd1%252F03d1a09115e43a4640830b4d1f7c4eae%252Fpa%252FYR74432_fc8565b96d58b2f884868faaa2817d17.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_fc8565b96d58b2f884868faaa2817d17.jpg not downloaded yet
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd1%252F03d1a09115e43a4640830b4d1f7c4eae%252Fpa%252FYR74432_f2b02ec6248bd95fafffbb2bb194f797.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_f2b02ec6248bd95fafffbb2bb194f797.jpg not downloaded yet
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd1%252F03d1a09115e43a4640830b4d1f7c4eae%252Fpa%252FYR74432_f6ba6c394d6a9d7817b4678211e4394f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_f6ba6c394d6a9d7817b4678211e4394f.jpg not downloaded yet
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd1%252F03d1a09115e43a4640830b4d1f7c4eae%252Fpa%252FYR74432_1e98396b6f306e0e70d7a6be733304f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_1e98396b6f306e0e70d7a6be733304f3.jpg not downloaded yet
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd1%252F03d1a09115e43a4640830b4d1f7c4eae%252Fpa%252FYR74432_4e211a694001af73c913e9105fcea276.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_4e211a694001af73c913e9105fcea276.jpg not downloaded yet
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd1%252F03d1a09115e43a4640830b4d1f7c4eae%252Fpa%252FYR74432_f68dade3b33b9dbe73634e2f0e9228eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_f68dade3b33b9dbe73634e2f0e9228eb.jpg not downloaded yet
2026-03-27 10:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:36:57 [auto1.de] INFO: Channel: 24h | Page: 7 | totalHits: 10502 | hits on page: 40
2026-03-27 10:36:57 [auto1.de] INFO: Found listing with ID: HB69443
2026-03-27 10:36:57 [auto1.de] INFO: Found listing with ID: MV22283
2026-03-27 10:36:57 [auto1.de] INFO: Found listing with ID: LM85601
2026-03-27 10:36:57 [auto1.de] INFO: Found listing with ID: WT41205
2026-03-27 10:36:57 [auto1.de] INFO: Found listing with ID: RM51665
2026-03-27 10:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM51665%27 HTTP/1.1" 200 None
2026-03-27 10:36:57 [auto1.de] INFO: Scrape type for RM51665: 2
2026-03-27 10:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce4719aa-1a6b-5615-b1a4-d4cc0df408fc with identifier: RM51665
2026-03-27 10:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce4719aa-1a6b-5615-b1a4-d4cc0df408fc with scrape type 2
2026-03-27 10:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce4719aa-1a6b-5615-b1a4-d4cc0df408fc with scrape type 2
2026-03-27 10:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce4719aa-1a6b-5615-b1a4-d4cc0df408fc, identifier: RM51665
2026-03-27 10:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce4719aa-1a6b-5615-b1a4-d4cc0df408fc with identifier: RM51665
2026-03-27 10:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce4719aa-1a6b-5615-b1a4-d4cc0df408fc with identifier: RM51665
2026-03-27 10:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce4719aa-1a6b-5615-b1a4-d4cc0df408fc with identifier: RM51665 to the API
2026-03-27 10:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:44:07Z',
 'fuel_type': 'diesel',
 'id': 'ce4719aa-1a6b-5615-b1a4-d4cc0df408fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM51665',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 223790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-25',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi DPF Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM51665%27 HTTP/1.1" 200 None
2026-03-27 10:36:58 [auto1.de] INFO: Saving data for RM51665: {'auction_closing_time': 1774716247.0, 'created_time': 1774032379.989111, 'last_price_update_time': 1774607818.346725}
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM51665') HTTP/1.1" 204 0
2026-03-27 10:36:58 [auto1.de] INFO: Found listing with ID: DA44697
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA44697%27 HTTP/1.1" 200 None
2026-03-27 10:36:58 [auto1.de] INFO: Scrape type for DA44697: 1
2026-03-27 10:36:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_f68dade3b33b9dbe73634e2f0e9228eb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:36:58 [auto1.de] INFO: Found listing with ID: NL59666
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59666%27 HTTP/1.1" 200 None
2026-03-27 10:36:58 [auto1.de] INFO: Scrape type for NL59666: 1
2026-03-27 10:36:58 [auto1.de] INFO: Found listing with ID: MN72943
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN72943%27 HTTP/1.1" 200 None
2026-03-27 10:36:58 [auto1.de] INFO: Scrape type for MN72943: 1
2026-03-27 10:36:58 [auto1.de] INFO: Found listing with ID: AU24928
2026-03-27 10:36:58 [auto1.de] INFO: Found listing with ID: BK59777
2026-03-27 10:36:58 [auto1.de] INFO: Found listing with ID: FB09525
2026-03-27 10:36:58 [auto1.de] INFO: Found listing with ID: NL50541
2026-03-27 10:36:58 [auto1.de] INFO: Found listing with ID: AB87355
2026-03-27 10:36:58 [auto1.de] INFO: Found listing with ID: NX68666
2026-03-27 10:36:58 [auto1.de] INFO: Found listing with ID: RE53759
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE53759%27 HTTP/1.1" 200 None
2026-03-27 10:36:58 [auto1.de] INFO: Scrape type for RE53759: 2
2026-03-27 10:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8a6067b-ee3b-5610-a804-62b31a689d9b with identifier: RE53759
2026-03-27 10:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8a6067b-ee3b-5610-a804-62b31a689d9b with scrape type 2
2026-03-27 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8a6067b-ee3b-5610-a804-62b31a689d9b with scrape type 2
2026-03-27 10:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8a6067b-ee3b-5610-a804-62b31a689d9b, identifier: RE53759
2026-03-27 10:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8a6067b-ee3b-5610-a804-62b31a689d9b with identifier: RE53759
2026-03-27 10:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8a6067b-ee3b-5610-a804-62b31a689d9b with identifier: RE53759
2026-03-27 10:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8a6067b-ee3b-5610-a804-62b31a689d9b with identifier: RE53759 to the API
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-28T16:56:17Z',
 'fuel_type': 'petrol',
 'id': 'b8a6067b-ee3b-5610-a804-62b31a689d9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE53759',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 128859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-05',
 'seller_name': None,
 'title': 'Opel Insignia 2.8 V6 Turbo OPC 4x4',
 'transmission': 'manual',
 'trim': 'OPC 4x4',
 'year': 2011}
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE53759%27 HTTP/1.1" 200 None
2026-03-27 10:36:58 [auto1.de] INFO: Saving data for RE53759: {'auction_closing_time': 1774716977.0, 'created_time': 1773945758.684726, 'last_price_update_time': 1774607818.887642}
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE53759') HTTP/1.1" 204 0
2026-03-27 10:36:59 [auto1.de] INFO: Found listing with ID: JT97344
2026-03-27 10:36:59 [auto1.de] INFO: Found listing with ID: ZW99084
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW99084%27 HTTP/1.1" 200 None
2026-03-27 10:36:59 [auto1.de] INFO: Scrape type for ZW99084: 2
2026-03-27 10:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1cb2c7a-2cf2-5d04-9bb0-faa016272f2b with identifier: ZW99084
2026-03-27 10:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1cb2c7a-2cf2-5d04-9bb0-faa016272f2b with scrape type 2
2026-03-27 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1cb2c7a-2cf2-5d04-9bb0-faa016272f2b with scrape type 2
2026-03-27 10:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1cb2c7a-2cf2-5d04-9bb0-faa016272f2b, identifier: ZW99084
2026-03-27 10:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1cb2c7a-2cf2-5d04-9bb0-faa016272f2b with identifier: ZW99084
2026-03-27 10:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1cb2c7a-2cf2-5d04-9bb0-faa016272f2b with identifier: ZW99084
2026-03-27 10:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1cb2c7a-2cf2-5d04-9bb0-faa016272f2b with identifier: ZW99084 to the API
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:19:05Z',
 'fuel_type': 'diesel',
 'id': 'd1cb2c7a-2cf2-5d04-9bb0-faa016272f2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW99084',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 195256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-02',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW99084%27 HTTP/1.1" 200 None
2026-03-27 10:36:59 [auto1.de] INFO: Saving data for ZW99084: {'auction_closing_time': 1774714745.0, 'created_time': 1774034285.469778, 'last_price_update_time': 1774607819.545248}
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW99084') HTTP/1.1" 204 0
2026-03-27 10:36:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:36:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a7650>
2026-03-27 10:36:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:36:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc4cd8e-8bcf-5a22-bd34-30f574283794/0cc4cd8e-8bcf-5a22-bd34-30f574283794_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd1%252F03d1a09115e43a4640830b4d1f7c4eae%252Fpa%252FYR74432_f68dade3b33b9dbe73634e2f0e9228eb.jpg') HTTP/1.1" 204 0
2026-03-27 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_f68dade3b33b9dbe73634e2f0e9228eb.jpg saved to cache
2026-03-27 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0cc4cd8e-8bcf-5a22-bd34-30f574283794
2026-03-27 10:36:59 [auto1.de] INFO: Found listing with ID: RK12981
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12981%27 HTTP/1.1" 200 None
2026-03-27 10:36:59 [auto1.de] INFO: Scrape type for RK12981: 2
2026-03-27 10:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac52cc4a-fe0a-50d3-9738-c9adc27c3b33 with identifier: RK12981
2026-03-27 10:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac52cc4a-fe0a-50d3-9738-c9adc27c3b33 with scrape type 2
2026-03-27 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac52cc4a-fe0a-50d3-9738-c9adc27c3b33 with scrape type 2
2026-03-27 10:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac52cc4a-fe0a-50d3-9738-c9adc27c3b33, identifier: RK12981
2026-03-27 10:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR23937> (referer: https://www.auto1.com/v1/car-details-view/PR23937/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac52cc4a-fe0a-50d3-9738-c9adc27c3b33 with identifier: RK12981
2026-03-27 10:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac52cc4a-fe0a-50d3-9738-c9adc27c3b33 with identifier: RK12981
2026-03-27 10:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac52cc4a-fe0a-50d3-9738-c9adc27c3b33 with identifier: RK12981 to the API
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:51:01Z',
 'fuel_type': 'petrol',
 'id': 'ac52cc4a-fe0a-50d3-9738-c9adc27c3b33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK12981',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 132872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2011}
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12981%27 HTTP/1.1" 200 None
2026-03-27 10:37:00 [auto1.de] INFO: Saving data for RK12981: {'auction_closing_time': 1774716661.0, 'created_time': 1773345944.381472, 'last_price_update_time': 1774607820.092883}
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK12981') HTTP/1.1" 204 0
2026-03-27 10:37:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:00 [auto1.de] INFO: Found listing with ID: SM28331
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM28331%27 HTTP/1.1" 200 None
2026-03-27 10:37:00 [auto1.de] INFO: Scrape type for SM28331: 1
2026-03-27 10:37:00 [auto1.de] INFO: Found listing with ID: PP43066
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP43066%27 HTTP/1.1" 200 None
2026-03-27 10:37:00 [auto1.de] INFO: Scrape type for PP43066: 1
2026-03-27 10:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM85601/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cce06b55-bcd3-51ca-a2df-9964fa37f093 with identifier: PR23937
2026-03-27 10:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cce06b55-bcd3-51ca-a2df-9964fa37f093 with scrape type 1
2026-03-27 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item cce06b55-bcd3-51ca-a2df-9964fa37f093
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F4e%252Fa84e7cdbbfd0520b8bacb7b09d696d8a%252Fpa%252FPR23937_6f8839e52d842d58680e66905fda8f4a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/4e/a84e7cdbbfd0520b8bacb7b09d696d8a/pa/PR23937_6f8839e52d842d58680e66905fda8f4a.jpg not downloaded yet
2026-03-27 10:37:00 [auto1.de] INFO: Found listing with ID: GE37655
2026-03-27 10:37:00 [auto1.de] INFO: Found listing with ID: DJ93554
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ93554%27 HTTP/1.1" 200 None
2026-03-27 10:37:00 [auto1.de] INFO: Scrape type for DJ93554: 1
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F4e%252Fa84e7cdbbfd0520b8bacb7b09d696d8a%252Fpa%252FPR23937_f1ee3d504257992b250dfe27f1384757.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/4e/a84e7cdbbfd0520b8bacb7b09d696d8a/pa/PR23937_f1ee3d504257992b250dfe27f1384757.jpg not downloaded yet
2026-03-27 10:37:00 [auto1.de] INFO: Found listing with ID: FF90181
2026-03-27 10:37:00 [auto1.de] INFO: Found listing with ID: CZ73559
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ73559%27 HTTP/1.1" 200 None
2026-03-27 10:37:00 [auto1.de] INFO: Scrape type for CZ73559: 2
2026-03-27 10:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e with identifier: CZ73559
2026-03-27 10:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e with scrape type 2
2026-03-27 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e with scrape type 2
2026-03-27 10:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e, identifier: CZ73559
2026-03-27 10:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e with identifier: CZ73559
2026-03-27 10:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e with identifier: CZ73559
2026-03-27 10:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e with identifier: CZ73559 to the API
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:55:45Z',
 'fuel_type': 'diesel',
 'id': '5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ73559',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 14683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-26',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Goal',
 'transmission': 'automatic',
 'trim': 'Goal',
 'year': 2025}
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ73559%27 HTTP/1.1" 200 None
2026-03-27 10:37:00 [auto1.de] INFO: Saving data for CZ73559: {'auction_closing_time': 1774716945.0, 'created_time': 1774034874.647783, 'last_price_update_time': 1774607820.699163}
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ73559') HTTP/1.1" 204 0
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F4e%252Fa84e7cdbbfd0520b8bacb7b09d696d8a%252Fpa%252FPR23937_048c67297e14a8db2b439a45dd3b337e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/4e/a84e7cdbbfd0520b8bacb7b09d696d8a/pa/PR23937_048c67297e14a8db2b439a45dd3b337e.jpg not downloaded yet
2026-03-27 10:37:00 [auto1.de] INFO: Found listing with ID: SP41921
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41921%27 HTTP/1.1" 200 None
2026-03-27 10:37:00 [auto1.de] INFO: Scrape type for SP41921: 1
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F4e%252Fa84e7cdbbfd0520b8bacb7b09d696d8a%252Fpa%252FPR23937_b728400a1e751633b8f9547f8a7a4fc4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/4e/a84e7cdbbfd0520b8bacb7b09d696d8a/pa/PR23937_b728400a1e751633b8f9547f8a7a4fc4.jpg not downloaded yet
2026-03-27 10:37:00 [auto1.de] INFO: Found listing with ID: KP48554
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP48554%27 HTTP/1.1" 200 None
2026-03-27 10:37:00 [auto1.de] INFO: Scrape type for KP48554: 1
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F4e%252Fa84e7cdbbfd0520b8bacb7b09d696d8a%252Fpa%252FPR23937_e5072f8dfdd3a9cb03df36b4fd398875.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/4e/a84e7cdbbfd0520b8bacb7b09d696d8a/pa/PR23937_e5072f8dfdd3a9cb03df36b4fd398875.jpg not downloaded yet
2026-03-27 10:37:00 [auto1.de] INFO: Found listing with ID: VX15127
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX15127%27 HTTP/1.1" 200 None
2026-03-27 10:37:00 [auto1.de] INFO: Scrape type for VX15127: 1
2026-03-27 10:37:00 [auto1.de] INFO: Found listing with ID: RS38976
2026-03-27 10:37:00 [auto1.de] INFO: Found listing with ID: XN16480
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN16480%27 HTTP/1.1" 200 None
2026-03-27 10:37:00 [auto1.de] INFO: Scrape type for XN16480: 2
2026-03-27 10:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04305936-6e41-50fa-9e9f-7d21f1db7b3d with identifier: XN16480
2026-03-27 10:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04305936-6e41-50fa-9e9f-7d21f1db7b3d with scrape type 2
2026-03-27 10:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04305936-6e41-50fa-9e9f-7d21f1db7b3d with scrape type 2
2026-03-27 10:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04305936-6e41-50fa-9e9f-7d21f1db7b3d, identifier: XN16480
2026-03-27 10:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04305936-6e41-50fa-9e9f-7d21f1db7b3d with identifier: XN16480
2026-03-27 10:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04305936-6e41-50fa-9e9f-7d21f1db7b3d with identifier: XN16480
2026-03-27 10:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04305936-6e41-50fa-9e9f-7d21f1db7b3d with identifier: XN16480 to the API
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:35:10Z',
 'fuel_type': 'petrol',
 'id': '04305936-6e41-50fa-9e9f-7d21f1db7b3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN16480',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 169882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-01',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.2 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2011}
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN16480%27 HTTP/1.1" 200 None
2026-03-27 10:37:01 [auto1.de] INFO: Saving data for XN16480: {'auction_closing_time': 1774715710.0, 'created_time': 1774350519.263454, 'last_price_update_time': 1774607821.329828}
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN16480') HTTP/1.1" 204 0
2026-03-27 10:37:01 [auto1.de] INFO: Found listing with ID: YT12990
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT12990%27 HTTP/1.1" 200 None
2026-03-27 10:37:01 [auto1.de] INFO: Scrape type for YT12990: 1
2026-03-27 10:37:01 [auto1.de] INFO: Found listing with ID: ZE79625
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE79625%27 HTTP/1.1" 200 None
2026-03-27 10:37:01 [auto1.de] INFO: Scrape type for ZE79625: 1
2026-03-27 10:37:01 [auto1.de] INFO: Found listing with ID: ZU85888
2026-03-27 10:37:01 [auto1.de] INFO: Found listing with ID: VW35628
2026-03-27 10:37:01 [auto1.de] INFO: Found listing with ID: DE80885
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE80885%27 HTTP/1.1" 200 None
2026-03-27 10:37:01 [auto1.de] INFO: Scrape type for DE80885: 1
2026-03-27 10:37:01 [auto1.de] INFO: Found listing with ID: JX17185
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX17185%27 HTTP/1.1" 200 None
2026-03-27 10:37:01 [auto1.de] INFO: Scrape type for JX17185: 1
2026-03-27 10:37:01 [auto1.de] INFO: Found listing with ID: BN48826
2026-03-27 10:37:01 [auto1.de] INFO: Found listing with ID: LR18629
2026-03-27 10:37:01 [auto1.de] INFO: Found listing with ID: XS57001
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS57001%27 HTTP/1.1" 200 None
2026-03-27 10:37:01 [auto1.de] INFO: Scrape type for XS57001: 1
2026-03-27 10:37:01 [auto1.de] INFO: Found listing with ID: BB33034
2026-03-27 10:37:01 [auto1.de] INFO: Found listing with ID: ZW26780
2026-03-27 10:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PB35846/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE15343> (referer: https://www.auto1.com/v1/car-details-view/BE15343/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c47b4df3-a17d-5f37-868c-ff87d9fdd66d with identifier: BE15343
2026-03-27 10:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c47b4df3-a17d-5f37-868c-ff87d9fdd66d with scrape type 1
2026-03-27 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c47b4df3-a17d-5f37-868c-ff87d9fdd66d
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F0f%252F680fdb59c6c7dbffbeddbcfb359e2341%252Fpa%252FBE15343_4abd8f9c6ea82fa23a6234cd229e815f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_4abd8f9c6ea82fa23a6234cd229e815f.jpg not downloaded yet
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F0f%252F680fdb59c6c7dbffbeddbcfb359e2341%252Fpa%252FBE15343_f57f9a646432253c0879b9e18776f28c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_f57f9a646432253c0879b9e18776f28c.jpg not downloaded yet
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F0f%252F680fdb59c6c7dbffbeddbcfb359e2341%252Fpa%252FBE15343_ef4a73e1763161dbe7bbe37952f7c515.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_ef4a73e1763161dbe7bbe37952f7c515.jpg not downloaded yet
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F0f%252F680fdb59c6c7dbffbeddbcfb359e2341%252Fpa%252FBE15343_70f210cc8f691ea8bb5bfbe24c438b88.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_70f210cc8f691ea8bb5bfbe24c438b88.jpg not downloaded yet
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F0f%252F680fdb59c6c7dbffbeddbcfb359e2341%252Fpa%252FBE15343_654779dd3a77ed2e384854f44efb5935.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_654779dd3a77ed2e384854f44efb5935.jpg not downloaded yet
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F0f%252F680fdb59c6c7dbffbeddbcfb359e2341%252Fpa%252FBE15343_a1b1aef7d6a809b33f509ab3a3138fb4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_a1b1aef7d6a809b33f509ab3a3138fb4.jpg not downloaded yet
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F0f%252F680fdb59c6c7dbffbeddbcfb359e2341%252Fpa%252FBE15343_491c06bfd08038f55f1c401d679bbe29.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_491c06bfd08038f55f1c401d679bbe29.jpg not downloaded yet
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F0f%252F680fdb59c6c7dbffbeddbcfb359e2341%252Fpa%252FBE15343_1925e3c9b91f8566118ea9d3c08f9f82.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_1925e3c9b91f8566118ea9d3c08f9f82.jpg not downloaded yet
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F0f%252F680fdb59c6c7dbffbeddbcfb359e2341%252Fpa%252FBE15343_82326c48eab655f240ee9854d4bf1796.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_82326c48eab655f240ee9854d4bf1796.jpg not downloaded yet
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F0f%252F680fdb59c6c7dbffbeddbcfb359e2341%252Fpa%252FBE15343_fd2abf0e3029bf70d9bc22f1b4859080.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_fd2abf0e3029bf70d9bc22f1b4859080.jpg not downloaded yet
2026-03-27 10:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CK62580> (referer: https://www.auto1.com/v1/car-details-view/CK62580/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:06 [scrapy.extensions.logstats] INFO: Crawled 113 pages (at 27 pages/min), scraped 53 items (at 26 items/min)
2026-03-27 10:37:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-27 10:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76 with identifier: CK62580
2026-03-27 10:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76 with scrape type 1
2026-03-27 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F22%252Fc62280a7a8aa8bdc355367e95996399c%252Fpa%252FCK62580_edce8c9df0294394117acf8097882d5f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_edce8c9df0294394117acf8097882d5f.jpg not downloaded yet
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F22%252Fc62280a7a8aa8bdc355367e95996399c%252Fpa%252FCK62580_40b90cf6d3657d4f9a0f1a9eab112f13.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_40b90cf6d3657d4f9a0f1a9eab112f13.jpg not downloaded yet
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F22%252Fc62280a7a8aa8bdc355367e95996399c%252Fpa%252FCK62580_6d7179e1e828546493733a64fe6c4618.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_6d7179e1e828546493733a64fe6c4618.jpg not downloaded yet
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F22%252Fc62280a7a8aa8bdc355367e95996399c%252Fpa%252FCK62580_38e8fcd58f1a83ce056a64e223eb8425.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_38e8fcd58f1a83ce056a64e223eb8425.jpg not downloaded yet
2026-03-27 10:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_fd2abf0e3029bf70d9bc22f1b4859080.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F22%252Fc62280a7a8aa8bdc355367e95996399c%252Fpa%252FCK62580_e6915caed502889c79f5d97aa5149770.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_e6915caed502889c79f5d97aa5149770.jpg not downloaded yet
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F22%252Fc62280a7a8aa8bdc355367e95996399c%252Fpa%252FCK62580_805d5922531e85c87c9876d25dc9ac59.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_805d5922531e85c87c9876d25dc9ac59.jpg not downloaded yet
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501663390>
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47b4df3-a17d-5f37-868c-ff87d9fdd66d/c47b4df3-a17d-5f37-868c-ff87d9fdd66d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F0f%252F680fdb59c6c7dbffbeddbcfb359e2341%252Fpa%252FBE15343_fd2abf0e3029bf70d9bc22f1b4859080.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_fd2abf0e3029bf70d9bc22f1b4859080.jpg saved to cache
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c47b4df3-a17d-5f37-868c-ff87d9fdd66d
2026-03-27 10:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GL18465/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_805d5922531e85c87c9876d25dc9ac59.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_38e8fcd58f1a83ce056a64e223eb8425.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017aeb50>
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76/08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F22%252Fc62280a7a8aa8bdc355367e95996399c%252Fpa%252FCK62580_805d5922531e85c87c9876d25dc9ac59.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_805d5922531e85c87c9876d25dc9ac59.jpg saved to cache
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76
2026-03-27 10:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_6d7179e1e828546493733a64fe6c4618.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_e6915caed502889c79f5d97aa5149770.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a8850>
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76/08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F22%252Fc62280a7a8aa8bdc355367e95996399c%252Fpa%252FCK62580_38e8fcd58f1a83ce056a64e223eb8425.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_38e8fcd58f1a83ce056a64e223eb8425.jpg saved to cache
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50058a590>
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76/08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F22%252Fc62280a7a8aa8bdc355367e95996399c%252Fpa%252FCK62580_6d7179e1e828546493733a64fe6c4618.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_6d7179e1e828546493733a64fe6c4618.jpg saved to cache
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501971110>
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76/08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F22%252Fc62280a7a8aa8bdc355367e95996399c%252Fpa%252FCK62580_e6915caed502889c79f5d97aa5149770.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_e6915caed502889c79f5d97aa5149770.jpg saved to cache
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76
2026-03-27 10:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_40b90cf6d3657d4f9a0f1a9eab112f13.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA54991/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_edce8c9df0294394117acf8097882d5f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016555d0>
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76/08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F22%252Fc62280a7a8aa8bdc355367e95996399c%252Fpa%252FCK62580_40b90cf6d3657d4f9a0f1a9eab112f13.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_40b90cf6d3657d4f9a0f1a9eab112f13.jpg saved to cache
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017e4c90>
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76/08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F22%252Fc62280a7a8aa8bdc355367e95996399c%252Fpa%252FCK62580_edce8c9df0294394117acf8097882d5f.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_edce8c9df0294394117acf8097882d5f.jpg saved to cache
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76
2026-03-27 10:37:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76, skipping ID generation
2026-03-27 10:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76 with scrape type 1
2026-03-27 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76 sending to next pipeline
2026-03-27 10:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76, identifier: CK62580
2026-03-27 10:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76 with identifier: CK62580
2026-03-27 10:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76 with identifier: CK62580
2026-03-27 10:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76 with identifier: CK62580 to the API
2026-03-27 10:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_edce8c9df0294394117acf8097882d5f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:23:35Z',
 'fuel_type': 'petrol',
 'id': '08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK62580',
 'listing': 'auction',
 'location': 'DE, Mönchengladbach',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 95626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76/08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_edce8c9df0294394117acf8097882d5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76/08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_40b90cf6d3657d4f9a0f1a9eab112f13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76/08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_6d7179e1e828546493733a64fe6c4618.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76/08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_38e8fcd58f1a83ce056a64e223eb8425.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76/08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_e6915caed502889c79f5d97aa5149770.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76/08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/22/c62280a7a8aa8bdc355367e95996399c/pa/CK62580_805d5922531e85c87c9876d25dc9ac59.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 MyLive',
 'transmission': 'manual',
 'trim': 'MyLive',
 'year': 2012}
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62580%27 HTTP/1.1" 200 None
2026-03-27 10:37:08 [auto1.de] INFO: Saving data for CK62580: {'created_time': 1774607828.159244, 'last_price_update_time': 1774607828.159255, 'auction_closing_time': 1774715015.0}
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK62580') HTTP/1.1" 204 0
2026-03-27 10:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_82326c48eab655f240ee9854d4bf1796.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_1925e3c9b91f8566118ea9d3c08f9f82.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_491c06bfd08038f55f1c401d679bbe29.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018ac9d0>
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47b4df3-a17d-5f37-868c-ff87d9fdd66d/c47b4df3-a17d-5f37-868c-ff87d9fdd66d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F0f%252F680fdb59c6c7dbffbeddbcfb359e2341%252Fpa%252FBE15343_82326c48eab655f240ee9854d4bf1796.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_82326c48eab655f240ee9854d4bf1796.jpg saved to cache
2026-03-27 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c47b4df3-a17d-5f37-868c-ff87d9fdd66d
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f0050>
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47b4df3-a17d-5f37-868c-ff87d9fdd66d/c47b4df3-a17d-5f37-868c-ff87d9fdd66d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F0f%252F680fdb59c6c7dbffbeddbcfb359e2341%252Fpa%252FBE15343_1925e3c9b91f8566118ea9d3c08f9f82.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_1925e3c9b91f8566118ea9d3c08f9f82.jpg saved to cache
2026-03-27 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c47b4df3-a17d-5f37-868c-ff87d9fdd66d
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a14310>
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47b4df3-a17d-5f37-868c-ff87d9fdd66d/c47b4df3-a17d-5f37-868c-ff87d9fdd66d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F0f%252F680fdb59c6c7dbffbeddbcfb359e2341%252Fpa%252FBE15343_491c06bfd08038f55f1c401d679bbe29.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_491c06bfd08038f55f1c401d679bbe29.jpg saved to cache
2026-03-27 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c47b4df3-a17d-5f37-868c-ff87d9fdd66d
2026-03-27 10:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_a1b1aef7d6a809b33f509ab3a3138fb4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50177bc50>
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47b4df3-a17d-5f37-868c-ff87d9fdd66d/c47b4df3-a17d-5f37-868c-ff87d9fdd66d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F0f%252F680fdb59c6c7dbffbeddbcfb359e2341%252Fpa%252FBE15343_a1b1aef7d6a809b33f509ab3a3138fb4.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_a1b1aef7d6a809b33f509ab3a3138fb4.jpg saved to cache
2026-03-27 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c47b4df3-a17d-5f37-868c-ff87d9fdd66d
2026-03-27 10:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_654779dd3a77ed2e384854f44efb5935.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50058b590>
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47b4df3-a17d-5f37-868c-ff87d9fdd66d/c47b4df3-a17d-5f37-868c-ff87d9fdd66d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F0f%252F680fdb59c6c7dbffbeddbcfb359e2341%252Fpa%252FBE15343_654779dd3a77ed2e384854f44efb5935.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_654779dd3a77ed2e384854f44efb5935.jpg saved to cache
2026-03-27 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c47b4df3-a17d-5f37-868c-ff87d9fdd66d
2026-03-27 10:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WR03810> (referer: https://www.auto1.com/v1/car-details-view/WR03810/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_70f210cc8f691ea8bb5bfbe24c438b88.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_f57f9a646432253c0879b9e18776f28c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_ef4a73e1763161dbe7bbe37952f7c515.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9f5d2dd-41f6-51fe-9541-1e1f00d44311 with identifier: WR03810
2026-03-27 10:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9f5d2dd-41f6-51fe-9541-1e1f00d44311 with scrape type 1
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b9f5d2dd-41f6-51fe-9541-1e1f00d44311
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F50%252F5150b0dd1af989e5d6e1ee41f0a690e7%252Fpa%252FWR03810_007cea54e8ecfdb202e89df735b0f929.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_007cea54e8ecfdb202e89df735b0f929.jpg not downloaded yet
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F50%252F5150b0dd1af989e5d6e1ee41f0a690e7%252Fpa%252FWR03810_cf5070eb2e678ecd8534a090c5257550.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_cf5070eb2e678ecd8534a090c5257550.jpg not downloaded yet
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F50%252F5150b0dd1af989e5d6e1ee41f0a690e7%252Fpa%252FWR03810_a8e2c51f793f6a00f7db1b17a12f6aa2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_a8e2c51f793f6a00f7db1b17a12f6aa2.jpg not downloaded yet
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016fded0>
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47b4df3-a17d-5f37-868c-ff87d9fdd66d/c47b4df3-a17d-5f37-868c-ff87d9fdd66d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F0f%252F680fdb59c6c7dbffbeddbcfb359e2341%252Fpa%252FBE15343_70f210cc8f691ea8bb5bfbe24c438b88.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_70f210cc8f691ea8bb5bfbe24c438b88.jpg saved to cache
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c47b4df3-a17d-5f37-868c-ff87d9fdd66d
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F50%252F5150b0dd1af989e5d6e1ee41f0a690e7%252Fpa%252FWR03810_1c904ed0e0caa018396bdb24aec470a4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_1c904ed0e0caa018396bdb24aec470a4.jpg not downloaded yet
2026-03-27 10:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_4abd8f9c6ea82fa23a6234cd229e815f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F50%252F5150b0dd1af989e5d6e1ee41f0a690e7%252Fpa%252FWR03810_324cedaf1481735cda1b46c0cf60120c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_324cedaf1481735cda1b46c0cf60120c.jpg not downloaded yet
2026-03-27 10:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY27021/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F50%252F5150b0dd1af989e5d6e1ee41f0a690e7%252Fpa%252FWR03810_0d38bca0c0360d4864ed7435eb93c1b9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_0d38bca0c0360d4864ed7435eb93c1b9.jpg not downloaded yet
2026-03-27 10:37:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50057da10>
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47b4df3-a17d-5f37-868c-ff87d9fdd66d/c47b4df3-a17d-5f37-868c-ff87d9fdd66d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F0f%252F680fdb59c6c7dbffbeddbcfb359e2341%252Fpa%252FBE15343_f57f9a646432253c0879b9e18776f28c.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_f57f9a646432253c0879b9e18776f28c.jpg saved to cache
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c47b4df3-a17d-5f37-868c-ff87d9fdd66d
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5113caad0>
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47b4df3-a17d-5f37-868c-ff87d9fdd66d/c47b4df3-a17d-5f37-868c-ff87d9fdd66d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F0f%252F680fdb59c6c7dbffbeddbcfb359e2341%252Fpa%252FBE15343_ef4a73e1763161dbe7bbe37952f7c515.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_ef4a73e1763161dbe7bbe37952f7c515.jpg saved to cache
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c47b4df3-a17d-5f37-868c-ff87d9fdd66d
2026-03-27 10:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WZ14073> (referer: https://www.auto1.com/v1/car-details-view/WZ14073/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F50%252F5150b0dd1af989e5d6e1ee41f0a690e7%252Fpa%252FWR03810_ae9314223b064edb097e599c47463f15.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_ae9314223b064edb097e599c47463f15.jpg not downloaded yet
2026-03-27 10:37:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50166cd90>
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c47b4df3-a17d-5f37-868c-ff87d9fdd66d/c47b4df3-a17d-5f37-868c-ff87d9fdd66d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F0f%252F680fdb59c6c7dbffbeddbcfb359e2341%252Fpa%252FBE15343_4abd8f9c6ea82fa23a6234cd229e815f.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_4abd8f9c6ea82fa23a6234cd229e815f.jpg saved to cache
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c47b4df3-a17d-5f37-868c-ff87d9fdd66d
2026-03-27 10:37:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c47b4df3-a17d-5f37-868c-ff87d9fdd66d, skipping ID generation
2026-03-27 10:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c47b4df3-a17d-5f37-868c-ff87d9fdd66d with scrape type 1
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c47b4df3-a17d-5f37-868c-ff87d9fdd66d sending to next pipeline
2026-03-27 10:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c47b4df3-a17d-5f37-868c-ff87d9fdd66d, identifier: BE15343
2026-03-27 10:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_a8e2c51f793f6a00f7db1b17a12f6aa2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F50%252F5150b0dd1af989e5d6e1ee41f0a690e7%252Fpa%252FWR03810_4478749f523598eb631961982c816086.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_4478749f523598eb631961982c816086.jpg not downloaded yet
2026-03-27 10:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c47b4df3-a17d-5f37-868c-ff87d9fdd66d with identifier: BE15343
2026-03-27 10:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c47b4df3-a17d-5f37-868c-ff87d9fdd66d with identifier: BE15343
2026-03-27 10:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c47b4df3-a17d-5f37-868c-ff87d9fdd66d with identifier: BE15343 to the API
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_4abd8f9c6ea82fa23a6234cd229e815f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:32:57Z',
 'fuel_type': 'diesel',
 'id': 'c47b4df3-a17d-5f37-868c-ff87d9fdd66d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE15343',
 'listing': 'auction',
 'location': 'DE, Bad Hersfeld',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 37227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47b4df3-a17d-5f37-868c-ff87d9fdd66d/c47b4df3-a17d-5f37-868c-ff87d9fdd66d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_4abd8f9c6ea82fa23a6234cd229e815f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47b4df3-a17d-5f37-868c-ff87d9fdd66d/c47b4df3-a17d-5f37-868c-ff87d9fdd66d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_f57f9a646432253c0879b9e18776f28c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47b4df3-a17d-5f37-868c-ff87d9fdd66d/c47b4df3-a17d-5f37-868c-ff87d9fdd66d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_ef4a73e1763161dbe7bbe37952f7c515.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47b4df3-a17d-5f37-868c-ff87d9fdd66d/c47b4df3-a17d-5f37-868c-ff87d9fdd66d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_70f210cc8f691ea8bb5bfbe24c438b88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47b4df3-a17d-5f37-868c-ff87d9fdd66d/c47b4df3-a17d-5f37-868c-ff87d9fdd66d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_654779dd3a77ed2e384854f44efb5935.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47b4df3-a17d-5f37-868c-ff87d9fdd66d/c47b4df3-a17d-5f37-868c-ff87d9fdd66d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_a1b1aef7d6a809b33f509ab3a3138fb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47b4df3-a17d-5f37-868c-ff87d9fdd66d/c47b4df3-a17d-5f37-868c-ff87d9fdd66d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_491c06bfd08038f55f1c401d679bbe29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47b4df3-a17d-5f37-868c-ff87d9fdd66d/c47b4df3-a17d-5f37-868c-ff87d9fdd66d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_1925e3c9b91f8566118ea9d3c08f9f82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47b4df3-a17d-5f37-868c-ff87d9fdd66d/c47b4df3-a17d-5f37-868c-ff87d9fdd66d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_82326c48eab655f240ee9854d4bf1796.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c47b4df3-a17d-5f37-868c-ff87d9fdd66d/c47b4df3-a17d-5f37-868c-ff87d9fdd66d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/0f/680fdb59c6c7dbffbeddbcfb359e2341/pa/BE15343_fd2abf0e3029bf70d9bc22f1b4859080.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-05',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2023}
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE15343%27 HTTP/1.1" 200 None
2026-03-27 10:37:10 [auto1.de] INFO: Saving data for BE15343: {'created_time': 1774607830.081576, 'last_price_update_time': 1774607830.081587, 'auction_closing_time': 1774715577.0}
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE15343') HTTP/1.1" 204 0
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F50%252F5150b0dd1af989e5d6e1ee41f0a690e7%252Fpa%252FWR03810_41bf4271d201e95a1f30a84891cd9f17.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_41bf4271d201e95a1f30a84891cd9f17.jpg not downloaded yet
2026-03-27 10:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b3067c3-6224-5209-a487-6c2423e66851 with identifier: WZ14073
2026-03-27 10:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b3067c3-6224-5209-a487-6c2423e66851 with scrape type 1
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b3067c3-6224-5209-a487-6c2423e66851
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F9f%252Fee9f1a6c31257608826fcd1dcc9cbf21%252Fpa%252FWZ14073_f5b8925fe19684979b59fb58920c0da1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_f5b8925fe19684979b59fb58920c0da1.jpg not downloaded yet
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501855dd0>
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9f5d2dd-41f6-51fe-9541-1e1f00d44311/b9f5d2dd-41f6-51fe-9541-1e1f00d44311_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F50%252F5150b0dd1af989e5d6e1ee41f0a690e7%252Fpa%252FWR03810_a8e2c51f793f6a00f7db1b17a12f6aa2.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_a8e2c51f793f6a00f7db1b17a12f6aa2.jpg saved to cache
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b9f5d2dd-41f6-51fe-9541-1e1f00d44311
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F50%252F5150b0dd1af989e5d6e1ee41f0a690e7%252Fpa%252FWR03810_ae63aa486a1d13a529b8d0ae7e03649b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_ae63aa486a1d13a529b8d0ae7e03649b.jpg not downloaded yet
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F9f%252Fee9f1a6c31257608826fcd1dcc9cbf21%252Fpa%252FWZ14073_777f2d7a9a3ed39e096be7777c45efff.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_777f2d7a9a3ed39e096be7777c45efff.jpg not downloaded yet
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F9f%252Fee9f1a6c31257608826fcd1dcc9cbf21%252Fpa%252FWZ14073_f7fb149fd475d425a5b19f522faf1deb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_f7fb149fd475d425a5b19f522faf1deb.jpg not downloaded yet
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F9f%252Fee9f1a6c31257608826fcd1dcc9cbf21%252Fpa%252FWZ14073_bb54038ee69184225b6ad15bc9efc2dc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_bb54038ee69184225b6ad15bc9efc2dc.jpg not downloaded yet
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F9f%252Fee9f1a6c31257608826fcd1dcc9cbf21%252Fpa%252FWZ14073_9016fb0733399dab62acea964e9b786b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_9016fb0733399dab62acea964e9b786b.jpg not downloaded yet
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F9f%252Fee9f1a6c31257608826fcd1dcc9cbf21%252Fpa%252FWZ14073_cf7a4bfd661b2ad85c0c7b291aeb42fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_cf7a4bfd661b2ad85c0c7b291aeb42fa.jpg not downloaded yet
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F9f%252Fee9f1a6c31257608826fcd1dcc9cbf21%252Fpa%252FWZ14073_b5837dfab7cd2c0231fda8030cb0d991.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_b5837dfab7cd2c0231fda8030cb0d991.jpg not downloaded yet
2026-03-27 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_0d38bca0c0360d4864ed7435eb93c1b9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F9f%252Fee9f1a6c31257608826fcd1dcc9cbf21%252Fpa%252FWZ14073_1c58c9333bb7aa49d2b27b5c683715bd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_1c58c9333bb7aa49d2b27b5c683715bd.jpg not downloaded yet
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F9f%252Fee9f1a6c31257608826fcd1dcc9cbf21%252Fpa%252FWZ14073_70e00ab79f8724adada4b91a30242ce0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_70e00ab79f8724adada4b91a30242ce0.jpg not downloaded yet
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F9f%252Fee9f1a6c31257608826fcd1dcc9cbf21%252Fpa%252FWZ14073_1285af927ff1772f6ed6d185dcf576ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_1285af927ff1772f6ed6d185dcf576ac.jpg not downloaded yet
2026-03-27 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_324cedaf1481735cda1b46c0cf60120c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501872990>
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9f5d2dd-41f6-51fe-9541-1e1f00d44311/b9f5d2dd-41f6-51fe-9541-1e1f00d44311_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F50%252F5150b0dd1af989e5d6e1ee41f0a690e7%252Fpa%252FWR03810_0d38bca0c0360d4864ed7435eb93c1b9.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_0d38bca0c0360d4864ed7435eb93c1b9.jpg saved to cache
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b9f5d2dd-41f6-51fe-9541-1e1f00d44311
2026-03-27 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_ae9314223b064edb097e599c47463f15.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500396c90>
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9f5d2dd-41f6-51fe-9541-1e1f00d44311/b9f5d2dd-41f6-51fe-9541-1e1f00d44311_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F50%252F5150b0dd1af989e5d6e1ee41f0a690e7%252Fpa%252FWR03810_324cedaf1481735cda1b46c0cf60120c.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_324cedaf1481735cda1b46c0cf60120c.jpg saved to cache
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b9f5d2dd-41f6-51fe-9541-1e1f00d44311
2026-03-27 10:37:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50175fa50>
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9f5d2dd-41f6-51fe-9541-1e1f00d44311/b9f5d2dd-41f6-51fe-9541-1e1f00d44311_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F50%252F5150b0dd1af989e5d6e1ee41f0a690e7%252Fpa%252FWR03810_ae9314223b064edb097e599c47463f15.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_ae9314223b064edb097e599c47463f15.jpg saved to cache
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b9f5d2dd-41f6-51fe-9541-1e1f00d44311
2026-03-27 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_cf7a4bfd661b2ad85c0c7b291aeb42fa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM28331/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_1285af927ff1772f6ed6d185dcf576ac.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501822e10>
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b3067c3-6224-5209-a487-6c2423e66851/6b3067c3-6224-5209-a487-6c2423e66851_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F9f%252Fee9f1a6c31257608826fcd1dcc9cbf21%252Fpa%252FWZ14073_cf7a4bfd661b2ad85c0c7b291aeb42fa.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_cf7a4bfd661b2ad85c0c7b291aeb42fa.jpg saved to cache
2026-03-27 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b3067c3-6224-5209-a487-6c2423e66851
2026-03-27 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_b5837dfab7cd2c0231fda8030cb0d991.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_1c58c9333bb7aa49d2b27b5c683715bd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015d4050>
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b3067c3-6224-5209-a487-6c2423e66851/6b3067c3-6224-5209-a487-6c2423e66851_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F9f%252Fee9f1a6c31257608826fcd1dcc9cbf21%252Fpa%252FWZ14073_1285af927ff1772f6ed6d185dcf576ac.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_1285af927ff1772f6ed6d185dcf576ac.jpg saved to cache
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b3067c3-6224-5209-a487-6c2423e66851
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50162fa50>
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b3067c3-6224-5209-a487-6c2423e66851/6b3067c3-6224-5209-a487-6c2423e66851_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F9f%252Fee9f1a6c31257608826fcd1dcc9cbf21%252Fpa%252FWZ14073_b5837dfab7cd2c0231fda8030cb0d991.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_b5837dfab7cd2c0231fda8030cb0d991.jpg saved to cache
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b3067c3-6224-5209-a487-6c2423e66851
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016e4a10>
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b3067c3-6224-5209-a487-6c2423e66851/6b3067c3-6224-5209-a487-6c2423e66851_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F9f%252Fee9f1a6c31257608826fcd1dcc9cbf21%252Fpa%252FWZ14073_1c58c9333bb7aa49d2b27b5c683715bd.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_1c58c9333bb7aa49d2b27b5c683715bd.jpg saved to cache
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b3067c3-6224-5209-a487-6c2423e66851
2026-03-27 10:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_9016fb0733399dab62acea964e9b786b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN72943/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016df990>
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b3067c3-6224-5209-a487-6c2423e66851/6b3067c3-6224-5209-a487-6c2423e66851_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F9f%252Fee9f1a6c31257608826fcd1dcc9cbf21%252Fpa%252FWZ14073_9016fb0733399dab62acea964e9b786b.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_9016fb0733399dab62acea964e9b786b.jpg saved to cache
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b3067c3-6224-5209-a487-6c2423e66851
2026-03-27 10:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZP86837> (referer: https://www.auto1.com/v1/car-details-view/ZP86837/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_bb54038ee69184225b6ad15bc9efc2dc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_70e00ab79f8724adada4b91a30242ce0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 085ceaf3-cddf-54c6-b445-9790d7063277 with identifier: ZP86837
2026-03-27 10:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 085ceaf3-cddf-54c6-b445-9790d7063277 with scrape type 1
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 085ceaf3-cddf-54c6-b445-9790d7063277
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F58%252F515876070550311142a3130817d868f8%252Fpa%252FZP86837_10d5e1470ddd5a543e0428ca8858afce.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_10d5e1470ddd5a543e0428ca8858afce.jpg not downloaded yet
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F58%252F515876070550311142a3130817d868f8%252Fpa%252FZP86837_105d66debd012518fe0a64ade5a223e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_105d66debd012518fe0a64ade5a223e2.jpg not downloaded yet
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F58%252F515876070550311142a3130817d868f8%252Fpa%252FZP86837_e7ec7726cd671be7740ab837f8291e76.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_e7ec7726cd671be7740ab837f8291e76.jpg not downloaded yet
2026-03-27 10:37:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50162ccd0>
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b3067c3-6224-5209-a487-6c2423e66851/6b3067c3-6224-5209-a487-6c2423e66851_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F9f%252Fee9f1a6c31257608826fcd1dcc9cbf21%252Fpa%252FWZ14073_bb54038ee69184225b6ad15bc9efc2dc.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_bb54038ee69184225b6ad15bc9efc2dc.jpg saved to cache
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b3067c3-6224-5209-a487-6c2423e66851
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F58%252F515876070550311142a3130817d868f8%252Fpa%252FZP86837_293290f4bdc56a5072932b8ed83480b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_293290f4bdc56a5072932b8ed83480b1.jpg not downloaded yet
2026-03-27 10:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_f7fb149fd475d425a5b19f522faf1deb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F58%252F515876070550311142a3130817d868f8%252Fpa%252FZP86837_c0b27a360d1282232c7ad4dfdbcc810e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_c0b27a360d1282232c7ad4dfdbcc810e.jpg not downloaded yet
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F58%252F515876070550311142a3130817d868f8%252Fpa%252FZP86837_70adf4332c8c1106c8055753a613fc11.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_70adf4332c8c1106c8055753a613fc11.jpg not downloaded yet
2026-03-27 10:37:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501663e90>
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b3067c3-6224-5209-a487-6c2423e66851/6b3067c3-6224-5209-a487-6c2423e66851_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F9f%252Fee9f1a6c31257608826fcd1dcc9cbf21%252Fpa%252FWZ14073_70e00ab79f8724adada4b91a30242ce0.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_70e00ab79f8724adada4b91a30242ce0.jpg saved to cache
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b3067c3-6224-5209-a487-6c2423e66851
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F58%252F515876070550311142a3130817d868f8%252Fpa%252FZP86837_7cb415d4546e3fee163e07736e260dc6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_7cb415d4546e3fee163e07736e260dc6.jpg not downloaded yet
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F58%252F515876070550311142a3130817d868f8%252Fpa%252FZP86837_376184f0cfcc67abcf4f4939800a7644.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_376184f0cfcc67abcf4f4939800a7644.jpg not downloaded yet
2026-03-27 10:37:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50033af10>
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b3067c3-6224-5209-a487-6c2423e66851/6b3067c3-6224-5209-a487-6c2423e66851_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F9f%252Fee9f1a6c31257608826fcd1dcc9cbf21%252Fpa%252FWZ14073_f7fb149fd475d425a5b19f522faf1deb.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_f7fb149fd475d425a5b19f522faf1deb.jpg saved to cache
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b3067c3-6224-5209-a487-6c2423e66851
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F58%252F515876070550311142a3130817d868f8%252Fpa%252FZP86837_751df4e0e1f30d0fa741b0b5c355ea6d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_751df4e0e1f30d0fa741b0b5c355ea6d.jpg not downloaded yet
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F58%252F515876070550311142a3130817d868f8%252Fpa%252FZP86837_1d9a7307828d15609e4b1d8e2816a952.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_1d9a7307828d15609e4b1d8e2816a952.jpg not downloaded yet
2026-03-27 10:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_777f2d7a9a3ed39e096be7777c45efff.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_ae63aa486a1d13a529b8d0ae7e03649b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500570450>
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b3067c3-6224-5209-a487-6c2423e66851/6b3067c3-6224-5209-a487-6c2423e66851_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F9f%252Fee9f1a6c31257608826fcd1dcc9cbf21%252Fpa%252FWZ14073_777f2d7a9a3ed39e096be7777c45efff.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_777f2d7a9a3ed39e096be7777c45efff.jpg saved to cache
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b3067c3-6224-5209-a487-6c2423e66851
2026-03-27 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_c0b27a360d1282232c7ad4dfdbcc810e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_1d9a7307828d15609e4b1d8e2816a952.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_70adf4332c8c1106c8055753a613fc11.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500589450>
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9f5d2dd-41f6-51fe-9541-1e1f00d44311/b9f5d2dd-41f6-51fe-9541-1e1f00d44311_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F50%252F5150b0dd1af989e5d6e1ee41f0a690e7%252Fpa%252FWR03810_ae63aa486a1d13a529b8d0ae7e03649b.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_ae63aa486a1d13a529b8d0ae7e03649b.jpg saved to cache
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b9f5d2dd-41f6-51fe-9541-1e1f00d44311
2026-03-27 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_751df4e0e1f30d0fa741b0b5c355ea6d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_376184f0cfcc67abcf4f4939800a7644.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_7cb415d4546e3fee163e07736e260dc6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f0e90>
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_085ceaf3-cddf-54c6-b445-9790d7063277/085ceaf3-cddf-54c6-b445-9790d7063277_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F58%252F515876070550311142a3130817d868f8%252Fpa%252FZP86837_c0b27a360d1282232c7ad4dfdbcc810e.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_c0b27a360d1282232c7ad4dfdbcc810e.jpg saved to cache
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 085ceaf3-cddf-54c6-b445-9790d7063277
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a15090>
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_085ceaf3-cddf-54c6-b445-9790d7063277/085ceaf3-cddf-54c6-b445-9790d7063277_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F58%252F515876070550311142a3130817d868f8%252Fpa%252FZP86837_1d9a7307828d15609e4b1d8e2816a952.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_1d9a7307828d15609e4b1d8e2816a952.jpg saved to cache
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 085ceaf3-cddf-54c6-b445-9790d7063277
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017ff710>
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_085ceaf3-cddf-54c6-b445-9790d7063277/085ceaf3-cddf-54c6-b445-9790d7063277_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F58%252F515876070550311142a3130817d868f8%252Fpa%252FZP86837_70adf4332c8c1106c8055753a613fc11.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_70adf4332c8c1106c8055753a613fc11.jpg saved to cache
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 085ceaf3-cddf-54c6-b445-9790d7063277
2026-03-27 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_293290f4bdc56a5072932b8ed83480b1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501762150>
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_085ceaf3-cddf-54c6-b445-9790d7063277/085ceaf3-cddf-54c6-b445-9790d7063277_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F58%252F515876070550311142a3130817d868f8%252Fpa%252FZP86837_751df4e0e1f30d0fa741b0b5c355ea6d.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_751df4e0e1f30d0fa741b0b5c355ea6d.jpg saved to cache
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 085ceaf3-cddf-54c6-b445-9790d7063277
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501941810>
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_085ceaf3-cddf-54c6-b445-9790d7063277/085ceaf3-cddf-54c6-b445-9790d7063277_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F58%252F515876070550311142a3130817d868f8%252Fpa%252FZP86837_376184f0cfcc67abcf4f4939800a7644.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_376184f0cfcc67abcf4f4939800a7644.jpg saved to cache
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 085ceaf3-cddf-54c6-b445-9790d7063277
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50378d590>
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_085ceaf3-cddf-54c6-b445-9790d7063277/085ceaf3-cddf-54c6-b445-9790d7063277_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F58%252F515876070550311142a3130817d868f8%252Fpa%252FZP86837_7cb415d4546e3fee163e07736e260dc6.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_7cb415d4546e3fee163e07736e260dc6.jpg saved to cache
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 085ceaf3-cddf-54c6-b445-9790d7063277
2026-03-27 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_e7ec7726cd671be7740ab837f8291e76.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_10d5e1470ddd5a543e0428ca8858afce.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_f5b8925fe19684979b59fb58920c0da1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50032e6d0>
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_085ceaf3-cddf-54c6-b445-9790d7063277/085ceaf3-cddf-54c6-b445-9790d7063277_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F58%252F515876070550311142a3130817d868f8%252Fpa%252FZP86837_293290f4bdc56a5072932b8ed83480b1.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_293290f4bdc56a5072932b8ed83480b1.jpg saved to cache
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 085ceaf3-cddf-54c6-b445-9790d7063277
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004c4fd0>
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_085ceaf3-cddf-54c6-b445-9790d7063277/085ceaf3-cddf-54c6-b445-9790d7063277_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F58%252F515876070550311142a3130817d868f8%252Fpa%252FZP86837_e7ec7726cd671be7740ab837f8291e76.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_e7ec7726cd671be7740ab837f8291e76.jpg saved to cache
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 085ceaf3-cddf-54c6-b445-9790d7063277
2026-03-27 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_105d66debd012518fe0a64ade5a223e2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017ab050>
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_085ceaf3-cddf-54c6-b445-9790d7063277/085ceaf3-cddf-54c6-b445-9790d7063277_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F58%252F515876070550311142a3130817d868f8%252Fpa%252FZP86837_10d5e1470ddd5a543e0428ca8858afce.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_10d5e1470ddd5a543e0428ca8858afce.jpg saved to cache
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 085ceaf3-cddf-54c6-b445-9790d7063277
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016cb610>
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b3067c3-6224-5209-a487-6c2423e66851/6b3067c3-6224-5209-a487-6c2423e66851_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F9f%252Fee9f1a6c31257608826fcd1dcc9cbf21%252Fpa%252FWZ14073_f5b8925fe19684979b59fb58920c0da1.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_f5b8925fe19684979b59fb58920c0da1.jpg saved to cache
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b3067c3-6224-5209-a487-6c2423e66851
2026-03-27 10:37:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b3067c3-6224-5209-a487-6c2423e66851, skipping ID generation
2026-03-27 10:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b3067c3-6224-5209-a487-6c2423e66851 with scrape type 1
2026-03-27 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b3067c3-6224-5209-a487-6c2423e66851 sending to next pipeline
2026-03-27 10:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b3067c3-6224-5209-a487-6c2423e66851, identifier: WZ14073
2026-03-27 10:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b3067c3-6224-5209-a487-6c2423e66851 with identifier: WZ14073
2026-03-27 10:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b3067c3-6224-5209-a487-6c2423e66851 with identifier: WZ14073
2026-03-27 10:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b3067c3-6224-5209-a487-6c2423e66851 with identifier: WZ14073 to the API
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_f5b8925fe19684979b59fb58920c0da1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:33:20Z',
 'fuel_type': 'petrol',
 'id': '6b3067c3-6224-5209-a487-6c2423e66851',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ14073',
 'listing': 'auction',
 'location': 'DE, Bremen',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 109419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b3067c3-6224-5209-a487-6c2423e66851/6b3067c3-6224-5209-a487-6c2423e66851_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_f5b8925fe19684979b59fb58920c0da1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b3067c3-6224-5209-a487-6c2423e66851/6b3067c3-6224-5209-a487-6c2423e66851_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3224064,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_777f2d7a9a3ed39e096be7777c45efff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b3067c3-6224-5209-a487-6c2423e66851/6b3067c3-6224-5209-a487-6c2423e66851_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2732750,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_f7fb149fd475d425a5b19f522faf1deb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b3067c3-6224-5209-a487-6c2423e66851/6b3067c3-6224-5209-a487-6c2423e66851_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2952211,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_bb54038ee69184225b6ad15bc9efc2dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b3067c3-6224-5209-a487-6c2423e66851/6b3067c3-6224-5209-a487-6c2423e66851_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_9016fb0733399dab62acea964e9b786b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b3067c3-6224-5209-a487-6c2423e66851/6b3067c3-6224-5209-a487-6c2423e66851_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2363089,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_cf7a4bfd661b2ad85c0c7b291aeb42fa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b3067c3-6224-5209-a487-6c2423e66851/6b3067c3-6224-5209-a487-6c2423e66851_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_b5837dfab7cd2c0231fda8030cb0d991.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b3067c3-6224-5209-a487-6c2423e66851/6b3067c3-6224-5209-a487-6c2423e66851_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_1c58c9333bb7aa49d2b27b5c683715bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b3067c3-6224-5209-a487-6c2423e66851/6b3067c3-6224-5209-a487-6c2423e66851_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3029791,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_70e00ab79f8724adada4b91a30242ce0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b3067c3-6224-5209-a487-6c2423e66851/6b3067c3-6224-5209-a487-6c2423e66851_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2759442,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/9f/ee9f1a6c31257608826fcd1dcc9cbf21/pa/WZ14073_1285af927ff1772f6ed6d185dcf576ac.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cabrio Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ14073%27 HTTP/1.1" 200 None
2026-03-27 10:37:13 [auto1.de] INFO: Saving data for WZ14073: {'created_time': 1774607833.785624, 'last_price_update_time': 1774607833.785634, 'auction_closing_time': 1774715600.0}
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ14073') HTTP/1.1" 204 0
2026-03-27 10:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501743ed0>
2026-03-27 10:37:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_085ceaf3-cddf-54c6-b445-9790d7063277/085ceaf3-cddf-54c6-b445-9790d7063277_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F58%252F515876070550311142a3130817d868f8%252Fpa%252FZP86837_105d66debd012518fe0a64ade5a223e2.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_105d66debd012518fe0a64ade5a223e2.jpg saved to cache
2026-03-27 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 085ceaf3-cddf-54c6-b445-9790d7063277
2026-03-27 10:37:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 085ceaf3-cddf-54c6-b445-9790d7063277, skipping ID generation
2026-03-27 10:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 085ceaf3-cddf-54c6-b445-9790d7063277 with scrape type 1
2026-03-27 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 085ceaf3-cddf-54c6-b445-9790d7063277 sending to next pipeline
2026-03-27 10:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 085ceaf3-cddf-54c6-b445-9790d7063277, identifier: ZP86837
2026-03-27 10:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PB35846> (referer: https://www.auto1.com/v1/car-details-view/PB35846/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GL18465> (referer: https://www.auto1.com/v1/car-details-view/GL18465/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 085ceaf3-cddf-54c6-b445-9790d7063277 with identifier: ZP86837
2026-03-27 10:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 085ceaf3-cddf-54c6-b445-9790d7063277 with identifier: ZP86837
2026-03-27 10:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 085ceaf3-cddf-54c6-b445-9790d7063277 with identifier: ZP86837 to the API
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_105d66debd012518fe0a64ade5a223e2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:49:38Z',
 'fuel_type': 'diesel',
 'id': '085ceaf3-cddf-54c6-b445-9790d7063277',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP86837',
 'listing': 'auction',
 'location': 'DE, Bad Hersfeld',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 43102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_085ceaf3-cddf-54c6-b445-9790d7063277/085ceaf3-cddf-54c6-b445-9790d7063277_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_10d5e1470ddd5a543e0428ca8858afce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_085ceaf3-cddf-54c6-b445-9790d7063277/085ceaf3-cddf-54c6-b445-9790d7063277_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_105d66debd012518fe0a64ade5a223e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_085ceaf3-cddf-54c6-b445-9790d7063277/085ceaf3-cddf-54c6-b445-9790d7063277_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_e7ec7726cd671be7740ab837f8291e76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_085ceaf3-cddf-54c6-b445-9790d7063277/085ceaf3-cddf-54c6-b445-9790d7063277_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_293290f4bdc56a5072932b8ed83480b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_085ceaf3-cddf-54c6-b445-9790d7063277/085ceaf3-cddf-54c6-b445-9790d7063277_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_c0b27a360d1282232c7ad4dfdbcc810e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_085ceaf3-cddf-54c6-b445-9790d7063277/085ceaf3-cddf-54c6-b445-9790d7063277_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_70adf4332c8c1106c8055753a613fc11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_085ceaf3-cddf-54c6-b445-9790d7063277/085ceaf3-cddf-54c6-b445-9790d7063277_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_7cb415d4546e3fee163e07736e260dc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_085ceaf3-cddf-54c6-b445-9790d7063277/085ceaf3-cddf-54c6-b445-9790d7063277_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_376184f0cfcc67abcf4f4939800a7644.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_085ceaf3-cddf-54c6-b445-9790d7063277/085ceaf3-cddf-54c6-b445-9790d7063277_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_751df4e0e1f30d0fa741b0b5c355ea6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_085ceaf3-cddf-54c6-b445-9790d7063277/085ceaf3-cddf-54c6-b445-9790d7063277_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/58/515876070550311142a3130817d868f8/pa/ZP86837_1d9a7307828d15609e4b1d8e2816a952.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-05',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2023}
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP86837%27 HTTP/1.1" 200 None
2026-03-27 10:37:14 [auto1.de] INFO: Saving data for ZP86837: {'created_time': 1774607834.379843, 'last_price_update_time': 1774607834.379854, 'auction_closing_time': 1774716578.0}
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP86837') HTTP/1.1" 204 0
2026-03-27 10:37:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:14 [auto1.de] INFO: Channel: 24h | Page: 8 | totalHits: 10502 | hits on page: 40
2026-03-27 10:37:14 [auto1.de] INFO: Found listing with ID: SW83321
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW83321%27 HTTP/1.1" 200 None
2026-03-27 10:37:14 [auto1.de] INFO: Scrape type for SW83321: 2
2026-03-27 10:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9235e0f5-7147-52b3-8aac-80edc826c31e with identifier: SW83321
2026-03-27 10:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9235e0f5-7147-52b3-8aac-80edc826c31e with scrape type 2
2026-03-27 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9235e0f5-7147-52b3-8aac-80edc826c31e with scrape type 2
2026-03-27 10:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9235e0f5-7147-52b3-8aac-80edc826c31e, identifier: SW83321
2026-03-27 10:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a with identifier: PB35846
2026-03-27 10:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a with scrape type 1
2026-03-27 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Faa%252F2eaaa733b00666c04056179d7be01d16%252Fpa%252FPB35846_cc7f174f99c9069974478f2168d67bdd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_cc7f174f99c9069974478f2168d67bdd.jpg not downloaded yet
2026-03-27 10:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5743c775-1541-5d96-ab2d-db07b572329d with identifier: GL18465
2026-03-27 10:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5743c775-1541-5d96-ab2d-db07b572329d with scrape type 1
2026-03-27 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5743c775-1541-5d96-ab2d-db07b572329d
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fd5%252Fc1d5ad6d4332d1d41b4631716f05596c%252Fpa%252FGL18465_bec484a56e3ff011175e27ee93eec567.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/d5/c1d5ad6d4332d1d41b4631716f05596c/pa/GL18465_bec484a56e3ff011175e27ee93eec567.jpg not downloaded yet
2026-03-27 10:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9235e0f5-7147-52b3-8aac-80edc826c31e with identifier: SW83321
2026-03-27 10:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9235e0f5-7147-52b3-8aac-80edc826c31e with identifier: SW83321
2026-03-27 10:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9235e0f5-7147-52b3-8aac-80edc826c31e with identifier: SW83321 to the API
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:48:40Z',
 'fuel_type': 'diesel',
 'id': '9235e0f5-7147-52b3-8aac-80edc826c31e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW83321',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 73295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-02',
 'seller_name': None,
 'title': 'Seat Arona 1.6 TDI Xcellence',
 'transmission': 'automatic',
 'trim': 'Xcellence',
 'year': 2020}
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW83321%27 HTTP/1.1" 200 None
2026-03-27 10:37:14 [auto1.de] INFO: Saving data for SW83321: {'auction_closing_time': 1774716520.0, 'created_time': 1774034297.768809, 'last_price_update_time': 1774607834.926397}
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW83321') HTTP/1.1" 204 0
2026-03-27 10:37:14 [auto1.de] INFO: Found listing with ID: PA36365
2026-03-27 10:37:14 [auto1.de] INFO: Found listing with ID: MC36419
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC36419%27 HTTP/1.1" 200 None
2026-03-27 10:37:14 [auto1.de] INFO: Scrape type for MC36419: 2
2026-03-27 10:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eabbf226-ded2-5c83-955d-c86e7083f3ed with identifier: MC36419
2026-03-27 10:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eabbf226-ded2-5c83-955d-c86e7083f3ed with scrape type 2
2026-03-27 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eabbf226-ded2-5c83-955d-c86e7083f3ed with scrape type 2
2026-03-27 10:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eabbf226-ded2-5c83-955d-c86e7083f3ed, identifier: MC36419
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Faa%252F2eaaa733b00666c04056179d7be01d16%252Fpa%252FPB35846_3c3f6e2acb59f2f0e5b766adbea97dcd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_3c3f6e2acb59f2f0e5b766adbea97dcd.jpg not downloaded yet
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fd5%252Fc1d5ad6d4332d1d41b4631716f05596c%252Fpa%252FGL18465_55f57322a2b4b69fc2de93fd9a12d5b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/d5/c1d5ad6d4332d1d41b4631716f05596c/pa/GL18465_55f57322a2b4b69fc2de93fd9a12d5b8.jpg not downloaded yet
2026-03-27 10:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eabbf226-ded2-5c83-955d-c86e7083f3ed with identifier: MC36419
2026-03-27 10:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eabbf226-ded2-5c83-955d-c86e7083f3ed with identifier: MC36419
2026-03-27 10:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eabbf226-ded2-5c83-955d-c86e7083f3ed with identifier: MC36419 to the API
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-28T16:41:54Z',
 'fuel_type': 'petrol',
 'id': 'eabbf226-ded2-5c83-955d-c86e7083f3ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC36419',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 112532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-23',
 'seller_name': None,
 'title': 'Opel Adam 1.4 Jam',
 'transmission': 'manual',
 'trim': 'Jam',
 'year': 2014}
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC36419%27 HTTP/1.1" 200 None
2026-03-27 10:37:15 [auto1.de] INFO: Saving data for MC36419: {'auction_closing_time': 1774716114.0, 'created_time': 1773945772.116049, 'last_price_update_time': 1774607835.485904}
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC36419') HTTP/1.1" 204 0
2026-03-27 10:37:15 [auto1.de] INFO: Found listing with ID: KC35382
2026-03-27 10:37:15 [auto1.de] INFO: Found listing with ID: EX72807
2026-03-27 10:37:15 [auto1.de] INFO: Found listing with ID: FZ80305
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ80305%27 HTTP/1.1" 200 None
2026-03-27 10:37:15 [auto1.de] INFO: Scrape type for FZ80305: 2
2026-03-27 10:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2 with identifier: FZ80305
2026-03-27 10:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2 with scrape type 2
2026-03-27 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2 with scrape type 2
2026-03-27 10:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2, identifier: FZ80305
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Faa%252F2eaaa733b00666c04056179d7be01d16%252Fpa%252FPB35846_550c49b06b548e2d80800e051ddb126c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_550c49b06b548e2d80800e051ddb126c.jpg not downloaded yet
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fd5%252Fc1d5ad6d4332d1d41b4631716f05596c%252Fpa%252FGL18465_ceff7c7bdd5a9c448553f7da4a832bc6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/d5/c1d5ad6d4332d1d41b4631716f05596c/pa/GL18465_ceff7c7bdd5a9c448553f7da4a832bc6.jpg not downloaded yet
2026-03-27 10:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2 with identifier: FZ80305
2026-03-27 10:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2 with identifier: FZ80305
2026-03-27 10:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2 with identifier: FZ80305 to the API
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:20:16Z',
 'fuel_type': 'petrol',
 'id': 'cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ80305',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 170018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-08',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2013}
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ80305%27 HTTP/1.1" 200 None
2026-03-27 10:37:16 [auto1.de] INFO: Saving data for FZ80305: {'auction_closing_time': 1774714816.0, 'created_time': 1773381718.379825, 'last_price_update_time': 1774607836.067335}
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ80305') HTTP/1.1" 204 0
2026-03-27 10:37:16 [auto1.de] INFO: Found listing with ID: EG01443
2026-03-27 10:37:16 [auto1.de] INFO: Found listing with ID: FR95379
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR95379%27 HTTP/1.1" 200 None
2026-03-27 10:37:16 [auto1.de] INFO: Scrape type for FR95379: 1
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Faa%252F2eaaa733b00666c04056179d7be01d16%252Fpa%252FPB35846_bae2af00a05cc8b3ca45f64b857732cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_bae2af00a05cc8b3ca45f64b857732cf.jpg not downloaded yet
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fd5%252Fc1d5ad6d4332d1d41b4631716f05596c%252Fpa%252FGL18465_35d371b657e1183843733a2c8f8713cd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/d5/c1d5ad6d4332d1d41b4631716f05596c/pa/GL18465_35d371b657e1183843733a2c8f8713cd.jpg not downloaded yet
2026-03-27 10:37:16 [auto1.de] INFO: Found listing with ID: ZV29308
2026-03-27 10:37:16 [auto1.de] INFO: Found listing with ID: VZ15565
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ15565%27 HTTP/1.1" 200 None
2026-03-27 10:37:16 [auto1.de] INFO: Scrape type for VZ15565: 1
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Faa%252F2eaaa733b00666c04056179d7be01d16%252Fpa%252FPB35846_cb1147a2d5c189c00f567dc09140bace.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_cb1147a2d5c189c00f567dc09140bace.jpg not downloaded yet
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fd5%252Fc1d5ad6d4332d1d41b4631716f05596c%252Fpa%252FGL18465_eb46528e55953fbe369a83cee6108f09.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/d5/c1d5ad6d4332d1d41b4631716f05596c/pa/GL18465_eb46528e55953fbe369a83cee6108f09.jpg not downloaded yet
2026-03-27 10:37:16 [auto1.de] INFO: Found listing with ID: KL31894
2026-03-27 10:37:16 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU37095%27 HTTP/1.1" 200 None
2026-03-27 10:37:16 [auto1.de] INFO: Scrape type for PU37095: 1
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Faa%252F2eaaa733b00666c04056179d7be01d16%252Fpa%252FPB35846_7252a0f0c3147bdbf6b651de80e6ffbc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_7252a0f0c3147bdbf6b651de80e6ffbc.jpg not downloaded yet
2026-03-27 10:37:16 [auto1.de] INFO: Found listing with ID: LF81800
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF81800%27 HTTP/1.1" 200 None
2026-03-27 10:37:16 [auto1.de] INFO: Scrape type for LF81800: 2
2026-03-27 10:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f537fabd-01eb-5925-9c49-4eeb5f2847d0 with identifier: LF81800
2026-03-27 10:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f537fabd-01eb-5925-9c49-4eeb5f2847d0 with scrape type 2
2026-03-27 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f537fabd-01eb-5925-9c49-4eeb5f2847d0 with scrape type 2
2026-03-27 10:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f537fabd-01eb-5925-9c49-4eeb5f2847d0, identifier: LF81800
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Faa%252F2eaaa733b00666c04056179d7be01d16%252Fpa%252FPB35846_98feab51d5862d68199edc01d0909c0f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_98feab51d5862d68199edc01d0909c0f.jpg not downloaded yet
2026-03-27 10:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f537fabd-01eb-5925-9c49-4eeb5f2847d0 with identifier: LF81800
2026-03-27 10:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f537fabd-01eb-5925-9c49-4eeb5f2847d0 with identifier: LF81800
2026-03-27 10:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f537fabd-01eb-5925-9c49-4eeb5f2847d0 with identifier: LF81800 to the API
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:09:21Z',
 'fuel_type': 'diesel',
 'id': 'f537fabd-01eb-5925-9c49-4eeb5f2847d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF81800',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 51374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-02',
 'seller_name': None,
 'title': 'Opel Vivaro 1.5 CDTI M Edition L2',
 'transmission': 'manual',
 'trim': 'M Edition L2',
 'year': 2024}
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF81800%27 HTTP/1.1" 200 None
2026-03-27 10:37:16 [auto1.de] INFO: Saving data for LF81800: {'auction_closing_time': 1774714161.0, 'created_time': 1773946473.89168, 'last_price_update_time': 1774607836.805987}
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF81800') HTTP/1.1" 204 0
2026-03-27 10:37:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA54991> (referer: https://www.auto1.com/v1/car-details-view/RA54991/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:16 [auto1.de] INFO: Found listing with ID: BP33481
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP33481%27 HTTP/1.1" 200 None
2026-03-27 10:37:16 [auto1.de] INFO: Scrape type for BP33481: 1
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Faa%252F2eaaa733b00666c04056179d7be01d16%252Fpa%252FPB35846_6498e0df6d2e75f35df4e6a27e1ccfef.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_6498e0df6d2e75f35df4e6a27e1ccfef.jpg not downloaded yet
2026-03-27 10:37:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:16 [auto1.de] INFO: Found listing with ID: YY13521
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY13521%27 HTTP/1.1" 200 None
2026-03-27 10:37:16 [auto1.de] INFO: Scrape type for YY13521: 1
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Faa%252F2eaaa733b00666c04056179d7be01d16%252Fpa%252FPB35846_e065dbf6a9a1904ce682a19e110f2d81.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_e065dbf6a9a1904ce682a19e110f2d81.jpg not downloaded yet
2026-03-27 10:37:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JX17185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:17 [auto1.de] INFO: Found listing with ID: RU59623
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU59623%27 HTTP/1.1" 200 None
2026-03-27 10:37:17 [auto1.de] INFO: Scrape type for RU59623: 1
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Faa%252F2eaaa733b00666c04056179d7be01d16%252Fpa%252FPB35846_0006a2764d453fa5af5eebbfda0bfae1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_0006a2764d453fa5af5eebbfda0bfae1.jpg not downloaded yet
2026-03-27 10:37:17 [auto1.de] INFO: Found listing with ID: JK60563
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK60563%27 HTTP/1.1" 200 None
2026-03-27 10:37:17 [auto1.de] INFO: Scrape type for JK60563: 2
2026-03-27 10:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f7ece84-c851-5581-8502-9c5f6d8034b5 with identifier: JK60563
2026-03-27 10:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f7ece84-c851-5581-8502-9c5f6d8034b5 with scrape type 2
2026-03-27 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f7ece84-c851-5581-8502-9c5f6d8034b5 with scrape type 2
2026-03-27 10:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f7ece84-c851-5581-8502-9c5f6d8034b5, identifier: JK60563
2026-03-27 10:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f7ece84-c851-5581-8502-9c5f6d8034b5 with identifier: JK60563
2026-03-27 10:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f7ece84-c851-5581-8502-9c5f6d8034b5 with identifier: JK60563
2026-03-27 10:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f7ece84-c851-5581-8502-9c5f6d8034b5 with identifier: JK60563 to the API
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:20:24Z',
 'fuel_type': 'diesel',
 'id': '7f7ece84-c851-5581-8502-9c5f6d8034b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK60563',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 106259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-06',
 'seller_name': None,
 'title': 'Audi A5 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK60563%27 HTTP/1.1" 200 None
2026-03-27 10:37:17 [auto1.de] INFO: Saving data for JK60563: {'auction_closing_time': 1774714824.0, 'created_time': 1773226319.30361, 'last_price_update_time': 1774607837.586225}
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK60563') HTTP/1.1" 204 0
2026-03-27 10:37:17 [auto1.de] INFO: Found listing with ID: ZU18943
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU18943%27 HTTP/1.1" 200 None
2026-03-27 10:37:17 [auto1.de] INFO: Scrape type for ZU18943: 1
2026-03-27 10:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fd7697d-1a2c-541b-98f2-466444732b31 with identifier: RA54991
2026-03-27 10:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fd7697d-1a2c-541b-98f2-466444732b31 with scrape type 1
2026-03-27 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7fd7697d-1a2c-541b-98f2-466444732b31
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd9%252Fd4d976209768ebfaa463507beee4f32a%252Fpa%252FRA54991_03f91d1ecae11f2b1b6609e27e1636a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_03f91d1ecae11f2b1b6609e27e1636a6.jpg not downloaded yet
2026-03-27 10:37:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_98feab51d5862d68199edc01d0909c0f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_41bf4271d201e95a1f30a84891cd9f17.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_6498e0df6d2e75f35df4e6a27e1ccfef.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:17 [auto1.de] INFO: Found listing with ID: VD47640
2026-03-27 10:37:17 [auto1.de] INFO: Found listing with ID: DU13341
2026-03-27 10:37:17 [auto1.de] INFO: Found listing with ID: XB85584
2026-03-27 10:37:17 [auto1.de] INFO: Found listing with ID: WC36574
2026-03-27 10:37:17 [auto1.de] INFO: Found listing with ID: HB67521
2026-03-27 10:37:17 [auto1.de] INFO: Found listing with ID: SE52893
2026-03-27 10:37:17 [auto1.de] INFO: Found listing with ID: FS32666
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS32666%27 HTTP/1.1" 200 None
2026-03-27 10:37:17 [auto1.de] INFO: Scrape type for FS32666: 1
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd9%252Fd4d976209768ebfaa463507beee4f32a%252Fpa%252FRA54991_adb02dc4936f2783aa4142f9de2f671c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_adb02dc4936f2783aa4142f9de2f671c.jpg not downloaded yet
2026-03-27 10:37:17 [auto1.de] INFO: Found listing with ID: ZN32695
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN32695%27 HTTP/1.1" 200 None
2026-03-27 10:37:17 [auto1.de] INFO: Scrape type for ZN32695: 1
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd9%252Fd4d976209768ebfaa463507beee4f32a%252Fpa%252FRA54991_207928c7b567c5eb52912f8bfe9aedc1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_207928c7b567c5eb52912f8bfe9aedc1.jpg not downloaded yet
2026-03-27 10:37:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_1c904ed0e0caa018396bdb24aec470a4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:17 [auto1.de] INFO: Found listing with ID: SD86365
2026-03-27 10:37:17 [auto1.de] INFO: Found listing with ID: MR34714
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR34714%27 HTTP/1.1" 200 None
2026-03-27 10:37:17 [auto1.de] INFO: Scrape type for MR34714: 2
2026-03-27 10:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ea3d14a-19a8-56c3-b23d-aec013038f1c with identifier: MR34714
2026-03-27 10:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ea3d14a-19a8-56c3-b23d-aec013038f1c with scrape type 2
2026-03-27 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ea3d14a-19a8-56c3-b23d-aec013038f1c with scrape type 2
2026-03-27 10:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ea3d14a-19a8-56c3-b23d-aec013038f1c, identifier: MR34714
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd9%252Fd4d976209768ebfaa463507beee4f32a%252Fpa%252FRA54991_2dc6e1298067f1fe37b8ab699eccda5a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_2dc6e1298067f1fe37b8ab699eccda5a.jpg not downloaded yet
2026-03-27 10:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ea3d14a-19a8-56c3-b23d-aec013038f1c with identifier: MR34714
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:37:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-27 10:37:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ea3d14a-19a8-56c3-b23d-aec013038f1c with identifier: MR34714
2026-03-27 10:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ea3d14a-19a8-56c3-b23d-aec013038f1c with identifier: MR34714 to the API
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:51:45Z',
 'fuel_type': 'petrol',
 'id': '6ea3d14a-19a8-56c3-b23d-aec013038f1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR34714',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 97256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-13',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2005}
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR34714%27 HTTP/1.1" 200 None
2026-03-27 10:37:18 [auto1.de] INFO: Saving data for MR34714: {'auction_closing_time': 1774716705.0, 'created_time': 1774033519.700841, 'last_price_update_time': 1774607838.379166}
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR34714') HTTP/1.1" 204 0
2026-03-27 10:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_03f91d1ecae11f2b1b6609e27e1636a6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:18 [auto1.de] INFO: Found listing with ID: LF03511
2026-03-27 10:37:18 [auto1.de] INFO: Found listing with ID: MK03700
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK03700%27 HTTP/1.1" 200 None
2026-03-27 10:37:18 [auto1.de] INFO: Scrape type for MK03700: 1
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd9%252Fd4d976209768ebfaa463507beee4f32a%252Fpa%252FRA54991_7c4758fdcff2f064617b799aad658595.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_7c4758fdcff2f064617b799aad658595.jpg not downloaded yet
2026-03-27 10:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_4478749f523598eb631961982c816086.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SM28331> (referer: https://www.auto1.com/v1/car-details-view/SM28331/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501969850>
2026-03-27 10:37:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a/8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Faa%252F2eaaa733b00666c04056179d7be01d16%252Fpa%252FPB35846_98feab51d5862d68199edc01d0909c0f.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_98feab51d5862d68199edc01d0909c0f.jpg saved to cache
2026-03-27 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a
2026-03-27 10:37:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50037ea90>
2026-03-27 10:37:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9f5d2dd-41f6-51fe-9541-1e1f00d44311/b9f5d2dd-41f6-51fe-9541-1e1f00d44311_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F50%252F5150b0dd1af989e5d6e1ee41f0a690e7%252Fpa%252FWR03810_41bf4271d201e95a1f30a84891cd9f17.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_41bf4271d201e95a1f30a84891cd9f17.jpg saved to cache
2026-03-27 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b9f5d2dd-41f6-51fe-9541-1e1f00d44311
2026-03-27 10:37:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016a9710>
2026-03-27 10:37:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a/8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Faa%252F2eaaa733b00666c04056179d7be01d16%252Fpa%252FPB35846_6498e0df6d2e75f35df4e6a27e1ccfef.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_6498e0df6d2e75f35df4e6a27e1ccfef.jpg saved to cache
2026-03-27 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a
2026-03-27 10:37:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501748f90>
2026-03-27 10:37:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9f5d2dd-41f6-51fe-9541-1e1f00d44311/b9f5d2dd-41f6-51fe-9541-1e1f00d44311_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F50%252F5150b0dd1af989e5d6e1ee41f0a690e7%252Fpa%252FWR03810_1c904ed0e0caa018396bdb24aec470a4.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_1c904ed0e0caa018396bdb24aec470a4.jpg saved to cache
2026-03-27 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b9f5d2dd-41f6-51fe-9541-1e1f00d44311
2026-03-27 10:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_0006a2764d453fa5af5eebbfda0bfae1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:18 [auto1.de] INFO: Found listing with ID: FK77468
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK77468%27 HTTP/1.1" 200 None
2026-03-27 10:37:18 [auto1.de] INFO: Scrape type for FK77468: 1
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd9%252Fd4d976209768ebfaa463507beee4f32a%252Fpa%252FRA54991_76eb7229dbfe18101ad26db88a84b40d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_76eb7229dbfe18101ad26db88a84b40d.jpg not downloaded yet
2026-03-27 10:37:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:18 [auto1.de] INFO: Found listing with ID: LW18163
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW18163%27 HTTP/1.1" 200 None
2026-03-27 10:37:18 [auto1.de] INFO: Scrape type for LW18163: 1
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd9%252Fd4d976209768ebfaa463507beee4f32a%252Fpa%252FRA54991_7dc21d8e3327d16491ff8649fd7da31f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_7dc21d8e3327d16491ff8649fd7da31f.jpg not downloaded yet
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c7f50>
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fd7697d-1a2c-541b-98f2-466444732b31/7fd7697d-1a2c-541b-98f2-466444732b31_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd9%252Fd4d976209768ebfaa463507beee4f32a%252Fpa%252FRA54991_03f91d1ecae11f2b1b6609e27e1636a6.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_03f91d1ecae11f2b1b6609e27e1636a6.jpg saved to cache
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7fd7697d-1a2c-541b-98f2-466444732b31
2026-03-27 10:37:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500348550>
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9f5d2dd-41f6-51fe-9541-1e1f00d44311/b9f5d2dd-41f6-51fe-9541-1e1f00d44311_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F50%252F5150b0dd1af989e5d6e1ee41f0a690e7%252Fpa%252FWR03810_4478749f523598eb631961982c816086.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_4478749f523598eb631961982c816086.jpg saved to cache
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b9f5d2dd-41f6-51fe-9541-1e1f00d44311
2026-03-27 10:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 606c995a-e7d7-51fa-81a9-153413786cc6 with identifier: SM28331
2026-03-27 10:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 606c995a-e7d7-51fa-81a9-153413786cc6 with scrape type 1
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 606c995a-e7d7-51fa-81a9-153413786cc6
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1d3c9938fca7dff83478f20f55dcd5%252Fpa%252FSM28331_8d35886e745c8155df23ba17631d41a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_8d35886e745c8155df23ba17631d41a3.jpg not downloaded yet
2026-03-27 10:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_2dc6e1298067f1fe37b8ab699eccda5a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:19 [auto1.de] INFO: Found listing with ID: PN22226
2026-03-27 10:37:19 [auto1.de] INFO: Found listing with ID: AG44420
2026-03-27 10:37:19 [auto1.de] INFO: Found listing with ID: KZ23226
2026-03-27 10:37:19 [auto1.de] INFO: Found listing with ID: MJ13308
2026-03-27 10:37:19 [auto1.de] INFO: Found listing with ID: WC63339
2026-03-27 10:37:19 [auto1.de] INFO: Found listing with ID: LL66179
2026-03-27 10:37:19 [auto1.de] INFO: Found listing with ID: VP53971
2026-03-27 10:37:19 [auto1.de] INFO: Found listing with ID: DE09566
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd9%252Fd4d976209768ebfaa463507beee4f32a%252Fpa%252FRA54991_7f7b2a431e273d1d19d556ab69c8ed85.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_7f7b2a431e273d1d19d556ab69c8ed85.jpg not downloaded yet
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1d3c9938fca7dff83478f20f55dcd5%252Fpa%252FSM28331_af86c72ad416d2f36621692be2541364.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_af86c72ad416d2f36621692be2541364.jpg not downloaded yet
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501944e90>
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a/8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Faa%252F2eaaa733b00666c04056179d7be01d16%252Fpa%252FPB35846_0006a2764d453fa5af5eebbfda0bfae1.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_0006a2764d453fa5af5eebbfda0bfae1.jpg saved to cache
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd9%252Fd4d976209768ebfaa463507beee4f32a%252Fpa%252FRA54991_41d1e3cf11da201d2c5efa1eba1930c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_41d1e3cf11da201d2c5efa1eba1930c2.jpg not downloaded yet
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1d3c9938fca7dff83478f20f55dcd5%252Fpa%252FSM28331_cbb438ebd1fc1a50529aaa324fe47960.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_cbb438ebd1fc1a50529aaa324fe47960.jpg not downloaded yet
2026-03-27 10:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_007cea54e8ecfdb202e89df735b0f929.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd9%252Fd4d976209768ebfaa463507beee4f32a%252Fpa%252FRA54991_b3a4c86ea9ce7020ad3e776c3db42cf0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_b3a4c86ea9ce7020ad3e776c3db42cf0.jpg not downloaded yet
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1d3c9938fca7dff83478f20f55dcd5%252Fpa%252FSM28331_2099c67a4130d120ba2df8d533c1fce1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_2099c67a4130d120ba2df8d533c1fce1.jpg not downloaded yet
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50181ac50>
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fd7697d-1a2c-541b-98f2-466444732b31/7fd7697d-1a2c-541b-98f2-466444732b31_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd9%252Fd4d976209768ebfaa463507beee4f32a%252Fpa%252FRA54991_2dc6e1298067f1fe37b8ab699eccda5a.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_2dc6e1298067f1fe37b8ab699eccda5a.jpg saved to cache
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7fd7697d-1a2c-541b-98f2-466444732b31
2026-03-27 10:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_cf5070eb2e678ecd8534a090c5257550.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_8d35886e745c8155df23ba17631d41a3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1d3c9938fca7dff83478f20f55dcd5%252Fpa%252FSM28331_fd7294bee30549e81a62516e56b54dd2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_fd7294bee30549e81a62516e56b54dd2.jpg not downloaded yet
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1d3c9938fca7dff83478f20f55dcd5%252Fpa%252FSM28331_3d8e047d6a7677ef18f207481a3197c4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_3d8e047d6a7677ef18f207481a3197c4.jpg not downloaded yet
2026-03-27 10:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_76eb7229dbfe18101ad26db88a84b40d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1d3c9938fca7dff83478f20f55dcd5%252Fpa%252FSM28331_199d2f81cf481b6a658f6038468af6ba.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_199d2f81cf481b6a658f6038468af6ba.jpg not downloaded yet
2026-03-27 10:37:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50175cd50>
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9f5d2dd-41f6-51fe-9541-1e1f00d44311/b9f5d2dd-41f6-51fe-9541-1e1f00d44311_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F50%252F5150b0dd1af989e5d6e1ee41f0a690e7%252Fpa%252FWR03810_007cea54e8ecfdb202e89df735b0f929.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_007cea54e8ecfdb202e89df735b0f929.jpg saved to cache
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9f5d2dd-41f6-51fe-9541-1e1f00d44311
2026-03-27 10:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_7c4758fdcff2f064617b799aad658595.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1d3c9938fca7dff83478f20f55dcd5%252Fpa%252FSM28331_8bc8d173522bc7145b78bb2495bae926.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_8bc8d173522bc7145b78bb2495bae926.jpg not downloaded yet
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1d3c9938fca7dff83478f20f55dcd5%252Fpa%252FSM28331_e71146071545469bb8da6717b6faf5ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_e71146071545469bb8da6717b6faf5ef.jpg not downloaded yet
2026-03-27 10:37:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50175fdd0>
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9f5d2dd-41f6-51fe-9541-1e1f00d44311/b9f5d2dd-41f6-51fe-9541-1e1f00d44311_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F50%252F5150b0dd1af989e5d6e1ee41f0a690e7%252Fpa%252FWR03810_cf5070eb2e678ecd8534a090c5257550.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_cf5070eb2e678ecd8534a090c5257550.jpg saved to cache
2026-03-27 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b9f5d2dd-41f6-51fe-9541-1e1f00d44311
2026-03-27 10:37:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9f5d2dd-41f6-51fe-9541-1e1f00d44311, skipping ID generation
2026-03-27 10:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9f5d2dd-41f6-51fe-9541-1e1f00d44311 with scrape type 1
2026-03-27 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9f5d2dd-41f6-51fe-9541-1e1f00d44311 sending to next pipeline
2026-03-27 10:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9f5d2dd-41f6-51fe-9541-1e1f00d44311, identifier: WR03810
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50160fe50>
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606c995a-e7d7-51fa-81a9-153413786cc6/606c995a-e7d7-51fa-81a9-153413786cc6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1d3c9938fca7dff83478f20f55dcd5%252Fpa%252FSM28331_8d35886e745c8155df23ba17631d41a3.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_8d35886e745c8155df23ba17631d41a3.jpg saved to cache
2026-03-27 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 606c995a-e7d7-51fa-81a9-153413786cc6
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017e5e50>
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fd7697d-1a2c-541b-98f2-466444732b31/7fd7697d-1a2c-541b-98f2-466444732b31_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd9%252Fd4d976209768ebfaa463507beee4f32a%252Fpa%252FRA54991_76eb7229dbfe18101ad26db88a84b40d.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_76eb7229dbfe18101ad26db88a84b40d.jpg saved to cache
2026-03-27 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7fd7697d-1a2c-541b-98f2-466444732b31
2026-03-27 10:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9f5d2dd-41f6-51fe-9541-1e1f00d44311 with identifier: WR03810
2026-03-27 10:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9f5d2dd-41f6-51fe-9541-1e1f00d44311 with identifier: WR03810
2026-03-27 10:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9f5d2dd-41f6-51fe-9541-1e1f00d44311 with identifier: WR03810 to the API
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_cf5070eb2e678ecd8534a090c5257550.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:17:37Z',
 'fuel_type': 'diesel',
 'id': 'b9f5d2dd-41f6-51fe-9541-1e1f00d44311',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR03810',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Renault',
 'model': 'Express',
 'odometer': 94309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9f5d2dd-41f6-51fe-9541-1e1f00d44311/b9f5d2dd-41f6-51fe-9541-1e1f00d44311_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2491760,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_007cea54e8ecfdb202e89df735b0f929.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9f5d2dd-41f6-51fe-9541-1e1f00d44311/b9f5d2dd-41f6-51fe-9541-1e1f00d44311_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2731331,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_cf5070eb2e678ecd8534a090c5257550.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9f5d2dd-41f6-51fe-9541-1e1f00d44311/b9f5d2dd-41f6-51fe-9541-1e1f00d44311_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_a8e2c51f793f6a00f7db1b17a12f6aa2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9f5d2dd-41f6-51fe-9541-1e1f00d44311/b9f5d2dd-41f6-51fe-9541-1e1f00d44311_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1988534,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_1c904ed0e0caa018396bdb24aec470a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9f5d2dd-41f6-51fe-9541-1e1f00d44311/b9f5d2dd-41f6-51fe-9541-1e1f00d44311_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2245795,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_324cedaf1481735cda1b46c0cf60120c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9f5d2dd-41f6-51fe-9541-1e1f00d44311/b9f5d2dd-41f6-51fe-9541-1e1f00d44311_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_0d38bca0c0360d4864ed7435eb93c1b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9f5d2dd-41f6-51fe-9541-1e1f00d44311/b9f5d2dd-41f6-51fe-9541-1e1f00d44311_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2034781,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_ae9314223b064edb097e599c47463f15.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9f5d2dd-41f6-51fe-9541-1e1f00d44311/b9f5d2dd-41f6-51fe-9541-1e1f00d44311_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2519169,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_4478749f523598eb631961982c816086.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9f5d2dd-41f6-51fe-9541-1e1f00d44311/b9f5d2dd-41f6-51fe-9541-1e1f00d44311_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2389461,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_41bf4271d201e95a1f30a84891cd9f17.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9f5d2dd-41f6-51fe-9541-1e1f00d44311/b9f5d2dd-41f6-51fe-9541-1e1f00d44311_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2341551,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img51/50/5150b0dd1af989e5d6e1ee41f0a690e7/pa/WR03810_ae63aa486a1d13a529b8d0ae7e03649b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Express 1.5 BLUE dCi Extra',
 'transmission': 'manual',
 'trim': 'Extra',
 'year': 2022}
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR03810%27 HTTP/1.1" 200 None
2026-03-27 10:37:20 [auto1.de] INFO: Saving data for WR03810: {'created_time': 1774607840.606156, 'last_price_update_time': 1774607840.606167, 'auction_closing_time': 1774714657.0}
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR03810') HTTP/1.1" 204 0
2026-03-27 10:37:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_41d1e3cf11da201d2c5efa1eba1930c2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1d3c9938fca7dff83478f20f55dcd5%252Fpa%252FSM28331_ab3192a1c02c68a0205abbfd25efd5c8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_ab3192a1c02c68a0205abbfd25efd5c8.jpg not downloaded yet
2026-03-27 10:37:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY27021> (referer: https://www.auto1.com/v1/car-details-view/DY27021/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XS57001/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_199d2f81cf481b6a658f6038468af6ba.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_2099c67a4130d120ba2df8d533c1fce1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_fd7294bee30549e81a62516e56b54dd2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_3d8e047d6a7677ef18f207481a3197c4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SM09769> (referer: https://www.auto1.com/v1/car-details-view/SM09769/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5036dc8d0>
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fd7697d-1a2c-541b-98f2-466444732b31/7fd7697d-1a2c-541b-98f2-466444732b31_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd9%252Fd4d976209768ebfaa463507beee4f32a%252Fpa%252FRA54991_7c4758fdcff2f064617b799aad658595.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_7c4758fdcff2f064617b799aad658595.jpg saved to cache
2026-03-27 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7fd7697d-1a2c-541b-98f2-466444732b31
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5036de090>
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fd7697d-1a2c-541b-98f2-466444732b31/7fd7697d-1a2c-541b-98f2-466444732b31_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd9%252Fd4d976209768ebfaa463507beee4f32a%252Fpa%252FRA54991_41d1e3cf11da201d2c5efa1eba1930c2.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_41d1e3cf11da201d2c5efa1eba1930c2.jpg saved to cache
2026-03-27 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7fd7697d-1a2c-541b-98f2-466444732b31
2026-03-27 10:37:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_af86c72ad416d2f36621692be2541364.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9 with identifier: DY27021
2026-03-27 10:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9 with scrape type 1
2026-03-27 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fe5%252Fe7e50c60fd61d179907fbb8286750003%252Fpa%252FDY27021_c9f7f9d949eb696ebbbded1b4ddcab74.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_c9f7f9d949eb696ebbbded1b4ddcab74.jpg not downloaded yet
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb504563150>
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606c995a-e7d7-51fa-81a9-153413786cc6/606c995a-e7d7-51fa-81a9-153413786cc6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1d3c9938fca7dff83478f20f55dcd5%252Fpa%252FSM28331_199d2f81cf481b6a658f6038468af6ba.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_199d2f81cf481b6a658f6038468af6ba.jpg saved to cache
2026-03-27 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 606c995a-e7d7-51fa-81a9-153413786cc6
2026-03-27 10:37:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501681c50>
2026-03-27 10:37:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606c995a-e7d7-51fa-81a9-153413786cc6/606c995a-e7d7-51fa-81a9-153413786cc6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1d3c9938fca7dff83478f20f55dcd5%252Fpa%252FSM28331_2099c67a4130d120ba2df8d533c1fce1.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_2099c67a4130d120ba2df8d533c1fce1.jpg saved to cache
2026-03-27 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 606c995a-e7d7-51fa-81a9-153413786cc6
2026-03-27 10:37:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50371d310>
2026-03-27 10:37:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606c995a-e7d7-51fa-81a9-153413786cc6/606c995a-e7d7-51fa-81a9-153413786cc6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1d3c9938fca7dff83478f20f55dcd5%252Fpa%252FSM28331_fd7294bee30549e81a62516e56b54dd2.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_fd7294bee30549e81a62516e56b54dd2.jpg saved to cache
2026-03-27 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 606c995a-e7d7-51fa-81a9-153413786cc6
2026-03-27 10:37:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015d8490>
2026-03-27 10:37:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606c995a-e7d7-51fa-81a9-153413786cc6/606c995a-e7d7-51fa-81a9-153413786cc6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1d3c9938fca7dff83478f20f55dcd5%252Fpa%252FSM28331_3d8e047d6a7677ef18f207481a3197c4.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_3d8e047d6a7677ef18f207481a3197c4.jpg saved to cache
2026-03-27 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 606c995a-e7d7-51fa-81a9-153413786cc6
2026-03-27 10:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53 with identifier: SM09769
2026-03-27 10:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53 with scrape type 1
2026-03-27 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F23%252F17235646f5c4a5b8ae97279c20429c8e%252Fpa%252FSM09769_231ada98c743d55b52b9e0c9d3b5673e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_231ada98c743d55b52b9e0c9d3b5673e.jpg already downloaded
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F23%252F17235646f5c4a5b8ae97279c20429c8e%252Fpa%252FSM09769_8b837d291c0363296256aa5e4fd54487.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_8b837d291c0363296256aa5e4fd54487.jpg already downloaded
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F23%252F17235646f5c4a5b8ae97279c20429c8e%252Fpa%252FSM09769_da830566bcead9e8d0e990b90fcda010.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_da830566bcead9e8d0e990b90fcda010.jpg already downloaded
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F23%252F17235646f5c4a5b8ae97279c20429c8e%252Fpa%252FSM09769_3fdd60cf6e691823d110903d3b8ea283.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_3fdd60cf6e691823d110903d3b8ea283.jpg already downloaded
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F23%252F17235646f5c4a5b8ae97279c20429c8e%252Fpa%252FSM09769_81c2f3b0778799d2955f98d1fe924d5b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_81c2f3b0778799d2955f98d1fe924d5b.jpg already downloaded
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F23%252F17235646f5c4a5b8ae97279c20429c8e%252Fpa%252FSM09769_fcfa825bf517ee68dbeb1ffdeda37f5c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_fcfa825bf517ee68dbeb1ffdeda37f5c.jpg already downloaded
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F23%252F17235646f5c4a5b8ae97279c20429c8e%252Fpa%252FSM09769_52763f78bd3e382369944af3224eaf4f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_52763f78bd3e382369944af3224eaf4f.jpg already downloaded
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F23%252F17235646f5c4a5b8ae97279c20429c8e%252Fpa%252FSM09769_e17cff9196be17669ddfea50774dd8b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_e17cff9196be17669ddfea50774dd8b2.jpg already downloaded
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F23%252F17235646f5c4a5b8ae97279c20429c8e%252Fpa%252FSM09769_a3f1c5fb6e0a48945eee6d9e85ea5141.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_a3f1c5fb6e0a48945eee6d9e85ea5141.jpg already downloaded
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F23%252F17235646f5c4a5b8ae97279c20429c8e%252Fpa%252FSM09769_88b5c6be87979761d17c3626ceeaff29.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_88b5c6be87979761d17c3626ceeaff29.jpg already downloaded
2026-03-27 10:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53, identifier: SM09769
2026-03-27 10:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53 with identifier: SM09769
2026-03-27 10:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53 with identifier: SM09769
2026-03-27 10:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53 with identifier: SM09769 to the API
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SM09769>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:45:58Z',
 'fuel_type': 'petrol',
 'id': '89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM09769',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 86870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_231ada98c743d55b52b9e0c9d3b5673e.jpg',
                'https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_8b837d291c0363296256aa5e4fd54487.jpg',
                'https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_da830566bcead9e8d0e990b90fcda010.jpg',
                'https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_3fdd60cf6e691823d110903d3b8ea283.jpg',
                'https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_81c2f3b0778799d2955f98d1fe924d5b.jpg',
                'https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_fcfa825bf517ee68dbeb1ffdeda37f5c.jpg',
                'https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_52763f78bd3e382369944af3224eaf4f.jpg',
                'https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_e17cff9196be17669ddfea50774dd8b2.jpg',
                'https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_a3f1c5fb6e0a48945eee6d9e85ea5141.jpg',
                'https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_88b5c6be87979761d17c3626ceeaff29.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53/89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3130470,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_231ada98c743d55b52b9e0c9d3b5673e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53/89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_8b837d291c0363296256aa5e4fd54487.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53/89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_da830566bcead9e8d0e990b90fcda010.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53/89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_3fdd60cf6e691823d110903d3b8ea283.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53/89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_81c2f3b0778799d2955f98d1fe924d5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53/89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_fcfa825bf517ee68dbeb1ffdeda37f5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53/89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_52763f78bd3e382369944af3224eaf4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53/89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_e17cff9196be17669ddfea50774dd8b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53/89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_a3f1c5fb6e0a48945eee6d9e85ea5141.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53/89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/23/17235646f5c4a5b8ae97279c20429c8e/pa/SM09769_88b5c6be87979761d17c3626ceeaff29.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-04-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09769%27 HTTP/1.1" 200 None
2026-03-27 10:37:22 [auto1.de] INFO: Saving data for SM09769: {'created_time': 1774607842.094719, 'last_price_update_time': 1774607842.094733, 'auction_closing_time': 1774716358.0}
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM09769') HTTP/1.1" 204 0
2026-03-27 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_7dc21d8e3327d16491ff8649fd7da31f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fe5%252Fe7e50c60fd61d179907fbb8286750003%252Fpa%252FDY27021_9de81c4a136a40b977da8a73dd4989a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_9de81c4a136a40b977da8a73dd4989a7.jpg not downloaded yet
2026-03-27 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_e71146071545469bb8da6717b6faf5ef.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_7f7b2a431e273d1d19d556ab69c8ed85.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_cbb438ebd1fc1a50529aaa324fe47960.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_ab3192a1c02c68a0205abbfd25efd5c8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_8bc8d173522bc7145b78bb2495bae926.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_b3a4c86ea9ce7020ad3e776c3db42cf0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fe5%252Fe7e50c60fd61d179907fbb8286750003%252Fpa%252FDY27021_a205cc227f5ad1b765eb56faa2c0538d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_a205cc227f5ad1b765eb56faa2c0538d.jpg not downloaded yet
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015d47d0>
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606c995a-e7d7-51fa-81a9-153413786cc6/606c995a-e7d7-51fa-81a9-153413786cc6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1d3c9938fca7dff83478f20f55dcd5%252Fpa%252FSM28331_af86c72ad416d2f36621692be2541364.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_af86c72ad416d2f36621692be2541364.jpg saved to cache
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 606c995a-e7d7-51fa-81a9-153413786cc6
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fe5%252Fe7e50c60fd61d179907fbb8286750003%252Fpa%252FDY27021_e62d2aaa956ef6c41fdf3e8aa409ead9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_e62d2aaa956ef6c41fdf3e8aa409ead9.jpg not downloaded yet
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019452d0>
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fd7697d-1a2c-541b-98f2-466444732b31/7fd7697d-1a2c-541b-98f2-466444732b31_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd9%252Fd4d976209768ebfaa463507beee4f32a%252Fpa%252FRA54991_7dc21d8e3327d16491ff8649fd7da31f.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_7dc21d8e3327d16491ff8649fd7da31f.jpg saved to cache
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7fd7697d-1a2c-541b-98f2-466444732b31
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fe5%252Fe7e50c60fd61d179907fbb8286750003%252Fpa%252FDY27021_88f0dc535bb16137f05ba119307ba05f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_88f0dc535bb16137f05ba119307ba05f.jpg not downloaded yet
2026-03-27 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_207928c7b567c5eb52912f8bfe9aedc1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_c9f7f9d949eb696ebbbded1b4ddcab74.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fe5%252Fe7e50c60fd61d179907fbb8286750003%252Fpa%252FDY27021_957f35a02195f3174763b4415d51f4b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_957f35a02195f3174763b4415d51f4b6.jpg not downloaded yet
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500391f50>
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606c995a-e7d7-51fa-81a9-153413786cc6/606c995a-e7d7-51fa-81a9-153413786cc6_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1d3c9938fca7dff83478f20f55dcd5%252Fpa%252FSM28331_e71146071545469bb8da6717b6faf5ef.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_e71146071545469bb8da6717b6faf5ef.jpg saved to cache
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 606c995a-e7d7-51fa-81a9-153413786cc6
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f2ad0>
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fd7697d-1a2c-541b-98f2-466444732b31/7fd7697d-1a2c-541b-98f2-466444732b31_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd9%252Fd4d976209768ebfaa463507beee4f32a%252Fpa%252FRA54991_7f7b2a431e273d1d19d556ab69c8ed85.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_7f7b2a431e273d1d19d556ab69c8ed85.jpg saved to cache
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7fd7697d-1a2c-541b-98f2-466444732b31
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500387150>
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606c995a-e7d7-51fa-81a9-153413786cc6/606c995a-e7d7-51fa-81a9-153413786cc6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1d3c9938fca7dff83478f20f55dcd5%252Fpa%252FSM28331_cbb438ebd1fc1a50529aaa324fe47960.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_cbb438ebd1fc1a50529aaa324fe47960.jpg saved to cache
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 606c995a-e7d7-51fa-81a9-153413786cc6
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501822490>
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606c995a-e7d7-51fa-81a9-153413786cc6/606c995a-e7d7-51fa-81a9-153413786cc6_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1d3c9938fca7dff83478f20f55dcd5%252Fpa%252FSM28331_ab3192a1c02c68a0205abbfd25efd5c8.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_ab3192a1c02c68a0205abbfd25efd5c8.jpg saved to cache
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 606c995a-e7d7-51fa-81a9-153413786cc6
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500343f10>
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_606c995a-e7d7-51fa-81a9-153413786cc6/606c995a-e7d7-51fa-81a9-153413786cc6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1d%252Faf1d3c9938fca7dff83478f20f55dcd5%252Fpa%252FSM28331_8bc8d173522bc7145b78bb2495bae926.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_8bc8d173522bc7145b78bb2495bae926.jpg saved to cache
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 606c995a-e7d7-51fa-81a9-153413786cc6
2026-03-27 10:37:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 606c995a-e7d7-51fa-81a9-153413786cc6, skipping ID generation
2026-03-27 10:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 606c995a-e7d7-51fa-81a9-153413786cc6 with scrape type 1
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 606c995a-e7d7-51fa-81a9-153413786cc6 sending to next pipeline
2026-03-27 10:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 606c995a-e7d7-51fa-81a9-153413786cc6, identifier: SM28331
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c7390>
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fd7697d-1a2c-541b-98f2-466444732b31/7fd7697d-1a2c-541b-98f2-466444732b31_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd9%252Fd4d976209768ebfaa463507beee4f32a%252Fpa%252FRA54991_b3a4c86ea9ce7020ad3e776c3db42cf0.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_b3a4c86ea9ce7020ad3e776c3db42cf0.jpg saved to cache
2026-03-27 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7fd7697d-1a2c-541b-98f2-466444732b31
2026-03-27 10:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 606c995a-e7d7-51fa-81a9-153413786cc6 with identifier: SM28331
2026-03-27 10:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 606c995a-e7d7-51fa-81a9-153413786cc6 with identifier: SM28331
2026-03-27 10:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 606c995a-e7d7-51fa-81a9-153413786cc6 with identifier: SM28331 to the API
2026-03-27 10:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_8bc8d173522bc7145b78bb2495bae926.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:32:23Z',
 'fuel_type': 'diesel',
 'id': '606c995a-e7d7-51fa-81a9-153413786cc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM28331',
 'listing': 'auction',
 'location': 'DE, Delmenhorst',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 134592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606c995a-e7d7-51fa-81a9-153413786cc6/606c995a-e7d7-51fa-81a9-153413786cc6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_8d35886e745c8155df23ba17631d41a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606c995a-e7d7-51fa-81a9-153413786cc6/606c995a-e7d7-51fa-81a9-153413786cc6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_af86c72ad416d2f36621692be2541364.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606c995a-e7d7-51fa-81a9-153413786cc6/606c995a-e7d7-51fa-81a9-153413786cc6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_cbb438ebd1fc1a50529aaa324fe47960.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606c995a-e7d7-51fa-81a9-153413786cc6/606c995a-e7d7-51fa-81a9-153413786cc6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_2099c67a4130d120ba2df8d533c1fce1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606c995a-e7d7-51fa-81a9-153413786cc6/606c995a-e7d7-51fa-81a9-153413786cc6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_fd7294bee30549e81a62516e56b54dd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606c995a-e7d7-51fa-81a9-153413786cc6/606c995a-e7d7-51fa-81a9-153413786cc6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_3d8e047d6a7677ef18f207481a3197c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606c995a-e7d7-51fa-81a9-153413786cc6/606c995a-e7d7-51fa-81a9-153413786cc6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_199d2f81cf481b6a658f6038468af6ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606c995a-e7d7-51fa-81a9-153413786cc6/606c995a-e7d7-51fa-81a9-153413786cc6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_8bc8d173522bc7145b78bb2495bae926.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606c995a-e7d7-51fa-81a9-153413786cc6/606c995a-e7d7-51fa-81a9-153413786cc6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_e71146071545469bb8da6717b6faf5ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_606c995a-e7d7-51fa-81a9-153413786cc6/606c995a-e7d7-51fa-81a9-153413786cc6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1d/af1d3c9938fca7dff83478f20f55dcd5/pa/SM28331_ab3192a1c02c68a0205abbfd25efd5c8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM28331%27 HTTP/1.1" 200 None
2026-03-27 10:37:23 [auto1.de] INFO: Saving data for SM28331: {'created_time': 1774607843.283709, 'last_price_update_time': 1774607843.283722, 'auction_closing_time': 1774715543.0}
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM28331') HTTP/1.1" 204 0
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fe5%252Fe7e50c60fd61d179907fbb8286750003%252Fpa%252FDY27021_02a4db944c650628fc31c8829043fe62.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_02a4db944c650628fc31c8829043fe62.jpg not downloaded yet
2026-03-27 10:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_adb02dc4936f2783aa4142f9de2f671c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE80885/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN72943> (referer: https://www.auto1.com/v1/car-details-view/MN72943/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK77468/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015ff4d0>
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fd7697d-1a2c-541b-98f2-466444732b31/7fd7697d-1a2c-541b-98f2-466444732b31_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd9%252Fd4d976209768ebfaa463507beee4f32a%252Fpa%252FRA54991_207928c7b567c5eb52912f8bfe9aedc1.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_207928c7b567c5eb52912f8bfe9aedc1.jpg saved to cache
2026-03-27 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7fd7697d-1a2c-541b-98f2-466444732b31
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500595c10>
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9/c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fe5%252Fe7e50c60fd61d179907fbb8286750003%252Fpa%252FDY27021_c9f7f9d949eb696ebbbded1b4ddcab74.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_c9f7f9d949eb696ebbbded1b4ddcab74.jpg saved to cache
2026-03-27 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fe5%252Fe7e50c60fd61d179907fbb8286750003%252Fpa%252FDY27021_0b8524794fdaa1cb8dad0def579c0276.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_0b8524794fdaa1cb8dad0def579c0276.jpg not downloaded yet
2026-03-27 10:37:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZU18943/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JX17185> (referer: https://www.auto1.com/v1/car-details-view/JX17185/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_88f0dc535bb16137f05ba119307ba05f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_e62d2aaa956ef6c41fdf3e8aa409ead9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fe5%252Fe7e50c60fd61d179907fbb8286750003%252Fpa%252FDY27021_4b081774cd4ce8f8e5945fd46535957a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_4b081774cd4ce8f8e5945fd46535957a.jpg not downloaded yet
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017ed990>
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fd7697d-1a2c-541b-98f2-466444732b31/7fd7697d-1a2c-541b-98f2-466444732b31_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd9%252Fd4d976209768ebfaa463507beee4f32a%252Fpa%252FRA54991_adb02dc4936f2783aa4142f9de2f671c.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_adb02dc4936f2783aa4142f9de2f671c.jpg saved to cache
2026-03-27 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7fd7697d-1a2c-541b-98f2-466444732b31
2026-03-27 10:37:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7fd7697d-1a2c-541b-98f2-466444732b31, skipping ID generation
2026-03-27 10:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fd7697d-1a2c-541b-98f2-466444732b31 with scrape type 1
2026-03-27 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7fd7697d-1a2c-541b-98f2-466444732b31 sending to next pipeline
2026-03-27 10:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7fd7697d-1a2c-541b-98f2-466444732b31, identifier: RA54991
2026-03-27 10:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40caefae-b0d8-54bc-93cb-207ca0940897 with identifier: MN72943
2026-03-27 10:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40caefae-b0d8-54bc-93cb-207ca0940897 with scrape type 1
2026-03-27 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 40caefae-b0d8-54bc-93cb-207ca0940897
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F23%252F842376c2a382dda3c49438bedc304176%252Fpa%252FMN72943_144c26cf3d4cf8ed68ee6bf1dafe4fc7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_144c26cf3d4cf8ed68ee6bf1dafe4fc7.jpg not downloaded yet
2026-03-27 10:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7fd7697d-1a2c-541b-98f2-466444732b31 with identifier: RA54991
2026-03-27 10:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7fd7697d-1a2c-541b-98f2-466444732b31 with identifier: RA54991
2026-03-27 10:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7fd7697d-1a2c-541b-98f2-466444732b31 with identifier: RA54991 to the API
2026-03-27 10:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_adb02dc4936f2783aa4142f9de2f671c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:50:15Z',
 'fuel_type': 'petrol',
 'id': '7fd7697d-1a2c-541b-98f2-466444732b31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA54991',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'BMW',
 'model': '1er',
 'odometer': 96079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd7697d-1a2c-541b-98f2-466444732b31/7fd7697d-1a2c-541b-98f2-466444732b31_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_03f91d1ecae11f2b1b6609e27e1636a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd7697d-1a2c-541b-98f2-466444732b31/7fd7697d-1a2c-541b-98f2-466444732b31_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_adb02dc4936f2783aa4142f9de2f671c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd7697d-1a2c-541b-98f2-466444732b31/7fd7697d-1a2c-541b-98f2-466444732b31_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_207928c7b567c5eb52912f8bfe9aedc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd7697d-1a2c-541b-98f2-466444732b31/7fd7697d-1a2c-541b-98f2-466444732b31_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_2dc6e1298067f1fe37b8ab699eccda5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd7697d-1a2c-541b-98f2-466444732b31/7fd7697d-1a2c-541b-98f2-466444732b31_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_7c4758fdcff2f064617b799aad658595.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd7697d-1a2c-541b-98f2-466444732b31/7fd7697d-1a2c-541b-98f2-466444732b31_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_76eb7229dbfe18101ad26db88a84b40d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd7697d-1a2c-541b-98f2-466444732b31/7fd7697d-1a2c-541b-98f2-466444732b31_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_7dc21d8e3327d16491ff8649fd7da31f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd7697d-1a2c-541b-98f2-466444732b31/7fd7697d-1a2c-541b-98f2-466444732b31_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_7f7b2a431e273d1d19d556ab69c8ed85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd7697d-1a2c-541b-98f2-466444732b31/7fd7697d-1a2c-541b-98f2-466444732b31_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_41d1e3cf11da201d2c5efa1eba1930c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd7697d-1a2c-541b-98f2-466444732b31/7fd7697d-1a2c-541b-98f2-466444732b31_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d9/d4d976209768ebfaa463507beee4f32a/pa/RA54991_b3a4c86ea9ce7020ad3e776c3db42cf0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2016}
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA54991%27 HTTP/1.1" 200 None
2026-03-27 10:37:24 [auto1.de] INFO: Saving data for RA54991: {'created_time': 1774607844.146742, 'last_price_update_time': 1774607844.146754, 'auction_closing_time': 1774716615.0}
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA54991') HTTP/1.1" 204 0
2026-03-27 10:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_02a4db944c650628fc31c8829043fe62.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fe5%252Fe7e50c60fd61d179907fbb8286750003%252Fpa%252FDY27021_2a240cf2160ea9ece1835c956ba46d4c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_2a240cf2160ea9ece1835c956ba46d4c.jpg not downloaded yet
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F23%252F842376c2a382dda3c49438bedc304176%252Fpa%252FMN72943_7a530676eb966edfd25403d06a1eee7e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_7a530676eb966edfd25403d06a1eee7e.jpg not downloaded yet
2026-03-27 10:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_e065dbf6a9a1904ce682a19e110f2d81.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_a205cc227f5ad1b765eb56faa2c0538d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_9de81c4a136a40b977da8a73dd4989a7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_957f35a02195f3174763b4415d51f4b6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F23%252F842376c2a382dda3c49438bedc304176%252Fpa%252FMN72943_c7295ae2d18ee34094829d7cdc4735e8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_c7295ae2d18ee34094829d7cdc4735e8.jpg not downloaded yet
2026-03-27 10:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bef360b7-994a-5ac5-bf57-42ec01862ff9 with identifier: JX17185
2026-03-27 10:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bef360b7-994a-5ac5-bf57-42ec01862ff9 with scrape type 1
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bef360b7-994a-5ac5-bf57-42ec01862ff9
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F99%252Fab99bd0ec8ae36fcac989f53693e4331%252Fpa%252FJX17185_f51ad346b8c6501c3ec62b192d8cc782.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_f51ad346b8c6501c3ec62b192d8cc782.jpg not downloaded yet
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018574d0>
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9/c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fe5%252Fe7e50c60fd61d179907fbb8286750003%252Fpa%252FDY27021_88f0dc535bb16137f05ba119307ba05f.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_88f0dc535bb16137f05ba119307ba05f.jpg saved to cache
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016e56d0>
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9/c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fe5%252Fe7e50c60fd61d179907fbb8286750003%252Fpa%252FDY27021_e62d2aaa956ef6c41fdf3e8aa409ead9.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_e62d2aaa956ef6c41fdf3e8aa409ead9.jpg saved to cache
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F23%252F842376c2a382dda3c49438bedc304176%252Fpa%252FMN72943_6b73796a556b7ffe44e0453ffd758d49.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_6b73796a556b7ffe44e0453ffd758d49.jpg not downloaded yet
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F99%252Fab99bd0ec8ae36fcac989f53693e4331%252Fpa%252FJX17185_b3ef4debafab014ea1b235b5c0a7b4f2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_b3ef4debafab014ea1b235b5c0a7b4f2.jpg not downloaded yet
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501768f50>
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9/c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fe5%252Fe7e50c60fd61d179907fbb8286750003%252Fpa%252FDY27021_02a4db944c650628fc31c8829043fe62.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_02a4db944c650628fc31c8829043fe62.jpg saved to cache
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015e13d0>
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a/8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Faa%252F2eaaa733b00666c04056179d7be01d16%252Fpa%252FPB35846_e065dbf6a9a1904ce682a19e110f2d81.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_e065dbf6a9a1904ce682a19e110f2d81.jpg saved to cache
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018ac410>
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9/c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fe5%252Fe7e50c60fd61d179907fbb8286750003%252Fpa%252FDY27021_a205cc227f5ad1b765eb56faa2c0538d.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_a205cc227f5ad1b765eb56faa2c0538d.jpg saved to cache
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50162a6d0>
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9/c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fe5%252Fe7e50c60fd61d179907fbb8286750003%252Fpa%252FDY27021_9de81c4a136a40b977da8a73dd4989a7.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_9de81c4a136a40b977da8a73dd4989a7.jpg saved to cache
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501820990>
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9/c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fe5%252Fe7e50c60fd61d179907fbb8286750003%252Fpa%252FDY27021_957f35a02195f3174763b4415d51f4b6.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_957f35a02195f3174763b4415d51f4b6.jpg saved to cache
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9
2026-03-27 10:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_2a240cf2160ea9ece1835c956ba46d4c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F23%252F842376c2a382dda3c49438bedc304176%252Fpa%252FMN72943_f6d35a099f8fadf6f48995ac84cbe129.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_f6d35a099f8fadf6f48995ac84cbe129.jpg not downloaded yet
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F99%252Fab99bd0ec8ae36fcac989f53693e4331%252Fpa%252FJX17185_6d196e23c31ad36e17eaf1922f9a0dba.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_6d196e23c31ad36e17eaf1922f9a0dba.jpg not downloaded yet
2026-03-27 10:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_7a530676eb966edfd25403d06a1eee7e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_144c26cf3d4cf8ed68ee6bf1dafe4fc7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F23%252F842376c2a382dda3c49438bedc304176%252Fpa%252FMN72943_b9d007fc7200ffd230be966c7678c028.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_b9d007fc7200ffd230be966c7678c028.jpg not downloaded yet
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F99%252Fab99bd0ec8ae36fcac989f53693e4331%252Fpa%252FJX17185_1794f1d842ac73ae9a74b38b25ea9236.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_1794f1d842ac73ae9a74b38b25ea9236.jpg not downloaded yet
2026-03-27 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F23%252F842376c2a382dda3c49438bedc304176%252Fpa%252FMN72943_85624953969db27c64c4c4992e0a4a12.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_85624953969db27c64c4c4992e0a4a12.jpg not downloaded yet
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F99%252Fab99bd0ec8ae36fcac989f53693e4331%252Fpa%252FJX17185_6f7c22143105e0912a7500cfd506c4af.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_6f7c22143105e0912a7500cfd506c4af.jpg not downloaded yet
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016ad010>
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9/c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fe5%252Fe7e50c60fd61d179907fbb8286750003%252Fpa%252FDY27021_2a240cf2160ea9ece1835c956ba46d4c.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_2a240cf2160ea9ece1835c956ba46d4c.jpg saved to cache
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F23%252F842376c2a382dda3c49438bedc304176%252Fpa%252FMN72943_d7f10c0385436619af4c54497d80e0de.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_d7f10c0385436619af4c54497d80e0de.jpg not downloaded yet
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F99%252Fab99bd0ec8ae36fcac989f53693e4331%252Fpa%252FJX17185_84e50f156835c9b72c67b0997d6cec34.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_84e50f156835c9b72c67b0997d6cec34.jpg not downloaded yet
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004ecd90>
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40caefae-b0d8-54bc-93cb-207ca0940897/40caefae-b0d8-54bc-93cb-207ca0940897_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F23%252F842376c2a382dda3c49438bedc304176%252Fpa%252FMN72943_7a530676eb966edfd25403d06a1eee7e.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_7a530676eb966edfd25403d06a1eee7e.jpg saved to cache
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40caefae-b0d8-54bc-93cb-207ca0940897
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016ad3d0>
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40caefae-b0d8-54bc-93cb-207ca0940897/40caefae-b0d8-54bc-93cb-207ca0940897_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F23%252F842376c2a382dda3c49438bedc304176%252Fpa%252FMN72943_144c26cf3d4cf8ed68ee6bf1dafe4fc7.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_144c26cf3d4cf8ed68ee6bf1dafe4fc7.jpg saved to cache
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40caefae-b0d8-54bc-93cb-207ca0940897
2026-03-27 10:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_6b73796a556b7ffe44e0453ffd758d49.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F23%252F842376c2a382dda3c49438bedc304176%252Fpa%252FMN72943_38e8c76cba61297dc0ae0f700dd68902.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_38e8c76cba61297dc0ae0f700dd68902.jpg not downloaded yet
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F99%252Fab99bd0ec8ae36fcac989f53693e4331%252Fpa%252FJX17185_62e2210c78a6d2be54b4872009b02627.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_62e2210c78a6d2be54b4872009b02627.jpg not downloaded yet
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F23%252F842376c2a382dda3c49438bedc304176%252Fpa%252FMN72943_6738ea7edc3478d0d32157d1a84b5772.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_6738ea7edc3478d0d32157d1a84b5772.jpg not downloaded yet
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F99%252Fab99bd0ec8ae36fcac989f53693e4331%252Fpa%252FJX17185_a8e435f0459404f8056919e65a83330f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_a8e435f0459404f8056919e65a83330f.jpg not downloaded yet
2026-03-27 10:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LW18163/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FS32666/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F99%252Fab99bd0ec8ae36fcac989f53693e4331%252Fpa%252FJX17185_8e47f47a94c50b7d2659c0dc273c397e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_8e47f47a94c50b7d2659c0dc273c397e.jpg not downloaded yet
2026-03-27 10:37:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50199a250>
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40caefae-b0d8-54bc-93cb-207ca0940897/40caefae-b0d8-54bc-93cb-207ca0940897_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F23%252F842376c2a382dda3c49438bedc304176%252Fpa%252FMN72943_6b73796a556b7ffe44e0453ffd758d49.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_6b73796a556b7ffe44e0453ffd758d49.jpg saved to cache
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40caefae-b0d8-54bc-93cb-207ca0940897
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F99%252Fab99bd0ec8ae36fcac989f53693e4331%252Fpa%252FJX17185_a501ceff340abf0b545df6e189fd13d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_a501ceff340abf0b545df6e189fd13d4.jpg not downloaded yet
2026-03-27 10:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_6738ea7edc3478d0d32157d1a84b5772.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_84e50f156835c9b72c67b0997d6cec34.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004c7f10>
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40caefae-b0d8-54bc-93cb-207ca0940897/40caefae-b0d8-54bc-93cb-207ca0940897_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F23%252F842376c2a382dda3c49438bedc304176%252Fpa%252FMN72943_6738ea7edc3478d0d32157d1a84b5772.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_6738ea7edc3478d0d32157d1a84b5772.jpg saved to cache
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 40caefae-b0d8-54bc-93cb-207ca0940897
2026-03-27 10:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_a8e435f0459404f8056919e65a83330f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017c4dd0>
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bef360b7-994a-5ac5-bf57-42ec01862ff9/bef360b7-994a-5ac5-bf57-42ec01862ff9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F99%252Fab99bd0ec8ae36fcac989f53693e4331%252Fpa%252FJX17185_84e50f156835c9b72c67b0997d6cec34.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_84e50f156835c9b72c67b0997d6cec34.jpg saved to cache
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bef360b7-994a-5ac5-bf57-42ec01862ff9
2026-03-27 10:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_6d196e23c31ad36e17eaf1922f9a0dba.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50199a890>
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bef360b7-994a-5ac5-bf57-42ec01862ff9/bef360b7-994a-5ac5-bf57-42ec01862ff9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F99%252Fab99bd0ec8ae36fcac989f53693e4331%252Fpa%252FJX17185_a8e435f0459404f8056919e65a83330f.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_a8e435f0459404f8056919e65a83330f.jpg saved to cache
2026-03-27 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bef360b7-994a-5ac5-bf57-42ec01862ff9
2026-03-27 10:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_a501ceff340abf0b545df6e189fd13d4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d1e90>
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bef360b7-994a-5ac5-bf57-42ec01862ff9/bef360b7-994a-5ac5-bf57-42ec01862ff9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F99%252Fab99bd0ec8ae36fcac989f53693e4331%252Fpa%252FJX17185_6d196e23c31ad36e17eaf1922f9a0dba.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_6d196e23c31ad36e17eaf1922f9a0dba.jpg saved to cache
2026-03-27 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bef360b7-994a-5ac5-bf57-42ec01862ff9
2026-03-27 10:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_8e47f47a94c50b7d2659c0dc273c397e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501681d10>
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bef360b7-994a-5ac5-bf57-42ec01862ff9/bef360b7-994a-5ac5-bf57-42ec01862ff9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F99%252Fab99bd0ec8ae36fcac989f53693e4331%252Fpa%252FJX17185_a501ceff340abf0b545df6e189fd13d4.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_a501ceff340abf0b545df6e189fd13d4.jpg saved to cache
2026-03-27 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bef360b7-994a-5ac5-bf57-42ec01862ff9
2026-03-27 10:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_b3ef4debafab014ea1b235b5c0a7b4f2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_62e2210c78a6d2be54b4872009b02627.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002c8f10>
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bef360b7-994a-5ac5-bf57-42ec01862ff9/bef360b7-994a-5ac5-bf57-42ec01862ff9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F99%252Fab99bd0ec8ae36fcac989f53693e4331%252Fpa%252FJX17185_8e47f47a94c50b7d2659c0dc273c397e.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_8e47f47a94c50b7d2659c0dc273c397e.jpg saved to cache
2026-03-27 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bef360b7-994a-5ac5-bf57-42ec01862ff9
2026-03-27 10:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_d7f10c0385436619af4c54497d80e0de.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_38e8c76cba61297dc0ae0f700dd68902.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY13521/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016cdd50>
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bef360b7-994a-5ac5-bf57-42ec01862ff9/bef360b7-994a-5ac5-bf57-42ec01862ff9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F99%252Fab99bd0ec8ae36fcac989f53693e4331%252Fpa%252FJX17185_b3ef4debafab014ea1b235b5c0a7b4f2.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_b3ef4debafab014ea1b235b5c0a7b4f2.jpg saved to cache
2026-03-27 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bef360b7-994a-5ac5-bf57-42ec01862ff9
2026-03-27 10:37:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017c43d0>
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bef360b7-994a-5ac5-bf57-42ec01862ff9/bef360b7-994a-5ac5-bf57-42ec01862ff9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F99%252Fab99bd0ec8ae36fcac989f53693e4331%252Fpa%252FJX17185_62e2210c78a6d2be54b4872009b02627.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_62e2210c78a6d2be54b4872009b02627.jpg saved to cache
2026-03-27 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bef360b7-994a-5ac5-bf57-42ec01862ff9
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501716150>
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40caefae-b0d8-54bc-93cb-207ca0940897/40caefae-b0d8-54bc-93cb-207ca0940897_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F23%252F842376c2a382dda3c49438bedc304176%252Fpa%252FMN72943_d7f10c0385436619af4c54497d80e0de.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_d7f10c0385436619af4c54497d80e0de.jpg saved to cache
2026-03-27 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40caefae-b0d8-54bc-93cb-207ca0940897
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500320910>
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40caefae-b0d8-54bc-93cb-207ca0940897/40caefae-b0d8-54bc-93cb-207ca0940897_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F23%252F842376c2a382dda3c49438bedc304176%252Fpa%252FMN72943_38e8c76cba61297dc0ae0f700dd68902.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_38e8c76cba61297dc0ae0f700dd68902.jpg saved to cache
2026-03-27 10:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 40caefae-b0d8-54bc-93cb-207ca0940897
2026-03-27 10:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_85624953969db27c64c4c4992e0a4a12.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_6f7c22143105e0912a7500cfd506c4af.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_1794f1d842ac73ae9a74b38b25ea9236.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50161ca50>
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40caefae-b0d8-54bc-93cb-207ca0940897/40caefae-b0d8-54bc-93cb-207ca0940897_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F23%252F842376c2a382dda3c49438bedc304176%252Fpa%252FMN72943_85624953969db27c64c4c4992e0a4a12.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_85624953969db27c64c4c4992e0a4a12.jpg saved to cache
2026-03-27 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40caefae-b0d8-54bc-93cb-207ca0940897
2026-03-27 10:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_b9d007fc7200ffd230be966c7678c028.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RP70991/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_f6d35a099f8fadf6f48995ac84cbe129.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016fda10>
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bef360b7-994a-5ac5-bf57-42ec01862ff9/bef360b7-994a-5ac5-bf57-42ec01862ff9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F99%252Fab99bd0ec8ae36fcac989f53693e4331%252Fpa%252FJX17185_6f7c22143105e0912a7500cfd506c4af.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_6f7c22143105e0912a7500cfd506c4af.jpg saved to cache
2026-03-27 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bef360b7-994a-5ac5-bf57-42ec01862ff9
2026-03-27 10:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_c7295ae2d18ee34094829d7cdc4735e8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f3250>
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bef360b7-994a-5ac5-bf57-42ec01862ff9/bef360b7-994a-5ac5-bf57-42ec01862ff9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F99%252Fab99bd0ec8ae36fcac989f53693e4331%252Fpa%252FJX17185_1794f1d842ac73ae9a74b38b25ea9236.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_1794f1d842ac73ae9a74b38b25ea9236.jpg saved to cache
2026-03-27 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bef360b7-994a-5ac5-bf57-42ec01862ff9
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016aded0>
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40caefae-b0d8-54bc-93cb-207ca0940897/40caefae-b0d8-54bc-93cb-207ca0940897_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F23%252F842376c2a382dda3c49438bedc304176%252Fpa%252FMN72943_b9d007fc7200ffd230be966c7678c028.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_b9d007fc7200ffd230be966c7678c028.jpg saved to cache
2026-03-27 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40caefae-b0d8-54bc-93cb-207ca0940897
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a3590>
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40caefae-b0d8-54bc-93cb-207ca0940897/40caefae-b0d8-54bc-93cb-207ca0940897_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F23%252F842376c2a382dda3c49438bedc304176%252Fpa%252FMN72943_f6d35a099f8fadf6f48995ac84cbe129.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_f6d35a099f8fadf6f48995ac84cbe129.jpg saved to cache
2026-03-27 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40caefae-b0d8-54bc-93cb-207ca0940897
2026-03-27 10:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_4b081774cd4ce8f8e5945fd46535957a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500322c90>
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40caefae-b0d8-54bc-93cb-207ca0940897/40caefae-b0d8-54bc-93cb-207ca0940897_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F23%252F842376c2a382dda3c49438bedc304176%252Fpa%252FMN72943_c7295ae2d18ee34094829d7cdc4735e8.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_c7295ae2d18ee34094829d7cdc4735e8.jpg saved to cache
2026-03-27 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40caefae-b0d8-54bc-93cb-207ca0940897
2026-03-27 10:37:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40caefae-b0d8-54bc-93cb-207ca0940897, skipping ID generation
2026-03-27 10:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40caefae-b0d8-54bc-93cb-207ca0940897 with scrape type 1
2026-03-27 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40caefae-b0d8-54bc-93cb-207ca0940897 sending to next pipeline
2026-03-27 10:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40caefae-b0d8-54bc-93cb-207ca0940897, identifier: MN72943
2026-03-27 10:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40caefae-b0d8-54bc-93cb-207ca0940897 with identifier: MN72943
2026-03-27 10:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40caefae-b0d8-54bc-93cb-207ca0940897 with identifier: MN72943
2026-03-27 10:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40caefae-b0d8-54bc-93cb-207ca0940897 with identifier: MN72943 to the API
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_c7295ae2d18ee34094829d7cdc4735e8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:51:28Z',
 'fuel_type': 'petrol',
 'id': '40caefae-b0d8-54bc-93cb-207ca0940897',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN72943',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 126257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40caefae-b0d8-54bc-93cb-207ca0940897/40caefae-b0d8-54bc-93cb-207ca0940897_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_144c26cf3d4cf8ed68ee6bf1dafe4fc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40caefae-b0d8-54bc-93cb-207ca0940897/40caefae-b0d8-54bc-93cb-207ca0940897_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_7a530676eb966edfd25403d06a1eee7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40caefae-b0d8-54bc-93cb-207ca0940897/40caefae-b0d8-54bc-93cb-207ca0940897_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_c7295ae2d18ee34094829d7cdc4735e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40caefae-b0d8-54bc-93cb-207ca0940897/40caefae-b0d8-54bc-93cb-207ca0940897_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_6b73796a556b7ffe44e0453ffd758d49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40caefae-b0d8-54bc-93cb-207ca0940897/40caefae-b0d8-54bc-93cb-207ca0940897_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_f6d35a099f8fadf6f48995ac84cbe129.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40caefae-b0d8-54bc-93cb-207ca0940897/40caefae-b0d8-54bc-93cb-207ca0940897_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_b9d007fc7200ffd230be966c7678c028.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40caefae-b0d8-54bc-93cb-207ca0940897/40caefae-b0d8-54bc-93cb-207ca0940897_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_85624953969db27c64c4c4992e0a4a12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40caefae-b0d8-54bc-93cb-207ca0940897/40caefae-b0d8-54bc-93cb-207ca0940897_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_d7f10c0385436619af4c54497d80e0de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40caefae-b0d8-54bc-93cb-207ca0940897/40caefae-b0d8-54bc-93cb-207ca0940897_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_38e8c76cba61297dc0ae0f700dd68902.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40caefae-b0d8-54bc-93cb-207ca0940897/40caefae-b0d8-54bc-93cb-207ca0940897_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/23/842376c2a382dda3c49438bedc304176/pa/MN72943_6738ea7edc3478d0d32157d1a84b5772.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-10-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN72943%27 HTTP/1.1" 200 None
2026-03-27 10:37:28 [auto1.de] INFO: Saving data for MN72943: {'created_time': 1774607848.116328, 'last_price_update_time': 1774607848.116391, 'auction_closing_time': 1774716688.0}
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN72943') HTTP/1.1" 204 0
2026-03-27 10:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_0b8524794fdaa1cb8dad0def579c0276.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZN32695/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50183fcd0>
2026-03-27 10:37:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9/c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fe5%252Fe7e50c60fd61d179907fbb8286750003%252Fpa%252FDY27021_4b081774cd4ce8f8e5945fd46535957a.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_4b081774cd4ce8f8e5945fd46535957a.jpg saved to cache
2026-03-27 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9
2026-03-27 10:37:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_f51ad346b8c6501c3ec62b192d8cc782.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d0290>
2026-03-27 10:37:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9/c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fe5%252Fe7e50c60fd61d179907fbb8286750003%252Fpa%252FDY27021_0b8524794fdaa1cb8dad0def579c0276.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_0b8524794fdaa1cb8dad0def579c0276.jpg saved to cache
2026-03-27 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9
2026-03-27 10:37:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9, skipping ID generation
2026-03-27 10:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9 with scrape type 1
2026-03-27 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9 sending to next pipeline
2026-03-27 10:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9, identifier: DY27021
2026-03-27 10:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9 with identifier: DY27021
2026-03-27 10:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9 with identifier: DY27021
2026-03-27 10:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9 with identifier: DY27021 to the API
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_0b8524794fdaa1cb8dad0def579c0276.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:04:41Z',
 'fuel_type': 'petrol',
 'id': 'c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY27021',
 'listing': 'auction',
 'location': 'DE, Dornach',
 'make': 'BMW',
 'model': '1er',
 'odometer': 93385,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9/c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_c9f7f9d949eb696ebbbded1b4ddcab74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9/c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_9de81c4a136a40b977da8a73dd4989a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9/c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_a205cc227f5ad1b765eb56faa2c0538d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9/c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_e62d2aaa956ef6c41fdf3e8aa409ead9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9/c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_88f0dc535bb16137f05ba119307ba05f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9/c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_957f35a02195f3174763b4415d51f4b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9/c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_02a4db944c650628fc31c8829043fe62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9/c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_0b8524794fdaa1cb8dad0def579c0276.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9/c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_4b081774cd4ce8f8e5945fd46535957a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9/c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/e5/e7e50c60fd61d179907fbb8286750003/pa/DY27021_2a240cf2160ea9ece1835c956ba46d4c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-08-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2017}
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY27021%27 HTTP/1.1" 200 None
2026-03-27 10:37:28 [auto1.de] INFO: Saving data for DY27021: {'created_time': 1774607848.818762, 'last_price_update_time': 1774607848.818773, 'auction_closing_time': 1774713881.0}
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY27021') HTTP/1.1" 204 0
2026-03-27 10:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_7252a0f0c3147bdbf6b651de80e6ffbc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/d5/c1d5ad6d4332d1d41b4631716f05596c/pa/GL18465_eb46528e55953fbe369a83cee6108f09.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TX63688/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017ed550>
2026-03-27 10:37:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bef360b7-994a-5ac5-bf57-42ec01862ff9/bef360b7-994a-5ac5-bf57-42ec01862ff9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F99%252Fab99bd0ec8ae36fcac989f53693e4331%252Fpa%252FJX17185_f51ad346b8c6501c3ec62b192d8cc782.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_f51ad346b8c6501c3ec62b192d8cc782.jpg saved to cache
2026-03-27 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bef360b7-994a-5ac5-bf57-42ec01862ff9
2026-03-27 10:37:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bef360b7-994a-5ac5-bf57-42ec01862ff9, skipping ID generation
2026-03-27 10:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bef360b7-994a-5ac5-bf57-42ec01862ff9 with scrape type 1
2026-03-27 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bef360b7-994a-5ac5-bf57-42ec01862ff9 sending to next pipeline
2026-03-27 10:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bef360b7-994a-5ac5-bf57-42ec01862ff9, identifier: JX17185
2026-03-27 10:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bef360b7-994a-5ac5-bf57-42ec01862ff9 with identifier: JX17185
2026-03-27 10:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bef360b7-994a-5ac5-bf57-42ec01862ff9 with identifier: JX17185
2026-03-27 10:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bef360b7-994a-5ac5-bf57-42ec01862ff9 with identifier: JX17185 to the API
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_f51ad346b8c6501c3ec62b192d8cc782.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:13:01Z',
 'fuel_type': 'petrol',
 'id': 'bef360b7-994a-5ac5-bf57-42ec01862ff9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX17185',
 'listing': 'auction',
 'location': 'DE, Bielefeld',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 24281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bef360b7-994a-5ac5-bf57-42ec01862ff9/bef360b7-994a-5ac5-bf57-42ec01862ff9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2645390,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_f51ad346b8c6501c3ec62b192d8cc782.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bef360b7-994a-5ac5-bf57-42ec01862ff9/bef360b7-994a-5ac5-bf57-42ec01862ff9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2701545,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_b3ef4debafab014ea1b235b5c0a7b4f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bef360b7-994a-5ac5-bf57-42ec01862ff9/bef360b7-994a-5ac5-bf57-42ec01862ff9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2600469,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_6d196e23c31ad36e17eaf1922f9a0dba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bef360b7-994a-5ac5-bf57-42ec01862ff9/bef360b7-994a-5ac5-bf57-42ec01862ff9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_1794f1d842ac73ae9a74b38b25ea9236.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bef360b7-994a-5ac5-bf57-42ec01862ff9/bef360b7-994a-5ac5-bf57-42ec01862ff9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_6f7c22143105e0912a7500cfd506c4af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bef360b7-994a-5ac5-bf57-42ec01862ff9/bef360b7-994a-5ac5-bf57-42ec01862ff9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2257230,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_84e50f156835c9b72c67b0997d6cec34.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bef360b7-994a-5ac5-bf57-42ec01862ff9/bef360b7-994a-5ac5-bf57-42ec01862ff9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2277841,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_62e2210c78a6d2be54b4872009b02627.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bef360b7-994a-5ac5-bf57-42ec01862ff9/bef360b7-994a-5ac5-bf57-42ec01862ff9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_a8e435f0459404f8056919e65a83330f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bef360b7-994a-5ac5-bf57-42ec01862ff9/bef360b7-994a-5ac5-bf57-42ec01862ff9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_8e47f47a94c50b7d2659c0dc273c397e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bef360b7-994a-5ac5-bf57-42ec01862ff9/bef360b7-994a-5ac5-bf57-42ec01862ff9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/99/ab99bd0ec8ae36fcac989f53693e4331/pa/JX17185_a501ceff340abf0b545df6e189fd13d4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2017}
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX17185%27 HTTP/1.1" 200 None
2026-03-27 10:37:29 [auto1.de] INFO: Saving data for JX17185: {'created_time': 1774607849.46068, 'last_price_update_time': 1774607849.460694, 'auction_closing_time': 1774714381.0}
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX17185') HTTP/1.1" 204 0
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d11d0>
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a/8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Faa%252F2eaaa733b00666c04056179d7be01d16%252Fpa%252FPB35846_7252a0f0c3147bdbf6b651de80e6ffbc.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_7252a0f0c3147bdbf6b651de80e6ffbc.jpg saved to cache
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015e2850>
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5743c775-1541-5d96-ab2d-db07b572329d/5743c775-1541-5d96-ab2d-db07b572329d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fd5%252Fc1d5ad6d4332d1d41b4631716f05596c%252Fpa%252FGL18465_eb46528e55953fbe369a83cee6108f09.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/d5/c1d5ad6d4332d1d41b4631716f05596c/pa/GL18465_eb46528e55953fbe369a83cee6108f09.jpg saved to cache
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5743c775-1541-5d96-ab2d-db07b572329d
2026-03-27 10:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/d5/c1d5ad6d4332d1d41b4631716f05596c/pa/GL18465_35d371b657e1183843733a2c8f8713cd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK77468> (referer: https://www.auto1.com/v1/car-details-view/FK77468/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_cb1147a2d5c189c00f567dc09140bace.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016df510>
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5743c775-1541-5d96-ab2d-db07b572329d/5743c775-1541-5d96-ab2d-db07b572329d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fd5%252Fc1d5ad6d4332d1d41b4631716f05596c%252Fpa%252FGL18465_35d371b657e1183843733a2c8f8713cd.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/d5/c1d5ad6d4332d1d41b4631716f05596c/pa/GL18465_35d371b657e1183843733a2c8f8713cd.jpg saved to cache
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5743c775-1541-5d96-ab2d-db07b572329d
2026-03-27 10:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 063f4963-6797-5479-b1f6-bfbb42498df7 with identifier: FK77468
2026-03-27 10:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 063f4963-6797-5479-b1f6-bfbb42498df7 with scrape type 1
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 063f4963-6797-5479-b1f6-bfbb42498df7
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fc5%252Feac50672d39284a4a6be0ab29ceb1574%252Fpa%252FFK77468_e2fae1b3ff8734fc54f9e05f3b71dc1c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_e2fae1b3ff8734fc54f9e05f3b71dc1c.jpg not downloaded yet
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fc5%252Feac50672d39284a4a6be0ab29ceb1574%252Fpa%252FFK77468_8813b7e5b0e6a98de067a2481de784ad.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_8813b7e5b0e6a98de067a2481de784ad.jpg not downloaded yet
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fc5%252Feac50672d39284a4a6be0ab29ceb1574%252Fpa%252FFK77468_c45e8c5e47b86e6c74f409b7d988cc54.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_c45e8c5e47b86e6c74f409b7d988cc54.jpg not downloaded yet
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50166d3d0>
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a/8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Faa%252F2eaaa733b00666c04056179d7be01d16%252Fpa%252FPB35846_cb1147a2d5c189c00f567dc09140bace.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_cb1147a2d5c189c00f567dc09140bace.jpg saved to cache
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fc5%252Feac50672d39284a4a6be0ab29ceb1574%252Fpa%252FFK77468_747afc5a7fe1e4d54693ebea9b7116b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_747afc5a7fe1e4d54693ebea9b7116b5.jpg not downloaded yet
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fc5%252Feac50672d39284a4a6be0ab29ceb1574%252Fpa%252FFK77468_c66d24f9b265732fbc8ca5f6c9d4284e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_c66d24f9b265732fbc8ca5f6c9d4284e.jpg not downloaded yet
2026-03-27 10:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_bae2af00a05cc8b3ca45f64b857732cf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fc5%252Feac50672d39284a4a6be0ab29ceb1574%252Fpa%252FFK77468_5300bb82fd14e3303c94b37afba9948e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_5300bb82fd14e3303c94b37afba9948e.jpg not downloaded yet
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fc5%252Feac50672d39284a4a6be0ab29ceb1574%252Fpa%252FFK77468_1960e0bb617faa1ac842d6428943d818.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_1960e0bb617faa1ac842d6428943d818.jpg not downloaded yet
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fc5%252Feac50672d39284a4a6be0ab29ceb1574%252Fpa%252FFK77468_f341f7356e1a5e8d234b63469e4577d2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_f341f7356e1a5e8d234b63469e4577d2.jpg not downloaded yet
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fc5%252Feac50672d39284a4a6be0ab29ceb1574%252Fpa%252FFK77468_de00bf261539c1247c00ddf129a2ccf3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_de00bf261539c1247c00ddf129a2ccf3.jpg not downloaded yet
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fc5%252Feac50672d39284a4a6be0ab29ceb1574%252Fpa%252FFK77468_d5e69b531f6bb8d7fcae1c540c3792d0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_d5e69b531f6bb8d7fcae1c540c3792d0.jpg not downloaded yet
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004c59d0>
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a/8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Faa%252F2eaaa733b00666c04056179d7be01d16%252Fpa%252FPB35846_bae2af00a05cc8b3ca45f64b857732cf.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_bae2af00a05cc8b3ca45f64b857732cf.jpg saved to cache
2026-03-27 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a
2026-03-27 10:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_c66d24f9b265732fbc8ca5f6c9d4284e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_d5e69b531f6bb8d7fcae1c540c3792d0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50180a350>
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063f4963-6797-5479-b1f6-bfbb42498df7/063f4963-6797-5479-b1f6-bfbb42498df7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fc5%252Feac50672d39284a4a6be0ab29ceb1574%252Fpa%252FFK77468_c66d24f9b265732fbc8ca5f6c9d4284e.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_c66d24f9b265732fbc8ca5f6c9d4284e.jpg saved to cache
2026-03-27 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 063f4963-6797-5479-b1f6-bfbb42498df7
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a1f050>
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063f4963-6797-5479-b1f6-bfbb42498df7/063f4963-6797-5479-b1f6-bfbb42498df7_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fc5%252Feac50672d39284a4a6be0ab29ceb1574%252Fpa%252FFK77468_d5e69b531f6bb8d7fcae1c540c3792d0.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_d5e69b531f6bb8d7fcae1c540c3792d0.jpg saved to cache
2026-03-27 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 063f4963-6797-5479-b1f6-bfbb42498df7
2026-03-27 10:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_de00bf261539c1247c00ddf129a2ccf3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503728d90>
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063f4963-6797-5479-b1f6-bfbb42498df7/063f4963-6797-5479-b1f6-bfbb42498df7_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fc5%252Feac50672d39284a4a6be0ab29ceb1574%252Fpa%252FFK77468_de00bf261539c1247c00ddf129a2ccf3.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_de00bf261539c1247c00ddf129a2ccf3.jpg saved to cache
2026-03-27 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 063f4963-6797-5479-b1f6-bfbb42498df7
2026-03-27 10:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_f341f7356e1a5e8d234b63469e4577d2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501819350>
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063f4963-6797-5479-b1f6-bfbb42498df7/063f4963-6797-5479-b1f6-bfbb42498df7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fc5%252Feac50672d39284a4a6be0ab29ceb1574%252Fpa%252FFK77468_f341f7356e1a5e8d234b63469e4577d2.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_f341f7356e1a5e8d234b63469e4577d2.jpg saved to cache
2026-03-27 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 063f4963-6797-5479-b1f6-bfbb42498df7
2026-03-27 10:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_1960e0bb617faa1ac842d6428943d818.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50171f610>
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063f4963-6797-5479-b1f6-bfbb42498df7/063f4963-6797-5479-b1f6-bfbb42498df7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fc5%252Feac50672d39284a4a6be0ab29ceb1574%252Fpa%252FFK77468_1960e0bb617faa1ac842d6428943d818.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_1960e0bb617faa1ac842d6428943d818.jpg saved to cache
2026-03-27 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 063f4963-6797-5479-b1f6-bfbb42498df7
2026-03-27 10:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_5300bb82fd14e3303c94b37afba9948e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004da050>
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063f4963-6797-5479-b1f6-bfbb42498df7/063f4963-6797-5479-b1f6-bfbb42498df7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fc5%252Feac50672d39284a4a6be0ab29ceb1574%252Fpa%252FFK77468_5300bb82fd14e3303c94b37afba9948e.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_5300bb82fd14e3303c94b37afba9948e.jpg saved to cache
2026-03-27 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 063f4963-6797-5479-b1f6-bfbb42498df7
2026-03-27 10:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_747afc5a7fe1e4d54693ebea9b7116b5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_c45e8c5e47b86e6c74f409b7d988cc54.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004c5ad0>
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063f4963-6797-5479-b1f6-bfbb42498df7/063f4963-6797-5479-b1f6-bfbb42498df7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fc5%252Feac50672d39284a4a6be0ab29ceb1574%252Fpa%252FFK77468_747afc5a7fe1e4d54693ebea9b7116b5.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_747afc5a7fe1e4d54693ebea9b7116b5.jpg saved to cache
2026-03-27 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 063f4963-6797-5479-b1f6-bfbb42498df7
2026-03-27 10:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_8813b7e5b0e6a98de067a2481de784ad.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d8150>
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063f4963-6797-5479-b1f6-bfbb42498df7/063f4963-6797-5479-b1f6-bfbb42498df7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fc5%252Feac50672d39284a4a6be0ab29ceb1574%252Fpa%252FFK77468_c45e8c5e47b86e6c74f409b7d988cc54.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_c45e8c5e47b86e6c74f409b7d988cc54.jpg saved to cache
2026-03-27 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 063f4963-6797-5479-b1f6-bfbb42498df7
2026-03-27 10:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_e2fae1b3ff8734fc54f9e05f3b71dc1c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50198afd0>
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063f4963-6797-5479-b1f6-bfbb42498df7/063f4963-6797-5479-b1f6-bfbb42498df7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fc5%252Feac50672d39284a4a6be0ab29ceb1574%252Fpa%252FFK77468_8813b7e5b0e6a98de067a2481de784ad.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_8813b7e5b0e6a98de067a2481de784ad.jpg saved to cache
2026-03-27 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 063f4963-6797-5479-b1f6-bfbb42498df7
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003993d0>
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063f4963-6797-5479-b1f6-bfbb42498df7/063f4963-6797-5479-b1f6-bfbb42498df7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fc5%252Feac50672d39284a4a6be0ab29ceb1574%252Fpa%252FFK77468_e2fae1b3ff8734fc54f9e05f3b71dc1c.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_e2fae1b3ff8734fc54f9e05f3b71dc1c.jpg saved to cache
2026-03-27 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 063f4963-6797-5479-b1f6-bfbb42498df7
2026-03-27 10:37:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 063f4963-6797-5479-b1f6-bfbb42498df7, skipping ID generation
2026-03-27 10:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 063f4963-6797-5479-b1f6-bfbb42498df7 with scrape type 1
2026-03-27 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 063f4963-6797-5479-b1f6-bfbb42498df7 sending to next pipeline
2026-03-27 10:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 063f4963-6797-5479-b1f6-bfbb42498df7, identifier: FK77468
2026-03-27 10:37:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 063f4963-6797-5479-b1f6-bfbb42498df7 with identifier: FK77468
2026-03-27 10:37:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 063f4963-6797-5479-b1f6-bfbb42498df7 with identifier: FK77468
2026-03-27 10:37:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 063f4963-6797-5479-b1f6-bfbb42498df7 with identifier: FK77468 to the API
2026-03-27 10:37:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_e2fae1b3ff8734fc54f9e05f3b71dc1c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:29:12Z',
 'fuel_type': 'petrol',
 'id': '063f4963-6797-5479-b1f6-bfbb42498df7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK77468',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 192653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063f4963-6797-5479-b1f6-bfbb42498df7/063f4963-6797-5479-b1f6-bfbb42498df7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_e2fae1b3ff8734fc54f9e05f3b71dc1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063f4963-6797-5479-b1f6-bfbb42498df7/063f4963-6797-5479-b1f6-bfbb42498df7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_8813b7e5b0e6a98de067a2481de784ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063f4963-6797-5479-b1f6-bfbb42498df7/063f4963-6797-5479-b1f6-bfbb42498df7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_c45e8c5e47b86e6c74f409b7d988cc54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063f4963-6797-5479-b1f6-bfbb42498df7/063f4963-6797-5479-b1f6-bfbb42498df7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_747afc5a7fe1e4d54693ebea9b7116b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063f4963-6797-5479-b1f6-bfbb42498df7/063f4963-6797-5479-b1f6-bfbb42498df7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_c66d24f9b265732fbc8ca5f6c9d4284e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063f4963-6797-5479-b1f6-bfbb42498df7/063f4963-6797-5479-b1f6-bfbb42498df7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_5300bb82fd14e3303c94b37afba9948e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063f4963-6797-5479-b1f6-bfbb42498df7/063f4963-6797-5479-b1f6-bfbb42498df7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_1960e0bb617faa1ac842d6428943d818.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063f4963-6797-5479-b1f6-bfbb42498df7/063f4963-6797-5479-b1f6-bfbb42498df7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_f341f7356e1a5e8d234b63469e4577d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063f4963-6797-5479-b1f6-bfbb42498df7/063f4963-6797-5479-b1f6-bfbb42498df7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_de00bf261539c1247c00ddf129a2ccf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063f4963-6797-5479-b1f6-bfbb42498df7/063f4963-6797-5479-b1f6-bfbb42498df7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/c5/eac50672d39284a4a6be0ab29ceb1574/pa/FK77468_d5e69b531f6bb8d7fcae1c540c3792d0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo 150 Jahre Opel',
 'transmission': 'manual',
 'trim': '150 Jahre',
 'year': 2012}
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK77468%27 HTTP/1.1" 200 None
2026-03-27 10:37:32 [auto1.de] INFO: Saving data for FK77468: {'created_time': 1774607852.128608, 'last_price_update_time': 1774607852.128624, 'auction_closing_time': 1774715352.0}
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK77468') HTTP/1.1" 204 0
2026-03-27 10:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LW18163> (referer: https://www.auto1.com/v1/car-details-view/LW18163/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/d5/c1d5ad6d4332d1d41b4631716f05596c/pa/GL18465_ceff7c7bdd5a9c448553f7da4a832bc6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1497bf16-a845-59af-8797-a627a7d61672 with identifier: LW18163
2026-03-27 10:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1497bf16-a845-59af-8797-a627a7d61672 with scrape type 1
2026-03-27 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1497bf16-a845-59af-8797-a627a7d61672
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F96%252F949646f5c1cfabe8e889fb3add9bbc55%252Fpa%252FLW18163_b7abe4265aa229bf22e7bbf697dee346.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_b7abe4265aa229bf22e7bbf697dee346.jpg not downloaded yet
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F96%252F949646f5c1cfabe8e889fb3add9bbc55%252Fpa%252FLW18163_fec0b112f54e17d64373f3b3cbfe2d9a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_fec0b112f54e17d64373f3b3cbfe2d9a.jpg not downloaded yet
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F96%252F949646f5c1cfabe8e889fb3add9bbc55%252Fpa%252FLW18163_9417361909538635770afea0901e6b1c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_9417361909538635770afea0901e6b1c.jpg not downloaded yet
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F96%252F949646f5c1cfabe8e889fb3add9bbc55%252Fpa%252FLW18163_0670675cb8815e20f8e144e380f16568.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_0670675cb8815e20f8e144e380f16568.jpg not downloaded yet
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F96%252F949646f5c1cfabe8e889fb3add9bbc55%252Fpa%252FLW18163_c94766106e8f450eca41d83d651bfbb1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_c94766106e8f450eca41d83d651bfbb1.jpg not downloaded yet
2026-03-27 10:37:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50171d4d0>
2026-03-27 10:37:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5743c775-1541-5d96-ab2d-db07b572329d/5743c775-1541-5d96-ab2d-db07b572329d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fd5%252Fc1d5ad6d4332d1d41b4631716f05596c%252Fpa%252FGL18465_ceff7c7bdd5a9c448553f7da4a832bc6.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/d5/c1d5ad6d4332d1d41b4631716f05596c/pa/GL18465_ceff7c7bdd5a9c448553f7da4a832bc6.jpg saved to cache
2026-03-27 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5743c775-1541-5d96-ab2d-db07b572329d
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F96%252F949646f5c1cfabe8e889fb3add9bbc55%252Fpa%252FLW18163_1c331a39f8799890980d578f8258920e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_1c331a39f8799890980d578f8258920e.jpg not downloaded yet
2026-03-27 10:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_550c49b06b548e2d80800e051ddb126c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F96%252F949646f5c1cfabe8e889fb3add9bbc55%252Fpa%252FLW18163_970ab9c72bb2c4ce08d1b1b98f8c3760.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_970ab9c72bb2c4ce08d1b1b98f8c3760.jpg not downloaded yet
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F96%252F949646f5c1cfabe8e889fb3add9bbc55%252Fpa%252FLW18163_beaeb3dd0ade97c23a73bdd613efa79f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_beaeb3dd0ade97c23a73bdd613efa79f.jpg not downloaded yet
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F96%252F949646f5c1cfabe8e889fb3add9bbc55%252Fpa%252FLW18163_b19d1bfd8e6902ce2a0c8af4e5aab87f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_b19d1bfd8e6902ce2a0c8af4e5aab87f.jpg not downloaded yet
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F96%252F949646f5c1cfabe8e889fb3add9bbc55%252Fpa%252FLW18163_bcc87ce429236f2450f2a0d4bceefc7c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_bcc87ce429236f2450f2a0d4bceefc7c.jpg not downloaded yet
2026-03-27 10:37:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017c4b50>
2026-03-27 10:37:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a/8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Faa%252F2eaaa733b00666c04056179d7be01d16%252Fpa%252FPB35846_550c49b06b548e2d80800e051ddb126c.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_550c49b06b548e2d80800e051ddb126c.jpg saved to cache
2026-03-27 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a
2026-03-27 10:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WN28352/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_1c331a39f8799890980d578f8258920e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017c74d0>
2026-03-27 10:37:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1497bf16-a845-59af-8797-a627a7d61672/1497bf16-a845-59af-8797-a627a7d61672_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F96%252F949646f5c1cfabe8e889fb3add9bbc55%252Fpa%252FLW18163_1c331a39f8799890980d578f8258920e.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_1c331a39f8799890980d578f8258920e.jpg saved to cache
2026-03-27 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1497bf16-a845-59af-8797-a627a7d61672
2026-03-27 10:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_b19d1bfd8e6902ce2a0c8af4e5aab87f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016de810>
2026-03-27 10:37:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1497bf16-a845-59af-8797-a627a7d61672/1497bf16-a845-59af-8797-a627a7d61672_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F96%252F949646f5c1cfabe8e889fb3add9bbc55%252Fpa%252FLW18163_b19d1bfd8e6902ce2a0c8af4e5aab87f.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_b19d1bfd8e6902ce2a0c8af4e5aab87f.jpg saved to cache
2026-03-27 10:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1497bf16-a845-59af-8797-a627a7d61672
2026-03-27 10:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_bcc87ce429236f2450f2a0d4bceefc7c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP33481/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002fd290>
2026-03-27 10:37:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1497bf16-a845-59af-8797-a627a7d61672/1497bf16-a845-59af-8797-a627a7d61672_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F96%252F949646f5c1cfabe8e889fb3add9bbc55%252Fpa%252FLW18163_bcc87ce429236f2450f2a0d4bceefc7c.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_bcc87ce429236f2450f2a0d4bceefc7c.jpg saved to cache
2026-03-27 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1497bf16-a845-59af-8797-a627a7d61672
2026-03-27 10:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_beaeb3dd0ade97c23a73bdd613efa79f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_970ab9c72bb2c4ce08d1b1b98f8c3760.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018190d0>
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1497bf16-a845-59af-8797-a627a7d61672/1497bf16-a845-59af-8797-a627a7d61672_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F96%252F949646f5c1cfabe8e889fb3add9bbc55%252Fpa%252FLW18163_beaeb3dd0ade97c23a73bdd613efa79f.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_beaeb3dd0ade97c23a73bdd613efa79f.jpg saved to cache
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1497bf16-a845-59af-8797-a627a7d61672
2026-03-27 10:37:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501615ad0>
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1497bf16-a845-59af-8797-a627a7d61672/1497bf16-a845-59af-8797-a627a7d61672_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F96%252F949646f5c1cfabe8e889fb3add9bbc55%252Fpa%252FLW18163_970ab9c72bb2c4ce08d1b1b98f8c3760.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_970ab9c72bb2c4ce08d1b1b98f8c3760.jpg saved to cache
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1497bf16-a845-59af-8797-a627a7d61672
2026-03-27 10:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FS32666> (referer: https://www.auto1.com/v1/car-details-view/FS32666/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2dd30a2-4a92-594f-abd0-554146a32812 with identifier: FS32666
2026-03-27 10:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2dd30a2-4a92-594f-abd0-554146a32812 with scrape type 1
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2dd30a2-4a92-594f-abd0-554146a32812
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fd0%252F78d09d01e490097aeaa283221cbddf4b%252Fpa%252FFS32666_b887e617ab3363e076645edd3a4139b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_b887e617ab3363e076645edd3a4139b6.jpg not downloaded yet
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fd0%252F78d09d01e490097aeaa283221cbddf4b%252Fpa%252FFS32666_87b125a579b4780af3c3529bda375af2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_87b125a579b4780af3c3529bda375af2.jpg not downloaded yet
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fd0%252F78d09d01e490097aeaa283221cbddf4b%252Fpa%252FFS32666_f1e40ee14d164d97d1fd9bd89fb09418.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_f1e40ee14d164d97d1fd9bd89fb09418.jpg not downloaded yet
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fd0%252F78d09d01e490097aeaa283221cbddf4b%252Fpa%252FFS32666_06b3211113ef60016c0609c3f4951ca0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_06b3211113ef60016c0609c3f4951ca0.jpg not downloaded yet
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fd0%252F78d09d01e490097aeaa283221cbddf4b%252Fpa%252FFS32666_6b33596a9635e1967dcc826d27b8a619.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_6b33596a9635e1967dcc826d27b8a619.jpg not downloaded yet
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fd0%252F78d09d01e490097aeaa283221cbddf4b%252Fpa%252FFS32666_d1a44d4ddbfd14f90edf4e811b22bca7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_d1a44d4ddbfd14f90edf4e811b22bca7.jpg not downloaded yet
2026-03-27 10:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_c94766106e8f450eca41d83d651bfbb1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fd0%252F78d09d01e490097aeaa283221cbddf4b%252Fpa%252FFS32666_69d74e100c806c81ec46929460f4262d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_69d74e100c806c81ec46929460f4262d.jpg not downloaded yet
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fd0%252F78d09d01e490097aeaa283221cbddf4b%252Fpa%252FFS32666_74d7bbfa05257c3c5825ff6cff9ef3bb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_74d7bbfa05257c3c5825ff6cff9ef3bb.jpg not downloaded yet
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fd0%252F78d09d01e490097aeaa283221cbddf4b%252Fpa%252FFS32666_1acac5d2badc83032c904889757d3873.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_1acac5d2badc83032c904889757d3873.jpg not downloaded yet
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fd0%252F78d09d01e490097aeaa283221cbddf4b%252Fpa%252FFS32666_a86e3efceb9616fd3fbbfc3b3f5101f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_a86e3efceb9616fd3fbbfc3b3f5101f6.jpg not downloaded yet
2026-03-27 10:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_0670675cb8815e20f8e144e380f16568.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50171e710>
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1497bf16-a845-59af-8797-a627a7d61672/1497bf16-a845-59af-8797-a627a7d61672_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F96%252F949646f5c1cfabe8e889fb3add9bbc55%252Fpa%252FLW18163_c94766106e8f450eca41d83d651bfbb1.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_c94766106e8f450eca41d83d651bfbb1.jpg saved to cache
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1497bf16-a845-59af-8797-a627a7d61672
2026-03-27 10:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_6b33596a9635e1967dcc826d27b8a619.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016df910>
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1497bf16-a845-59af-8797-a627a7d61672/1497bf16-a845-59af-8797-a627a7d61672_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F96%252F949646f5c1cfabe8e889fb3add9bbc55%252Fpa%252FLW18163_0670675cb8815e20f8e144e380f16568.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_0670675cb8815e20f8e144e380f16568.jpg saved to cache
2026-03-27 10:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1497bf16-a845-59af-8797-a627a7d61672
2026-03-27 10:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_a86e3efceb9616fd3fbbfc3b3f5101f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50166f910>
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2dd30a2-4a92-594f-abd0-554146a32812/a2dd30a2-4a92-594f-abd0-554146a32812_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fd0%252F78d09d01e490097aeaa283221cbddf4b%252Fpa%252FFS32666_6b33596a9635e1967dcc826d27b8a619.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_6b33596a9635e1967dcc826d27b8a619.jpg saved to cache
2026-03-27 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2dd30a2-4a92-594f-abd0-554146a32812
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501629a90>
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2dd30a2-4a92-594f-abd0-554146a32812/a2dd30a2-4a92-594f-abd0-554146a32812_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fd0%252F78d09d01e490097aeaa283221cbddf4b%252Fpa%252FFS32666_a86e3efceb9616fd3fbbfc3b3f5101f6.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_a86e3efceb9616fd3fbbfc3b3f5101f6.jpg saved to cache
2026-03-27 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a2dd30a2-4a92-594f-abd0-554146a32812
2026-03-27 10:37:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_1acac5d2badc83032c904889757d3873.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500399190>
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2dd30a2-4a92-594f-abd0-554146a32812/a2dd30a2-4a92-594f-abd0-554146a32812_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fd0%252F78d09d01e490097aeaa283221cbddf4b%252Fpa%252FFS32666_1acac5d2badc83032c904889757d3873.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_1acac5d2badc83032c904889757d3873.jpg saved to cache
2026-03-27 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2dd30a2-4a92-594f-abd0-554146a32812
2026-03-27 10:37:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_69d74e100c806c81ec46929460f4262d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50171ff10>
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2dd30a2-4a92-594f-abd0-554146a32812/a2dd30a2-4a92-594f-abd0-554146a32812_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fd0%252F78d09d01e490097aeaa283221cbddf4b%252Fpa%252FFS32666_69d74e100c806c81ec46929460f4262d.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_69d74e100c806c81ec46929460f4262d.jpg saved to cache
2026-03-27 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2dd30a2-4a92-594f-abd0-554146a32812
2026-03-27 10:37:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_d1a44d4ddbfd14f90edf4e811b22bca7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RP70991> (referer: https://www.auto1.com/v1/car-details-view/RP70991/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500399f50>
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2dd30a2-4a92-594f-abd0-554146a32812/a2dd30a2-4a92-594f-abd0-554146a32812_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fd0%252F78d09d01e490097aeaa283221cbddf4b%252Fpa%252FFS32666_d1a44d4ddbfd14f90edf4e811b22bca7.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_d1a44d4ddbfd14f90edf4e811b22bca7.jpg saved to cache
2026-03-27 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2dd30a2-4a92-594f-abd0-554146a32812
2026-03-27 10:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca with identifier: RP70991
2026-03-27 10:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca with scrape type 1
2026-03-27 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fe2%252F32e2ac8a965e86688fb932ae8a1a4334%252Fpa%252FRP70991_201cb07be44dc10be69f85aa1227b46b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_201cb07be44dc10be69f85aa1227b46b.jpg not downloaded yet
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fe2%252F32e2ac8a965e86688fb932ae8a1a4334%252Fpa%252FRP70991_7cf8cbdca63febfd1ac2406a7a819b5a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_7cf8cbdca63febfd1ac2406a7a819b5a.jpg not downloaded yet
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fe2%252F32e2ac8a965e86688fb932ae8a1a4334%252Fpa%252FRP70991_c4a6023900a722566d02d37b96912560.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_c4a6023900a722566d02d37b96912560.jpg not downloaded yet
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fe2%252F32e2ac8a965e86688fb932ae8a1a4334%252Fpa%252FRP70991_dc53baac0c8b99abc9051ea646448df6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_dc53baac0c8b99abc9051ea646448df6.jpg not downloaded yet
2026-03-27 10:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_74d7bbfa05257c3c5825ff6cff9ef3bb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fe2%252F32e2ac8a965e86688fb932ae8a1a4334%252Fpa%252FRP70991_522a3c1fd7d4653a42862e83fe3e57c8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_522a3c1fd7d4653a42862e83fe3e57c8.jpg not downloaded yet
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fe2%252F32e2ac8a965e86688fb932ae8a1a4334%252Fpa%252FRP70991_ec5b09f59b9d8d3c5f1898549b9a0127.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_ec5b09f59b9d8d3c5f1898549b9a0127.jpg not downloaded yet
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fe2%252F32e2ac8a965e86688fb932ae8a1a4334%252Fpa%252FRP70991_410e99ff85fec660c61eb710467f69dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_410e99ff85fec660c61eb710467f69dd.jpg not downloaded yet
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fe2%252F32e2ac8a965e86688fb932ae8a1a4334%252Fpa%252FRP70991_26fcb5473bbc504444cf79c179ce1820.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_26fcb5473bbc504444cf79c179ce1820.jpg not downloaded yet
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fe2%252F32e2ac8a965e86688fb932ae8a1a4334%252Fpa%252FRP70991_a7d7f1fce559e55ebd43b7aa9971af15.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_a7d7f1fce559e55ebd43b7aa9971af15.jpg not downloaded yet
2026-03-27 10:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_c4a6023900a722566d02d37b96912560.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fe2%252F32e2ac8a965e86688fb932ae8a1a4334%252Fpa%252FRP70991_0b577fb6939c40a50add7466e7b9b0b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_0b577fb6939c40a50add7466e7b9b0b1.jpg not downloaded yet
2026-03-27 10:37:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002cac10>
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2dd30a2-4a92-594f-abd0-554146a32812/a2dd30a2-4a92-594f-abd0-554146a32812_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fd0%252F78d09d01e490097aeaa283221cbddf4b%252Fpa%252FFS32666_74d7bbfa05257c3c5825ff6cff9ef3bb.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_74d7bbfa05257c3c5825ff6cff9ef3bb.jpg saved to cache
2026-03-27 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2dd30a2-4a92-594f-abd0-554146a32812
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50183c4d0>
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca/08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fe2%252F32e2ac8a965e86688fb932ae8a1a4334%252Fpa%252FRP70991_c4a6023900a722566d02d37b96912560.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_c4a6023900a722566d02d37b96912560.jpg saved to cache
2026-03-27 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca
2026-03-27 10:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_a7d7f1fce559e55ebd43b7aa9971af15.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU37095/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_f1e40ee14d164d97d1fd9bd89fb09418.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_06b3211113ef60016c0609c3f4951ca0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_0b577fb6939c40a50add7466e7b9b0b1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501683090>
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca/08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fe2%252F32e2ac8a965e86688fb932ae8a1a4334%252Fpa%252FRP70991_a7d7f1fce559e55ebd43b7aa9971af15.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_a7d7f1fce559e55ebd43b7aa9971af15.jpg saved to cache
2026-03-27 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca
2026-03-27 10:37:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50037f9d0>
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2dd30a2-4a92-594f-abd0-554146a32812/a2dd30a2-4a92-594f-abd0-554146a32812_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fd0%252F78d09d01e490097aeaa283221cbddf4b%252Fpa%252FFS32666_f1e40ee14d164d97d1fd9bd89fb09418.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_f1e40ee14d164d97d1fd9bd89fb09418.jpg saved to cache
2026-03-27 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2dd30a2-4a92-594f-abd0-554146a32812
2026-03-27 10:37:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017496d0>
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2dd30a2-4a92-594f-abd0-554146a32812/a2dd30a2-4a92-594f-abd0-554146a32812_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fd0%252F78d09d01e490097aeaa283221cbddf4b%252Fpa%252FFS32666_06b3211113ef60016c0609c3f4951ca0.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_06b3211113ef60016c0609c3f4951ca0.jpg saved to cache
2026-03-27 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2dd30a2-4a92-594f-abd0-554146a32812
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50199a450>
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca/08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fe2%252F32e2ac8a965e86688fb932ae8a1a4334%252Fpa%252FRP70991_0b577fb6939c40a50add7466e7b9b0b1.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_0b577fb6939c40a50add7466e7b9b0b1.jpg saved to cache
2026-03-27 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca
2026-03-27 10:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_410e99ff85fec660c61eb710467f69dd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_26fcb5473bbc504444cf79c179ce1820.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_522a3c1fd7d4653a42862e83fe3e57c8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f2c10>
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca/08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fe2%252F32e2ac8a965e86688fb932ae8a1a4334%252Fpa%252FRP70991_410e99ff85fec660c61eb710467f69dd.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_410e99ff85fec660c61eb710467f69dd.jpg saved to cache
2026-03-27 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca
2026-03-27 10:37:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501763e50>
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca/08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fe2%252F32e2ac8a965e86688fb932ae8a1a4334%252Fpa%252FRP70991_26fcb5473bbc504444cf79c179ce1820.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_26fcb5473bbc504444cf79c179ce1820.jpg saved to cache
2026-03-27 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501711c50>
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca/08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fe2%252F32e2ac8a965e86688fb932ae8a1a4334%252Fpa%252FRP70991_522a3c1fd7d4653a42862e83fe3e57c8.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_522a3c1fd7d4653a42862e83fe3e57c8.jpg saved to cache
2026-03-27 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca
2026-03-27 10:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_dc53baac0c8b99abc9051ea646448df6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500390190>
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca/08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fe2%252F32e2ac8a965e86688fb932ae8a1a4334%252Fpa%252FRP70991_dc53baac0c8b99abc9051ea646448df6.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_dc53baac0c8b99abc9051ea646448df6.jpg saved to cache
2026-03-27 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca
2026-03-27 10:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_7cf8cbdca63febfd1ac2406a7a819b5a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TX63688> (referer: https://www.auto1.com/v1/car-details-view/TX63688/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017666d0>
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca/08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fe2%252F32e2ac8a965e86688fb932ae8a1a4334%252Fpa%252FRP70991_7cf8cbdca63febfd1ac2406a7a819b5a.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_7cf8cbdca63febfd1ac2406a7a819b5a.jpg saved to cache
2026-03-27 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca
2026-03-27 10:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_87b125a579b4780af3c3529bda375af2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6328d2a1-39c1-5106-9e54-ce92a4d90535 with identifier: TX63688
2026-03-27 10:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6328d2a1-39c1-5106-9e54-ce92a4d90535 with scrape type 1
2026-03-27 10:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6328d2a1-39c1-5106-9e54-ce92a4d90535
2026-03-27 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F51%252Ff7518128de55d21fe3ed402cc7103b31%252Fpa%252FTX63688_dade373858fa04909080b2cd32d02025.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_dade373858fa04909080b2cd32d02025.jpg not downloaded yet
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F51%252Ff7518128de55d21fe3ed402cc7103b31%252Fpa%252FTX63688_fd75a05256f0396a2b28b6d51d7cda3f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_fd75a05256f0396a2b28b6d51d7cda3f.jpg not downloaded yet
2026-03-27 10:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_201cb07be44dc10be69f85aa1227b46b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F51%252Ff7518128de55d21fe3ed402cc7103b31%252Fpa%252FTX63688_1252224757ef044cc4cff7e0b453a965.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_1252224757ef044cc4cff7e0b453a965.jpg not downloaded yet
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F51%252Ff7518128de55d21fe3ed402cc7103b31%252Fpa%252FTX63688_4ca94d77529db0bb00b3e99bdb594941.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_4ca94d77529db0bb00b3e99bdb594941.jpg not downloaded yet
2026-03-27 10:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_ec5b09f59b9d8d3c5f1898549b9a0127.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F51%252Ff7518128de55d21fe3ed402cc7103b31%252Fpa%252FTX63688_62d6da793bdc46f866351f09a9fe305a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_62d6da793bdc46f866351f09a9fe305a.jpg not downloaded yet
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F51%252Ff7518128de55d21fe3ed402cc7103b31%252Fpa%252FTX63688_527faf4c8a471076117a41c2fb97bdcd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_527faf4c8a471076117a41c2fb97bdcd.jpg not downloaded yet
2026-03-27 10:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501749cd0>
2026-03-27 10:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2dd30a2-4a92-594f-abd0-554146a32812/a2dd30a2-4a92-594f-abd0-554146a32812_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fd0%252F78d09d01e490097aeaa283221cbddf4b%252Fpa%252FFS32666_87b125a579b4780af3c3529bda375af2.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_87b125a579b4780af3c3529bda375af2.jpg saved to cache
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2dd30a2-4a92-594f-abd0-554146a32812
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F51%252Ff7518128de55d21fe3ed402cc7103b31%252Fpa%252FTX63688_b6885758cd7f2ac1652f9afb00a0f4ee.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_b6885758cd7f2ac1652f9afb00a0f4ee.jpg not downloaded yet
2026-03-27 10:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ15565/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F51%252Ff7518128de55d21fe3ed402cc7103b31%252Fpa%252FTX63688_b6f1a5d8fcadd61a1e4d2b126167a1a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_b6f1a5d8fcadd61a1e4d2b126167a1a1.jpg not downloaded yet
2026-03-27 10:37:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F51%252Ff7518128de55d21fe3ed402cc7103b31%252Fpa%252FTX63688_ab9bfb97490e4cb6138455c43b05a9fe.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_ab9bfb97490e4cb6138455c43b05a9fe.jpg not downloaded yet
2026-03-27 10:37:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a12910>
2026-03-27 10:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca/08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fe2%252F32e2ac8a965e86688fb932ae8a1a4334%252Fpa%252FRP70991_201cb07be44dc10be69f85aa1227b46b.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_201cb07be44dc10be69f85aa1227b46b.jpg saved to cache
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca
2026-03-27 10:37:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016e4990>
2026-03-27 10:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca/08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fe2%252F32e2ac8a965e86688fb932ae8a1a4334%252Fpa%252FRP70991_ec5b09f59b9d8d3c5f1898549b9a0127.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_ec5b09f59b9d8d3c5f1898549b9a0127.jpg saved to cache
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca
2026-03-27 10:37:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca, skipping ID generation
2026-03-27 10:37:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca with scrape type 1
2026-03-27 10:37:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca sending to next pipeline
2026-03-27 10:37:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca, identifier: RP70991
2026-03-27 10:37:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca with identifier: RP70991
2026-03-27 10:37:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca with identifier: RP70991
2026-03-27 10:37:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca with identifier: RP70991 to the API
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_ec5b09f59b9d8d3c5f1898549b9a0127.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 280,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '3.8L',
 'engine_horse_power': 355,
 'expiration_date': '2026-03-28T16:36:01Z',
 'fuel_type': 'petrol',
 'id': '08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP70991',
 'listing': 'auction',
 'location': 'DE, Düsseldorf',
 'make': 'Porsche',
 'model': '911',
 'odometer': 93486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca/08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3239024,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_201cb07be44dc10be69f85aa1227b46b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca/08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3134276,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_7cf8cbdca63febfd1ac2406a7a819b5a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca/08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_c4a6023900a722566d02d37b96912560.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca/08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_dc53baac0c8b99abc9051ea646448df6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca/08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_522a3c1fd7d4653a42862e83fe3e57c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca/08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3361400,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_ec5b09f59b9d8d3c5f1898549b9a0127.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca/08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2999839,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_410e99ff85fec660c61eb710467f69dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca/08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3259051,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_26fcb5473bbc504444cf79c179ce1820.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca/08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_a7d7f1fce559e55ebd43b7aa9971af15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca/08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/e2/32e2ac8a965e86688fb932ae8a1a4334/pa/RP70991_0b577fb6939c40a50add7466e7b9b0b1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-05-07',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Porsche 911 997 Carrera S Cabrio',
 'transmission': 'manual',
 'trim': 'Carrera S Cabrio',
 'year': 2008}
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP70991%27 HTTP/1.1" 200 None
2026-03-27 10:37:40 [auto1.de] INFO: Saving data for RP70991: {'created_time': 1774607860.319753, 'last_price_update_time': 1774607860.319764, 'auction_closing_time': 1774715761.0}
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP70991') HTTP/1.1" 204 0
2026-03-27 10:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_fd75a05256f0396a2b28b6d51d7cda3f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F51%252Ff7518128de55d21fe3ed402cc7103b31%252Fpa%252FTX63688_36c4a515babb2a5bb658e0ffb51f30ab.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_36c4a515babb2a5bb658e0ffb51f30ab.jpg not downloaded yet
2026-03-27 10:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XS57001> (referer: https://www.auto1.com/v1/car-details-view/XS57001/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE80885> (referer: https://www.auto1.com/v1/car-details-view/DE80885/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_9417361909538635770afea0901e6b1c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_b887e617ab3363e076645edd3a4139b6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016fd2d0>
2026-03-27 10:37:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6328d2a1-39c1-5106-9e54-ce92a4d90535/6328d2a1-39c1-5106-9e54-ce92a4d90535_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F51%252Ff7518128de55d21fe3ed402cc7103b31%252Fpa%252FTX63688_fd75a05256f0396a2b28b6d51d7cda3f.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_fd75a05256f0396a2b28b6d51d7cda3f.jpg saved to cache
2026-03-27 10:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6328d2a1-39c1-5106-9e54-ce92a4d90535
2026-03-27 10:37:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbdce216-66a7-56d0-9e96-bc377b3ac056 with identifier: XS57001
2026-03-27 10:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbdce216-66a7-56d0-9e96-bc377b3ac056 with scrape type 1
2026-03-27 10:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fbdce216-66a7-56d0-9e96-bc377b3ac056
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F52%252F8f527556ca0b5df9f07f8239076b7de6%252Fpa%252FXS57001_04cdd76916ace33008621bfdeb809822.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_04cdd76916ace33008621bfdeb809822.jpg not downloaded yet
2026-03-27 10:37:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c478098-0899-5054-bb41-5eed6243400e with identifier: DE80885
2026-03-27 10:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c478098-0899-5054-bb41-5eed6243400e with scrape type 1
2026-03-27 10:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c478098-0899-5054-bb41-5eed6243400e
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ff8%252F48f8c2ab70beb75d6ceb9d5374b2d942%252Fpa%252FDE80885_24a85dbcd7c0fffea92798c385bb421b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_24a85dbcd7c0fffea92798c385bb421b.jpg not downloaded yet
2026-03-27 10:37:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb502610210>
2026-03-27 10:37:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1497bf16-a845-59af-8797-a627a7d61672/1497bf16-a845-59af-8797-a627a7d61672_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F96%252F949646f5c1cfabe8e889fb3add9bbc55%252Fpa%252FLW18163_9417361909538635770afea0901e6b1c.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_9417361909538635770afea0901e6b1c.jpg saved to cache
2026-03-27 10:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1497bf16-a845-59af-8797-a627a7d61672
2026-03-27 10:37:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501840550>
2026-03-27 10:37:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2dd30a2-4a92-594f-abd0-554146a32812/a2dd30a2-4a92-594f-abd0-554146a32812_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fd0%252F78d09d01e490097aeaa283221cbddf4b%252Fpa%252FFS32666_b887e617ab3363e076645edd3a4139b6.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_b887e617ab3363e076645edd3a4139b6.jpg saved to cache
2026-03-27 10:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2dd30a2-4a92-594f-abd0-554146a32812
2026-03-27 10:37:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2dd30a2-4a92-594f-abd0-554146a32812, skipping ID generation
2026-03-27 10:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2dd30a2-4a92-594f-abd0-554146a32812 with scrape type 1
2026-03-27 10:37:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2dd30a2-4a92-594f-abd0-554146a32812 sending to next pipeline
2026-03-27 10:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2dd30a2-4a92-594f-abd0-554146a32812, identifier: FS32666
2026-03-27 10:37:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2dd30a2-4a92-594f-abd0-554146a32812 with identifier: FS32666
2026-03-27 10:37:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2dd30a2-4a92-594f-abd0-554146a32812 with identifier: FS32666
2026-03-27 10:37:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2dd30a2-4a92-594f-abd0-554146a32812 with identifier: FS32666 to the API
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_b887e617ab3363e076645edd3a4139b6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:07:40Z',
 'fuel_type': 'petrol',
 'id': 'a2dd30a2-4a92-594f-abd0-554146a32812',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS32666',
 'listing': 'auction',
 'location': 'DE, Stuttgart',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 88669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2dd30a2-4a92-594f-abd0-554146a32812/a2dd30a2-4a92-594f-abd0-554146a32812_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2992241,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_b887e617ab3363e076645edd3a4139b6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2dd30a2-4a92-594f-abd0-554146a32812/a2dd30a2-4a92-594f-abd0-554146a32812_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_87b125a579b4780af3c3529bda375af2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2dd30a2-4a92-594f-abd0-554146a32812/a2dd30a2-4a92-594f-abd0-554146a32812_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2783331,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_f1e40ee14d164d97d1fd9bd89fb09418.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2dd30a2-4a92-594f-abd0-554146a32812/a2dd30a2-4a92-594f-abd0-554146a32812_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2822082,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_06b3211113ef60016c0609c3f4951ca0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2dd30a2-4a92-594f-abd0-554146a32812/a2dd30a2-4a92-594f-abd0-554146a32812_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_6b33596a9635e1967dcc826d27b8a619.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2dd30a2-4a92-594f-abd0-554146a32812/a2dd30a2-4a92-594f-abd0-554146a32812_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2891479,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_d1a44d4ddbfd14f90edf4e811b22bca7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2dd30a2-4a92-594f-abd0-554146a32812/a2dd30a2-4a92-594f-abd0-554146a32812_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2847414,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_69d74e100c806c81ec46929460f4262d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2dd30a2-4a92-594f-abd0-554146a32812/a2dd30a2-4a92-594f-abd0-554146a32812_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3007716,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_74d7bbfa05257c3c5825ff6cff9ef3bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2dd30a2-4a92-594f-abd0-554146a32812/a2dd30a2-4a92-594f-abd0-554146a32812_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_1acac5d2badc83032c904889757d3873.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2dd30a2-4a92-594f-abd0-554146a32812/a2dd30a2-4a92-594f-abd0-554146a32812_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/d0/78d09d01e490097aeaa283221cbddf4b/pa/FS32666_a86e3efceb9616fd3fbbfc3b3f5101f6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Urban Explorer 4x2',
 'transmission': 'manual',
 'trim': 'Urban Explorer 4x2',
 'year': 2015}
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS32666%27 HTTP/1.1" 200 None
2026-03-27 10:37:41 [auto1.de] INFO: Saving data for FS32666: {'created_time': 1774607861.316366, 'last_price_update_time': 1774607861.31638, 'auction_closing_time': 1774714060.0}
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS32666') HTTP/1.1" 204 0
2026-03-27 10:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_b6885758cd7f2ac1652f9afb00a0f4ee.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_36c4a515babb2a5bb658e0ffb51f30ab.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_527faf4c8a471076117a41c2fb97bdcd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F52%252F8f527556ca0b5df9f07f8239076b7de6%252Fpa%252FXS57001_758a58b43fedbbd88ac882197793d0b3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_758a58b43fedbbd88ac882197793d0b3.jpg not downloaded yet
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ff8%252F48f8c2ab70beb75d6ceb9d5374b2d942%252Fpa%252FDE80885_d976fc391797763dc53396fd78fc7895.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_d976fc391797763dc53396fd78fc7895.jpg not downloaded yet
2026-03-27 10:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_ab9bfb97490e4cb6138455c43b05a9fe.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_b6f1a5d8fcadd61a1e4d2b126167a1a1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZN32695> (referer: https://www.auto1.com/v1/car-details-view/ZN32695/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F52%252F8f527556ca0b5df9f07f8239076b7de6%252Fpa%252FXS57001_18404f38479c6b94b0b0f8e5da521aba.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_18404f38479c6b94b0b0f8e5da521aba.jpg not downloaded yet
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ff8%252F48f8c2ab70beb75d6ceb9d5374b2d942%252Fpa%252FDE80885_792d09c313a23dbf8922f8fd2f431bb8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_792d09c313a23dbf8922f8fd2f431bb8.jpg not downloaded yet
2026-03-27 10:37:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F52%252F8f527556ca0b5df9f07f8239076b7de6%252Fpa%252FXS57001_eeab476fdc67cc9d648ca8d6b17a0c45.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_eeab476fdc67cc9d648ca8d6b17a0c45.jpg not downloaded yet
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ff8%252F48f8c2ab70beb75d6ceb9d5374b2d942%252Fpa%252FDE80885_b3a036ec1220bd89e0f00cc1b2579865.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_b3a036ec1220bd89e0f00cc1b2579865.jpg not downloaded yet
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50178c950>
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6328d2a1-39c1-5106-9e54-ce92a4d90535/6328d2a1-39c1-5106-9e54-ce92a4d90535_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F51%252Ff7518128de55d21fe3ed402cc7103b31%252Fpa%252FTX63688_b6885758cd7f2ac1652f9afb00a0f4ee.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_b6885758cd7f2ac1652f9afb00a0f4ee.jpg saved to cache
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6328d2a1-39c1-5106-9e54-ce92a4d90535
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F52%252F8f527556ca0b5df9f07f8239076b7de6%252Fpa%252FXS57001_4fe282acf2ae3633dd4cf969776dccdd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_4fe282acf2ae3633dd4cf969776dccdd.jpg not downloaded yet
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ff8%252F48f8c2ab70beb75d6ceb9d5374b2d942%252Fpa%252FDE80885_2a095ba04aa634c27ef1dfd4a35b2edd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_2a095ba04aa634c27ef1dfd4a35b2edd.jpg not downloaded yet
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017607d0>
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6328d2a1-39c1-5106-9e54-ce92a4d90535/6328d2a1-39c1-5106-9e54-ce92a4d90535_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F51%252Ff7518128de55d21fe3ed402cc7103b31%252Fpa%252FTX63688_36c4a515babb2a5bb658e0ffb51f30ab.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_36c4a515babb2a5bb658e0ffb51f30ab.jpg saved to cache
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6328d2a1-39c1-5106-9e54-ce92a4d90535
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501998a90>
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6328d2a1-39c1-5106-9e54-ce92a4d90535/6328d2a1-39c1-5106-9e54-ce92a4d90535_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F51%252Ff7518128de55d21fe3ed402cc7103b31%252Fpa%252FTX63688_527faf4c8a471076117a41c2fb97bdcd.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_527faf4c8a471076117a41c2fb97bdcd.jpg saved to cache
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6328d2a1-39c1-5106-9e54-ce92a4d90535
2026-03-27 10:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_04cdd76916ace33008621bfdeb809822.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F52%252F8f527556ca0b5df9f07f8239076b7de6%252Fpa%252FXS57001_12b574636f2e74a14821127bbfa70a39.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_12b574636f2e74a14821127bbfa70a39.jpg not downloaded yet
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ff8%252F48f8c2ab70beb75d6ceb9d5374b2d942%252Fpa%252FDE80885_118ca672aed40f495a15cda639ba5614.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_118ca672aed40f495a15cda639ba5614.jpg not downloaded yet
2026-03-27 10:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_4ca94d77529db0bb00b3e99bdb594941.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_62d6da793bdc46f866351f09a9fe305a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_d976fc391797763dc53396fd78fc7895.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503c07250>
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6328d2a1-39c1-5106-9e54-ce92a4d90535/6328d2a1-39c1-5106-9e54-ce92a4d90535_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F51%252Ff7518128de55d21fe3ed402cc7103b31%252Fpa%252FTX63688_ab9bfb97490e4cb6138455c43b05a9fe.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_ab9bfb97490e4cb6138455c43b05a9fe.jpg saved to cache
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6328d2a1-39c1-5106-9e54-ce92a4d90535
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500557dd0>
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6328d2a1-39c1-5106-9e54-ce92a4d90535/6328d2a1-39c1-5106-9e54-ce92a4d90535_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F51%252Ff7518128de55d21fe3ed402cc7103b31%252Fpa%252FTX63688_b6f1a5d8fcadd61a1e4d2b126167a1a1.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_b6f1a5d8fcadd61a1e4d2b126167a1a1.jpg saved to cache
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6328d2a1-39c1-5106-9e54-ce92a4d90535
2026-03-27 10:37:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f48a2e84-9136-5ddf-8c5b-928cf3e867f1 with identifier: ZN32695
2026-03-27 10:37:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f48a2e84-9136-5ddf-8c5b-928cf3e867f1 with scrape type 1
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f48a2e84-9136-5ddf-8c5b-928cf3e867f1
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fec%252F44ec42cdb2f6f8e1211478a4134b941c%252Fpa%252FZN32695_bd77386ed437601ebe2f192326cf123a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_bd77386ed437601ebe2f192326cf123a.jpg not downloaded yet
2026-03-27 10:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_1252224757ef044cc4cff7e0b453a965.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F52%252F8f527556ca0b5df9f07f8239076b7de6%252Fpa%252FXS57001_e9cbf09a9d641159abcfadedd819db97.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_e9cbf09a9d641159abcfadedd819db97.jpg not downloaded yet
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ff8%252F48f8c2ab70beb75d6ceb9d5374b2d942%252Fpa%252FDE80885_c5ce6364d11d4d51af3208fede6740a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_c5ce6364d11d4d51af3208fede6740a3.jpg not downloaded yet
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fec%252F44ec42cdb2f6f8e1211478a4134b941c%252Fpa%252FZN32695_cbd5a9b058277869a84fb9191da3f156.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_cbd5a9b058277869a84fb9191da3f156.jpg not downloaded yet
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F52%252F8f527556ca0b5df9f07f8239076b7de6%252Fpa%252FXS57001_1eed0d001f6173dbf9fc702d3ffa6188.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_1eed0d001f6173dbf9fc702d3ffa6188.jpg not downloaded yet
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ff8%252F48f8c2ab70beb75d6ceb9d5374b2d942%252Fpa%252FDE80885_b104ba5b17885d4b669e34d549d12b5b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_b104ba5b17885d4b669e34d549d12b5b.jpg not downloaded yet
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fec%252F44ec42cdb2f6f8e1211478a4134b941c%252Fpa%252FZN32695_58a9adb0d8ccb91bd5ba5a1a09d9037a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_58a9adb0d8ccb91bd5ba5a1a09d9037a.jpg not downloaded yet
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018aa390>
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbdce216-66a7-56d0-9e96-bc377b3ac056/fbdce216-66a7-56d0-9e96-bc377b3ac056_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F52%252F8f527556ca0b5df9f07f8239076b7de6%252Fpa%252FXS57001_04cdd76916ace33008621bfdeb809822.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_04cdd76916ace33008621bfdeb809822.jpg saved to cache
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fbdce216-66a7-56d0-9e96-bc377b3ac056
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50388a190>
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6328d2a1-39c1-5106-9e54-ce92a4d90535/6328d2a1-39c1-5106-9e54-ce92a4d90535_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F51%252Ff7518128de55d21fe3ed402cc7103b31%252Fpa%252FTX63688_4ca94d77529db0bb00b3e99bdb594941.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_4ca94d77529db0bb00b3e99bdb594941.jpg saved to cache
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6328d2a1-39c1-5106-9e54-ce92a4d90535
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500339b50>
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6328d2a1-39c1-5106-9e54-ce92a4d90535/6328d2a1-39c1-5106-9e54-ce92a4d90535_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F51%252Ff7518128de55d21fe3ed402cc7103b31%252Fpa%252FTX63688_62d6da793bdc46f866351f09a9fe305a.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_62d6da793bdc46f866351f09a9fe305a.jpg saved to cache
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6328d2a1-39c1-5106-9e54-ce92a4d90535
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004db890>
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c478098-0899-5054-bb41-5eed6243400e/5c478098-0899-5054-bb41-5eed6243400e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ff8%252F48f8c2ab70beb75d6ceb9d5374b2d942%252Fpa%252FDE80885_d976fc391797763dc53396fd78fc7895.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_d976fc391797763dc53396fd78fc7895.jpg saved to cache
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c478098-0899-5054-bb41-5eed6243400e
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F52%252F8f527556ca0b5df9f07f8239076b7de6%252Fpa%252FXS57001_0a32d999b79a335f162763f265e6e20a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_0a32d999b79a335f162763f265e6e20a.jpg not downloaded yet
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ff8%252F48f8c2ab70beb75d6ceb9d5374b2d942%252Fpa%252FDE80885_3f36d5e51b51354f9f4a8ece61df1f91.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_3f36d5e51b51354f9f4a8ece61df1f91.jpg not downloaded yet
2026-03-27 10:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_118ca672aed40f495a15cda639ba5614.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_4fe282acf2ae3633dd4cf969776dccdd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fec%252F44ec42cdb2f6f8e1211478a4134b941c%252Fpa%252FZN32695_6b1b19c475322b3899e0acd5d764cb9e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_6b1b19c475322b3899e0acd5d764cb9e.jpg not downloaded yet
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500338c10>
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6328d2a1-39c1-5106-9e54-ce92a4d90535/6328d2a1-39c1-5106-9e54-ce92a4d90535_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F51%252Ff7518128de55d21fe3ed402cc7103b31%252Fpa%252FTX63688_1252224757ef044cc4cff7e0b453a965.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_1252224757ef044cc4cff7e0b453a965.jpg saved to cache
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6328d2a1-39c1-5106-9e54-ce92a4d90535
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F52%252F8f527556ca0b5df9f07f8239076b7de6%252Fpa%252FXS57001_9b2bcd4a82184bd0de5c4e0e60414ca7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_9b2bcd4a82184bd0de5c4e0e60414ca7.jpg not downloaded yet
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ff8%252F48f8c2ab70beb75d6ceb9d5374b2d942%252Fpa%252FDE80885_07561314cd0514df5d0a362b4cfd0268.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_07561314cd0514df5d0a362b4cfd0268.jpg not downloaded yet
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fec%252F44ec42cdb2f6f8e1211478a4134b941c%252Fpa%252FZN32695_e281b9693bb3f0d2d98f24e29e329a39.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_e281b9693bb3f0d2d98f24e29e329a39.jpg not downloaded yet
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fec%252F44ec42cdb2f6f8e1211478a4134b941c%252Fpa%252FZN32695_6bbf5546f284a72bb6e7fbbaeffca8c7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_6bbf5546f284a72bb6e7fbbaeffca8c7.jpg not downloaded yet
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fec%252F44ec42cdb2f6f8e1211478a4134b941c%252Fpa%252FZN32695_5e983aaf300c360deea89a0d40ec61b9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_5e983aaf300c360deea89a0d40ec61b9.jpg not downloaded yet
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50057ff10>
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c478098-0899-5054-bb41-5eed6243400e/5c478098-0899-5054-bb41-5eed6243400e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ff8%252F48f8c2ab70beb75d6ceb9d5374b2d942%252Fpa%252FDE80885_118ca672aed40f495a15cda639ba5614.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_118ca672aed40f495a15cda639ba5614.jpg saved to cache
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c478098-0899-5054-bb41-5eed6243400e
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50059ead0>
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbdce216-66a7-56d0-9e96-bc377b3ac056/fbdce216-66a7-56d0-9e96-bc377b3ac056_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F52%252F8f527556ca0b5df9f07f8239076b7de6%252Fpa%252FXS57001_4fe282acf2ae3633dd4cf969776dccdd.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_4fe282acf2ae3633dd4cf969776dccdd.jpg saved to cache
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fbdce216-66a7-56d0-9e96-bc377b3ac056
2026-03-27 10:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_58a9adb0d8ccb91bd5ba5a1a09d9037a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_b104ba5b17885d4b669e34d549d12b5b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fec%252F44ec42cdb2f6f8e1211478a4134b941c%252Fpa%252FZN32695_3b6f33f175fcc70507e638452c83114b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_3b6f33f175fcc70507e638452c83114b.jpg not downloaded yet
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fec%252F44ec42cdb2f6f8e1211478a4134b941c%252Fpa%252FZN32695_d6e99c92b3ddcc26b16ee55b0dedefcf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_d6e99c92b3ddcc26b16ee55b0dedefcf.jpg not downloaded yet
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fec%252F44ec42cdb2f6f8e1211478a4134b941c%252Fpa%252FZN32695_a0b8045b66cd5a03a44442507ff9112a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_a0b8045b66cd5a03a44442507ff9112a.jpg not downloaded yet
2026-03-27 10:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP33481> (referer: https://www.auto1.com/v1/car-details-view/BP33481/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_24a85dbcd7c0fffea92798c385bb421b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50372a210>
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f48a2e84-9136-5ddf-8c5b-928cf3e867f1/f48a2e84-9136-5ddf-8c5b-928cf3e867f1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fec%252F44ec42cdb2f6f8e1211478a4134b941c%252Fpa%252FZN32695_58a9adb0d8ccb91bd5ba5a1a09d9037a.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_58a9adb0d8ccb91bd5ba5a1a09d9037a.jpg saved to cache
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f48a2e84-9136-5ddf-8c5b-928cf3e867f1
2026-03-27 10:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_b3a036ec1220bd89e0f00cc1b2579865.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_758a58b43fedbbd88ac882197793d0b3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_2a095ba04aa634c27ef1dfd4a35b2edd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_a0b8045b66cd5a03a44442507ff9112a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50186d9d0>
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c478098-0899-5054-bb41-5eed6243400e/5c478098-0899-5054-bb41-5eed6243400e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ff8%252F48f8c2ab70beb75d6ceb9d5374b2d942%252Fpa%252FDE80885_b104ba5b17885d4b669e34d549d12b5b.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_b104ba5b17885d4b669e34d549d12b5b.jpg saved to cache
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c478098-0899-5054-bb41-5eed6243400e
2026-03-27 10:37:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bb0099a-3b0d-50f1-ba1b-750944f050f9 with identifier: BP33481
2026-03-27 10:37:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bb0099a-3b0d-50f1-ba1b-750944f050f9 with scrape type 1
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0bb0099a-3b0d-50f1-ba1b-750944f050f9
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F67%252F3d675c7738fad31e81468544d068ed62%252Fpa%252FBP33481_984c2c9b9fcb1bd3eeeadd6a6062ba70.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/67/3d675c7738fad31e81468544d068ed62/pa/BP33481_984c2c9b9fcb1bd3eeeadd6a6062ba70.jpg already downloaded
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F67%252F3d675c7738fad31e81468544d068ed62%252Fpa%252FBP33481_54e663ec7030ffaef1be7e597e127322.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/67/3d675c7738fad31e81468544d068ed62/pa/BP33481_54e663ec7030ffaef1be7e597e127322.jpg already downloaded
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F67%252F3d675c7738fad31e81468544d068ed62%252Fpa%252FBP33481_80101a83af06410ac5b5755ea2c466bb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/67/3d675c7738fad31e81468544d068ed62/pa/BP33481_80101a83af06410ac5b5755ea2c466bb.jpg already downloaded
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F67%252F3d675c7738fad31e81468544d068ed62%252Fpa%252FBP33481_f71dcf2ec534b3665ec0ee0b9778ee80.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/67/3d675c7738fad31e81468544d068ed62/pa/BP33481_f71dcf2ec534b3665ec0ee0b9778ee80.jpg already downloaded
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F67%252F3d675c7738fad31e81468544d068ed62%252Fpa%252FBP33481_8f518ccf393857b99ea02c778ce80d0a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/67/3d675c7738fad31e81468544d068ed62/pa/BP33481_8f518ccf393857b99ea02c778ce80d0a.jpg already downloaded
2026-03-27 10:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0bb0099a-3b0d-50f1-ba1b-750944f050f9, identifier: BP33481
2026-03-27 10:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0bb0099a-3b0d-50f1-ba1b-750944f050f9 with identifier: BP33481
2026-03-27 10:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0bb0099a-3b0d-50f1-ba1b-750944f050f9 with identifier: BP33481
2026-03-27 10:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0bb0099a-3b0d-50f1-ba1b-750944f050f9 with identifier: BP33481 to the API
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BP33481>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:56:36Z',
 'fuel_type': 'petrol',
 'id': '0bb0099a-3b0d-50f1-ba1b-750944f050f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP33481',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 257051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img3d/67/3d675c7738fad31e81468544d068ed62/pa/BP33481_984c2c9b9fcb1bd3eeeadd6a6062ba70.jpg',
                'https://img-pa.auto1.com/img3d/67/3d675c7738fad31e81468544d068ed62/pa/BP33481_54e663ec7030ffaef1be7e597e127322.jpg',
                'https://img-pa.auto1.com/img3d/67/3d675c7738fad31e81468544d068ed62/pa/BP33481_80101a83af06410ac5b5755ea2c466bb.jpg',
                'https://img-pa.auto1.com/img3d/67/3d675c7738fad31e81468544d068ed62/pa/BP33481_f71dcf2ec534b3665ec0ee0b9778ee80.jpg',
                'https://img-pa.auto1.com/img3d/67/3d675c7738fad31e81468544d068ed62/pa/BP33481_8f518ccf393857b99ea02c778ce80d0a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bb0099a-3b0d-50f1-ba1b-750944f050f9/0bb0099a-3b0d-50f1-ba1b-750944f050f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/67/3d675c7738fad31e81468544d068ed62/pa/BP33481_984c2c9b9fcb1bd3eeeadd6a6062ba70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bb0099a-3b0d-50f1-ba1b-750944f050f9/0bb0099a-3b0d-50f1-ba1b-750944f050f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/67/3d675c7738fad31e81468544d068ed62/pa/BP33481_54e663ec7030ffaef1be7e597e127322.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bb0099a-3b0d-50f1-ba1b-750944f050f9/0bb0099a-3b0d-50f1-ba1b-750944f050f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/67/3d675c7738fad31e81468544d068ed62/pa/BP33481_80101a83af06410ac5b5755ea2c466bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bb0099a-3b0d-50f1-ba1b-750944f050f9/0bb0099a-3b0d-50f1-ba1b-750944f050f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/67/3d675c7738fad31e81468544d068ed62/pa/BP33481_f71dcf2ec534b3665ec0ee0b9778ee80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bb0099a-3b0d-50f1-ba1b-750944f050f9/0bb0099a-3b0d-50f1-ba1b-750944f050f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/67/3d675c7738fad31e81468544d068ed62/pa/BP33481_8f518ccf393857b99ea02c778ce80d0a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-13',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2013}
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP33481%27 HTTP/1.1" 200 None
2026-03-27 10:37:43 [auto1.de] INFO: Saving data for BP33481: {'created_time': 1774607863.392483, 'last_price_update_time': 1774607863.392494, 'auction_closing_time': 1774716996.0}
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP33481') HTTP/1.1" 204 0
2026-03-27 10:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_6bbf5546f284a72bb6e7fbbaeffca8c7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_eeab476fdc67cc9d648ca8d6b17a0c45.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_5e983aaf300c360deea89a0d40ec61b9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FR95379/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50170d650>
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c478098-0899-5054-bb41-5eed6243400e/5c478098-0899-5054-bb41-5eed6243400e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ff8%252F48f8c2ab70beb75d6ceb9d5374b2d942%252Fpa%252FDE80885_24a85dbcd7c0fffea92798c385bb421b.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_24a85dbcd7c0fffea92798c385bb421b.jpg saved to cache
2026-03-27 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c478098-0899-5054-bb41-5eed6243400e
2026-03-27 10:37:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015c5790>
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c478098-0899-5054-bb41-5eed6243400e/5c478098-0899-5054-bb41-5eed6243400e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ff8%252F48f8c2ab70beb75d6ceb9d5374b2d942%252Fpa%252FDE80885_b3a036ec1220bd89e0f00cc1b2579865.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_b3a036ec1220bd89e0f00cc1b2579865.jpg saved to cache
2026-03-27 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c478098-0899-5054-bb41-5eed6243400e
2026-03-27 10:37:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016ffd10>
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbdce216-66a7-56d0-9e96-bc377b3ac056/fbdce216-66a7-56d0-9e96-bc377b3ac056_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F52%252F8f527556ca0b5df9f07f8239076b7de6%252Fpa%252FXS57001_758a58b43fedbbd88ac882197793d0b3.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_758a58b43fedbbd88ac882197793d0b3.jpg saved to cache
2026-03-27 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fbdce216-66a7-56d0-9e96-bc377b3ac056
2026-03-27 10:37:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016aa510>
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c478098-0899-5054-bb41-5eed6243400e/5c478098-0899-5054-bb41-5eed6243400e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ff8%252F48f8c2ab70beb75d6ceb9d5374b2d942%252Fpa%252FDE80885_2a095ba04aa634c27ef1dfd4a35b2edd.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_2a095ba04aa634c27ef1dfd4a35b2edd.jpg saved to cache
2026-03-27 10:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c478098-0899-5054-bb41-5eed6243400e
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500320550>
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f48a2e84-9136-5ddf-8c5b-928cf3e867f1/f48a2e84-9136-5ddf-8c5b-928cf3e867f1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fec%252F44ec42cdb2f6f8e1211478a4134b941c%252Fpa%252FZN32695_a0b8045b66cd5a03a44442507ff9112a.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_a0b8045b66cd5a03a44442507ff9112a.jpg saved to cache
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f48a2e84-9136-5ddf-8c5b-928cf3e867f1
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500571a50>
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f48a2e84-9136-5ddf-8c5b-928cf3e867f1/f48a2e84-9136-5ddf-8c5b-928cf3e867f1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fec%252F44ec42cdb2f6f8e1211478a4134b941c%252Fpa%252FZN32695_6bbf5546f284a72bb6e7fbbaeffca8c7.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_6bbf5546f284a72bb6e7fbbaeffca8c7.jpg saved to cache
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f48a2e84-9136-5ddf-8c5b-928cf3e867f1
2026-03-27 10:37:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50161d150>
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbdce216-66a7-56d0-9e96-bc377b3ac056/fbdce216-66a7-56d0-9e96-bc377b3ac056_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F52%252F8f527556ca0b5df9f07f8239076b7de6%252Fpa%252FXS57001_eeab476fdc67cc9d648ca8d6b17a0c45.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_eeab476fdc67cc9d648ca8d6b17a0c45.jpg saved to cache
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fbdce216-66a7-56d0-9e96-bc377b3ac056
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501689bd0>
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f48a2e84-9136-5ddf-8c5b-928cf3e867f1/f48a2e84-9136-5ddf-8c5b-928cf3e867f1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fec%252F44ec42cdb2f6f8e1211478a4134b941c%252Fpa%252FZN32695_5e983aaf300c360deea89a0d40ec61b9.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_5e983aaf300c360deea89a0d40ec61b9.jpg saved to cache
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f48a2e84-9136-5ddf-8c5b-928cf3e867f1
2026-03-27 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_d6e99c92b3ddcc26b16ee55b0dedefcf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_9b2bcd4a82184bd0de5c4e0e60414ca7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_6b1b19c475322b3899e0acd5d764cb9e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_0a32d999b79a335f162763f265e6e20a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_cbd5a9b058277869a84fb9191da3f156.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501656990>
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f48a2e84-9136-5ddf-8c5b-928cf3e867f1/f48a2e84-9136-5ddf-8c5b-928cf3e867f1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fec%252F44ec42cdb2f6f8e1211478a4134b941c%252Fpa%252FZN32695_d6e99c92b3ddcc26b16ee55b0dedefcf.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_d6e99c92b3ddcc26b16ee55b0dedefcf.jpg saved to cache
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f48a2e84-9136-5ddf-8c5b-928cf3e867f1
2026-03-27 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_c5ce6364d11d4d51af3208fede6740a3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_bd77386ed437601ebe2f192326cf123a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_e9cbf09a9d641159abcfadedd819db97.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004dde50>
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbdce216-66a7-56d0-9e96-bc377b3ac056/fbdce216-66a7-56d0-9e96-bc377b3ac056_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F52%252F8f527556ca0b5df9f07f8239076b7de6%252Fpa%252FXS57001_9b2bcd4a82184bd0de5c4e0e60414ca7.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_9b2bcd4a82184bd0de5c4e0e60414ca7.jpg saved to cache
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fbdce216-66a7-56d0-9e96-bc377b3ac056
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50178e150>
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f48a2e84-9136-5ddf-8c5b-928cf3e867f1/f48a2e84-9136-5ddf-8c5b-928cf3e867f1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fec%252F44ec42cdb2f6f8e1211478a4134b941c%252Fpa%252FZN32695_6b1b19c475322b3899e0acd5d764cb9e.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_6b1b19c475322b3899e0acd5d764cb9e.jpg saved to cache
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f48a2e84-9136-5ddf-8c5b-928cf3e867f1
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500385310>
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbdce216-66a7-56d0-9e96-bc377b3ac056/fbdce216-66a7-56d0-9e96-bc377b3ac056_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F52%252F8f527556ca0b5df9f07f8239076b7de6%252Fpa%252FXS57001_0a32d999b79a335f162763f265e6e20a.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_0a32d999b79a335f162763f265e6e20a.jpg saved to cache
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fbdce216-66a7-56d0-9e96-bc377b3ac056
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f0c10>
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f48a2e84-9136-5ddf-8c5b-928cf3e867f1/f48a2e84-9136-5ddf-8c5b-928cf3e867f1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fec%252F44ec42cdb2f6f8e1211478a4134b941c%252Fpa%252FZN32695_cbd5a9b058277869a84fb9191da3f156.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_cbd5a9b058277869a84fb9191da3f156.jpg saved to cache
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f48a2e84-9136-5ddf-8c5b-928cf3e867f1
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018ad050>
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c478098-0899-5054-bb41-5eed6243400e/5c478098-0899-5054-bb41-5eed6243400e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ff8%252F48f8c2ab70beb75d6ceb9d5374b2d942%252Fpa%252FDE80885_c5ce6364d11d4d51af3208fede6740a3.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_c5ce6364d11d4d51af3208fede6740a3.jpg saved to cache
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c478098-0899-5054-bb41-5eed6243400e
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500351f90>
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f48a2e84-9136-5ddf-8c5b-928cf3e867f1/f48a2e84-9136-5ddf-8c5b-928cf3e867f1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fec%252F44ec42cdb2f6f8e1211478a4134b941c%252Fpa%252FZN32695_bd77386ed437601ebe2f192326cf123a.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_bd77386ed437601ebe2f192326cf123a.jpg saved to cache
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f48a2e84-9136-5ddf-8c5b-928cf3e867f1
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501897590>
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbdce216-66a7-56d0-9e96-bc377b3ac056/fbdce216-66a7-56d0-9e96-bc377b3ac056_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F52%252F8f527556ca0b5df9f07f8239076b7de6%252Fpa%252FXS57001_e9cbf09a9d641159abcfadedd819db97.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_e9cbf09a9d641159abcfadedd819db97.jpg saved to cache
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fbdce216-66a7-56d0-9e96-bc377b3ac056
2026-03-27 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_12b574636f2e74a14821127bbfa70a39.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_18404f38479c6b94b0b0f8e5da521aba.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_e281b9693bb3f0d2d98f24e29e329a39.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_1eed0d001f6173dbf9fc702d3ffa6188.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_3b6f33f175fcc70507e638452c83114b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_07561314cd0514df5d0a362b4cfd0268.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_792d09c313a23dbf8922f8fd2f431bb8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_dade373858fa04909080b2cd32d02025.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_3f36d5e51b51354f9f4a8ece61df1f91.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50161eb50>
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbdce216-66a7-56d0-9e96-bc377b3ac056/fbdce216-66a7-56d0-9e96-bc377b3ac056_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F52%252F8f527556ca0b5df9f07f8239076b7de6%252Fpa%252FXS57001_12b574636f2e74a14821127bbfa70a39.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_12b574636f2e74a14821127bbfa70a39.jpg saved to cache
2026-03-27 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fbdce216-66a7-56d0-9e96-bc377b3ac056
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50183c850>
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbdce216-66a7-56d0-9e96-bc377b3ac056/fbdce216-66a7-56d0-9e96-bc377b3ac056_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F52%252F8f527556ca0b5df9f07f8239076b7de6%252Fpa%252FXS57001_18404f38479c6b94b0b0f8e5da521aba.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_18404f38479c6b94b0b0f8e5da521aba.jpg saved to cache
2026-03-27 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fbdce216-66a7-56d0-9e96-bc377b3ac056
2026-03-27 10:37:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501740310>
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f48a2e84-9136-5ddf-8c5b-928cf3e867f1/f48a2e84-9136-5ddf-8c5b-928cf3e867f1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fec%252F44ec42cdb2f6f8e1211478a4134b941c%252Fpa%252FZN32695_e281b9693bb3f0d2d98f24e29e329a39.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_e281b9693bb3f0d2d98f24e29e329a39.jpg saved to cache
2026-03-27 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f48a2e84-9136-5ddf-8c5b-928cf3e867f1
2026-03-27 10:37:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501620950>
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbdce216-66a7-56d0-9e96-bc377b3ac056/fbdce216-66a7-56d0-9e96-bc377b3ac056_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F52%252F8f527556ca0b5df9f07f8239076b7de6%252Fpa%252FXS57001_1eed0d001f6173dbf9fc702d3ffa6188.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_1eed0d001f6173dbf9fc702d3ffa6188.jpg saved to cache
2026-03-27 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fbdce216-66a7-56d0-9e96-bc377b3ac056
2026-03-27 10:37:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fbdce216-66a7-56d0-9e96-bc377b3ac056, skipping ID generation
2026-03-27 10:37:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbdce216-66a7-56d0-9e96-bc377b3ac056 with scrape type 1
2026-03-27 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fbdce216-66a7-56d0-9e96-bc377b3ac056 sending to next pipeline
2026-03-27 10:37:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbdce216-66a7-56d0-9e96-bc377b3ac056, identifier: XS57001
2026-03-27 10:37:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018b3f90>
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f48a2e84-9136-5ddf-8c5b-928cf3e867f1/f48a2e84-9136-5ddf-8c5b-928cf3e867f1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fec%252F44ec42cdb2f6f8e1211478a4134b941c%252Fpa%252FZN32695_3b6f33f175fcc70507e638452c83114b.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_3b6f33f175fcc70507e638452c83114b.jpg saved to cache
2026-03-27 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f48a2e84-9136-5ddf-8c5b-928cf3e867f1
2026-03-27 10:37:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f48a2e84-9136-5ddf-8c5b-928cf3e867f1, skipping ID generation
2026-03-27 10:37:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f48a2e84-9136-5ddf-8c5b-928cf3e867f1 with scrape type 1
2026-03-27 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f48a2e84-9136-5ddf-8c5b-928cf3e867f1 sending to next pipeline
2026-03-27 10:37:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f48a2e84-9136-5ddf-8c5b-928cf3e867f1, identifier: ZN32695
2026-03-27 10:37:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018af890>
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c478098-0899-5054-bb41-5eed6243400e/5c478098-0899-5054-bb41-5eed6243400e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ff8%252F48f8c2ab70beb75d6ceb9d5374b2d942%252Fpa%252FDE80885_07561314cd0514df5d0a362b4cfd0268.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_07561314cd0514df5d0a362b4cfd0268.jpg saved to cache
2026-03-27 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c478098-0899-5054-bb41-5eed6243400e
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50161e8d0>
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c478098-0899-5054-bb41-5eed6243400e/5c478098-0899-5054-bb41-5eed6243400e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ff8%252F48f8c2ab70beb75d6ceb9d5374b2d942%252Fpa%252FDE80885_792d09c313a23dbf8922f8fd2f431bb8.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_792d09c313a23dbf8922f8fd2f431bb8.jpg saved to cache
2026-03-27 10:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c478098-0899-5054-bb41-5eed6243400e
2026-03-27 10:37:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbdce216-66a7-56d0-9e96-bc377b3ac056 with identifier: XS57001
2026-03-27 10:37:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbdce216-66a7-56d0-9e96-bc377b3ac056 with identifier: XS57001
2026-03-27 10:37:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbdce216-66a7-56d0-9e96-bc377b3ac056 with identifier: XS57001 to the API
2026-03-27 10:37:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_1eed0d001f6173dbf9fc702d3ffa6188.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:05:13Z',
 'fuel_type': 'petrol',
 'id': 'fbdce216-66a7-56d0-9e96-bc377b3ac056',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS57001',
 'listing': 'auction',
 'location': 'DE, München',
 'make': 'BMW',
 'model': '3er',
 'odometer': 107951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbdce216-66a7-56d0-9e96-bc377b3ac056/fbdce216-66a7-56d0-9e96-bc377b3ac056_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_04cdd76916ace33008621bfdeb809822.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbdce216-66a7-56d0-9e96-bc377b3ac056/fbdce216-66a7-56d0-9e96-bc377b3ac056_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2833881,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_758a58b43fedbbd88ac882197793d0b3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbdce216-66a7-56d0-9e96-bc377b3ac056/fbdce216-66a7-56d0-9e96-bc377b3ac056_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_18404f38479c6b94b0b0f8e5da521aba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbdce216-66a7-56d0-9e96-bc377b3ac056/fbdce216-66a7-56d0-9e96-bc377b3ac056_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2463213,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_eeab476fdc67cc9d648ca8d6b17a0c45.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbdce216-66a7-56d0-9e96-bc377b3ac056/fbdce216-66a7-56d0-9e96-bc377b3ac056_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_4fe282acf2ae3633dd4cf969776dccdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbdce216-66a7-56d0-9e96-bc377b3ac056/fbdce216-66a7-56d0-9e96-bc377b3ac056_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_12b574636f2e74a14821127bbfa70a39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbdce216-66a7-56d0-9e96-bc377b3ac056/fbdce216-66a7-56d0-9e96-bc377b3ac056_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_e9cbf09a9d641159abcfadedd819db97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbdce216-66a7-56d0-9e96-bc377b3ac056/fbdce216-66a7-56d0-9e96-bc377b3ac056_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2918505,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_1eed0d001f6173dbf9fc702d3ffa6188.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbdce216-66a7-56d0-9e96-bc377b3ac056/fbdce216-66a7-56d0-9e96-bc377b3ac056_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_0a32d999b79a335f162763f265e6e20a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbdce216-66a7-56d0-9e96-bc377b3ac056/fbdce216-66a7-56d0-9e96-bc377b3ac056_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/52/8f527556ca0b5df9f07f8239076b7de6/pa/XS57001_9b2bcd4a82184bd0de5c4e0e60414ca7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-02-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 3er 318Ci',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS57001%27 HTTP/1.1" 200 None
2026-03-27 10:37:46 [auto1.de] INFO: Saving data for XS57001: {'created_time': 1774607866.245284, 'last_price_update_time': 1774607866.245295, 'auction_closing_time': 1774713913.0}
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS57001') HTTP/1.1" 204 0
2026-03-27 10:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f48a2e84-9136-5ddf-8c5b-928cf3e867f1 with identifier: ZN32695
2026-03-27 10:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f48a2e84-9136-5ddf-8c5b-928cf3e867f1 with identifier: ZN32695
2026-03-27 10:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f48a2e84-9136-5ddf-8c5b-928cf3e867f1 with identifier: ZN32695 to the API
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_3b6f33f175fcc70507e638452c83114b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:17:44Z',
 'fuel_type': 'petrol',
 'id': 'f48a2e84-9136-5ddf-8c5b-928cf3e867f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN32695',
 'listing': 'auction',
 'location': 'DE, Böblingen',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 167579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f48a2e84-9136-5ddf-8c5b-928cf3e867f1/f48a2e84-9136-5ddf-8c5b-928cf3e867f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_bd77386ed437601ebe2f192326cf123a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f48a2e84-9136-5ddf-8c5b-928cf3e867f1/f48a2e84-9136-5ddf-8c5b-928cf3e867f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_cbd5a9b058277869a84fb9191da3f156.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f48a2e84-9136-5ddf-8c5b-928cf3e867f1/f48a2e84-9136-5ddf-8c5b-928cf3e867f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_58a9adb0d8ccb91bd5ba5a1a09d9037a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f48a2e84-9136-5ddf-8c5b-928cf3e867f1/f48a2e84-9136-5ddf-8c5b-928cf3e867f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_6b1b19c475322b3899e0acd5d764cb9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f48a2e84-9136-5ddf-8c5b-928cf3e867f1/f48a2e84-9136-5ddf-8c5b-928cf3e867f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2264530,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_e281b9693bb3f0d2d98f24e29e329a39.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f48a2e84-9136-5ddf-8c5b-928cf3e867f1/f48a2e84-9136-5ddf-8c5b-928cf3e867f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_6bbf5546f284a72bb6e7fbbaeffca8c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f48a2e84-9136-5ddf-8c5b-928cf3e867f1/f48a2e84-9136-5ddf-8c5b-928cf3e867f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_5e983aaf300c360deea89a0d40ec61b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f48a2e84-9136-5ddf-8c5b-928cf3e867f1/f48a2e84-9136-5ddf-8c5b-928cf3e867f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2425836,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_3b6f33f175fcc70507e638452c83114b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f48a2e84-9136-5ddf-8c5b-928cf3e867f1/f48a2e84-9136-5ddf-8c5b-928cf3e867f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2335666,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_d6e99c92b3ddcc26b16ee55b0dedefcf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f48a2e84-9136-5ddf-8c5b-928cf3e867f1/f48a2e84-9136-5ddf-8c5b-928cf3e867f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/ec/44ec42cdb2f6f8e1211478a4134b941c/pa/ZN32695_a0b8045b66cd5a03a44442507ff9112a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Lounge BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2015}
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN32695%27 HTTP/1.1" 200 None
2026-03-27 10:37:46 [auto1.de] INFO: Saving data for ZN32695: {'created_time': 1774607866.665239, 'last_price_update_time': 1774607866.66525, 'auction_closing_time': 1774714664.0}
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN32695') HTTP/1.1" 204 0
2026-03-27 10:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_fec0b112f54e17d64373f3b3cbfe2d9a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FR95379> (referer: https://www.auto1.com/v1/car-details-view/FR95379/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016b0a10>
2026-03-27 10:37:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6328d2a1-39c1-5106-9e54-ce92a4d90535/6328d2a1-39c1-5106-9e54-ce92a4d90535_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F51%252Ff7518128de55d21fe3ed402cc7103b31%252Fpa%252FTX63688_dade373858fa04909080b2cd32d02025.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_dade373858fa04909080b2cd32d02025.jpg saved to cache
2026-03-27 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6328d2a1-39c1-5106-9e54-ce92a4d90535
2026-03-27 10:37:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6328d2a1-39c1-5106-9e54-ce92a4d90535, skipping ID generation
2026-03-27 10:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6328d2a1-39c1-5106-9e54-ce92a4d90535 with scrape type 1
2026-03-27 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6328d2a1-39c1-5106-9e54-ce92a4d90535 sending to next pipeline
2026-03-27 10:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6328d2a1-39c1-5106-9e54-ce92a4d90535, identifier: TX63688
2026-03-27 10:37:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501765a10>
2026-03-27 10:37:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c478098-0899-5054-bb41-5eed6243400e/5c478098-0899-5054-bb41-5eed6243400e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Ff8%252F48f8c2ab70beb75d6ceb9d5374b2d942%252Fpa%252FDE80885_3f36d5e51b51354f9f4a8ece61df1f91.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_3f36d5e51b51354f9f4a8ece61df1f91.jpg saved to cache
2026-03-27 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c478098-0899-5054-bb41-5eed6243400e
2026-03-27 10:37:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c478098-0899-5054-bb41-5eed6243400e, skipping ID generation
2026-03-27 10:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c478098-0899-5054-bb41-5eed6243400e with scrape type 1
2026-03-27 10:37:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c478098-0899-5054-bb41-5eed6243400e sending to next pipeline
2026-03-27 10:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c478098-0899-5054-bb41-5eed6243400e, identifier: DE80885
2026-03-27 10:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6328d2a1-39c1-5106-9e54-ce92a4d90535 with identifier: TX63688
2026-03-27 10:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6328d2a1-39c1-5106-9e54-ce92a4d90535 with identifier: TX63688
2026-03-27 10:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6328d2a1-39c1-5106-9e54-ce92a4d90535 with identifier: TX63688 to the API
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_dade373858fa04909080b2cd32d02025.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:50:47Z',
 'fuel_type': 'diesel',
 'id': '6328d2a1-39c1-5106-9e54-ce92a4d90535',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX63688',
 'listing': 'auction',
 'location': 'DE, Mannheim',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 77192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6328d2a1-39c1-5106-9e54-ce92a4d90535/6328d2a1-39c1-5106-9e54-ce92a4d90535_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85214,
             'Height': 528,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_dade373858fa04909080b2cd32d02025.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6328d2a1-39c1-5106-9e54-ce92a4d90535/6328d2a1-39c1-5106-9e54-ce92a4d90535_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_fd75a05256f0396a2b28b6d51d7cda3f.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6328d2a1-39c1-5106-9e54-ce92a4d90535/6328d2a1-39c1-5106-9e54-ce92a4d90535_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83661,
             'Height': 530,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_1252224757ef044cc4cff7e0b453a965.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6328d2a1-39c1-5106-9e54-ce92a4d90535/6328d2a1-39c1-5106-9e54-ce92a4d90535_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_4ca94d77529db0bb00b3e99bdb594941.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6328d2a1-39c1-5106-9e54-ce92a4d90535/6328d2a1-39c1-5106-9e54-ce92a4d90535_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_62d6da793bdc46f866351f09a9fe305a.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6328d2a1-39c1-5106-9e54-ce92a4d90535/6328d2a1-39c1-5106-9e54-ce92a4d90535_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_527faf4c8a471076117a41c2fb97bdcd.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6328d2a1-39c1-5106-9e54-ce92a4d90535/6328d2a1-39c1-5106-9e54-ce92a4d90535_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_b6885758cd7f2ac1652f9afb00a0f4ee.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6328d2a1-39c1-5106-9e54-ce92a4d90535/6328d2a1-39c1-5106-9e54-ce92a4d90535_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83538,
             'Height': 530,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_b6f1a5d8fcadd61a1e4d2b126167a1a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6328d2a1-39c1-5106-9e54-ce92a4d90535/6328d2a1-39c1-5106-9e54-ce92a4d90535_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67438,
             'Height': 530,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_ab9bfb97490e4cb6138455c43b05a9fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6328d2a1-39c1-5106-9e54-ce92a4d90535/6328d2a1-39c1-5106-9e54-ce92a4d90535_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54734,
             'Height': 530,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/51/f7518128de55d21fe3ed402cc7103b31/pa/TX63688_36c4a515babb2a5bb658e0ffb51f30ab.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure Pack',
 'transmission': 'manual',
 'trim': 'Allure Pack',
 'year': 2021}
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX63688%27 HTTP/1.1" 200 None
2026-03-27 10:37:47 [auto1.de] INFO: Saving data for TX63688: {'created_time': 1774607867.468872, 'last_price_update_time': 1774607867.468883, 'auction_closing_time': 1774716647.0}
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX63688') HTTP/1.1" 204 0
2026-03-27 10:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c478098-0899-5054-bb41-5eed6243400e with identifier: DE80885
2026-03-27 10:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c478098-0899-5054-bb41-5eed6243400e with identifier: DE80885
2026-03-27 10:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c478098-0899-5054-bb41-5eed6243400e with identifier: DE80885 to the API
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_3f36d5e51b51354f9f4a8ece61df1f91.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:34:34Z',
 'fuel_type': 'petrol',
 'id': '5c478098-0899-5054-bb41-5eed6243400e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE80885',
 'listing': 'auction',
 'location': 'DE, Essen',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 121463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c478098-0899-5054-bb41-5eed6243400e/5c478098-0899-5054-bb41-5eed6243400e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2448510,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_24a85dbcd7c0fffea92798c385bb421b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c478098-0899-5054-bb41-5eed6243400e/5c478098-0899-5054-bb41-5eed6243400e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_d976fc391797763dc53396fd78fc7895.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c478098-0899-5054-bb41-5eed6243400e/5c478098-0899-5054-bb41-5eed6243400e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_792d09c313a23dbf8922f8fd2f431bb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c478098-0899-5054-bb41-5eed6243400e/5c478098-0899-5054-bb41-5eed6243400e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2255647,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_b3a036ec1220bd89e0f00cc1b2579865.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c478098-0899-5054-bb41-5eed6243400e/5c478098-0899-5054-bb41-5eed6243400e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2408829,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_2a095ba04aa634c27ef1dfd4a35b2edd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c478098-0899-5054-bb41-5eed6243400e/5c478098-0899-5054-bb41-5eed6243400e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_118ca672aed40f495a15cda639ba5614.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c478098-0899-5054-bb41-5eed6243400e/5c478098-0899-5054-bb41-5eed6243400e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_c5ce6364d11d4d51af3208fede6740a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c478098-0899-5054-bb41-5eed6243400e/5c478098-0899-5054-bb41-5eed6243400e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_b104ba5b17885d4b669e34d549d12b5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c478098-0899-5054-bb41-5eed6243400e/5c478098-0899-5054-bb41-5eed6243400e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2337244,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_3f36d5e51b51354f9f4a8ece61df1f91.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c478098-0899-5054-bb41-5eed6243400e/5c478098-0899-5054-bb41-5eed6243400e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2445684,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/f8/48f8c2ab70beb75d6ceb9d5374b2d942/pa/DE80885_07561314cd0514df5d0a362b4cfd0268.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2013}
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE80885%27 HTTP/1.1" 200 None
2026-03-27 10:37:47 [auto1.de] INFO: Saving data for DE80885: {'created_time': 1774607867.8939, 'last_price_update_time': 1774607867.893911, 'auction_closing_time': 1774715674.0}
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE80885') HTTP/1.1" 204 0
2026-03-27 10:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5036d1050>
2026-03-27 10:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1497bf16-a845-59af-8797-a627a7d61672/1497bf16-a845-59af-8797-a627a7d61672_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F96%252F949646f5c1cfabe8e889fb3add9bbc55%252Fpa%252FLW18163_fec0b112f54e17d64373f3b3cbfe2d9a.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_fec0b112f54e17d64373f3b3cbfe2d9a.jpg saved to cache
2026-03-27 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1497bf16-a845-59af-8797-a627a7d61672
2026-03-27 10:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff2c81ee-9d17-52bc-8cfd-2ab00979e48a with identifier: FR95379
2026-03-27 10:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff2c81ee-9d17-52bc-8cfd-2ab00979e48a with scrape type 1
2026-03-27 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ff2c81ee-9d17-52bc-8cfd-2ab00979e48a
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F05%252F5f0586dd8c96a6482a6746a91186cb3c%252Fpa%252FFR95379_27bbe8f6ff56dd6d61d80f2c0753bd34.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_27bbe8f6ff56dd6d61d80f2c0753bd34.jpg not downloaded yet
2026-03-27 10:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_cc7f174f99c9069974478f2168d67bdd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F05%252F5f0586dd8c96a6482a6746a91186cb3c%252Fpa%252FFR95379_4894dce5568888ce5410768a75723e43.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_4894dce5568888ce5410768a75723e43.jpg not downloaded yet
2026-03-27 10:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/d5/c1d5ad6d4332d1d41b4631716f05596c/pa/GL18465_55f57322a2b4b69fc2de93fd9a12d5b8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_3c3f6e2acb59f2f0e5b766adbea97dcd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/d5/c1d5ad6d4332d1d41b4631716f05596c/pa/GL18465_bec484a56e3ff011175e27ee93eec567.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F05%252F5f0586dd8c96a6482a6746a91186cb3c%252Fpa%252FFR95379_1b027422b809119ec8b680be876570da.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_1b027422b809119ec8b680be876570da.jpg not downloaded yet
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F05%252F5f0586dd8c96a6482a6746a91186cb3c%252Fpa%252FFR95379_8c62bb1aa03e1b0442bdc7bc5fa241ec.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_8c62bb1aa03e1b0442bdc7bc5fa241ec.jpg not downloaded yet
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F05%252F5f0586dd8c96a6482a6746a91186cb3c%252Fpa%252FFR95379_f7fe67fb11dd398a338648f3fe359181.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_f7fe67fb11dd398a338648f3fe359181.jpg not downloaded yet
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F05%252F5f0586dd8c96a6482a6746a91186cb3c%252Fpa%252FFR95379_15296bed474ba20fcc31ac8737f58f5c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_15296bed474ba20fcc31ac8737f58f5c.jpg not downloaded yet
2026-03-27 10:37:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501713890>
2026-03-27 10:37:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a/8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Faa%252F2eaaa733b00666c04056179d7be01d16%252Fpa%252FPB35846_cc7f174f99c9069974478f2168d67bdd.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_cc7f174f99c9069974478f2168d67bdd.jpg saved to cache
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a
2026-03-27 10:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_4894dce5568888ce5410768a75723e43.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_27bbe8f6ff56dd6d61d80f2c0753bd34.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_b7abe4265aa229bf22e7bbf697dee346.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501761350>
2026-03-27 10:37:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5743c775-1541-5d96-ab2d-db07b572329d/5743c775-1541-5d96-ab2d-db07b572329d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fd5%252Fc1d5ad6d4332d1d41b4631716f05596c%252Fpa%252FGL18465_55f57322a2b4b69fc2de93fd9a12d5b8.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/d5/c1d5ad6d4332d1d41b4631716f05596c/pa/GL18465_55f57322a2b4b69fc2de93fd9a12d5b8.jpg saved to cache
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5743c775-1541-5d96-ab2d-db07b572329d
2026-03-27 10:37:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500503bd0>
2026-03-27 10:37:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a/8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Faa%252F2eaaa733b00666c04056179d7be01d16%252Fpa%252FPB35846_3c3f6e2acb59f2f0e5b766adbea97dcd.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_3c3f6e2acb59f2f0e5b766adbea97dcd.jpg saved to cache
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a
2026-03-27 10:37:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a, skipping ID generation
2026-03-27 10:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a with scrape type 1
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a sending to next pipeline
2026-03-27 10:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a, identifier: PB35846
2026-03-27 10:37:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5036dd510>
2026-03-27 10:37:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5743c775-1541-5d96-ab2d-db07b572329d/5743c775-1541-5d96-ab2d-db07b572329d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fd5%252Fc1d5ad6d4332d1d41b4631716f05596c%252Fpa%252FGL18465_bec484a56e3ff011175e27ee93eec567.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/d5/c1d5ad6d4332d1d41b4631716f05596c/pa/GL18465_bec484a56e3ff011175e27ee93eec567.jpg saved to cache
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5743c775-1541-5d96-ab2d-db07b572329d
2026-03-27 10:37:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5743c775-1541-5d96-ab2d-db07b572329d, skipping ID generation
2026-03-27 10:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5743c775-1541-5d96-ab2d-db07b572329d with scrape type 1
2026-03-27 10:37:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5743c775-1541-5d96-ab2d-db07b572329d sending to next pipeline
2026-03-27 10:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5743c775-1541-5d96-ab2d-db07b572329d, identifier: GL18465
2026-03-27 10:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a with identifier: PB35846
2026-03-27 10:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a with identifier: PB35846
2026-03-27 10:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a with identifier: PB35846 to the API
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_3c3f6e2acb59f2f0e5b766adbea97dcd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:39:44Z',
 'fuel_type': 'petrol',
 'id': '8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB35846',
 'listing': 'auction',
 'location': 'DE, Reinbek',
 'make': 'Seat',
 'model': 'Mii',
 'odometer': 104798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a/8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_cc7f174f99c9069974478f2168d67bdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a/8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_3c3f6e2acb59f2f0e5b766adbea97dcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a/8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_550c49b06b548e2d80800e051ddb126c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a/8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_bae2af00a05cc8b3ca45f64b857732cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a/8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_cb1147a2d5c189c00f567dc09140bace.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a/8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_7252a0f0c3147bdbf6b651de80e6ffbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a/8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_98feab51d5862d68199edc01d0909c0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a/8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_6498e0df6d2e75f35df4e6a27e1ccfef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a/8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_e065dbf6a9a1904ce682a19e110f2d81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a/8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/aa/2eaaa733b00666c04056179d7be01d16/pa/PB35846_0006a2764d453fa5af5eebbfda0bfae1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Seat Mii 1.0 FR-Line',
 'transmission': 'manual',
 'trim': 'FR-Line',
 'year': 2016}
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB35846%27 HTTP/1.1" 200 None
2026-03-27 10:37:48 [auto1.de] INFO: Saving data for PB35846: {'created_time': 1774607868.888461, 'last_price_update_time': 1774607868.888473, 'auction_closing_time': 1774715984.0}
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB35846') HTTP/1.1" 204 0
2026-03-27 10:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5743c775-1541-5d96-ab2d-db07b572329d with identifier: GL18465
2026-03-27 10:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5743c775-1541-5d96-ab2d-db07b572329d with identifier: GL18465
2026-03-27 10:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5743c775-1541-5d96-ab2d-db07b572329d with identifier: GL18465 to the API
2026-03-27 10:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc1/d5/c1d5ad6d4332d1d41b4631716f05596c/pa/GL18465_bec484a56e3ff011175e27ee93eec567.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 238,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:09:12Z',
 'fuel_type': 'diesel',
 'id': '5743c775-1541-5d96-ab2d-db07b572329d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL18465',
 'listing': 'auction',
 'location': 'DE, Dresden',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 255387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5743c775-1541-5d96-ab2d-db07b572329d/5743c775-1541-5d96-ab2d-db07b572329d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/d5/c1d5ad6d4332d1d41b4631716f05596c/pa/GL18465_bec484a56e3ff011175e27ee93eec567.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5743c775-1541-5d96-ab2d-db07b572329d/5743c775-1541-5d96-ab2d-db07b572329d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/d5/c1d5ad6d4332d1d41b4631716f05596c/pa/GL18465_55f57322a2b4b69fc2de93fd9a12d5b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5743c775-1541-5d96-ab2d-db07b572329d/5743c775-1541-5d96-ab2d-db07b572329d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/d5/c1d5ad6d4332d1d41b4631716f05596c/pa/GL18465_ceff7c7bdd5a9c448553f7da4a832bc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5743c775-1541-5d96-ab2d-db07b572329d/5743c775-1541-5d96-ab2d-db07b572329d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/d5/c1d5ad6d4332d1d41b4631716f05596c/pa/GL18465_35d371b657e1183843733a2c8f8713cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5743c775-1541-5d96-ab2d-db07b572329d/5743c775-1541-5d96-ab2d-db07b572329d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/d5/c1d5ad6d4332d1d41b4631716f05596c/pa/GL18465_eb46528e55953fbe369a83cee6108f09.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sorento 2.5 CRDi EX',
 'transmission': 'automatic',
 'trim': 'EX',
 'year': 2003}
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL18465%27 HTTP/1.1" 200 None
2026-03-27 10:37:49 [auto1.de] INFO: Saving data for GL18465: {'created_time': 1774607869.279201, 'last_price_update_time': 1774607869.279217, 'auction_closing_time': 1774714152.0}
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL18465') HTTP/1.1" 204 0
2026-03-27 10:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/4e/a84e7cdbbfd0520b8bacb7b09d696d8a/pa/PR23937_e5072f8dfdd3a9cb03df36b4fd398875.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_f7fe67fb11dd398a338648f3fe359181.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_15296bed474ba20fcc31ac8737f58f5c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_8c62bb1aa03e1b0442bdc7bc5fa241ec.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU37095> (referer: https://www.auto1.com/v1/car-details-view/PU37095/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50057fe50>
2026-03-27 10:37:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff2c81ee-9d17-52bc-8cfd-2ab00979e48a/ff2c81ee-9d17-52bc-8cfd-2ab00979e48a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F05%252F5f0586dd8c96a6482a6746a91186cb3c%252Fpa%252FFR95379_4894dce5568888ce5410768a75723e43.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_4894dce5568888ce5410768a75723e43.jpg saved to cache
2026-03-27 10:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff2c81ee-9d17-52bc-8cfd-2ab00979e48a
2026-03-27 10:37:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501942510>
2026-03-27 10:37:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff2c81ee-9d17-52bc-8cfd-2ab00979e48a/ff2c81ee-9d17-52bc-8cfd-2ab00979e48a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F05%252F5f0586dd8c96a6482a6746a91186cb3c%252Fpa%252FFR95379_27bbe8f6ff56dd6d61d80f2c0753bd34.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_27bbe8f6ff56dd6d61d80f2c0753bd34.jpg saved to cache
2026-03-27 10:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff2c81ee-9d17-52bc-8cfd-2ab00979e48a
2026-03-27 10:37:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501697c50>
2026-03-27 10:37:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1497bf16-a845-59af-8797-a627a7d61672/1497bf16-a845-59af-8797-a627a7d61672_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F96%252F949646f5c1cfabe8e889fb3add9bbc55%252Fpa%252FLW18163_b7abe4265aa229bf22e7bbf697dee346.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_b7abe4265aa229bf22e7bbf697dee346.jpg saved to cache
2026-03-27 10:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1497bf16-a845-59af-8797-a627a7d61672
2026-03-27 10:37:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1497bf16-a845-59af-8797-a627a7d61672, skipping ID generation
2026-03-27 10:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1497bf16-a845-59af-8797-a627a7d61672 with scrape type 1
2026-03-27 10:37:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1497bf16-a845-59af-8797-a627a7d61672 sending to next pipeline
2026-03-27 10:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1497bf16-a845-59af-8797-a627a7d61672, identifier: LW18163
2026-03-27 10:37:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1497bf16-a845-59af-8797-a627a7d61672 with identifier: LW18163
2026-03-27 10:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1497bf16-a845-59af-8797-a627a7d61672 with identifier: LW18163
2026-03-27 10:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1497bf16-a845-59af-8797-a627a7d61672 with identifier: LW18163 to the API
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_b7abe4265aa229bf22e7bbf697dee346.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:59:55Z',
 'fuel_type': 'diesel',
 'id': '1497bf16-a845-59af-8797-a627a7d61672',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW18163',
 'listing': 'auction',
 'location': 'DE, Worms',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 206605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1497bf16-a845-59af-8797-a627a7d61672/1497bf16-a845-59af-8797-a627a7d61672_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2388698,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_b7abe4265aa229bf22e7bbf697dee346.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1497bf16-a845-59af-8797-a627a7d61672/1497bf16-a845-59af-8797-a627a7d61672_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_fec0b112f54e17d64373f3b3cbfe2d9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1497bf16-a845-59af-8797-a627a7d61672/1497bf16-a845-59af-8797-a627a7d61672_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2262092,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_9417361909538635770afea0901e6b1c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1497bf16-a845-59af-8797-a627a7d61672/1497bf16-a845-59af-8797-a627a7d61672_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2216630,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_0670675cb8815e20f8e144e380f16568.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1497bf16-a845-59af-8797-a627a7d61672/1497bf16-a845-59af-8797-a627a7d61672_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2357911,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_c94766106e8f450eca41d83d651bfbb1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1497bf16-a845-59af-8797-a627a7d61672/1497bf16-a845-59af-8797-a627a7d61672_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_1c331a39f8799890980d578f8258920e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1497bf16-a845-59af-8797-a627a7d61672/1497bf16-a845-59af-8797-a627a7d61672_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2303038,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_970ab9c72bb2c4ce08d1b1b98f8c3760.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1497bf16-a845-59af-8797-a627a7d61672/1497bf16-a845-59af-8797-a627a7d61672_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2425593,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_beaeb3dd0ade97c23a73bdd613efa79f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1497bf16-a845-59af-8797-a627a7d61672/1497bf16-a845-59af-8797-a627a7d61672_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_b19d1bfd8e6902ce2a0c8af4e5aab87f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1497bf16-a845-59af-8797-a627a7d61672/1497bf16-a845-59af-8797-a627a7d61672_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2560396,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/96/949646f5c1cfabe8e889fb3add9bbc55/pa/LW18163_bcc87ce429236f2450f2a0d4bceefc7c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V60 2.0 D4 Summum',
 'transmission': 'manual',
 'trim': 'Summum',
 'year': 2013}
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW18163%27 HTTP/1.1" 200 None
2026-03-27 10:37:50 [auto1.de] INFO: Saving data for LW18163: {'created_time': 1774607870.080896, 'last_price_update_time': 1774607870.080907, 'auction_closing_time': 1774717195.0}
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW18163') HTTP/1.1" 204 0
2026-03-27 10:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_1b027422b809119ec8b680be876570da.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/4e/a84e7cdbbfd0520b8bacb7b09d696d8a/pa/PR23937_b728400a1e751633b8f9547f8a7a4fc4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501943290>
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cce06b55-bcd3-51ca-a2df-9964fa37f093/cce06b55-bcd3-51ca-a2df-9964fa37f093_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F4e%252Fa84e7cdbbfd0520b8bacb7b09d696d8a%252Fpa%252FPR23937_e5072f8dfdd3a9cb03df36b4fd398875.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/4e/a84e7cdbbfd0520b8bacb7b09d696d8a/pa/PR23937_e5072f8dfdd3a9cb03df36b4fd398875.jpg saved to cache
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cce06b55-bcd3-51ca-a2df-9964fa37f093
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016df910>
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff2c81ee-9d17-52bc-8cfd-2ab00979e48a/ff2c81ee-9d17-52bc-8cfd-2ab00979e48a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F05%252F5f0586dd8c96a6482a6746a91186cb3c%252Fpa%252FFR95379_f7fe67fb11dd398a338648f3fe359181.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_f7fe67fb11dd398a338648f3fe359181.jpg saved to cache
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff2c81ee-9d17-52bc-8cfd-2ab00979e48a
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500589dd0>
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff2c81ee-9d17-52bc-8cfd-2ab00979e48a/ff2c81ee-9d17-52bc-8cfd-2ab00979e48a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F05%252F5f0586dd8c96a6482a6746a91186cb3c%252Fpa%252FFR95379_15296bed474ba20fcc31ac8737f58f5c.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_15296bed474ba20fcc31ac8737f58f5c.jpg saved to cache
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff2c81ee-9d17-52bc-8cfd-2ab00979e48a
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501749f50>
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff2c81ee-9d17-52bc-8cfd-2ab00979e48a/ff2c81ee-9d17-52bc-8cfd-2ab00979e48a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F05%252F5f0586dd8c96a6482a6746a91186cb3c%252Fpa%252FFR95379_8c62bb1aa03e1b0442bdc7bc5fa241ec.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_8c62bb1aa03e1b0442bdc7bc5fa241ec.jpg saved to cache
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff2c81ee-9d17-52bc-8cfd-2ab00979e48a
2026-03-27 10:37:50 [auto1.de] INFO: Channel: 24h | Page: 9 | totalHits: 10502 | hits on page: 40
2026-03-27 10:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90434af9-4655-5121-a7a0-1bd4e25b93e5 with identifier: PU37095
2026-03-27 10:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90434af9-4655-5121-a7a0-1bd4e25b93e5 with scrape type 1
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 90434af9-4655-5121-a7a0-1bd4e25b93e5
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F56%252Fba56f5ef91943c243777b0f7a8fc6594%252Fpa%252FPU37095_507fd0c4a0235ad818d30dc7062e022e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_507fd0c4a0235ad818d30dc7062e022e.jpg already downloaded
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F56%252Fba56f5ef91943c243777b0f7a8fc6594%252Fpa%252FPU37095_21e674ce0079bf8ff8328d58753f17de.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_21e674ce0079bf8ff8328d58753f17de.jpg already downloaded
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F56%252Fba56f5ef91943c243777b0f7a8fc6594%252Fpa%252FPU37095_80c5131a47842262c6cd4473332ebfdb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_80c5131a47842262c6cd4473332ebfdb.jpg already downloaded
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F56%252Fba56f5ef91943c243777b0f7a8fc6594%252Fpa%252FPU37095_61d8b8cef78e07028daeb2c3e65d4e1b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_61d8b8cef78e07028daeb2c3e65d4e1b.jpg already downloaded
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F56%252Fba56f5ef91943c243777b0f7a8fc6594%252Fpa%252FPU37095_8fd3ec456845c0855b7cb81371e9cbd1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_8fd3ec456845c0855b7cb81371e9cbd1.jpg already downloaded
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F56%252Fba56f5ef91943c243777b0f7a8fc6594%252Fpa%252FPU37095_3ede11f8b666ed1dd44f50583c9f7108.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_3ede11f8b666ed1dd44f50583c9f7108.jpg already downloaded
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F56%252Fba56f5ef91943c243777b0f7a8fc6594%252Fpa%252FPU37095_5481d2f6960b132b38fce473fadf661a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_5481d2f6960b132b38fce473fadf661a.jpg already downloaded
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F56%252Fba56f5ef91943c243777b0f7a8fc6594%252Fpa%252FPU37095_181ece68c2d63df7dc70caafc3000956.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_181ece68c2d63df7dc70caafc3000956.jpg already downloaded
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F56%252Fba56f5ef91943c243777b0f7a8fc6594%252Fpa%252FPU37095_4d2036268b73821bbfb74b790448232c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_4d2036268b73821bbfb74b790448232c.jpg already downloaded
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F56%252Fba56f5ef91943c243777b0f7a8fc6594%252Fpa%252FPU37095_ed7fb343bfbf574588b9733929c9397d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_ed7fb343bfbf574588b9733929c9397d.jpg already downloaded
2026-03-27 10:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90434af9-4655-5121-a7a0-1bd4e25b93e5, identifier: PU37095
2026-03-27 10:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90434af9-4655-5121-a7a0-1bd4e25b93e5 with identifier: PU37095
2026-03-27 10:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90434af9-4655-5121-a7a0-1bd4e25b93e5 with identifier: PU37095
2026-03-27 10:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90434af9-4655-5121-a7a0-1bd4e25b93e5 with identifier: PU37095 to the API
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PU37095>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:02:48Z',
 'fuel_type': 'petrol',
 'id': '90434af9-4655-5121-a7a0-1bd4e25b93e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU37095',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 61329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_507fd0c4a0235ad818d30dc7062e022e.jpg',
                'https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_21e674ce0079bf8ff8328d58753f17de.jpg',
                'https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_80c5131a47842262c6cd4473332ebfdb.jpg',
                'https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_61d8b8cef78e07028daeb2c3e65d4e1b.jpg',
                'https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_8fd3ec456845c0855b7cb81371e9cbd1.jpg',
                'https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_3ede11f8b666ed1dd44f50583c9f7108.jpg',
                'https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_5481d2f6960b132b38fce473fadf661a.jpg',
                'https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_181ece68c2d63df7dc70caafc3000956.jpg',
                'https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_4d2036268b73821bbfb74b790448232c.jpg',
                'https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_ed7fb343bfbf574588b9733929c9397d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90434af9-4655-5121-a7a0-1bd4e25b93e5/90434af9-4655-5121-a7a0-1bd4e25b93e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2775470,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_507fd0c4a0235ad818d30dc7062e022e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90434af9-4655-5121-a7a0-1bd4e25b93e5/90434af9-4655-5121-a7a0-1bd4e25b93e5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_21e674ce0079bf8ff8328d58753f17de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90434af9-4655-5121-a7a0-1bd4e25b93e5/90434af9-4655-5121-a7a0-1bd4e25b93e5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_80c5131a47842262c6cd4473332ebfdb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90434af9-4655-5121-a7a0-1bd4e25b93e5/90434af9-4655-5121-a7a0-1bd4e25b93e5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2936705,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_61d8b8cef78e07028daeb2c3e65d4e1b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90434af9-4655-5121-a7a0-1bd4e25b93e5/90434af9-4655-5121-a7a0-1bd4e25b93e5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2795159,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_8fd3ec456845c0855b7cb81371e9cbd1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90434af9-4655-5121-a7a0-1bd4e25b93e5/90434af9-4655-5121-a7a0-1bd4e25b93e5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2830989,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_3ede11f8b666ed1dd44f50583c9f7108.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90434af9-4655-5121-a7a0-1bd4e25b93e5/90434af9-4655-5121-a7a0-1bd4e25b93e5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_5481d2f6960b132b38fce473fadf661a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90434af9-4655-5121-a7a0-1bd4e25b93e5/90434af9-4655-5121-a7a0-1bd4e25b93e5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2810922,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_181ece68c2d63df7dc70caafc3000956.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90434af9-4655-5121-a7a0-1bd4e25b93e5/90434af9-4655-5121-a7a0-1bd4e25b93e5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2852297,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_4d2036268b73821bbfb74b790448232c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90434af9-4655-5121-a7a0-1bd4e25b93e5/90434af9-4655-5121-a7a0-1bd4e25b93e5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/56/ba56f5ef91943c243777b0f7a8fc6594/pa/PU37095_ed7fb343bfbf574588b9733929c9397d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 0.9 Energy Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2015}
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU37095%27 HTTP/1.1" 200 None
2026-03-27 10:37:50 [auto1.de] INFO: Saving data for PU37095: {'created_time': 1774607870.876091, 'last_price_update_time': 1774607870.876103, 'auction_closing_time': 1774713768.0}
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU37095') HTTP/1.1" 204 0
2026-03-27 10:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/4e/a84e7cdbbfd0520b8bacb7b09d696d8a/pa/PR23937_048c67297e14a8db2b439a45dd3b337e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:50 [auto1.de] INFO: Found listing with ID: BD50097
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD50097%27 HTTP/1.1" 200 None
2026-03-27 10:37:50 [auto1.de] INFO: Scrape type for BD50097: 1
2026-03-27 10:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/4e/a84e7cdbbfd0520b8bacb7b09d696d8a/pa/PR23937_f1ee3d504257992b250dfe27f1384757.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500363290>
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff2c81ee-9d17-52bc-8cfd-2ab00979e48a/ff2c81ee-9d17-52bc-8cfd-2ab00979e48a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F05%252F5f0586dd8c96a6482a6746a91186cb3c%252Fpa%252FFR95379_1b027422b809119ec8b680be876570da.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_1b027422b809119ec8b680be876570da.jpg saved to cache
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff2c81ee-9d17-52bc-8cfd-2ab00979e48a
2026-03-27 10:37:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff2c81ee-9d17-52bc-8cfd-2ab00979e48a, skipping ID generation
2026-03-27 10:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff2c81ee-9d17-52bc-8cfd-2ab00979e48a with scrape type 1
2026-03-27 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff2c81ee-9d17-52bc-8cfd-2ab00979e48a sending to next pipeline
2026-03-27 10:37:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff2c81ee-9d17-52bc-8cfd-2ab00979e48a, identifier: FR95379
2026-03-27 10:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50178f6d0>
2026-03-27 10:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cce06b55-bcd3-51ca-a2df-9964fa37f093/cce06b55-bcd3-51ca-a2df-9964fa37f093_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F4e%252Fa84e7cdbbfd0520b8bacb7b09d696d8a%252Fpa%252FPR23937_b728400a1e751633b8f9547f8a7a4fc4.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/4e/a84e7cdbbfd0520b8bacb7b09d696d8a/pa/PR23937_b728400a1e751633b8f9547f8a7a4fc4.jpg saved to cache
2026-03-27 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cce06b55-bcd3-51ca-a2df-9964fa37f093
2026-03-27 10:37:51 [auto1.de] INFO: Found listing with ID: FB90112
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB90112%27 HTTP/1.1" 200 None
2026-03-27 10:37:51 [auto1.de] INFO: Scrape type for FB90112: 1
2026-03-27 10:37:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff2c81ee-9d17-52bc-8cfd-2ab00979e48a with identifier: FR95379
2026-03-27 10:37:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff2c81ee-9d17-52bc-8cfd-2ab00979e48a with identifier: FR95379
2026-03-27 10:37:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff2c81ee-9d17-52bc-8cfd-2ab00979e48a with identifier: FR95379 to the API
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_1b027422b809119ec8b680be876570da.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:03:35Z',
 'fuel_type': 'diesel',
 'id': 'ff2c81ee-9d17-52bc-8cfd-2ab00979e48a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR95379',
 'listing': 'auction',
 'location': 'DE, Sulzbach-Rosenberg',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 255205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff2c81ee-9d17-52bc-8cfd-2ab00979e48a/ff2c81ee-9d17-52bc-8cfd-2ab00979e48a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_27bbe8f6ff56dd6d61d80f2c0753bd34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff2c81ee-9d17-52bc-8cfd-2ab00979e48a/ff2c81ee-9d17-52bc-8cfd-2ab00979e48a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_4894dce5568888ce5410768a75723e43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff2c81ee-9d17-52bc-8cfd-2ab00979e48a/ff2c81ee-9d17-52bc-8cfd-2ab00979e48a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_1b027422b809119ec8b680be876570da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff2c81ee-9d17-52bc-8cfd-2ab00979e48a/ff2c81ee-9d17-52bc-8cfd-2ab00979e48a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_8c62bb1aa03e1b0442bdc7bc5fa241ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff2c81ee-9d17-52bc-8cfd-2ab00979e48a/ff2c81ee-9d17-52bc-8cfd-2ab00979e48a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_f7fe67fb11dd398a338648f3fe359181.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff2c81ee-9d17-52bc-8cfd-2ab00979e48a/ff2c81ee-9d17-52bc-8cfd-2ab00979e48a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/05/5f0586dd8c96a6482a6746a91186cb3c/pa/FR95379_15296bed474ba20fcc31ac8737f58f5c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 e-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2013}
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR95379%27 HTTP/1.1" 200 None
2026-03-27 10:37:51 [auto1.de] INFO: Saving data for FR95379: {'created_time': 1774607871.525974, 'last_price_update_time': 1774607871.525984, 'auction_closing_time': 1774713815.0}
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR95379') HTTP/1.1" 204 0
2026-03-27 10:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/4e/a84e7cdbbfd0520b8bacb7b09d696d8a/pa/PR23937_6f8839e52d842d58680e66905fda8f4a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:51 [auto1.de] INFO: Found listing with ID: HM57840
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM57840%27 HTTP/1.1" 200 None
2026-03-27 10:37:51 [auto1.de] INFO: Scrape type for HM57840: 1
2026-03-27 10:37:51 [auto1.de] INFO: Found listing with ID: JW30909
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW30909%27 HTTP/1.1" 200 None
2026-03-27 10:37:51 [auto1.de] INFO: Scrape type for JW30909: 1
2026-03-27 10:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018ae210>
2026-03-27 10:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cce06b55-bcd3-51ca-a2df-9964fa37f093/cce06b55-bcd3-51ca-a2df-9964fa37f093_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F4e%252Fa84e7cdbbfd0520b8bacb7b09d696d8a%252Fpa%252FPR23937_048c67297e14a8db2b439a45dd3b337e.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/4e/a84e7cdbbfd0520b8bacb7b09d696d8a/pa/PR23937_048c67297e14a8db2b439a45dd3b337e.jpg saved to cache
2026-03-27 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cce06b55-bcd3-51ca-a2df-9964fa37f093
2026-03-27 10:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50176a490>
2026-03-27 10:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cce06b55-bcd3-51ca-a2df-9964fa37f093/cce06b55-bcd3-51ca-a2df-9964fa37f093_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F4e%252Fa84e7cdbbfd0520b8bacb7b09d696d8a%252Fpa%252FPR23937_f1ee3d504257992b250dfe27f1384757.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/4e/a84e7cdbbfd0520b8bacb7b09d696d8a/pa/PR23937_f1ee3d504257992b250dfe27f1384757.jpg saved to cache
2026-03-27 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cce06b55-bcd3-51ca-a2df-9964fa37f093
2026-03-27 10:37:51 [auto1.de] INFO: Found listing with ID: NR35268
2026-03-27 10:37:51 [auto1.de] INFO: Found listing with ID: VE41412
2026-03-27 10:37:51 [auto1.de] INFO: Found listing with ID: VV46432
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46432%27 HTTP/1.1" 200 None
2026-03-27 10:37:51 [auto1.de] INFO: Scrape type for VV46432: 1
2026-03-27 10:37:51 [auto1.de] INFO: Found listing with ID: KS78216
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS78216%27 HTTP/1.1" 200 None
2026-03-27 10:37:51 [auto1.de] INFO: Scrape type for KS78216: 1
2026-03-27 10:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50033a910>
2026-03-27 10:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cce06b55-bcd3-51ca-a2df-9964fa37f093/cce06b55-bcd3-51ca-a2df-9964fa37f093_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F4e%252Fa84e7cdbbfd0520b8bacb7b09d696d8a%252Fpa%252FPR23937_6f8839e52d842d58680e66905fda8f4a.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/4e/a84e7cdbbfd0520b8bacb7b09d696d8a/pa/PR23937_6f8839e52d842d58680e66905fda8f4a.jpg saved to cache
2026-03-27 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cce06b55-bcd3-51ca-a2df-9964fa37f093
2026-03-27 10:37:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cce06b55-bcd3-51ca-a2df-9964fa37f093, skipping ID generation
2026-03-27 10:37:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cce06b55-bcd3-51ca-a2df-9964fa37f093 with scrape type 1
2026-03-27 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cce06b55-bcd3-51ca-a2df-9964fa37f093 sending to next pipeline
2026-03-27 10:37:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cce06b55-bcd3-51ca-a2df-9964fa37f093, identifier: PR23937
2026-03-27 10:37:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cce06b55-bcd3-51ca-a2df-9964fa37f093 with identifier: PR23937
2026-03-27 10:37:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cce06b55-bcd3-51ca-a2df-9964fa37f093 with identifier: PR23937
2026-03-27 10:37:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cce06b55-bcd3-51ca-a2df-9964fa37f093 with identifier: PR23937 to the API
2026-03-27 10:37:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/4e/a84e7cdbbfd0520b8bacb7b09d696d8a/pa/PR23937_6f8839e52d842d58680e66905fda8f4a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:27:17Z',
 'fuel_type': 'diesel',
 'id': 'cce06b55-bcd3-51ca-a2df-9964fa37f093',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR23937',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 199491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cce06b55-bcd3-51ca-a2df-9964fa37f093/cce06b55-bcd3-51ca-a2df-9964fa37f093_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/4e/a84e7cdbbfd0520b8bacb7b09d696d8a/pa/PR23937_6f8839e52d842d58680e66905fda8f4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cce06b55-bcd3-51ca-a2df-9964fa37f093/cce06b55-bcd3-51ca-a2df-9964fa37f093_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/4e/a84e7cdbbfd0520b8bacb7b09d696d8a/pa/PR23937_f1ee3d504257992b250dfe27f1384757.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cce06b55-bcd3-51ca-a2df-9964fa37f093/cce06b55-bcd3-51ca-a2df-9964fa37f093_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/4e/a84e7cdbbfd0520b8bacb7b09d696d8a/pa/PR23937_048c67297e14a8db2b439a45dd3b337e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cce06b55-bcd3-51ca-a2df-9964fa37f093/cce06b55-bcd3-51ca-a2df-9964fa37f093_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/4e/a84e7cdbbfd0520b8bacb7b09d696d8a/pa/PR23937_b728400a1e751633b8f9547f8a7a4fc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cce06b55-bcd3-51ca-a2df-9964fa37f093/cce06b55-bcd3-51ca-a2df-9964fa37f093_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/4e/a84e7cdbbfd0520b8bacb7b09d696d8a/pa/PR23937_e5072f8dfdd3a9cb03df36b4fd398875.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23937%27 HTTP/1.1" 200 None
2026-03-27 10:37:52 [auto1.de] INFO: Saving data for PR23937: {'created_time': 1774607872.255165, 'last_price_update_time': 1774607872.255176, 'auction_closing_time': 1774715237.0}
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR23937') HTTP/1.1" 204 0
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: RC79950
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC79950%27 HTTP/1.1" 200 None
2026-03-27 10:37:52 [auto1.de] INFO: Scrape type for RC79950: 1
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: UL59525
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL59525%27 HTTP/1.1" 200 None
2026-03-27 10:37:52 [auto1.de] INFO: Scrape type for UL59525: 2
2026-03-27 10:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b0dc56a-d463-5dcc-9dc1-2355f79b7862 with identifier: UL59525
2026-03-27 10:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b0dc56a-d463-5dcc-9dc1-2355f79b7862 with scrape type 2
2026-03-27 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b0dc56a-d463-5dcc-9dc1-2355f79b7862 with scrape type 2
2026-03-27 10:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b0dc56a-d463-5dcc-9dc1-2355f79b7862, identifier: UL59525
2026-03-27 10:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b0dc56a-d463-5dcc-9dc1-2355f79b7862 with identifier: UL59525
2026-03-27 10:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b0dc56a-d463-5dcc-9dc1-2355f79b7862 with identifier: UL59525
2026-03-27 10:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b0dc56a-d463-5dcc-9dc1-2355f79b7862 with identifier: UL59525 to the API
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:03:48Z',
 'fuel_type': 'diesel',
 'id': '4b0dc56a-d463-5dcc-9dc1-2355f79b7862',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL59525',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 354078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-27',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2011}
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL59525%27 HTTP/1.1" 200 None
2026-03-27 10:37:52 [auto1.de] INFO: Saving data for UL59525: {'auction_closing_time': 1774713828.0, 'created_time': 1773946710.247724, 'last_price_update_time': 1774607872.733283}
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL59525') HTTP/1.1" 204 0
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: BX01003
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: DT14163
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT14163%27 HTTP/1.1" 200 None
2026-03-27 10:37:52 [auto1.de] INFO: Scrape type for DT14163: 1
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: HK20534
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: UF20593
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: CC81369
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: UN23019
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: EK21596
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: AC15853
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC15853%27 HTTP/1.1" 200 None
2026-03-27 10:37:52 [auto1.de] INFO: Scrape type for AC15853: 1
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: SD28198
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: NG44703
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: SP19687
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP19687%27 HTTP/1.1" 200 None
2026-03-27 10:37:52 [auto1.de] INFO: Scrape type for SP19687: 1
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: LU27790
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU27790%27 HTTP/1.1" 200 None
2026-03-27 10:37:52 [auto1.de] INFO: Scrape type for LU27790: 1
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: RG76834
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG76834%27 HTTP/1.1" 200 None
2026-03-27 10:37:52 [auto1.de] INFO: Scrape type for RG76834: 1
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: HP18010
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: VC15219
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: UC42370
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC42370%27 HTTP/1.1" 200 None
2026-03-27 10:37:52 [auto1.de] INFO: Scrape type for UC42370: 1
2026-03-27 10:37:52 [auto1.de] INFO: Found listing with ID: BN55276
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN55276%27 HTTP/1.1" 200 None
2026-03-27 10:37:52 [auto1.de] INFO: Scrape type for BN55276: 2
2026-03-27 10:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c93bf116-19cf-5fff-abcc-d3c64aece2a6 with identifier: BN55276
2026-03-27 10:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c93bf116-19cf-5fff-abcc-d3c64aece2a6 with scrape type 2
2026-03-27 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c93bf116-19cf-5fff-abcc-d3c64aece2a6 with scrape type 2
2026-03-27 10:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c93bf116-19cf-5fff-abcc-d3c64aece2a6, identifier: BN55276
2026-03-27 10:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c93bf116-19cf-5fff-abcc-d3c64aece2a6 with identifier: BN55276
2026-03-27 10:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c93bf116-19cf-5fff-abcc-d3c64aece2a6 with identifier: BN55276
2026-03-27 10:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c93bf116-19cf-5fff-abcc-d3c64aece2a6 with identifier: BN55276 to the API
2026-03-27 10:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 151,
 'expiration_date': '2026-03-28T16:45:31Z',
 'fuel_type': 'petrol',
 'id': 'c93bf116-19cf-5fff-abcc-d3c64aece2a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN55276',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 46113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seller_name': None,
 'title': 'Fiat 500X 1.3 Turbo Cross',
 'transmission': 'automatic',
 'trim': 'Cross',
 'year': 2021}
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN55276%27 HTTP/1.1" 200 None
2026-03-27 10:37:54 [auto1.de] INFO: Saving data for BN55276: {'auction_closing_time': 1774716331.0, 'created_time': 1773400902.368161, 'last_price_update_time': 1774607874.380276}
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN55276') HTTP/1.1" 204 0
2026-03-27 10:37:54 [auto1.de] INFO: Found listing with ID: SJ87943
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ87943%27 HTTP/1.1" 200 None
2026-03-27 10:37:54 [auto1.de] INFO: Scrape type for SJ87943: 1
2026-03-27 10:37:54 [auto1.de] INFO: Found listing with ID: GA58010
2026-03-27 10:37:54 [auto1.de] INFO: Found listing with ID: DF59303
2026-03-27 10:37:54 [auto1.de] INFO: Found listing with ID: EA40469
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA40469%27 HTTP/1.1" 200 None
2026-03-27 10:37:54 [auto1.de] INFO: Scrape type for EA40469: 1
2026-03-27 10:37:54 [auto1.de] INFO: Found listing with ID: MA93398
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA93398%27 HTTP/1.1" 200 None
2026-03-27 10:37:54 [auto1.de] INFO: Scrape type for MA93398: 1
2026-03-27 10:37:54 [auto1.de] INFO: Found listing with ID: TU49821
2026-03-27 10:37:54 [auto1.de] INFO: Found listing with ID: CG74532
2026-03-27 10:37:54 [auto1.de] INFO: Found listing with ID: DF30572
2026-03-27 10:37:54 [auto1.de] INFO: Found listing with ID: CH55650
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH55650%27 HTTP/1.1" 200 None
2026-03-27 10:37:54 [auto1.de] INFO: Scrape type for CH55650: 1
2026-03-27 10:37:54 [auto1.de] INFO: Found listing with ID: CK07133
2026-03-27 10:37:54 [auto1.de] INFO: Found listing with ID: TX89120
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX89120%27 HTTP/1.1" 200 None
2026-03-27 10:37:54 [auto1.de] INFO: Scrape type for TX89120: 1
2026-03-27 10:37:54 [auto1.de] INFO: Found listing with ID: XH18940
2026-03-27 10:37:54 [auto1.de] INFO: Found listing with ID: YS81106
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81106%27 HTTP/1.1" 200 None
2026-03-27 10:37:54 [auto1.de] INFO: Scrape type for YS81106: 1
2026-03-27 10:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE79625/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ15565> (referer: https://www.auto1.com/v1/car-details-view/VZ15565/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab with identifier: VZ15565
2026-03-27 10:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab with scrape type 1
2026-03-27 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F3f%252Fce3f4b1028cc87a9f9777e8a52c929e5%252Fpa%252FVZ15565_42ebc99307679f423e0757409633edbc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_42ebc99307679f423e0757409633edbc.jpg not downloaded yet
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F3f%252Fce3f4b1028cc87a9f9777e8a52c929e5%252Fpa%252FVZ15565_365106dd6a2046156506b4f50764d87c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_365106dd6a2046156506b4f50764d87c.jpg not downloaded yet
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F3f%252Fce3f4b1028cc87a9f9777e8a52c929e5%252Fpa%252FVZ15565_191c83384ecfe687039c59434e5449ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_191c83384ecfe687039c59434e5449ed.jpg not downloaded yet
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F3f%252Fce3f4b1028cc87a9f9777e8a52c929e5%252Fpa%252FVZ15565_d5e6560d6b0db866442f9346fa9c37aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_d5e6560d6b0db866442f9346fa9c37aa.jpg not downloaded yet
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F3f%252Fce3f4b1028cc87a9f9777e8a52c929e5%252Fpa%252FVZ15565_994c4d3d602f6bc9a29e943a7be6abc3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_994c4d3d602f6bc9a29e943a7be6abc3.jpg not downloaded yet
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F3f%252Fce3f4b1028cc87a9f9777e8a52c929e5%252Fpa%252FVZ15565_729a7904bc8db41981150c66accbbde3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_729a7904bc8db41981150c66accbbde3.jpg not downloaded yet
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F3f%252Fce3f4b1028cc87a9f9777e8a52c929e5%252Fpa%252FVZ15565_07fd25036324ba5997098d5ff4dcfcfe.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_07fd25036324ba5997098d5ff4dcfcfe.jpg not downloaded yet
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F3f%252Fce3f4b1028cc87a9f9777e8a52c929e5%252Fpa%252FVZ15565_60bd58e019d4014deb53a49fb07ec214.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_60bd58e019d4014deb53a49fb07ec214.jpg not downloaded yet
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F3f%252Fce3f4b1028cc87a9f9777e8a52c929e5%252Fpa%252FVZ15565_2dc8b295613d927f23c3a796e91d2c0b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_2dc8b295613d927f23c3a796e91d2c0b.jpg not downloaded yet
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F3f%252Fce3f4b1028cc87a9f9777e8a52c929e5%252Fpa%252FVZ15565_ae3708e7e0e103042be3629285c78bc2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_ae3708e7e0e103042be3629285c78bc2.jpg not downloaded yet
2026-03-27 10:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VX15127/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_ae3708e7e0e103042be3629285c78bc2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:37:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016dd410>
2026-03-27 10:37:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab/abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F3f%252Fce3f4b1028cc87a9f9777e8a52c929e5%252Fpa%252FVZ15565_ae3708e7e0e103042be3629285c78bc2.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_ae3708e7e0e103042be3629285c78bc2.jpg saved to cache
2026-03-27 10:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab
2026-03-27 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP48554/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_2dc8b295613d927f23c3a796e91d2c0b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50163a550>
2026-03-27 10:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab/abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F3f%252Fce3f4b1028cc87a9f9777e8a52c929e5%252Fpa%252FVZ15565_2dc8b295613d927f23c3a796e91d2c0b.jpg') HTTP/1.1" 204 0
2026-03-27 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_2dc8b295613d927f23c3a796e91d2c0b.jpg saved to cache
2026-03-27 10:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab
2026-03-27 10:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MK03700/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:37:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_60bd58e019d4014deb53a49fb07ec214.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018acdd0>
2026-03-27 10:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab/abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F3f%252Fce3f4b1028cc87a9f9777e8a52c929e5%252Fpa%252FVZ15565_60bd58e019d4014deb53a49fb07ec214.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_60bd58e019d4014deb53a49fb07ec214.jpg saved to cache
2026-03-27 10:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab
2026-03-27 10:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ93554/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WN28352> (referer: https://www.auto1.com/v1/car-details-view/WN28352/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_07fd25036324ba5997098d5ff4dcfcfe.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e54fa90-1f36-582e-8fcb-d49035d1a9d9 with identifier: WN28352
2026-03-27 10:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e54fa90-1f36-582e-8fcb-d49035d1a9d9 with scrape type 1
2026-03-27 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8e54fa90-1f36-582e-8fcb-d49035d1a9d9
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F24%252Ffa24d61c152177615cce53b019491d07%252Fpa%252FWN28352_490598d6510957d7739f1a7f8a586248.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_490598d6510957d7739f1a7f8a586248.jpg not downloaded yet
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F24%252Ffa24d61c152177615cce53b019491d07%252Fpa%252FWN28352_04ab94aa32b5b2a31769c51b89dd8755.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_04ab94aa32b5b2a31769c51b89dd8755.jpg not downloaded yet
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F24%252Ffa24d61c152177615cce53b019491d07%252Fpa%252FWN28352_77f84645b55999c9523d84cca1bff743.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_77f84645b55999c9523d84cca1bff743.jpg not downloaded yet
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F24%252Ffa24d61c152177615cce53b019491d07%252Fpa%252FWN28352_182019fb12cc3e8a28a9968ea23d0cb9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_182019fb12cc3e8a28a9968ea23d0cb9.jpg not downloaded yet
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F24%252Ffa24d61c152177615cce53b019491d07%252Fpa%252FWN28352_19659fca115c5463e1f81918adf0d06a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_19659fca115c5463e1f81918adf0d06a.jpg not downloaded yet
2026-03-27 10:38:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501638fd0>
2026-03-27 10:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab/abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F3f%252Fce3f4b1028cc87a9f9777e8a52c929e5%252Fpa%252FVZ15565_07fd25036324ba5997098d5ff4dcfcfe.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_07fd25036324ba5997098d5ff4dcfcfe.jpg saved to cache
2026-03-27 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F24%252Ffa24d61c152177615cce53b019491d07%252Fpa%252FWN28352_9c09d36b24a5ab2e347826a4a9c52d68.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_9c09d36b24a5ab2e347826a4a9c52d68.jpg not downloaded yet
2026-03-27 10:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_729a7904bc8db41981150c66accbbde3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c6bd0>
2026-03-27 10:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab/abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F3f%252Fce3f4b1028cc87a9f9777e8a52c929e5%252Fpa%252FVZ15565_729a7904bc8db41981150c66accbbde3.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_729a7904bc8db41981150c66accbbde3.jpg saved to cache
2026-03-27 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab
2026-03-27 10:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_9c09d36b24a5ab2e347826a4a9c52d68.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_19659fca115c5463e1f81918adf0d06a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501638850>
2026-03-27 10:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e54fa90-1f36-582e-8fcb-d49035d1a9d9/8e54fa90-1f36-582e-8fcb-d49035d1a9d9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F24%252Ffa24d61c152177615cce53b019491d07%252Fpa%252FWN28352_9c09d36b24a5ab2e347826a4a9c52d68.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_9c09d36b24a5ab2e347826a4a9c52d68.jpg saved to cache
2026-03-27 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e54fa90-1f36-582e-8fcb-d49035d1a9d9
2026-03-27 10:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_182019fb12cc3e8a28a9968ea23d0cb9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50032fb90>
2026-03-27 10:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e54fa90-1f36-582e-8fcb-d49035d1a9d9/8e54fa90-1f36-582e-8fcb-d49035d1a9d9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F24%252Ffa24d61c152177615cce53b019491d07%252Fpa%252FWN28352_19659fca115c5463e1f81918adf0d06a.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_19659fca115c5463e1f81918adf0d06a.jpg saved to cache
2026-03-27 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e54fa90-1f36-582e-8fcb-d49035d1a9d9
2026-03-27 10:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_77f84645b55999c9523d84cca1bff743.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500321c10>
2026-03-27 10:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e54fa90-1f36-582e-8fcb-d49035d1a9d9/8e54fa90-1f36-582e-8fcb-d49035d1a9d9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F24%252Ffa24d61c152177615cce53b019491d07%252Fpa%252FWN28352_182019fb12cc3e8a28a9968ea23d0cb9.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_182019fb12cc3e8a28a9968ea23d0cb9.jpg saved to cache
2026-03-27 10:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e54fa90-1f36-582e-8fcb-d49035d1a9d9
2026-03-27 10:38:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50059d410>
2026-03-27 10:38:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e54fa90-1f36-582e-8fcb-d49035d1a9d9/8e54fa90-1f36-582e-8fcb-d49035d1a9d9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F24%252Ffa24d61c152177615cce53b019491d07%252Fpa%252FWN28352_77f84645b55999c9523d84cca1bff743.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_77f84645b55999c9523d84cca1bff743.jpg saved to cache
2026-03-27 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e54fa90-1f36-582e-8fcb-d49035d1a9d9
2026-03-27 10:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_04ab94aa32b5b2a31769c51b89dd8755.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_490598d6510957d7739f1a7f8a586248.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50163a590>
2026-03-27 10:38:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e54fa90-1f36-582e-8fcb-d49035d1a9d9/8e54fa90-1f36-582e-8fcb-d49035d1a9d9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F24%252Ffa24d61c152177615cce53b019491d07%252Fpa%252FWN28352_04ab94aa32b5b2a31769c51b89dd8755.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_04ab94aa32b5b2a31769c51b89dd8755.jpg saved to cache
2026-03-27 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e54fa90-1f36-582e-8fcb-d49035d1a9d9
2026-03-27 10:38:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50171e1d0>
2026-03-27 10:38:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e54fa90-1f36-582e-8fcb-d49035d1a9d9/8e54fa90-1f36-582e-8fcb-d49035d1a9d9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F24%252Ffa24d61c152177615cce53b019491d07%252Fpa%252FWN28352_490598d6510957d7739f1a7f8a586248.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_490598d6510957d7739f1a7f8a586248.jpg saved to cache
2026-03-27 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e54fa90-1f36-582e-8fcb-d49035d1a9d9
2026-03-27 10:38:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e54fa90-1f36-582e-8fcb-d49035d1a9d9, skipping ID generation
2026-03-27 10:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e54fa90-1f36-582e-8fcb-d49035d1a9d9 with scrape type 1
2026-03-27 10:38:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e54fa90-1f36-582e-8fcb-d49035d1a9d9 sending to next pipeline
2026-03-27 10:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e54fa90-1f36-582e-8fcb-d49035d1a9d9, identifier: WN28352
2026-03-27 10:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e54fa90-1f36-582e-8fcb-d49035d1a9d9 with identifier: WN28352
2026-03-27 10:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e54fa90-1f36-582e-8fcb-d49035d1a9d9 with identifier: WN28352
2026-03-27 10:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e54fa90-1f36-582e-8fcb-d49035d1a9d9 with identifier: WN28352 to the API
2026-03-27 10:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_490598d6510957d7739f1a7f8a586248.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 3',
 'engine': '1.4L',
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:35:10Z',
 'fuel_type': 'petrol',
 'id': '8e54fa90-1f36-582e-8fcb-d49035d1a9d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN28352',
 'listing': 'auction',
 'location': 'DE, Leipzig',
 'make': 'Citroen',
 'model': 'C2',
 'odometer': 112687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e54fa90-1f36-582e-8fcb-d49035d1a9d9/8e54fa90-1f36-582e-8fcb-d49035d1a9d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_490598d6510957d7739f1a7f8a586248.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e54fa90-1f36-582e-8fcb-d49035d1a9d9/8e54fa90-1f36-582e-8fcb-d49035d1a9d9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_04ab94aa32b5b2a31769c51b89dd8755.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e54fa90-1f36-582e-8fcb-d49035d1a9d9/8e54fa90-1f36-582e-8fcb-d49035d1a9d9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_77f84645b55999c9523d84cca1bff743.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e54fa90-1f36-582e-8fcb-d49035d1a9d9/8e54fa90-1f36-582e-8fcb-d49035d1a9d9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_182019fb12cc3e8a28a9968ea23d0cb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e54fa90-1f36-582e-8fcb-d49035d1a9d9/8e54fa90-1f36-582e-8fcb-d49035d1a9d9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_19659fca115c5463e1f81918adf0d06a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e54fa90-1f36-582e-8fcb-d49035d1a9d9/8e54fa90-1f36-582e-8fcb-d49035d1a9d9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/24/fa24d61c152177615cce53b019491d07/pa/WN28352_9c09d36b24a5ab2e347826a4a9c52d68.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-10-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Citroen C2 1.4 VSX',
 'transmission': 'manual',
 'trim': 'VSX',
 'year': 2004}
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN28352%27 HTTP/1.1" 200 None
2026-03-27 10:38:03 [auto1.de] INFO: Saving data for WN28352: {'created_time': 1774607883.158682, 'last_price_update_time': 1774607883.158693, 'auction_closing_time': 1774715710.0}
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN28352') HTTP/1.1" 204 0
2026-03-27 10:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YT12990/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_994c4d3d602f6bc9a29e943a7be6abc3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:03 [auto1.de] INFO: Channel: 24h | Page: 10 | totalHits: 10505 | hits on page: 40
2026-03-27 10:38:03 [auto1.de] INFO: Found listing with ID: TX89120
2026-03-27 10:38:03 [auto1.de] INFO: Found listing with ID: XH18940
2026-03-27 10:38:03 [auto1.de] INFO: Found listing with ID: YS81106
2026-03-27 10:38:03 [auto1.de] INFO: Found listing with ID: AK08323
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK08323%27 HTTP/1.1" 200 None
2026-03-27 10:38:03 [auto1.de] INFO: Scrape type for AK08323: 2
2026-03-27 10:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45c276a8-99d1-5247-aa38-db4ac122d928 with identifier: AK08323
2026-03-27 10:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45c276a8-99d1-5247-aa38-db4ac122d928 with scrape type 2
2026-03-27 10:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45c276a8-99d1-5247-aa38-db4ac122d928 with scrape type 2
2026-03-27 10:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45c276a8-99d1-5247-aa38-db4ac122d928, identifier: AK08323
2026-03-27 10:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45c276a8-99d1-5247-aa38-db4ac122d928 with identifier: AK08323
2026-03-27 10:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45c276a8-99d1-5247-aa38-db4ac122d928 with identifier: AK08323
2026-03-27 10:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45c276a8-99d1-5247-aa38-db4ac122d928 with identifier: AK08323 to the API
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-28T16:26:34Z',
 'fuel_type': 'petrol',
 'id': '45c276a8-99d1-5247-aa38-db4ac122d928',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK08323',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 76182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-12',
 'seller_name': None,
 'title': 'Jaguar E-Pace P250 R-Dynamic HSE AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic HSE AWD',
 'year': 2018}
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK08323%27 HTTP/1.1" 200 None
2026-03-27 10:38:03 [auto1.de] INFO: Saving data for AK08323: {'auction_closing_time': 1774715194.0, 'created_time': 1773984975.644639, 'last_price_update_time': 1774607883.950002}
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK08323') HTTP/1.1" 204 0
2026-03-27 10:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_d5e6560d6b0db866442f9346fa9c37aa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:03 [auto1.de] INFO: Found listing with ID: BE25239
2026-03-27 10:38:03 [auto1.de] INFO: Found listing with ID: JN21638
2026-03-27 10:38:03 [auto1.de] INFO: Found listing with ID: XY47977
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY47977%27 HTTP/1.1" 200 None
2026-03-27 10:38:03 [auto1.de] INFO: Scrape type for XY47977: 1
2026-03-27 10:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_191c83384ecfe687039c59434e5449ed.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:04 [auto1.de] INFO: Found listing with ID: HL08327
2026-03-27 10:38:04 [auto1.de] INFO: Found listing with ID: PS35101
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS35101%27 HTTP/1.1" 200 None
2026-03-27 10:38:04 [auto1.de] INFO: Scrape type for PS35101: 2
2026-03-27 10:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e235fbb-29c6-5be6-8d72-1511d219f418 with identifier: PS35101
2026-03-27 10:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e235fbb-29c6-5be6-8d72-1511d219f418 with scrape type 2
2026-03-27 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e235fbb-29c6-5be6-8d72-1511d219f418 with scrape type 2
2026-03-27 10:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e235fbb-29c6-5be6-8d72-1511d219f418, identifier: PS35101
2026-03-27 10:38:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501638410>
2026-03-27 10:38:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab/abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F3f%252Fce3f4b1028cc87a9f9777e8a52c929e5%252Fpa%252FVZ15565_994c4d3d602f6bc9a29e943a7be6abc3.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_994c4d3d602f6bc9a29e943a7be6abc3.jpg saved to cache
2026-03-27 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab
2026-03-27 10:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e235fbb-29c6-5be6-8d72-1511d219f418 with identifier: PS35101
2026-03-27 10:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e235fbb-29c6-5be6-8d72-1511d219f418 with identifier: PS35101
2026-03-27 10:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e235fbb-29c6-5be6-8d72-1511d219f418 with identifier: PS35101 to the API
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:28:38Z',
 'fuel_type': 'petrol',
 'id': '2e235fbb-29c6-5be6-8d72-1511d219f418',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS35101',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 51116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-13',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.2 TSI Cup',
 'transmission': 'automatic',
 'trim': 'Cup',
 'year': 2015}
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS35101%27 HTTP/1.1" 200 None
2026-03-27 10:38:04 [auto1.de] INFO: Saving data for PS35101: {'auction_closing_time': 1774715318.0, 'created_time': 1773341586.502563, 'last_price_update_time': 1774607884.666845}
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS35101') HTTP/1.1" 204 0
2026-03-27 10:38:04 [auto1.de] INFO: Found listing with ID: NC46979
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC46979%27 HTTP/1.1" 200 None
2026-03-27 10:38:04 [auto1.de] INFO: Scrape type for NC46979: 2
2026-03-27 10:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bdd9516-2c72-501c-91fb-f10500fbcd1e with identifier: NC46979
2026-03-27 10:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bdd9516-2c72-501c-91fb-f10500fbcd1e with scrape type 2
2026-03-27 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bdd9516-2c72-501c-91fb-f10500fbcd1e with scrape type 2
2026-03-27 10:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bdd9516-2c72-501c-91fb-f10500fbcd1e, identifier: NC46979
2026-03-27 10:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bdd9516-2c72-501c-91fb-f10500fbcd1e with identifier: NC46979
2026-03-27 10:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bdd9516-2c72-501c-91fb-f10500fbcd1e with identifier: NC46979
2026-03-27 10:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bdd9516-2c72-501c-91fb-f10500fbcd1e with identifier: NC46979 to the API
2026-03-27 10:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:24:46Z',
 'fuel_type': 'diesel',
 'id': '4bdd9516-2c72-501c-91fb-f10500fbcd1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC46979',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon Shooting Brake',
 'odometer': 125285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-13',
 'seller_name': None,
 'title': 'Volkswagen Arteon Shooting Brake 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC46979%27 HTTP/1.1" 200 None
2026-03-27 10:38:05 [auto1.de] INFO: Saving data for NC46979: {'auction_closing_time': 1774715086.0, 'created_time': 1773383627.538955, 'last_price_update_time': 1774607885.211653}
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC46979') HTTP/1.1" 204 0
2026-03-27 10:38:05 [auto1.de] INFO: Found listing with ID: SB81454
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB81454%27 HTTP/1.1" 200 None
2026-03-27 10:38:05 [auto1.de] INFO: Scrape type for SB81454: 2
2026-03-27 10:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faa22120-cf3a-51f8-b850-1de84f4d2282 with identifier: SB81454
2026-03-27 10:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faa22120-cf3a-51f8-b850-1de84f4d2282 with scrape type 2
2026-03-27 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faa22120-cf3a-51f8-b850-1de84f4d2282 with scrape type 2
2026-03-27 10:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: faa22120-cf3a-51f8-b850-1de84f4d2282, identifier: SB81454
2026-03-27 10:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: faa22120-cf3a-51f8-b850-1de84f4d2282 with identifier: SB81454
2026-03-27 10:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: faa22120-cf3a-51f8-b850-1de84f4d2282 with identifier: SB81454
2026-03-27 10:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: faa22120-cf3a-51f8-b850-1de84f4d2282 with identifier: SB81454 to the API
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:03:20Z',
 'fuel_type': 'diesel',
 'id': 'faa22120-cf3a-51f8-b850-1de84f4d2282',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB81454',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 99844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-13',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2010}
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB81454%27 HTTP/1.1" 200 None
2026-03-27 10:38:05 [auto1.de] INFO: Saving data for SB81454: {'auction_closing_time': 1774713800.0, 'created_time': 1773946316.304271, 'last_price_update_time': 1774607885.697459}
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB81454') HTTP/1.1" 204 0
2026-03-27 10:38:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50058b290>
2026-03-27 10:38:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab/abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F3f%252Fce3f4b1028cc87a9f9777e8a52c929e5%252Fpa%252FVZ15565_d5e6560d6b0db866442f9346fa9c37aa.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_d5e6560d6b0db866442f9346fa9c37aa.jpg saved to cache
2026-03-27 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab
2026-03-27 10:38:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500399ad0>
2026-03-27 10:38:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab/abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F3f%252Fce3f4b1028cc87a9f9777e8a52c929e5%252Fpa%252FVZ15565_191c83384ecfe687039c59434e5449ed.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_191c83384ecfe687039c59434e5449ed.jpg saved to cache
2026-03-27 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab
2026-03-27 10:38:05 [auto1.de] INFO: Found listing with ID: GE16553
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16553%27 HTTP/1.1" 200 None
2026-03-27 10:38:05 [auto1.de] INFO: Scrape type for GE16553: 1
2026-03-27 10:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM85601> (referer: https://www.auto1.com/v1/car-details-view/LM85601/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:05 [auto1.de] INFO: Found listing with ID: PM23375
2026-03-27 10:38:05 [auto1.de] INFO: Found listing with ID: UZ37067
2026-03-27 10:38:05 [auto1.de] INFO: Found listing with ID: WY87564
2026-03-27 10:38:05 [auto1.de] INFO: Found listing with ID: SC06812
2026-03-27 10:38:05 [auto1.de] INFO: Found listing with ID: YF78558
2026-03-27 10:38:05 [auto1.de] INFO: Found listing with ID: LA14502
2026-03-27 10:38:05 [auto1.de] INFO: Found listing with ID: ZR01639
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR01639%27 HTTP/1.1" 200 None
2026-03-27 10:38:05 [auto1.de] INFO: Scrape type for ZR01639: 2
2026-03-27 10:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ca74376-76c1-5ed1-94ff-614a861ec9b5 with identifier: ZR01639
2026-03-27 10:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ca74376-76c1-5ed1-94ff-614a861ec9b5 with scrape type 2
2026-03-27 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ca74376-76c1-5ed1-94ff-614a861ec9b5 with scrape type 2
2026-03-27 10:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ca74376-76c1-5ed1-94ff-614a861ec9b5, identifier: ZR01639
2026-03-27 10:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ca74376-76c1-5ed1-94ff-614a861ec9b5 with identifier: ZR01639
2026-03-27 10:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ca74376-76c1-5ed1-94ff-614a861ec9b5 with identifier: ZR01639
2026-03-27 10:38:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ca74376-76c1-5ed1-94ff-614a861ec9b5 with identifier: ZR01639 to the API
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:26:53Z',
 'fuel_type': 'petrol',
 'id': '8ca74376-76c1-5ed1-94ff-614a861ec9b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR01639',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 56795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-12',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT United',
 'transmission': 'automatic',
 'trim': 'United',
 'year': 2021}
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR01639%27 HTTP/1.1" 200 None
2026-03-27 10:38:06 [auto1.de] INFO: Saving data for ZR01639: {'auction_closing_time': 1774715213.0, 'created_time': 1773428974.29145, 'last_price_update_time': 1774607886.280831}
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR01639') HTTP/1.1" 204 0
2026-03-27 10:38:06 [auto1.de] INFO: Found listing with ID: GC05156
2026-03-27 10:38:06 [auto1.de] INFO: Found listing with ID: GT57416
2026-03-27 10:38:06 [auto1.de] INFO: Found listing with ID: ZP29614
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP29614%27 HTTP/1.1" 200 None
2026-03-27 10:38:06 [auto1.de] INFO: Scrape type for ZP29614: 1
2026-03-27 10:38:06 [auto1.de] INFO: Found listing with ID: XU86679
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU86679%27 HTTP/1.1" 200 None
2026-03-27 10:38:06 [auto1.de] INFO: Scrape type for XU86679: 2
2026-03-27 10:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc48c99e-4337-579d-8523-cf9e36237100 with identifier: XU86679
2026-03-27 10:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc48c99e-4337-579d-8523-cf9e36237100 with scrape type 2
2026-03-27 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc48c99e-4337-579d-8523-cf9e36237100 with scrape type 2
2026-03-27 10:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc48c99e-4337-579d-8523-cf9e36237100, identifier: XU86679
2026-03-27 10:38:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc48c99e-4337-579d-8523-cf9e36237100 with identifier: XU86679
2026-03-27 10:38:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc48c99e-4337-579d-8523-cf9e36237100 with identifier: XU86679
2026-03-27 10:38:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc48c99e-4337-579d-8523-cf9e36237100 with identifier: XU86679 to the API
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:26:03Z',
 'fuel_type': 'petrol',
 'id': 'cc48c99e-4337-579d-8523-cf9e36237100',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU86679',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 52202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-26',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2022}
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU86679%27 HTTP/1.1" 200 None
2026-03-27 10:38:06 [auto1.de] INFO: Saving data for XU86679: {'auction_closing_time': 1774715163.0, 'created_time': 1773344426.681026, 'last_price_update_time': 1774607886.928986}
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU86679') HTTP/1.1" 204 0
2026-03-27 10:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7d60d65-98ae-59b3-9e5b-c52df001aa14 with identifier: LM85601
2026-03-27 10:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7d60d65-98ae-59b3-9e5b-c52df001aa14 with scrape type 1
2026-03-27 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7d60d65-98ae-59b3-9e5b-c52df001aa14
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd0%252F56d018ca9ee4da5cc3b0a48f71991d19%252Fpa%252FLM85601_e9daf421ab1eef38c706446c85695416.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_e9daf421ab1eef38c706446c85695416.jpg not downloaded yet
2026-03-27 10:38:06 [auto1.de] INFO: Found listing with ID: EX22671
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX22671%27 HTTP/1.1" 200 None
2026-03-27 10:38:06 [auto1.de] INFO: Scrape type for EX22671: 1
2026-03-27 10:38:06 [scrapy.extensions.logstats] INFO: Crawled 168 pages (at 55 pages/min), scraped 93 items (at 40 items/min)
2026-03-27 10:38:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd0%252F56d018ca9ee4da5cc3b0a48f71991d19%252Fpa%252FLM85601_985e37690ced3f94bc0b1b64f4cf3f69.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_985e37690ced3f94bc0b1b64f4cf3f69.jpg not downloaded yet
2026-03-27 10:38:06 [auto1.de] INFO: Found listing with ID: UH40808
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH40808%27 HTTP/1.1" 200 None
2026-03-27 10:38:07 [auto1.de] INFO: Scrape type for UH40808: 1
2026-03-27 10:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS81106/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd0%252F56d018ca9ee4da5cc3b0a48f71991d19%252Fpa%252FLM85601_46e3277941db1c83a6ce979b4e0f7420.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_46e3277941db1c83a6ce979b4e0f7420.jpg not downloaded yet
2026-03-27 10:38:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:07 [auto1.de] INFO: Found listing with ID: EJ47676
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47676%27 HTTP/1.1" 200 None
2026-03-27 10:38:07 [auto1.de] INFO: Scrape type for EJ47676: 2
2026-03-27 10:38:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19d2bdcf-827a-5a9d-82e6-277e49db4bcc with identifier: EJ47676
2026-03-27 10:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19d2bdcf-827a-5a9d-82e6-277e49db4bcc with scrape type 2
2026-03-27 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19d2bdcf-827a-5a9d-82e6-277e49db4bcc with scrape type 2
2026-03-27 10:38:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19d2bdcf-827a-5a9d-82e6-277e49db4bcc, identifier: EJ47676
2026-03-27 10:38:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19d2bdcf-827a-5a9d-82e6-277e49db4bcc with identifier: EJ47676
2026-03-27 10:38:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19d2bdcf-827a-5a9d-82e6-277e49db4bcc with identifier: EJ47676
2026-03-27 10:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19d2bdcf-827a-5a9d-82e6-277e49db4bcc with identifier: EJ47676 to the API
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:52:05Z',
 'fuel_type': 'diesel',
 'id': '19d2bdcf-827a-5a9d-82e6-277e49db4bcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ47676',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 159800,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-01',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2015}
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47676%27 HTTP/1.1" 200 None
2026-03-27 10:38:07 [auto1.de] INFO: Saving data for EJ47676: {'auction_closing_time': 1774716725.0, 'created_time': 1773227164.060533, 'last_price_update_time': 1774607887.500938}
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ47676') HTTP/1.1" 204 0
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd0%252F56d018ca9ee4da5cc3b0a48f71991d19%252Fpa%252FLM85601_0757a468b831ea8a8261d51b3e849b3f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_0757a468b831ea8a8261d51b3e849b3f.jpg not downloaded yet
2026-03-27 10:38:07 [auto1.de] INFO: Found listing with ID: ZE17013
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE17013%27 HTTP/1.1" 200 None
2026-03-27 10:38:07 [auto1.de] INFO: Scrape type for ZE17013: 1
2026-03-27 10:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_985e37690ced3f94bc0b1b64f4cf3f69.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd0%252F56d018ca9ee4da5cc3b0a48f71991d19%252Fpa%252FLM85601_d365eafab82486c7787686197c4d2205.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_d365eafab82486c7787686197c4d2205.jpg not downloaded yet
2026-03-27 10:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY13521> (referer: https://www.auto1.com/v1/car-details-view/YY13521/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:07 [auto1.de] INFO: Found listing with ID: FR92717
2026-03-27 10:38:07 [auto1.de] INFO: Found listing with ID: TA25367
2026-03-27 10:38:07 [auto1.de] INFO: Found listing with ID: RN18911
2026-03-27 10:38:07 [auto1.de] INFO: Found listing with ID: DF38507
2026-03-27 10:38:07 [auto1.de] INFO: Found listing with ID: KE92828
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE92828%27 HTTP/1.1" 200 None
2026-03-27 10:38:07 [auto1.de] INFO: Scrape type for KE92828: 2
2026-03-27 10:38:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bdb6f17-9819-5f37-b37a-257715535bca with identifier: KE92828
2026-03-27 10:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bdb6f17-9819-5f37-b37a-257715535bca with scrape type 2
2026-03-27 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bdb6f17-9819-5f37-b37a-257715535bca with scrape type 2
2026-03-27 10:38:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bdb6f17-9819-5f37-b37a-257715535bca, identifier: KE92828
2026-03-27 10:38:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bdb6f17-9819-5f37-b37a-257715535bca with identifier: KE92828
2026-03-27 10:38:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bdb6f17-9819-5f37-b37a-257715535bca with identifier: KE92828
2026-03-27 10:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bdb6f17-9819-5f37-b37a-257715535bca with identifier: KE92828 to the API
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:44:53Z',
 'fuel_type': 'petrol',
 'id': '3bdb6f17-9819-5f37-b37a-257715535bca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE92828',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 81290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-28',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Celebration 4x2',
 'transmission': 'manual',
 'trim': 'Celebration 4x2',
 'year': 2015}
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE92828%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [auto1.de] INFO: Saving data for KE92828: {'auction_closing_time': 1774716293.0, 'created_time': 1773946615.33707, 'last_price_update_time': 1774607888.07264}
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE92828') HTTP/1.1" 204 0
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd0%252F56d018ca9ee4da5cc3b0a48f71991d19%252Fpa%252FLM85601_59c75c1aec93f29d27d9469b7cc7d0c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_59c75c1aec93f29d27d9469b7cc7d0c2.jpg not downloaded yet
2026-03-27 10:38:08 [auto1.de] INFO: Found listing with ID: SC10304
2026-03-27 10:38:08 [auto1.de] INFO: Found listing with ID: GM45973
2026-03-27 10:38:08 [auto1.de] INFO: Found listing with ID: YM57013
2026-03-27 10:38:08 [auto1.de] INFO: Found listing with ID: BR67018
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR67018%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [auto1.de] INFO: Scrape type for BR67018: 1
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd0%252F56d018ca9ee4da5cc3b0a48f71991d19%252Fpa%252FLM85601_8996ba8505d4994bd570eff84b80e0ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_8996ba8505d4994bd570eff84b80e0ef.jpg not downloaded yet
2026-03-27 10:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501865ad0>
2026-03-27 10:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d60d65-98ae-59b3-9e5b-c52df001aa14/b7d60d65-98ae-59b3-9e5b-c52df001aa14_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd0%252F56d018ca9ee4da5cc3b0a48f71991d19%252Fpa%252FLM85601_985e37690ced3f94bc0b1b64f4cf3f69.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_985e37690ced3f94bc0b1b64f4cf3f69.jpg saved to cache
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7d60d65-98ae-59b3-9e5b-c52df001aa14
2026-03-27 10:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d90399d-4d6a-5ce4-9639-e6435a8cb023 with identifier: YY13521
2026-03-27 10:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d90399d-4d6a-5ce4-9639-e6435a8cb023 with scrape type 1
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d90399d-4d6a-5ce4-9639-e6435a8cb023
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75103145ccaf212cd2316ebeed9bd9%252Fpa%252FYY13521_c165e4265edb86d9dcd796c4042b2452.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_c165e4265edb86d9dcd796c4042b2452.jpg not downloaded yet
2026-03-27 10:38:08 [auto1.de] INFO: Found listing with ID: EA75512
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA75512%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [auto1.de] INFO: Scrape type for EA75512: 1
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd0%252F56d018ca9ee4da5cc3b0a48f71991d19%252Fpa%252FLM85601_d4714a731bc62fb9ccc5ee557b8cd9b7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_d4714a731bc62fb9ccc5ee557b8cd9b7.jpg not downloaded yet
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75103145ccaf212cd2316ebeed9bd9%252Fpa%252FYY13521_f928be7a64e9f8f3cd62ef0685c2aa7e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_f928be7a64e9f8f3cd62ef0685c2aa7e.jpg not downloaded yet
2026-03-27 10:38:08 [auto1.de] INFO: Found listing with ID: VF83806
2026-03-27 10:38:08 [auto1.de] INFO: Found listing with ID: SU14525
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU14525%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [auto1.de] INFO: Scrape type for SU14525: 1
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd0%252F56d018ca9ee4da5cc3b0a48f71991d19%252Fpa%252FLM85601_116eb1ce41fb59f121612eaf4806cb1b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_116eb1ce41fb59f121612eaf4806cb1b.jpg not downloaded yet
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75103145ccaf212cd2316ebeed9bd9%252Fpa%252FYY13521_af4daa5fe632a6ceb330a11664a77ef6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_af4daa5fe632a6ceb330a11664a77ef6.jpg not downloaded yet
2026-03-27 10:38:08 [auto1.de] INFO: Found listing with ID: AR33954
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd0%252F56d018ca9ee4da5cc3b0a48f71991d19%252Fpa%252FLM85601_b21e3c2fe45708b0c705a86fa53a4407.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_b21e3c2fe45708b0c705a86fa53a4407.jpg not downloaded yet
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75103145ccaf212cd2316ebeed9bd9%252Fpa%252FYY13521_9ad9dd66ddcfaa99e9a276aba4f1953f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_9ad9dd66ddcfaa99e9a276aba4f1953f.jpg not downloaded yet
2026-03-27 10:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_365106dd6a2046156506b4f50764d87c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75103145ccaf212cd2316ebeed9bd9%252Fpa%252FYY13521_8c6480853d0eb7e0e55ee5281bdeffa2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_8c6480853d0eb7e0e55ee5281bdeffa2.jpg not downloaded yet
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75103145ccaf212cd2316ebeed9bd9%252Fpa%252FYY13521_642ff1f7058f12a6af7069866a40d8b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_642ff1f7058f12a6af7069866a40d8b4.jpg not downloaded yet
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75103145ccaf212cd2316ebeed9bd9%252Fpa%252FYY13521_a95a67c6291fff85357cbb499c489ffa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_a95a67c6291fff85357cbb499c489ffa.jpg not downloaded yet
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75103145ccaf212cd2316ebeed9bd9%252Fpa%252FYY13521_8a9a38113ff86356e7f24de0f129349f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_8a9a38113ff86356e7f24de0f129349f.jpg not downloaded yet
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75103145ccaf212cd2316ebeed9bd9%252Fpa%252FYY13521_15fa4d4f985b6237034da36451a763d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_15fa4d4f985b6237034da36451a763d4.jpg not downloaded yet
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75103145ccaf212cd2316ebeed9bd9%252Fpa%252FYY13521_0df74ad7f07b40238a5fb25cd74cef09.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_0df74ad7f07b40238a5fb25cd74cef09.jpg not downloaded yet
2026-03-27 10:38:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c6ad0>
2026-03-27 10:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab/abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F3f%252Fce3f4b1028cc87a9f9777e8a52c929e5%252Fpa%252FVZ15565_365106dd6a2046156506b4f50764d87c.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_365106dd6a2046156506b4f50764d87c.jpg saved to cache
2026-03-27 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab
2026-03-27 10:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_af4daa5fe632a6ceb330a11664a77ef6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_0757a468b831ea8a8261d51b3e849b3f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50191f1d0>
2026-03-27 10:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d90399d-4d6a-5ce4-9639-e6435a8cb023/8d90399d-4d6a-5ce4-9639-e6435a8cb023_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75103145ccaf212cd2316ebeed9bd9%252Fpa%252FYY13521_af4daa5fe632a6ceb330a11664a77ef6.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_af4daa5fe632a6ceb330a11664a77ef6.jpg saved to cache
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d90399d-4d6a-5ce4-9639-e6435a8cb023
2026-03-27 10:38:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50191fbd0>
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d60d65-98ae-59b3-9e5b-c52df001aa14/b7d60d65-98ae-59b3-9e5b-c52df001aa14_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd0%252F56d018ca9ee4da5cc3b0a48f71991d19%252Fpa%252FLM85601_0757a468b831ea8a8261d51b3e849b3f.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_0757a468b831ea8a8261d51b3e849b3f.jpg saved to cache
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7d60d65-98ae-59b3-9e5b-c52df001aa14
2026-03-27 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_15fa4d4f985b6237034da36451a763d4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP48554> (referer: https://www.auto1.com/v1/car-details-view/KP48554/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500561d90>
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d90399d-4d6a-5ce4-9639-e6435a8cb023/8d90399d-4d6a-5ce4-9639-e6435a8cb023_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75103145ccaf212cd2316ebeed9bd9%252Fpa%252FYY13521_15fa4d4f985b6237034da36451a763d4.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_15fa4d4f985b6237034da36451a763d4.jpg saved to cache
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d90399d-4d6a-5ce4-9639-e6435a8cb023
2026-03-27 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_8a9a38113ff86356e7f24de0f129349f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6 with identifier: KP48554
2026-03-27 10:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6 with scrape type 1
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F7d%252F0c7d5bbe6579bcd832dd9ce633baa26b%252Fpa%252FKP48554_3aeab5ec9d93aca97e833a63658398d3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_3aeab5ec9d93aca97e833a63658398d3.jpg not downloaded yet
2026-03-27 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_a95a67c6291fff85357cbb499c489ffa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F7d%252F0c7d5bbe6579bcd832dd9ce633baa26b%252Fpa%252FKP48554_60a2a4d81fb4d4404f269884cfd5868c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_60a2a4d81fb4d4404f269884cfd5868c.jpg not downloaded yet
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F7d%252F0c7d5bbe6579bcd832dd9ce633baa26b%252Fpa%252FKP48554_90d680a69de74cb7e943a6e425cbd38f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_90d680a69de74cb7e943a6e425cbd38f.jpg not downloaded yet
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F7d%252F0c7d5bbe6579bcd832dd9ce633baa26b%252Fpa%252FKP48554_7500af65e67a34b8792fe7b6fbb57699.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_7500af65e67a34b8792fe7b6fbb57699.jpg not downloaded yet
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F7d%252F0c7d5bbe6579bcd832dd9ce633baa26b%252Fpa%252FKP48554_8bf72ac9cd33be79fb07f1f62f441c4b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_8bf72ac9cd33be79fb07f1f62f441c4b.jpg not downloaded yet
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016fff90>
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d90399d-4d6a-5ce4-9639-e6435a8cb023/8d90399d-4d6a-5ce4-9639-e6435a8cb023_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75103145ccaf212cd2316ebeed9bd9%252Fpa%252FYY13521_8a9a38113ff86356e7f24de0f129349f.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_8a9a38113ff86356e7f24de0f129349f.jpg saved to cache
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d90399d-4d6a-5ce4-9639-e6435a8cb023
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F7d%252F0c7d5bbe6579bcd832dd9ce633baa26b%252Fpa%252FKP48554_02e28e62b36c63e622459069e700fff5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_02e28e62b36c63e622459069e700fff5.jpg not downloaded yet
2026-03-27 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_0df74ad7f07b40238a5fb25cd74cef09.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_3aeab5ec9d93aca97e833a63658398d3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a18d50>
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d90399d-4d6a-5ce4-9639-e6435a8cb023/8d90399d-4d6a-5ce4-9639-e6435a8cb023_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75103145ccaf212cd2316ebeed9bd9%252Fpa%252FYY13521_a95a67c6291fff85357cbb499c489ffa.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_a95a67c6291fff85357cbb499c489ffa.jpg saved to cache
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d90399d-4d6a-5ce4-9639-e6435a8cb023
2026-03-27 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_7500af65e67a34b8792fe7b6fbb57699.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50170c110>
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d90399d-4d6a-5ce4-9639-e6435a8cb023/8d90399d-4d6a-5ce4-9639-e6435a8cb023_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75103145ccaf212cd2316ebeed9bd9%252Fpa%252FYY13521_0df74ad7f07b40238a5fb25cd74cef09.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_0df74ad7f07b40238a5fb25cd74cef09.jpg saved to cache
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d90399d-4d6a-5ce4-9639-e6435a8cb023
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500501f50>
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6/50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F7d%252F0c7d5bbe6579bcd832dd9ce633baa26b%252Fpa%252FKP48554_3aeab5ec9d93aca97e833a63658398d3.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_3aeab5ec9d93aca97e833a63658398d3.jpg saved to cache
2026-03-27 10:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6
2026-03-27 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_02e28e62b36c63e622459069e700fff5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_8bf72ac9cd33be79fb07f1f62f441c4b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a15650>
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6/50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F7d%252F0c7d5bbe6579bcd832dd9ce633baa26b%252Fpa%252FKP48554_7500af65e67a34b8792fe7b6fbb57699.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_7500af65e67a34b8792fe7b6fbb57699.jpg saved to cache
2026-03-27 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501615a50>
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6/50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F7d%252F0c7d5bbe6579bcd832dd9ce633baa26b%252Fpa%252FKP48554_02e28e62b36c63e622459069e700fff5.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_02e28e62b36c63e622459069e700fff5.jpg saved to cache
2026-03-27 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501779250>
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6/50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F7d%252F0c7d5bbe6579bcd832dd9ce633baa26b%252Fpa%252FKP48554_8bf72ac9cd33be79fb07f1f62f441c4b.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_8bf72ac9cd33be79fb07f1f62f441c4b.jpg saved to cache
2026-03-27 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6
2026-03-27 10:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_642ff1f7058f12a6af7069866a40d8b4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_90d680a69de74cb7e943a6e425cbd38f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50261c7d0>
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d90399d-4d6a-5ce4-9639-e6435a8cb023/8d90399d-4d6a-5ce4-9639-e6435a8cb023_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75103145ccaf212cd2316ebeed9bd9%252Fpa%252FYY13521_642ff1f7058f12a6af7069866a40d8b4.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_642ff1f7058f12a6af7069866a40d8b4.jpg saved to cache
2026-03-27 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d90399d-4d6a-5ce4-9639-e6435a8cb023
2026-03-27 10:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_60a2a4d81fb4d4404f269884cfd5868c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019b2a90>
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6/50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F7d%252F0c7d5bbe6579bcd832dd9ce633baa26b%252Fpa%252FKP48554_90d680a69de74cb7e943a6e425cbd38f.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_90d680a69de74cb7e943a6e425cbd38f.jpg saved to cache
2026-03-27 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6
2026-03-27 10:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_9ad9dd66ddcfaa99e9a276aba4f1953f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_b21e3c2fe45708b0c705a86fa53a4407.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a16dd0>
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6/50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F7d%252F0c7d5bbe6579bcd832dd9ce633baa26b%252Fpa%252FKP48554_60a2a4d81fb4d4404f269884cfd5868c.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_60a2a4d81fb4d4404f269884cfd5868c.jpg saved to cache
2026-03-27 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6
2026-03-27 10:38:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6, skipping ID generation
2026-03-27 10:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6 with scrape type 1
2026-03-27 10:38:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6 sending to next pipeline
2026-03-27 10:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6, identifier: KP48554
2026-03-27 10:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6 with identifier: KP48554
2026-03-27 10:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6 with identifier: KP48554
2026-03-27 10:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6 with identifier: KP48554 to the API
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_60a2a4d81fb4d4404f269884cfd5868c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': 'Rental',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:50:37Z',
 'fuel_type': 'diesel',
 'id': '50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP48554',
 'listing': 'auction',
 'location': 'DE, Bonn',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 201949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6/50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_3aeab5ec9d93aca97e833a63658398d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6/50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_60a2a4d81fb4d4404f269884cfd5868c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6/50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_90d680a69de74cb7e943a6e425cbd38f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6/50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_7500af65e67a34b8792fe7b6fbb57699.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6/50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_8bf72ac9cd33be79fb07f1f62f441c4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6/50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/7d/0c7d5bbe6579bcd832dd9ce633baa26b/pa/KP48554_02e28e62b36c63e622459069e700fff5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2011}
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP48554%27 HTTP/1.1" 200 None
2026-03-27 10:38:11 [auto1.de] INFO: Saving data for KP48554: {'created_time': 1774607891.335144, 'last_price_update_time': 1774607891.335155, 'auction_closing_time': 1774716637.0}
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP48554') HTTP/1.1" 204 0
2026-03-27 10:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_116eb1ce41fb59f121612eaf4806cb1b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a173d0>
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d90399d-4d6a-5ce4-9639-e6435a8cb023/8d90399d-4d6a-5ce4-9639-e6435a8cb023_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75103145ccaf212cd2316ebeed9bd9%252Fpa%252FYY13521_9ad9dd66ddcfaa99e9a276aba4f1953f.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_9ad9dd66ddcfaa99e9a276aba4f1953f.jpg saved to cache
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d90399d-4d6a-5ce4-9639-e6435a8cb023
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501748410>
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d60d65-98ae-59b3-9e5b-c52df001aa14/b7d60d65-98ae-59b3-9e5b-c52df001aa14_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd0%252F56d018ca9ee4da5cc3b0a48f71991d19%252Fpa%252FLM85601_b21e3c2fe45708b0c705a86fa53a4407.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_b21e3c2fe45708b0c705a86fa53a4407.jpg saved to cache
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b7d60d65-98ae-59b3-9e5b-c52df001aa14
2026-03-27 10:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_f928be7a64e9f8f3cd62ef0685c2aa7e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a137d0>
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d60d65-98ae-59b3-9e5b-c52df001aa14/b7d60d65-98ae-59b3-9e5b-c52df001aa14_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd0%252F56d018ca9ee4da5cc3b0a48f71991d19%252Fpa%252FLM85601_116eb1ce41fb59f121612eaf4806cb1b.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_116eb1ce41fb59f121612eaf4806cb1b.jpg saved to cache
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b7d60d65-98ae-59b3-9e5b-c52df001aa14
2026-03-27 10:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_8c6480853d0eb7e0e55ee5281bdeffa2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a1b590>
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d90399d-4d6a-5ce4-9639-e6435a8cb023/8d90399d-4d6a-5ce4-9639-e6435a8cb023_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75103145ccaf212cd2316ebeed9bd9%252Fpa%252FYY13521_f928be7a64e9f8f3cd62ef0685c2aa7e.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_f928be7a64e9f8f3cd62ef0685c2aa7e.jpg saved to cache
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d90399d-4d6a-5ce4-9639-e6435a8cb023
2026-03-27 10:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_d4714a731bc62fb9ccc5ee557b8cd9b7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002ff150>
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d90399d-4d6a-5ce4-9639-e6435a8cb023/8d90399d-4d6a-5ce4-9639-e6435a8cb023_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75103145ccaf212cd2316ebeed9bd9%252Fpa%252FYY13521_8c6480853d0eb7e0e55ee5281bdeffa2.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_8c6480853d0eb7e0e55ee5281bdeffa2.jpg saved to cache
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d90399d-4d6a-5ce4-9639-e6435a8cb023
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50035c610>
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d60d65-98ae-59b3-9e5b-c52df001aa14/b7d60d65-98ae-59b3-9e5b-c52df001aa14_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd0%252F56d018ca9ee4da5cc3b0a48f71991d19%252Fpa%252FLM85601_d4714a731bc62fb9ccc5ee557b8cd9b7.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_d4714a731bc62fb9ccc5ee557b8cd9b7.jpg saved to cache
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b7d60d65-98ae-59b3-9e5b-c52df001aa14
2026-03-27 10:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_c165e4265edb86d9dcd796c4042b2452.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a1350>
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d90399d-4d6a-5ce4-9639-e6435a8cb023/8d90399d-4d6a-5ce4-9639-e6435a8cb023_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F75%252Faa75103145ccaf212cd2316ebeed9bd9%252Fpa%252FYY13521_c165e4265edb86d9dcd796c4042b2452.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_c165e4265edb86d9dcd796c4042b2452.jpg saved to cache
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d90399d-4d6a-5ce4-9639-e6435a8cb023
2026-03-27 10:38:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d90399d-4d6a-5ce4-9639-e6435a8cb023, skipping ID generation
2026-03-27 10:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d90399d-4d6a-5ce4-9639-e6435a8cb023 with scrape type 1
2026-03-27 10:38:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d90399d-4d6a-5ce4-9639-e6435a8cb023 sending to next pipeline
2026-03-27 10:38:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d90399d-4d6a-5ce4-9639-e6435a8cb023, identifier: YY13521
2026-03-27 10:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d90399d-4d6a-5ce4-9639-e6435a8cb023 with identifier: YY13521
2026-03-27 10:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d90399d-4d6a-5ce4-9639-e6435a8cb023 with identifier: YY13521
2026-03-27 10:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d90399d-4d6a-5ce4-9639-e6435a8cb023 with identifier: YY13521 to the API
2026-03-27 10:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_c165e4265edb86d9dcd796c4042b2452.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:49:48Z',
 'fuel_type': 'diesel',
 'id': '8d90399d-4d6a-5ce4-9639-e6435a8cb023',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY13521',
 'listing': 'auction',
 'location': 'DE, Hannover',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 169283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d90399d-4d6a-5ce4-9639-e6435a8cb023/8d90399d-4d6a-5ce4-9639-e6435a8cb023_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_c165e4265edb86d9dcd796c4042b2452.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d90399d-4d6a-5ce4-9639-e6435a8cb023/8d90399d-4d6a-5ce4-9639-e6435a8cb023_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_f928be7a64e9f8f3cd62ef0685c2aa7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d90399d-4d6a-5ce4-9639-e6435a8cb023/8d90399d-4d6a-5ce4-9639-e6435a8cb023_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_af4daa5fe632a6ceb330a11664a77ef6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d90399d-4d6a-5ce4-9639-e6435a8cb023/8d90399d-4d6a-5ce4-9639-e6435a8cb023_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2456410,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_9ad9dd66ddcfaa99e9a276aba4f1953f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d90399d-4d6a-5ce4-9639-e6435a8cb023/8d90399d-4d6a-5ce4-9639-e6435a8cb023_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2562789,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_8c6480853d0eb7e0e55ee5281bdeffa2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d90399d-4d6a-5ce4-9639-e6435a8cb023/8d90399d-4d6a-5ce4-9639-e6435a8cb023_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2788155,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_642ff1f7058f12a6af7069866a40d8b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d90399d-4d6a-5ce4-9639-e6435a8cb023/8d90399d-4d6a-5ce4-9639-e6435a8cb023_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_a95a67c6291fff85357cbb499c489ffa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d90399d-4d6a-5ce4-9639-e6435a8cb023/8d90399d-4d6a-5ce4-9639-e6435a8cb023_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_8a9a38113ff86356e7f24de0f129349f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d90399d-4d6a-5ce4-9639-e6435a8cb023/8d90399d-4d6a-5ce4-9639-e6435a8cb023_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2497566,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_15fa4d4f985b6237034da36451a763d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d90399d-4d6a-5ce4-9639-e6435a8cb023/8d90399d-4d6a-5ce4-9639-e6435a8cb023_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2512271,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/75/aa75103145ccaf212cd2316ebeed9bd9/pa/YY13521_0df74ad7f07b40238a5fb25cd74cef09.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 CRDi Go-Plus 4WD',
 'transmission': 'automatic',
 'trim': 'Go-Plus 4WD',
 'year': 2014}
2026-03-27 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY13521%27 HTTP/1.1" 200 None
2026-03-27 10:38:12 [auto1.de] INFO: Saving data for YY13521: {'created_time': 1774607892.469515, 'last_price_update_time': 1774607892.469528, 'auction_closing_time': 1774716588.0}
2026-03-27 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY13521') HTTP/1.1" 204 0
2026-03-27 10:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_8996ba8505d4994bd570eff84b80e0ef.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a125d0>
2026-03-27 10:38:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d60d65-98ae-59b3-9e5b-c52df001aa14/b7d60d65-98ae-59b3-9e5b-c52df001aa14_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd0%252F56d018ca9ee4da5cc3b0a48f71991d19%252Fpa%252FLM85601_8996ba8505d4994bd570eff84b80e0ef.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_8996ba8505d4994bd570eff84b80e0ef.jpg saved to cache
2026-03-27 10:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b7d60d65-98ae-59b3-9e5b-c52df001aa14
2026-03-27 10:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BD50097/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_59c75c1aec93f29d27d9469b7cc7d0c2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VX15127> (referer: https://www.auto1.com/v1/car-details-view/VX15127/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501748ed0>
2026-03-27 10:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d60d65-98ae-59b3-9e5b-c52df001aa14/b7d60d65-98ae-59b3-9e5b-c52df001aa14_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd0%252F56d018ca9ee4da5cc3b0a48f71991d19%252Fpa%252FLM85601_59c75c1aec93f29d27d9469b7cc7d0c2.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_59c75c1aec93f29d27d9469b7cc7d0c2.jpg saved to cache
2026-03-27 10:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7d60d65-98ae-59b3-9e5b-c52df001aa14
2026-03-27 10:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2280100b-b82e-55b6-8e4f-5653c06cdb3b with identifier: VX15127
2026-03-27 10:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2280100b-b82e-55b6-8e4f-5653c06cdb3b with scrape type 1
2026-03-27 10:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2280100b-b82e-55b6-8e4f-5653c06cdb3b
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F93%252Fee93d09860304c1406daf133f7464081%252Fpa%252FVX15127_b47b3a0b5d20395a35ad5c3353f28721.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_b47b3a0b5d20395a35ad5c3353f28721.jpg not downloaded yet
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F93%252Fee93d09860304c1406daf133f7464081%252Fpa%252FVX15127_25e6ded4f48186a7980b426ab410425d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_25e6ded4f48186a7980b426ab410425d.jpg not downloaded yet
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F93%252Fee93d09860304c1406daf133f7464081%252Fpa%252FVX15127_2811d14cdbf12ff0741adfb4ac8a9957.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_2811d14cdbf12ff0741adfb4ac8a9957.jpg not downloaded yet
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F93%252Fee93d09860304c1406daf133f7464081%252Fpa%252FVX15127_ff0b6e3ae17d3eebc7e0834953ad1e0a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_ff0b6e3ae17d3eebc7e0834953ad1e0a.jpg not downloaded yet
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F93%252Fee93d09860304c1406daf133f7464081%252Fpa%252FVX15127_16b747d360c7244596598525dd1e6033.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_16b747d360c7244596598525dd1e6033.jpg not downloaded yet
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F93%252Fee93d09860304c1406daf133f7464081%252Fpa%252FVX15127_d8c6aad38d411c47c262e029ca897816.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_d8c6aad38d411c47c262e029ca897816.jpg not downloaded yet
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F93%252Fee93d09860304c1406daf133f7464081%252Fpa%252FVX15127_12ee3bd60ec006552a359c1132de0bf5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_12ee3bd60ec006552a359c1132de0bf5.jpg not downloaded yet
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F93%252Fee93d09860304c1406daf133f7464081%252Fpa%252FVX15127_c642056cf55da2397600726d5ca70427.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_c642056cf55da2397600726d5ca70427.jpg not downloaded yet
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F93%252Fee93d09860304c1406daf133f7464081%252Fpa%252FVX15127_57eebf140e2f02c634b89f94e07da01b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_57eebf140e2f02c634b89f94e07da01b.jpg not downloaded yet
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F93%252Fee93d09860304c1406daf133f7464081%252Fpa%252FVX15127_ce32af9530cbd53a193ce0e11cedebdc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_ce32af9530cbd53a193ce0e11cedebdc.jpg not downloaded yet
2026-03-27 10:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE79625> (referer: https://www.auto1.com/v1/car-details-view/ZE79625/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5356c6df-c266-58d6-827d-f52dbfdd28a3 with identifier: ZE79625
2026-03-27 10:38:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5356c6df-c266-58d6-827d-f52dbfdd28a3 with scrape type 1
2026-03-27 10:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5356c6df-c266-58d6-827d-f52dbfdd28a3
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0c%252Fd90c6a9be8880d5f07bb6b343a624415%252Fpa%252FZE79625_efb0b970bd80c1027cf6d2b7477bbc0c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_efb0b970bd80c1027cf6d2b7477bbc0c.jpg not downloaded yet
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0c%252Fd90c6a9be8880d5f07bb6b343a624415%252Fpa%252FZE79625_040f77b3330d45fdd1066532494a2179.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_040f77b3330d45fdd1066532494a2179.jpg not downloaded yet
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0c%252Fd90c6a9be8880d5f07bb6b343a624415%252Fpa%252FZE79625_83d09eb94d38c88eb6034e6888568457.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_83d09eb94d38c88eb6034e6888568457.jpg not downloaded yet
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0c%252Fd90c6a9be8880d5f07bb6b343a624415%252Fpa%252FZE79625_44c2108c3618ec8be466dd44e9aa2438.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_44c2108c3618ec8be466dd44e9aa2438.jpg not downloaded yet
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0c%252Fd90c6a9be8880d5f07bb6b343a624415%252Fpa%252FZE79625_410ffc80de79207e7ab48dcd103ce396.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_410ffc80de79207e7ab48dcd103ce396.jpg not downloaded yet
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0c%252Fd90c6a9be8880d5f07bb6b343a624415%252Fpa%252FZE79625_08285c58fe5ca15e6d61cb2c4fc17543.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_08285c58fe5ca15e6d61cb2c4fc17543.jpg not downloaded yet
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0c%252Fd90c6a9be8880d5f07bb6b343a624415%252Fpa%252FZE79625_9578f438b6f91c0529362c01b23a4835.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_9578f438b6f91c0529362c01b23a4835.jpg not downloaded yet
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0c%252Fd90c6a9be8880d5f07bb6b343a624415%252Fpa%252FZE79625_2d5b962cc6966335efe587dd0bfda954.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_2d5b962cc6966335efe587dd0bfda954.jpg not downloaded yet
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0c%252Fd90c6a9be8880d5f07bb6b343a624415%252Fpa%252FZE79625_9b7af64b072e48f46c38d6bb3266223e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_9b7af64b072e48f46c38d6bb3266223e.jpg not downloaded yet
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0c%252Fd90c6a9be8880d5f07bb6b343a624415%252Fpa%252FZE79625_ac4477c2779184ee06cd239f9dd64065.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_ac4477c2779184ee06cd239f9dd64065.jpg not downloaded yet
2026-03-27 10:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_ce32af9530cbd53a193ce0e11cedebdc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501893510>
2026-03-27 10:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2280100b-b82e-55b6-8e4f-5653c06cdb3b/2280100b-b82e-55b6-8e4f-5653c06cdb3b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F93%252Fee93d09860304c1406daf133f7464081%252Fpa%252FVX15127_ce32af9530cbd53a193ce0e11cedebdc.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_ce32af9530cbd53a193ce0e11cedebdc.jpg saved to cache
2026-03-27 10:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2280100b-b82e-55b6-8e4f-5653c06cdb3b
2026-03-27 10:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_ac4477c2779184ee06cd239f9dd64065.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501656ed0>
2026-03-27 10:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5356c6df-c266-58d6-827d-f52dbfdd28a3/5356c6df-c266-58d6-827d-f52dbfdd28a3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0c%252Fd90c6a9be8880d5f07bb6b343a624415%252Fpa%252FZE79625_ac4477c2779184ee06cd239f9dd64065.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_ac4477c2779184ee06cd239f9dd64065.jpg saved to cache
2026-03-27 10:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5356c6df-c266-58d6-827d-f52dbfdd28a3
2026-03-27 10:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_9b7af64b072e48f46c38d6bb3266223e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50170ea50>
2026-03-27 10:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5356c6df-c266-58d6-827d-f52dbfdd28a3/5356c6df-c266-58d6-827d-f52dbfdd28a3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0c%252Fd90c6a9be8880d5f07bb6b343a624415%252Fpa%252FZE79625_9b7af64b072e48f46c38d6bb3266223e.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_9b7af64b072e48f46c38d6bb3266223e.jpg saved to cache
2026-03-27 10:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5356c6df-c266-58d6-827d-f52dbfdd28a3
2026-03-27 10:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_2d5b962cc6966335efe587dd0bfda954.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a1c50>
2026-03-27 10:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5356c6df-c266-58d6-827d-f52dbfdd28a3/5356c6df-c266-58d6-827d-f52dbfdd28a3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0c%252Fd90c6a9be8880d5f07bb6b343a624415%252Fpa%252FZE79625_2d5b962cc6966335efe587dd0bfda954.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_2d5b962cc6966335efe587dd0bfda954.jpg saved to cache
2026-03-27 10:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5356c6df-c266-58d6-827d-f52dbfdd28a3
2026-03-27 10:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_9578f438b6f91c0529362c01b23a4835.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501655810>
2026-03-27 10:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5356c6df-c266-58d6-827d-f52dbfdd28a3/5356c6df-c266-58d6-827d-f52dbfdd28a3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0c%252Fd90c6a9be8880d5f07bb6b343a624415%252Fpa%252FZE79625_9578f438b6f91c0529362c01b23a4835.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_9578f438b6f91c0529362c01b23a4835.jpg saved to cache
2026-03-27 10:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5356c6df-c266-58d6-827d-f52dbfdd28a3
2026-03-27 10:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_08285c58fe5ca15e6d61cb2c4fc17543.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50167e810>
2026-03-27 10:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5356c6df-c266-58d6-827d-f52dbfdd28a3/5356c6df-c266-58d6-827d-f52dbfdd28a3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0c%252Fd90c6a9be8880d5f07bb6b343a624415%252Fpa%252FZE79625_08285c58fe5ca15e6d61cb2c4fc17543.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_08285c58fe5ca15e6d61cb2c4fc17543.jpg saved to cache
2026-03-27 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5356c6df-c266-58d6-827d-f52dbfdd28a3
2026-03-27 10:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_410ffc80de79207e7ab48dcd103ce396.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50170c290>
2026-03-27 10:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5356c6df-c266-58d6-827d-f52dbfdd28a3/5356c6df-c266-58d6-827d-f52dbfdd28a3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0c%252Fd90c6a9be8880d5f07bb6b343a624415%252Fpa%252FZE79625_410ffc80de79207e7ab48dcd103ce396.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_410ffc80de79207e7ab48dcd103ce396.jpg saved to cache
2026-03-27 10:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5356c6df-c266-58d6-827d-f52dbfdd28a3
2026-03-27 10:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_44c2108c3618ec8be466dd44e9aa2438.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501828a50>
2026-03-27 10:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5356c6df-c266-58d6-827d-f52dbfdd28a3/5356c6df-c266-58d6-827d-f52dbfdd28a3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0c%252Fd90c6a9be8880d5f07bb6b343a624415%252Fpa%252FZE79625_44c2108c3618ec8be466dd44e9aa2438.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_44c2108c3618ec8be466dd44e9aa2438.jpg saved to cache
2026-03-27 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5356c6df-c266-58d6-827d-f52dbfdd28a3
2026-03-27 10:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_83d09eb94d38c88eb6034e6888568457.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002ffd50>
2026-03-27 10:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5356c6df-c266-58d6-827d-f52dbfdd28a3/5356c6df-c266-58d6-827d-f52dbfdd28a3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0c%252Fd90c6a9be8880d5f07bb6b343a624415%252Fpa%252FZE79625_83d09eb94d38c88eb6034e6888568457.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_83d09eb94d38c88eb6034e6888568457.jpg saved to cache
2026-03-27 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5356c6df-c266-58d6-827d-f52dbfdd28a3
2026-03-27 10:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_040f77b3330d45fdd1066532494a2179.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_efb0b970bd80c1027cf6d2b7477bbc0c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018432d0>
2026-03-27 10:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5356c6df-c266-58d6-827d-f52dbfdd28a3/5356c6df-c266-58d6-827d-f52dbfdd28a3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0c%252Fd90c6a9be8880d5f07bb6b343a624415%252Fpa%252FZE79625_040f77b3330d45fdd1066532494a2179.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_040f77b3330d45fdd1066532494a2179.jpg saved to cache
2026-03-27 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5356c6df-c266-58d6-827d-f52dbfdd28a3
2026-03-27 10:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a1b010>
2026-03-27 10:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5356c6df-c266-58d6-827d-f52dbfdd28a3/5356c6df-c266-58d6-827d-f52dbfdd28a3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F0c%252Fd90c6a9be8880d5f07bb6b343a624415%252Fpa%252FZE79625_efb0b970bd80c1027cf6d2b7477bbc0c.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_efb0b970bd80c1027cf6d2b7477bbc0c.jpg saved to cache
2026-03-27 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5356c6df-c266-58d6-827d-f52dbfdd28a3
2026-03-27 10:38:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5356c6df-c266-58d6-827d-f52dbfdd28a3, skipping ID generation
2026-03-27 10:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5356c6df-c266-58d6-827d-f52dbfdd28a3 with scrape type 1
2026-03-27 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5356c6df-c266-58d6-827d-f52dbfdd28a3 sending to next pipeline
2026-03-27 10:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5356c6df-c266-58d6-827d-f52dbfdd28a3, identifier: ZE79625
2026-03-27 10:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5356c6df-c266-58d6-827d-f52dbfdd28a3 with identifier: ZE79625
2026-03-27 10:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5356c6df-c266-58d6-827d-f52dbfdd28a3 with identifier: ZE79625
2026-03-27 10:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5356c6df-c266-58d6-827d-f52dbfdd28a3 with identifier: ZE79625 to the API
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_efb0b970bd80c1027cf6d2b7477bbc0c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:28:37Z',
 'fuel_type': 'petrol',
 'id': '5356c6df-c266-58d6-827d-f52dbfdd28a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE79625',
 'listing': 'auction',
 'location': 'DE, Krefeld',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 113996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5356c6df-c266-58d6-827d-f52dbfdd28a3/5356c6df-c266-58d6-827d-f52dbfdd28a3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_efb0b970bd80c1027cf6d2b7477bbc0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5356c6df-c266-58d6-827d-f52dbfdd28a3/5356c6df-c266-58d6-827d-f52dbfdd28a3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2359798,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_040f77b3330d45fdd1066532494a2179.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5356c6df-c266-58d6-827d-f52dbfdd28a3/5356c6df-c266-58d6-827d-f52dbfdd28a3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2561241,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_83d09eb94d38c88eb6034e6888568457.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5356c6df-c266-58d6-827d-f52dbfdd28a3/5356c6df-c266-58d6-827d-f52dbfdd28a3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2576898,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_44c2108c3618ec8be466dd44e9aa2438.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5356c6df-c266-58d6-827d-f52dbfdd28a3/5356c6df-c266-58d6-827d-f52dbfdd28a3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_410ffc80de79207e7ab48dcd103ce396.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5356c6df-c266-58d6-827d-f52dbfdd28a3/5356c6df-c266-58d6-827d-f52dbfdd28a3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_08285c58fe5ca15e6d61cb2c4fc17543.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5356c6df-c266-58d6-827d-f52dbfdd28a3/5356c6df-c266-58d6-827d-f52dbfdd28a3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2405462,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_9578f438b6f91c0529362c01b23a4835.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5356c6df-c266-58d6-827d-f52dbfdd28a3/5356c6df-c266-58d6-827d-f52dbfdd28a3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2304384,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_2d5b962cc6966335efe587dd0bfda954.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5356c6df-c266-58d6-827d-f52dbfdd28a3/5356c6df-c266-58d6-827d-f52dbfdd28a3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_9b7af64b072e48f46c38d6bb3266223e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5356c6df-c266-58d6-827d-f52dbfdd28a3/5356c6df-c266-58d6-827d-f52dbfdd28a3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2982956,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/0c/d90c6a9be8880d5f07bb6b343a624415/pa/ZE79625_ac4477c2779184ee06cd239f9dd64065.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-02-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis Prime',
 'transmission': 'manual',
 'trim': 'Basis Prime',
 'year': 2015}
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE79625%27 HTTP/1.1" 200 None
2026-03-27 10:38:23 [auto1.de] INFO: Saving data for ZE79625: {'created_time': 1774607903.553274, 'last_price_update_time': 1774607903.553285, 'auction_closing_time': 1774715317.0}
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE79625') HTTP/1.1" 204 0
2026-03-27 10:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_57eebf140e2f02c634b89f94e07da01b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5025e6f10>
2026-03-27 10:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2280100b-b82e-55b6-8e4f-5653c06cdb3b/2280100b-b82e-55b6-8e4f-5653c06cdb3b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F93%252Fee93d09860304c1406daf133f7464081%252Fpa%252FVX15127_57eebf140e2f02c634b89f94e07da01b.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_57eebf140e2f02c634b89f94e07da01b.jpg saved to cache
2026-03-27 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2280100b-b82e-55b6-8e4f-5653c06cdb3b
2026-03-27 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_c642056cf55da2397600726d5ca70427.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501766050>
2026-03-27 10:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2280100b-b82e-55b6-8e4f-5653c06cdb3b/2280100b-b82e-55b6-8e4f-5653c06cdb3b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F93%252Fee93d09860304c1406daf133f7464081%252Fpa%252FVX15127_c642056cf55da2397600726d5ca70427.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_c642056cf55da2397600726d5ca70427.jpg saved to cache
2026-03-27 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2280100b-b82e-55b6-8e4f-5653c06cdb3b
2026-03-27 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_12ee3bd60ec006552a359c1132de0bf5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501764890>
2026-03-27 10:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2280100b-b82e-55b6-8e4f-5653c06cdb3b/2280100b-b82e-55b6-8e4f-5653c06cdb3b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F93%252Fee93d09860304c1406daf133f7464081%252Fpa%252FVX15127_12ee3bd60ec006552a359c1132de0bf5.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_12ee3bd60ec006552a359c1132de0bf5.jpg saved to cache
2026-03-27 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2280100b-b82e-55b6-8e4f-5653c06cdb3b
2026-03-27 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_d8c6aad38d411c47c262e029ca897816.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500348c50>
2026-03-27 10:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2280100b-b82e-55b6-8e4f-5653c06cdb3b/2280100b-b82e-55b6-8e4f-5653c06cdb3b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F93%252Fee93d09860304c1406daf133f7464081%252Fpa%252FVX15127_d8c6aad38d411c47c262e029ca897816.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_d8c6aad38d411c47c262e029ca897816.jpg saved to cache
2026-03-27 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2280100b-b82e-55b6-8e4f-5653c06cdb3b
2026-03-27 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_16b747d360c7244596598525dd1e6033.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018b2510>
2026-03-27 10:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2280100b-b82e-55b6-8e4f-5653c06cdb3b/2280100b-b82e-55b6-8e4f-5653c06cdb3b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F93%252Fee93d09860304c1406daf133f7464081%252Fpa%252FVX15127_16b747d360c7244596598525dd1e6033.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_16b747d360c7244596598525dd1e6033.jpg saved to cache
2026-03-27 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2280100b-b82e-55b6-8e4f-5653c06cdb3b
2026-03-27 10:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_ff0b6e3ae17d3eebc7e0834953ad1e0a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a0950>
2026-03-27 10:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2280100b-b82e-55b6-8e4f-5653c06cdb3b/2280100b-b82e-55b6-8e4f-5653c06cdb3b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F93%252Fee93d09860304c1406daf133f7464081%252Fpa%252FVX15127_ff0b6e3ae17d3eebc7e0834953ad1e0a.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_ff0b6e3ae17d3eebc7e0834953ad1e0a.jpg saved to cache
2026-03-27 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2280100b-b82e-55b6-8e4f-5653c06cdb3b
2026-03-27 10:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_2811d14cdbf12ff0741adfb4ac8a9957.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002fc2d0>
2026-03-27 10:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2280100b-b82e-55b6-8e4f-5653c06cdb3b/2280100b-b82e-55b6-8e4f-5653c06cdb3b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F93%252Fee93d09860304c1406daf133f7464081%252Fpa%252FVX15127_2811d14cdbf12ff0741adfb4ac8a9957.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_2811d14cdbf12ff0741adfb4ac8a9957.jpg saved to cache
2026-03-27 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2280100b-b82e-55b6-8e4f-5653c06cdb3b
2026-03-27 10:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_25e6ded4f48186a7980b426ab410425d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018b3c50>
2026-03-27 10:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2280100b-b82e-55b6-8e4f-5653c06cdb3b/2280100b-b82e-55b6-8e4f-5653c06cdb3b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F93%252Fee93d09860304c1406daf133f7464081%252Fpa%252FVX15127_25e6ded4f48186a7980b426ab410425d.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_25e6ded4f48186a7980b426ab410425d.jpg saved to cache
2026-03-27 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2280100b-b82e-55b6-8e4f-5653c06cdb3b
2026-03-27 10:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MK03700> (referer: https://www.auto1.com/v1/car-details-view/MK03700/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_d365eafab82486c7787686197c4d2205.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6d515cc-b349-51af-8401-a6d8f0ed83fd with identifier: MK03700
2026-03-27 10:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6d515cc-b349-51af-8401-a6d8f0ed83fd with scrape type 1
2026-03-27 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c6d515cc-b349-51af-8401-a6d8f0ed83fd
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F62%252F7762a44988075e925b3c961c5095da23%252Fpa%252FMK03700_5793db461bdeb1e5b004383d3ea425cb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_5793db461bdeb1e5b004383d3ea425cb.jpg not downloaded yet
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F62%252F7762a44988075e925b3c961c5095da23%252Fpa%252FMK03700_18dae674db39fa0be634502b0b2f0e1a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_18dae674db39fa0be634502b0b2f0e1a.jpg not downloaded yet
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F62%252F7762a44988075e925b3c961c5095da23%252Fpa%252FMK03700_2516a06aeb1e8894d9b49fe9e9093305.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_2516a06aeb1e8894d9b49fe9e9093305.jpg not downloaded yet
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F62%252F7762a44988075e925b3c961c5095da23%252Fpa%252FMK03700_7117124c4f2de65009540a7a289d75c1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_7117124c4f2de65009540a7a289d75c1.jpg not downloaded yet
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F62%252F7762a44988075e925b3c961c5095da23%252Fpa%252FMK03700_32c7046b577b78e06e16152b85c6956f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_32c7046b577b78e06e16152b85c6956f.jpg not downloaded yet
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F62%252F7762a44988075e925b3c961c5095da23%252Fpa%252FMK03700_15229eb67c3975d888abdb383350332d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_15229eb67c3975d888abdb383350332d.jpg not downloaded yet
2026-03-27 10:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500348e10>
2026-03-27 10:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d60d65-98ae-59b3-9e5b-c52df001aa14/b7d60d65-98ae-59b3-9e5b-c52df001aa14_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd0%252F56d018ca9ee4da5cc3b0a48f71991d19%252Fpa%252FLM85601_d365eafab82486c7787686197c4d2205.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_d365eafab82486c7787686197c4d2205.jpg saved to cache
2026-03-27 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7d60d65-98ae-59b3-9e5b-c52df001aa14
2026-03-27 10:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_46e3277941db1c83a6ce979b4e0f7420.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_15229eb67c3975d888abdb383350332d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501748710>
2026-03-27 10:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d60d65-98ae-59b3-9e5b-c52df001aa14/b7d60d65-98ae-59b3-9e5b-c52df001aa14_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd0%252F56d018ca9ee4da5cc3b0a48f71991d19%252Fpa%252FLM85601_46e3277941db1c83a6ce979b4e0f7420.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_46e3277941db1c83a6ce979b4e0f7420.jpg saved to cache
2026-03-27 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7d60d65-98ae-59b3-9e5b-c52df001aa14
2026-03-27 10:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50170ff90>
2026-03-27 10:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6d515cc-b349-51af-8401-a6d8f0ed83fd/c6d515cc-b349-51af-8401-a6d8f0ed83fd_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F62%252F7762a44988075e925b3c961c5095da23%252Fpa%252FMK03700_15229eb67c3975d888abdb383350332d.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_15229eb67c3975d888abdb383350332d.jpg saved to cache
2026-03-27 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6d515cc-b349-51af-8401-a6d8f0ed83fd
2026-03-27 10:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_b47b3a0b5d20395a35ad5c3353f28721.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_32c7046b577b78e06e16152b85c6956f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501948590>
2026-03-27 10:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2280100b-b82e-55b6-8e4f-5653c06cdb3b/2280100b-b82e-55b6-8e4f-5653c06cdb3b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F93%252Fee93d09860304c1406daf133f7464081%252Fpa%252FVX15127_b47b3a0b5d20395a35ad5c3353f28721.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_b47b3a0b5d20395a35ad5c3353f28721.jpg saved to cache
2026-03-27 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2280100b-b82e-55b6-8e4f-5653c06cdb3b
2026-03-27 10:38:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2280100b-b82e-55b6-8e4f-5653c06cdb3b, skipping ID generation
2026-03-27 10:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2280100b-b82e-55b6-8e4f-5653c06cdb3b with scrape type 1
2026-03-27 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2280100b-b82e-55b6-8e4f-5653c06cdb3b sending to next pipeline
2026-03-27 10:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2280100b-b82e-55b6-8e4f-5653c06cdb3b, identifier: VX15127
2026-03-27 10:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2280100b-b82e-55b6-8e4f-5653c06cdb3b with identifier: VX15127
2026-03-27 10:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2280100b-b82e-55b6-8e4f-5653c06cdb3b with identifier: VX15127
2026-03-27 10:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2280100b-b82e-55b6-8e4f-5653c06cdb3b with identifier: VX15127 to the API
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_b47b3a0b5d20395a35ad5c3353f28721.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:27:40Z',
 'fuel_type': 'petrol',
 'id': '2280100b-b82e-55b6-8e4f-5653c06cdb3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX15127',
 'listing': 'auction',
 'location': 'DE, Friedrichshafen',
 'make': 'Subaru',
 'model': 'Forester',
 'odometer': 116249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2280100b-b82e-55b6-8e4f-5653c06cdb3b/2280100b-b82e-55b6-8e4f-5653c06cdb3b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3033772,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_b47b3a0b5d20395a35ad5c3353f28721.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2280100b-b82e-55b6-8e4f-5653c06cdb3b/2280100b-b82e-55b6-8e4f-5653c06cdb3b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_25e6ded4f48186a7980b426ab410425d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2280100b-b82e-55b6-8e4f-5653c06cdb3b/2280100b-b82e-55b6-8e4f-5653c06cdb3b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2987008,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_2811d14cdbf12ff0741adfb4ac8a9957.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2280100b-b82e-55b6-8e4f-5653c06cdb3b/2280100b-b82e-55b6-8e4f-5653c06cdb3b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2816666,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_ff0b6e3ae17d3eebc7e0834953ad1e0a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2280100b-b82e-55b6-8e4f-5653c06cdb3b/2280100b-b82e-55b6-8e4f-5653c06cdb3b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2909741,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_16b747d360c7244596598525dd1e6033.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2280100b-b82e-55b6-8e4f-5653c06cdb3b/2280100b-b82e-55b6-8e4f-5653c06cdb3b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_d8c6aad38d411c47c262e029ca897816.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2280100b-b82e-55b6-8e4f-5653c06cdb3b/2280100b-b82e-55b6-8e4f-5653c06cdb3b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_12ee3bd60ec006552a359c1132de0bf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2280100b-b82e-55b6-8e4f-5653c06cdb3b/2280100b-b82e-55b6-8e4f-5653c06cdb3b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2964314,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_c642056cf55da2397600726d5ca70427.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2280100b-b82e-55b6-8e4f-5653c06cdb3b/2280100b-b82e-55b6-8e4f-5653c06cdb3b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2916949,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_57eebf140e2f02c634b89f94e07da01b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2280100b-b82e-55b6-8e4f-5653c06cdb3b/2280100b-b82e-55b6-8e4f-5653c06cdb3b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2816998,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/93/ee93d09860304c1406daf133f7464081/pa/VX15127_ce32af9530cbd53a193ce0e11cedebdc.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Subaru Forester 2.0 Mild-Hybrid Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2020}
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX15127%27 HTTP/1.1" 200 None
2026-03-27 10:38:26 [auto1.de] INFO: Saving data for VX15127: {'created_time': 1774607906.992446, 'last_price_update_time': 1774607906.99246, 'auction_closing_time': 1774715260.0}
2026-03-27 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX15127') HTTP/1.1" 204 0
2026-03-27 10:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_7117124c4f2de65009540a7a289d75c1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_2516a06aeb1e8894d9b49fe9e9093305.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY47977/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ93554> (referer: https://www.auto1.com/v1/car-details-view/DJ93554/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50167e7d0>
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6d515cc-b349-51af-8401-a6d8f0ed83fd/c6d515cc-b349-51af-8401-a6d8f0ed83fd_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F62%252F7762a44988075e925b3c961c5095da23%252Fpa%252FMK03700_32c7046b577b78e06e16152b85c6956f.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_32c7046b577b78e06e16152b85c6956f.jpg saved to cache
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6d515cc-b349-51af-8401-a6d8f0ed83fd
2026-03-27 10:38:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_18dae674db39fa0be634502b0b2f0e1a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50174a210>
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6d515cc-b349-51af-8401-a6d8f0ed83fd/c6d515cc-b349-51af-8401-a6d8f0ed83fd_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F62%252F7762a44988075e925b3c961c5095da23%252Fpa%252FMK03700_7117124c4f2de65009540a7a289d75c1.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_7117124c4f2de65009540a7a289d75c1.jpg saved to cache
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6d515cc-b349-51af-8401-a6d8f0ed83fd
2026-03-27 10:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_5793db461bdeb1e5b004383d3ea425cb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501841250>
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6d515cc-b349-51af-8401-a6d8f0ed83fd/c6d515cc-b349-51af-8401-a6d8f0ed83fd_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F62%252F7762a44988075e925b3c961c5095da23%252Fpa%252FMK03700_2516a06aeb1e8894d9b49fe9e9093305.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_2516a06aeb1e8894d9b49fe9e9093305.jpg saved to cache
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6d515cc-b349-51af-8401-a6d8f0ed83fd
2026-03-27 10:38:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45bfcb05-cc85-56f2-95b4-9652f8e5b570 with identifier: DJ93554
2026-03-27 10:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45bfcb05-cc85-56f2-95b4-9652f8e5b570 with scrape type 1
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 45bfcb05-cc85-56f2-95b4-9652f8e5b570
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6c%252F986c9f0ab177f7fa6d376ad88503d8cf%252Fpa%252FDJ93554_c2506b442f41f13e809d78791602785c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_c2506b442f41f13e809d78791602785c.jpg not downloaded yet
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6c%252F986c9f0ab177f7fa6d376ad88503d8cf%252Fpa%252FDJ93554_c588f73441fee2cdbafbf395fd3ca097.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_c588f73441fee2cdbafbf395fd3ca097.jpg not downloaded yet
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6c%252F986c9f0ab177f7fa6d376ad88503d8cf%252Fpa%252FDJ93554_8a34dbda52aa80844cfe58a3ac317ee7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_8a34dbda52aa80844cfe58a3ac317ee7.jpg not downloaded yet
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50059e850>
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6d515cc-b349-51af-8401-a6d8f0ed83fd/c6d515cc-b349-51af-8401-a6d8f0ed83fd_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F62%252F7762a44988075e925b3c961c5095da23%252Fpa%252FMK03700_18dae674db39fa0be634502b0b2f0e1a.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_18dae674db39fa0be634502b0b2f0e1a.jpg saved to cache
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c6d515cc-b349-51af-8401-a6d8f0ed83fd
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6c%252F986c9f0ab177f7fa6d376ad88503d8cf%252Fpa%252FDJ93554_5fa64abfbe5676abb7595e59b3e46b30.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_5fa64abfbe5676abb7595e59b3e46b30.jpg not downloaded yet
2026-03-27 10:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_e9daf421ab1eef38c706446c85695416.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6c%252F986c9f0ab177f7fa6d376ad88503d8cf%252Fpa%252FDJ93554_062ff1d1d34063dcc1d438e24352b2c7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_062ff1d1d34063dcc1d438e24352b2c7.jpg not downloaded yet
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6c%252F986c9f0ab177f7fa6d376ad88503d8cf%252Fpa%252FDJ93554_8a698c483b01f648a3d1ec3b88660fcb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_8a698c483b01f648a3d1ec3b88660fcb.jpg not downloaded yet
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501765f50>
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6d515cc-b349-51af-8401-a6d8f0ed83fd/c6d515cc-b349-51af-8401-a6d8f0ed83fd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F62%252F7762a44988075e925b3c961c5095da23%252Fpa%252FMK03700_5793db461bdeb1e5b004383d3ea425cb.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_5793db461bdeb1e5b004383d3ea425cb.jpg saved to cache
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6d515cc-b349-51af-8401-a6d8f0ed83fd
2026-03-27 10:38:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6d515cc-b349-51af-8401-a6d8f0ed83fd, skipping ID generation
2026-03-27 10:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6d515cc-b349-51af-8401-a6d8f0ed83fd with scrape type 1
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6d515cc-b349-51af-8401-a6d8f0ed83fd sending to next pipeline
2026-03-27 10:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6d515cc-b349-51af-8401-a6d8f0ed83fd, identifier: MK03700
2026-03-27 10:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6d515cc-b349-51af-8401-a6d8f0ed83fd with identifier: MK03700
2026-03-27 10:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6d515cc-b349-51af-8401-a6d8f0ed83fd with identifier: MK03700
2026-03-27 10:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6d515cc-b349-51af-8401-a6d8f0ed83fd with identifier: MK03700 to the API
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_5793db461bdeb1e5b004383d3ea425cb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:01:25Z',
 'fuel_type': 'petrol',
 'id': 'c6d515cc-b349-51af-8401-a6d8f0ed83fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK03700',
 'listing': 'auction',
 'location': 'DE, Bischberg',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 133985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6d515cc-b349-51af-8401-a6d8f0ed83fd/c6d515cc-b349-51af-8401-a6d8f0ed83fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_5793db461bdeb1e5b004383d3ea425cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6d515cc-b349-51af-8401-a6d8f0ed83fd/c6d515cc-b349-51af-8401-a6d8f0ed83fd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_18dae674db39fa0be634502b0b2f0e1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6d515cc-b349-51af-8401-a6d8f0ed83fd/c6d515cc-b349-51af-8401-a6d8f0ed83fd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_2516a06aeb1e8894d9b49fe9e9093305.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6d515cc-b349-51af-8401-a6d8f0ed83fd/c6d515cc-b349-51af-8401-a6d8f0ed83fd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_7117124c4f2de65009540a7a289d75c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6d515cc-b349-51af-8401-a6d8f0ed83fd/c6d515cc-b349-51af-8401-a6d8f0ed83fd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_32c7046b577b78e06e16152b85c6956f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6d515cc-b349-51af-8401-a6d8f0ed83fd/c6d515cc-b349-51af-8401-a6d8f0ed83fd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/62/7762a44988075e925b3c961c5095da23/pa/MK03700_15229eb67c3975d888abdb383350332d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kangoo 1.2 Edition Campus',
 'transmission': 'manual',
 'trim': 'Edition Campus',
 'year': 2007}
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK03700%27 HTTP/1.1" 200 None
2026-03-27 10:38:27 [auto1.de] INFO: Saving data for MK03700: {'created_time': 1774607907.853747, 'last_price_update_time': 1774607907.853757, 'auction_closing_time': 1774713685.0}
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK03700') HTTP/1.1" 204 0
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6c%252F986c9f0ab177f7fa6d376ad88503d8cf%252Fpa%252FDJ93554_e75f1e2826452c539f745587c0046365.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_e75f1e2826452c539f745587c0046365.jpg not downloaded yet
2026-03-27 10:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_8a34dbda52aa80844cfe58a3ac317ee7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6c%252F986c9f0ab177f7fa6d376ad88503d8cf%252Fpa%252FDJ93554_6b449a2d07ecdf030d225158218216d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_6b449a2d07ecdf030d225158218216d8.jpg not downloaded yet
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501855550>
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7d60d65-98ae-59b3-9e5b-c52df001aa14/b7d60d65-98ae-59b3-9e5b-c52df001aa14_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fd0%252F56d018ca9ee4da5cc3b0a48f71991d19%252Fpa%252FLM85601_e9daf421ab1eef38c706446c85695416.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_e9daf421ab1eef38c706446c85695416.jpg saved to cache
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7d60d65-98ae-59b3-9e5b-c52df001aa14
2026-03-27 10:38:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7d60d65-98ae-59b3-9e5b-c52df001aa14, skipping ID generation
2026-03-27 10:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7d60d65-98ae-59b3-9e5b-c52df001aa14 with scrape type 1
2026-03-27 10:38:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7d60d65-98ae-59b3-9e5b-c52df001aa14 sending to next pipeline
2026-03-27 10:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7d60d65-98ae-59b3-9e5b-c52df001aa14, identifier: LM85601
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6c%252F986c9f0ab177f7fa6d376ad88503d8cf%252Fpa%252FDJ93554_f4a872180f64a275105de29ddf784939.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_f4a872180f64a275105de29ddf784939.jpg not downloaded yet
2026-03-27 10:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7d60d65-98ae-59b3-9e5b-c52df001aa14 with identifier: LM85601
2026-03-27 10:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7d60d65-98ae-59b3-9e5b-c52df001aa14 with identifier: LM85601
2026-03-27 10:38:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7d60d65-98ae-59b3-9e5b-c52df001aa14 with identifier: LM85601 to the API
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_e9daf421ab1eef38c706446c85695416.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:24:52Z',
 'fuel_type': 'petrol',
 'id': 'b7d60d65-98ae-59b3-9e5b-c52df001aa14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM85601',
 'listing': 'auction',
 'location': 'DE, Wuppertal',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 214569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d60d65-98ae-59b3-9e5b-c52df001aa14/b7d60d65-98ae-59b3-9e5b-c52df001aa14_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_e9daf421ab1eef38c706446c85695416.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d60d65-98ae-59b3-9e5b-c52df001aa14/b7d60d65-98ae-59b3-9e5b-c52df001aa14_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_985e37690ced3f94bc0b1b64f4cf3f69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d60d65-98ae-59b3-9e5b-c52df001aa14/b7d60d65-98ae-59b3-9e5b-c52df001aa14_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_46e3277941db1c83a6ce979b4e0f7420.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d60d65-98ae-59b3-9e5b-c52df001aa14/b7d60d65-98ae-59b3-9e5b-c52df001aa14_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2356287,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_0757a468b831ea8a8261d51b3e849b3f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d60d65-98ae-59b3-9e5b-c52df001aa14/b7d60d65-98ae-59b3-9e5b-c52df001aa14_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_d365eafab82486c7787686197c4d2205.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d60d65-98ae-59b3-9e5b-c52df001aa14/b7d60d65-98ae-59b3-9e5b-c52df001aa14_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2074848,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_59c75c1aec93f29d27d9469b7cc7d0c2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d60d65-98ae-59b3-9e5b-c52df001aa14/b7d60d65-98ae-59b3-9e5b-c52df001aa14_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_8996ba8505d4994bd570eff84b80e0ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d60d65-98ae-59b3-9e5b-c52df001aa14/b7d60d65-98ae-59b3-9e5b-c52df001aa14_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_d4714a731bc62fb9ccc5ee557b8cd9b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d60d65-98ae-59b3-9e5b-c52df001aa14/b7d60d65-98ae-59b3-9e5b-c52df001aa14_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_116eb1ce41fb59f121612eaf4806cb1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7d60d65-98ae-59b3-9e5b-c52df001aa14/b7d60d65-98ae-59b3-9e5b-c52df001aa14_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/d0/56d018ca9ee4da5cc3b0a48f71991d19/pa/LM85601_b21e3c2fe45708b0c705a86fa53a4407.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Dream Team 2WD',
 'transmission': 'manual',
 'trim': 'Dream Team 2WD',
 'year': 2013}
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85601%27 HTTP/1.1" 200 None
2026-03-27 10:38:28 [auto1.de] INFO: Saving data for LM85601: {'created_time': 1774607908.521715, 'last_price_update_time': 1774607908.521728, 'auction_closing_time': 1774715092.0}
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM85601') HTTP/1.1" 204 0
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6c%252F986c9f0ab177f7fa6d376ad88503d8cf%252Fpa%252FDJ93554_9255972dbfdb7fdb41e4b5b0f15f104d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_9255972dbfdb7fdb41e4b5b0f15f104d.jpg not downloaded yet
2026-03-27 10:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017e6d50>
2026-03-27 10:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45bfcb05-cc85-56f2-95b4-9652f8e5b570/45bfcb05-cc85-56f2-95b4-9652f8e5b570_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6c%252F986c9f0ab177f7fa6d376ad88503d8cf%252Fpa%252FDJ93554_8a34dbda52aa80844cfe58a3ac317ee7.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_8a34dbda52aa80844cfe58a3ac317ee7.jpg saved to cache
2026-03-27 10:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45bfcb05-cc85-56f2-95b4-9652f8e5b570
2026-03-27 10:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_e75f1e2826452c539f745587c0046365.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_9255972dbfdb7fdb41e4b5b0f15f104d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501748f10>
2026-03-27 10:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45bfcb05-cc85-56f2-95b4-9652f8e5b570/45bfcb05-cc85-56f2-95b4-9652f8e5b570_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6c%252F986c9f0ab177f7fa6d376ad88503d8cf%252Fpa%252FDJ93554_e75f1e2826452c539f745587c0046365.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_e75f1e2826452c539f745587c0046365.jpg saved to cache
2026-03-27 10:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 45bfcb05-cc85-56f2-95b4-9652f8e5b570
2026-03-27 10:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_f4a872180f64a275105de29ddf784939.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501749610>
2026-03-27 10:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45bfcb05-cc85-56f2-95b4-9652f8e5b570/45bfcb05-cc85-56f2-95b4-9652f8e5b570_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6c%252F986c9f0ab177f7fa6d376ad88503d8cf%252Fpa%252FDJ93554_9255972dbfdb7fdb41e4b5b0f15f104d.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_9255972dbfdb7fdb41e4b5b0f15f104d.jpg saved to cache
2026-03-27 10:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 45bfcb05-cc85-56f2-95b4-9652f8e5b570
2026-03-27 10:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500385d50>
2026-03-27 10:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45bfcb05-cc85-56f2-95b4-9652f8e5b570/45bfcb05-cc85-56f2-95b4-9652f8e5b570_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6c%252F986c9f0ab177f7fa6d376ad88503d8cf%252Fpa%252FDJ93554_f4a872180f64a275105de29ddf784939.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_f4a872180f64a275105de29ddf784939.jpg saved to cache
2026-03-27 10:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 45bfcb05-cc85-56f2-95b4-9652f8e5b570
2026-03-27 10:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_6b449a2d07ecdf030d225158218216d8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c2fd0>
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45bfcb05-cc85-56f2-95b4-9652f8e5b570/45bfcb05-cc85-56f2-95b4-9652f8e5b570_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6c%252F986c9f0ab177f7fa6d376ad88503d8cf%252Fpa%252FDJ93554_6b449a2d07ecdf030d225158218216d8.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_6b449a2d07ecdf030d225158218216d8.jpg saved to cache
2026-03-27 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 45bfcb05-cc85-56f2-95b4-9652f8e5b570
2026-03-27 10:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_8a698c483b01f648a3d1ec3b88660fcb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_062ff1d1d34063dcc1d438e24352b2c7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002fe390>
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45bfcb05-cc85-56f2-95b4-9652f8e5b570/45bfcb05-cc85-56f2-95b4-9652f8e5b570_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6c%252F986c9f0ab177f7fa6d376ad88503d8cf%252Fpa%252FDJ93554_8a698c483b01f648a3d1ec3b88660fcb.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_8a698c483b01f648a3d1ec3b88660fcb.jpg saved to cache
2026-03-27 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 45bfcb05-cc85-56f2-95b4-9652f8e5b570
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501822090>
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45bfcb05-cc85-56f2-95b4-9652f8e5b570/45bfcb05-cc85-56f2-95b4-9652f8e5b570_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6c%252F986c9f0ab177f7fa6d376ad88503d8cf%252Fpa%252FDJ93554_062ff1d1d34063dcc1d438e24352b2c7.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_062ff1d1d34063dcc1d438e24352b2c7.jpg saved to cache
2026-03-27 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45bfcb05-cc85-56f2-95b4-9652f8e5b570
2026-03-27 10:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_5fa64abfbe5676abb7595e59b3e46b30.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501656c90>
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45bfcb05-cc85-56f2-95b4-9652f8e5b570/45bfcb05-cc85-56f2-95b4-9652f8e5b570_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6c%252F986c9f0ab177f7fa6d376ad88503d8cf%252Fpa%252FDJ93554_5fa64abfbe5676abb7595e59b3e46b30.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_5fa64abfbe5676abb7595e59b3e46b30.jpg saved to cache
2026-03-27 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45bfcb05-cc85-56f2-95b4-9652f8e5b570
2026-03-27 10:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_c588f73441fee2cdbafbf395fd3ca097.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_c2506b442f41f13e809d78791602785c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c24d0>
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45bfcb05-cc85-56f2-95b4-9652f8e5b570/45bfcb05-cc85-56f2-95b4-9652f8e5b570_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6c%252F986c9f0ab177f7fa6d376ad88503d8cf%252Fpa%252FDJ93554_c588f73441fee2cdbafbf395fd3ca097.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_c588f73441fee2cdbafbf395fd3ca097.jpg saved to cache
2026-03-27 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45bfcb05-cc85-56f2-95b4-9652f8e5b570
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501655fd0>
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45bfcb05-cc85-56f2-95b4-9652f8e5b570/45bfcb05-cc85-56f2-95b4-9652f8e5b570_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6c%252F986c9f0ab177f7fa6d376ad88503d8cf%252Fpa%252FDJ93554_c2506b442f41f13e809d78791602785c.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_c2506b442f41f13e809d78791602785c.jpg saved to cache
2026-03-27 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45bfcb05-cc85-56f2-95b4-9652f8e5b570
2026-03-27 10:38:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45bfcb05-cc85-56f2-95b4-9652f8e5b570, skipping ID generation
2026-03-27 10:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45bfcb05-cc85-56f2-95b4-9652f8e5b570 with scrape type 1
2026-03-27 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45bfcb05-cc85-56f2-95b4-9652f8e5b570 sending to next pipeline
2026-03-27 10:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45bfcb05-cc85-56f2-95b4-9652f8e5b570, identifier: DJ93554
2026-03-27 10:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45bfcb05-cc85-56f2-95b4-9652f8e5b570 with identifier: DJ93554
2026-03-27 10:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45bfcb05-cc85-56f2-95b4-9652f8e5b570 with identifier: DJ93554
2026-03-27 10:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45bfcb05-cc85-56f2-95b4-9652f8e5b570 with identifier: DJ93554 to the API
2026-03-27 10:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_c2506b442f41f13e809d78791602785c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:21:57Z',
 'fuel_type': 'petrol',
 'id': '45bfcb05-cc85-56f2-95b4-9652f8e5b570',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ93554',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 40873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45bfcb05-cc85-56f2-95b4-9652f8e5b570/45bfcb05-cc85-56f2-95b4-9652f8e5b570_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_c2506b442f41f13e809d78791602785c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45bfcb05-cc85-56f2-95b4-9652f8e5b570/45bfcb05-cc85-56f2-95b4-9652f8e5b570_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_c588f73441fee2cdbafbf395fd3ca097.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45bfcb05-cc85-56f2-95b4-9652f8e5b570/45bfcb05-cc85-56f2-95b4-9652f8e5b570_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_8a34dbda52aa80844cfe58a3ac317ee7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45bfcb05-cc85-56f2-95b4-9652f8e5b570/45bfcb05-cc85-56f2-95b4-9652f8e5b570_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_5fa64abfbe5676abb7595e59b3e46b30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45bfcb05-cc85-56f2-95b4-9652f8e5b570/45bfcb05-cc85-56f2-95b4-9652f8e5b570_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_062ff1d1d34063dcc1d438e24352b2c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45bfcb05-cc85-56f2-95b4-9652f8e5b570/45bfcb05-cc85-56f2-95b4-9652f8e5b570_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_8a698c483b01f648a3d1ec3b88660fcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45bfcb05-cc85-56f2-95b4-9652f8e5b570/45bfcb05-cc85-56f2-95b4-9652f8e5b570_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_e75f1e2826452c539f745587c0046365.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45bfcb05-cc85-56f2-95b4-9652f8e5b570/45bfcb05-cc85-56f2-95b4-9652f8e5b570_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_6b449a2d07ecdf030d225158218216d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45bfcb05-cc85-56f2-95b4-9652f8e5b570/45bfcb05-cc85-56f2-95b4-9652f8e5b570_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_f4a872180f64a275105de29ddf784939.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45bfcb05-cc85-56f2-95b4-9652f8e5b570/45bfcb05-cc85-56f2-95b4-9652f8e5b570_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6c/986c9f0ab177f7fa6d376ad88503d8cf/pa/DJ93554_9255972dbfdb7fdb41e4b5b0f15f104d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 40 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2023}
2026-03-27 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ93554%27 HTTP/1.1" 200 None
2026-03-27 10:38:30 [auto1.de] INFO: Saving data for DJ93554: {'created_time': 1774607910.329623, 'last_price_update_time': 1774607910.329634, 'auction_closing_time': 1774714917.0}
2026-03-27 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ93554') HTTP/1.1" 204 0
2026-03-27 10:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:42 [auto1.de] INFO: Channel: 24h | Page: 11 | totalHits: 10507 | hits on page: 40
2026-03-27 10:38:42 [auto1.de] INFO: Found listing with ID: SU14525
2026-03-27 10:38:42 [auto1.de] INFO: Found listing with ID: AR33954
2026-03-27 10:38:42 [auto1.de] INFO: Found listing with ID: XH92207
2026-03-27 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH92207%27 HTTP/1.1" 200 None
2026-03-27 10:38:42 [auto1.de] INFO: Scrape type for XH92207: 1
2026-03-27 10:38:42 [auto1.de] INFO: Found listing with ID: FL90187
2026-03-27 10:38:42 [auto1.de] INFO: Found listing with ID: WB38942
2026-03-27 10:38:42 [auto1.de] INFO: Found listing with ID: XT08525
2026-03-27 10:38:42 [auto1.de] INFO: Found listing with ID: EX64550
2026-03-27 10:38:42 [auto1.de] INFO: Found listing with ID: FZ93202
2026-03-27 10:38:42 [auto1.de] INFO: Found listing with ID: YP37345
2026-03-27 10:38:42 [auto1.de] INFO: Found listing with ID: BD51611
2026-03-27 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD51611%27 HTTP/1.1" 200 None
2026-03-27 10:38:42 [auto1.de] INFO: Scrape type for BD51611: 1
2026-03-27 10:38:42 [auto1.de] INFO: Found listing with ID: TT34897
2026-03-27 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT34897%27 HTTP/1.1" 200 None
2026-03-27 10:38:42 [auto1.de] INFO: Scrape type for TT34897: 1
2026-03-27 10:38:42 [auto1.de] INFO: Found listing with ID: ML20845
2026-03-27 10:38:42 [auto1.de] INFO: Found listing with ID: BN78852
2026-03-27 10:38:42 [auto1.de] INFO: Found listing with ID: ZT20326
2026-03-27 10:38:42 [auto1.de] INFO: Found listing with ID: VG97349
2026-03-27 10:38:42 [auto1.de] INFO: Found listing with ID: BK65604
2026-03-27 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK65604%27 HTTP/1.1" 200 None
2026-03-27 10:38:42 [auto1.de] INFO: Scrape type for BK65604: 1
2026-03-27 10:38:42 [auto1.de] INFO: Found listing with ID: WS02654
2026-03-27 10:38:42 [auto1.de] INFO: Found listing with ID: EP70088
2026-03-27 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP70088%27 HTTP/1.1" 200 None
2026-03-27 10:38:42 [auto1.de] INFO: Scrape type for EP70088: 1
2026-03-27 10:38:42 [auto1.de] INFO: Found listing with ID: VB62953
2026-03-27 10:38:42 [auto1.de] INFO: Found listing with ID: LE21956
2026-03-27 10:38:42 [auto1.de] INFO: Found listing with ID: XH60803
2026-03-27 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH60803%27 HTTP/1.1" 200 None
2026-03-27 10:38:42 [auto1.de] INFO: Scrape type for XH60803: 2
2026-03-27 10:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f10d7e07-2d9b-5fc3-af76-43281d86d1cc with identifier: XH60803
2026-03-27 10:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f10d7e07-2d9b-5fc3-af76-43281d86d1cc with scrape type 2
2026-03-27 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f10d7e07-2d9b-5fc3-af76-43281d86d1cc with scrape type 2
2026-03-27 10:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f10d7e07-2d9b-5fc3-af76-43281d86d1cc, identifier: XH60803
2026-03-27 10:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f10d7e07-2d9b-5fc3-af76-43281d86d1cc with identifier: XH60803
2026-03-27 10:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f10d7e07-2d9b-5fc3-af76-43281d86d1cc with identifier: XH60803
2026-03-27 10:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f10d7e07-2d9b-5fc3-af76-43281d86d1cc with identifier: XH60803 to the API
2026-03-27 10:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:02:20Z',
 'fuel_type': 'diesel',
 'id': 'f10d7e07-2d9b-5fc3-af76-43281d86d1cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH60803',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 265844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-03-27 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH60803%27 HTTP/1.1" 200 None
2026-03-27 10:38:42 [auto1.de] INFO: Saving data for XH60803: {'auction_closing_time': 1774713740.0, 'created_time': 1774034973.94635, 'last_price_update_time': 1774607922.965852}
2026-03-27 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH60803') HTTP/1.1" 204 0
2026-03-27 10:38:43 [auto1.de] INFO: Found listing with ID: KH20562
2026-03-27 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH20562%27 HTTP/1.1" 200 None
2026-03-27 10:38:43 [auto1.de] INFO: Scrape type for KH20562: 2
2026-03-27 10:38:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e22452bb-7a4a-5b55-90c2-e7e48a451095 with identifier: KH20562
2026-03-27 10:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e22452bb-7a4a-5b55-90c2-e7e48a451095 with scrape type 2
2026-03-27 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e22452bb-7a4a-5b55-90c2-e7e48a451095 with scrape type 2
2026-03-27 10:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e22452bb-7a4a-5b55-90c2-e7e48a451095, identifier: KH20562
2026-03-27 10:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e22452bb-7a4a-5b55-90c2-e7e48a451095 with identifier: KH20562
2026-03-27 10:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e22452bb-7a4a-5b55-90c2-e7e48a451095 with identifier: KH20562
2026-03-27 10:38:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e22452bb-7a4a-5b55-90c2-e7e48a451095 with identifier: KH20562 to the API
2026-03-27 10:38:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:40:15Z',
 'fuel_type': 'petrol',
 'id': 'e22452bb-7a4a-5b55-90c2-e7e48a451095',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH20562',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 107445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-25',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CGI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-27 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH20562%27 HTTP/1.1" 200 None
2026-03-27 10:38:43 [auto1.de] INFO: Saving data for KH20562: {'auction_closing_time': 1774716015.0, 'created_time': 1773341572.003589, 'last_price_update_time': 1774607923.531012}
2026-03-27 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH20562') HTTP/1.1" 204 0
2026-03-27 10:38:43 [auto1.de] INFO: Found listing with ID: KH96137
2026-03-27 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH96137%27 HTTP/1.1" 200 None
2026-03-27 10:38:43 [auto1.de] INFO: Scrape type for KH96137: 2
2026-03-27 10:38:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ee910bd-65a1-582f-bd5e-7f6162d01902 with identifier: KH96137
2026-03-27 10:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ee910bd-65a1-582f-bd5e-7f6162d01902 with scrape type 2
2026-03-27 10:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ee910bd-65a1-582f-bd5e-7f6162d01902 with scrape type 2
2026-03-27 10:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ee910bd-65a1-582f-bd5e-7f6162d01902, identifier: KH96137
2026-03-27 10:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ee910bd-65a1-582f-bd5e-7f6162d01902 with identifier: KH96137
2026-03-27 10:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ee910bd-65a1-582f-bd5e-7f6162d01902 with identifier: KH96137
2026-03-27 10:38:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ee910bd-65a1-582f-bd5e-7f6162d01902 with identifier: KH96137 to the API
2026-03-27 10:38:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:59:27Z',
 'fuel_type': 'diesel',
 'id': '7ee910bd-65a1-582f-bd5e-7f6162d01902',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH96137',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 224096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-24',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi 360',
 'transmission': 'automatic',
 'trim': '360',
 'year': 2015}
2026-03-27 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH96137%27 HTTP/1.1" 200 None
2026-03-27 10:38:43 [auto1.de] INFO: Saving data for KH96137: {'auction_closing_time': 1774717167.0, 'created_time': 1773830580.958743, 'last_price_update_time': 1774607923.995694}
2026-03-27 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH96137') HTTP/1.1" 204 0
2026-03-27 10:38:44 [auto1.de] INFO: Found listing with ID: EY23363
2026-03-27 10:38:44 [auto1.de] INFO: Found listing with ID: MU47356
2026-03-27 10:38:44 [auto1.de] INFO: Found listing with ID: FL14438
2026-03-27 10:38:44 [auto1.de] INFO: Found listing with ID: JS49483
2026-03-27 10:38:44 [auto1.de] INFO: Found listing with ID: PY44699
2026-03-27 10:38:44 [auto1.de] INFO: Found listing with ID: HA69467
2026-03-27 10:38:44 [auto1.de] INFO: Found listing with ID: CJ94642
2026-03-27 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ94642%27 HTTP/1.1" 200 None
2026-03-27 10:38:44 [auto1.de] INFO: Scrape type for CJ94642: 2
2026-03-27 10:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6782bfd-9371-5a5e-9668-335f14764b8a with identifier: CJ94642
2026-03-27 10:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6782bfd-9371-5a5e-9668-335f14764b8a with scrape type 2
2026-03-27 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6782bfd-9371-5a5e-9668-335f14764b8a with scrape type 2
2026-03-27 10:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6782bfd-9371-5a5e-9668-335f14764b8a, identifier: CJ94642
2026-03-27 10:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6782bfd-9371-5a5e-9668-335f14764b8a with identifier: CJ94642
2026-03-27 10:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6782bfd-9371-5a5e-9668-335f14764b8a with identifier: CJ94642
2026-03-27 10:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6782bfd-9371-5a5e-9668-335f14764b8a with identifier: CJ94642 to the API
2026-03-27 10:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:49:42Z',
 'fuel_type': 'diesel',
 'id': 'd6782bfd-9371-5a5e-9668-335f14764b8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ94642',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 217323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-06',
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2011}
2026-03-27 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ94642%27 HTTP/1.1" 200 None
2026-03-27 10:38:44 [auto1.de] INFO: Saving data for CJ94642: {'auction_closing_time': 1774716582.0, 'created_time': 1773688146.343724, 'last_price_update_time': 1774607924.479552}
2026-03-27 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ94642') HTTP/1.1" 204 0
2026-03-27 10:38:44 [auto1.de] INFO: Found listing with ID: SD45668
2026-03-27 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD45668%27 HTTP/1.1" 200 None
2026-03-27 10:38:44 [auto1.de] INFO: Scrape type for SD45668: 2
2026-03-27 10:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71046146-e93c-553f-b627-7916516e0c27 with identifier: SD45668
2026-03-27 10:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71046146-e93c-553f-b627-7916516e0c27 with scrape type 2
2026-03-27 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71046146-e93c-553f-b627-7916516e0c27 with scrape type 2
2026-03-27 10:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71046146-e93c-553f-b627-7916516e0c27, identifier: SD45668
2026-03-27 10:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71046146-e93c-553f-b627-7916516e0c27 with identifier: SD45668
2026-03-27 10:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:38:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-27 10:38:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71046146-e93c-553f-b627-7916516e0c27 with identifier: SD45668
2026-03-27 10:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71046146-e93c-553f-b627-7916516e0c27 with identifier: SD45668 to the API
2026-03-27 10:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:00:27Z',
 'fuel_type': 'diesel',
 'id': '71046146-e93c-553f-b627-7916516e0c27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD45668',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 230322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-03',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 CDI T BlueEfficiency Elegance',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Elegance',
 'year': 2010}
2026-03-27 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD45668%27 HTTP/1.1" 200 None
2026-03-27 10:38:45 [auto1.de] INFO: Saving data for SD45668: {'auction_closing_time': 1774713627.0, 'created_time': 1773646538.524547, 'last_price_update_time': 1774607925.083557}
2026-03-27 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD45668') HTTP/1.1" 204 0
2026-03-27 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA75512/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:45 [auto1.de] INFO: Found listing with ID: FX08537
2026-03-27 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX08537%27 HTTP/1.1" 200 None
2026-03-27 10:38:45 [auto1.de] INFO: Scrape type for FX08537: 2
2026-03-27 10:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2 with identifier: FX08537
2026-03-27 10:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2 with scrape type 2
2026-03-27 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2 with scrape type 2
2026-03-27 10:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2, identifier: FX08537
2026-03-27 10:38:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2 with identifier: FX08537
2026-03-27 10:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2 with identifier: FX08537
2026-03-27 10:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2 with identifier: FX08537 to the API
2026-03-27 10:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:24:15Z',
 'fuel_type': 'diesel',
 'id': 'fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX08537',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 211393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-03',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Style blue 2WD',
 'transmission': 'automatic',
 'trim': 'Style blue 2WD',
 'year': 2017}
2026-03-27 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX08537%27 HTTP/1.1" 200 None
2026-03-27 10:38:45 [auto1.de] INFO: Saving data for FX08537: {'auction_closing_time': 1774715055.0, 'created_time': 1774292788.054162, 'last_price_update_time': 1774607925.5533}
2026-03-27 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX08537') HTTP/1.1" 204 0
2026-03-27 10:38:45 [auto1.de] INFO: Found listing with ID: CE85756
2026-03-27 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE85756%27 HTTP/1.1" 200 None
2026-03-27 10:38:45 [auto1.de] INFO: Scrape type for CE85756: 1
2026-03-27 10:38:45 [auto1.de] INFO: Found listing with ID: SF33056
2026-03-27 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF33056%27 HTTP/1.1" 200 None
2026-03-27 10:38:45 [auto1.de] INFO: Scrape type for SF33056: 2
2026-03-27 10:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 888b1695-1cc5-5889-b6b7-4445200e45b4 with identifier: SF33056
2026-03-27 10:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 888b1695-1cc5-5889-b6b7-4445200e45b4 with scrape type 2
2026-03-27 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 888b1695-1cc5-5889-b6b7-4445200e45b4 with scrape type 2
2026-03-27 10:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 888b1695-1cc5-5889-b6b7-4445200e45b4, identifier: SF33056
2026-03-27 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE17013/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 888b1695-1cc5-5889-b6b7-4445200e45b4 with identifier: SF33056
2026-03-27 10:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 888b1695-1cc5-5889-b6b7-4445200e45b4 with identifier: SF33056
2026-03-27 10:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 888b1695-1cc5-5889-b6b7-4445200e45b4 with identifier: SF33056 to the API
2026-03-27 10:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:23:57Z',
 'fuel_type': 'petrol',
 'id': '888b1695-1cc5-5889-b6b7-4445200e45b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF33056',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 40286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-07',
 'seller_name': None,
 'title': 'Hyundai i10 1.2 Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2012}
2026-03-27 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF33056%27 HTTP/1.1" 200 None
2026-03-27 10:38:46 [auto1.de] INFO: Saving data for SF33056: {'auction_closing_time': 1774715037.0, 'created_time': 1773302822.228211, 'last_price_update_time': 1774607926.169004}
2026-03-27 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF33056') HTTP/1.1" 204 0
2026-03-27 10:38:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:46 [auto1.de] INFO: Found listing with ID: ZV33449
2026-03-27 10:38:46 [auto1.de] INFO: Found listing with ID: SA55190
2026-03-27 10:38:46 [auto1.de] INFO: Found listing with ID: JK17459
2026-03-27 10:38:46 [auto1.de] INFO: Found listing with ID: BG14243
2026-03-27 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG14243%27 HTTP/1.1" 200 None
2026-03-27 10:38:46 [auto1.de] INFO: Scrape type for BG14243: 2
2026-03-27 10:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c42063c-1d88-5c02-b4ba-e1fb1838ffce with identifier: BG14243
2026-03-27 10:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c42063c-1d88-5c02-b4ba-e1fb1838ffce with scrape type 2
2026-03-27 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c42063c-1d88-5c02-b4ba-e1fb1838ffce with scrape type 2
2026-03-27 10:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c42063c-1d88-5c02-b4ba-e1fb1838ffce, identifier: BG14243
2026-03-27 10:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c42063c-1d88-5c02-b4ba-e1fb1838ffce with identifier: BG14243
2026-03-27 10:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c42063c-1d88-5c02-b4ba-e1fb1838ffce with identifier: BG14243
2026-03-27 10:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c42063c-1d88-5c02-b4ba-e1fb1838ffce with identifier: BG14243 to the API
2026-03-27 10:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-28T16:43:06Z',
 'fuel_type': 'petrol',
 'id': '2c42063c-1d88-5c02-b4ba-e1fb1838ffce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG14243',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 92563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-13',
 'seller_name': None,
 'title': 'Ford Focus 2.0 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2016}
2026-03-27 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG14243%27 HTTP/1.1" 200 None
2026-03-27 10:38:46 [auto1.de] INFO: Saving data for BG14243: {'auction_closing_time': 1774716186.0, 'created_time': 1774293982.656612, 'last_price_update_time': 1774607926.624973}
2026-03-27 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG14243') HTTP/1.1" 204 0
2026-03-27 10:38:46 [auto1.de] INFO: Found listing with ID: BG81908
2026-03-27 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG81908%27 HTTP/1.1" 200 None
2026-03-27 10:38:46 [auto1.de] INFO: Scrape type for BG81908: 2
2026-03-27 10:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1582a76a-7768-5657-bbaa-47d7cb91b1e1 with identifier: BG81908
2026-03-27 10:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1582a76a-7768-5657-bbaa-47d7cb91b1e1 with scrape type 2
2026-03-27 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1582a76a-7768-5657-bbaa-47d7cb91b1e1 with scrape type 2
2026-03-27 10:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1582a76a-7768-5657-bbaa-47d7cb91b1e1, identifier: BG81908
2026-03-27 10:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1582a76a-7768-5657-bbaa-47d7cb91b1e1 with identifier: BG81908
2026-03-27 10:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1582a76a-7768-5657-bbaa-47d7cb91b1e1 with identifier: BG81908
2026-03-27 10:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1582a76a-7768-5657-bbaa-47d7cb91b1e1 with identifier: BG81908 to the API
2026-03-27 10:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:42:53Z',
 'fuel_type': 'petrol',
 'id': '1582a76a-7768-5657-bbaa-47d7cb91b1e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG81908',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 6474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 TSI ACT Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2022}
2026-03-27 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG81908%27 HTTP/1.1" 200 None
2026-03-27 10:38:47 [auto1.de] INFO: Saving data for BG81908: {'auction_closing_time': 1774716173.0, 'created_time': 1774294694.658125, 'last_price_update_time': 1774607927.094762}
2026-03-27 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG81908') HTTP/1.1" 204 0
2026-03-27 10:38:47 [auto1.de] INFO: Found listing with ID: HG45518
2026-03-27 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR67018/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU14525/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BD50097> (referer: https://www.auto1.com/v1/car-details-view/BD50097/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af297216-e1f5-5156-a455-3c8afaf1467b with identifier: BD50097
2026-03-27 10:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af297216-e1f5-5156-a455-3c8afaf1467b with scrape type 1
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af297216-e1f5-5156-a455-3c8afaf1467b
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F45%252F4b45abc4733fc22d71027bedaed97457%252Fpa%252FBD50097_f4203bbf8ad1cc81fc33a482cfe7b3ab.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_f4203bbf8ad1cc81fc33a482cfe7b3ab.jpg not downloaded yet
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F45%252F4b45abc4733fc22d71027bedaed97457%252Fpa%252FBD50097_dc11648b75f7bd1c4ca976158a03530e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_dc11648b75f7bd1c4ca976158a03530e.jpg not downloaded yet
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F45%252F4b45abc4733fc22d71027bedaed97457%252Fpa%252FBD50097_4f198c2ddc3d19b0726c88b052940b11.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_4f198c2ddc3d19b0726c88b052940b11.jpg not downloaded yet
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F45%252F4b45abc4733fc22d71027bedaed97457%252Fpa%252FBD50097_f4f1594f1593eb7b092a2a29527ecddc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_f4f1594f1593eb7b092a2a29527ecddc.jpg not downloaded yet
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F45%252F4b45abc4733fc22d71027bedaed97457%252Fpa%252FBD50097_6c2034ab7bc3b17640dd053f0f3e1995.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_6c2034ab7bc3b17640dd053f0f3e1995.jpg not downloaded yet
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F45%252F4b45abc4733fc22d71027bedaed97457%252Fpa%252FBD50097_d49b6abe5c668633bf11b06acdaada7b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_d49b6abe5c668633bf11b06acdaada7b.jpg not downloaded yet
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F45%252F4b45abc4733fc22d71027bedaed97457%252Fpa%252FBD50097_69c815c5180f70c402646922fde7f63a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_69c815c5180f70c402646922fde7f63a.jpg not downloaded yet
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F45%252F4b45abc4733fc22d71027bedaed97457%252Fpa%252FBD50097_bed8f411e38996ba5d79ff7054c67fca.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_bed8f411e38996ba5d79ff7054c67fca.jpg not downloaded yet
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F45%252F4b45abc4733fc22d71027bedaed97457%252Fpa%252FBD50097_ef357b531db63bcc86c29902a715c360.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_ef357b531db63bcc86c29902a715c360.jpg not downloaded yet
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F45%252F4b45abc4733fc22d71027bedaed97457%252Fpa%252FBD50097_f7938423e46dcaabbe965db7e99842bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_f7938423e46dcaabbe965db7e99842bf.jpg not downloaded yet
2026-03-27 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS81106> (referer: https://www.auto1.com/v1/car-details-view/YS81106/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0684b6c-6f56-5f95-8f3d-5dd375dd0713 with identifier: YS81106
2026-03-27 10:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0684b6c-6f56-5f95-8f3d-5dd375dd0713 with scrape type 1
2026-03-27 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b0684b6c-6f56-5f95-8f3d-5dd375dd0713
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd5%252Fc5d5e86c6c1a93fc482b85fd6d758750%252Fpa%252FYS81106_34cd0122692d74cfbe19372b470e29c1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_34cd0122692d74cfbe19372b470e29c1.jpg not downloaded yet
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd5%252Fc5d5e86c6c1a93fc482b85fd6d758750%252Fpa%252FYS81106_5e8d2c2468c71a813c66e36dba59a688.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_5e8d2c2468c71a813c66e36dba59a688.jpg not downloaded yet
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd5%252Fc5d5e86c6c1a93fc482b85fd6d758750%252Fpa%252FYS81106_f6ee1e8bee8b7777c81e23ce3b5db31c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_f6ee1e8bee8b7777c81e23ce3b5db31c.jpg not downloaded yet
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd5%252Fc5d5e86c6c1a93fc482b85fd6d758750%252Fpa%252FYS81106_1bf0e48b46f21825113f39ba2c96aeea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_1bf0e48b46f21825113f39ba2c96aeea.jpg not downloaded yet
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd5%252Fc5d5e86c6c1a93fc482b85fd6d758750%252Fpa%252FYS81106_0795359a4bdabbcad09da4035aee85cd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_0795359a4bdabbcad09da4035aee85cd.jpg not downloaded yet
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd5%252Fc5d5e86c6c1a93fc482b85fd6d758750%252Fpa%252FYS81106_7db2157e00ab1a2ad2597633e99cf6df.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_7db2157e00ab1a2ad2597633e99cf6df.jpg not downloaded yet
2026-03-27 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EX22671/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd5%252Fc5d5e86c6c1a93fc482b85fd6d758750%252Fpa%252FYS81106_e2731604a4800489e6059aa8c7984ff4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_e2731604a4800489e6059aa8c7984ff4.jpg not downloaded yet
2026-03-27 10:38:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd5%252Fc5d5e86c6c1a93fc482b85fd6d758750%252Fpa%252FYS81106_7477fdab61b1b3ba467b4827d20c5774.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_7477fdab61b1b3ba467b4827d20c5774.jpg not downloaded yet
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd5%252Fc5d5e86c6c1a93fc482b85fd6d758750%252Fpa%252FYS81106_96e566d30052f9d5e17d559b3cdf0ac6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_96e566d30052f9d5e17d559b3cdf0ac6.jpg not downloaded yet
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd5%252Fc5d5e86c6c1a93fc482b85fd6d758750%252Fpa%252FYS81106_b9fb45d5f347fdf33b7a0abd3753e58f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_b9fb45d5f347fdf33b7a0abd3753e58f.jpg not downloaded yet
2026-03-27 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_7db2157e00ab1a2ad2597633e99cf6df.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_f7938423e46dcaabbe965db7e99842bf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50371d1d0>
2026-03-27 10:38:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0684b6c-6f56-5f95-8f3d-5dd375dd0713/b0684b6c-6f56-5f95-8f3d-5dd375dd0713_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd5%252Fc5d5e86c6c1a93fc482b85fd6d758750%252Fpa%252FYS81106_7db2157e00ab1a2ad2597633e99cf6df.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_7db2157e00ab1a2ad2597633e99cf6df.jpg saved to cache
2026-03-27 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b0684b6c-6f56-5f95-8f3d-5dd375dd0713
2026-03-27 10:38:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016fd710>
2026-03-27 10:38:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af297216-e1f5-5156-a455-3c8afaf1467b/af297216-e1f5-5156-a455-3c8afaf1467b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F45%252F4b45abc4733fc22d71027bedaed97457%252Fpa%252FBD50097_f7938423e46dcaabbe965db7e99842bf.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_f7938423e46dcaabbe965db7e99842bf.jpg saved to cache
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af297216-e1f5-5156-a455-3c8afaf1467b
2026-03-27 10:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_b9fb45d5f347fdf33b7a0abd3753e58f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016dd690>
2026-03-27 10:38:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0684b6c-6f56-5f95-8f3d-5dd375dd0713/b0684b6c-6f56-5f95-8f3d-5dd375dd0713_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd5%252Fc5d5e86c6c1a93fc482b85fd6d758750%252Fpa%252FYS81106_b9fb45d5f347fdf33b7a0abd3753e58f.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_b9fb45d5f347fdf33b7a0abd3753e58f.jpg saved to cache
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b0684b6c-6f56-5f95-8f3d-5dd375dd0713
2026-03-27 10:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP29614/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_96e566d30052f9d5e17d559b3cdf0ac6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_7477fdab61b1b3ba467b4827d20c5774.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501957550>
2026-03-27 10:38:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0684b6c-6f56-5f95-8f3d-5dd375dd0713/b0684b6c-6f56-5f95-8f3d-5dd375dd0713_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd5%252Fc5d5e86c6c1a93fc482b85fd6d758750%252Fpa%252FYS81106_96e566d30052f9d5e17d559b3cdf0ac6.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_96e566d30052f9d5e17d559b3cdf0ac6.jpg saved to cache
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b0684b6c-6f56-5f95-8f3d-5dd375dd0713
2026-03-27 10:38:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501766350>
2026-03-27 10:38:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0684b6c-6f56-5f95-8f3d-5dd375dd0713/b0684b6c-6f56-5f95-8f3d-5dd375dd0713_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd5%252Fc5d5e86c6c1a93fc482b85fd6d758750%252Fpa%252FYS81106_7477fdab61b1b3ba467b4827d20c5774.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_7477fdab61b1b3ba467b4827d20c5774.jpg saved to cache
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b0684b6c-6f56-5f95-8f3d-5dd375dd0713
2026-03-27 10:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY47977> (referer: https://www.auto1.com/v1/car-details-view/XY47977/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_e2731604a4800489e6059aa8c7984ff4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366 with identifier: XY47977
2026-03-27 10:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366 with scrape type 1
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F18%252F6918cc743b71ea7ed0204fdae205c009%252Fpa%252FXY47977_f6cbe39917071da61b46153142069270.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_f6cbe39917071da61b46153142069270.jpg not downloaded yet
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F18%252F6918cc743b71ea7ed0204fdae205c009%252Fpa%252FXY47977_b58912ceb660978d27d513795f495ed2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_b58912ceb660978d27d513795f495ed2.jpg not downloaded yet
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F18%252F6918cc743b71ea7ed0204fdae205c009%252Fpa%252FXY47977_4e4a08461e26664dc561e1039c0bccca.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_4e4a08461e26664dc561e1039c0bccca.jpg not downloaded yet
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F18%252F6918cc743b71ea7ed0204fdae205c009%252Fpa%252FXY47977_0027f4e14dfc6ea186f2c2796f47d507.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_0027f4e14dfc6ea186f2c2796f47d507.jpg not downloaded yet
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F18%252F6918cc743b71ea7ed0204fdae205c009%252Fpa%252FXY47977_b68bb0330a6ac5b4f1ccf4117a7d3d0a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_b68bb0330a6ac5b4f1ccf4117a7d3d0a.jpg not downloaded yet
2026-03-27 10:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_1bf0e48b46f21825113f39ba2c96aeea.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F18%252F6918cc743b71ea7ed0204fdae205c009%252Fpa%252FXY47977_315492cba642d4f76b175e4db16a9fb1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_315492cba642d4f76b175e4db16a9fb1.jpg not downloaded yet
2026-03-27 10:38:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f9750>
2026-03-27 10:38:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0684b6c-6f56-5f95-8f3d-5dd375dd0713/b0684b6c-6f56-5f95-8f3d-5dd375dd0713_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd5%252Fc5d5e86c6c1a93fc482b85fd6d758750%252Fpa%252FYS81106_e2731604a4800489e6059aa8c7984ff4.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_e2731604a4800489e6059aa8c7984ff4.jpg saved to cache
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b0684b6c-6f56-5f95-8f3d-5dd375dd0713
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F18%252F6918cc743b71ea7ed0204fdae205c009%252Fpa%252FXY47977_bf3e5731cee24ef6b4675f66b1f9dd89.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_bf3e5731cee24ef6b4675f66b1f9dd89.jpg not downloaded yet
2026-03-27 10:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_0795359a4bdabbcad09da4035aee85cd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F18%252F6918cc743b71ea7ed0204fdae205c009%252Fpa%252FXY47977_021d425b0d4b9d16a10173b4d23e1242.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_021d425b0d4b9d16a10173b4d23e1242.jpg not downloaded yet
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F18%252F6918cc743b71ea7ed0204fdae205c009%252Fpa%252FXY47977_05b963f38211a3fa4a9da601d997cacf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_05b963f38211a3fa4a9da601d997cacf.jpg not downloaded yet
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F18%252F6918cc743b71ea7ed0204fdae205c009%252Fpa%252FXY47977_1603cc796452ecd17e4a2210f7890b5b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_1603cc796452ecd17e4a2210f7890b5b.jpg not downloaded yet
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017e5990>
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0684b6c-6f56-5f95-8f3d-5dd375dd0713/b0684b6c-6f56-5f95-8f3d-5dd375dd0713_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd5%252Fc5d5e86c6c1a93fc482b85fd6d758750%252Fpa%252FYS81106_1bf0e48b46f21825113f39ba2c96aeea.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_1bf0e48b46f21825113f39ba2c96aeea.jpg saved to cache
2026-03-27 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0684b6c-6f56-5f95-8f3d-5dd375dd0713
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50175db90>
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0684b6c-6f56-5f95-8f3d-5dd375dd0713/b0684b6c-6f56-5f95-8f3d-5dd375dd0713_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd5%252Fc5d5e86c6c1a93fc482b85fd6d758750%252Fpa%252FYS81106_0795359a4bdabbcad09da4035aee85cd.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_0795359a4bdabbcad09da4035aee85cd.jpg saved to cache
2026-03-27 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b0684b6c-6f56-5f95-8f3d-5dd375dd0713
2026-03-27 10:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_bf3e5731cee24ef6b4675f66b1f9dd89.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_b68bb0330a6ac5b4f1ccf4117a7d3d0a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a3390>
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ada0154-2dce-5ea5-ac7f-71d4a6dcc366/3ada0154-2dce-5ea5-ac7f-71d4a6dcc366_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F18%252F6918cc743b71ea7ed0204fdae205c009%252Fpa%252FXY47977_bf3e5731cee24ef6b4675f66b1f9dd89.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_bf3e5731cee24ef6b4675f66b1f9dd89.jpg saved to cache
2026-03-27 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366
2026-03-27 10:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_1603cc796452ecd17e4a2210f7890b5b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50059ec90>
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ada0154-2dce-5ea5-ac7f-71d4a6dcc366/3ada0154-2dce-5ea5-ac7f-71d4a6dcc366_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F18%252F6918cc743b71ea7ed0204fdae205c009%252Fpa%252FXY47977_b68bb0330a6ac5b4f1ccf4117a7d3d0a.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_b68bb0330a6ac5b4f1ccf4117a7d3d0a.jpg saved to cache
2026-03-27 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366
2026-03-27 10:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP70088/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_05b963f38211a3fa4a9da601d997cacf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018b3e50>
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ada0154-2dce-5ea5-ac7f-71d4a6dcc366/3ada0154-2dce-5ea5-ac7f-71d4a6dcc366_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F18%252F6918cc743b71ea7ed0204fdae205c009%252Fpa%252FXY47977_1603cc796452ecd17e4a2210f7890b5b.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_1603cc796452ecd17e4a2210f7890b5b.jpg saved to cache
2026-03-27 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50035ce10>
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ada0154-2dce-5ea5-ac7f-71d4a6dcc366/3ada0154-2dce-5ea5-ac7f-71d4a6dcc366_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F18%252F6918cc743b71ea7ed0204fdae205c009%252Fpa%252FXY47977_05b963f38211a3fa4a9da601d997cacf.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_05b963f38211a3fa4a9da601d997cacf.jpg saved to cache
2026-03-27 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366
2026-03-27 10:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_315492cba642d4f76b175e4db16a9fb1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_021d425b0d4b9d16a10173b4d23e1242.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50175f990>
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ada0154-2dce-5ea5-ac7f-71d4a6dcc366/3ada0154-2dce-5ea5-ac7f-71d4a6dcc366_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F18%252F6918cc743b71ea7ed0204fdae205c009%252Fpa%252FXY47977_315492cba642d4f76b175e4db16a9fb1.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_315492cba642d4f76b175e4db16a9fb1.jpg saved to cache
2026-03-27 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366
2026-03-27 10:38:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501940a90>
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ada0154-2dce-5ea5-ac7f-71d4a6dcc366/3ada0154-2dce-5ea5-ac7f-71d4a6dcc366_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F18%252F6918cc743b71ea7ed0204fdae205c009%252Fpa%252FXY47977_021d425b0d4b9d16a10173b4d23e1242.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_021d425b0d4b9d16a10173b4d23e1242.jpg saved to cache
2026-03-27 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366
2026-03-27 10:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_4e4a08461e26664dc561e1039c0bccca.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018ac850>
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ada0154-2dce-5ea5-ac7f-71d4a6dcc366/3ada0154-2dce-5ea5-ac7f-71d4a6dcc366_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F18%252F6918cc743b71ea7ed0204fdae205c009%252Fpa%252FXY47977_4e4a08461e26664dc561e1039c0bccca.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_4e4a08461e26664dc561e1039c0bccca.jpg saved to cache
2026-03-27 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366
2026-03-27 10:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_0027f4e14dfc6ea186f2c2796f47d507.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_b58912ceb660978d27d513795f495ed2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a0a90>
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ada0154-2dce-5ea5-ac7f-71d4a6dcc366/3ada0154-2dce-5ea5-ac7f-71d4a6dcc366_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F18%252F6918cc743b71ea7ed0204fdae205c009%252Fpa%252FXY47977_0027f4e14dfc6ea186f2c2796f47d507.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_0027f4e14dfc6ea186f2c2796f47d507.jpg saved to cache
2026-03-27 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366
2026-03-27 10:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_f6ee1e8bee8b7777c81e23ce3b5db31c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500393dd0>
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ada0154-2dce-5ea5-ac7f-71d4a6dcc366/3ada0154-2dce-5ea5-ac7f-71d4a6dcc366_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F18%252F6918cc743b71ea7ed0204fdae205c009%252Fpa%252FXY47977_b58912ceb660978d27d513795f495ed2.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_b58912ceb660978d27d513795f495ed2.jpg saved to cache
2026-03-27 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501823ad0>
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0684b6c-6f56-5f95-8f3d-5dd375dd0713/b0684b6c-6f56-5f95-8f3d-5dd375dd0713_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd5%252Fc5d5e86c6c1a93fc482b85fd6d758750%252Fpa%252FYS81106_f6ee1e8bee8b7777c81e23ce3b5db31c.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_f6ee1e8bee8b7777c81e23ce3b5db31c.jpg saved to cache
2026-03-27 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b0684b6c-6f56-5f95-8f3d-5dd375dd0713
2026-03-27 10:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_f6cbe39917071da61b46153142069270.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_5e8d2c2468c71a813c66e36dba59a688.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_34cd0122692d74cfbe19372b470e29c1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500392cd0>
2026-03-27 10:38:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ada0154-2dce-5ea5-ac7f-71d4a6dcc366/3ada0154-2dce-5ea5-ac7f-71d4a6dcc366_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F18%252F6918cc743b71ea7ed0204fdae205c009%252Fpa%252FXY47977_f6cbe39917071da61b46153142069270.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_f6cbe39917071da61b46153142069270.jpg saved to cache
2026-03-27 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366
2026-03-27 10:38:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366, skipping ID generation
2026-03-27 10:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366 with scrape type 1
2026-03-27 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366 sending to next pipeline
2026-03-27 10:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366, identifier: XY47977
2026-03-27 10:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366 with identifier: XY47977
2026-03-27 10:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366 with identifier: XY47977
2026-03-27 10:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366 with identifier: XY47977 to the API
2026-03-27 10:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_f6cbe39917071da61b46153142069270.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:29:09Z',
 'fuel_type': 'petrol',
 'id': '3ada0154-2dce-5ea5-ac7f-71d4a6dcc366',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY47977',
 'listing': 'auction',
 'location': 'DE, Ludwigshafen am Rhein',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 157399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ada0154-2dce-5ea5-ac7f-71d4a6dcc366/3ada0154-2dce-5ea5-ac7f-71d4a6dcc366_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2972340,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_f6cbe39917071da61b46153142069270.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ada0154-2dce-5ea5-ac7f-71d4a6dcc366/3ada0154-2dce-5ea5-ac7f-71d4a6dcc366_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_b58912ceb660978d27d513795f495ed2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ada0154-2dce-5ea5-ac7f-71d4a6dcc366/3ada0154-2dce-5ea5-ac7f-71d4a6dcc366_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_4e4a08461e26664dc561e1039c0bccca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ada0154-2dce-5ea5-ac7f-71d4a6dcc366/3ada0154-2dce-5ea5-ac7f-71d4a6dcc366_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2688478,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_0027f4e14dfc6ea186f2c2796f47d507.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ada0154-2dce-5ea5-ac7f-71d4a6dcc366/3ada0154-2dce-5ea5-ac7f-71d4a6dcc366_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2792334,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_b68bb0330a6ac5b4f1ccf4117a7d3d0a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ada0154-2dce-5ea5-ac7f-71d4a6dcc366/3ada0154-2dce-5ea5-ac7f-71d4a6dcc366_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_315492cba642d4f76b175e4db16a9fb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ada0154-2dce-5ea5-ac7f-71d4a6dcc366/3ada0154-2dce-5ea5-ac7f-71d4a6dcc366_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2736156,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_bf3e5731cee24ef6b4675f66b1f9dd89.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ada0154-2dce-5ea5-ac7f-71d4a6dcc366/3ada0154-2dce-5ea5-ac7f-71d4a6dcc366_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2824367,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_021d425b0d4b9d16a10173b4d23e1242.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ada0154-2dce-5ea5-ac7f-71d4a6dcc366/3ada0154-2dce-5ea5-ac7f-71d4a6dcc366_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_05b963f38211a3fa4a9da601d997cacf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ada0154-2dce-5ea5-ac7f-71d4a6dcc366/3ada0154-2dce-5ea5-ac7f-71d4a6dcc366_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/18/6918cc743b71ea7ed0204fdae205c009/pa/XY47977_1603cc796452ecd17e4a2210f7890b5b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.2 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2012}
2026-03-27 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY47977%27 HTTP/1.1" 200 None
2026-03-27 10:38:53 [auto1.de] INFO: Saving data for XY47977: {'created_time': 1774607933.858252, 'last_price_update_time': 1774607933.858268, 'auction_closing_time': 1774715349.0}
2026-03-27 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY47977') HTTP/1.1" 204 0
2026-03-27 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_bed8f411e38996ba5d79ff7054c67fca.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f23d0>
2026-03-27 10:38:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0684b6c-6f56-5f95-8f3d-5dd375dd0713/b0684b6c-6f56-5f95-8f3d-5dd375dd0713_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd5%252Fc5d5e86c6c1a93fc482b85fd6d758750%252Fpa%252FYS81106_5e8d2c2468c71a813c66e36dba59a688.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_5e8d2c2468c71a813c66e36dba59a688.jpg saved to cache
2026-03-27 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b0684b6c-6f56-5f95-8f3d-5dd375dd0713
2026-03-27 10:38:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50170c4d0>
2026-03-27 10:38:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0684b6c-6f56-5f95-8f3d-5dd375dd0713/b0684b6c-6f56-5f95-8f3d-5dd375dd0713_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fd5%252Fc5d5e86c6c1a93fc482b85fd6d758750%252Fpa%252FYS81106_34cd0122692d74cfbe19372b470e29c1.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_34cd0122692d74cfbe19372b470e29c1.jpg saved to cache
2026-03-27 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0684b6c-6f56-5f95-8f3d-5dd375dd0713
2026-03-27 10:38:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0684b6c-6f56-5f95-8f3d-5dd375dd0713, skipping ID generation
2026-03-27 10:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0684b6c-6f56-5f95-8f3d-5dd375dd0713 with scrape type 1
2026-03-27 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0684b6c-6f56-5f95-8f3d-5dd375dd0713 sending to next pipeline
2026-03-27 10:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0684b6c-6f56-5f95-8f3d-5dd375dd0713, identifier: YS81106
2026-03-27 10:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0684b6c-6f56-5f95-8f3d-5dd375dd0713 with identifier: YS81106
2026-03-27 10:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0684b6c-6f56-5f95-8f3d-5dd375dd0713 with identifier: YS81106
2026-03-27 10:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0684b6c-6f56-5f95-8f3d-5dd375dd0713 with identifier: YS81106 to the API
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_34cd0122692d74cfbe19372b470e29c1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:58:45Z',
 'fuel_type': 'petrol',
 'id': 'b0684b6c-6f56-5f95-8f3d-5dd375dd0713',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS81106',
 'listing': 'auction',
 'location': 'DE, Köln',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 35739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0684b6c-6f56-5f95-8f3d-5dd375dd0713/b0684b6c-6f56-5f95-8f3d-5dd375dd0713_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_34cd0122692d74cfbe19372b470e29c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0684b6c-6f56-5f95-8f3d-5dd375dd0713/b0684b6c-6f56-5f95-8f3d-5dd375dd0713_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_5e8d2c2468c71a813c66e36dba59a688.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0684b6c-6f56-5f95-8f3d-5dd375dd0713/b0684b6c-6f56-5f95-8f3d-5dd375dd0713_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_f6ee1e8bee8b7777c81e23ce3b5db31c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0684b6c-6f56-5f95-8f3d-5dd375dd0713/b0684b6c-6f56-5f95-8f3d-5dd375dd0713_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_1bf0e48b46f21825113f39ba2c96aeea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0684b6c-6f56-5f95-8f3d-5dd375dd0713/b0684b6c-6f56-5f95-8f3d-5dd375dd0713_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_0795359a4bdabbcad09da4035aee85cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0684b6c-6f56-5f95-8f3d-5dd375dd0713/b0684b6c-6f56-5f95-8f3d-5dd375dd0713_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_7db2157e00ab1a2ad2597633e99cf6df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0684b6c-6f56-5f95-8f3d-5dd375dd0713/b0684b6c-6f56-5f95-8f3d-5dd375dd0713_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_e2731604a4800489e6059aa8c7984ff4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0684b6c-6f56-5f95-8f3d-5dd375dd0713/b0684b6c-6f56-5f95-8f3d-5dd375dd0713_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_7477fdab61b1b3ba467b4827d20c5774.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0684b6c-6f56-5f95-8f3d-5dd375dd0713/b0684b6c-6f56-5f95-8f3d-5dd375dd0713_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_96e566d30052f9d5e17d559b3cdf0ac6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0684b6c-6f56-5f95-8f3d-5dd375dd0713/b0684b6c-6f56-5f95-8f3d-5dd375dd0713_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/d5/c5d5e86c6c1a93fc482b85fd6d758750/pa/YS81106_b9fb45d5f347fdf33b7a0abd3753e58f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2022}
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81106%27 HTTP/1.1" 200 None
2026-03-27 10:38:54 [auto1.de] INFO: Saving data for YS81106: {'created_time': 1774607934.480418, 'last_price_update_time': 1774607934.480433, 'auction_closing_time': 1774717125.0}
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS81106') HTTP/1.1" 204 0
2026-03-27 10:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017acd10>
2026-03-27 10:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af297216-e1f5-5156-a455-3c8afaf1467b/af297216-e1f5-5156-a455-3c8afaf1467b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F45%252F4b45abc4733fc22d71027bedaed97457%252Fpa%252FBD50097_bed8f411e38996ba5d79ff7054c67fca.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_bed8f411e38996ba5d79ff7054c67fca.jpg saved to cache
2026-03-27 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af297216-e1f5-5156-a455-3c8afaf1467b
2026-03-27 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_ef357b531db63bcc86c29902a715c360.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503761050>
2026-03-27 10:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af297216-e1f5-5156-a455-3c8afaf1467b/af297216-e1f5-5156-a455-3c8afaf1467b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F45%252F4b45abc4733fc22d71027bedaed97457%252Fpa%252FBD50097_ef357b531db63bcc86c29902a715c360.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_ef357b531db63bcc86c29902a715c360.jpg saved to cache
2026-03-27 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af297216-e1f5-5156-a455-3c8afaf1467b
2026-03-27 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UH40808/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA75512> (referer: https://www.auto1.com/v1/car-details-view/EA75512/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_d49b6abe5c668633bf11b06acdaada7b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39a73000-d2ce-5a52-b8f5-a36cdb240ebf with identifier: EA75512
2026-03-27 10:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf with scrape type 1
2026-03-27 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fca%252F94caa446994874e5f0519f5cc5d32041%252Fpa%252FEA75512_677805224e678c36014eee3340ded5b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_677805224e678c36014eee3340ded5b4.jpg not downloaded yet
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fca%252F94caa446994874e5f0519f5cc5d32041%252Fpa%252FEA75512_175b1adb70917e2d0012d1bbe503f4eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_175b1adb70917e2d0012d1bbe503f4eb.jpg not downloaded yet
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fca%252F94caa446994874e5f0519f5cc5d32041%252Fpa%252FEA75512_3dbd78d7f9dedf61ddab2d0da3b8bf78.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_3dbd78d7f9dedf61ddab2d0da3b8bf78.jpg not downloaded yet
2026-03-27 10:38:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50171cf90>
2026-03-27 10:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af297216-e1f5-5156-a455-3c8afaf1467b/af297216-e1f5-5156-a455-3c8afaf1467b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F45%252F4b45abc4733fc22d71027bedaed97457%252Fpa%252FBD50097_d49b6abe5c668633bf11b06acdaada7b.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_d49b6abe5c668633bf11b06acdaada7b.jpg saved to cache
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af297216-e1f5-5156-a455-3c8afaf1467b
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fca%252F94caa446994874e5f0519f5cc5d32041%252Fpa%252FEA75512_30fec732fd34587948190e1e71ea2170.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_30fec732fd34587948190e1e71ea2170.jpg not downloaded yet
2026-03-27 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_4f198c2ddc3d19b0726c88b052940b11.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fca%252F94caa446994874e5f0519f5cc5d32041%252Fpa%252FEA75512_ffa403b2e7bb969e97b52a437d07adaf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_ffa403b2e7bb969e97b52a437d07adaf.jpg not downloaded yet
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fca%252F94caa446994874e5f0519f5cc5d32041%252Fpa%252FEA75512_9d0fd4cb70b68b5f21a8fe3c7e4d1da4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_9d0fd4cb70b68b5f21a8fe3c7e4d1da4.jpg not downloaded yet
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fca%252F94caa446994874e5f0519f5cc5d32041%252Fpa%252FEA75512_71f35240df7cf2e0ef9192dc6a2e7f82.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_71f35240df7cf2e0ef9192dc6a2e7f82.jpg not downloaded yet
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fca%252F94caa446994874e5f0519f5cc5d32041%252Fpa%252FEA75512_7c7922aafda008ade6b9f73d16e8ee5a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_7c7922aafda008ade6b9f73d16e8ee5a.jpg not downloaded yet
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fca%252F94caa446994874e5f0519f5cc5d32041%252Fpa%252FEA75512_8d8113a486bed84a5f5c28c5daad310a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_8d8113a486bed84a5f5c28c5daad310a.jpg not downloaded yet
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fca%252F94caa446994874e5f0519f5cc5d32041%252Fpa%252FEA75512_2000517c30defbabd3d759360e546364.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_2000517c30defbabd3d759360e546364.jpg not downloaded yet
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500563610>
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af297216-e1f5-5156-a455-3c8afaf1467b/af297216-e1f5-5156-a455-3c8afaf1467b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F45%252F4b45abc4733fc22d71027bedaed97457%252Fpa%252FBD50097_4f198c2ddc3d19b0726c88b052940b11.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_4f198c2ddc3d19b0726c88b052940b11.jpg saved to cache
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af297216-e1f5-5156-a455-3c8afaf1467b
2026-03-27 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_69c815c5180f70c402646922fde7f63a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_f4f1594f1593eb7b092a2a29527ecddc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_6c2034ab7bc3b17640dd053f0f3e1995.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_30fec732fd34587948190e1e71ea2170.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019401d0>
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af297216-e1f5-5156-a455-3c8afaf1467b/af297216-e1f5-5156-a455-3c8afaf1467b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F45%252F4b45abc4733fc22d71027bedaed97457%252Fpa%252FBD50097_69c815c5180f70c402646922fde7f63a.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_69c815c5180f70c402646922fde7f63a.jpg saved to cache
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af297216-e1f5-5156-a455-3c8afaf1467b
2026-03-27 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_2000517c30defbabd3d759360e546364.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500501a90>
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af297216-e1f5-5156-a455-3c8afaf1467b/af297216-e1f5-5156-a455-3c8afaf1467b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F45%252F4b45abc4733fc22d71027bedaed97457%252Fpa%252FBD50097_f4f1594f1593eb7b092a2a29527ecddc.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_f4f1594f1593eb7b092a2a29527ecddc.jpg saved to cache
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af297216-e1f5-5156-a455-3c8afaf1467b
2026-03-27 10:38:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004c77d0>
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af297216-e1f5-5156-a455-3c8afaf1467b/af297216-e1f5-5156-a455-3c8afaf1467b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F45%252F4b45abc4733fc22d71027bedaed97457%252Fpa%252FBD50097_6c2034ab7bc3b17640dd053f0f3e1995.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_6c2034ab7bc3b17640dd053f0f3e1995.jpg saved to cache
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af297216-e1f5-5156-a455-3c8afaf1467b
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a3950>
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fca%252F94caa446994874e5f0519f5cc5d32041%252Fpa%252FEA75512_30fec732fd34587948190e1e71ea2170.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_30fec732fd34587948190e1e71ea2170.jpg saved to cache
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb502612a10>
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fca%252F94caa446994874e5f0519f5cc5d32041%252Fpa%252FEA75512_2000517c30defbabd3d759360e546364.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_2000517c30defbabd3d759360e546364.jpg saved to cache
2026-03-27 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-27 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_7c7922aafda008ade6b9f73d16e8ee5a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_8d8113a486bed84a5f5c28c5daad310a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_9d0fd4cb70b68b5f21a8fe3c7e4d1da4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_ffa403b2e7bb969e97b52a437d07adaf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501655a90>
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fca%252F94caa446994874e5f0519f5cc5d32041%252Fpa%252FEA75512_7c7922aafda008ade6b9f73d16e8ee5a.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_7c7922aafda008ade6b9f73d16e8ee5a.jpg saved to cache
2026-03-27 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-27 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_677805224e678c36014eee3340ded5b4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_3dbd78d7f9dedf61ddab2d0da3b8bf78.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_71f35240df7cf2e0ef9192dc6a2e7f82.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c8350>
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fca%252F94caa446994874e5f0519f5cc5d32041%252Fpa%252FEA75512_8d8113a486bed84a5f5c28c5daad310a.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_8d8113a486bed84a5f5c28c5daad310a.jpg saved to cache
2026-03-27 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50181b050>
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fca%252F94caa446994874e5f0519f5cc5d32041%252Fpa%252FEA75512_9d0fd4cb70b68b5f21a8fe3c7e4d1da4.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_9d0fd4cb70b68b5f21a8fe3c7e4d1da4.jpg saved to cache
2026-03-27 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a14b90>
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fca%252F94caa446994874e5f0519f5cc5d32041%252Fpa%252FEA75512_ffa403b2e7bb969e97b52a437d07adaf.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_ffa403b2e7bb969e97b52a437d07adaf.jpg saved to cache
2026-03-27 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-27 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_175b1adb70917e2d0012d1bbe503f4eb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019b1d10>
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fca%252F94caa446994874e5f0519f5cc5d32041%252Fpa%252FEA75512_677805224e678c36014eee3340ded5b4.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_677805224e678c36014eee3340ded5b4.jpg saved to cache
2026-03-27 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501940690>
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fca%252F94caa446994874e5f0519f5cc5d32041%252Fpa%252FEA75512_3dbd78d7f9dedf61ddab2d0da3b8bf78.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_3dbd78d7f9dedf61ddab2d0da3b8bf78.jpg saved to cache
2026-03-27 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50183ea50>
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fca%252F94caa446994874e5f0519f5cc5d32041%252Fpa%252FEA75512_71f35240df7cf2e0ef9192dc6a2e7f82.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_71f35240df7cf2e0ef9192dc6a2e7f82.jpg saved to cache
2026-03-27 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501940450>
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fca%252F94caa446994874e5f0519f5cc5d32041%252Fpa%252FEA75512_175b1adb70917e2d0012d1bbe503f4eb.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_175b1adb70917e2d0012d1bbe503f4eb.jpg saved to cache
2026-03-27 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf
2026-03-27 10:38:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39a73000-d2ce-5a52-b8f5-a36cdb240ebf, skipping ID generation
2026-03-27 10:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf with scrape type 1
2026-03-27 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf sending to next pipeline
2026-03-27 10:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39a73000-d2ce-5a52-b8f5-a36cdb240ebf, identifier: EA75512
2026-03-27 10:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39a73000-d2ce-5a52-b8f5-a36cdb240ebf with identifier: EA75512
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-27 10:38:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39a73000-d2ce-5a52-b8f5-a36cdb240ebf with identifier: EA75512
2026-03-27 10:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39a73000-d2ce-5a52-b8f5-a36cdb240ebf with identifier: EA75512 to the API
2026-03-27 10:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_175b1adb70917e2d0012d1bbe503f4eb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:15:38Z',
 'fuel_type': 'electro',
 'id': '39a73000-d2ce-5a52-b8f5-a36cdb240ebf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA75512',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 10,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_677805224e678c36014eee3340ded5b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_175b1adb70917e2d0012d1bbe503f4eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_3dbd78d7f9dedf61ddab2d0da3b8bf78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_30fec732fd34587948190e1e71ea2170.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_ffa403b2e7bb969e97b52a437d07adaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_9d0fd4cb70b68b5f21a8fe3c7e4d1da4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_71f35240df7cf2e0ef9192dc6a2e7f82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_7c7922aafda008ade6b9f73d16e8ee5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_8d8113a486bed84a5f5c28c5daad310a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a73000-d2ce-5a52-b8f5-a36cdb240ebf/39a73000-d2ce-5a52-b8f5-a36cdb240ebf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/ca/94caa446994874e5f0519f5cc5d32041/pa/EA75512_2000517c30defbabd3d759360e546364.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-12-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA75512%27 HTTP/1.1" 200 None
2026-03-27 10:38:57 [auto1.de] INFO: Saving data for EA75512: {'created_time': 1774607937.308526, 'last_price_update_time': 1774607937.308539, 'auction_closing_time': 1774714538.0}
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA75512') HTTP/1.1" 204 0
2026-03-27 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_dc11648b75f7bd1c4ca976158a03530e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501942e50>
2026-03-27 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af297216-e1f5-5156-a455-3c8afaf1467b/af297216-e1f5-5156-a455-3c8afaf1467b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F45%252F4b45abc4733fc22d71027bedaed97457%252Fpa%252FBD50097_dc11648b75f7bd1c4ca976158a03530e.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_dc11648b75f7bd1c4ca976158a03530e.jpg saved to cache
2026-03-27 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af297216-e1f5-5156-a455-3c8afaf1467b
2026-03-27 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_f4203bbf8ad1cc81fc33a482cfe7b3ab.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:38:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501711a90>
2026-03-27 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af297216-e1f5-5156-a455-3c8afaf1467b/af297216-e1f5-5156-a455-3c8afaf1467b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F45%252F4b45abc4733fc22d71027bedaed97457%252Fpa%252FBD50097_f4203bbf8ad1cc81fc33a482cfe7b3ab.jpg') HTTP/1.1" 204 0
2026-03-27 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_f4203bbf8ad1cc81fc33a482cfe7b3ab.jpg saved to cache
2026-03-27 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af297216-e1f5-5156-a455-3c8afaf1467b
2026-03-27 10:38:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af297216-e1f5-5156-a455-3c8afaf1467b, skipping ID generation
2026-03-27 10:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af297216-e1f5-5156-a455-3c8afaf1467b with scrape type 1
2026-03-27 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af297216-e1f5-5156-a455-3c8afaf1467b sending to next pipeline
2026-03-27 10:38:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af297216-e1f5-5156-a455-3c8afaf1467b, identifier: BD50097
2026-03-27 10:38:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af297216-e1f5-5156-a455-3c8afaf1467b with identifier: BD50097
2026-03-27 10:38:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af297216-e1f5-5156-a455-3c8afaf1467b with identifier: BD50097
2026-03-27 10:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af297216-e1f5-5156-a455-3c8afaf1467b with identifier: BD50097 to the API
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_f4203bbf8ad1cc81fc33a482cfe7b3ab.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:24:54Z',
 'fuel_type': 'petrol',
 'id': 'af297216-e1f5-5156-a455-3c8afaf1467b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD50097',
 'listing': 'auction',
 'location': 'DE, Laatzen',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 57107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af297216-e1f5-5156-a455-3c8afaf1467b/af297216-e1f5-5156-a455-3c8afaf1467b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2951198,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_f4203bbf8ad1cc81fc33a482cfe7b3ab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af297216-e1f5-5156-a455-3c8afaf1467b/af297216-e1f5-5156-a455-3c8afaf1467b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2883966,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_dc11648b75f7bd1c4ca976158a03530e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af297216-e1f5-5156-a455-3c8afaf1467b/af297216-e1f5-5156-a455-3c8afaf1467b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_4f198c2ddc3d19b0726c88b052940b11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af297216-e1f5-5156-a455-3c8afaf1467b/af297216-e1f5-5156-a455-3c8afaf1467b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2807954,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_f4f1594f1593eb7b092a2a29527ecddc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af297216-e1f5-5156-a455-3c8afaf1467b/af297216-e1f5-5156-a455-3c8afaf1467b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2741122,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_6c2034ab7bc3b17640dd053f0f3e1995.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af297216-e1f5-5156-a455-3c8afaf1467b/af297216-e1f5-5156-a455-3c8afaf1467b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2805433,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_d49b6abe5c668633bf11b06acdaada7b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af297216-e1f5-5156-a455-3c8afaf1467b/af297216-e1f5-5156-a455-3c8afaf1467b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2794368,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_69c815c5180f70c402646922fde7f63a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af297216-e1f5-5156-a455-3c8afaf1467b/af297216-e1f5-5156-a455-3c8afaf1467b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_bed8f411e38996ba5d79ff7054c67fca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af297216-e1f5-5156-a455-3c8afaf1467b/af297216-e1f5-5156-a455-3c8afaf1467b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2685850,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_ef357b531db63bcc86c29902a715c360.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af297216-e1f5-5156-a455-3c8afaf1467b/af297216-e1f5-5156-a455-3c8afaf1467b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3145990,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/45/4b45abc4733fc22d71027bedaed97457/pa/BD50097_f7938423e46dcaabbe965db7e99842bf.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD50097%27 HTTP/1.1" 200 None
2026-03-27 10:38:58 [auto1.de] INFO: Saving data for BD50097: {'created_time': 1774607938.354709, 'last_price_update_time': 1774607938.354719, 'auction_closing_time': 1774715094.0}
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD50097') HTTP/1.1" 204 0
2026-03-27 10:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR67018> (referer: https://www.auto1.com/v1/car-details-view/BR67018/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:38:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95 with identifier: BR67018
2026-03-27 10:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95 with scrape type 1
2026-03-27 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F8d%252F878d672962e18710b7c3dff16f574a27%252Fpa%252FBR67018_c5725290b4a80762889d434adef1ef55.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_c5725290b4a80762889d434adef1ef55.jpg not downloaded yet
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F8d%252F878d672962e18710b7c3dff16f574a27%252Fpa%252FBR67018_d0a2ea6fd2a35cff822e815b2153ba1a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_d0a2ea6fd2a35cff822e815b2153ba1a.jpg not downloaded yet
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F8d%252F878d672962e18710b7c3dff16f574a27%252Fpa%252FBR67018_c6a073c6f028c2f303b24020f66a6f6f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_c6a073c6f028c2f303b24020f66a6f6f.jpg not downloaded yet
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F8d%252F878d672962e18710b7c3dff16f574a27%252Fpa%252FBR67018_cc841680b49aae6732dde29db62fcfb4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_cc841680b49aae6732dde29db62fcfb4.jpg not downloaded yet
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F8d%252F878d672962e18710b7c3dff16f574a27%252Fpa%252FBR67018_441c4d0b2955e193ed459fe97dca0edb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_441c4d0b2955e193ed459fe97dca0edb.jpg not downloaded yet
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F8d%252F878d672962e18710b7c3dff16f574a27%252Fpa%252FBR67018_eae1331bcab3ab6a86c1bb95ab85e19d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_eae1331bcab3ab6a86c1bb95ab85e19d.jpg not downloaded yet
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F8d%252F878d672962e18710b7c3dff16f574a27%252Fpa%252FBR67018_c889c07f17a38d6acecc1534c8e186e0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_c889c07f17a38d6acecc1534c8e186e0.jpg not downloaded yet
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F8d%252F878d672962e18710b7c3dff16f574a27%252Fpa%252FBR67018_c84aefd23c1edba75e7812845b3b0664.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_c84aefd23c1edba75e7812845b3b0664.jpg not downloaded yet
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F8d%252F878d672962e18710b7c3dff16f574a27%252Fpa%252FBR67018_35a741f7d3a21ea1ef2be599365a4492.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_35a741f7d3a21ea1ef2be599365a4492.jpg not downloaded yet
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F8d%252F878d672962e18710b7c3dff16f574a27%252Fpa%252FBR67018_466f19959f6f8542e86186da9ea90aa8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_466f19959f6f8542e86186da9ea90aa8.jpg not downloaded yet
2026-03-27 10:39:06 [scrapy.extensions.logstats] INFO: Crawled 191 pages (at 23 pages/min), scraped 115 items (at 22 items/min)
2026-03-27 10:39:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-27 10:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE17013> (referer: https://www.auto1.com/v1/car-details-view/ZE17013/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8f96efe-8ba1-5dc9-8cec-76fac3d74696 with identifier: ZE17013
2026-03-27 10:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8f96efe-8ba1-5dc9-8cec-76fac3d74696 with scrape type 1
2026-03-27 10:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8f96efe-8ba1-5dc9-8cec-76fac3d74696
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F6a%252Ff76a24af85a3777dfe9bcbf9ed70b224%252Fpa%252FZE17013_798e27d72dfb8ce2b398e9dcf1e2117f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_798e27d72dfb8ce2b398e9dcf1e2117f.jpg not downloaded yet
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F6a%252Ff76a24af85a3777dfe9bcbf9ed70b224%252Fpa%252FZE17013_1a7fed840f071ed82691c0f54767afee.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_1a7fed840f071ed82691c0f54767afee.jpg not downloaded yet
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F6a%252Ff76a24af85a3777dfe9bcbf9ed70b224%252Fpa%252FZE17013_68adcba41b6630f9150efb5258cf8dfb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_68adcba41b6630f9150efb5258cf8dfb.jpg not downloaded yet
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F6a%252Ff76a24af85a3777dfe9bcbf9ed70b224%252Fpa%252FZE17013_6c752cefc7090e947eeb01f19a7b2fef.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_6c752cefc7090e947eeb01f19a7b2fef.jpg not downloaded yet
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F6a%252Ff76a24af85a3777dfe9bcbf9ed70b224%252Fpa%252FZE17013_034507c3e07a71aec61b057de90a02fd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_034507c3e07a71aec61b057de90a02fd.jpg not downloaded yet
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F6a%252Ff76a24af85a3777dfe9bcbf9ed70b224%252Fpa%252FZE17013_acc9a92341c6d8337098ab4fbb69109f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_acc9a92341c6d8337098ab4fbb69109f.jpg not downloaded yet
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F6a%252Ff76a24af85a3777dfe9bcbf9ed70b224%252Fpa%252FZE17013_332e4e2df1f3810d196f393c5d05562f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_332e4e2df1f3810d196f393c5d05562f.jpg not downloaded yet
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F6a%252Ff76a24af85a3777dfe9bcbf9ed70b224%252Fpa%252FZE17013_e8095a58a5ca3de4dac1e23a370de2fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_e8095a58a5ca3de4dac1e23a370de2fc.jpg not downloaded yet
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F6a%252Ff76a24af85a3777dfe9bcbf9ed70b224%252Fpa%252FZE17013_8710c6e7246d5c43f118383329ea889b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_8710c6e7246d5c43f118383329ea889b.jpg not downloaded yet
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F6a%252Ff76a24af85a3777dfe9bcbf9ed70b224%252Fpa%252FZE17013_c42f8650ababde410259304b9eb5e872.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_c42f8650ababde410259304b9eb5e872.jpg not downloaded yet
2026-03-27 10:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_466f19959f6f8542e86186da9ea90aa8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501971090>
2026-03-27 10:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f6086c3-075b-5f4a-9712-6bf7b7ad5a95/5f6086c3-075b-5f4a-9712-6bf7b7ad5a95_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F8d%252F878d672962e18710b7c3dff16f574a27%252Fpa%252FBR67018_466f19959f6f8542e86186da9ea90aa8.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_466f19959f6f8542e86186da9ea90aa8.jpg saved to cache
2026-03-27 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95
2026-03-27 10:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_c42f8650ababde410259304b9eb5e872.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501711cd0>
2026-03-27 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f96efe-8ba1-5dc9-8cec-76fac3d74696/e8f96efe-8ba1-5dc9-8cec-76fac3d74696_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F6a%252Ff76a24af85a3777dfe9bcbf9ed70b224%252Fpa%252FZE17013_c42f8650ababde410259304b9eb5e872.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_c42f8650ababde410259304b9eb5e872.jpg saved to cache
2026-03-27 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8f96efe-8ba1-5dc9-8cec-76fac3d74696
2026-03-27 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_8710c6e7246d5c43f118383329ea889b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50058a690>
2026-03-27 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f96efe-8ba1-5dc9-8cec-76fac3d74696/e8f96efe-8ba1-5dc9-8cec-76fac3d74696_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F6a%252Ff76a24af85a3777dfe9bcbf9ed70b224%252Fpa%252FZE17013_8710c6e7246d5c43f118383329ea889b.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_8710c6e7246d5c43f118383329ea889b.jpg saved to cache
2026-03-27 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8f96efe-8ba1-5dc9-8cec-76fac3d74696
2026-03-27 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_e8095a58a5ca3de4dac1e23a370de2fc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50183d550>
2026-03-27 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f96efe-8ba1-5dc9-8cec-76fac3d74696/e8f96efe-8ba1-5dc9-8cec-76fac3d74696_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F6a%252Ff76a24af85a3777dfe9bcbf9ed70b224%252Fpa%252FZE17013_e8095a58a5ca3de4dac1e23a370de2fc.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_e8095a58a5ca3de4dac1e23a370de2fc.jpg saved to cache
2026-03-27 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8f96efe-8ba1-5dc9-8cec-76fac3d74696
2026-03-27 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_332e4e2df1f3810d196f393c5d05562f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018ac910>
2026-03-27 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f96efe-8ba1-5dc9-8cec-76fac3d74696/e8f96efe-8ba1-5dc9-8cec-76fac3d74696_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F6a%252Ff76a24af85a3777dfe9bcbf9ed70b224%252Fpa%252FZE17013_332e4e2df1f3810d196f393c5d05562f.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_332e4e2df1f3810d196f393c5d05562f.jpg saved to cache
2026-03-27 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8f96efe-8ba1-5dc9-8cec-76fac3d74696
2026-03-27 10:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_acc9a92341c6d8337098ab4fbb69109f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50183d410>
2026-03-27 10:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f96efe-8ba1-5dc9-8cec-76fac3d74696/e8f96efe-8ba1-5dc9-8cec-76fac3d74696_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F6a%252Ff76a24af85a3777dfe9bcbf9ed70b224%252Fpa%252FZE17013_acc9a92341c6d8337098ab4fbb69109f.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_acc9a92341c6d8337098ab4fbb69109f.jpg saved to cache
2026-03-27 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8f96efe-8ba1-5dc9-8cec-76fac3d74696
2026-03-27 10:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_034507c3e07a71aec61b057de90a02fd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501711e50>
2026-03-27 10:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f96efe-8ba1-5dc9-8cec-76fac3d74696/e8f96efe-8ba1-5dc9-8cec-76fac3d74696_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F6a%252Ff76a24af85a3777dfe9bcbf9ed70b224%252Fpa%252FZE17013_034507c3e07a71aec61b057de90a02fd.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_034507c3e07a71aec61b057de90a02fd.jpg saved to cache
2026-03-27 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8f96efe-8ba1-5dc9-8cec-76fac3d74696
2026-03-27 10:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_6c752cefc7090e947eeb01f19a7b2fef.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501642810>
2026-03-27 10:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f96efe-8ba1-5dc9-8cec-76fac3d74696/e8f96efe-8ba1-5dc9-8cec-76fac3d74696_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F6a%252Ff76a24af85a3777dfe9bcbf9ed70b224%252Fpa%252FZE17013_6c752cefc7090e947eeb01f19a7b2fef.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_6c752cefc7090e947eeb01f19a7b2fef.jpg saved to cache
2026-03-27 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8f96efe-8ba1-5dc9-8cec-76fac3d74696
2026-03-27 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_68adcba41b6630f9150efb5258cf8dfb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501943c90>
2026-03-27 10:39:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f96efe-8ba1-5dc9-8cec-76fac3d74696/e8f96efe-8ba1-5dc9-8cec-76fac3d74696_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F6a%252Ff76a24af85a3777dfe9bcbf9ed70b224%252Fpa%252FZE17013_68adcba41b6630f9150efb5258cf8dfb.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_68adcba41b6630f9150efb5258cf8dfb.jpg saved to cache
2026-03-27 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8f96efe-8ba1-5dc9-8cec-76fac3d74696
2026-03-27 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_1a7fed840f071ed82691c0f54767afee.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_798e27d72dfb8ce2b398e9dcf1e2117f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500393410>
2026-03-27 10:39:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f96efe-8ba1-5dc9-8cec-76fac3d74696/e8f96efe-8ba1-5dc9-8cec-76fac3d74696_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F6a%252Ff76a24af85a3777dfe9bcbf9ed70b224%252Fpa%252FZE17013_1a7fed840f071ed82691c0f54767afee.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_1a7fed840f071ed82691c0f54767afee.jpg saved to cache
2026-03-27 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8f96efe-8ba1-5dc9-8cec-76fac3d74696
2026-03-27 10:39:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501865550>
2026-03-27 10:39:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f96efe-8ba1-5dc9-8cec-76fac3d74696/e8f96efe-8ba1-5dc9-8cec-76fac3d74696_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F6a%252Ff76a24af85a3777dfe9bcbf9ed70b224%252Fpa%252FZE17013_798e27d72dfb8ce2b398e9dcf1e2117f.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_798e27d72dfb8ce2b398e9dcf1e2117f.jpg saved to cache
2026-03-27 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8f96efe-8ba1-5dc9-8cec-76fac3d74696
2026-03-27 10:39:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8f96efe-8ba1-5dc9-8cec-76fac3d74696, skipping ID generation
2026-03-27 10:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8f96efe-8ba1-5dc9-8cec-76fac3d74696 with scrape type 1
2026-03-27 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8f96efe-8ba1-5dc9-8cec-76fac3d74696 sending to next pipeline
2026-03-27 10:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8f96efe-8ba1-5dc9-8cec-76fac3d74696, identifier: ZE17013
2026-03-27 10:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8f96efe-8ba1-5dc9-8cec-76fac3d74696 with identifier: ZE17013
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-27 10:39:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8f96efe-8ba1-5dc9-8cec-76fac3d74696 with identifier: ZE17013
2026-03-27 10:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8f96efe-8ba1-5dc9-8cec-76fac3d74696 with identifier: ZE17013 to the API
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_798e27d72dfb8ce2b398e9dcf1e2117f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:06:16Z',
 'fuel_type': 'petrol',
 'id': 'e8f96efe-8ba1-5dc9-8cec-76fac3d74696',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE17013',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 92020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f96efe-8ba1-5dc9-8cec-76fac3d74696/e8f96efe-8ba1-5dc9-8cec-76fac3d74696_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_798e27d72dfb8ce2b398e9dcf1e2117f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f96efe-8ba1-5dc9-8cec-76fac3d74696/e8f96efe-8ba1-5dc9-8cec-76fac3d74696_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2945594,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_1a7fed840f071ed82691c0f54767afee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f96efe-8ba1-5dc9-8cec-76fac3d74696/e8f96efe-8ba1-5dc9-8cec-76fac3d74696_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3001061,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_68adcba41b6630f9150efb5258cf8dfb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f96efe-8ba1-5dc9-8cec-76fac3d74696/e8f96efe-8ba1-5dc9-8cec-76fac3d74696_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2938624,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_6c752cefc7090e947eeb01f19a7b2fef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f96efe-8ba1-5dc9-8cec-76fac3d74696/e8f96efe-8ba1-5dc9-8cec-76fac3d74696_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2857137,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_034507c3e07a71aec61b057de90a02fd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f96efe-8ba1-5dc9-8cec-76fac3d74696/e8f96efe-8ba1-5dc9-8cec-76fac3d74696_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_acc9a92341c6d8337098ab4fbb69109f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f96efe-8ba1-5dc9-8cec-76fac3d74696/e8f96efe-8ba1-5dc9-8cec-76fac3d74696_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_332e4e2df1f3810d196f393c5d05562f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f96efe-8ba1-5dc9-8cec-76fac3d74696/e8f96efe-8ba1-5dc9-8cec-76fac3d74696_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3021448,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_e8095a58a5ca3de4dac1e23a370de2fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f96efe-8ba1-5dc9-8cec-76fac3d74696/e8f96efe-8ba1-5dc9-8cec-76fac3d74696_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_8710c6e7246d5c43f118383329ea889b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f96efe-8ba1-5dc9-8cec-76fac3d74696/e8f96efe-8ba1-5dc9-8cec-76fac3d74696_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3139369,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/6a/f76a24af85a3777dfe9bcbf9ed70b224/pa/ZE17013_c42f8650ababde410259304b9eb5e872.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.4 Turbo S-Design City Look',
 'transmission': 'automatic',
 'trim': 'S-Design City Look',
 'year': 2017}
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE17013%27 HTTP/1.1" 200 None
2026-03-27 10:39:11 [auto1.de] INFO: Saving data for ZE17013: {'created_time': 1774607951.946302, 'last_price_update_time': 1774607951.946315, 'auction_closing_time': 1774713976.0}
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE17013') HTTP/1.1" 204 0
2026-03-27 10:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_35a741f7d3a21ea1ef2be599365a4492.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500588ed0>
2026-03-27 10:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f6086c3-075b-5f4a-9712-6bf7b7ad5a95/5f6086c3-075b-5f4a-9712-6bf7b7ad5a95_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F8d%252F878d672962e18710b7c3dff16f574a27%252Fpa%252FBR67018_35a741f7d3a21ea1ef2be599365a4492.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_35a741f7d3a21ea1ef2be599365a4492.jpg saved to cache
2026-03-27 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95
2026-03-27 10:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_c84aefd23c1edba75e7812845b3b0664.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016416d0>
2026-03-27 10:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f6086c3-075b-5f4a-9712-6bf7b7ad5a95/5f6086c3-075b-5f4a-9712-6bf7b7ad5a95_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F8d%252F878d672962e18710b7c3dff16f574a27%252Fpa%252FBR67018_c84aefd23c1edba75e7812845b3b0664.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_c84aefd23c1edba75e7812845b3b0664.jpg saved to cache
2026-03-27 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95
2026-03-27 10:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_c889c07f17a38d6acecc1534c8e186e0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503729390>
2026-03-27 10:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f6086c3-075b-5f4a-9712-6bf7b7ad5a95/5f6086c3-075b-5f4a-9712-6bf7b7ad5a95_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F8d%252F878d672962e18710b7c3dff16f574a27%252Fpa%252FBR67018_c889c07f17a38d6acecc1534c8e186e0.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_c889c07f17a38d6acecc1534c8e186e0.jpg saved to cache
2026-03-27 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95
2026-03-27 10:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_eae1331bcab3ab6a86c1bb95ab85e19d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50183cf50>
2026-03-27 10:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f6086c3-075b-5f4a-9712-6bf7b7ad5a95/5f6086c3-075b-5f4a-9712-6bf7b7ad5a95_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F8d%252F878d672962e18710b7c3dff16f574a27%252Fpa%252FBR67018_eae1331bcab3ab6a86c1bb95ab85e19d.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_eae1331bcab3ab6a86c1bb95ab85e19d.jpg saved to cache
2026-03-27 10:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95
2026-03-27 10:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_441c4d0b2955e193ed459fe97dca0edb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50058bcd0>
2026-03-27 10:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f6086c3-075b-5f4a-9712-6bf7b7ad5a95/5f6086c3-075b-5f4a-9712-6bf7b7ad5a95_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F8d%252F878d672962e18710b7c3dff16f574a27%252Fpa%252FBR67018_441c4d0b2955e193ed459fe97dca0edb.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_441c4d0b2955e193ed459fe97dca0edb.jpg saved to cache
2026-03-27 10:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95
2026-03-27 10:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_cc841680b49aae6732dde29db62fcfb4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50183c650>
2026-03-27 10:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f6086c3-075b-5f4a-9712-6bf7b7ad5a95/5f6086c3-075b-5f4a-9712-6bf7b7ad5a95_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F8d%252F878d672962e18710b7c3dff16f574a27%252Fpa%252FBR67018_cc841680b49aae6732dde29db62fcfb4.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_cc841680b49aae6732dde29db62fcfb4.jpg saved to cache
2026-03-27 10:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95
2026-03-27 10:39:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_c6a073c6f028c2f303b24020f66a6f6f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50183d650>
2026-03-27 10:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f6086c3-075b-5f4a-9712-6bf7b7ad5a95/5f6086c3-075b-5f4a-9712-6bf7b7ad5a95_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F8d%252F878d672962e18710b7c3dff16f574a27%252Fpa%252FBR67018_c6a073c6f028c2f303b24020f66a6f6f.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_c6a073c6f028c2f303b24020f66a6f6f.jpg saved to cache
2026-03-27 10:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95
2026-03-27 10:39:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_d0a2ea6fd2a35cff822e815b2153ba1a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500589890>
2026-03-27 10:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f6086c3-075b-5f4a-9712-6bf7b7ad5a95/5f6086c3-075b-5f4a-9712-6bf7b7ad5a95_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F8d%252F878d672962e18710b7c3dff16f574a27%252Fpa%252FBR67018_d0a2ea6fd2a35cff822e815b2153ba1a.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_d0a2ea6fd2a35cff822e815b2153ba1a.jpg saved to cache
2026-03-27 10:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95
2026-03-27 10:39:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_c5725290b4a80762889d434adef1ef55.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501857750>
2026-03-27 10:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f6086c3-075b-5f4a-9712-6bf7b7ad5a95/5f6086c3-075b-5f4a-9712-6bf7b7ad5a95_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F8d%252F878d672962e18710b7c3dff16f574a27%252Fpa%252FBR67018_c5725290b4a80762889d434adef1ef55.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_c5725290b4a80762889d434adef1ef55.jpg saved to cache
2026-03-27 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95
2026-03-27 10:39:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95, skipping ID generation
2026-03-27 10:39:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95 with scrape type 1
2026-03-27 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95 sending to next pipeline
2026-03-27 10:39:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95, identifier: BR67018
2026-03-27 10:39:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95 with identifier: BR67018
2026-03-27 10:39:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95 with identifier: BR67018
2026-03-27 10:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95 with identifier: BR67018 to the API
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_c5725290b4a80762889d434adef1ef55.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:21:24Z',
 'fuel_type': 'petrol',
 'id': '5f6086c3-075b-5f4a-9712-6bf7b7ad5a95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR67018',
 'listing': 'auction',
 'location': 'DE, Hagen',
 'make': 'Opel',
 'model': 'Karl',
 'odometer': 52601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f6086c3-075b-5f4a-9712-6bf7b7ad5a95/5f6086c3-075b-5f4a-9712-6bf7b7ad5a95_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2697062,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_c5725290b4a80762889d434adef1ef55.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f6086c3-075b-5f4a-9712-6bf7b7ad5a95/5f6086c3-075b-5f4a-9712-6bf7b7ad5a95_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_d0a2ea6fd2a35cff822e815b2153ba1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f6086c3-075b-5f4a-9712-6bf7b7ad5a95/5f6086c3-075b-5f4a-9712-6bf7b7ad5a95_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2519746,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_c6a073c6f028c2f303b24020f66a6f6f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f6086c3-075b-5f4a-9712-6bf7b7ad5a95/5f6086c3-075b-5f4a-9712-6bf7b7ad5a95_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2456479,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_cc841680b49aae6732dde29db62fcfb4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f6086c3-075b-5f4a-9712-6bf7b7ad5a95/5f6086c3-075b-5f4a-9712-6bf7b7ad5a95_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2469429,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_441c4d0b2955e193ed459fe97dca0edb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f6086c3-075b-5f4a-9712-6bf7b7ad5a95/5f6086c3-075b-5f4a-9712-6bf7b7ad5a95_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2168336,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_eae1331bcab3ab6a86c1bb95ab85e19d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f6086c3-075b-5f4a-9712-6bf7b7ad5a95/5f6086c3-075b-5f4a-9712-6bf7b7ad5a95_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_c889c07f17a38d6acecc1534c8e186e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f6086c3-075b-5f4a-9712-6bf7b7ad5a95/5f6086c3-075b-5f4a-9712-6bf7b7ad5a95_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_c84aefd23c1edba75e7812845b3b0664.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f6086c3-075b-5f4a-9712-6bf7b7ad5a95/5f6086c3-075b-5f4a-9712-6bf7b7ad5a95_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2601265,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_35a741f7d3a21ea1ef2be599365a4492.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f6086c3-075b-5f4a-9712-6bf7b7ad5a95/5f6086c3-075b-5f4a-9712-6bf7b7ad5a95_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2525434,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/8d/878d672962e18710b7c3dff16f574a27/pa/BR67018_466f19959f6f8542e86186da9ea90aa8.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Karl 1.0 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2015}
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR67018%27 HTTP/1.1" 200 None
2026-03-27 10:39:15 [auto1.de] INFO: Saving data for BR67018: {'created_time': 1774607955.679332, 'last_price_update_time': 1774607955.679344, 'auction_closing_time': 1774714884.0}
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR67018') HTTP/1.1" 204 0
2026-03-27 10:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU14525> (referer: https://www.auto1.com/v1/car-details-view/SU14525/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c96cac54-aefd-5e54-a0a7-2b702bfc4abe with identifier: SU14525
2026-03-27 10:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c96cac54-aefd-5e54-a0a7-2b702bfc4abe with scrape type 1
2026-03-27 10:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c96cac54-aefd-5e54-a0a7-2b702bfc4abe
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fef%252F31efd490ecfa3cc618750abe47cd405e%252Fpa%252FSU14525_45aaf097ff810c97ed0084099643d71d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_45aaf097ff810c97ed0084099643d71d.jpg not downloaded yet
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fef%252F31efd490ecfa3cc618750abe47cd405e%252Fpa%252FSU14525_23dd78ed53f9d751ffc33ed034c3ef68.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_23dd78ed53f9d751ffc33ed034c3ef68.jpg not downloaded yet
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fef%252F31efd490ecfa3cc618750abe47cd405e%252Fpa%252FSU14525_db1c2205cbc4cb9b735445812c131191.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_db1c2205cbc4cb9b735445812c131191.jpg not downloaded yet
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fef%252F31efd490ecfa3cc618750abe47cd405e%252Fpa%252FSU14525_60720c05e0ae599d8cbf0d980732d911.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_60720c05e0ae599d8cbf0d980732d911.jpg not downloaded yet
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fef%252F31efd490ecfa3cc618750abe47cd405e%252Fpa%252FSU14525_6c49f38b7df7c676f3c8ccaf612fb5d3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_6c49f38b7df7c676f3c8ccaf612fb5d3.jpg not downloaded yet
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fef%252F31efd490ecfa3cc618750abe47cd405e%252Fpa%252FSU14525_41ab079eef0e1bcfa62d9fd6fb0c0d2d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_41ab079eef0e1bcfa62d9fd6fb0c0d2d.jpg not downloaded yet
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fef%252F31efd490ecfa3cc618750abe47cd405e%252Fpa%252FSU14525_997fbc2478e97e2b22e52d3fea08865f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_997fbc2478e97e2b22e52d3fea08865f.jpg not downloaded yet
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fef%252F31efd490ecfa3cc618750abe47cd405e%252Fpa%252FSU14525_fb0a3f1e8dd09f4e5e7e0ad20d91d1c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_fb0a3f1e8dd09f4e5e7e0ad20d91d1c0.jpg not downloaded yet
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fef%252F31efd490ecfa3cc618750abe47cd405e%252Fpa%252FSU14525_9c7ba017ec8ef8c6bb88e7a477e498f9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_9c7ba017ec8ef8c6bb88e7a477e498f9.jpg not downloaded yet
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fef%252F31efd490ecfa3cc618750abe47cd405e%252Fpa%252FSU14525_fc99d71e352d3c8b2e0504252c316ef4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_fc99d71e352d3c8b2e0504252c316ef4.jpg not downloaded yet
2026-03-27 10:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZP29614> (referer: https://www.auto1.com/v1/car-details-view/ZP29614/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_fc99d71e352d3c8b2e0504252c316ef4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ff3db46-c194-5187-9ec7-67543c85209e with identifier: ZP29614
2026-03-27 10:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ff3db46-c194-5187-9ec7-67543c85209e with scrape type 1
2026-03-27 10:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6ff3db46-c194-5187-9ec7-67543c85209e
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fba%252Fb1ba6301a12ff94091a567ca28404838%252Fpa%252FZP29614_df4ae2c95d3a4ab20bb08a0e1e4def4b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_df4ae2c95d3a4ab20bb08a0e1e4def4b.jpg not downloaded yet
2026-03-27 10:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_9c7ba017ec8ef8c6bb88e7a477e498f9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fba%252Fb1ba6301a12ff94091a567ca28404838%252Fpa%252FZP29614_0dbab53d84dea62bb2062b08089656f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_0dbab53d84dea62bb2062b08089656f5.jpg not downloaded yet
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fba%252Fb1ba6301a12ff94091a567ca28404838%252Fpa%252FZP29614_b11e38b9ce353ff16c6f363b87588548.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_b11e38b9ce353ff16c6f363b87588548.jpg not downloaded yet
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fba%252Fb1ba6301a12ff94091a567ca28404838%252Fpa%252FZP29614_d0f765faea0d1a5934740eb06953c7b3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_d0f765faea0d1a5934740eb06953c7b3.jpg not downloaded yet
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fba%252Fb1ba6301a12ff94091a567ca28404838%252Fpa%252FZP29614_4d522f9840b76a5047c750d8a5acc6b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_4d522f9840b76a5047c750d8a5acc6b2.jpg not downloaded yet
2026-03-27 10:39:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500573890>
2026-03-27 10:39:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96cac54-aefd-5e54-a0a7-2b702bfc4abe/c96cac54-aefd-5e54-a0a7-2b702bfc4abe_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fef%252F31efd490ecfa3cc618750abe47cd405e%252Fpa%252FSU14525_fc99d71e352d3c8b2e0504252c316ef4.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_fc99d71e352d3c8b2e0504252c316ef4.jpg saved to cache
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c96cac54-aefd-5e54-a0a7-2b702bfc4abe
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fba%252Fb1ba6301a12ff94091a567ca28404838%252Fpa%252FZP29614_86a0741a4280a948c80142c44a8ca176.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_86a0741a4280a948c80142c44a8ca176.jpg not downloaded yet
2026-03-27 10:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_df4ae2c95d3a4ab20bb08a0e1e4def4b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fba%252Fb1ba6301a12ff94091a567ca28404838%252Fpa%252FZP29614_b27ad7153033ba15f65f3d7df9ffef0e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_b27ad7153033ba15f65f3d7df9ffef0e.jpg not downloaded yet
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fba%252Fb1ba6301a12ff94091a567ca28404838%252Fpa%252FZP29614_98a26c3c9fefe304be41ef9b71961f52.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_98a26c3c9fefe304be41ef9b71961f52.jpg not downloaded yet
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500393490>
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96cac54-aefd-5e54-a0a7-2b702bfc4abe/c96cac54-aefd-5e54-a0a7-2b702bfc4abe_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fef%252F31efd490ecfa3cc618750abe47cd405e%252Fpa%252FSU14525_9c7ba017ec8ef8c6bb88e7a477e498f9.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_9c7ba017ec8ef8c6bb88e7a477e498f9.jpg saved to cache
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c96cac54-aefd-5e54-a0a7-2b702bfc4abe
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fba%252Fb1ba6301a12ff94091a567ca28404838%252Fpa%252FZP29614_78aa31818e790d71e7b7f1d9ab5edefd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_78aa31818e790d71e7b7f1d9ab5edefd.jpg not downloaded yet
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fba%252Fb1ba6301a12ff94091a567ca28404838%252Fpa%252FZP29614_12c1da100b043795ef378490e8aa350f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_12c1da100b043795ef378490e8aa350f.jpg not downloaded yet
2026-03-27 10:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_4d522f9840b76a5047c750d8a5acc6b2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501628710>
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff3db46-c194-5187-9ec7-67543c85209e/6ff3db46-c194-5187-9ec7-67543c85209e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fba%252Fb1ba6301a12ff94091a567ca28404838%252Fpa%252FZP29614_df4ae2c95d3a4ab20bb08a0e1e4def4b.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_df4ae2c95d3a4ab20bb08a0e1e4def4b.jpg saved to cache
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ff3db46-c194-5187-9ec7-67543c85209e
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501866ad0>
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff3db46-c194-5187-9ec7-67543c85209e/6ff3db46-c194-5187-9ec7-67543c85209e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fba%252Fb1ba6301a12ff94091a567ca28404838%252Fpa%252FZP29614_4d522f9840b76a5047c750d8a5acc6b2.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_4d522f9840b76a5047c750d8a5acc6b2.jpg saved to cache
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ff3db46-c194-5187-9ec7-67543c85209e
2026-03-27 10:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_12c1da100b043795ef378490e8aa350f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_78aa31818e790d71e7b7f1d9ab5edefd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503b53e10>
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff3db46-c194-5187-9ec7-67543c85209e/6ff3db46-c194-5187-9ec7-67543c85209e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fba%252Fb1ba6301a12ff94091a567ca28404838%252Fpa%252FZP29614_12c1da100b043795ef378490e8aa350f.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_12c1da100b043795ef378490e8aa350f.jpg saved to cache
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6ff3db46-c194-5187-9ec7-67543c85209e
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500589490>
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff3db46-c194-5187-9ec7-67543c85209e/6ff3db46-c194-5187-9ec7-67543c85209e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fba%252Fb1ba6301a12ff94091a567ca28404838%252Fpa%252FZP29614_78aa31818e790d71e7b7f1d9ab5edefd.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_78aa31818e790d71e7b7f1d9ab5edefd.jpg saved to cache
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6ff3db46-c194-5187-9ec7-67543c85209e
2026-03-27 10:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_98a26c3c9fefe304be41ef9b71961f52.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_b27ad7153033ba15f65f3d7df9ffef0e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f23d0>
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff3db46-c194-5187-9ec7-67543c85209e/6ff3db46-c194-5187-9ec7-67543c85209e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fba%252Fb1ba6301a12ff94091a567ca28404838%252Fpa%252FZP29614_98a26c3c9fefe304be41ef9b71961f52.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_98a26c3c9fefe304be41ef9b71961f52.jpg saved to cache
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ff3db46-c194-5187-9ec7-67543c85209e
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f21d0>
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff3db46-c194-5187-9ec7-67543c85209e/6ff3db46-c194-5187-9ec7-67543c85209e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fba%252Fb1ba6301a12ff94091a567ca28404838%252Fpa%252FZP29614_b27ad7153033ba15f65f3d7df9ffef0e.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_b27ad7153033ba15f65f3d7df9ffef0e.jpg saved to cache
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ff3db46-c194-5187-9ec7-67543c85209e
2026-03-27 10:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP70088> (referer: https://www.auto1.com/v1/car-details-view/EP70088/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_86a0741a4280a948c80142c44a8ca176.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1aa1988-2205-589a-8056-74499d1d99da with identifier: EP70088
2026-03-27 10:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1aa1988-2205-589a-8056-74499d1d99da with scrape type 1
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a1aa1988-2205-589a-8056-74499d1d99da
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a98c5c33a6f43728c4059b76833033%252Fpa%252FEP70088_1eb17a99c603fd15e5d410852a9a93ad.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a98c5c33a6f43728c4059b76833033/pa/EP70088_1eb17a99c603fd15e5d410852a9a93ad.jpg not downloaded yet
2026-03-27 10:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_b11e38b9ce353ff16c6f363b87588548.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a98c5c33a6f43728c4059b76833033%252Fpa%252FEP70088_bb8f98a897263a5e0b681417edccb827.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a98c5c33a6f43728c4059b76833033/pa/EP70088_bb8f98a897263a5e0b681417edccb827.jpg not downloaded yet
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a98c5c33a6f43728c4059b76833033%252Fpa%252FEP70088_df0de074b0d664994dcb84ef5cd6488a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a98c5c33a6f43728c4059b76833033/pa/EP70088_df0de074b0d664994dcb84ef5cd6488a.jpg not downloaded yet
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a98c5c33a6f43728c4059b76833033%252Fpa%252FEP70088_fcfb302d81bf60893ec290d043fad10b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a98c5c33a6f43728c4059b76833033/pa/EP70088_fcfb302d81bf60893ec290d043fad10b.jpg not downloaded yet
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501867890>
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff3db46-c194-5187-9ec7-67543c85209e/6ff3db46-c194-5187-9ec7-67543c85209e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fba%252Fb1ba6301a12ff94091a567ca28404838%252Fpa%252FZP29614_86a0741a4280a948c80142c44a8ca176.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_86a0741a4280a948c80142c44a8ca176.jpg saved to cache
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ff3db46-c194-5187-9ec7-67543c85209e
2026-03-27 10:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_d0f765faea0d1a5934740eb06953c7b3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a98c5c33a6f43728c4059b76833033%252Fpa%252FEP70088_69cfd1b75bcd90104c0e98d5214f1ac2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a98c5c33a6f43728c4059b76833033/pa/EP70088_69cfd1b75bcd90104c0e98d5214f1ac2.jpg not downloaded yet
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501989fd0>
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff3db46-c194-5187-9ec7-67543c85209e/6ff3db46-c194-5187-9ec7-67543c85209e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fba%252Fb1ba6301a12ff94091a567ca28404838%252Fpa%252FZP29614_b11e38b9ce353ff16c6f363b87588548.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_b11e38b9ce353ff16c6f363b87588548.jpg saved to cache
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ff3db46-c194-5187-9ec7-67543c85209e
2026-03-27 10:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a9/b9a98c5c33a6f43728c4059b76833033/pa/EP70088_1eb17a99c603fd15e5d410852a9a93ad.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501989d90>
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff3db46-c194-5187-9ec7-67543c85209e/6ff3db46-c194-5187-9ec7-67543c85209e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fba%252Fb1ba6301a12ff94091a567ca28404838%252Fpa%252FZP29614_d0f765faea0d1a5934740eb06953c7b3.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_d0f765faea0d1a5934740eb06953c7b3.jpg saved to cache
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ff3db46-c194-5187-9ec7-67543c85209e
2026-03-27 10:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a9/b9a98c5c33a6f43728c4059b76833033/pa/EP70088_fcfb302d81bf60893ec290d043fad10b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a9/b9a98c5c33a6f43728c4059b76833033/pa/EP70088_69cfd1b75bcd90104c0e98d5214f1ac2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50372b550>
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1aa1988-2205-589a-8056-74499d1d99da/a1aa1988-2205-589a-8056-74499d1d99da_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a98c5c33a6f43728c4059b76833033%252Fpa%252FEP70088_1eb17a99c603fd15e5d410852a9a93ad.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a98c5c33a6f43728c4059b76833033/pa/EP70088_1eb17a99c603fd15e5d410852a9a93ad.jpg saved to cache
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1aa1988-2205-589a-8056-74499d1d99da
2026-03-27 10:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a9/b9a98c5c33a6f43728c4059b76833033/pa/EP70088_bb8f98a897263a5e0b681417edccb827.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50161e7d0>
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1aa1988-2205-589a-8056-74499d1d99da/a1aa1988-2205-589a-8056-74499d1d99da_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a98c5c33a6f43728c4059b76833033%252Fpa%252FEP70088_fcfb302d81bf60893ec290d043fad10b.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a98c5c33a6f43728c4059b76833033/pa/EP70088_fcfb302d81bf60893ec290d043fad10b.jpg saved to cache
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1aa1988-2205-589a-8056-74499d1d99da
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5005009d0>
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1aa1988-2205-589a-8056-74499d1d99da/a1aa1988-2205-589a-8056-74499d1d99da_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a98c5c33a6f43728c4059b76833033%252Fpa%252FEP70088_69cfd1b75bcd90104c0e98d5214f1ac2.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a98c5c33a6f43728c4059b76833033/pa/EP70088_69cfd1b75bcd90104c0e98d5214f1ac2.jpg saved to cache
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1aa1988-2205-589a-8056-74499d1d99da
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50183f990>
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1aa1988-2205-589a-8056-74499d1d99da/a1aa1988-2205-589a-8056-74499d1d99da_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a98c5c33a6f43728c4059b76833033%252Fpa%252FEP70088_bb8f98a897263a5e0b681417edccb827.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a98c5c33a6f43728c4059b76833033/pa/EP70088_bb8f98a897263a5e0b681417edccb827.jpg saved to cache
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1aa1988-2205-589a-8056-74499d1d99da
2026-03-27 10:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a9/b9a98c5c33a6f43728c4059b76833033/pa/EP70088_df0de074b0d664994dcb84ef5cd6488a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_0dbab53d84dea62bb2062b08089656f5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_fb0a3f1e8dd09f4e5e7e0ad20d91d1c0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50175e390>
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1aa1988-2205-589a-8056-74499d1d99da/a1aa1988-2205-589a-8056-74499d1d99da_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a98c5c33a6f43728c4059b76833033%252Fpa%252FEP70088_df0de074b0d664994dcb84ef5cd6488a.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a98c5c33a6f43728c4059b76833033/pa/EP70088_df0de074b0d664994dcb84ef5cd6488a.jpg saved to cache
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1aa1988-2205-589a-8056-74499d1d99da
2026-03-27 10:39:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1aa1988-2205-589a-8056-74499d1d99da, skipping ID generation
2026-03-27 10:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1aa1988-2205-589a-8056-74499d1d99da with scrape type 1
2026-03-27 10:39:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1aa1988-2205-589a-8056-74499d1d99da sending to next pipeline
2026-03-27 10:39:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1aa1988-2205-589a-8056-74499d1d99da, identifier: EP70088
2026-03-27 10:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1aa1988-2205-589a-8056-74499d1d99da with identifier: EP70088
2026-03-27 10:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1aa1988-2205-589a-8056-74499d1d99da with identifier: EP70088
2026-03-27 10:39:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1aa1988-2205-589a-8056-74499d1d99da with identifier: EP70088 to the API
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb9/a9/b9a98c5c33a6f43728c4059b76833033/pa/EP70088_df0de074b0d664994dcb84ef5cd6488a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:50:48Z',
 'fuel_type': 'diesel',
 'id': 'a1aa1988-2205-589a-8056-74499d1d99da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP70088',
 'listing': 'auction',
 'location': 'DE, Bochum',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 258296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1aa1988-2205-589a-8056-74499d1d99da/a1aa1988-2205-589a-8056-74499d1d99da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a9/b9a98c5c33a6f43728c4059b76833033/pa/EP70088_1eb17a99c603fd15e5d410852a9a93ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1aa1988-2205-589a-8056-74499d1d99da/a1aa1988-2205-589a-8056-74499d1d99da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a9/b9a98c5c33a6f43728c4059b76833033/pa/EP70088_bb8f98a897263a5e0b681417edccb827.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1aa1988-2205-589a-8056-74499d1d99da/a1aa1988-2205-589a-8056-74499d1d99da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a9/b9a98c5c33a6f43728c4059b76833033/pa/EP70088_df0de074b0d664994dcb84ef5cd6488a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1aa1988-2205-589a-8056-74499d1d99da/a1aa1988-2205-589a-8056-74499d1d99da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a9/b9a98c5c33a6f43728c4059b76833033/pa/EP70088_fcfb302d81bf60893ec290d043fad10b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1aa1988-2205-589a-8056-74499d1d99da/a1aa1988-2205-589a-8056-74499d1d99da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a9/b9a98c5c33a6f43728c4059b76833033/pa/EP70088_69cfd1b75bcd90104c0e98d5214f1ac2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Yeti 2.0 TDI Joy 4x4',
 'transmission': 'manual',
 'trim': 'Joy 4x4',
 'year': 2016}
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP70088%27 HTTP/1.1" 200 None
2026-03-27 10:39:23 [auto1.de] INFO: Saving data for EP70088: {'created_time': 1774607963.336038, 'last_price_update_time': 1774607963.336048, 'auction_closing_time': 1774716648.0}
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP70088') HTTP/1.1" 204 0
2026-03-27 10:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_997fbc2478e97e2b22e52d3fea08865f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501866710>
2026-03-27 10:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff3db46-c194-5187-9ec7-67543c85209e/6ff3db46-c194-5187-9ec7-67543c85209e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fba%252Fb1ba6301a12ff94091a567ca28404838%252Fpa%252FZP29614_0dbab53d84dea62bb2062b08089656f5.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_0dbab53d84dea62bb2062b08089656f5.jpg saved to cache
2026-03-27 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ff3db46-c194-5187-9ec7-67543c85209e
2026-03-27 10:39:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ff3db46-c194-5187-9ec7-67543c85209e, skipping ID generation
2026-03-27 10:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ff3db46-c194-5187-9ec7-67543c85209e with scrape type 1
2026-03-27 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ff3db46-c194-5187-9ec7-67543c85209e sending to next pipeline
2026-03-27 10:39:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ff3db46-c194-5187-9ec7-67543c85209e, identifier: ZP29614
2026-03-27 10:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50058acd0>
2026-03-27 10:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96cac54-aefd-5e54-a0a7-2b702bfc4abe/c96cac54-aefd-5e54-a0a7-2b702bfc4abe_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fef%252F31efd490ecfa3cc618750abe47cd405e%252Fpa%252FSU14525_fb0a3f1e8dd09f4e5e7e0ad20d91d1c0.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_fb0a3f1e8dd09f4e5e7e0ad20d91d1c0.jpg saved to cache
2026-03-27 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c96cac54-aefd-5e54-a0a7-2b702bfc4abe
2026-03-27 10:39:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ff3db46-c194-5187-9ec7-67543c85209e with identifier: ZP29614
2026-03-27 10:39:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ff3db46-c194-5187-9ec7-67543c85209e with identifier: ZP29614
2026-03-27 10:39:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ff3db46-c194-5187-9ec7-67543c85209e with identifier: ZP29614 to the API
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_0dbab53d84dea62bb2062b08089656f5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:14:54Z',
 'fuel_type': 'diesel',
 'id': '6ff3db46-c194-5187-9ec7-67543c85209e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP29614',
 'listing': 'auction',
 'location': 'DE, Blankenfelde-Mahlow',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 166750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ff3db46-c194-5187-9ec7-67543c85209e/6ff3db46-c194-5187-9ec7-67543c85209e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_df4ae2c95d3a4ab20bb08a0e1e4def4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ff3db46-c194-5187-9ec7-67543c85209e/6ff3db46-c194-5187-9ec7-67543c85209e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_0dbab53d84dea62bb2062b08089656f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ff3db46-c194-5187-9ec7-67543c85209e/6ff3db46-c194-5187-9ec7-67543c85209e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_b11e38b9ce353ff16c6f363b87588548.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ff3db46-c194-5187-9ec7-67543c85209e/6ff3db46-c194-5187-9ec7-67543c85209e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_d0f765faea0d1a5934740eb06953c7b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ff3db46-c194-5187-9ec7-67543c85209e/6ff3db46-c194-5187-9ec7-67543c85209e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_4d522f9840b76a5047c750d8a5acc6b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ff3db46-c194-5187-9ec7-67543c85209e/6ff3db46-c194-5187-9ec7-67543c85209e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_86a0741a4280a948c80142c44a8ca176.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ff3db46-c194-5187-9ec7-67543c85209e/6ff3db46-c194-5187-9ec7-67543c85209e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_b27ad7153033ba15f65f3d7df9ffef0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ff3db46-c194-5187-9ec7-67543c85209e/6ff3db46-c194-5187-9ec7-67543c85209e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_98a26c3c9fefe304be41ef9b71961f52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ff3db46-c194-5187-9ec7-67543c85209e/6ff3db46-c194-5187-9ec7-67543c85209e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_78aa31818e790d71e7b7f1d9ab5edefd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ff3db46-c194-5187-9ec7-67543c85209e/6ff3db46-c194-5187-9ec7-67543c85209e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/ba/b1ba6301a12ff94091a567ca28404838/pa/ZP29614_12c1da100b043795ef378490e8aa350f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi EcoBlue Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2023}
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP29614%27 HTTP/1.1" 200 None
2026-03-27 10:39:23 [auto1.de] INFO: Saving data for ZP29614: {'created_time': 1774607963.910998, 'last_price_update_time': 1774607963.911011, 'auction_closing_time': 1774714494.0}
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP29614') HTTP/1.1" 204 0
2026-03-27 10:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50183dfd0>
2026-03-27 10:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96cac54-aefd-5e54-a0a7-2b702bfc4abe/c96cac54-aefd-5e54-a0a7-2b702bfc4abe_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fef%252F31efd490ecfa3cc618750abe47cd405e%252Fpa%252FSU14525_997fbc2478e97e2b22e52d3fea08865f.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_997fbc2478e97e2b22e52d3fea08865f.jpg saved to cache
2026-03-27 10:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c96cac54-aefd-5e54-a0a7-2b702bfc4abe
2026-03-27 10:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_41ab079eef0e1bcfa62d9fd6fb0c0d2d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_6c49f38b7df7c676f3c8ccaf612fb5d3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501809a90>
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96cac54-aefd-5e54-a0a7-2b702bfc4abe/c96cac54-aefd-5e54-a0a7-2b702bfc4abe_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fef%252F31efd490ecfa3cc618750abe47cd405e%252Fpa%252FSU14525_41ab079eef0e1bcfa62d9fd6fb0c0d2d.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_41ab079eef0e1bcfa62d9fd6fb0c0d2d.jpg saved to cache
2026-03-27 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c96cac54-aefd-5e54-a0a7-2b702bfc4abe
2026-03-27 10:39:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501867390>
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96cac54-aefd-5e54-a0a7-2b702bfc4abe/c96cac54-aefd-5e54-a0a7-2b702bfc4abe_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fef%252F31efd490ecfa3cc618750abe47cd405e%252Fpa%252FSU14525_6c49f38b7df7c676f3c8ccaf612fb5d3.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_6c49f38b7df7c676f3c8ccaf612fb5d3.jpg saved to cache
2026-03-27 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c96cac54-aefd-5e54-a0a7-2b702bfc4abe
2026-03-27 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_db1c2205cbc4cb9b735445812c131191.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_60720c05e0ae599d8cbf0d980732d911.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_23dd78ed53f9d751ffc33ed034c3ef68.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_45aaf097ff810c97ed0084099643d71d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50058b510>
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96cac54-aefd-5e54-a0a7-2b702bfc4abe/c96cac54-aefd-5e54-a0a7-2b702bfc4abe_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fef%252F31efd490ecfa3cc618750abe47cd405e%252Fpa%252FSU14525_db1c2205cbc4cb9b735445812c131191.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_db1c2205cbc4cb9b735445812c131191.jpg saved to cache
2026-03-27 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c96cac54-aefd-5e54-a0a7-2b702bfc4abe
2026-03-27 10:39:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50175dc50>
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96cac54-aefd-5e54-a0a7-2b702bfc4abe/c96cac54-aefd-5e54-a0a7-2b702bfc4abe_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fef%252F31efd490ecfa3cc618750abe47cd405e%252Fpa%252FSU14525_60720c05e0ae599d8cbf0d980732d911.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_60720c05e0ae599d8cbf0d980732d911.jpg saved to cache
2026-03-27 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c96cac54-aefd-5e54-a0a7-2b702bfc4abe
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018b1a10>
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96cac54-aefd-5e54-a0a7-2b702bfc4abe/c96cac54-aefd-5e54-a0a7-2b702bfc4abe_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fef%252F31efd490ecfa3cc618750abe47cd405e%252Fpa%252FSU14525_23dd78ed53f9d751ffc33ed034c3ef68.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_23dd78ed53f9d751ffc33ed034c3ef68.jpg saved to cache
2026-03-27 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c96cac54-aefd-5e54-a0a7-2b702bfc4abe
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50191e290>
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c96cac54-aefd-5e54-a0a7-2b702bfc4abe/c96cac54-aefd-5e54-a0a7-2b702bfc4abe_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fef%252F31efd490ecfa3cc618750abe47cd405e%252Fpa%252FSU14525_45aaf097ff810c97ed0084099643d71d.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_45aaf097ff810c97ed0084099643d71d.jpg saved to cache
2026-03-27 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c96cac54-aefd-5e54-a0a7-2b702bfc4abe
2026-03-27 10:39:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c96cac54-aefd-5e54-a0a7-2b702bfc4abe, skipping ID generation
2026-03-27 10:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c96cac54-aefd-5e54-a0a7-2b702bfc4abe with scrape type 1
2026-03-27 10:39:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c96cac54-aefd-5e54-a0a7-2b702bfc4abe sending to next pipeline
2026-03-27 10:39:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c96cac54-aefd-5e54-a0a7-2b702bfc4abe, identifier: SU14525
2026-03-27 10:39:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c96cac54-aefd-5e54-a0a7-2b702bfc4abe with identifier: SU14525
2026-03-27 10:39:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c96cac54-aefd-5e54-a0a7-2b702bfc4abe with identifier: SU14525
2026-03-27 10:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c96cac54-aefd-5e54-a0a7-2b702bfc4abe with identifier: SU14525 to the API
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_45aaf097ff810c97ed0084099643d71d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:50:41Z',
 'fuel_type': 'diesel',
 'id': 'c96cac54-aefd-5e54-a0a7-2b702bfc4abe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU14525',
 'listing': 'auction',
 'location': 'DE, Bitburg',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 71243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c96cac54-aefd-5e54-a0a7-2b702bfc4abe/c96cac54-aefd-5e54-a0a7-2b702bfc4abe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_45aaf097ff810c97ed0084099643d71d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c96cac54-aefd-5e54-a0a7-2b702bfc4abe/c96cac54-aefd-5e54-a0a7-2b702bfc4abe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_23dd78ed53f9d751ffc33ed034c3ef68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c96cac54-aefd-5e54-a0a7-2b702bfc4abe/c96cac54-aefd-5e54-a0a7-2b702bfc4abe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2047638,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_db1c2205cbc4cb9b735445812c131191.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c96cac54-aefd-5e54-a0a7-2b702bfc4abe/c96cac54-aefd-5e54-a0a7-2b702bfc4abe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1872307,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_60720c05e0ae599d8cbf0d980732d911.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c96cac54-aefd-5e54-a0a7-2b702bfc4abe/c96cac54-aefd-5e54-a0a7-2b702bfc4abe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1950452,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_6c49f38b7df7c676f3c8ccaf612fb5d3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c96cac54-aefd-5e54-a0a7-2b702bfc4abe/c96cac54-aefd-5e54-a0a7-2b702bfc4abe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2371209,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_41ab079eef0e1bcfa62d9fd6fb0c0d2d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c96cac54-aefd-5e54-a0a7-2b702bfc4abe/c96cac54-aefd-5e54-a0a7-2b702bfc4abe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_997fbc2478e97e2b22e52d3fea08865f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c96cac54-aefd-5e54-a0a7-2b702bfc4abe/c96cac54-aefd-5e54-a0a7-2b702bfc4abe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_fb0a3f1e8dd09f4e5e7e0ad20d91d1c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c96cac54-aefd-5e54-a0a7-2b702bfc4abe/c96cac54-aefd-5e54-a0a7-2b702bfc4abe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_9c7ba017ec8ef8c6bb88e7a477e498f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c96cac54-aefd-5e54-a0a7-2b702bfc4abe/c96cac54-aefd-5e54-a0a7-2b702bfc4abe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/ef/31efd490ecfa3cc618750abe47cd405e/pa/SU14525_fc99d71e352d3c8b2e0504252c316ef4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-24',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi Energy L2H1 3,5t',
 'transmission': 'manual',
 'trim': 'L2H1 3,5t',
 'year': 2018}
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU14525%27 HTTP/1.1" 200 None
2026-03-27 10:39:25 [auto1.de] INFO: Saving data for SU14525: {'created_time': 1774607965.374403, 'last_price_update_time': 1774607965.374414, 'auction_closing_time': 1774716641.0}
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU14525') HTTP/1.1" 204 0
2026-03-27 10:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE16553/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_42ebc99307679f423e0757409633edbc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004c46d0>
2026-03-27 10:39:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab/abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F3f%252Fce3f4b1028cc87a9f9777e8a52c929e5%252Fpa%252FVZ15565_42ebc99307679f423e0757409633edbc.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_42ebc99307679f423e0757409633edbc.jpg saved to cache
2026-03-27 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab
2026-03-27 10:39:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab, skipping ID generation
2026-03-27 10:39:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab with scrape type 1
2026-03-27 10:39:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab sending to next pipeline
2026-03-27 10:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab, identifier: VZ15565
2026-03-27 10:39:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab with identifier: VZ15565
2026-03-27 10:39:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab with identifier: VZ15565
2026-03-27 10:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab with identifier: VZ15565 to the API
2026-03-27 10:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_42ebc99307679f423e0757409633edbc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:36:12Z',
 'fuel_type': 'petrol',
 'id': 'abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ15565',
 'listing': 'auction',
 'location': 'DE, Sinzheim',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 135645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab/abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2677902,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_42ebc99307679f423e0757409633edbc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab/abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2616210,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_365106dd6a2046156506b4f50764d87c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab/abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_191c83384ecfe687039c59434e5449ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab/abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_d5e6560d6b0db866442f9346fa9c37aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab/abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2807584,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_994c4d3d602f6bc9a29e943a7be6abc3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab/abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_729a7904bc8db41981150c66accbbde3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab/abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2702743,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_07fd25036324ba5997098d5ff4dcfcfe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab/abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2910376,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_60bd58e019d4014deb53a49fb07ec214.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab/abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_2dc8b295613d927f23c3a796e91d2c0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab/abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3267369,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/3f/ce3f4b1028cc87a9f9777e8a52c929e5/pa/VZ15565_ae3708e7e0e103042be3629285c78bc2.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Style Viva',
 'transmission': 'manual',
 'trim': 'Style Viva',
 'year': 2012}
2026-03-27 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ15565%27 HTTP/1.1" 200 None
2026-03-27 10:39:26 [auto1.de] INFO: Saving data for VZ15565: {'created_time': 1774607966.13937, 'last_price_update_time': 1774607966.139383, 'auction_closing_time': 1774715772.0}
2026-03-27 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ15565') HTTP/1.1" 204 0
2026-03-27 10:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UH40808> (referer: https://www.auto1.com/v1/car-details-view/UH40808/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bc8adaf-a9e8-510e-a96f-641f78a0a15c with identifier: UH40808
2026-03-27 10:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bc8adaf-a9e8-510e-a96f-641f78a0a15c with scrape type 1
2026-03-27 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9bc8adaf-a9e8-510e-a96f-641f78a0a15c
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F0d%252F5e0dc2539b4dfeb52d6e63424838bf6e%252Fpa%252FUH40808_882849a5f20a58a8ab4b54291916f5fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_882849a5f20a58a8ab4b54291916f5fa.jpg already downloaded
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F0d%252F5e0dc2539b4dfeb52d6e63424838bf6e%252Fpa%252FUH40808_176bbb6de3de0bba1f7e85dff7685588.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_176bbb6de3de0bba1f7e85dff7685588.jpg already downloaded
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F0d%252F5e0dc2539b4dfeb52d6e63424838bf6e%252Fpa%252FUH40808_cae0a2b85c00ba87a2853047df3dada6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_cae0a2b85c00ba87a2853047df3dada6.jpg already downloaded
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F0d%252F5e0dc2539b4dfeb52d6e63424838bf6e%252Fpa%252FUH40808_312f56932d23379ed083f4025864db9d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_312f56932d23379ed083f4025864db9d.jpg already downloaded
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F0d%252F5e0dc2539b4dfeb52d6e63424838bf6e%252Fpa%252FUH40808_8b19fc1dbe11c1831c0944c923af8b1c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_8b19fc1dbe11c1831c0944c923af8b1c.jpg already downloaded
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F0d%252F5e0dc2539b4dfeb52d6e63424838bf6e%252Fpa%252FUH40808_331d042c8241c4191fb140f4403862e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_331d042c8241c4191fb140f4403862e1.jpg already downloaded
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F0d%252F5e0dc2539b4dfeb52d6e63424838bf6e%252Fpa%252FUH40808_28cff8f328facc1f9120cca34534fc65.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_28cff8f328facc1f9120cca34534fc65.jpg already downloaded
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F0d%252F5e0dc2539b4dfeb52d6e63424838bf6e%252Fpa%252FUH40808_4931351d8c6794c24516a7c4c66e34f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_4931351d8c6794c24516a7c4c66e34f0.jpg already downloaded
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F0d%252F5e0dc2539b4dfeb52d6e63424838bf6e%252Fpa%252FUH40808_38b0dc8612414a158e46a625995b98d1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_38b0dc8612414a158e46a625995b98d1.jpg already downloaded
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F0d%252F5e0dc2539b4dfeb52d6e63424838bf6e%252Fpa%252FUH40808_ec36959777d8ca9a57b5ed5d488d5d5a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_ec36959777d8ca9a57b5ed5d488d5d5a.jpg already downloaded
2026-03-27 10:39:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9bc8adaf-a9e8-510e-a96f-641f78a0a15c, identifier: UH40808
2026-03-27 10:39:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9bc8adaf-a9e8-510e-a96f-641f78a0a15c with identifier: UH40808
2026-03-27 10:39:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9bc8adaf-a9e8-510e-a96f-641f78a0a15c with identifier: UH40808
2026-03-27 10:39:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9bc8adaf-a9e8-510e-a96f-641f78a0a15c with identifier: UH40808 to the API
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UH40808>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:47:02Z',
 'fuel_type': 'hybrid',
 'id': '9bc8adaf-a9e8-510e-a96f-641f78a0a15c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH40808',
 'listing': 'auction',
 'location': 'DE, Hodenhagen',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 27201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_882849a5f20a58a8ab4b54291916f5fa.jpg',
                'https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_176bbb6de3de0bba1f7e85dff7685588.jpg',
                'https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_cae0a2b85c00ba87a2853047df3dada6.jpg',
                'https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_312f56932d23379ed083f4025864db9d.jpg',
                'https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_8b19fc1dbe11c1831c0944c923af8b1c.jpg',
                'https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_331d042c8241c4191fb140f4403862e1.jpg',
                'https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_28cff8f328facc1f9120cca34534fc65.jpg',
                'https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_4931351d8c6794c24516a7c4c66e34f0.jpg',
                'https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_38b0dc8612414a158e46a625995b98d1.jpg',
                'https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_ec36959777d8ca9a57b5ed5d488d5d5a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc8adaf-a9e8-510e-a96f-641f78a0a15c/9bc8adaf-a9e8-510e-a96f-641f78a0a15c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_882849a5f20a58a8ab4b54291916f5fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc8adaf-a9e8-510e-a96f-641f78a0a15c/9bc8adaf-a9e8-510e-a96f-641f78a0a15c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_176bbb6de3de0bba1f7e85dff7685588.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc8adaf-a9e8-510e-a96f-641f78a0a15c/9bc8adaf-a9e8-510e-a96f-641f78a0a15c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_cae0a2b85c00ba87a2853047df3dada6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc8adaf-a9e8-510e-a96f-641f78a0a15c/9bc8adaf-a9e8-510e-a96f-641f78a0a15c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_312f56932d23379ed083f4025864db9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc8adaf-a9e8-510e-a96f-641f78a0a15c/9bc8adaf-a9e8-510e-a96f-641f78a0a15c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_8b19fc1dbe11c1831c0944c923af8b1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc8adaf-a9e8-510e-a96f-641f78a0a15c/9bc8adaf-a9e8-510e-a96f-641f78a0a15c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_331d042c8241c4191fb140f4403862e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc8adaf-a9e8-510e-a96f-641f78a0a15c/9bc8adaf-a9e8-510e-a96f-641f78a0a15c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_28cff8f328facc1f9120cca34534fc65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc8adaf-a9e8-510e-a96f-641f78a0a15c/9bc8adaf-a9e8-510e-a96f-641f78a0a15c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_4931351d8c6794c24516a7c4c66e34f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc8adaf-a9e8-510e-a96f-641f78a0a15c/9bc8adaf-a9e8-510e-a96f-641f78a0a15c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_38b0dc8612414a158e46a625995b98d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc8adaf-a9e8-510e-a96f-641f78a0a15c/9bc8adaf-a9e8-510e-a96f-641f78a0a15c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/0d/5e0dc2539b4dfeb52d6e63424838bf6e/pa/UH40808_ec36959777d8ca9a57b5ed5d488d5d5a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 eHybrid R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH40808%27 HTTP/1.1" 200 None
2026-03-27 10:39:27 [auto1.de] INFO: Saving data for UH40808: {'created_time': 1774607967.863991, 'last_price_update_time': 1774607967.864001, 'auction_closing_time': 1774716422.0}
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH40808') HTTP/1.1" 204 0
2026-03-27 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BK65604/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE85756/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BD51611/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:35 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.954(s), this was the 1st time calling it.
2026-03-27 10:39:35 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.3409231863852837 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-27 10:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TT34897/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XH92207/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-27 10:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:39 [auto1.de] INFO: Channel: 24h | Page: 12 | totalHits: 10512 | hits on page: 40
2026-03-27 10:39:39 [auto1.de] INFO: Found listing with ID: SA55190
2026-03-27 10:39:39 [auto1.de] INFO: Found listing with ID: JK17459
2026-03-27 10:39:39 [auto1.de] INFO: Found listing with ID: BG14243
2026-03-27 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG14243%27 HTTP/1.1" 200 None
2026-03-27 10:39:39 [auto1.de] INFO: Scrape type for BG14243: 0
2026-03-27 10:39:39 [auto1.de] INFO: Found listing with ID: BG81908
2026-03-27 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG81908%27 HTTP/1.1" 200 None
2026-03-27 10:39:39 [auto1.de] INFO: Scrape type for BG81908: 0
2026-03-27 10:39:39 [auto1.de] INFO: Found listing with ID: HG45518
2026-03-27 10:39:39 [auto1.de] INFO: Found listing with ID: DF93652
2026-03-27 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF93652%27 HTTP/1.1" 200 None
2026-03-27 10:39:39 [auto1.de] INFO: Scrape type for DF93652: 2
2026-03-27 10:39:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45e1a13a-53bc-5f5c-8dce-3fa9de323dab with identifier: DF93652
2026-03-27 10:39:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45e1a13a-53bc-5f5c-8dce-3fa9de323dab with scrape type 2
2026-03-27 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45e1a13a-53bc-5f5c-8dce-3fa9de323dab with scrape type 2
2026-03-27 10:39:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45e1a13a-53bc-5f5c-8dce-3fa9de323dab, identifier: DF93652
2026-03-27 10:39:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45e1a13a-53bc-5f5c-8dce-3fa9de323dab with identifier: DF93652
2026-03-27 10:39:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45e1a13a-53bc-5f5c-8dce-3fa9de323dab with identifier: DF93652
2026-03-27 10:39:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45e1a13a-53bc-5f5c-8dce-3fa9de323dab with identifier: DF93652 to the API
2026-03-27 10:39:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:46:39Z',
 'fuel_type': 'petrol',
 'id': '45e1a13a-53bc-5f5c-8dce-3fa9de323dab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF93652',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 174284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-13',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Ti-VCT Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2010}
2026-03-27 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF93652%27 HTTP/1.1" 200 None
2026-03-27 10:39:39 [auto1.de] INFO: Saving data for DF93652: {'auction_closing_time': 1774716399.0, 'created_time': 1774293735.382538, 'last_price_update_time': 1774607979.716431}
2026-03-27 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF93652') HTTP/1.1" 204 0
2026-03-27 10:39:39 [auto1.de] INFO: Found listing with ID: KR60146
2026-03-27 10:39:39 [auto1.de] INFO: Found listing with ID: UU73518
2026-03-27 10:39:39 [auto1.de] INFO: Found listing with ID: XT97786
2026-03-27 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT97786%27 HTTP/1.1" 200 None
2026-03-27 10:39:39 [auto1.de] INFO: Scrape type for XT97786: 2
2026-03-27 10:39:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6facd69-7e21-50c3-9f3f-9f041ea4f94b with identifier: XT97786
2026-03-27 10:39:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6facd69-7e21-50c3-9f3f-9f041ea4f94b with scrape type 2
2026-03-27 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6facd69-7e21-50c3-9f3f-9f041ea4f94b with scrape type 2
2026-03-27 10:39:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6facd69-7e21-50c3-9f3f-9f041ea4f94b, identifier: XT97786
2026-03-27 10:39:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6facd69-7e21-50c3-9f3f-9f041ea4f94b with identifier: XT97786
2026-03-27 10:39:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6facd69-7e21-50c3-9f3f-9f041ea4f94b with identifier: XT97786
2026-03-27 10:39:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6facd69-7e21-50c3-9f3f-9f041ea4f94b with identifier: XT97786 to the API
2026-03-27 10:39:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:18:14Z',
 'fuel_type': 'diesel',
 'id': 'b6facd69-7e21-50c3-9f3f-9f041ea4f94b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT97786',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 161110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-04',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2010}
2026-03-27 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT97786%27 HTTP/1.1" 200 None
2026-03-27 10:39:40 [auto1.de] INFO: Saving data for XT97786: {'auction_closing_time': 1774714694.0, 'created_time': 1773304551.431809, 'last_price_update_time': 1774607980.763193}
2026-03-27 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT97786') HTTP/1.1" 204 0
2026-03-27 10:39:40 [auto1.de] INFO: Found listing with ID: HJ94843
2026-03-27 10:39:40 [auto1.de] INFO: Found listing with ID: SX60280
2026-03-27 10:39:40 [auto1.de] INFO: Found listing with ID: CA31330
2026-03-27 10:39:40 [auto1.de] INFO: Found listing with ID: HV25811
2026-03-27 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV25811%27 HTTP/1.1" 200 None
2026-03-27 10:39:40 [auto1.de] INFO: Scrape type for HV25811: 2
2026-03-27 10:39:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a67d37d4-9e1d-59fb-be68-efdf59c28486 with identifier: HV25811
2026-03-27 10:39:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a67d37d4-9e1d-59fb-be68-efdf59c28486 with scrape type 2
2026-03-27 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a67d37d4-9e1d-59fb-be68-efdf59c28486 with scrape type 2
2026-03-27 10:39:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a67d37d4-9e1d-59fb-be68-efdf59c28486, identifier: HV25811
2026-03-27 10:39:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a67d37d4-9e1d-59fb-be68-efdf59c28486 with identifier: HV25811
2026-03-27 10:39:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a67d37d4-9e1d-59fb-be68-efdf59c28486 with identifier: HV25811
2026-03-27 10:39:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a67d37d4-9e1d-59fb-be68-efdf59c28486 with identifier: HV25811 to the API
2026-03-27 10:39:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:54:28Z',
 'fuel_type': 'diesel',
 'id': 'a67d37d4-9e1d-59fb-be68-efdf59c28486',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV25811',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 194886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-10',
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 TDCi Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2014}
2026-03-27 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV25811%27 HTTP/1.1" 200 None
2026-03-27 10:39:41 [auto1.de] INFO: Saving data for HV25811: {'auction_closing_time': 1774716868.0, 'created_time': 1773861037.372869, 'last_price_update_time': 1774607981.265365}
2026-03-27 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV25811') HTTP/1.1" 204 0
2026-03-27 10:39:41 [auto1.de] INFO: Found listing with ID: UM95943
2026-03-27 10:39:41 [auto1.de] INFO: Found listing with ID: NW54336
2026-03-27 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW54336%27 HTTP/1.1" 200 None
2026-03-27 10:39:41 [auto1.de] INFO: Scrape type for NW54336: 1
2026-03-27 10:39:41 [auto1.de] INFO: Found listing with ID: PS82435
2026-03-27 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82435%27 HTTP/1.1" 200 None
2026-03-27 10:39:41 [auto1.de] INFO: Scrape type for PS82435: 2
2026-03-27 10:39:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83d46900-c4d0-596f-bf3c-3292316c6c06 with identifier: PS82435
2026-03-27 10:39:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83d46900-c4d0-596f-bf3c-3292316c6c06 with scrape type 2
2026-03-27 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83d46900-c4d0-596f-bf3c-3292316c6c06 with scrape type 2
2026-03-27 10:39:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83d46900-c4d0-596f-bf3c-3292316c6c06, identifier: PS82435
2026-03-27 10:39:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83d46900-c4d0-596f-bf3c-3292316c6c06 with identifier: PS82435
2026-03-27 10:39:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83d46900-c4d0-596f-bf3c-3292316c6c06 with identifier: PS82435
2026-03-27 10:39:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83d46900-c4d0-596f-bf3c-3292316c6c06 with identifier: PS82435 to the API
2026-03-27 10:39:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:30:31Z',
 'fuel_type': 'diesel',
 'id': '83d46900-c4d0-596f-bf3c-3292316c6c06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS82435',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 111544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-05',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2016}
2026-03-27 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82435%27 HTTP/1.1" 200 None
2026-03-27 10:39:42 [auto1.de] INFO: Saving data for PS82435: {'auction_closing_time': 1774715431.0, 'created_time': 1773383897.094769, 'last_price_update_time': 1774607982.223484}
2026-03-27 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS82435') HTTP/1.1" 204 0
2026-03-27 10:39:42 [auto1.de] INFO: Found listing with ID: HD83134
2026-03-27 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD83134%27 HTTP/1.1" 200 None
2026-03-27 10:39:42 [auto1.de] INFO: Scrape type for HD83134: 2
2026-03-27 10:39:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 775d625a-b63d-5158-8a4d-ab299b317418 with identifier: HD83134
2026-03-27 10:39:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 775d625a-b63d-5158-8a4d-ab299b317418 with scrape type 2
2026-03-27 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 775d625a-b63d-5158-8a4d-ab299b317418 with scrape type 2
2026-03-27 10:39:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 775d625a-b63d-5158-8a4d-ab299b317418, identifier: HD83134
2026-03-27 10:39:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 775d625a-b63d-5158-8a4d-ab299b317418 with identifier: HD83134
2026-03-27 10:39:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 775d625a-b63d-5158-8a4d-ab299b317418 with identifier: HD83134
2026-03-27 10:39:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 775d625a-b63d-5158-8a4d-ab299b317418 with identifier: HD83134 to the API
2026-03-27 10:39:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:56:42Z',
 'fuel_type': 'diesel',
 'id': '775d625a-b63d-5158-8a4d-ab299b317418',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD83134',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 127808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-22',
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 Blue-HDi Feel M',
 'transmission': 'automatic',
 'trim': 'Feel M',
 'year': 2018}
2026-03-27 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD83134%27 HTTP/1.1" 200 None
2026-03-27 10:39:42 [auto1.de] INFO: Saving data for HD83134: {'auction_closing_time': 1774717002.0, 'created_time': 1773743753.185873, 'last_price_update_time': 1774607982.708219}
2026-03-27 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD83134') HTTP/1.1" 204 0
2026-03-27 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TX89120/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:42 [auto1.de] INFO: Found listing with ID: BK83629
2026-03-27 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK83629%27 HTTP/1.1" 200 None
2026-03-27 10:39:42 [auto1.de] INFO: Scrape type for BK83629: 2
2026-03-27 10:39:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08b99433-4430-572a-bf83-d3422960a74c with identifier: BK83629
2026-03-27 10:39:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08b99433-4430-572a-bf83-d3422960a74c with scrape type 2
2026-03-27 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08b99433-4430-572a-bf83-d3422960a74c with scrape type 2
2026-03-27 10:39:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08b99433-4430-572a-bf83-d3422960a74c, identifier: BK83629
2026-03-27 10:39:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08b99433-4430-572a-bf83-d3422960a74c with identifier: BK83629
2026-03-27 10:39:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08b99433-4430-572a-bf83-d3422960a74c with identifier: BK83629
2026-03-27 10:39:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08b99433-4430-572a-bf83-d3422960a74c with identifier: BK83629 to the API
2026-03-27 10:39:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:37:25Z',
 'fuel_type': 'diesel',
 'id': '08b99433-4430-572a-bf83-d3422960a74c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK83629',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 247105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-25',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-27 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK83629%27 HTTP/1.1" 200 None
2026-03-27 10:39:43 [auto1.de] INFO: Saving data for BK83629: {'auction_closing_time': 1774715845.0, 'created_time': 1773775072.915129, 'last_price_update_time': 1774607983.26811}
2026-03-27 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK83629') HTTP/1.1" 204 0
2026-03-27 10:39:43 [auto1.de] INFO: Found listing with ID: PF67152
2026-03-27 10:39:43 [auto1.de] INFO: Found listing with ID: EL68687
2026-03-27 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL68687%27 HTTP/1.1" 200 None
2026-03-27 10:39:43 [auto1.de] INFO: Scrape type for EL68687: 2
2026-03-27 10:39:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36584fe8-f12d-5dab-b9be-feec72cec099 with identifier: EL68687
2026-03-27 10:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36584fe8-f12d-5dab-b9be-feec72cec099 with scrape type 2
2026-03-27 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36584fe8-f12d-5dab-b9be-feec72cec099 with scrape type 2
2026-03-27 10:39:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36584fe8-f12d-5dab-b9be-feec72cec099, identifier: EL68687
2026-03-27 10:39:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36584fe8-f12d-5dab-b9be-feec72cec099 with identifier: EL68687
2026-03-27 10:39:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36584fe8-f12d-5dab-b9be-feec72cec099 with identifier: EL68687
2026-03-27 10:39:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36584fe8-f12d-5dab-b9be-feec72cec099 with identifier: EL68687 to the API
2026-03-27 10:39:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-28T16:22:23Z',
 'fuel_type': 'petrol',
 'id': '36584fe8-f12d-5dab-b9be-feec72cec099',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL68687',
 'listing': 'auction',
 'make': 'Lada',
 'model': 'Kalina 2',
 'odometer': 113754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-14',
 'seller_name': None,
 'title': 'Lada Kalina 2 1.6 Luxus',
 'transmission': 'manual',
 'trim': 'Luxus',
 'year': 2018}
2026-03-27 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL68687%27 HTTP/1.1" 200 None
2026-03-27 10:39:43 [auto1.de] INFO: Saving data for EL68687: {'auction_closing_time': 1774714943.0, 'created_time': 1774290939.72187, 'last_price_update_time': 1774607983.771579}
2026-03-27 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL68687') HTTP/1.1" 204 0
2026-03-27 10:39:43 [auto1.de] INFO: Found listing with ID: XR58128
2026-03-27 10:39:43 [auto1.de] INFO: Found listing with ID: ZS15843
2026-03-27 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS15843%27 HTTP/1.1" 200 None
2026-03-27 10:39:43 [auto1.de] INFO: Scrape type for ZS15843: 2
2026-03-27 10:39:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 957f701b-78c6-5a1a-bce4-b900c77f25bc with identifier: ZS15843
2026-03-27 10:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 957f701b-78c6-5a1a-bce4-b900c77f25bc with scrape type 2
2026-03-27 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 957f701b-78c6-5a1a-bce4-b900c77f25bc with scrape type 2
2026-03-27 10:39:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 957f701b-78c6-5a1a-bce4-b900c77f25bc, identifier: ZS15843
2026-03-27 10:39:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 957f701b-78c6-5a1a-bce4-b900c77f25bc with identifier: ZS15843
2026-03-27 10:39:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 957f701b-78c6-5a1a-bce4-b900c77f25bc with identifier: ZS15843
2026-03-27 10:39:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 957f701b-78c6-5a1a-bce4-b900c77f25bc with identifier: ZS15843 to the API
2026-03-27 10:39:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:10:34Z',
 'fuel_type': 'diesel',
 'id': '957f701b-78c6-5a1a-bce4-b900c77f25bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS15843',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 129072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-01',
 'seller_name': None,
 'title': 'BMW X3 xDrive 25d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2019}
2026-03-27 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS15843%27 HTTP/1.1" 200 None
2026-03-27 10:39:44 [auto1.de] INFO: Saving data for ZS15843: {'auction_closing_time': 1774714234.0, 'created_time': 1773830242.553052, 'last_price_update_time': 1774607984.244335}
2026-03-27 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS15843') HTTP/1.1" 204 0
2026-03-27 10:39:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.817(s), this was the 1st time calling it.
2026-03-27 10:39:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.592400942007548 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-27 10:39:44 [auto1.de] INFO: Found listing with ID: JK31212
2026-03-27 10:39:44 [auto1.de] INFO: Found listing with ID: XE19125
2026-03-27 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE19125%27 HTTP/1.1" 200 None
2026-03-27 10:39:44 [auto1.de] INFO: Scrape type for XE19125: 2
2026-03-27 10:39:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b186d73a-d055-5875-a0cd-f9c620e51bbc with identifier: XE19125
2026-03-27 10:39:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b186d73a-d055-5875-a0cd-f9c620e51bbc with scrape type 2
2026-03-27 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b186d73a-d055-5875-a0cd-f9c620e51bbc with scrape type 2
2026-03-27 10:39:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b186d73a-d055-5875-a0cd-f9c620e51bbc, identifier: XE19125
2026-03-27 10:39:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b186d73a-d055-5875-a0cd-f9c620e51bbc with identifier: XE19125
2026-03-27 10:39:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b186d73a-d055-5875-a0cd-f9c620e51bbc with identifier: XE19125
2026-03-27 10:39:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b186d73a-d055-5875-a0cd-f9c620e51bbc with identifier: XE19125 to the API
2026-03-27 10:39:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:26:42Z',
 'fuel_type': 'diesel',
 'id': 'b186d73a-d055-5875-a0cd-f9c620e51bbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE19125',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 168849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-28',
 'seller_name': None,
 'title': 'Skoda Yeti 2.0 TDI Active Plus Edition',
 'transmission': 'manual',
 'trim': 'Active Plus Edition',
 'year': 2013}
2026-03-27 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE19125%27 HTTP/1.1" 200 None
2026-03-27 10:39:44 [auto1.de] INFO: Saving data for XE19125: {'auction_closing_time': 1774715202.0, 'created_time': 1774293395.749275, 'last_price_update_time': 1774607984.732717}
2026-03-27 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE19125') HTTP/1.1" 204 0
2026-03-27 10:39:44 [auto1.de] INFO: Found listing with ID: GY96570
2026-03-27 10:39:44 [auto1.de] INFO: Found listing with ID: ZU59417
2026-03-27 10:39:44 [auto1.de] INFO: Found listing with ID: DG34410
2026-03-27 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34410%27 HTTP/1.1" 200 None
2026-03-27 10:39:44 [auto1.de] INFO: Scrape type for DG34410: 2
2026-03-27 10:39:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32396ce5-c841-5787-9313-5ee60592a2c4 with identifier: DG34410
2026-03-27 10:39:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32396ce5-c841-5787-9313-5ee60592a2c4 with scrape type 2
2026-03-27 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32396ce5-c841-5787-9313-5ee60592a2c4 with scrape type 2
2026-03-27 10:39:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32396ce5-c841-5787-9313-5ee60592a2c4, identifier: DG34410
2026-03-27 10:39:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32396ce5-c841-5787-9313-5ee60592a2c4 with identifier: DG34410
2026-03-27 10:39:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32396ce5-c841-5787-9313-5ee60592a2c4 with identifier: DG34410
2026-03-27 10:39:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32396ce5-c841-5787-9313-5ee60592a2c4 with identifier: DG34410 to the API
2026-03-27 10:39:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:02:24Z',
 'fuel_type': 'petrol',
 'id': '32396ce5-c841-5787-9313-5ee60592a2c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG34410',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 105777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-11',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2016}
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34410%27 HTTP/1.1" 200 None
2026-03-27 10:39:45 [auto1.de] INFO: Saving data for DG34410: {'auction_closing_time': 1774713744.0, 'created_time': 1774262886.678608, 'last_price_update_time': 1774607985.201516}
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG34410') HTTP/1.1" 204 0
2026-03-27 10:39:45 [auto1.de] INFO: Found listing with ID: LX86336
2026-03-27 10:39:45 [auto1.de] INFO: Found listing with ID: CY33039
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY33039%27 HTTP/1.1" 200 None
2026-03-27 10:39:45 [auto1.de] INFO: Scrape type for CY33039: 2
2026-03-27 10:39:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57a3b39f-620e-5e34-af76-592760220052 with identifier: CY33039
2026-03-27 10:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57a3b39f-620e-5e34-af76-592760220052 with scrape type 2
2026-03-27 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57a3b39f-620e-5e34-af76-592760220052 with scrape type 2
2026-03-27 10:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57a3b39f-620e-5e34-af76-592760220052, identifier: CY33039
2026-03-27 10:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57a3b39f-620e-5e34-af76-592760220052 with identifier: CY33039
2026-03-27 10:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57a3b39f-620e-5e34-af76-592760220052 with identifier: CY33039
2026-03-27 10:39:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57a3b39f-620e-5e34-af76-592760220052 with identifier: CY33039 to the API
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:08:05Z',
 'fuel_type': 'petrol',
 'id': '57a3b39f-620e-5e34-af76-592760220052',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY33039',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 219827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-31',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Fresh',
 'transmission': 'manual',
 'trim': 'Fresh',
 'year': 2013}
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY33039%27 HTTP/1.1" 200 None
2026-03-27 10:39:45 [auto1.de] INFO: Saving data for CY33039: {'auction_closing_time': 1774714085.0, 'created_time': 1774262936.886555, 'last_price_update_time': 1774607985.66955}
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY33039') HTTP/1.1" 204 0
2026-03-27 10:39:45 [auto1.de] INFO: Found listing with ID: HK68029
2026-03-27 10:39:45 [auto1.de] INFO: Found listing with ID: YJ51408
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ51408%27 HTTP/1.1" 200 None
2026-03-27 10:39:45 [auto1.de] INFO: Scrape type for YJ51408: 2
2026-03-27 10:39:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99e4a30f-26f4-5199-8aea-c26cfbeb21f0 with identifier: YJ51408
2026-03-27 10:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99e4a30f-26f4-5199-8aea-c26cfbeb21f0 with scrape type 2
2026-03-27 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99e4a30f-26f4-5199-8aea-c26cfbeb21f0 with scrape type 2
2026-03-27 10:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99e4a30f-26f4-5199-8aea-c26cfbeb21f0, identifier: YJ51408
2026-03-27 10:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99e4a30f-26f4-5199-8aea-c26cfbeb21f0 with identifier: YJ51408
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:39:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-27 10:39:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:39:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99e4a30f-26f4-5199-8aea-c26cfbeb21f0 with identifier: YJ51408
2026-03-27 10:39:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99e4a30f-26f4-5199-8aea-c26cfbeb21f0 with identifier: YJ51408 to the API
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:46:57Z',
 'fuel_type': 'diesel',
 'id': '99e4a30f-26f4-5199-8aea-c26cfbeb21f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ51408',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 196247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-19',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2014}
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ51408%27 HTTP/1.1" 200 None
2026-03-27 10:39:46 [auto1.de] INFO: Saving data for YJ51408: {'auction_closing_time': 1774716417.0, 'created_time': 1774293333.078668, 'last_price_update_time': 1774607986.455008}
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ51408') HTTP/1.1" 204 0
2026-03-27 10:39:46 [auto1.de] INFO: Found listing with ID: AL71232
2026-03-27 10:39:46 [auto1.de] INFO: Found listing with ID: EG34201
2026-03-27 10:39:46 [auto1.de] INFO: Found listing with ID: AG88480
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG88480%27 HTTP/1.1" 200 None
2026-03-27 10:39:46 [auto1.de] INFO: Scrape type for AG88480: 2
2026-03-27 10:39:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 858c7846-9150-55e7-a719-a197d896567e with identifier: AG88480
2026-03-27 10:39:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 858c7846-9150-55e7-a719-a197d896567e with scrape type 2
2026-03-27 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 858c7846-9150-55e7-a719-a197d896567e with scrape type 2
2026-03-27 10:39:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 858c7846-9150-55e7-a719-a197d896567e, identifier: AG88480
2026-03-27 10:39:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 858c7846-9150-55e7-a719-a197d896567e with identifier: AG88480
2026-03-27 10:39:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 858c7846-9150-55e7-a719-a197d896567e with identifier: AG88480
2026-03-27 10:39:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 858c7846-9150-55e7-a719-a197d896567e with identifier: AG88480 to the API
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-28T16:38:05Z',
 'fuel_type': 'diesel',
 'id': '858c7846-9150-55e7-a719-a197d896567e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG88480',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 204182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-05',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2009}
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG88480%27 HTTP/1.1" 200 None
2026-03-27 10:39:46 [auto1.de] INFO: Saving data for AG88480: {'auction_closing_time': 1774715885.0, 'created_time': 1773861288.338836, 'last_price_update_time': 1774607986.930923}
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG88480') HTTP/1.1" 204 0
2026-03-27 10:39:46 [auto1.de] INFO: Found listing with ID: PH16330
2026-03-27 10:39:46 [auto1.de] INFO: Found listing with ID: XU55815
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU55815%27 HTTP/1.1" 200 None
2026-03-27 10:39:46 [auto1.de] INFO: Scrape type for XU55815: 2
2026-03-27 10:39:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f446d91-50e7-5bc0-934f-0bf01935e8df with identifier: XU55815
2026-03-27 10:39:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f446d91-50e7-5bc0-934f-0bf01935e8df with scrape type 2
2026-03-27 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f446d91-50e7-5bc0-934f-0bf01935e8df with scrape type 2
2026-03-27 10:39:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f446d91-50e7-5bc0-934f-0bf01935e8df, identifier: XU55815
2026-03-27 10:39:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f446d91-50e7-5bc0-934f-0bf01935e8df with identifier: XU55815
2026-03-27 10:39:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f446d91-50e7-5bc0-934f-0bf01935e8df with identifier: XU55815
2026-03-27 10:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f446d91-50e7-5bc0-934f-0bf01935e8df with identifier: XU55815 to the API
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:24:52Z',
 'fuel_type': 'diesel',
 'id': '3f446d91-50e7-5bc0-934f-0bf01935e8df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU55815',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 198988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-27',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Lounge Sport & Style 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Lounge Sport & Style 4Motion BlueMotion',
 'year': 2015}
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU55815%27 HTTP/1.1" 200 None
2026-03-27 10:39:47 [auto1.de] INFO: Saving data for XU55815: {'auction_closing_time': 1774715092.0, 'created_time': 1773861341.399962, 'last_price_update_time': 1774607987.457635}
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU55815') HTTP/1.1" 204 0
2026-03-27 10:39:47 [auto1.de] INFO: Found listing with ID: HH61225
2026-03-27 10:39:47 [auto1.de] INFO: Found listing with ID: PB28144
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB28144%27 HTTP/1.1" 200 None
2026-03-27 10:39:47 [auto1.de] INFO: Scrape type for PB28144: 2
2026-03-27 10:39:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7628a106-4bdd-5030-a8f2-12f1a7c24f90 with identifier: PB28144
2026-03-27 10:39:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7628a106-4bdd-5030-a8f2-12f1a7c24f90 with scrape type 2
2026-03-27 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7628a106-4bdd-5030-a8f2-12f1a7c24f90 with scrape type 2
2026-03-27 10:39:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7628a106-4bdd-5030-a8f2-12f1a7c24f90, identifier: PB28144
2026-03-27 10:39:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7628a106-4bdd-5030-a8f2-12f1a7c24f90 with identifier: PB28144
2026-03-27 10:39:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7628a106-4bdd-5030-a8f2-12f1a7c24f90 with identifier: PB28144
2026-03-27 10:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7628a106-4bdd-5030-a8f2-12f1a7c24f90 with identifier: PB28144 to the API
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-28T16:01:25Z',
 'fuel_type': 'petrol',
 'id': '7628a106-4bdd-5030-a8f2-12f1a7c24f90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB28144',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 147726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-27',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 Edition 2WD',
 'transmission': 'manual',
 'trim': 'Edition 2WD',
 'year': 2014}
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB28144%27 HTTP/1.1" 200 None
2026-03-27 10:39:47 [auto1.de] INFO: Saving data for PB28144: {'auction_closing_time': 1774713685.0, 'created_time': 1773555375.668089, 'last_price_update_time': 1774607987.975552}
2026-03-27 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB28144') HTTP/1.1" 204 0
2026-03-27 10:39:48 [auto1.de] INFO: Found listing with ID: RJ10234
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ10234%27 HTTP/1.1" 200 None
2026-03-27 10:39:48 [auto1.de] INFO: Scrape type for RJ10234: 2
2026-03-27 10:39:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd2ed279-1c7c-5855-be48-0f7a527b1e0d with identifier: RJ10234
2026-03-27 10:39:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd2ed279-1c7c-5855-be48-0f7a527b1e0d with scrape type 2
2026-03-27 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd2ed279-1c7c-5855-be48-0f7a527b1e0d with scrape type 2
2026-03-27 10:39:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd2ed279-1c7c-5855-be48-0f7a527b1e0d, identifier: RJ10234
2026-03-27 10:39:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd2ed279-1c7c-5855-be48-0f7a527b1e0d with identifier: RJ10234
2026-03-27 10:39:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd2ed279-1c7c-5855-be48-0f7a527b1e0d with identifier: RJ10234
2026-03-27 10:39:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd2ed279-1c7c-5855-be48-0f7a527b1e0d with identifier: RJ10234 to the API
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:27:21Z',
 'fuel_type': 'petrol',
 'id': 'dd2ed279-1c7c-5855-be48-0f7a527b1e0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ10234',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 21540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-27',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TSI R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2024}
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ10234%27 HTTP/1.1" 200 None
2026-03-27 10:39:48 [auto1.de] INFO: Saving data for RJ10234: {'auction_closing_time': 1774715241.0, 'created_time': 1773304642.434631, 'last_price_update_time': 1774607988.463395}
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ10234') HTTP/1.1" 204 0
2026-03-27 10:39:48 [auto1.de] INFO: Found listing with ID: BJ03907
2026-03-27 10:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MA93398/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CH55650/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA40469/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE16553> (referer: https://www.auto1.com/v1/car-details-view/GE16553/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d with identifier: GE16553
2026-03-27 10:39:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d with scrape type 1
2026-03-27 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fbf%252Fafbf80b7fba179f77e1fc6909d1a3d16%252Fpa%252FGE16553_da232ff4ad4645628fe4b5e7867f5e73.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_da232ff4ad4645628fe4b5e7867f5e73.jpg not downloaded yet
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fbf%252Fafbf80b7fba179f77e1fc6909d1a3d16%252Fpa%252FGE16553_3b0f8e25e4e2620c2b4ed5e336bd3ee9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_3b0f8e25e4e2620c2b4ed5e336bd3ee9.jpg not downloaded yet
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fbf%252Fafbf80b7fba179f77e1fc6909d1a3d16%252Fpa%252FGE16553_e0a484705e74f9e58a9d90f37dd31024.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_e0a484705e74f9e58a9d90f37dd31024.jpg not downloaded yet
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fbf%252Fafbf80b7fba179f77e1fc6909d1a3d16%252Fpa%252FGE16553_0260bf8d0a70ba8045e14c614aa970f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_0260bf8d0a70ba8045e14c614aa970f5.jpg not downloaded yet
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fbf%252Fafbf80b7fba179f77e1fc6909d1a3d16%252Fpa%252FGE16553_5688b90178ec52794058be6060b74dae.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_5688b90178ec52794058be6060b74dae.jpg not downloaded yet
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fbf%252Fafbf80b7fba179f77e1fc6909d1a3d16%252Fpa%252FGE16553_ae9317aed01291ae3d29a8d05073aaa1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_ae9317aed01291ae3d29a8d05073aaa1.jpg not downloaded yet
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fbf%252Fafbf80b7fba179f77e1fc6909d1a3d16%252Fpa%252FGE16553_7f5e6327139594fb869c0467f4806d50.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_7f5e6327139594fb869c0467f4806d50.jpg not downloaded yet
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fbf%252Fafbf80b7fba179f77e1fc6909d1a3d16%252Fpa%252FGE16553_330e322c409236ae4ec0e7fa1eab68dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_330e322c409236ae4ec0e7fa1eab68dd.jpg not downloaded yet
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fbf%252Fafbf80b7fba179f77e1fc6909d1a3d16%252Fpa%252FGE16553_dd0da6970154a408f582d476bf22f563.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_dd0da6970154a408f582d476bf22f563.jpg not downloaded yet
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fbf%252Fafbf80b7fba179f77e1fc6909d1a3d16%252Fpa%252FGE16553_81023d0b02478b1e7dd390dc2f5d3940.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_81023d0b02478b1e7dd390dc2f5d3940.jpg not downloaded yet
2026-03-27 10:39:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-27 10:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BK65604> (referer: https://www.auto1.com/v1/car-details-view/BK65604/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb with identifier: BK65604
2026-03-27 10:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb with scrape type 1
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe7%252F98e7f5092ab07315b151b21153586926%252Fpa%252FBK65604_1b8f76e956e659dece52f965062ecadc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_1b8f76e956e659dece52f965062ecadc.jpg not downloaded yet
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe7%252F98e7f5092ab07315b151b21153586926%252Fpa%252FBK65604_c2750503c47c2a0934029e0a1d9cf043.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_c2750503c47c2a0934029e0a1d9cf043.jpg not downloaded yet
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe7%252F98e7f5092ab07315b151b21153586926%252Fpa%252FBK65604_a0a60c53e9a73882e381ce48c14fe740.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_a0a60c53e9a73882e381ce48c14fe740.jpg not downloaded yet
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe7%252F98e7f5092ab07315b151b21153586926%252Fpa%252FBK65604_6b683a3aaa73c1d458c00ac5cf553447.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_6b683a3aaa73c1d458c00ac5cf553447.jpg not downloaded yet
2026-03-27 10:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE85756> (referer: https://www.auto1.com/v1/car-details-view/CE85756/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_81023d0b02478b1e7dd390dc2f5d3940.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe7%252F98e7f5092ab07315b151b21153586926%252Fpa%252FBK65604_b3925d1703cbf1b2368820c8717bb9c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_b3925d1703cbf1b2368820c8717bb9c0.jpg not downloaded yet
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe7%252F98e7f5092ab07315b151b21153586926%252Fpa%252FBK65604_896a5f57db530554d266dca5cefc7a3d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_896a5f57db530554d266dca5cefc7a3d.jpg not downloaded yet
2026-03-27 10:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7a9fb5c-4305-5cbe-a28b-6748434ca9a0 with identifier: CE85756
2026-03-27 10:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7a9fb5c-4305-5cbe-a28b-6748434ca9a0 with scrape type 1
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7a9fb5c-4305-5cbe-a28b-6748434ca9a0
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5a%252F6d5a210df96e90a3f270e4a9e210c39a%252Fpa%252FCE85756_71d132064d5b1a2b26ff64561d94adce.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_71d132064d5b1a2b26ff64561d94adce.jpg not downloaded yet
2026-03-27 10:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_a0a60c53e9a73882e381ce48c14fe740.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_c2750503c47c2a0934029e0a1d9cf043.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5a%252F6d5a210df96e90a3f270e4a9e210c39a%252Fpa%252FCE85756_ad9f9f3a174746a5d419f83e39e521ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_ad9f9f3a174746a5d419f83e39e521ef.jpg not downloaded yet
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5a%252F6d5a210df96e90a3f270e4a9e210c39a%252Fpa%252FCE85756_f5f7fa13ca6e52bedd65628ad26f113a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_f5f7fa13ca6e52bedd65628ad26f113a.jpg not downloaded yet
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018969d0>
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d/dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fbf%252Fafbf80b7fba179f77e1fc6909d1a3d16%252Fpa%252FGE16553_81023d0b02478b1e7dd390dc2f5d3940.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_81023d0b02478b1e7dd390dc2f5d3940.jpg saved to cache
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5a%252F6d5a210df96e90a3f270e4a9e210c39a%252Fpa%252FCE85756_1548c025732c9413e0518cc584c2d302.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_1548c025732c9413e0518cc584c2d302.jpg not downloaded yet
2026-03-27 10:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_896a5f57db530554d266dca5cefc7a3d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5a%252F6d5a210df96e90a3f270e4a9e210c39a%252Fpa%252FCE85756_932a749f6672b40cd497f21461207f33.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_932a749f6672b40cd497f21461207f33.jpg not downloaded yet
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50059ca50>
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb/8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe7%252F98e7f5092ab07315b151b21153586926%252Fpa%252FBK65604_a0a60c53e9a73882e381ce48c14fe740.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_a0a60c53e9a73882e381ce48c14fe740.jpg saved to cache
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019426d0>
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb/8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe7%252F98e7f5092ab07315b151b21153586926%252Fpa%252FBK65604_c2750503c47c2a0934029e0a1d9cf043.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_c2750503c47c2a0934029e0a1d9cf043.jpg saved to cache
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5a%252F6d5a210df96e90a3f270e4a9e210c39a%252Fpa%252FCE85756_cedd157f9e7adf9b42dec4b516566fc3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_cedd157f9e7adf9b42dec4b516566fc3.jpg not downloaded yet
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5a%252F6d5a210df96e90a3f270e4a9e210c39a%252Fpa%252FCE85756_443684f43e276516f14bb098ed197f5c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_443684f43e276516f14bb098ed197f5c.jpg not downloaded yet
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5a%252F6d5a210df96e90a3f270e4a9e210c39a%252Fpa%252FCE85756_019e3ab3d1284f8ce729f714eec6f911.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_019e3ab3d1284f8ce729f714eec6f911.jpg not downloaded yet
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50033add0>
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb/8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe7%252F98e7f5092ab07315b151b21153586926%252Fpa%252FBK65604_896a5f57db530554d266dca5cefc7a3d.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_896a5f57db530554d266dca5cefc7a3d.jpg saved to cache
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5a%252F6d5a210df96e90a3f270e4a9e210c39a%252Fpa%252FCE85756_f2b417f7504c374fc4b31958bfa3376e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_f2b417f7504c374fc4b31958bfa3376e.jpg not downloaded yet
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5a%252F6d5a210df96e90a3f270e4a9e210c39a%252Fpa%252FCE85756_5b220f0949de54b9f517569eb3536edb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_5b220f0949de54b9f517569eb3536edb.jpg not downloaded yet
2026-03-27 10:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_1548c025732c9413e0518cc584c2d302.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50161e850>
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a9fb5c-4305-5cbe-a28b-6748434ca9a0/b7a9fb5c-4305-5cbe-a28b-6748434ca9a0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5a%252F6d5a210df96e90a3f270e4a9e210c39a%252Fpa%252FCE85756_1548c025732c9413e0518cc584c2d302.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_1548c025732c9413e0518cc584c2d302.jpg saved to cache
2026-03-27 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7a9fb5c-4305-5cbe-a28b-6748434ca9a0
2026-03-27 10:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_71d132064d5b1a2b26ff64561d94adce.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_5b220f0949de54b9f517569eb3536edb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZU18943> (referer: https://www.auto1.com/v1/car-details-view/ZU18943/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501732b90>
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a9fb5c-4305-5cbe-a28b-6748434ca9a0/b7a9fb5c-4305-5cbe-a28b-6748434ca9a0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5a%252F6d5a210df96e90a3f270e4a9e210c39a%252Fpa%252FCE85756_71d132064d5b1a2b26ff64561d94adce.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_71d132064d5b1a2b26ff64561d94adce.jpg saved to cache
2026-03-27 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7a9fb5c-4305-5cbe-a28b-6748434ca9a0
2026-03-27 10:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_019e3ab3d1284f8ce729f714eec6f911.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BD51611> (referer: https://www.auto1.com/v1/car-details-view/BD51611/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c58d0>
2026-03-27 10:39:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a9fb5c-4305-5cbe-a28b-6748434ca9a0/b7a9fb5c-4305-5cbe-a28b-6748434ca9a0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5a%252F6d5a210df96e90a3f270e4a9e210c39a%252Fpa%252FCE85756_5b220f0949de54b9f517569eb3536edb.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_5b220f0949de54b9f517569eb3536edb.jpg saved to cache
2026-03-27 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b7a9fb5c-4305-5cbe-a28b-6748434ca9a0
2026-03-27 10:39:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36bc4754-36b5-5669-815e-2f90396e29c3 with identifier: ZU18943
2026-03-27 10:39:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36bc4754-36b5-5669-815e-2f90396e29c3 with scrape type 1
2026-03-27 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 36bc4754-36b5-5669-815e-2f90396e29c3
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5c%252Fc45c6a7fcce165c780a5dd9b3b3470b7%252Fpa%252FZU18943_a2de6410e636da5e511a232a6f648750.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5c/c45c6a7fcce165c780a5dd9b3b3470b7/pa/ZU18943_a2de6410e636da5e511a232a6f648750.jpg already downloaded
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5c%252Fc45c6a7fcce165c780a5dd9b3b3470b7%252Fpa%252FZU18943_253cfe3b8faf3db8ff6edb2b72c6b812.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5c/c45c6a7fcce165c780a5dd9b3b3470b7/pa/ZU18943_253cfe3b8faf3db8ff6edb2b72c6b812.jpg already downloaded
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5c%252Fc45c6a7fcce165c780a5dd9b3b3470b7%252Fpa%252FZU18943_db0dff9289016327224fa197d3cb8f36.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5c/c45c6a7fcce165c780a5dd9b3b3470b7/pa/ZU18943_db0dff9289016327224fa197d3cb8f36.jpg already downloaded
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5c%252Fc45c6a7fcce165c780a5dd9b3b3470b7%252Fpa%252FZU18943_17eb1b40e0412f5ec856a5f785c9eaf2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5c/c45c6a7fcce165c780a5dd9b3b3470b7/pa/ZU18943_17eb1b40e0412f5ec856a5f785c9eaf2.jpg already downloaded
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5c%252Fc45c6a7fcce165c780a5dd9b3b3470b7%252Fpa%252FZU18943_04cab07f724d9901120226d7f0506fbd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5c/c45c6a7fcce165c780a5dd9b3b3470b7/pa/ZU18943_04cab07f724d9901120226d7f0506fbd.jpg already downloaded
2026-03-27 10:39:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36bc4754-36b5-5669-815e-2f90396e29c3, identifier: ZU18943
2026-03-27 10:39:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36bc4754-36b5-5669-815e-2f90396e29c3 with identifier: ZU18943
2026-03-27 10:39:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36bc4754-36b5-5669-815e-2f90396e29c3 with identifier: ZU18943
2026-03-27 10:39:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36bc4754-36b5-5669-815e-2f90396e29c3 with identifier: ZU18943 to the API
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZU18943>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:45:51Z',
 'fuel_type': 'petrol',
 'id': '36bc4754-36b5-5669-815e-2f90396e29c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU18943',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 28590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgc4/5c/c45c6a7fcce165c780a5dd9b3b3470b7/pa/ZU18943_a2de6410e636da5e511a232a6f648750.jpg',
                'https://img-pa.auto1.com/imgc4/5c/c45c6a7fcce165c780a5dd9b3b3470b7/pa/ZU18943_253cfe3b8faf3db8ff6edb2b72c6b812.jpg',
                'https://img-pa.auto1.com/imgc4/5c/c45c6a7fcce165c780a5dd9b3b3470b7/pa/ZU18943_db0dff9289016327224fa197d3cb8f36.jpg',
                'https://img-pa.auto1.com/imgc4/5c/c45c6a7fcce165c780a5dd9b3b3470b7/pa/ZU18943_17eb1b40e0412f5ec856a5f785c9eaf2.jpg',
                'https://img-pa.auto1.com/imgc4/5c/c45c6a7fcce165c780a5dd9b3b3470b7/pa/ZU18943_04cab07f724d9901120226d7f0506fbd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36bc4754-36b5-5669-815e-2f90396e29c3/36bc4754-36b5-5669-815e-2f90396e29c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/5c/c45c6a7fcce165c780a5dd9b3b3470b7/pa/ZU18943_a2de6410e636da5e511a232a6f648750.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36bc4754-36b5-5669-815e-2f90396e29c3/36bc4754-36b5-5669-815e-2f90396e29c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/5c/c45c6a7fcce165c780a5dd9b3b3470b7/pa/ZU18943_253cfe3b8faf3db8ff6edb2b72c6b812.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36bc4754-36b5-5669-815e-2f90396e29c3/36bc4754-36b5-5669-815e-2f90396e29c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/5c/c45c6a7fcce165c780a5dd9b3b3470b7/pa/ZU18943_db0dff9289016327224fa197d3cb8f36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36bc4754-36b5-5669-815e-2f90396e29c3/36bc4754-36b5-5669-815e-2f90396e29c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/5c/c45c6a7fcce165c780a5dd9b3b3470b7/pa/ZU18943_17eb1b40e0412f5ec856a5f785c9eaf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36bc4754-36b5-5669-815e-2f90396e29c3/36bc4754-36b5-5669-815e-2f90396e29c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/5c/c45c6a7fcce165c780a5dd9b3b3470b7/pa/ZU18943_04cab07f724d9901120226d7f0506fbd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU18943%27 HTTP/1.1" 200 None
2026-03-27 10:39:52 [auto1.de] INFO: Saving data for ZU18943: {'created_time': 1774607992.887277, 'last_price_update_time': 1774607992.887288, 'auction_closing_time': 1774716351.0}
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU18943') HTTP/1.1" 204 0
2026-03-27 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TT34897> (referer: https://www.auto1.com/v1/car-details-view/TT34897/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50183e850>
2026-03-27 10:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a9fb5c-4305-5cbe-a28b-6748434ca9a0/b7a9fb5c-4305-5cbe-a28b-6748434ca9a0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5a%252F6d5a210df96e90a3f270e4a9e210c39a%252Fpa%252FCE85756_019e3ab3d1284f8ce729f714eec6f911.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_019e3ab3d1284f8ce729f714eec6f911.jpg saved to cache
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b7a9fb5c-4305-5cbe-a28b-6748434ca9a0
2026-03-27 10:39:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6394e207-b268-51c9-b24f-7418e5b80f7c with identifier: BD51611
2026-03-27 10:39:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6394e207-b268-51c9-b24f-7418e5b80f7c with scrape type 1
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6394e207-b268-51c9-b24f-7418e5b80f7c
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F8e%252F9e8e8c4ea216decd0bcdd380b32fad5f%252Fpa%252FBD51611_195efd19fda0ff4eec00f16c1cadbcb0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/8e/9e8e8c4ea216decd0bcdd380b32fad5f/pa/BD51611_195efd19fda0ff4eec00f16c1cadbcb0.jpg not downloaded yet
2026-03-27 10:39:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F8e%252F9e8e8c4ea216decd0bcdd380b32fad5f%252Fpa%252FBD51611_4eef76142d72f57679cd083208a68d4e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/8e/9e8e8c4ea216decd0bcdd380b32fad5f/pa/BD51611_4eef76142d72f57679cd083208a68d4e.jpg not downloaded yet
2026-03-27 10:39:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f983f4c-065d-5952-8729-e67adaf03168 with identifier: TT34897
2026-03-27 10:39:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f983f4c-065d-5952-8729-e67adaf03168 with scrape type 1
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f983f4c-065d-5952-8729-e67adaf03168
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb046424e75210961891109ff28a927%252Fpa%252FTT34897_cca1d44570218ac703bfed9bccdb03eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_cca1d44570218ac703bfed9bccdb03eb.jpg not downloaded yet
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F8e%252F9e8e8c4ea216decd0bcdd380b32fad5f%252Fpa%252FBD51611_2b05c555c0b985fdf7160e9befee0c60.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/8e/9e8e8c4ea216decd0bcdd380b32fad5f/pa/BD51611_2b05c555c0b985fdf7160e9befee0c60.jpg not downloaded yet
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb046424e75210961891109ff28a927%252Fpa%252FTT34897_6658e7724dd5d5b317e9e84c98402e24.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_6658e7724dd5d5b317e9e84c98402e24.jpg not downloaded yet
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F8e%252F9e8e8c4ea216decd0bcdd380b32fad5f%252Fpa%252FBD51611_30f944500381ece0a867b899c18ab180.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/8e/9e8e8c4ea216decd0bcdd380b32fad5f/pa/BD51611_30f944500381ece0a867b899c18ab180.jpg not downloaded yet
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb046424e75210961891109ff28a927%252Fpa%252FTT34897_6aa64bbba3af5e10e1874959f32f0b9d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_6aa64bbba3af5e10e1874959f32f0b9d.jpg not downloaded yet
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F8e%252F9e8e8c4ea216decd0bcdd380b32fad5f%252Fpa%252FBD51611_b8bb867ae9a80504489c31e4f2a9577c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/8e/9e8e8c4ea216decd0bcdd380b32fad5f/pa/BD51611_b8bb867ae9a80504489c31e4f2a9577c.jpg not downloaded yet
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb046424e75210961891109ff28a927%252Fpa%252FTT34897_2c519e0c237452b96277ad088cf9c191.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_2c519e0c237452b96277ad088cf9c191.jpg not downloaded yet
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb046424e75210961891109ff28a927%252Fpa%252FTT34897_bf6b6e1db813ef94093f5f3772fa114e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_bf6b6e1db813ef94093f5f3772fa114e.jpg not downloaded yet
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb046424e75210961891109ff28a927%252Fpa%252FTT34897_beee140679e287222b3ce4c203ded3f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_beee140679e287222b3ce4c203ded3f8.jpg not downloaded yet
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb046424e75210961891109ff28a927%252Fpa%252FTT34897_bf580ffae331c583b7f46e42d043c7b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_bf580ffae331c583b7f46e42d043c7b4.jpg not downloaded yet
2026-03-27 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_f5f7fa13ca6e52bedd65628ad26f113a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb046424e75210961891109ff28a927%252Fpa%252FTT34897_87ed860da320fb81d74bd26aa05720a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_87ed860da320fb81d74bd26aa05720a2.jpg not downloaded yet
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb046424e75210961891109ff28a927%252Fpa%252FTT34897_e63a531cfdf6d46dfa64ba12ac52f1fd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_e63a531cfdf6d46dfa64ba12ac52f1fd.jpg not downloaded yet
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb046424e75210961891109ff28a927%252Fpa%252FTT34897_757468e3bf97b58974b24554394173c7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_757468e3bf97b58974b24554394173c7.jpg not downloaded yet
2026-03-27 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_f2b417f7504c374fc4b31958bfa3376e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_443684f43e276516f14bb098ed197f5c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_932a749f6672b40cd497f21461207f33.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_cedd157f9e7adf9b42dec4b516566fc3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016201d0>
2026-03-27 10:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a9fb5c-4305-5cbe-a28b-6748434ca9a0/b7a9fb5c-4305-5cbe-a28b-6748434ca9a0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5a%252F6d5a210df96e90a3f270e4a9e210c39a%252Fpa%252FCE85756_f5f7fa13ca6e52bedd65628ad26f113a.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_f5f7fa13ca6e52bedd65628ad26f113a.jpg saved to cache
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7a9fb5c-4305-5cbe-a28b-6748434ca9a0
2026-03-27 10:39:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016cb810>
2026-03-27 10:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a9fb5c-4305-5cbe-a28b-6748434ca9a0/b7a9fb5c-4305-5cbe-a28b-6748434ca9a0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5a%252F6d5a210df96e90a3f270e4a9e210c39a%252Fpa%252FCE85756_f2b417f7504c374fc4b31958bfa3376e.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_f2b417f7504c374fc4b31958bfa3376e.jpg saved to cache
2026-03-27 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b7a9fb5c-4305-5cbe-a28b-6748434ca9a0
2026-03-27 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_757468e3bf97b58974b24554394173c7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NW54336/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015cd250>
2026-03-27 10:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a9fb5c-4305-5cbe-a28b-6748434ca9a0/b7a9fb5c-4305-5cbe-a28b-6748434ca9a0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5a%252F6d5a210df96e90a3f270e4a9e210c39a%252Fpa%252FCE85756_443684f43e276516f14bb098ed197f5c.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_443684f43e276516f14bb098ed197f5c.jpg saved to cache
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b7a9fb5c-4305-5cbe-a28b-6748434ca9a0
2026-03-27 10:39:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50170c510>
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a9fb5c-4305-5cbe-a28b-6748434ca9a0/b7a9fb5c-4305-5cbe-a28b-6748434ca9a0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5a%252F6d5a210df96e90a3f270e4a9e210c39a%252Fpa%252FCE85756_932a749f6672b40cd497f21461207f33.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_932a749f6672b40cd497f21461207f33.jpg saved to cache
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7a9fb5c-4305-5cbe-a28b-6748434ca9a0
2026-03-27 10:39:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50034afd0>
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a9fb5c-4305-5cbe-a28b-6748434ca9a0/b7a9fb5c-4305-5cbe-a28b-6748434ca9a0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5a%252F6d5a210df96e90a3f270e4a9e210c39a%252Fpa%252FCE85756_cedd157f9e7adf9b42dec4b516566fc3.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_cedd157f9e7adf9b42dec4b516566fc3.jpg saved to cache
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7a9fb5c-4305-5cbe-a28b-6748434ca9a0
2026-03-27 10:39:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XH92207> (referer: https://www.auto1.com/v1/car-details-view/XH92207/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501654610>
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f983f4c-065d-5952-8729-e67adaf03168/2f983f4c-065d-5952-8729-e67adaf03168_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb046424e75210961891109ff28a927%252Fpa%252FTT34897_757468e3bf97b58974b24554394173c7.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_757468e3bf97b58974b24554394173c7.jpg saved to cache
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2f983f4c-065d-5952-8729-e67adaf03168
2026-03-27 10:39:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_bf580ffae331c583b7f46e42d043c7b4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TX89120> (referer: https://www.auto1.com/v1/car-details-view/TX89120/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e46331e9-982e-5737-98ed-b7250cfd202d with identifier: XH92207
2026-03-27 10:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e46331e9-982e-5737-98ed-b7250cfd202d with scrape type 1
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e46331e9-982e-5737-98ed-b7250cfd202d
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F8e%252Ff08e47f50490b2754bee2267c9efd649%252Fpa%252FXH92207_88776d8fc94f6198d43f36f83a84b070.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_88776d8fc94f6198d43f36f83a84b070.jpg not downloaded yet
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F8e%252Ff08e47f50490b2754bee2267c9efd649%252Fpa%252FXH92207_303285cb11d8116a5e13265befe74b7e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_303285cb11d8116a5e13265befe74b7e.jpg not downloaded yet
2026-03-27 10:39:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/8e/9e8e8c4ea216decd0bcdd380b32fad5f/pa/BD51611_b8bb867ae9a80504489c31e4f2a9577c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_e63a531cfdf6d46dfa64ba12ac52f1fd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F8e%252Ff08e47f50490b2754bee2267c9efd649%252Fpa%252FXH92207_292016ca83ed6abbb44f96bb20fae6da.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_292016ca83ed6abbb44f96bb20fae6da.jpg not downloaded yet
2026-03-27 10:39:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_87ed860da320fb81d74bd26aa05720a2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_6aa64bbba3af5e10e1874959f32f0b9d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50035fd90>
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f983f4c-065d-5952-8729-e67adaf03168/2f983f4c-065d-5952-8729-e67adaf03168_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb046424e75210961891109ff28a927%252Fpa%252FTT34897_bf580ffae331c583b7f46e42d043c7b4.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_bf580ffae331c583b7f46e42d043c7b4.jpg saved to cache
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2f983f4c-065d-5952-8729-e67adaf03168
2026-03-27 10:39:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23414e8d-2f88-5a50-a9a3-5035574efa54 with identifier: TX89120
2026-03-27 10:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23414e8d-2f88-5a50-a9a3-5035574efa54 with scrape type 1
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 23414e8d-2f88-5a50-a9a3-5035574efa54
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F07%252Fdd070b339d92748978ef277faf400bd3%252Fpa%252FTX89120_705ab594e802014eba1ffccf2d821bc1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_705ab594e802014eba1ffccf2d821bc1.jpg not downloaded yet
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F8e%252Ff08e47f50490b2754bee2267c9efd649%252Fpa%252FXH92207_2728a41b202affbdaa56ea0bde54c2b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_2728a41b202affbdaa56ea0bde54c2b5.jpg not downloaded yet
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F07%252Fdd070b339d92748978ef277faf400bd3%252Fpa%252FTX89120_257da2f5fe925ac617c5ec3f6a62201f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_257da2f5fe925ac617c5ec3f6a62201f.jpg not downloaded yet
2026-03-27 10:39:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_88776d8fc94f6198d43f36f83a84b070.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F8e%252Ff08e47f50490b2754bee2267c9efd649%252Fpa%252FXH92207_97a001c1826c6cdbbebbf5cb59cd0445.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_97a001c1826c6cdbbebbf5cb59cd0445.jpg not downloaded yet
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f9a50>
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6394e207-b268-51c9-b24f-7418e5b80f7c/6394e207-b268-51c9-b24f-7418e5b80f7c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F8e%252F9e8e8c4ea216decd0bcdd380b32fad5f%252Fpa%252FBD51611_b8bb867ae9a80504489c31e4f2a9577c.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/8e/9e8e8c4ea216decd0bcdd380b32fad5f/pa/BD51611_b8bb867ae9a80504489c31e4f2a9577c.jpg saved to cache
2026-03-27 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6394e207-b268-51c9-b24f-7418e5b80f7c
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018aa1d0>
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f983f4c-065d-5952-8729-e67adaf03168/2f983f4c-065d-5952-8729-e67adaf03168_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb046424e75210961891109ff28a927%252Fpa%252FTT34897_e63a531cfdf6d46dfa64ba12ac52f1fd.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_e63a531cfdf6d46dfa64ba12ac52f1fd.jpg saved to cache
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2f983f4c-065d-5952-8729-e67adaf03168
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015c62d0>
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f983f4c-065d-5952-8729-e67adaf03168/2f983f4c-065d-5952-8729-e67adaf03168_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb046424e75210961891109ff28a927%252Fpa%252FTT34897_87ed860da320fb81d74bd26aa05720a2.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_87ed860da320fb81d74bd26aa05720a2.jpg saved to cache
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2f983f4c-065d-5952-8729-e67adaf03168
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016aaf50>
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f983f4c-065d-5952-8729-e67adaf03168/2f983f4c-065d-5952-8729-e67adaf03168_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb046424e75210961891109ff28a927%252Fpa%252FTT34897_6aa64bbba3af5e10e1874959f32f0b9d.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_6aa64bbba3af5e10e1874959f32f0b9d.jpg saved to cache
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2f983f4c-065d-5952-8729-e67adaf03168
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F07%252Fdd070b339d92748978ef277faf400bd3%252Fpa%252FTX89120_fde1399a22586d6ebbf3eb733bf452b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_fde1399a22586d6ebbf3eb733bf452b1.jpg not downloaded yet
2026-03-27 10:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_303285cb11d8116a5e13265befe74b7e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F8e%252Ff08e47f50490b2754bee2267c9efd649%252Fpa%252FXH92207_1f03a5e1dfb21980a5fe69905aac4b4b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_1f03a5e1dfb21980a5fe69905aac4b4b.jpg not downloaded yet
2026-03-27 10:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/8e/9e8e8c4ea216decd0bcdd380b32fad5f/pa/BD51611_30f944500381ece0a867b899c18ab180.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_6658e7724dd5d5b317e9e84c98402e24.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F07%252Fdd070b339d92748978ef277faf400bd3%252Fpa%252FTX89120_4e62c2df98b3b16fc8e76d9518d0d75a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_4e62c2df98b3b16fc8e76d9518d0d75a.jpg not downloaded yet
2026-03-27 10:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EX22671> (referer: https://www.auto1.com/v1/car-details-view/EX22671/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015d2d50>
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e46331e9-982e-5737-98ed-b7250cfd202d/e46331e9-982e-5737-98ed-b7250cfd202d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F8e%252Ff08e47f50490b2754bee2267c9efd649%252Fpa%252FXH92207_88776d8fc94f6198d43f36f83a84b070.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_88776d8fc94f6198d43f36f83a84b070.jpg saved to cache
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e46331e9-982e-5737-98ed-b7250cfd202d
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F8e%252Ff08e47f50490b2754bee2267c9efd649%252Fpa%252FXH92207_3046abb8815524d8091c858215d91f94.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_3046abb8815524d8091c858215d91f94.jpg not downloaded yet
2026-03-27 10:39:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F07%252Fdd070b339d92748978ef277faf400bd3%252Fpa%252FTX89120_fce1f973b5e77157acc419d8876dbab9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_fce1f973b5e77157acc419d8876dbab9.jpg not downloaded yet
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F8e%252Ff08e47f50490b2754bee2267c9efd649%252Fpa%252FXH92207_dde36f4c9d468dc537e8482d6e90e832.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_dde36f4c9d468dc537e8482d6e90e832.jpg not downloaded yet
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F07%252Fdd070b339d92748978ef277faf400bd3%252Fpa%252FTX89120_93515e325d19d39a371023bf8213293a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_93515e325d19d39a371023bf8213293a.jpg not downloaded yet
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F8e%252Ff08e47f50490b2754bee2267c9efd649%252Fpa%252FXH92207_706bce3c03fe5122ac7ff4d57c638a00.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_706bce3c03fe5122ac7ff4d57c638a00.jpg not downloaded yet
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017fcf90>
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e46331e9-982e-5737-98ed-b7250cfd202d/e46331e9-982e-5737-98ed-b7250cfd202d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F8e%252Ff08e47f50490b2754bee2267c9efd649%252Fpa%252FXH92207_303285cb11d8116a5e13265befe74b7e.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_303285cb11d8116a5e13265befe74b7e.jpg saved to cache
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e46331e9-982e-5737-98ed-b7250cfd202d
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50037f150>
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6394e207-b268-51c9-b24f-7418e5b80f7c/6394e207-b268-51c9-b24f-7418e5b80f7c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F8e%252F9e8e8c4ea216decd0bcdd380b32fad5f%252Fpa%252FBD51611_30f944500381ece0a867b899c18ab180.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/8e/9e8e8c4ea216decd0bcdd380b32fad5f/pa/BD51611_30f944500381ece0a867b899c18ab180.jpg saved to cache
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6394e207-b268-51c9-b24f-7418e5b80f7c
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50171dcd0>
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f983f4c-065d-5952-8729-e67adaf03168/2f983f4c-065d-5952-8729-e67adaf03168_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb046424e75210961891109ff28a927%252Fpa%252FTT34897_6658e7724dd5d5b317e9e84c98402e24.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_6658e7724dd5d5b317e9e84c98402e24.jpg saved to cache
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2f983f4c-065d-5952-8729-e67adaf03168
2026-03-27 10:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_fde1399a22586d6ebbf3eb733bf452b1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F07%252Fdd070b339d92748978ef277faf400bd3%252Fpa%252FTX89120_a63163dbaffbcfdddf7d6b6a4f06ad0e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_a63163dbaffbcfdddf7d6b6a4f06ad0e.jpg not downloaded yet
2026-03-27 10:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_2728a41b202affbdaa56ea0bde54c2b5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_257da2f5fe925ac617c5ec3f6a62201f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_97a001c1826c6cdbbebbf5cb59cd0445.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F8e%252Ff08e47f50490b2754bee2267c9efd649%252Fpa%252FXH92207_467a4b932f0a731dcc6e03b10913bc5e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_467a4b932f0a731dcc6e03b10913bc5e.jpg not downloaded yet
2026-03-27 10:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b4cdf85-78e5-5e8b-acc4-acb367780537 with identifier: EX22671
2026-03-27 10:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b4cdf85-78e5-5e8b-acc4-acb367780537 with scrape type 1
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b4cdf85-78e5-5e8b-acc4-acb367780537
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F43%252F7e438750c458b90e705d99a15cd38473%252Fpa%252FEX22671_8d8f7666df462195774a370437f748da.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_8d8f7666df462195774a370437f748da.jpg not downloaded yet
2026-03-27 10:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_1f03a5e1dfb21980a5fe69905aac4b4b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F07%252Fdd070b339d92748978ef277faf400bd3%252Fpa%252FTX89120_2f00df08274241a5f4b52ed8c71b8043.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_2f00df08274241a5f4b52ed8c71b8043.jpg not downloaded yet
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F43%252F7e438750c458b90e705d99a15cd38473%252Fpa%252FEX22671_bdef0a2f52cccef7d87585e1adb983be.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_bdef0a2f52cccef7d87585e1adb983be.jpg not downloaded yet
2026-03-27 10:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MA93398> (referer: https://www.auto1.com/v1/car-details-view/MA93398/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F07%252Fdd070b339d92748978ef277faf400bd3%252Fpa%252FTX89120_9b6a27db543a6d63c8659ecee41b24eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_9b6a27db543a6d63c8659ecee41b24eb.jpg not downloaded yet
2026-03-27 10:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CH55650> (referer: https://www.auto1.com/v1/car-details-view/CH55650/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F43%252F7e438750c458b90e705d99a15cd38473%252Fpa%252FEX22671_a6b98651ca3886ad9782dbadf1920954.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_a6b98651ca3886ad9782dbadf1920954.jpg not downloaded yet
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F07%252Fdd070b339d92748978ef277faf400bd3%252Fpa%252FTX89120_9bb316483b195268d569a872c58943f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_9bb316483b195268d569a872c58943f6.jpg not downloaded yet
2026-03-27 10:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_706bce3c03fe5122ac7ff4d57c638a00.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F43%252F7e438750c458b90e705d99a15cd38473%252Fpa%252FEX22671_b6aa1c16b8cf7020551ea24f31776c5a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_b6aa1c16b8cf7020551ea24f31776c5a.jpg not downloaded yet
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018679d0>
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23414e8d-2f88-5a50-a9a3-5035574efa54/23414e8d-2f88-5a50-a9a3-5035574efa54_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F07%252Fdd070b339d92748978ef277faf400bd3%252Fpa%252FTX89120_fde1399a22586d6ebbf3eb733bf452b1.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_fde1399a22586d6ebbf3eb733bf452b1.jpg saved to cache
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 23414e8d-2f88-5a50-a9a3-5035574efa54
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501768810>
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e46331e9-982e-5737-98ed-b7250cfd202d/e46331e9-982e-5737-98ed-b7250cfd202d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F8e%252Ff08e47f50490b2754bee2267c9efd649%252Fpa%252FXH92207_2728a41b202affbdaa56ea0bde54c2b5.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_2728a41b202affbdaa56ea0bde54c2b5.jpg saved to cache
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e46331e9-982e-5737-98ed-b7250cfd202d
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500352090>
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23414e8d-2f88-5a50-a9a3-5035574efa54/23414e8d-2f88-5a50-a9a3-5035574efa54_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F07%252Fdd070b339d92748978ef277faf400bd3%252Fpa%252FTX89120_257da2f5fe925ac617c5ec3f6a62201f.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_257da2f5fe925ac617c5ec3f6a62201f.jpg saved to cache
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 23414e8d-2f88-5a50-a9a3-5035574efa54
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016abf90>
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e46331e9-982e-5737-98ed-b7250cfd202d/e46331e9-982e-5737-98ed-b7250cfd202d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F8e%252Ff08e47f50490b2754bee2267c9efd649%252Fpa%252FXH92207_97a001c1826c6cdbbebbf5cb59cd0445.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_97a001c1826c6cdbbebbf5cb59cd0445.jpg saved to cache
2026-03-27 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e46331e9-982e-5737-98ed-b7250cfd202d
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F43%252F7e438750c458b90e705d99a15cd38473%252Fpa%252FEX22671_6f1680c284449d81af85d37b86aa7296.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_6f1680c284449d81af85d37b86aa7296.jpg not downloaded yet
2026-03-27 10:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_93515e325d19d39a371023bf8213293a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_a63163dbaffbcfdddf7d6b6a4f06ad0e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500350fd0>
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e46331e9-982e-5737-98ed-b7250cfd202d/e46331e9-982e-5737-98ed-b7250cfd202d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F8e%252Ff08e47f50490b2754bee2267c9efd649%252Fpa%252FXH92207_1f03a5e1dfb21980a5fe69905aac4b4b.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_1f03a5e1dfb21980a5fe69905aac4b4b.jpg saved to cache
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e46331e9-982e-5737-98ed-b7250cfd202d
2026-03-27 10:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_dde36f4c9d468dc537e8482d6e90e832.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F43%252F7e438750c458b90e705d99a15cd38473%252Fpa%252FEX22671_d82dd615ae8a65838730a67a55cdaa59.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_d82dd615ae8a65838730a67a55cdaa59.jpg not downloaded yet
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F43%252F7e438750c458b90e705d99a15cd38473%252Fpa%252FEX22671_5f73c8dcbc1fa14adcbad5ae31bb050b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_5f73c8dcbc1fa14adcbad5ae31bb050b.jpg not downloaded yet
2026-03-27 10:39:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80b3e699-b153-5c86-9d0f-190ccd31e032 with identifier: MA93398
2026-03-27 10:39:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80b3e699-b153-5c86-9d0f-190ccd31e032 with scrape type 1
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80b3e699-b153-5c86-9d0f-190ccd31e032
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F78%252F3378f68cbbfd920130d4c3dec31b147c%252Fpa%252FMA93398_e4256f60ee00cec405af8314943f4285.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_e4256f60ee00cec405af8314943f4285.jpg not downloaded yet
2026-03-27 10:39:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43149b24-5c84-5b00-830f-49bd6b2c7f0d with identifier: CH55650
2026-03-27 10:39:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43149b24-5c84-5b00-830f-49bd6b2c7f0d with scrape type 1
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43149b24-5c84-5b00-830f-49bd6b2c7f0d
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbe%252F68be70296381a043efabdc0e0b0c4024%252Fpa%252FCH55650_d3adfc086863a2838d56b835e229c162.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_d3adfc086863a2838d56b835e229c162.jpg not downloaded yet
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501944850>
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e46331e9-982e-5737-98ed-b7250cfd202d/e46331e9-982e-5737-98ed-b7250cfd202d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F8e%252Ff08e47f50490b2754bee2267c9efd649%252Fpa%252FXH92207_706bce3c03fe5122ac7ff4d57c638a00.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_706bce3c03fe5122ac7ff4d57c638a00.jpg saved to cache
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e46331e9-982e-5737-98ed-b7250cfd202d
2026-03-27 10:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_9bb316483b195268d569a872c58943f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_2f00df08274241a5f4b52ed8c71b8043.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F43%252F7e438750c458b90e705d99a15cd38473%252Fpa%252FEX22671_a9151c8a8ff23d5129f47d217275ac10.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_a9151c8a8ff23d5129f47d217275ac10.jpg not downloaded yet
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F78%252F3378f68cbbfd920130d4c3dec31b147c%252Fpa%252FMA93398_68b62b8c697f314251bb9434cd19069e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_68b62b8c697f314251bb9434cd19069e.jpg not downloaded yet
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbe%252F68be70296381a043efabdc0e0b0c4024%252Fpa%252FCH55650_818a21d6365624be87c6ffc76526f2ff.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_818a21d6365624be87c6ffc76526f2ff.jpg not downloaded yet
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50039a4d0>
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23414e8d-2f88-5a50-a9a3-5035574efa54/23414e8d-2f88-5a50-a9a3-5035574efa54_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F07%252Fdd070b339d92748978ef277faf400bd3%252Fpa%252FTX89120_93515e325d19d39a371023bf8213293a.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_93515e325d19d39a371023bf8213293a.jpg saved to cache
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 23414e8d-2f88-5a50-a9a3-5035574efa54
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501959390>
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23414e8d-2f88-5a50-a9a3-5035574efa54/23414e8d-2f88-5a50-a9a3-5035574efa54_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F07%252Fdd070b339d92748978ef277faf400bd3%252Fpa%252FTX89120_a63163dbaffbcfdddf7d6b6a4f06ad0e.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_a63163dbaffbcfdddf7d6b6a4f06ad0e.jpg saved to cache
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 23414e8d-2f88-5a50-a9a3-5035574efa54
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F43%252F7e438750c458b90e705d99a15cd38473%252Fpa%252FEX22671_5a15ad5756fd39ef2a6d2ba9a205de44.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_5a15ad5756fd39ef2a6d2ba9a205de44.jpg not downloaded yet
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F78%252F3378f68cbbfd920130d4c3dec31b147c%252Fpa%252FMA93398_f65d4d9c9baf79e21e6cbdef61572676.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_f65d4d9c9baf79e21e6cbdef61572676.jpg not downloaded yet
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbe%252F68be70296381a043efabdc0e0b0c4024%252Fpa%252FCH55650_395898acaba60e7fa75783bd496f92be.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_395898acaba60e7fa75783bd496f92be.jpg not downloaded yet
2026-03-27 10:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_b6aa1c16b8cf7020551ea24f31776c5a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50160e190>
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e46331e9-982e-5737-98ed-b7250cfd202d/e46331e9-982e-5737-98ed-b7250cfd202d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F8e%252Ff08e47f50490b2754bee2267c9efd649%252Fpa%252FXH92207_dde36f4c9d468dc537e8482d6e90e832.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_dde36f4c9d468dc537e8482d6e90e832.jpg saved to cache
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e46331e9-982e-5737-98ed-b7250cfd202d
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50183dfd0>
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23414e8d-2f88-5a50-a9a3-5035574efa54/23414e8d-2f88-5a50-a9a3-5035574efa54_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F07%252Fdd070b339d92748978ef277faf400bd3%252Fpa%252FTX89120_9bb316483b195268d569a872c58943f6.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_9bb316483b195268d569a872c58943f6.jpg saved to cache
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 23414e8d-2f88-5a50-a9a3-5035574efa54
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50161c090>
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23414e8d-2f88-5a50-a9a3-5035574efa54/23414e8d-2f88-5a50-a9a3-5035574efa54_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F07%252Fdd070b339d92748978ef277faf400bd3%252Fpa%252FTX89120_2f00df08274241a5f4b52ed8c71b8043.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_2f00df08274241a5f4b52ed8c71b8043.jpg saved to cache
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 23414e8d-2f88-5a50-a9a3-5035574efa54
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F43%252F7e438750c458b90e705d99a15cd38473%252Fpa%252FEX22671_e2c4a0bc900b043a1a93bf30d9c33c3c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_e2c4a0bc900b043a1a93bf30d9c33c3c.jpg not downloaded yet
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F78%252F3378f68cbbfd920130d4c3dec31b147c%252Fpa%252FMA93398_742e1febd4e6251970891c41386c0021.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_742e1febd4e6251970891c41386c0021.jpg not downloaded yet
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbe%252F68be70296381a043efabdc0e0b0c4024%252Fpa%252FCH55650_d7585da52a61f88b494e867b2133f9be.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_d7585da52a61f88b494e867b2133f9be.jpg not downloaded yet
2026-03-27 10:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_a6b98651ca3886ad9782dbadf1920954.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_6f1680c284449d81af85d37b86aa7296.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F78%252F3378f68cbbfd920130d4c3dec31b147c%252Fpa%252FMA93398_7b175cfb045000ab979aa4de127ed5c9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_7b175cfb045000ab979aa4de127ed5c9.jpg not downloaded yet
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbe%252F68be70296381a043efabdc0e0b0c4024%252Fpa%252FCH55650_f71ddeddc458797496a0a2f9b9f75704.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_f71ddeddc458797496a0a2f9b9f75704.jpg not downloaded yet
2026-03-27 10:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NW54336> (referer: https://www.auto1.com/v1/car-details-view/NW54336/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50172a010>
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4cdf85-78e5-5e8b-acc4-acb367780537/3b4cdf85-78e5-5e8b-acc4-acb367780537_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F43%252F7e438750c458b90e705d99a15cd38473%252Fpa%252FEX22671_b6aa1c16b8cf7020551ea24f31776c5a.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_b6aa1c16b8cf7020551ea24f31776c5a.jpg saved to cache
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b4cdf85-78e5-5e8b-acc4-acb367780537
2026-03-27 10:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_d3adfc086863a2838d56b835e229c162.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F78%252F3378f68cbbfd920130d4c3dec31b147c%252Fpa%252FMA93398_cda442b2ad412595f7efc910360b8dd3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_cda442b2ad412595f7efc910360b8dd3.jpg not downloaded yet
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbe%252F68be70296381a043efabdc0e0b0c4024%252Fpa%252FCH55650_f43d2f31255c8a27248e73b86105f113.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_f43d2f31255c8a27248e73b86105f113.jpg not downloaded yet
2026-03-27 10:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F78%252F3378f68cbbfd920130d4c3dec31b147c%252Fpa%252FMA93398_b8a96fe56feeebfdc4e88147ce0797b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_b8a96fe56feeebfdc4e88147ce0797b2.jpg not downloaded yet
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbe%252F68be70296381a043efabdc0e0b0c4024%252Fpa%252FCH55650_2a18f09611c10ea46594b914f7ad95cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_2a18f09611c10ea46594b914f7ad95cc.jpg not downloaded yet
2026-03-27 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_e4256f60ee00cec405af8314943f4285.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004ee390>
2026-03-27 10:39:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4cdf85-78e5-5e8b-acc4-acb367780537/3b4cdf85-78e5-5e8b-acc4-acb367780537_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F43%252F7e438750c458b90e705d99a15cd38473%252Fpa%252FEX22671_a6b98651ca3886ad9782dbadf1920954.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_a6b98651ca3886ad9782dbadf1920954.jpg saved to cache
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b4cdf85-78e5-5e8b-acc4-acb367780537
2026-03-27 10:39:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f9c90>
2026-03-27 10:39:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4cdf85-78e5-5e8b-acc4-acb367780537/3b4cdf85-78e5-5e8b-acc4-acb367780537_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F43%252F7e438750c458b90e705d99a15cd38473%252Fpa%252FEX22671_6f1680c284449d81af85d37b86aa7296.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_6f1680c284449d81af85d37b86aa7296.jpg saved to cache
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b4cdf85-78e5-5e8b-acc4-acb367780537
2026-03-27 10:39:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51273f1e-8e51-5a24-afab-3768a127c295 with identifier: NW54336
2026-03-27 10:39:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51273f1e-8e51-5a24-afab-3768a127c295 with scrape type 1
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F16%252F79160da376da89f55e2bc775229df4a4%252Fpa%252FNW54336_ace1e26355a8c90f871e5f47b776d908.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_ace1e26355a8c90f871e5f47b776d908.jpg not downloaded yet
2026-03-27 10:39:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50035f5d0>
2026-03-27 10:39:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43149b24-5c84-5b00-830f-49bd6b2c7f0d/43149b24-5c84-5b00-830f-49bd6b2c7f0d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbe%252F68be70296381a043efabdc0e0b0c4024%252Fpa%252FCH55650_d3adfc086863a2838d56b835e229c162.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_d3adfc086863a2838d56b835e229c162.jpg saved to cache
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43149b24-5c84-5b00-830f-49bd6b2c7f0d
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F78%252F3378f68cbbfd920130d4c3dec31b147c%252Fpa%252FMA93398_72fd1df7b1dad3790a0d5721e6a3bd6b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_72fd1df7b1dad3790a0d5721e6a3bd6b.jpg not downloaded yet
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbe%252F68be70296381a043efabdc0e0b0c4024%252Fpa%252FCH55650_f92cb5ea05f2ca9646fc7a790b285499.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_f92cb5ea05f2ca9646fc7a790b285499.jpg not downloaded yet
2026-03-27 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_2c519e0c237452b96277ad088cf9c191.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F16%252F79160da376da89f55e2bc775229df4a4%252Fpa%252FNW54336_24e0f48a559ea3137f8705d272c3b581.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_24e0f48a559ea3137f8705d272c3b581.jpg not downloaded yet
2026-03-27 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_818a21d6365624be87c6ffc76526f2ff.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_d7585da52a61f88b494e867b2133f9be.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F78%252F3378f68cbbfd920130d4c3dec31b147c%252Fpa%252FMA93398_08d1fa7eaf2230903a4b50f212631028.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_08d1fa7eaf2230903a4b50f212631028.jpg not downloaded yet
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbe%252F68be70296381a043efabdc0e0b0c4024%252Fpa%252FCH55650_7df0eb41f299158cb604aac237f86ae1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_7df0eb41f299158cb604aac237f86ae1.jpg not downloaded yet
2026-03-27 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_beee140679e287222b3ce4c203ded3f8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F16%252F79160da376da89f55e2bc775229df4a4%252Fpa%252FNW54336_540a01f105da508ac626077596f64445.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_540a01f105da508ac626077596f64445.jpg not downloaded yet
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F78%252F3378f68cbbfd920130d4c3dec31b147c%252Fpa%252FMA93398_c16a343a8a6980f6d9f6e671fcd36cef.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_c16a343a8a6980f6d9f6e671fcd36cef.jpg not downloaded yet
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbe%252F68be70296381a043efabdc0e0b0c4024%252Fpa%252FCH55650_646877843af6e73f2ea93052b33614f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_646877843af6e73f2ea93052b33614f6.jpg not downloaded yet
2026-03-27 10:39:57 [auto1.de] INFO: Channel: 24h | Page: 13 | totalHits: 10512 | hits on page: 40
2026-03-27 10:39:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015d3490>
2026-03-27 10:39:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b3e699-b153-5c86-9d0f-190ccd31e032/80b3e699-b153-5c86-9d0f-190ccd31e032_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F78%252F3378f68cbbfd920130d4c3dec31b147c%252Fpa%252FMA93398_e4256f60ee00cec405af8314943f4285.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_e4256f60ee00cec405af8314943f4285.jpg saved to cache
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80b3e699-b153-5c86-9d0f-190ccd31e032
2026-03-27 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_bf6b6e1db813ef94093f5f3772fa114e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F16%252F79160da376da89f55e2bc775229df4a4%252Fpa%252FNW54336_e198637555db4306c16adbaa79e3bdf5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_e198637555db4306c16adbaa79e3bdf5.jpg not downloaded yet
2026-03-27 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_742e1febd4e6251970891c41386c0021.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:57 [auto1.de] INFO: Found listing with ID: CC89371
2026-03-27 10:39:57 [auto1.de] INFO: Found listing with ID: VG26326
2026-03-27 10:39:57 [auto1.de] INFO: Found listing with ID: LL88784
2026-03-27 10:39:57 [auto1.de] INFO: Found listing with ID: HW66490
2026-03-27 10:39:57 [auto1.de] INFO: Found listing with ID: UH98886
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH98886%27 HTTP/1.1" 200 None
2026-03-27 10:39:57 [auto1.de] INFO: Scrape type for UH98886: 1
2026-03-27 10:39:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50165ee50>
2026-03-27 10:39:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f983f4c-065d-5952-8729-e67adaf03168/2f983f4c-065d-5952-8729-e67adaf03168_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb046424e75210961891109ff28a927%252Fpa%252FTT34897_2c519e0c237452b96277ad088cf9c191.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_2c519e0c237452b96277ad088cf9c191.jpg saved to cache
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2f983f4c-065d-5952-8729-e67adaf03168
2026-03-27 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_f43d2f31255c8a27248e73b86105f113.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_7b175cfb045000ab979aa4de127ed5c9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F16%252F79160da376da89f55e2bc775229df4a4%252Fpa%252FNW54336_05d54b69421279c64b1c099c7e15e72a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_05d54b69421279c64b1c099c7e15e72a.jpg not downloaded yet
2026-03-27 10:39:57 [auto1.de] INFO: Found listing with ID: XC17243
2026-03-27 10:39:57 [auto1.de] INFO: Found listing with ID: PZ27483
2026-03-27 10:39:57 [auto1.de] INFO: Found listing with ID: NV75211
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV75211%27 HTTP/1.1" 200 None
2026-03-27 10:39:57 [auto1.de] INFO: Scrape type for NV75211: 2
2026-03-27 10:39:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ac15e28-8e54-5284-9efa-765b93e1ede7 with identifier: NV75211
2026-03-27 10:39:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ac15e28-8e54-5284-9efa-765b93e1ede7 with scrape type 2
2026-03-27 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ac15e28-8e54-5284-9efa-765b93e1ede7 with scrape type 2
2026-03-27 10:39:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ac15e28-8e54-5284-9efa-765b93e1ede7, identifier: NV75211
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F16%252F79160da376da89f55e2bc775229df4a4%252Fpa%252FNW54336_47030efc79dce9954087c96da1ec311a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_47030efc79dce9954087c96da1ec311a.jpg not downloaded yet
2026-03-27 10:39:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ac15e28-8e54-5284-9efa-765b93e1ede7 with identifier: NV75211
2026-03-27 10:39:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ac15e28-8e54-5284-9efa-765b93e1ede7 with identifier: NV75211
2026-03-27 10:39:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ac15e28-8e54-5284-9efa-765b93e1ede7 with identifier: NV75211 to the API
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-28T16:51:41Z',
 'fuel_type': 'petrol',
 'id': '8ac15e28-8e54-5284-9efa-765b93e1ede7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV75211',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 148562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-26',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV75211%27 HTTP/1.1" 200 None
2026-03-27 10:39:58 [auto1.de] INFO: Saving data for NV75211: {'auction_closing_time': 1774716701.0, 'created_time': 1774263448.460566, 'last_price_update_time': 1774607998.62809}
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV75211') HTTP/1.1" 204 0
2026-03-27 10:39:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501952bd0>
2026-03-27 10:39:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43149b24-5c84-5b00-830f-49bd6b2c7f0d/43149b24-5c84-5b00-830f-49bd6b2c7f0d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbe%252F68be70296381a043efabdc0e0b0c4024%252Fpa%252FCH55650_818a21d6365624be87c6ffc76526f2ff.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_818a21d6365624be87c6ffc76526f2ff.jpg saved to cache
2026-03-27 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43149b24-5c84-5b00-830f-49bd6b2c7f0d
2026-03-27 10:39:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501689650>
2026-03-27 10:39:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43149b24-5c84-5b00-830f-49bd6b2c7f0d/43149b24-5c84-5b00-830f-49bd6b2c7f0d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbe%252F68be70296381a043efabdc0e0b0c4024%252Fpa%252FCH55650_d7585da52a61f88b494e867b2133f9be.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_d7585da52a61f88b494e867b2133f9be.jpg saved to cache
2026-03-27 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43149b24-5c84-5b00-830f-49bd6b2c7f0d
2026-03-27 10:39:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002ca150>
2026-03-27 10:39:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f983f4c-065d-5952-8729-e67adaf03168/2f983f4c-065d-5952-8729-e67adaf03168_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb046424e75210961891109ff28a927%252Fpa%252FTT34897_beee140679e287222b3ce4c203ded3f8.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_beee140679e287222b3ce4c203ded3f8.jpg saved to cache
2026-03-27 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2f983f4c-065d-5952-8729-e67adaf03168
2026-03-27 10:39:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:39:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50175db10>
2026-03-27 10:39:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f983f4c-065d-5952-8729-e67adaf03168/2f983f4c-065d-5952-8729-e67adaf03168_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb046424e75210961891109ff28a927%252Fpa%252FTT34897_bf6b6e1db813ef94093f5f3772fa114e.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_bf6b6e1db813ef94093f5f3772fa114e.jpg saved to cache
2026-03-27 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2f983f4c-065d-5952-8729-e67adaf03168
2026-03-27 10:39:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a37d0>
2026-03-27 10:39:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b3e699-b153-5c86-9d0f-190ccd31e032/80b3e699-b153-5c86-9d0f-190ccd31e032_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F78%252F3378f68cbbfd920130d4c3dec31b147c%252Fpa%252FMA93398_742e1febd4e6251970891c41386c0021.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_742e1febd4e6251970891c41386c0021.jpg saved to cache
2026-03-27 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80b3e699-b153-5c86-9d0f-190ccd31e032
2026-03-27 10:39:59 [auto1.de] INFO: Found listing with ID: HZ19691
2026-03-27 10:39:59 [auto1.de] INFO: Found listing with ID: HX66232
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX66232%27 HTTP/1.1" 200 None
2026-03-27 10:39:59 [auto1.de] INFO: Scrape type for HX66232: 2
2026-03-27 10:39:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08bd7200-f9fb-57ab-9d1a-3f8497e28f1e with identifier: HX66232
2026-03-27 10:39:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08bd7200-f9fb-57ab-9d1a-3f8497e28f1e with scrape type 2
2026-03-27 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08bd7200-f9fb-57ab-9d1a-3f8497e28f1e with scrape type 2
2026-03-27 10:39:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08bd7200-f9fb-57ab-9d1a-3f8497e28f1e, identifier: HX66232
2026-03-27 10:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_cda442b2ad412595f7efc910360b8dd3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_ace1e26355a8c90f871e5f47b776d908.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_f92cb5ea05f2ca9646fc7a790b285499.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_72fd1df7b1dad3790a0d5721e6a3bd6b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F16%252F79160da376da89f55e2bc775229df4a4%252Fpa%252FNW54336_e2e19573acb040fb6b6c705a1e1af729.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_e2e19573acb040fb6b6c705a1e1af729.jpg not downloaded yet
2026-03-27 10:39:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08bd7200-f9fb-57ab-9d1a-3f8497e28f1e with identifier: HX66232
2026-03-27 10:39:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08bd7200-f9fb-57ab-9d1a-3f8497e28f1e with identifier: HX66232
2026-03-27 10:39:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08bd7200-f9fb-57ab-9d1a-3f8497e28f1e with identifier: HX66232 to the API
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:27:44Z',
 'fuel_type': 'petrol',
 'id': '08bd7200-f9fb-57ab-9d1a-3f8497e28f1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX66232',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 167261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-26',
 'seller_name': None,
 'title': 'Seat Leon 1.6 Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2007}
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX66232%27 HTTP/1.1" 200 None
2026-03-27 10:39:59 [auto1.de] INFO: Saving data for HX66232: {'auction_closing_time': 1774715264.0, 'created_time': 1773772791.720956, 'last_price_update_time': 1774607999.55923}
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX66232') HTTP/1.1" 204 0
2026-03-27 10:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_fce1f973b5e77157acc419d8876dbab9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:39:59 [auto1.de] INFO: Found listing with ID: CS56497
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS56497%27 HTTP/1.1" 200 None
2026-03-27 10:39:59 [auto1.de] INFO: Scrape type for CS56497: 2
2026-03-27 10:39:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d with identifier: CS56497
2026-03-27 10:39:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d with scrape type 2
2026-03-27 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d with scrape type 2
2026-03-27 10:39:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d, identifier: CS56497
2026-03-27 10:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU59623/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:39:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50378d9d0>
2026-03-27 10:39:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43149b24-5c84-5b00-830f-49bd6b2c7f0d/43149b24-5c84-5b00-830f-49bd6b2c7f0d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbe%252F68be70296381a043efabdc0e0b0c4024%252Fpa%252FCH55650_f43d2f31255c8a27248e73b86105f113.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_f43d2f31255c8a27248e73b86105f113.jpg saved to cache
2026-03-27 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43149b24-5c84-5b00-830f-49bd6b2c7f0d
2026-03-27 10:39:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:39:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019a45d0>
2026-03-27 10:39:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:39:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b3e699-b153-5c86-9d0f-190ccd31e032/80b3e699-b153-5c86-9d0f-190ccd31e032_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F78%252F3378f68cbbfd920130d4c3dec31b147c%252Fpa%252FMA93398_7b175cfb045000ab979aa4de127ed5c9.jpg') HTTP/1.1" 204 0
2026-03-27 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_7b175cfb045000ab979aa4de127ed5c9.jpg saved to cache
2026-03-27 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80b3e699-b153-5c86-9d0f-190ccd31e032
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F16%252F79160da376da89f55e2bc775229df4a4%252Fpa%252FNW54336_f50f23b0bfd9e9140f6dda093673792d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_f50f23b0bfd9e9140f6dda093673792d.jpg not downloaded yet
2026-03-27 10:39:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d with identifier: CS56497
2026-03-27 10:39:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d with identifier: CS56497
2026-03-27 10:39:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d with identifier: CS56497 to the API
2026-03-27 10:39:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:57:36Z',
 'fuel_type': 'diesel',
 'id': 'ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS56497',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 98752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-12',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Q4 Lusso',
 'transmission': 'automatic',
 'trim': 'Q4 Lusso',
 'year': 2020}
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS56497%27 HTTP/1.1" 200 None
2026-03-27 10:40:00 [auto1.de] INFO: Saving data for CS56497: {'auction_closing_time': 1774717056.0, 'created_time': 1774291223.832113, 'last_price_update_time': 1774608000.205162}
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS56497') HTTP/1.1" 204 0
2026-03-27 10:40:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:00 [auto1.de] INFO: Found listing with ID: AM15816
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM15816%27 HTTP/1.1" 200 None
2026-03-27 10:40:00 [auto1.de] INFO: Scrape type for AM15816: 2
2026-03-27 10:40:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3c7c327-8ad4-501a-87c8-8ea9167146f9 with identifier: AM15816
2026-03-27 10:40:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3c7c327-8ad4-501a-87c8-8ea9167146f9 with scrape type 2
2026-03-27 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3c7c327-8ad4-501a-87c8-8ea9167146f9 with scrape type 2
2026-03-27 10:40:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3c7c327-8ad4-501a-87c8-8ea9167146f9, identifier: AM15816
2026-03-27 10:40:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50039b1d0>
2026-03-27 10:40:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b3e699-b153-5c86-9d0f-190ccd31e032/80b3e699-b153-5c86-9d0f-190ccd31e032_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F78%252F3378f68cbbfd920130d4c3dec31b147c%252Fpa%252FMA93398_cda442b2ad412595f7efc910360b8dd3.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_cda442b2ad412595f7efc910360b8dd3.jpg saved to cache
2026-03-27 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80b3e699-b153-5c86-9d0f-190ccd31e032
2026-03-27 10:40:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a14750>
2026-03-27 10:40:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F16%252F79160da376da89f55e2bc775229df4a4%252Fpa%252FNW54336_ace1e26355a8c90f871e5f47b776d908.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_ace1e26355a8c90f871e5f47b776d908.jpg saved to cache
2026-03-27 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-27 10:40:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500350a50>
2026-03-27 10:40:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43149b24-5c84-5b00-830f-49bd6b2c7f0d/43149b24-5c84-5b00-830f-49bd6b2c7f0d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbe%252F68be70296381a043efabdc0e0b0c4024%252Fpa%252FCH55650_f92cb5ea05f2ca9646fc7a790b285499.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_f92cb5ea05f2ca9646fc7a790b285499.jpg saved to cache
2026-03-27 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 43149b24-5c84-5b00-830f-49bd6b2c7f0d
2026-03-27 10:40:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501854ad0>
2026-03-27 10:40:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b3e699-b153-5c86-9d0f-190ccd31e032/80b3e699-b153-5c86-9d0f-190ccd31e032_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F78%252F3378f68cbbfd920130d4c3dec31b147c%252Fpa%252FMA93398_72fd1df7b1dad3790a0d5721e6a3bd6b.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_72fd1df7b1dad3790a0d5721e6a3bd6b.jpg saved to cache
2026-03-27 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80b3e699-b153-5c86-9d0f-190ccd31e032
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F16%252F79160da376da89f55e2bc775229df4a4%252Fpa%252FNW54336_83e98fc0c7272f6a38da6fb0062c3e87.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_83e98fc0c7272f6a38da6fb0062c3e87.jpg not downloaded yet
2026-03-27 10:40:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3c7c327-8ad4-501a-87c8-8ea9167146f9 with identifier: AM15816
2026-03-27 10:40:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3c7c327-8ad4-501a-87c8-8ea9167146f9 with identifier: AM15816
2026-03-27 10:40:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3c7c327-8ad4-501a-87c8-8ea9167146f9 with identifier: AM15816 to the API
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:52:17Z',
 'fuel_type': 'petrol',
 'id': 'a3c7c327-8ad4-501a-87c8-8ea9167146f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM15816',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 182668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-19',
 'seller_name': None,
 'title': 'Suzuki SX4 1.5 Streetline Classic',
 'transmission': 'manual',
 'trim': 'Streetline Classic',
 'year': 2009}
2026-03-27 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM15816%27 HTTP/1.1" 200 None
2026-03-27 10:40:01 [auto1.de] INFO: Saving data for AM15816: {'auction_closing_time': 1774716737.0, 'created_time': 1774293061.861027, 'last_price_update_time': 1774608001.001221}
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM15816') HTTP/1.1" 204 0
2026-03-27 10:40:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500503ad0>
2026-03-27 10:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23414e8d-2f88-5a50-a9a3-5035574efa54/23414e8d-2f88-5a50-a9a3-5035574efa54_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F07%252Fdd070b339d92748978ef277faf400bd3%252Fpa%252FTX89120_fce1f973b5e77157acc419d8876dbab9.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_fce1f973b5e77157acc419d8876dbab9.jpg saved to cache
2026-03-27 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 23414e8d-2f88-5a50-a9a3-5035574efa54
2026-03-27 10:40:01 [auto1.de] INFO: Found listing with ID: ZK39912
2026-03-27 10:40:01 [auto1.de] INFO: Found listing with ID: RJ47669
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ47669%27 HTTP/1.1" 200 None
2026-03-27 10:40:01 [auto1.de] INFO: Scrape type for RJ47669: 2
2026-03-27 10:40:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78100c6e-4e2d-58f3-bcc4-183a44130648 with identifier: RJ47669
2026-03-27 10:40:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78100c6e-4e2d-58f3-bcc4-183a44130648 with scrape type 2
2026-03-27 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78100c6e-4e2d-58f3-bcc4-183a44130648 with scrape type 2
2026-03-27 10:40:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78100c6e-4e2d-58f3-bcc4-183a44130648, identifier: RJ47669
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F16%252F79160da376da89f55e2bc775229df4a4%252Fpa%252FNW54336_7e71a505d12e1b2d565137230375f9a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_7e71a505d12e1b2d565137230375f9a7.jpg not downloaded yet
2026-03-27 10:40:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78100c6e-4e2d-58f3-bcc4-183a44130648 with identifier: RJ47669
2026-03-27 10:40:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78100c6e-4e2d-58f3-bcc4-183a44130648 with identifier: RJ47669
2026-03-27 10:40:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78100c6e-4e2d-58f3-bcc4-183a44130648 with identifier: RJ47669 to the API
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:55:55Z',
 'fuel_type': 'petrol',
 'id': '78100c6e-4e2d-58f3-bcc4-183a44130648',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ47669',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 182184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-17',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.4 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2011}
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ47669%27 HTTP/1.1" 200 None
2026-03-27 10:40:01 [auto1.de] INFO: Saving data for RJ47669: {'auction_closing_time': 1774716955.0, 'created_time': 1773830401.654902, 'last_price_update_time': 1774608001.711385}
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ47669') HTTP/1.1" 204 0
2026-03-27 10:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_47030efc79dce9954087c96da1ec311a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_05d54b69421279c64b1c099c7e15e72a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_646877843af6e73f2ea93052b33614f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_e198637555db4306c16adbaa79e3bdf5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_e2e19573acb040fb6b6c705a1e1af729.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_c16a343a8a6980f6d9f6e671fcd36cef.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:01 [auto1.de] INFO: Found listing with ID: JU74172
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU74172%27 HTTP/1.1" 200 None
2026-03-27 10:40:01 [auto1.de] INFO: Scrape type for JU74172: 2
2026-03-27 10:40:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5256a6c5-b8ff-5574-87c3-fc726db79b21 with identifier: JU74172
2026-03-27 10:40:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5256a6c5-b8ff-5574-87c3-fc726db79b21 with scrape type 2
2026-03-27 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5256a6c5-b8ff-5574-87c3-fc726db79b21 with scrape type 2
2026-03-27 10:40:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5256a6c5-b8ff-5574-87c3-fc726db79b21, identifier: JU74172
2026-03-27 10:40:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5256a6c5-b8ff-5574-87c3-fc726db79b21 with identifier: JU74172
2026-03-27 10:40:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5256a6c5-b8ff-5574-87c3-fc726db79b21 with identifier: JU74172
2026-03-27 10:40:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5256a6c5-b8ff-5574-87c3-fc726db79b21 with identifier: JU74172 to the API
2026-03-27 10:40:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:55:39Z',
 'fuel_type': 'diesel',
 'id': '5256a6c5-b8ff-5574-87c3-fc726db79b21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU74172',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 55424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-10',
 'seller_name': None,
 'title': 'Volvo V90 2.0 B4 Mild-Hybrid R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2023}
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU74172%27 HTTP/1.1" 200 None
2026-03-27 10:40:02 [auto1.de] INFO: Saving data for JU74172: {'auction_closing_time': 1774716939.0, 'created_time': 1774293543.250006, 'last_price_update_time': 1774608002.232894}
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU74172') HTTP/1.1" 204 0
2026-03-27 10:40:02 [auto1.de] INFO: Found listing with ID: MZ82429
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ82429%27 HTTP/1.1" 200 None
2026-03-27 10:40:02 [auto1.de] INFO: Scrape type for MZ82429: 2
2026-03-27 10:40:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 743b2873-ad5e-50b7-b75d-7ce5fa0325e1 with identifier: MZ82429
2026-03-27 10:40:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 743b2873-ad5e-50b7-b75d-7ce5fa0325e1 with scrape type 2
2026-03-27 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 743b2873-ad5e-50b7-b75d-7ce5fa0325e1 with scrape type 2
2026-03-27 10:40:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 743b2873-ad5e-50b7-b75d-7ce5fa0325e1, identifier: MZ82429
2026-03-27 10:40:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 743b2873-ad5e-50b7-b75d-7ce5fa0325e1 with identifier: MZ82429
2026-03-27 10:40:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 743b2873-ad5e-50b7-b75d-7ce5fa0325e1 with identifier: MZ82429
2026-03-27 10:40:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 743b2873-ad5e-50b7-b75d-7ce5fa0325e1 with identifier: MZ82429 to the API
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 174,
 'expiration_date': '2026-03-28T16:03:09Z',
 'fuel_type': 'diesel',
 'id': '743b2873-ad5e-50b7-b75d-7ce5fa0325e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ82429',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 62985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-18',
 'seller_name': None,
 'title': 'Opel Insignia 2.0 CDTI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2022}
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ82429%27 HTTP/1.1" 200 None
2026-03-27 10:40:02 [auto1.de] INFO: Saving data for MZ82429: {'auction_closing_time': 1774713789.0, 'created_time': 1773819352.587743, 'last_price_update_time': 1774608002.746467}
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ82429') HTTP/1.1" 204 0
2026-03-27 10:40:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50039a110>
2026-03-27 10:40:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F16%252F79160da376da89f55e2bc775229df4a4%252Fpa%252FNW54336_47030efc79dce9954087c96da1ec311a.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_47030efc79dce9954087c96da1ec311a.jpg saved to cache
2026-03-27 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-27 10:40:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501699950>
2026-03-27 10:40:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F16%252F79160da376da89f55e2bc775229df4a4%252Fpa%252FNW54336_05d54b69421279c64b1c099c7e15e72a.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_05d54b69421279c64b1c099c7e15e72a.jpg saved to cache
2026-03-27 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-27 10:40:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501968490>
2026-03-27 10:40:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43149b24-5c84-5b00-830f-49bd6b2c7f0d/43149b24-5c84-5b00-830f-49bd6b2c7f0d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbe%252F68be70296381a043efabdc0e0b0c4024%252Fpa%252FCH55650_646877843af6e73f2ea93052b33614f6.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_646877843af6e73f2ea93052b33614f6.jpg saved to cache
2026-03-27 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43149b24-5c84-5b00-830f-49bd6b2c7f0d
2026-03-27 10:40:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501842750>
2026-03-27 10:40:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F16%252F79160da376da89f55e2bc775229df4a4%252Fpa%252FNW54336_e198637555db4306c16adbaa79e3bdf5.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_e198637555db4306c16adbaa79e3bdf5.jpg saved to cache
2026-03-27 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-27 10:40:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50176b6d0>
2026-03-27 10:40:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F16%252F79160da376da89f55e2bc775229df4a4%252Fpa%252FNW54336_e2e19573acb040fb6b6c705a1e1af729.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_e2e19573acb040fb6b6c705a1e1af729.jpg saved to cache
2026-03-27 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-27 10:40:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501681410>
2026-03-27 10:40:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b3e699-b153-5c86-9d0f-190ccd31e032/80b3e699-b153-5c86-9d0f-190ccd31e032_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F78%252F3378f68cbbfd920130d4c3dec31b147c%252Fpa%252FMA93398_c16a343a8a6980f6d9f6e671fcd36cef.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_c16a343a8a6980f6d9f6e671fcd36cef.jpg saved to cache
2026-03-27 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80b3e699-b153-5c86-9d0f-190ccd31e032
2026-03-27 10:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_540a01f105da508ac626077596f64445.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_08d1fa7eaf2230903a4b50f212631028.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:03 [auto1.de] INFO: Found listing with ID: GA31373
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31373%27 HTTP/1.1" 200 None
2026-03-27 10:40:03 [auto1.de] INFO: Scrape type for GA31373: 2
2026-03-27 10:40:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61230e02-7fb6-5d7f-9b1d-37da11809044 with identifier: GA31373
2026-03-27 10:40:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61230e02-7fb6-5d7f-9b1d-37da11809044 with scrape type 2
2026-03-27 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61230e02-7fb6-5d7f-9b1d-37da11809044 with scrape type 2
2026-03-27 10:40:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61230e02-7fb6-5d7f-9b1d-37da11809044, identifier: GA31373
2026-03-27 10:40:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_24e0f48a559ea3137f8705d272c3b581.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61230e02-7fb6-5d7f-9b1d-37da11809044 with identifier: GA31373
2026-03-27 10:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61230e02-7fb6-5d7f-9b1d-37da11809044 with identifier: GA31373
2026-03-27 10:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61230e02-7fb6-5d7f-9b1d-37da11809044 with identifier: GA31373 to the API
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:55:42Z',
 'fuel_type': 'diesel',
 'id': '61230e02-7fb6-5d7f-9b1d-37da11809044',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA31373',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 157142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-24',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31373%27 HTTP/1.1" 200 None
2026-03-27 10:40:03 [auto1.de] INFO: Saving data for GA31373: {'auction_closing_time': 1774716942.0, 'created_time': 1773134997.959537, 'last_price_update_time': 1774608003.582005}
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA31373') HTTP/1.1" 204 0
2026-03-27 10:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_f50f23b0bfd9e9140f6dda093673792d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_83e98fc0c7272f6a38da6fb0062c3e87.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:03 [auto1.de] INFO: Found listing with ID: FL12267
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL12267%27 HTTP/1.1" 200 None
2026-03-27 10:40:03 [auto1.de] INFO: Scrape type for FL12267: 2
2026-03-27 10:40:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d317abd7-0a52-5f1c-9142-0091822e1c18 with identifier: FL12267
2026-03-27 10:40:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d317abd7-0a52-5f1c-9142-0091822e1c18 with scrape type 2
2026-03-27 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d317abd7-0a52-5f1c-9142-0091822e1c18 with scrape type 2
2026-03-27 10:40:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d317abd7-0a52-5f1c-9142-0091822e1c18, identifier: FL12267
2026-03-27 10:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d317abd7-0a52-5f1c-9142-0091822e1c18 with identifier: FL12267
2026-03-27 10:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d317abd7-0a52-5f1c-9142-0091822e1c18 with identifier: FL12267
2026-03-27 10:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d317abd7-0a52-5f1c-9142-0091822e1c18 with identifier: FL12267 to the API
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:49:02Z',
 'fuel_type': 'petrol',
 'id': 'd317abd7-0a52-5f1c-9142-0091822e1c18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL12267',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 176906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-01',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL12267%27 HTTP/1.1" 200 None
2026-03-27 10:40:04 [auto1.de] INFO: Saving data for FL12267: {'auction_closing_time': 1774716542.0, 'created_time': 1773303651.843904, 'last_price_update_time': 1774608004.091471}
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL12267') HTTP/1.1" 204 0
2026-03-27 10:40:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_b8a96fe56feeebfdc4e88147ce0797b2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:04 [auto1.de] INFO: Found listing with ID: YH04834
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH04834%27 HTTP/1.1" 200 None
2026-03-27 10:40:04 [auto1.de] INFO: Scrape type for YH04834: 2
2026-03-27 10:40:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27e89818-238b-5676-ad89-4085c1019d05 with identifier: YH04834
2026-03-27 10:40:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27e89818-238b-5676-ad89-4085c1019d05 with scrape type 2
2026-03-27 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27e89818-238b-5676-ad89-4085c1019d05 with scrape type 2
2026-03-27 10:40:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27e89818-238b-5676-ad89-4085c1019d05, identifier: YH04834
2026-03-27 10:40:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27e89818-238b-5676-ad89-4085c1019d05 with identifier: YH04834
2026-03-27 10:40:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27e89818-238b-5676-ad89-4085c1019d05 with identifier: YH04834
2026-03-27 10:40:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27e89818-238b-5676-ad89-4085c1019d05 with identifier: YH04834 to the API
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:45:03Z',
 'fuel_type': 'petrol',
 'id': '27e89818-238b-5676-ad89-4085c1019d05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH04834',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 41555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-30',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 170 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2008}
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH04834%27 HTTP/1.1" 200 None
2026-03-27 10:40:04 [auto1.de] INFO: Saving data for YH04834: {'auction_closing_time': 1774716303.0, 'created_time': 1774263797.126811, 'last_price_update_time': 1774608004.58715}
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH04834') HTTP/1.1" 204 0
2026-03-27 10:40:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016505d0>
2026-03-27 10:40:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F16%252F79160da376da89f55e2bc775229df4a4%252Fpa%252FNW54336_540a01f105da508ac626077596f64445.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_540a01f105da508ac626077596f64445.jpg saved to cache
2026-03-27 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-27 10:40:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50170ef50>
2026-03-27 10:40:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b3e699-b153-5c86-9d0f-190ccd31e032/80b3e699-b153-5c86-9d0f-190ccd31e032_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F78%252F3378f68cbbfd920130d4c3dec31b147c%252Fpa%252FMA93398_08d1fa7eaf2230903a4b50f212631028.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_08d1fa7eaf2230903a4b50f212631028.jpg saved to cache
2026-03-27 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80b3e699-b153-5c86-9d0f-190ccd31e032
2026-03-27 10:40:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50058bfd0>
2026-03-27 10:40:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F16%252F79160da376da89f55e2bc775229df4a4%252Fpa%252FNW54336_24e0f48a559ea3137f8705d272c3b581.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_24e0f48a559ea3137f8705d272c3b581.jpg saved to cache
2026-03-27 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-27 10:40:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002ff290>
2026-03-27 10:40:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F16%252F79160da376da89f55e2bc775229df4a4%252Fpa%252FNW54336_f50f23b0bfd9e9140f6dda093673792d.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_f50f23b0bfd9e9140f6dda093673792d.jpg saved to cache
2026-03-27 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-27 10:40:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501653e10>
2026-03-27 10:40:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F16%252F79160da376da89f55e2bc775229df4a4%252Fpa%252FNW54336_83e98fc0c7272f6a38da6fb0062c3e87.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_83e98fc0c7272f6a38da6fb0062c3e87.jpg saved to cache
2026-03-27 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-27 10:40:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_7e71a505d12e1b2d565137230375f9a7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:04 [auto1.de] INFO: Found listing with ID: WN12652
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN12652%27 HTTP/1.1" 200 None
2026-03-27 10:40:04 [auto1.de] INFO: Scrape type for WN12652: 2
2026-03-27 10:40:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baccaceb-0dfd-5a48-b66c-2ab35fcffa70 with identifier: WN12652
2026-03-27 10:40:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baccaceb-0dfd-5a48-b66c-2ab35fcffa70 with scrape type 2
2026-03-27 10:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item baccaceb-0dfd-5a48-b66c-2ab35fcffa70 with scrape type 2
2026-03-27 10:40:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: baccaceb-0dfd-5a48-b66c-2ab35fcffa70, identifier: WN12652
2026-03-27 10:40:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_bdef0a2f52cccef7d87585e1adb983be.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: baccaceb-0dfd-5a48-b66c-2ab35fcffa70 with identifier: WN12652
2026-03-27 10:40:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: baccaceb-0dfd-5a48-b66c-2ab35fcffa70 with identifier: WN12652
2026-03-27 10:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: baccaceb-0dfd-5a48-b66c-2ab35fcffa70 with identifier: WN12652 to the API
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-28T16:06:46Z',
 'fuel_type': 'petrol',
 'id': 'baccaceb-0dfd-5a48-b66c-2ab35fcffa70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN12652',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 50726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-27',
 'seller_name': None,
 'title': 'Fiat Panda 1.1 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2009}
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN12652%27 HTTP/1.1" 200 None
2026-03-27 10:40:05 [auto1.de] INFO: Saving data for WN12652: {'auction_closing_time': 1774714006.0, 'created_time': 1773307574.059231, 'last_price_update_time': 1774608005.296884}
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN12652') HTTP/1.1" 204 0
2026-03-27 10:40:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003868d0>
2026-03-27 10:40:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b3e699-b153-5c86-9d0f-190ccd31e032/80b3e699-b153-5c86-9d0f-190ccd31e032_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F78%252F3378f68cbbfd920130d4c3dec31b147c%252Fpa%252FMA93398_b8a96fe56feeebfdc4e88147ce0797b2.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_b8a96fe56feeebfdc4e88147ce0797b2.jpg saved to cache
2026-03-27 10:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80b3e699-b153-5c86-9d0f-190ccd31e032
2026-03-27 10:40:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_395898acaba60e7fa75783bd496f92be.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:05 [auto1.de] INFO: Found listing with ID: DW51780
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW51780%27 HTTP/1.1" 200 None
2026-03-27 10:40:05 [auto1.de] INFO: Scrape type for DW51780: 2
2026-03-27 10:40:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c653339c-9f41-5a46-b656-52162bcf9398 with identifier: DW51780
2026-03-27 10:40:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c653339c-9f41-5a46-b656-52162bcf9398 with scrape type 2
2026-03-27 10:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c653339c-9f41-5a46-b656-52162bcf9398 with scrape type 2
2026-03-27 10:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c653339c-9f41-5a46-b656-52162bcf9398, identifier: DW51780
2026-03-27 10:40:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c653339c-9f41-5a46-b656-52162bcf9398 with identifier: DW51780
2026-03-27 10:40:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c653339c-9f41-5a46-b656-52162bcf9398 with identifier: DW51780
2026-03-27 10:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c653339c-9f41-5a46-b656-52162bcf9398 with identifier: DW51780 to the API
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:34:38Z',
 'fuel_type': 'diesel',
 'id': 'c653339c-9f41-5a46-b656-52162bcf9398',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW51780',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 266330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-28',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2012}
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW51780%27 HTTP/1.1" 200 None
2026-03-27 10:40:05 [auto1.de] INFO: Saving data for DW51780: {'auction_closing_time': 1774715678.0, 'created_time': 1774293394.095364, 'last_price_update_time': 1774608005.887372}
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW51780') HTTP/1.1" 204 0
2026-03-27 10:40:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_f65d4d9c9baf79e21e6cbdef61572676.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:05 [auto1.de] INFO: Found listing with ID: DD89889
2026-03-27 10:40:05 [auto1.de] INFO: Found listing with ID: TK47054
2026-03-27 10:40:05 [auto1.de] INFO: Found listing with ID: TL66452
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL66452%27 HTTP/1.1" 200 None
2026-03-27 10:40:05 [auto1.de] INFO: Scrape type for TL66452: 2
2026-03-27 10:40:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d68b5eeb-0d3d-5433-97c5-03ce07cb2e97 with identifier: TL66452
2026-03-27 10:40:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d68b5eeb-0d3d-5433-97c5-03ce07cb2e97 with scrape type 2
2026-03-27 10:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d68b5eeb-0d3d-5433-97c5-03ce07cb2e97 with scrape type 2
2026-03-27 10:40:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d68b5eeb-0d3d-5433-97c5-03ce07cb2e97, identifier: TL66452
2026-03-27 10:40:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a9150>
2026-03-27 10:40:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F16%252F79160da376da89f55e2bc775229df4a4%252Fpa%252FNW54336_7e71a505d12e1b2d565137230375f9a7.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_7e71a505d12e1b2d565137230375f9a7.jpg saved to cache
2026-03-27 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 51273f1e-8e51-5a24-afab-3768a127c295
2026-03-27 10:40:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51273f1e-8e51-5a24-afab-3768a127c295, skipping ID generation
2026-03-27 10:40:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51273f1e-8e51-5a24-afab-3768a127c295 with scrape type 1
2026-03-27 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51273f1e-8e51-5a24-afab-3768a127c295 sending to next pipeline
2026-03-27 10:40:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51273f1e-8e51-5a24-afab-3768a127c295, identifier: NW54336
2026-03-27 10:40:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:40:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501873a90>
2026-03-27 10:40:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4cdf85-78e5-5e8b-acc4-acb367780537/3b4cdf85-78e5-5e8b-acc4-acb367780537_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F43%252F7e438750c458b90e705d99a15cd38473%252Fpa%252FEX22671_bdef0a2f52cccef7d87585e1adb983be.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_bdef0a2f52cccef7d87585e1adb983be.jpg saved to cache
2026-03-27 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b4cdf85-78e5-5e8b-acc4-acb367780537
2026-03-27 10:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d68b5eeb-0d3d-5433-97c5-03ce07cb2e97 with identifier: TL66452
2026-03-27 10:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d68b5eeb-0d3d-5433-97c5-03ce07cb2e97 with identifier: TL66452
2026-03-27 10:40:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d68b5eeb-0d3d-5433-97c5-03ce07cb2e97 with identifier: TL66452 to the API
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:27:58Z',
 'fuel_type': 'diesel',
 'id': 'd68b5eeb-0d3d-5433-97c5-03ce07cb2e97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL66452',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 204490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-02',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 320 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2007}
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL66452%27 HTTP/1.1" 200 None
2026-03-27 10:40:06 [auto1.de] INFO: Saving data for TL66452: {'auction_closing_time': 1774715278.0, 'created_time': 1773773226.657106, 'last_price_update_time': 1774608006.69996}
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL66452') HTTP/1.1" 204 0
2026-03-27 10:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51273f1e-8e51-5a24-afab-3768a127c295 with identifier: NW54336
2026-03-27 10:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51273f1e-8e51-5a24-afab-3768a127c295 with identifier: NW54336
2026-03-27 10:40:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51273f1e-8e51-5a24-afab-3768a127c295 with identifier: NW54336 to the API
2026-03-27 10:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_7e71a505d12e1b2d565137230375f9a7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:17:23Z',
 'fuel_type': 'electro',
 'id': '51273f1e-8e51-5a24-afab-3768a127c295',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW54336',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 12,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_ace1e26355a8c90f871e5f47b776d908.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_24e0f48a559ea3137f8705d272c3b581.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_540a01f105da508ac626077596f64445.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_e198637555db4306c16adbaa79e3bdf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_05d54b69421279c64b1c099c7e15e72a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_47030efc79dce9954087c96da1ec311a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_e2e19573acb040fb6b6c705a1e1af729.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_f50f23b0bfd9e9140f6dda093673792d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_83e98fc0c7272f6a38da6fb0062c3e87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51273f1e-8e51-5a24-afab-3768a127c295/51273f1e-8e51-5a24-afab-3768a127c295_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/16/79160da376da89f55e2bc775229df4a4/pa/NW54336_7e71a505d12e1b2d565137230375f9a7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-12-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW54336%27 HTTP/1.1" 200 None
2026-03-27 10:40:07 [auto1.de] INFO: Saving data for NW54336: {'created_time': 1774608007.139317, 'last_price_update_time': 1774608007.139327, 'auction_closing_time': 1774714643.0}
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW54336') HTTP/1.1" 204 0
2026-03-27 10:40:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_68b62b8c697f314251bb9434cd19069e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_5a15ad5756fd39ef2a6d2ba9a205de44.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_a9151c8a8ff23d5129f47d217275ac10.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:07 [scrapy.extensions.logstats] INFO: Crawled 227 pages (at 36 pages/min), scraped 153 items (at 38 items/min)
2026-03-27 10:40:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-27 10:40:07 [auto1.de] INFO: Found listing with ID: WB03477
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB03477%27 HTTP/1.1" 200 None
2026-03-27 10:40:07 [auto1.de] INFO: Scrape type for WB03477: 2
2026-03-27 10:40:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daf68544-325e-5a0c-87b8-84dbd2136216 with identifier: WB03477
2026-03-27 10:40:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daf68544-325e-5a0c-87b8-84dbd2136216 with scrape type 2
2026-03-27 10:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item daf68544-325e-5a0c-87b8-84dbd2136216 with scrape type 2
2026-03-27 10:40:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: daf68544-325e-5a0c-87b8-84dbd2136216, identifier: WB03477
2026-03-27 10:40:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018731d0>
2026-03-27 10:40:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43149b24-5c84-5b00-830f-49bd6b2c7f0d/43149b24-5c84-5b00-830f-49bd6b2c7f0d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbe%252F68be70296381a043efabdc0e0b0c4024%252Fpa%252FCH55650_395898acaba60e7fa75783bd496f92be.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_395898acaba60e7fa75783bd496f92be.jpg saved to cache
2026-03-27 10:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43149b24-5c84-5b00-830f-49bd6b2c7f0d
2026-03-27 10:40:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: daf68544-325e-5a0c-87b8-84dbd2136216 with identifier: WB03477
2026-03-27 10:40:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: daf68544-325e-5a0c-87b8-84dbd2136216 with identifier: WB03477
2026-03-27 10:40:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: daf68544-325e-5a0c-87b8-84dbd2136216 with identifier: WB03477 to the API
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:46:07Z',
 'fuel_type': 'petrol',
 'id': 'daf68544-325e-5a0c-87b8-84dbd2136216',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB03477',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 140843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-07',
 'seller_name': None,
 'title': 'Hyundai i20 1.4 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2011}
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB03477%27 HTTP/1.1" 200 None
2026-03-27 10:40:07 [auto1.de] INFO: Saving data for WB03477: {'auction_closing_time': 1774716367.0, 'created_time': 1774294751.774, 'last_price_update_time': 1774608007.656832}
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB03477') HTTP/1.1" 204 0
2026-03-27 10:40:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_5f73c8dcbc1fa14adcbad5ae31bb050b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:07 [auto1.de] INFO: Found listing with ID: LJ75768
2026-03-27 10:40:07 [auto1.de] INFO: Found listing with ID: FY30353
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY30353%27 HTTP/1.1" 200 None
2026-03-27 10:40:07 [auto1.de] INFO: Scrape type for FY30353: 2
2026-03-27 10:40:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b3c3729-9171-5c1c-bb0d-07865d298010 with identifier: FY30353
2026-03-27 10:40:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b3c3729-9171-5c1c-bb0d-07865d298010 with scrape type 2
2026-03-27 10:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b3c3729-9171-5c1c-bb0d-07865d298010 with scrape type 2
2026-03-27 10:40:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b3c3729-9171-5c1c-bb0d-07865d298010, identifier: FY30353
2026-03-27 10:40:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_9b6a27db543a6d63c8659ecee41b24eb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b3c3729-9171-5c1c-bb0d-07865d298010 with identifier: FY30353
2026-03-27 10:40:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b3c3729-9171-5c1c-bb0d-07865d298010 with identifier: FY30353
2026-03-27 10:40:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b3c3729-9171-5c1c-bb0d-07865d298010 with identifier: FY30353 to the API
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:36:52Z',
 'fuel_type': 'diesel',
 'id': '4b3c3729-9171-5c1c-bb0d-07865d298010',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY30353',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 181354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-03',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2010}
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY30353%27 HTTP/1.1" 200 None
2026-03-27 10:40:08 [auto1.de] INFO: Saving data for FY30353: {'auction_closing_time': 1774715812.0, 'created_time': 1773305735.967438, 'last_price_update_time': 1774608008.403497}
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY30353') HTTP/1.1" 204 0
2026-03-27 10:40:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50038ce90>
2026-03-27 10:40:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b3e699-b153-5c86-9d0f-190ccd31e032/80b3e699-b153-5c86-9d0f-190ccd31e032_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F78%252F3378f68cbbfd920130d4c3dec31b147c%252Fpa%252FMA93398_f65d4d9c9baf79e21e6cbdef61572676.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_f65d4d9c9baf79e21e6cbdef61572676.jpg saved to cache
2026-03-27 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80b3e699-b153-5c86-9d0f-190ccd31e032
2026-03-27 10:40:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501688fd0>
2026-03-27 10:40:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b3e699-b153-5c86-9d0f-190ccd31e032/80b3e699-b153-5c86-9d0f-190ccd31e032_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F78%252F3378f68cbbfd920130d4c3dec31b147c%252Fpa%252FMA93398_68b62b8c697f314251bb9434cd19069e.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_68b62b8c697f314251bb9434cd19069e.jpg saved to cache
2026-03-27 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80b3e699-b153-5c86-9d0f-190ccd31e032
2026-03-27 10:40:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80b3e699-b153-5c86-9d0f-190ccd31e032, skipping ID generation
2026-03-27 10:40:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80b3e699-b153-5c86-9d0f-190ccd31e032 with scrape type 1
2026-03-27 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80b3e699-b153-5c86-9d0f-190ccd31e032 sending to next pipeline
2026-03-27 10:40:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80b3e699-b153-5c86-9d0f-190ccd31e032, identifier: MA93398
2026-03-27 10:40:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5036de090>
2026-03-27 10:40:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4cdf85-78e5-5e8b-acc4-acb367780537/3b4cdf85-78e5-5e8b-acc4-acb367780537_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F43%252F7e438750c458b90e705d99a15cd38473%252Fpa%252FEX22671_5a15ad5756fd39ef2a6d2ba9a205de44.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_5a15ad5756fd39ef2a6d2ba9a205de44.jpg saved to cache
2026-03-27 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b4cdf85-78e5-5e8b-acc4-acb367780537
2026-03-27 10:40:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a0fd0>
2026-03-27 10:40:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4cdf85-78e5-5e8b-acc4-acb367780537/3b4cdf85-78e5-5e8b-acc4-acb367780537_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F43%252F7e438750c458b90e705d99a15cd38473%252Fpa%252FEX22671_a9151c8a8ff23d5129f47d217275ac10.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_a9151c8a8ff23d5129f47d217275ac10.jpg saved to cache
2026-03-27 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b4cdf85-78e5-5e8b-acc4-acb367780537
2026-03-27 10:40:08 [auto1.de] INFO: Found listing with ID: GL59385
2026-03-27 10:40:08 [auto1.de] INFO: Found listing with ID: WF80406
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF80406%27 HTTP/1.1" 200 None
2026-03-27 10:40:08 [auto1.de] INFO: Scrape type for WF80406: 2
2026-03-27 10:40:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af86c294-3dc1-5bf4-888f-47e35863b310 with identifier: WF80406
2026-03-27 10:40:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af86c294-3dc1-5bf4-888f-47e35863b310 with scrape type 2
2026-03-27 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af86c294-3dc1-5bf4-888f-47e35863b310 with scrape type 2
2026-03-27 10:40:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af86c294-3dc1-5bf4-888f-47e35863b310, identifier: WF80406
2026-03-27 10:40:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80b3e699-b153-5c86-9d0f-190ccd31e032 with identifier: MA93398
2026-03-27 10:40:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80b3e699-b153-5c86-9d0f-190ccd31e032 with identifier: MA93398
2026-03-27 10:40:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80b3e699-b153-5c86-9d0f-190ccd31e032 with identifier: MA93398 to the API
2026-03-27 10:40:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_68b62b8c697f314251bb9434cd19069e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:29:46Z',
 'fuel_type': 'petrol',
 'id': '80b3e699-b153-5c86-9d0f-190ccd31e032',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA93398',
 'listing': 'auction',
 'location': 'DE, Ludwigsburg',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 61441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b3e699-b153-5c86-9d0f-190ccd31e032/80b3e699-b153-5c86-9d0f-190ccd31e032_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_e4256f60ee00cec405af8314943f4285.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b3e699-b153-5c86-9d0f-190ccd31e032/80b3e699-b153-5c86-9d0f-190ccd31e032_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_68b62b8c697f314251bb9434cd19069e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b3e699-b153-5c86-9d0f-190ccd31e032/80b3e699-b153-5c86-9d0f-190ccd31e032_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_f65d4d9c9baf79e21e6cbdef61572676.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b3e699-b153-5c86-9d0f-190ccd31e032/80b3e699-b153-5c86-9d0f-190ccd31e032_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_742e1febd4e6251970891c41386c0021.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b3e699-b153-5c86-9d0f-190ccd31e032/80b3e699-b153-5c86-9d0f-190ccd31e032_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_7b175cfb045000ab979aa4de127ed5c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b3e699-b153-5c86-9d0f-190ccd31e032/80b3e699-b153-5c86-9d0f-190ccd31e032_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_cda442b2ad412595f7efc910360b8dd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b3e699-b153-5c86-9d0f-190ccd31e032/80b3e699-b153-5c86-9d0f-190ccd31e032_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_b8a96fe56feeebfdc4e88147ce0797b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b3e699-b153-5c86-9d0f-190ccd31e032/80b3e699-b153-5c86-9d0f-190ccd31e032_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_72fd1df7b1dad3790a0d5721e6a3bd6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b3e699-b153-5c86-9d0f-190ccd31e032/80b3e699-b153-5c86-9d0f-190ccd31e032_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_08d1fa7eaf2230903a4b50f212631028.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b3e699-b153-5c86-9d0f-190ccd31e032/80b3e699-b153-5c86-9d0f-190ccd31e032_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/78/3378f68cbbfd920130d4c3dec31b147c/pa/MA93398_c16a343a8a6980f6d9f6e671fcd36cef.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 MPI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA93398%27 HTTP/1.1" 200 None
2026-03-27 10:40:09 [auto1.de] INFO: Saving data for MA93398: {'created_time': 1774608009.184302, 'last_price_update_time': 1774608009.184313, 'auction_closing_time': 1774715386.0}
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA93398') HTTP/1.1" 204 0
2026-03-27 10:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_8d8f7666df462195774a370437f748da.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af86c294-3dc1-5bf4-888f-47e35863b310 with identifier: WF80406
2026-03-27 10:40:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af86c294-3dc1-5bf4-888f-47e35863b310 with identifier: WF80406
2026-03-27 10:40:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af86c294-3dc1-5bf4-888f-47e35863b310 with identifier: WF80406 to the API
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:48:07Z',
 'fuel_type': 'petrol',
 'id': 'af86c294-3dc1-5bf4-888f-47e35863b310',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF80406',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 66628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-01',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.5 TSI ACT sport',
 'transmission': 'automatic',
 'trim': 'sport',
 'year': 2018}
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF80406%27 HTTP/1.1" 200 None
2026-03-27 10:40:09 [auto1.de] INFO: Saving data for WF80406: {'auction_closing_time': 1774716487.0, 'created_time': 1773819327.018415, 'last_price_update_time': 1774608009.540136}
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF80406') HTTP/1.1" 204 0
2026-03-27 10:40:09 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 132.224(s), this was the 1st time calling it.
2026-03-27 10:40:09 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.075429343169485 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-27 10:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016d2590>
2026-03-27 10:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4cdf85-78e5-5e8b-acc4-acb367780537/3b4cdf85-78e5-5e8b-acc4-acb367780537_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F43%252F7e438750c458b90e705d99a15cd38473%252Fpa%252FEX22671_5f73c8dcbc1fa14adcbad5ae31bb050b.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_5f73c8dcbc1fa14adcbad5ae31bb050b.jpg saved to cache
2026-03-27 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b4cdf85-78e5-5e8b-acc4-acb367780537
2026-03-27 10:40:09 [auto1.de] INFO: Found listing with ID: PZ82865
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ82865%27 HTTP/1.1" 200 None
2026-03-27 10:40:09 [auto1.de] INFO: Scrape type for PZ82865: 2
2026-03-27 10:40:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 661c9ce5-0090-5231-9228-7a2dafd12b96 with identifier: PZ82865
2026-03-27 10:40:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 661c9ce5-0090-5231-9228-7a2dafd12b96 with scrape type 2
2026-03-27 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 661c9ce5-0090-5231-9228-7a2dafd12b96 with scrape type 2
2026-03-27 10:40:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 661c9ce5-0090-5231-9228-7a2dafd12b96, identifier: PZ82865
2026-03-27 10:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_3046abb8815524d8091c858215d91f94.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_467a4b932f0a731dcc6e03b10913bc5e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 661c9ce5-0090-5231-9228-7a2dafd12b96 with identifier: PZ82865
2026-03-27 10:40:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 661c9ce5-0090-5231-9228-7a2dafd12b96 with identifier: PZ82865
2026-03-27 10:40:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 661c9ce5-0090-5231-9228-7a2dafd12b96 with identifier: PZ82865 to the API
2026-03-27 10:40:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 262,
 'expiration_date': '2026-03-28T16:06:44Z',
 'fuel_type': 'diesel',
 'id': '661c9ce5-0090-5231-9228-7a2dafd12b96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ82865',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A8',
 'odometer': 120246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-24',
 'seller_name': None,
 'title': 'Audi A8 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ82865%27 HTTP/1.1" 200 None
2026-03-27 10:40:10 [auto1.de] INFO: Saving data for PZ82865: {'auction_closing_time': 1774714004.0, 'created_time': 1774265072.591874, 'last_price_update_time': 1774608010.110708}
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ82865') HTTP/1.1" 204 0
2026-03-27 10:40:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501688c10>
2026-03-27 10:40:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23414e8d-2f88-5a50-a9a3-5035574efa54/23414e8d-2f88-5a50-a9a3-5035574efa54_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F07%252Fdd070b339d92748978ef277faf400bd3%252Fpa%252FTX89120_9b6a27db543a6d63c8659ecee41b24eb.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_9b6a27db543a6d63c8659ecee41b24eb.jpg saved to cache
2026-03-27 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 23414e8d-2f88-5a50-a9a3-5035574efa54
2026-03-27 10:40:10 [auto1.de] INFO: Found listing with ID: TX48260
2026-03-27 10:40:10 [auto1.de] INFO: Found listing with ID: DE77804
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE77804%27 HTTP/1.1" 200 None
2026-03-27 10:40:10 [auto1.de] INFO: Scrape type for DE77804: 2
2026-03-27 10:40:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e3b8874-fe0d-5b78-b639-10d5a47a172c with identifier: DE77804
2026-03-27 10:40:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e3b8874-fe0d-5b78-b639-10d5a47a172c with scrape type 2
2026-03-27 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e3b8874-fe0d-5b78-b639-10d5a47a172c with scrape type 2
2026-03-27 10:40:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e3b8874-fe0d-5b78-b639-10d5a47a172c, identifier: DE77804
2026-03-27 10:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_4e62c2df98b3b16fc8e76d9518d0d75a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e3b8874-fe0d-5b78-b639-10d5a47a172c with identifier: DE77804
2026-03-27 10:40:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e3b8874-fe0d-5b78-b639-10d5a47a172c with identifier: DE77804
2026-03-27 10:40:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e3b8874-fe0d-5b78-b639-10d5a47a172c with identifier: DE77804 to the API
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:32:06Z',
 'fuel_type': 'diesel',
 'id': '6e3b8874-fe0d-5b78-b639-10d5a47a172c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE77804',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 177625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-13',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 1.6 CDTI DPF Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2016}
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE77804%27 HTTP/1.1" 200 None
2026-03-27 10:40:10 [auto1.de] INFO: Saving data for DE77804: {'auction_closing_time': 1774715526.0, 'created_time': 1774294179.848863, 'last_price_update_time': 1774608010.659973}
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE77804') HTTP/1.1" 204 0
2026-03-27 10:40:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016d0bd0>
2026-03-27 10:40:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4cdf85-78e5-5e8b-acc4-acb367780537/3b4cdf85-78e5-5e8b-acc4-acb367780537_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F43%252F7e438750c458b90e705d99a15cd38473%252Fpa%252FEX22671_8d8f7666df462195774a370437f748da.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_8d8f7666df462195774a370437f748da.jpg saved to cache
2026-03-27 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b4cdf85-78e5-5e8b-acc4-acb367780537
2026-03-27 10:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_705ab594e802014eba1ffccf2d821bc1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:10 [auto1.de] INFO: Found listing with ID: NS47503
2026-03-27 10:40:10 [auto1.de] INFO: Found listing with ID: SY34106
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY34106%27 HTTP/1.1" 200 None
2026-03-27 10:40:10 [auto1.de] INFO: Scrape type for SY34106: 2
2026-03-27 10:40:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ab9479e-42f4-5d2d-8a4e-8256e191a47e with identifier: SY34106
2026-03-27 10:40:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ab9479e-42f4-5d2d-8a4e-8256e191a47e with scrape type 2
2026-03-27 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ab9479e-42f4-5d2d-8a4e-8256e191a47e with scrape type 2
2026-03-27 10:40:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ab9479e-42f4-5d2d-8a4e-8256e191a47e, identifier: SY34106
2026-03-27 10:40:10 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.008(s), this was the 1st time calling it.
2026-03-27 10:40:10 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.1463744269651555 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-27 10:40:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ab9479e-42f4-5d2d-8a4e-8256e191a47e with identifier: SY34106
2026-03-27 10:40:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ab9479e-42f4-5d2d-8a4e-8256e191a47e with identifier: SY34106
2026-03-27 10:40:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ab9479e-42f4-5d2d-8a4e-8256e191a47e with identifier: SY34106 to the API
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:46:18Z',
 'fuel_type': 'diesel',
 'id': '8ab9479e-42f4-5d2d-8a4e-8256e191a47e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY34106',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 123575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-10',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY34106%27 HTTP/1.1" 200 None
2026-03-27 10:40:11 [auto1.de] INFO: Saving data for SY34106: {'auction_closing_time': 1774716378.0, 'created_time': 1773305456.105949, 'last_price_update_time': 1774608011.369493}
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY34106') HTTP/1.1" 204 0
2026-03-27 10:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50162e090>
2026-03-27 10:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e46331e9-982e-5737-98ed-b7250cfd202d/e46331e9-982e-5737-98ed-b7250cfd202d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F8e%252Ff08e47f50490b2754bee2267c9efd649%252Fpa%252FXH92207_3046abb8815524d8091c858215d91f94.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_3046abb8815524d8091c858215d91f94.jpg saved to cache
2026-03-27 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e46331e9-982e-5737-98ed-b7250cfd202d
2026-03-27 10:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500588f50>
2026-03-27 10:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e46331e9-982e-5737-98ed-b7250cfd202d/e46331e9-982e-5737-98ed-b7250cfd202d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F8e%252Ff08e47f50490b2754bee2267c9efd649%252Fpa%252FXH92207_467a4b932f0a731dcc6e03b10913bc5e.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_467a4b932f0a731dcc6e03b10913bc5e.jpg saved to cache
2026-03-27 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e46331e9-982e-5737-98ed-b7250cfd202d
2026-03-27 10:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_292016ca83ed6abbb44f96bb20fae6da.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:11 [auto1.de] INFO: Found listing with ID: FF62684
2026-03-27 10:40:11 [auto1.de] INFO: Found listing with ID: MV18053
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV18053%27 HTTP/1.1" 200 None
2026-03-27 10:40:11 [auto1.de] INFO: Scrape type for MV18053: 2
2026-03-27 10:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 461a9b45-ae98-56f9-8454-d7329e490e6b with identifier: MV18053
2026-03-27 10:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 461a9b45-ae98-56f9-8454-d7329e490e6b with scrape type 2
2026-03-27 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 461a9b45-ae98-56f9-8454-d7329e490e6b with scrape type 2
2026-03-27 10:40:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 461a9b45-ae98-56f9-8454-d7329e490e6b, identifier: MV18053
2026-03-27 10:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/8e/9e8e8c4ea216decd0bcdd380b32fad5f/pa/BD51611_2b05c555c0b985fdf7160e9befee0c60.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 461a9b45-ae98-56f9-8454-d7329e490e6b with identifier: MV18053
2026-03-27 10:40:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 461a9b45-ae98-56f9-8454-d7329e490e6b with identifier: MV18053
2026-03-27 10:40:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 461a9b45-ae98-56f9-8454-d7329e490e6b with identifier: MV18053 to the API
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:48:37Z',
 'fuel_type': 'petrol',
 'id': '461a9b45-ae98-56f9-8454-d7329e490e6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV18053',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 115670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-03',
 'seller_name': None,
 'title': 'Audi A5 2.0 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV18053%27 HTTP/1.1" 200 None
2026-03-27 10:40:11 [auto1.de] INFO: Saving data for MV18053: {'auction_closing_time': 1774716517.0, 'created_time': 1773812125.868679, 'last_price_update_time': 1774608011.921281}
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV18053') HTTP/1.1" 204 0
2026-03-27 10:40:12 [auto1.de] INFO: Found listing with ID: JR98479
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR98479%27 HTTP/1.1" 200 None
2026-03-27 10:40:12 [auto1.de] INFO: Scrape type for JR98479: 2
2026-03-27 10:40:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbef9642-8ef4-533c-9d0c-89f213793cf7 with identifier: JR98479
2026-03-27 10:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbef9642-8ef4-533c-9d0c-89f213793cf7 with scrape type 2
2026-03-27 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbef9642-8ef4-533c-9d0c-89f213793cf7 with scrape type 2
2026-03-27 10:40:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbef9642-8ef4-533c-9d0c-89f213793cf7, identifier: JR98479
2026-03-27 10:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50172a950>
2026-03-27 10:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23414e8d-2f88-5a50-a9a3-5035574efa54/23414e8d-2f88-5a50-a9a3-5035574efa54_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F07%252Fdd070b339d92748978ef277faf400bd3%252Fpa%252FTX89120_4e62c2df98b3b16fc8e76d9518d0d75a.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_4e62c2df98b3b16fc8e76d9518d0d75a.jpg saved to cache
2026-03-27 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 23414e8d-2f88-5a50-a9a3-5035574efa54
2026-03-27 10:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50191f990>
2026-03-27 10:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23414e8d-2f88-5a50-a9a3-5035574efa54/23414e8d-2f88-5a50-a9a3-5035574efa54_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F07%252Fdd070b339d92748978ef277faf400bd3%252Fpa%252FTX89120_705ab594e802014eba1ffccf2d821bc1.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_705ab594e802014eba1ffccf2d821bc1.jpg saved to cache
2026-03-27 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23414e8d-2f88-5a50-a9a3-5035574efa54
2026-03-27 10:40:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23414e8d-2f88-5a50-a9a3-5035574efa54, skipping ID generation
2026-03-27 10:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23414e8d-2f88-5a50-a9a3-5035574efa54 with scrape type 1
2026-03-27 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23414e8d-2f88-5a50-a9a3-5035574efa54 sending to next pipeline
2026-03-27 10:40:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23414e8d-2f88-5a50-a9a3-5035574efa54, identifier: TX89120
2026-03-27 10:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_cca1d44570218ac703bfed9bccdb03eb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbef9642-8ef4-533c-9d0c-89f213793cf7 with identifier: JR98479
2026-03-27 10:40:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbef9642-8ef4-533c-9d0c-89f213793cf7 with identifier: JR98479
2026-03-27 10:40:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbef9642-8ef4-533c-9d0c-89f213793cf7 with identifier: JR98479 to the API
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:36:29Z',
 'fuel_type': 'petrol',
 'id': 'cbef9642-8ef4-533c-9d0c-89f213793cf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR98479',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 91269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-29',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR98479%27 HTTP/1.1" 200 None
2026-03-27 10:40:12 [auto1.de] INFO: Saving data for JR98479: {'auction_closing_time': 1774715789.0, 'created_time': 1773382837.87717, 'last_price_update_time': 1774608012.715902}
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR98479') HTTP/1.1" 204 0
2026-03-27 10:40:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23414e8d-2f88-5a50-a9a3-5035574efa54 with identifier: TX89120
2026-03-27 10:40:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23414e8d-2f88-5a50-a9a3-5035574efa54 with identifier: TX89120
2026-03-27 10:40:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23414e8d-2f88-5a50-a9a3-5035574efa54 with identifier: TX89120 to the API
2026-03-27 10:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_705ab594e802014eba1ffccf2d821bc1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 195,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:19:18Z',
 'fuel_type': 'diesel',
 'id': '23414e8d-2f88-5a50-a9a3-5035574efa54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX89120',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 303555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23414e8d-2f88-5a50-a9a3-5035574efa54/23414e8d-2f88-5a50-a9a3-5035574efa54_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_705ab594e802014eba1ffccf2d821bc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23414e8d-2f88-5a50-a9a3-5035574efa54/23414e8d-2f88-5a50-a9a3-5035574efa54_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_257da2f5fe925ac617c5ec3f6a62201f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23414e8d-2f88-5a50-a9a3-5035574efa54/23414e8d-2f88-5a50-a9a3-5035574efa54_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_fde1399a22586d6ebbf3eb733bf452b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23414e8d-2f88-5a50-a9a3-5035574efa54/23414e8d-2f88-5a50-a9a3-5035574efa54_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_4e62c2df98b3b16fc8e76d9518d0d75a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23414e8d-2f88-5a50-a9a3-5035574efa54/23414e8d-2f88-5a50-a9a3-5035574efa54_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2164201,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_fce1f973b5e77157acc419d8876dbab9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23414e8d-2f88-5a50-a9a3-5035574efa54/23414e8d-2f88-5a50-a9a3-5035574efa54_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_93515e325d19d39a371023bf8213293a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23414e8d-2f88-5a50-a9a3-5035574efa54/23414e8d-2f88-5a50-a9a3-5035574efa54_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_a63163dbaffbcfdddf7d6b6a4f06ad0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23414e8d-2f88-5a50-a9a3-5035574efa54/23414e8d-2f88-5a50-a9a3-5035574efa54_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_2f00df08274241a5f4b52ed8c71b8043.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23414e8d-2f88-5a50-a9a3-5035574efa54/23414e8d-2f88-5a50-a9a3-5035574efa54_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_9b6a27db543a6d63c8659ecee41b24eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23414e8d-2f88-5a50-a9a3-5035574efa54/23414e8d-2f88-5a50-a9a3-5035574efa54_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/07/dd070b339d92748978ef277faf400bd3/pa/TX89120_9bb316483b195268d569a872c58943f6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-10-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten lang',
 'transmission': 'manual',
 'trim': 'Kasten lang',
 'year': 2012}
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX89120%27 HTTP/1.1" 200 None
2026-03-27 10:40:13 [auto1.de] INFO: Saving data for TX89120: {'created_time': 1774608013.189323, 'last_price_update_time': 1774608013.189336, 'auction_closing_time': 1774714758.0}
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX89120') HTTP/1.1" 204 0
2026-03-27 10:40:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/8e/9e8e8c4ea216decd0bcdd380b32fad5f/pa/BD51611_4eef76142d72f57679cd083208a68d4e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:13 [auto1.de] INFO: Found listing with ID: KU06936
2026-03-27 10:40:13 [auto1.de] INFO: Found listing with ID: KJ86247
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ86247%27 HTTP/1.1" 200 None
2026-03-27 10:40:13 [auto1.de] INFO: Scrape type for KJ86247: 2
2026-03-27 10:40:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ba46270-addc-54d3-b949-b4eb8697481d with identifier: KJ86247
2026-03-27 10:40:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ba46270-addc-54d3-b949-b4eb8697481d with scrape type 2
2026-03-27 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ba46270-addc-54d3-b949-b4eb8697481d with scrape type 2
2026-03-27 10:40:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ba46270-addc-54d3-b949-b4eb8697481d, identifier: KJ86247
2026-03-27 10:40:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ba46270-addc-54d3-b949-b4eb8697481d with identifier: KJ86247
2026-03-27 10:40:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ba46270-addc-54d3-b949-b4eb8697481d with identifier: KJ86247
2026-03-27 10:40:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ba46270-addc-54d3-b949-b4eb8697481d with identifier: KJ86247 to the API
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 50,
 'expiration_date': '2026-03-28T16:58:58Z',
 'fuel_type': 'petrol',
 'id': '5ba46270-addc-54d3-b949-b4eb8697481d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ86247',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Lupo',
 'odometer': 87412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-09-30',
 'seller_name': None,
 'title': 'Volkswagen Lupo 1.0 Oxford',
 'transmission': 'manual',
 'trim': 'Oxford',
 'year': 2002}
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ86247%27 HTTP/1.1" 200 None
2026-03-27 10:40:13 [auto1.de] INFO: Saving data for KJ86247: {'auction_closing_time': 1774717138.0, 'created_time': 1774118969.730182, 'last_price_update_time': 1774608013.704188}
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ86247') HTTP/1.1" 204 0
2026-03-27 10:40:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a1c650>
2026-03-27 10:40:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e46331e9-982e-5737-98ed-b7250cfd202d/e46331e9-982e-5737-98ed-b7250cfd202d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F8e%252Ff08e47f50490b2754bee2267c9efd649%252Fpa%252FXH92207_292016ca83ed6abbb44f96bb20fae6da.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_292016ca83ed6abbb44f96bb20fae6da.jpg saved to cache
2026-03-27 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e46331e9-982e-5737-98ed-b7250cfd202d
2026-03-27 10:40:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e46331e9-982e-5737-98ed-b7250cfd202d, skipping ID generation
2026-03-27 10:40:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e46331e9-982e-5737-98ed-b7250cfd202d with scrape type 1
2026-03-27 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e46331e9-982e-5737-98ed-b7250cfd202d sending to next pipeline
2026-03-27 10:40:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e46331e9-982e-5737-98ed-b7250cfd202d, identifier: XH92207
2026-03-27 10:40:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016d3bd0>
2026-03-27 10:40:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6394e207-b268-51c9-b24f-7418e5b80f7c/6394e207-b268-51c9-b24f-7418e5b80f7c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F8e%252F9e8e8c4ea216decd0bcdd380b32fad5f%252Fpa%252FBD51611_2b05c555c0b985fdf7160e9befee0c60.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/8e/9e8e8c4ea216decd0bcdd380b32fad5f/pa/BD51611_2b05c555c0b985fdf7160e9befee0c60.jpg saved to cache
2026-03-27 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6394e207-b268-51c9-b24f-7418e5b80f7c
2026-03-27 10:40:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/8e/9e8e8c4ea216decd0bcdd380b32fad5f/pa/BD51611_195efd19fda0ff4eec00f16c1cadbcb0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:14 [auto1.de] INFO: Found listing with ID: PS47170
2026-03-27 10:40:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e46331e9-982e-5737-98ed-b7250cfd202d with identifier: XH92207
2026-03-27 10:40:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e46331e9-982e-5737-98ed-b7250cfd202d with identifier: XH92207
2026-03-27 10:40:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e46331e9-982e-5737-98ed-b7250cfd202d with identifier: XH92207 to the API
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_292016ca83ed6abbb44f96bb20fae6da.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:07:17Z',
 'fuel_type': 'petrol',
 'id': 'e46331e9-982e-5737-98ed-b7250cfd202d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH92207',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 169795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e46331e9-982e-5737-98ed-b7250cfd202d/e46331e9-982e-5737-98ed-b7250cfd202d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_88776d8fc94f6198d43f36f83a84b070.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e46331e9-982e-5737-98ed-b7250cfd202d/e46331e9-982e-5737-98ed-b7250cfd202d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_303285cb11d8116a5e13265befe74b7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e46331e9-982e-5737-98ed-b7250cfd202d/e46331e9-982e-5737-98ed-b7250cfd202d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_292016ca83ed6abbb44f96bb20fae6da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e46331e9-982e-5737-98ed-b7250cfd202d/e46331e9-982e-5737-98ed-b7250cfd202d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_2728a41b202affbdaa56ea0bde54c2b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e46331e9-982e-5737-98ed-b7250cfd202d/e46331e9-982e-5737-98ed-b7250cfd202d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_97a001c1826c6cdbbebbf5cb59cd0445.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e46331e9-982e-5737-98ed-b7250cfd202d/e46331e9-982e-5737-98ed-b7250cfd202d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_1f03a5e1dfb21980a5fe69905aac4b4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e46331e9-982e-5737-98ed-b7250cfd202d/e46331e9-982e-5737-98ed-b7250cfd202d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_3046abb8815524d8091c858215d91f94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e46331e9-982e-5737-98ed-b7250cfd202d/e46331e9-982e-5737-98ed-b7250cfd202d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_dde36f4c9d468dc537e8482d6e90e832.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e46331e9-982e-5737-98ed-b7250cfd202d/e46331e9-982e-5737-98ed-b7250cfd202d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_706bce3c03fe5122ac7ff4d57c638a00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e46331e9-982e-5737-98ed-b7250cfd202d/e46331e9-982e-5737-98ed-b7250cfd202d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/8e/f08e47f50490b2754bee2267c9efd649/pa/XH92207_467a4b932f0a731dcc6e03b10913bc5e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-05-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 150',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH92207%27 HTTP/1.1" 200 None
2026-03-27 10:40:14 [auto1.de] INFO: Saving data for XH92207: {'created_time': 1774608014.371783, 'last_price_update_time': 1774608014.371794, 'auction_closing_time': 1774714037.0}
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH92207') HTTP/1.1" 204 0
2026-03-27 10:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_f71ddeddc458797496a0a2f9b9f75704.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5036dced0>
2026-03-27 10:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f983f4c-065d-5952-8729-e67adaf03168/2f983f4c-065d-5952-8729-e67adaf03168_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fb0%252Fdcb046424e75210961891109ff28a927%252Fpa%252FTT34897_cca1d44570218ac703bfed9bccdb03eb.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_cca1d44570218ac703bfed9bccdb03eb.jpg saved to cache
2026-03-27 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f983f4c-065d-5952-8729-e67adaf03168
2026-03-27 10:40:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f983f4c-065d-5952-8729-e67adaf03168, skipping ID generation
2026-03-27 10:40:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f983f4c-065d-5952-8729-e67adaf03168 with scrape type 1
2026-03-27 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f983f4c-065d-5952-8729-e67adaf03168 sending to next pipeline
2026-03-27 10:40:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f983f4c-065d-5952-8729-e67adaf03168, identifier: TT34897
2026-03-27 10:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500563c50>
2026-03-27 10:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6394e207-b268-51c9-b24f-7418e5b80f7c/6394e207-b268-51c9-b24f-7418e5b80f7c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F8e%252F9e8e8c4ea216decd0bcdd380b32fad5f%252Fpa%252FBD51611_4eef76142d72f57679cd083208a68d4e.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/8e/9e8e8c4ea216decd0bcdd380b32fad5f/pa/BD51611_4eef76142d72f57679cd083208a68d4e.jpg saved to cache
2026-03-27 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6394e207-b268-51c9-b24f-7418e5b80f7c
2026-03-27 10:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_ad9f9f3a174746a5d419f83e39e521ef.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f983f4c-065d-5952-8729-e67adaf03168 with identifier: TT34897
2026-03-27 10:40:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f983f4c-065d-5952-8729-e67adaf03168 with identifier: TT34897
2026-03-27 10:40:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f983f4c-065d-5952-8729-e67adaf03168 with identifier: TT34897 to the API
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_cca1d44570218ac703bfed9bccdb03eb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 194,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2026-03-28T16:01:03Z',
 'fuel_type': 'petrol',
 'id': '2f983f4c-065d-5952-8729-e67adaf03168',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT34897',
 'listing': 'auction',
 'location': 'DE, Hannover',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 134826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f983f4c-065d-5952-8729-e67adaf03168/2f983f4c-065d-5952-8729-e67adaf03168_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_cca1d44570218ac703bfed9bccdb03eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f983f4c-065d-5952-8729-e67adaf03168/2f983f4c-065d-5952-8729-e67adaf03168_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_6658e7724dd5d5b317e9e84c98402e24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f983f4c-065d-5952-8729-e67adaf03168/2f983f4c-065d-5952-8729-e67adaf03168_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_6aa64bbba3af5e10e1874959f32f0b9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f983f4c-065d-5952-8729-e67adaf03168/2f983f4c-065d-5952-8729-e67adaf03168_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2934203,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_2c519e0c237452b96277ad088cf9c191.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f983f4c-065d-5952-8729-e67adaf03168/2f983f4c-065d-5952-8729-e67adaf03168_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3084274,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_bf6b6e1db813ef94093f5f3772fa114e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f983f4c-065d-5952-8729-e67adaf03168/2f983f4c-065d-5952-8729-e67adaf03168_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3068834,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_beee140679e287222b3ce4c203ded3f8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f983f4c-065d-5952-8729-e67adaf03168/2f983f4c-065d-5952-8729-e67adaf03168_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3113501,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_bf580ffae331c583b7f46e42d043c7b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f983f4c-065d-5952-8729-e67adaf03168/2f983f4c-065d-5952-8729-e67adaf03168_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_87ed860da320fb81d74bd26aa05720a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f983f4c-065d-5952-8729-e67adaf03168/2f983f4c-065d-5952-8729-e67adaf03168_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_e63a531cfdf6d46dfa64ba12ac52f1fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f983f4c-065d-5952-8729-e67adaf03168/2f983f4c-065d-5952-8729-e67adaf03168_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/b0/dcb046424e75210961891109ff28a927/pa/TT34897_757468e3bf97b58974b24554394173c7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford S-Max 2.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2011}
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT34897%27 HTTP/1.1" 200 None
2026-03-27 10:40:15 [auto1.de] INFO: Saving data for TT34897: {'created_time': 1774608015.045552, 'last_price_update_time': 1774608015.045563, 'auction_closing_time': 1774713663.0}
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT34897') HTTP/1.1" 204 0
2026-03-27 10:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_b3925d1703cbf1b2368820c8717bb9c0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU59623> (referer: https://www.auto1.com/v1/car-details-view/RU59623/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500396510>
2026-03-27 10:40:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6394e207-b268-51c9-b24f-7418e5b80f7c/6394e207-b268-51c9-b24f-7418e5b80f7c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F8e%252F9e8e8c4ea216decd0bcdd380b32fad5f%252Fpa%252FBD51611_195efd19fda0ff4eec00f16c1cadbcb0.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/8e/9e8e8c4ea216decd0bcdd380b32fad5f/pa/BD51611_195efd19fda0ff4eec00f16c1cadbcb0.jpg saved to cache
2026-03-27 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6394e207-b268-51c9-b24f-7418e5b80f7c
2026-03-27 10:40:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6394e207-b268-51c9-b24f-7418e5b80f7c, skipping ID generation
2026-03-27 10:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6394e207-b268-51c9-b24f-7418e5b80f7c with scrape type 1
2026-03-27 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6394e207-b268-51c9-b24f-7418e5b80f7c sending to next pipeline
2026-03-27 10:40:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6394e207-b268-51c9-b24f-7418e5b80f7c, identifier: BD51611
2026-03-27 10:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_6b683a3aaa73c1d458c00ac5cf553447.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6394e207-b268-51c9-b24f-7418e5b80f7c with identifier: BD51611
2026-03-27 10:40:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6394e207-b268-51c9-b24f-7418e5b80f7c with identifier: BD51611
2026-03-27 10:40:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6394e207-b268-51c9-b24f-7418e5b80f7c with identifier: BD51611 to the API
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9e/8e/9e8e8c4ea216decd0bcdd380b32fad5f/pa/BD51611_195efd19fda0ff4eec00f16c1cadbcb0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:51:24Z',
 'fuel_type': 'petrol',
 'id': '6394e207-b268-51c9-b24f-7418e5b80f7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD51611',
 'listing': 'auction',
 'location': 'DE, Düsseldorf',
 'make': 'Ford',
 'model': 'Fusion',
 'odometer': 147851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6394e207-b268-51c9-b24f-7418e5b80f7c/6394e207-b268-51c9-b24f-7418e5b80f7c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/8e/9e8e8c4ea216decd0bcdd380b32fad5f/pa/BD51611_195efd19fda0ff4eec00f16c1cadbcb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6394e207-b268-51c9-b24f-7418e5b80f7c/6394e207-b268-51c9-b24f-7418e5b80f7c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/8e/9e8e8c4ea216decd0bcdd380b32fad5f/pa/BD51611_4eef76142d72f57679cd083208a68d4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6394e207-b268-51c9-b24f-7418e5b80f7c/6394e207-b268-51c9-b24f-7418e5b80f7c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/8e/9e8e8c4ea216decd0bcdd380b32fad5f/pa/BD51611_2b05c555c0b985fdf7160e9befee0c60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6394e207-b268-51c9-b24f-7418e5b80f7c/6394e207-b268-51c9-b24f-7418e5b80f7c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/8e/9e8e8c4ea216decd0bcdd380b32fad5f/pa/BD51611_30f944500381ece0a867b899c18ab180.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6394e207-b268-51c9-b24f-7418e5b80f7c/6394e207-b268-51c9-b24f-7418e5b80f7c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/8e/9e8e8c4ea216decd0bcdd380b32fad5f/pa/BD51611_b8bb867ae9a80504489c31e4f2a9577c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fusion 1.25 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2005}
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD51611%27 HTTP/1.1" 200 None
2026-03-27 10:40:15 [auto1.de] INFO: Saving data for BD51611: {'created_time': 1774608015.602678, 'last_price_update_time': 1774608015.60269, 'auction_closing_time': 1774716684.0}
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD51611') HTTP/1.1" 204 0
2026-03-27 10:40:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:40:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50373f8d0>
2026-03-27 10:40:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43149b24-5c84-5b00-830f-49bd6b2c7f0d/43149b24-5c84-5b00-830f-49bd6b2c7f0d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbe%252F68be70296381a043efabdc0e0b0c4024%252Fpa%252FCH55650_f71ddeddc458797496a0a2f9b9f75704.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_f71ddeddc458797496a0a2f9b9f75704.jpg saved to cache
2026-03-27 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43149b24-5c84-5b00-830f-49bd6b2c7f0d
2026-03-27 10:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_1b8f76e956e659dece52f965062ecadc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501660090>
2026-03-27 10:40:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7a9fb5c-4305-5cbe-a28b-6748434ca9a0/b7a9fb5c-4305-5cbe-a28b-6748434ca9a0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5a%252F6d5a210df96e90a3f270e4a9e210c39a%252Fpa%252FCE85756_ad9f9f3a174746a5d419f83e39e521ef.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_ad9f9f3a174746a5d419f83e39e521ef.jpg saved to cache
2026-03-27 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7a9fb5c-4305-5cbe-a28b-6748434ca9a0
2026-03-27 10:40:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7a9fb5c-4305-5cbe-a28b-6748434ca9a0, skipping ID generation
2026-03-27 10:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7a9fb5c-4305-5cbe-a28b-6748434ca9a0 with scrape type 1
2026-03-27 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7a9fb5c-4305-5cbe-a28b-6748434ca9a0 sending to next pipeline
2026-03-27 10:40:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7a9fb5c-4305-5cbe-a28b-6748434ca9a0, identifier: CE85756
2026-03-27 10:40:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500340f50>
2026-03-27 10:40:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb/8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe7%252F98e7f5092ab07315b151b21153586926%252Fpa%252FBK65604_b3925d1703cbf1b2368820c8717bb9c0.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_b3925d1703cbf1b2368820c8717bb9c0.jpg saved to cache
2026-03-27 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb
2026-03-27 10:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd8496aa-ce74-5fca-b528-3e32ab32a063 with identifier: RU59623
2026-03-27 10:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd8496aa-ce74-5fca-b528-3e32ab32a063 with scrape type 1
2026-03-27 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd8496aa-ce74-5fca-b528-3e32ab32a063
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F96%252Fb0962e4192393d84e9d793056f53a550%252Fpa%252FRU59623_9fb1a2392e30f07224d4755899fbea14.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_9fb1a2392e30f07224d4755899fbea14.jpg not downloaded yet
2026-03-27 10:40:15 [auto1.de] INFO: Channel: 24h | Page: 14 | totalHits: 10513 | hits on page: 40
2026-03-27 10:40:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-27 10:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_dd0da6970154a408f582d476bf22f563.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_330e322c409236ae4ec0e7fa1eab68dd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7a9fb5c-4305-5cbe-a28b-6748434ca9a0 with identifier: CE85756
2026-03-27 10:40:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7a9fb5c-4305-5cbe-a28b-6748434ca9a0 with identifier: CE85756
2026-03-27 10:40:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7a9fb5c-4305-5cbe-a28b-6748434ca9a0 with identifier: CE85756 to the API
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_ad9f9f3a174746a5d419f83e39e521ef.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:25:30Z',
 'fuel_type': 'petrol',
 'id': 'b7a9fb5c-4305-5cbe-a28b-6748434ca9a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE85756',
 'listing': 'auction',
 'location': 'DE, Kamen',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 28024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a9fb5c-4305-5cbe-a28b-6748434ca9a0/b7a9fb5c-4305-5cbe-a28b-6748434ca9a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3115678,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_71d132064d5b1a2b26ff64561d94adce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a9fb5c-4305-5cbe-a28b-6748434ca9a0/b7a9fb5c-4305-5cbe-a28b-6748434ca9a0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_ad9f9f3a174746a5d419f83e39e521ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a9fb5c-4305-5cbe-a28b-6748434ca9a0/b7a9fb5c-4305-5cbe-a28b-6748434ca9a0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_f5f7fa13ca6e52bedd65628ad26f113a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a9fb5c-4305-5cbe-a28b-6748434ca9a0/b7a9fb5c-4305-5cbe-a28b-6748434ca9a0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_1548c025732c9413e0518cc584c2d302.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a9fb5c-4305-5cbe-a28b-6748434ca9a0/b7a9fb5c-4305-5cbe-a28b-6748434ca9a0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3013349,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_932a749f6672b40cd497f21461207f33.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a9fb5c-4305-5cbe-a28b-6748434ca9a0/b7a9fb5c-4305-5cbe-a28b-6748434ca9a0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3160161,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_cedd157f9e7adf9b42dec4b516566fc3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a9fb5c-4305-5cbe-a28b-6748434ca9a0/b7a9fb5c-4305-5cbe-a28b-6748434ca9a0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3191471,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_443684f43e276516f14bb098ed197f5c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a9fb5c-4305-5cbe-a28b-6748434ca9a0/b7a9fb5c-4305-5cbe-a28b-6748434ca9a0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_019e3ab3d1284f8ce729f714eec6f911.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a9fb5c-4305-5cbe-a28b-6748434ca9a0/b7a9fb5c-4305-5cbe-a28b-6748434ca9a0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3064080,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_f2b417f7504c374fc4b31958bfa3376e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7a9fb5c-4305-5cbe-a28b-6748434ca9a0/b7a9fb5c-4305-5cbe-a28b-6748434ca9a0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/5a/6d5a210df96e90a3f270e4a9e210c39a/pa/CE85756_5b220f0949de54b9f517569eb3536edb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Go',
 'transmission': 'manual',
 'trim': 'Go',
 'year': 2017}
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE85756%27 HTTP/1.1" 200 None
2026-03-27 10:40:16 [auto1.de] INFO: Saving data for CE85756: {'created_time': 1774608016.406347, 'last_price_update_time': 1774608016.406358, 'auction_closing_time': 1774715130.0}
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE85756') HTTP/1.1" 204 0
2026-03-27 10:40:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F96%252Fb0962e4192393d84e9d793056f53a550%252Fpa%252FRU59623_d8b4e598127815c6b0d30b67f709d307.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_d8b4e598127815c6b0d30b67f709d307.jpg not downloaded yet
2026-03-27 10:40:16 [auto1.de] INFO: Found listing with ID: PS47170
2026-03-27 10:40:16 [auto1.de] INFO: Found listing with ID: KM87247
2026-03-27 10:40:16 [auto1.de] INFO: Found listing with ID: YK98725
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK98725%27 HTTP/1.1" 200 None
2026-03-27 10:40:16 [auto1.de] INFO: Scrape type for YK98725: 2
2026-03-27 10:40:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a0b6d57-d74a-52e1-8c56-947ccc99826a with identifier: YK98725
2026-03-27 10:40:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a0b6d57-d74a-52e1-8c56-947ccc99826a with scrape type 2
2026-03-27 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a0b6d57-d74a-52e1-8c56-947ccc99826a with scrape type 2
2026-03-27 10:40:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a0b6d57-d74a-52e1-8c56-947ccc99826a, identifier: YK98725
2026-03-27 10:40:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501761a50>
2026-03-27 10:40:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb/8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe7%252F98e7f5092ab07315b151b21153586926%252Fpa%252FBK65604_6b683a3aaa73c1d458c00ac5cf553447.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_6b683a3aaa73c1d458c00ac5cf553447.jpg saved to cache
2026-03-27 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb
2026-03-27 10:40:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_7f5e6327139594fb869c0467f4806d50.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a0b6d57-d74a-52e1-8c56-947ccc99826a with identifier: YK98725
2026-03-27 10:40:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a0b6d57-d74a-52e1-8c56-947ccc99826a with identifier: YK98725
2026-03-27 10:40:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a0b6d57-d74a-52e1-8c56-947ccc99826a with identifier: YK98725 to the API
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:51:21Z',
 'fuel_type': 'petrol',
 'id': '7a0b6d57-d74a-52e1-8c56-947ccc99826a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK98725',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 38839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-31',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK98725%27 HTTP/1.1" 200 None
2026-03-27 10:40:17 [auto1.de] INFO: Saving data for YK98725: {'auction_closing_time': 1774716681.0, 'created_time': 1773401270.60782, 'last_price_update_time': 1774608017.013226}
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK98725') HTTP/1.1" 204 0
2026-03-27 10:40:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-27 10:40:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500341c10>
2026-03-27 10:40:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb/8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fe7%252F98e7f5092ab07315b151b21153586926%252Fpa%252FBK65604_1b8f76e956e659dece52f965062ecadc.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_1b8f76e956e659dece52f965062ecadc.jpg saved to cache
2026-03-27 10:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb
2026-03-27 10:40:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb, skipping ID generation
2026-03-27 10:40:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb with scrape type 1
2026-03-27 10:40:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb sending to next pipeline
2026-03-27 10:40:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb, identifier: BK65604
2026-03-27 10:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_ae9317aed01291ae3d29a8d05073aaa1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F96%252Fb0962e4192393d84e9d793056f53a550%252Fpa%252FRU59623_8f15222f8078f817c188f39f8903760b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_8f15222f8078f817c188f39f8903760b.jpg not downloaded yet
2026-03-27 10:40:17 [auto1.de] INFO: Found listing with ID: NN29334
2026-03-27 10:40:17 [auto1.de] INFO: Found listing with ID: CU86908
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU86908%27 HTTP/1.1" 200 None
2026-03-27 10:40:17 [auto1.de] INFO: Scrape type for CU86908: 2
2026-03-27 10:40:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8 with identifier: CU86908
2026-03-27 10:40:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8 with scrape type 2
2026-03-27 10:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8 with scrape type 2
2026-03-27 10:40:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8, identifier: CU86908
2026-03-27 10:40:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb with identifier: BK65604
2026-03-27 10:40:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb with identifier: BK65604
2026-03-27 10:40:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb with identifier: BK65604 to the API
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_1b8f76e956e659dece52f965062ecadc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.7L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:05:05Z',
 'fuel_type': 'diesel',
 'id': '8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK65604',
 'listing': 'auction',
 'location': 'DE, Hof',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 166320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb/8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_1b8f76e956e659dece52f965062ecadc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb/8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_c2750503c47c2a0934029e0a1d9cf043.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb/8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_a0a60c53e9a73882e381ce48c14fe740.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb/8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_6b683a3aaa73c1d458c00ac5cf553447.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb/8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_b3925d1703cbf1b2368820c8717bb9c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb/8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/e7/98e7f5092ab07315b151b21153586926/pa/BK65604_896a5f57db530554d266dca5cefc7a3d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Opel Zafira 1.7 CDTI Family Plus',
 'transmission': 'manual',
 'trim': 'Family Plus',
 'year': 2012}
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK65604%27 HTTP/1.1" 200 None
2026-03-27 10:40:17 [auto1.de] INFO: Saving data for BK65604: {'created_time': 1774608017.737482, 'last_price_update_time': 1774608017.737492, 'auction_closing_time': 1774713905.0}
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK65604') HTTP/1.1" 204 0
2026-03-27 10:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_5688b90178ec52794058be6060b74dae.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_0260bf8d0a70ba8045e14c614aa970f5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8 with identifier: CU86908
2026-03-27 10:40:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8 with identifier: CU86908
2026-03-27 10:40:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8 with identifier: CU86908 to the API
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:58:01Z',
 'fuel_type': 'diesel',
 'id': 'b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU86908',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 219979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-29',
 'seller_name': None,
 'title': 'Hyundai i40 1.7 CRDi Trend Blue',
 'transmission': 'automatic',
 'trim': 'Trend Blue',
 'year': 2016}
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU86908%27 HTTP/1.1" 200 None
2026-03-27 10:40:18 [auto1.de] INFO: Saving data for CU86908: {'auction_closing_time': 1774717081.0, 'created_time': 1773689314.152203, 'last_price_update_time': 1774608018.112942}
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU86908') HTTP/1.1" 204 0
2026-03-27 10:40:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500572750>
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d/dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fbf%252Fafbf80b7fba179f77e1fc6909d1a3d16%252Fpa%252FGE16553_dd0da6970154a408f582d476bf22f563.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_dd0da6970154a408f582d476bf22f563.jpg saved to cache
2026-03-27 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501683910>
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d/dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fbf%252Fafbf80b7fba179f77e1fc6909d1a3d16%252Fpa%252FGE16553_330e322c409236ae4ec0e7fa1eab68dd.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_330e322c409236ae4ec0e7fa1eab68dd.jpg saved to cache
2026-03-27 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F96%252Fb0962e4192393d84e9d793056f53a550%252Fpa%252FRU59623_b58fbd4d7533f63a8df038cf9a0191f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_b58fbd4d7533f63a8df038cf9a0191f3.jpg not downloaded yet
2026-03-27 10:40:18 [auto1.de] INFO: Found listing with ID: DF96715
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF96715%27 HTTP/1.1" 200 None
2026-03-27 10:40:18 [auto1.de] INFO: Scrape type for DF96715: 2
2026-03-27 10:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7742fa76-9cc1-5d9f-b388-0277a7f4e6e8 with identifier: DF96715
2026-03-27 10:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7742fa76-9cc1-5d9f-b388-0277a7f4e6e8 with scrape type 2
2026-03-27 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7742fa76-9cc1-5d9f-b388-0277a7f4e6e8 with scrape type 2
2026-03-27 10:40:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7742fa76-9cc1-5d9f-b388-0277a7f4e6e8, identifier: DF96715
2026-03-27 10:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_e0a484705e74f9e58a9d90f37dd31024.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7742fa76-9cc1-5d9f-b388-0277a7f4e6e8 with identifier: DF96715
2026-03-27 10:40:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7742fa76-9cc1-5d9f-b388-0277a7f4e6e8 with identifier: DF96715
2026-03-27 10:40:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7742fa76-9cc1-5d9f-b388-0277a7f4e6e8 with identifier: DF96715 to the API
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:44:32Z',
 'fuel_type': 'petrol',
 'id': '7742fa76-9cc1-5d9f-b388-0277a7f4e6e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF96715',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 77424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seller_name': None,
 'title': 'Seat Tarraco 2.0 TSI FR 4Drive',
 'transmission': 'automatic',
 'trim': 'FR 4Drive',
 'year': 2021}
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF96715%27 HTTP/1.1" 200 None
2026-03-27 10:40:18 [auto1.de] INFO: Saving data for DF96715: {'auction_closing_time': 1774716272.0, 'created_time': 1774293551.8757, 'last_price_update_time': 1774608018.67626}
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF96715') HTTP/1.1" 204 0
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F96%252Fb0962e4192393d84e9d793056f53a550%252Fpa%252FRU59623_a1880c3eb2371ddbd5f40f91238b9e54.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_a1880c3eb2371ddbd5f40f91238b9e54.jpg not downloaded yet
2026-03-27 10:40:18 [auto1.de] INFO: Found listing with ID: EV39961
2026-03-27 10:40:18 [auto1.de] INFO: Found listing with ID: SR51449
2026-03-27 10:40:18 [auto1.de] INFO: Found listing with ID: DT77440
2026-03-27 10:40:18 [auto1.de] INFO: Found listing with ID: WY91699
2026-03-27 10:40:18 [auto1.de] INFO: Found listing with ID: DM70862
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70862%27 HTTP/1.1" 200 None
2026-03-27 10:40:18 [auto1.de] INFO: Scrape type for DM70862: 2
2026-03-27 10:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d5fed20-9456-582a-948a-5c9ca0672fbd with identifier: DM70862
2026-03-27 10:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d5fed20-9456-582a-948a-5c9ca0672fbd with scrape type 2
2026-03-27 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d5fed20-9456-582a-948a-5c9ca0672fbd with scrape type 2
2026-03-27 10:40:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d5fed20-9456-582a-948a-5c9ca0672fbd, identifier: DM70862
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004c43d0>
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d/dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fbf%252Fafbf80b7fba179f77e1fc6909d1a3d16%252Fpa%252FGE16553_7f5e6327139594fb869c0467f4806d50.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_7f5e6327139594fb869c0467f4806d50.jpg saved to cache
2026-03-27 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50199a490>
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d/dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fbf%252Fafbf80b7fba179f77e1fc6909d1a3d16%252Fpa%252FGE16553_ae9317aed01291ae3d29a8d05073aaa1.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_ae9317aed01291ae3d29a8d05073aaa1.jpg saved to cache
2026-03-27 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501769a10>
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d/dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fbf%252Fafbf80b7fba179f77e1fc6909d1a3d16%252Fpa%252FGE16553_5688b90178ec52794058be6060b74dae.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_5688b90178ec52794058be6060b74dae.jpg saved to cache
2026-03-27 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016fcb90>
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d/dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fbf%252Fafbf80b7fba179f77e1fc6909d1a3d16%252Fpa%252FGE16553_0260bf8d0a70ba8045e14c614aa970f5.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_0260bf8d0a70ba8045e14c614aa970f5.jpg saved to cache
2026-03-27 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d
2026-03-27 10:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_3b0f8e25e4e2620c2b4ed5e336bd3ee9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_da232ff4ad4645628fe4b5e7867f5e73.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d5fed20-9456-582a-948a-5c9ca0672fbd with identifier: DM70862
2026-03-27 10:40:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d5fed20-9456-582a-948a-5c9ca0672fbd with identifier: DM70862
2026-03-27 10:40:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d5fed20-9456-582a-948a-5c9ca0672fbd with identifier: DM70862 to the API
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:39:39Z',
 'fuel_type': 'diesel',
 'id': '5d5fed20-9456-582a-948a-5c9ca0672fbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM70862',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 22332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-30',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d Mild-Hybrid 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': '4Matic Avantgarde',
 'year': 2023}
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70862%27 HTTP/1.1" 200 None
2026-03-27 10:40:19 [auto1.de] INFO: Saving data for DM70862: {'auction_closing_time': 1774715979.0, 'created_time': 1773861787.746374, 'last_price_update_time': 1774608019.553202}
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM70862') HTTP/1.1" 204 0
2026-03-27 10:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_d8b4e598127815c6b0d30b67f709d307.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F96%252Fb0962e4192393d84e9d793056f53a550%252Fpa%252FRU59623_68f93287dc0e142bcd7867288f7f5da8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_68f93287dc0e142bcd7867288f7f5da8.jpg not downloaded yet
2026-03-27 10:40:19 [auto1.de] INFO: Found listing with ID: RU29030
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU29030%27 HTTP/1.1" 200 None
2026-03-27 10:40:19 [auto1.de] INFO: Scrape type for RU29030: 2
2026-03-27 10:40:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa7dd30f-fe61-5917-8a71-83b37c2f8e07 with identifier: RU29030
2026-03-27 10:40:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa7dd30f-fe61-5917-8a71-83b37c2f8e07 with scrape type 2
2026-03-27 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa7dd30f-fe61-5917-8a71-83b37c2f8e07 with scrape type 2
2026-03-27 10:40:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa7dd30f-fe61-5917-8a71-83b37c2f8e07, identifier: RU29030
2026-03-27 10:40:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501711b50>
2026-03-27 10:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d/dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fbf%252Fafbf80b7fba179f77e1fc6909d1a3d16%252Fpa%252FGE16553_e0a484705e74f9e58a9d90f37dd31024.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_e0a484705e74f9e58a9d90f37dd31024.jpg saved to cache
2026-03-27 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d
2026-03-27 10:40:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa7dd30f-fe61-5917-8a71-83b37c2f8e07 with identifier: RU29030
2026-03-27 10:40:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa7dd30f-fe61-5917-8a71-83b37c2f8e07 with identifier: RU29030
2026-03-27 10:40:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa7dd30f-fe61-5917-8a71-83b37c2f8e07 with identifier: RU29030 to the API
2026-03-27 10:40:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:57:05Z',
 'fuel_type': 'diesel',
 'id': 'fa7dd30f-fe61-5917-8a71-83b37c2f8e07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU29030',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 69046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-24',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Move',
 'transmission': 'automatic',
 'trim': 'Move',
 'year': 2021}
2026-03-27 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU29030%27 HTTP/1.1" 200 None
2026-03-27 10:40:20 [auto1.de] INFO: Saving data for RU29030: {'auction_closing_time': 1774717025.0, 'created_time': 1773381073.093071, 'last_price_update_time': 1774608020.488723}
2026-03-27 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU29030') HTTP/1.1" 204 0
2026-03-27 10:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_9fb1a2392e30f07224d4755899fbea14.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F96%252Fb0962e4192393d84e9d793056f53a550%252Fpa%252FRU59623_4beec568a2d1ea9acc1de270c200dba3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_4beec568a2d1ea9acc1de270c200dba3.jpg not downloaded yet
2026-03-27 10:40:20 [auto1.de] INFO: Found listing with ID: KW79987
2026-03-27 10:40:20 [auto1.de] INFO: Found listing with ID: MD24708
2026-03-27 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD24708%27 HTTP/1.1" 200 None
2026-03-27 10:40:20 [auto1.de] INFO: Scrape type for MD24708: 2
2026-03-27 10:40:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e52f448-d37d-5714-9374-c06bbaa8e935 with identifier: MD24708
2026-03-27 10:40:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e52f448-d37d-5714-9374-c06bbaa8e935 with scrape type 2
2026-03-27 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e52f448-d37d-5714-9374-c06bbaa8e935 with scrape type 2
2026-03-27 10:40:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e52f448-d37d-5714-9374-c06bbaa8e935, identifier: MD24708
2026-03-27 10:40:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e52f448-d37d-5714-9374-c06bbaa8e935 with identifier: MD24708
2026-03-27 10:40:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e52f448-d37d-5714-9374-c06bbaa8e935 with identifier: MD24708
2026-03-27 10:40:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e52f448-d37d-5714-9374-c06bbaa8e935 with identifier: MD24708 to the API
2026-03-27 10:40:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:23:29Z',
 'fuel_type': 'diesel',
 'id': '3e52f448-d37d-5714-9374-c06bbaa8e935',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD24708',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 167802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-09',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2014}
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD24708%27 HTTP/1.1" 200 None
2026-03-27 10:40:21 [auto1.de] INFO: Saving data for MD24708: {'auction_closing_time': 1774715009.0, 'created_time': 1773775402.212362, 'last_price_update_time': 1774608021.253021}
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD24708') HTTP/1.1" 204 0
2026-03-27 10:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500351c10>
2026-03-27 10:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d/dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fbf%252Fafbf80b7fba179f77e1fc6909d1a3d16%252Fpa%252FGE16553_3b0f8e25e4e2620c2b4ed5e336bd3ee9.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_3b0f8e25e4e2620c2b4ed5e336bd3ee9.jpg saved to cache
2026-03-27 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d
2026-03-27 10:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d7390>
2026-03-27 10:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d/dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fbf%252Fafbf80b7fba179f77e1fc6909d1a3d16%252Fpa%252FGE16553_da232ff4ad4645628fe4b5e7867f5e73.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_da232ff4ad4645628fe4b5e7867f5e73.jpg saved to cache
2026-03-27 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d
2026-03-27 10:40:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d, skipping ID generation
2026-03-27 10:40:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d with scrape type 1
2026-03-27 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d sending to next pipeline
2026-03-27 10:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d, identifier: GE16553
2026-03-27 10:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500572f90>
2026-03-27 10:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd8496aa-ce74-5fca-b528-3e32ab32a063/fd8496aa-ce74-5fca-b528-3e32ab32a063_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F96%252Fb0962e4192393d84e9d793056f53a550%252Fpa%252FRU59623_d8b4e598127815c6b0d30b67f709d307.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_d8b4e598127815c6b0d30b67f709d307.jpg saved to cache
2026-03-27 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd8496aa-ce74-5fca-b528-3e32ab32a063
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F96%252Fb0962e4192393d84e9d793056f53a550%252Fpa%252FRU59623_a5e3b91a00676341d286cbab581c278e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_a5e3b91a00676341d286cbab581c278e.jpg not downloaded yet
2026-03-27 10:40:21 [auto1.de] INFO: Found listing with ID: YU96411
2026-03-27 10:40:21 [auto1.de] INFO: Found listing with ID: AD28287
2026-03-27 10:40:21 [auto1.de] INFO: Found listing with ID: MJ60689
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ60689%27 HTTP/1.1" 200 None
2026-03-27 10:40:21 [auto1.de] INFO: Scrape type for MJ60689: 2
2026-03-27 10:40:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2118a9bc-558a-520a-a7f0-d34c6377ae8c with identifier: MJ60689
2026-03-27 10:40:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2118a9bc-558a-520a-a7f0-d34c6377ae8c with scrape type 2
2026-03-27 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2118a9bc-558a-520a-a7f0-d34c6377ae8c with scrape type 2
2026-03-27 10:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2118a9bc-558a-520a-a7f0-d34c6377ae8c, identifier: MJ60689
2026-03-27 10:40:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d with identifier: GE16553
2026-03-27 10:40:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d with identifier: GE16553
2026-03-27 10:40:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d with identifier: GE16553 to the API
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_da232ff4ad4645628fe4b5e7867f5e73.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 236,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:47:28Z',
 'fuel_type': 'diesel',
 'id': 'dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE16553',
 'listing': 'auction',
 'location': 'DE, Darmstadt',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 103087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d/dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_da232ff4ad4645628fe4b5e7867f5e73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d/dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_3b0f8e25e4e2620c2b4ed5e336bd3ee9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d/dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_e0a484705e74f9e58a9d90f37dd31024.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d/dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_0260bf8d0a70ba8045e14c614aa970f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d/dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_5688b90178ec52794058be6060b74dae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d/dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_ae9317aed01291ae3d29a8d05073aaa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d/dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_7f5e6327139594fb869c0467f4806d50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d/dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_330e322c409236ae4ec0e7fa1eab68dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d/dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_dd0da6970154a408f582d476bf22f563.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d/dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/bf/afbf80b7fba179f77e1fc6909d1a3d16/pa/GE16553_81023d0b02478b1e7dd390dc2f5d3940.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-17',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 310 L1 Sport',
 'transmission': 'automatic',
 'trim': '310 L1 Sport',
 'year': 2019}
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16553%27 HTTP/1.1" 200 None
2026-03-27 10:40:22 [auto1.de] INFO: Saving data for GE16553: {'created_time': 1774608022.077746, 'last_price_update_time': 1774608022.077757, 'auction_closing_time': 1774716448.0}
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE16553') HTTP/1.1" 204 0
2026-03-27 10:40:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2118a9bc-558a-520a-a7f0-d34c6377ae8c with identifier: MJ60689
2026-03-27 10:40:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2118a9bc-558a-520a-a7f0-d34c6377ae8c with identifier: MJ60689
2026-03-27 10:40:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2118a9bc-558a-520a-a7f0-d34c6377ae8c with identifier: MJ60689 to the API
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:50:13Z',
 'fuel_type': 'diesel',
 'id': '2118a9bc-558a-520a-a7f0-d34c6377ae8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ60689',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 214351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-09',
 'seller_name': None,
 'title': 'BMW X5 xDrive 40d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ60689%27 HTTP/1.1" 200 None
2026-03-27 10:40:22 [auto1.de] INFO: Saving data for MJ60689: {'auction_closing_time': 1774716613.0, 'created_time': 1773830340.42552, 'last_price_update_time': 1774608022.452929}
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ60689') HTTP/1.1" 204 0
2026-03-27 10:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_a1880c3eb2371ddbd5f40f91238b9e54.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_8f15222f8078f817c188f39f8903760b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F96%252Fb0962e4192393d84e9d793056f53a550%252Fpa%252FRU59623_3535111604e1f08e6bcd971003ff14ad.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_3535111604e1f08e6bcd971003ff14ad.jpg not downloaded yet
2026-03-27 10:40:22 [auto1.de] INFO: Found listing with ID: YF55621
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF55621%27 HTTP/1.1" 200 None
2026-03-27 10:40:22 [auto1.de] INFO: Scrape type for YF55621: 2
2026-03-27 10:40:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d21c6585-5bb0-5522-8d5c-8a39cd5aa874 with identifier: YF55621
2026-03-27 10:40:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d21c6585-5bb0-5522-8d5c-8a39cd5aa874 with scrape type 2
2026-03-27 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d21c6585-5bb0-5522-8d5c-8a39cd5aa874 with scrape type 2
2026-03-27 10:40:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d21c6585-5bb0-5522-8d5c-8a39cd5aa874, identifier: YF55621
2026-03-27 10:40:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501769b90>
2026-03-27 10:40:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd8496aa-ce74-5fca-b528-3e32ab32a063/fd8496aa-ce74-5fca-b528-3e32ab32a063_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F96%252Fb0962e4192393d84e9d793056f53a550%252Fpa%252FRU59623_9fb1a2392e30f07224d4755899fbea14.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_9fb1a2392e30f07224d4755899fbea14.jpg saved to cache
2026-03-27 10:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd8496aa-ce74-5fca-b528-3e32ab32a063
2026-03-27 10:40:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d21c6585-5bb0-5522-8d5c-8a39cd5aa874 with identifier: YF55621
2026-03-27 10:40:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d21c6585-5bb0-5522-8d5c-8a39cd5aa874 with identifier: YF55621
2026-03-27 10:40:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d21c6585-5bb0-5522-8d5c-8a39cd5aa874 with identifier: YF55621 to the API
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:13:17Z',
 'fuel_type': 'diesel',
 'id': 'd21c6585-5bb0-5522-8d5c-8a39cd5aa874',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF55621',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 119211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-28',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2014}
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF55621%27 HTTP/1.1" 200 None
2026-03-27 10:40:23 [auto1.de] INFO: Saving data for YF55621: {'auction_closing_time': 1774714397.0, 'created_time': 1774294670.597503, 'last_price_update_time': 1774608023.104912}
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF55621') HTTP/1.1" 204 0
2026-03-27 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ87943/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_2a18f09611c10ea46594b914f7ad95cc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_68f93287dc0e142bcd7867288f7f5da8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F96%252Fb0962e4192393d84e9d793056f53a550%252Fpa%252FRU59623_7a93cdd858b0e85f6534958395f94457.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_7a93cdd858b0e85f6534958395f94457.jpg not downloaded yet
2026-03-27 10:40:23 [auto1.de] INFO: Found listing with ID: ZZ43768
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ43768%27 HTTP/1.1" 200 None
2026-03-27 10:40:23 [auto1.de] INFO: Scrape type for ZZ43768: 2
2026-03-27 10:40:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c2be28d-d61f-58a1-8f16-7034c7136e3d with identifier: ZZ43768
2026-03-27 10:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c2be28d-d61f-58a1-8f16-7034c7136e3d with scrape type 2
2026-03-27 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c2be28d-d61f-58a1-8f16-7034c7136e3d with scrape type 2
2026-03-27 10:40:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c2be28d-d61f-58a1-8f16-7034c7136e3d, identifier: ZZ43768
2026-03-27 10:40:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_e2c4a0bc900b043a1a93bf30d9c33c3c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c2be28d-d61f-58a1-8f16-7034c7136e3d with identifier: ZZ43768
2026-03-27 10:40:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c2be28d-d61f-58a1-8f16-7034c7136e3d with identifier: ZZ43768
2026-03-27 10:40:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c2be28d-d61f-58a1-8f16-7034c7136e3d with identifier: ZZ43768 to the API
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:39:16Z',
 'fuel_type': 'diesel',
 'id': '1c2be28d-d61f-58a1-8f16-7034c7136e3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ43768',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 245269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-30',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2014}
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ43768%27 HTTP/1.1" 200 None
2026-03-27 10:40:23 [auto1.de] INFO: Saving data for ZZ43768: {'auction_closing_time': 1774715956.0, 'created_time': 1773342872.518771, 'last_price_update_time': 1774608023.854907}
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ43768') HTTP/1.1" 204 0
2026-03-27 10:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016e6a50>
2026-03-27 10:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd8496aa-ce74-5fca-b528-3e32ab32a063/fd8496aa-ce74-5fca-b528-3e32ab32a063_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F96%252Fb0962e4192393d84e9d793056f53a550%252Fpa%252FRU59623_a1880c3eb2371ddbd5f40f91238b9e54.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_a1880c3eb2371ddbd5f40f91238b9e54.jpg saved to cache
2026-03-27 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd8496aa-ce74-5fca-b528-3e32ab32a063
2026-03-27 10:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002c9bd0>
2026-03-27 10:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd8496aa-ce74-5fca-b528-3e32ab32a063/fd8496aa-ce74-5fca-b528-3e32ab32a063_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F96%252Fb0962e4192393d84e9d793056f53a550%252Fpa%252FRU59623_8f15222f8078f817c188f39f8903760b.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_8f15222f8078f817c188f39f8903760b.jpg saved to cache
2026-03-27 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd8496aa-ce74-5fca-b528-3e32ab32a063
2026-03-27 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_7df0eb41f299158cb604aac237f86ae1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:23 [auto1.de] INFO: Found listing with ID: SB04104
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB04104%27 HTTP/1.1" 200 None
2026-03-27 10:40:23 [auto1.de] INFO: Scrape type for SB04104: 2
2026-03-27 10:40:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 810e3f38-3373-571a-ae95-ca7dda2783d0 with identifier: SB04104
2026-03-27 10:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 810e3f38-3373-571a-ae95-ca7dda2783d0 with scrape type 2
2026-03-27 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 810e3f38-3373-571a-ae95-ca7dda2783d0 with scrape type 2
2026-03-27 10:40:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 810e3f38-3373-571a-ae95-ca7dda2783d0, identifier: SB04104
2026-03-27 10:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UH98886/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 810e3f38-3373-571a-ae95-ca7dda2783d0 with identifier: SB04104
2026-03-27 10:40:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 810e3f38-3373-571a-ae95-ca7dda2783d0 with identifier: SB04104
2026-03-27 10:40:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 810e3f38-3373-571a-ae95-ca7dda2783d0 with identifier: SB04104 to the API
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:37:08Z',
 'fuel_type': 'diesel',
 'id': '810e3f38-3373-571a-ae95-ca7dda2783d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB04104',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 219697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-08',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB04104%27 HTTP/1.1" 200 None
2026-03-27 10:40:24 [auto1.de] INFO: Saving data for SB04104: {'auction_closing_time': 1774715828.0, 'created_time': 1773307850.246341, 'last_price_update_time': 1774608024.415478}
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB04104') HTTP/1.1" 204 0
2026-03-27 10:40:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:40:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004c5350>
2026-03-27 10:40:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43149b24-5c84-5b00-830f-49bd6b2c7f0d/43149b24-5c84-5b00-830f-49bd6b2c7f0d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbe%252F68be70296381a043efabdc0e0b0c4024%252Fpa%252FCH55650_2a18f09611c10ea46594b914f7ad95cc.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_2a18f09611c10ea46594b914f7ad95cc.jpg saved to cache
2026-03-27 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 43149b24-5c84-5b00-830f-49bd6b2c7f0d
2026-03-27 10:40:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015d9f90>
2026-03-27 10:40:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd8496aa-ce74-5fca-b528-3e32ab32a063/fd8496aa-ce74-5fca-b528-3e32ab32a063_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F96%252Fb0962e4192393d84e9d793056f53a550%252Fpa%252FRU59623_68f93287dc0e142bcd7867288f7f5da8.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_68f93287dc0e142bcd7867288f7f5da8.jpg saved to cache
2026-03-27 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd8496aa-ce74-5fca-b528-3e32ab32a063
2026-03-27 10:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_4beec568a2d1ea9acc1de270c200dba3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_a5e3b91a00676341d286cbab581c278e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:24 [auto1.de] INFO: Found listing with ID: HJ11294
2026-03-27 10:40:24 [auto1.de] INFO: Found listing with ID: LU16486
2026-03-27 10:40:24 [auto1.de] INFO: Found listing with ID: RJ71204
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ71204%27 HTTP/1.1" 200 None
2026-03-27 10:40:24 [auto1.de] INFO: Scrape type for RJ71204: 2
2026-03-27 10:40:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e95a1df0-e40c-50bd-9721-20cf7e298200 with identifier: RJ71204
2026-03-27 10:40:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e95a1df0-e40c-50bd-9721-20cf7e298200 with scrape type 2
2026-03-27 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e95a1df0-e40c-50bd-9721-20cf7e298200 with scrape type 2
2026-03-27 10:40:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e95a1df0-e40c-50bd-9721-20cf7e298200, identifier: RJ71204
2026-03-27 10:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA40469> (referer: https://www.auto1.com/v1/car-details-view/EA40469/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SP41921/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e95a1df0-e40c-50bd-9721-20cf7e298200 with identifier: RJ71204
2026-03-27 10:40:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e95a1df0-e40c-50bd-9721-20cf7e298200 with identifier: RJ71204
2026-03-27 10:40:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e95a1df0-e40c-50bd-9721-20cf7e298200 with identifier: RJ71204 to the API
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:33:00Z',
 'fuel_type': 'diesel',
 'id': 'e95a1df0-e40c-50bd-9721-20cf7e298200',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ71204',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 130501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-20',
 'seller_name': None,
 'title': 'Volvo V90 2.0 D4 R-Design',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2019}
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ71204%27 HTTP/1.1" 200 None
2026-03-27 10:40:25 [auto1.de] INFO: Saving data for RJ71204: {'auction_closing_time': 1774715580.0, 'created_time': 1774291517.558018, 'last_price_update_time': 1774608025.068768}
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ71204') HTTP/1.1" 204 0
2026-03-27 10:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:25 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.865(s), this was the 1st time calling it.
2026-03-27 10:40:25 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.170134993141342 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-27 10:40:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:40:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017ff4d0>
2026-03-27 10:40:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4cdf85-78e5-5e8b-acc4-acb367780537/3b4cdf85-78e5-5e8b-acc4-acb367780537_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F43%252F7e438750c458b90e705d99a15cd38473%252Fpa%252FEX22671_e2c4a0bc900b043a1a93bf30d9c33c3c.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_e2c4a0bc900b043a1a93bf30d9c33c3c.jpg saved to cache
2026-03-27 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b4cdf85-78e5-5e8b-acc4-acb367780537
2026-03-27 10:40:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:40:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50034b410>
2026-03-27 10:40:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43149b24-5c84-5b00-830f-49bd6b2c7f0d/43149b24-5c84-5b00-830f-49bd6b2c7f0d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fbe%252F68be70296381a043efabdc0e0b0c4024%252Fpa%252FCH55650_7df0eb41f299158cb604aac237f86ae1.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_7df0eb41f299158cb604aac237f86ae1.jpg saved to cache
2026-03-27 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 43149b24-5c84-5b00-830f-49bd6b2c7f0d
2026-03-27 10:40:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43149b24-5c84-5b00-830f-49bd6b2c7f0d, skipping ID generation
2026-03-27 10:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43149b24-5c84-5b00-830f-49bd6b2c7f0d with scrape type 1
2026-03-27 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43149b24-5c84-5b00-830f-49bd6b2c7f0d sending to next pipeline
2026-03-27 10:40:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43149b24-5c84-5b00-830f-49bd6b2c7f0d, identifier: CH55650
2026-03-27 10:40:25 [auto1.de] INFO: Found listing with ID: FN85650
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN85650%27 HTTP/1.1" 200 None
2026-03-27 10:40:25 [auto1.de] INFO: Scrape type for FN85650: 2
2026-03-27 10:40:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1c2e178-ce7f-5b09-8064-be885d0c3f8f with identifier: FN85650
2026-03-27 10:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1c2e178-ce7f-5b09-8064-be885d0c3f8f with scrape type 2
2026-03-27 10:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1c2e178-ce7f-5b09-8064-be885d0c3f8f with scrape type 2
2026-03-27 10:40:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1c2e178-ce7f-5b09-8064-be885d0c3f8f, identifier: FN85650
2026-03-27 10:40:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43149b24-5c84-5b00-830f-49bd6b2c7f0d with identifier: CH55650
2026-03-27 10:40:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43149b24-5c84-5b00-830f-49bd6b2c7f0d with identifier: CH55650
2026-03-27 10:40:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43149b24-5c84-5b00-830f-49bd6b2c7f0d with identifier: CH55650 to the API
2026-03-27 10:40:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_7df0eb41f299158cb604aac237f86ae1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:24:08Z',
 'fuel_type': 'petrol',
 'id': '43149b24-5c84-5b00-830f-49bd6b2c7f0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH55650',
 'listing': 'auction',
 'location': 'DE, Markkleeberg',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 129941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43149b24-5c84-5b00-830f-49bd6b2c7f0d/43149b24-5c84-5b00-830f-49bd6b2c7f0d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_d3adfc086863a2838d56b835e229c162.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43149b24-5c84-5b00-830f-49bd6b2c7f0d/43149b24-5c84-5b00-830f-49bd6b2c7f0d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_818a21d6365624be87c6ffc76526f2ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43149b24-5c84-5b00-830f-49bd6b2c7f0d/43149b24-5c84-5b00-830f-49bd6b2c7f0d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_395898acaba60e7fa75783bd496f92be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43149b24-5c84-5b00-830f-49bd6b2c7f0d/43149b24-5c84-5b00-830f-49bd6b2c7f0d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_d7585da52a61f88b494e867b2133f9be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43149b24-5c84-5b00-830f-49bd6b2c7f0d/43149b24-5c84-5b00-830f-49bd6b2c7f0d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3269022,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_f71ddeddc458797496a0a2f9b9f75704.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43149b24-5c84-5b00-830f-49bd6b2c7f0d/43149b24-5c84-5b00-830f-49bd6b2c7f0d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_f43d2f31255c8a27248e73b86105f113.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43149b24-5c84-5b00-830f-49bd6b2c7f0d/43149b24-5c84-5b00-830f-49bd6b2c7f0d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3360713,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_2a18f09611c10ea46594b914f7ad95cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43149b24-5c84-5b00-830f-49bd6b2c7f0d/43149b24-5c84-5b00-830f-49bd6b2c7f0d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_f92cb5ea05f2ca9646fc7a790b285499.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43149b24-5c84-5b00-830f-49bd6b2c7f0d/43149b24-5c84-5b00-830f-49bd6b2c7f0d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3729050,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_7df0eb41f299158cb604aac237f86ae1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43149b24-5c84-5b00-830f-49bd6b2c7f0d/43149b24-5c84-5b00-830f-49bd6b2c7f0d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/be/68be70296381a043efabdc0e0b0c4024/pa/CH55650_646877843af6e73f2ea93052b33614f6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2017}
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH55650%27 HTTP/1.1" 200 None
2026-03-27 10:40:26 [auto1.de] INFO: Saving data for CH55650: {'created_time': 1774608026.185795, 'last_price_update_time': 1774608026.185805, 'auction_closing_time': 1774715048.0}
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH55650') HTTP/1.1" 204 0
2026-03-27 10:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_d82dd615ae8a65838730a67a55cdaa59.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1c2e178-ce7f-5b09-8064-be885d0c3f8f with identifier: FN85650
2026-03-27 10:40:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1c2e178-ce7f-5b09-8064-be885d0c3f8f with identifier: FN85650
2026-03-27 10:40:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1c2e178-ce7f-5b09-8064-be885d0c3f8f with identifier: FN85650 to the API
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:57:16Z',
 'fuel_type': 'diesel',
 'id': 'c1c2e178-ce7f-5b09-8064-be885d0c3f8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN85650',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 254257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2009}
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN85650%27 HTTP/1.1" 200 None
2026-03-27 10:40:26 [auto1.de] INFO: Saving data for FN85650: {'auction_closing_time': 1774717036.0, 'created_time': 1773303224.078945, 'last_price_update_time': 1774608026.56311}
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN85650') HTTP/1.1" 204 0
2026-03-27 10:40:26 [auto1.de] INFO: Found listing with ID: UF88550
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF88550%27 HTTP/1.1" 200 None
2026-03-27 10:40:26 [auto1.de] INFO: Scrape type for UF88550: 2
2026-03-27 10:40:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afc428fd-cfba-5e75-b43c-c0704bde8799 with identifier: UF88550
2026-03-27 10:40:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afc428fd-cfba-5e75-b43c-c0704bde8799 with scrape type 2
2026-03-27 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afc428fd-cfba-5e75-b43c-c0704bde8799 with scrape type 2
2026-03-27 10:40:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afc428fd-cfba-5e75-b43c-c0704bde8799, identifier: UF88550
2026-03-27 10:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501891390>
2026-03-27 10:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd8496aa-ce74-5fca-b528-3e32ab32a063/fd8496aa-ce74-5fca-b528-3e32ab32a063_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F96%252Fb0962e4192393d84e9d793056f53a550%252Fpa%252FRU59623_4beec568a2d1ea9acc1de270c200dba3.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_4beec568a2d1ea9acc1de270c200dba3.jpg saved to cache
2026-03-27 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fd8496aa-ce74-5fca-b528-3e32ab32a063
2026-03-27 10:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016e5950>
2026-03-27 10:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd8496aa-ce74-5fca-b528-3e32ab32a063/fd8496aa-ce74-5fca-b528-3e32ab32a063_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F96%252Fb0962e4192393d84e9d793056f53a550%252Fpa%252FRU59623_a5e3b91a00676341d286cbab581c278e.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_a5e3b91a00676341d286cbab581c278e.jpg saved to cache
2026-03-27 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fd8496aa-ce74-5fca-b528-3e32ab32a063
2026-03-27 10:40:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bea29f7e-cce3-5300-b779-898fd8dd79f3 with identifier: EA40469
2026-03-27 10:40:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bea29f7e-cce3-5300-b779-898fd8dd79f3 with scrape type 1
2026-03-27 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bea29f7e-cce3-5300-b779-898fd8dd79f3
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F46%252F4c464dc6d412a2a21d980dd050dc07cb%252Fpa%252FEA40469_561ddb612d08ffb2bd071b3fe20a653b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_561ddb612d08ffb2bd071b3fe20a653b.jpg not downloaded yet
2026-03-27 10:40:26 [auto1.de] INFO: Channel: 24h | Page: 15 | totalHits: 10513 | hits on page: 40
2026-03-27 10:40:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afc428fd-cfba-5e75-b43c-c0704bde8799 with identifier: UF88550
2026-03-27 10:40:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afc428fd-cfba-5e75-b43c-c0704bde8799 with identifier: UF88550
2026-03-27 10:40:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afc428fd-cfba-5e75-b43c-c0704bde8799 with identifier: UF88550 to the API
2026-03-27 10:40:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:40:15Z',
 'fuel_type': 'diesel',
 'id': 'afc428fd-cfba-5e75-b43c-c0704bde8799',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF88550',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 267188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-17',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF88550%27 HTTP/1.1" 200 None
2026-03-27 10:40:27 [auto1.de] INFO: Saving data for UF88550: {'auction_closing_time': 1774716015.0, 'created_time': 1773830357.863718, 'last_price_update_time': 1774608027.179754}
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF88550') HTTP/1.1" 204 0
2026-03-27 10:40:27 [auto1.de] INFO: Found listing with ID: JX81073
2026-03-27 10:40:27 [auto1.de] INFO: Found listing with ID: RU03073
2026-03-27 10:40:27 [auto1.de] INFO: Found listing with ID: XF55006
2026-03-27 10:40:27 [auto1.de] INFO: Found listing with ID: VC80296
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC80296%27 HTTP/1.1" 200 None
2026-03-27 10:40:27 [auto1.de] INFO: Scrape type for VC80296: 1
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F46%252F4c464dc6d412a2a21d980dd050dc07cb%252Fpa%252FEA40469_658c6203ff5ccda6712404bc015dd38e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_658c6203ff5ccda6712404bc015dd38e.jpg not downloaded yet
2026-03-27 10:40:27 [auto1.de] INFO: Found listing with ID: ZC13254
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC13254%27 HTTP/1.1" 200 None
2026-03-27 10:40:27 [auto1.de] INFO: Scrape type for ZC13254: 2
2026-03-27 10:40:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5bff240-ac6e-58e7-811d-b4244204b4ea with identifier: ZC13254
2026-03-27 10:40:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5bff240-ac6e-58e7-811d-b4244204b4ea with scrape type 2
2026-03-27 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5bff240-ac6e-58e7-811d-b4244204b4ea with scrape type 2
2026-03-27 10:40:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5bff240-ac6e-58e7-811d-b4244204b4ea, identifier: ZC13254
2026-03-27 10:40:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:40:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500317ad0>
2026-03-27 10:40:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4cdf85-78e5-5e8b-acc4-acb367780537/3b4cdf85-78e5-5e8b-acc4-acb367780537_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F43%252F7e438750c458b90e705d99a15cd38473%252Fpa%252FEX22671_d82dd615ae8a65838730a67a55cdaa59.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_d82dd615ae8a65838730a67a55cdaa59.jpg saved to cache
2026-03-27 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b4cdf85-78e5-5e8b-acc4-acb367780537
2026-03-27 10:40:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b4cdf85-78e5-5e8b-acc4-acb367780537, skipping ID generation
2026-03-27 10:40:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b4cdf85-78e5-5e8b-acc4-acb367780537 with scrape type 1
2026-03-27 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b4cdf85-78e5-5e8b-acc4-acb367780537 sending to next pipeline
2026-03-27 10:40:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b4cdf85-78e5-5e8b-acc4-acb367780537, identifier: EX22671
2026-03-27 10:40:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5bff240-ac6e-58e7-811d-b4244204b4ea with identifier: ZC13254
2026-03-27 10:40:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5bff240-ac6e-58e7-811d-b4244204b4ea with identifier: ZC13254
2026-03-27 10:40:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5bff240-ac6e-58e7-811d-b4244204b4ea with identifier: ZC13254 to the API
2026-03-27 10:40:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:57:17Z',
 'fuel_type': 'diesel',
 'id': 'b5bff240-ac6e-58e7-811d-b4244204b4ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC13254',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 255829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-03',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2016}
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC13254%27 HTTP/1.1" 200 None
2026-03-27 10:40:28 [auto1.de] INFO: Saving data for ZC13254: {'auction_closing_time': 1774717037.0, 'created_time': 1773307849.083539, 'last_price_update_time': 1774608028.146642}
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC13254') HTTP/1.1" 204 0
2026-03-27 10:40:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b4cdf85-78e5-5e8b-acc4-acb367780537 with identifier: EX22671
2026-03-27 10:40:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b4cdf85-78e5-5e8b-acc4-acb367780537 with identifier: EX22671
2026-03-27 10:40:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b4cdf85-78e5-5e8b-acc4-acb367780537 with identifier: EX22671 to the API
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_d82dd615ae8a65838730a67a55cdaa59.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:26:43Z',
 'fuel_type': 'petrol',
 'id': '3b4cdf85-78e5-5e8b-acc4-acb367780537',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX22671',
 'listing': 'auction',
 'location': 'DE, Heilbronn',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 135909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b4cdf85-78e5-5e8b-acc4-acb367780537/3b4cdf85-78e5-5e8b-acc4-acb367780537_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_8d8f7666df462195774a370437f748da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b4cdf85-78e5-5e8b-acc4-acb367780537/3b4cdf85-78e5-5e8b-acc4-acb367780537_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2893265,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_bdef0a2f52cccef7d87585e1adb983be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b4cdf85-78e5-5e8b-acc4-acb367780537/3b4cdf85-78e5-5e8b-acc4-acb367780537_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_a6b98651ca3886ad9782dbadf1920954.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b4cdf85-78e5-5e8b-acc4-acb367780537/3b4cdf85-78e5-5e8b-acc4-acb367780537_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_b6aa1c16b8cf7020551ea24f31776c5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b4cdf85-78e5-5e8b-acc4-acb367780537/3b4cdf85-78e5-5e8b-acc4-acb367780537_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_6f1680c284449d81af85d37b86aa7296.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b4cdf85-78e5-5e8b-acc4-acb367780537/3b4cdf85-78e5-5e8b-acc4-acb367780537_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3047269,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_d82dd615ae8a65838730a67a55cdaa59.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b4cdf85-78e5-5e8b-acc4-acb367780537/3b4cdf85-78e5-5e8b-acc4-acb367780537_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_5f73c8dcbc1fa14adcbad5ae31bb050b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b4cdf85-78e5-5e8b-acc4-acb367780537/3b4cdf85-78e5-5e8b-acc4-acb367780537_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_a9151c8a8ff23d5129f47d217275ac10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b4cdf85-78e5-5e8b-acc4-acb367780537/3b4cdf85-78e5-5e8b-acc4-acb367780537_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_5a15ad5756fd39ef2a6d2ba9a205de44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b4cdf85-78e5-5e8b-acc4-acb367780537/3b4cdf85-78e5-5e8b-acc4-acb367780537_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3311670,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/43/7e438750c458b90e705d99a15cd38473/pa/EX22671_e2c4a0bc900b043a1a93bf30d9c33c3c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2017}
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX22671%27 HTTP/1.1" 200 None
2026-03-27 10:40:28 [auto1.de] INFO: Saving data for EX22671: {'created_time': 1774608028.557649, 'last_price_update_time': 1774608028.55766, 'auction_closing_time': 1774715203.0}
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX22671') HTTP/1.1" 204 0
2026-03-27 10:40:28 [auto1.de] INFO: Found listing with ID: BF57036
2026-03-27 10:40:28 [auto1.de] INFO: Found listing with ID: UH99848
2026-03-27 10:40:28 [auto1.de] INFO: Found listing with ID: GD60404
2026-03-27 10:40:28 [auto1.de] INFO: Found listing with ID: MY70814
2026-03-27 10:40:28 [auto1.de] INFO: Found listing with ID: CR52623
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR52623%27 HTTP/1.1" 200 None
2026-03-27 10:40:28 [auto1.de] INFO: Scrape type for CR52623: 2
2026-03-27 10:40:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faf909b0-c479-565e-b019-828c74c2efe9 with identifier: CR52623
2026-03-27 10:40:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faf909b0-c479-565e-b019-828c74c2efe9 with scrape type 2
2026-03-27 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faf909b0-c479-565e-b019-828c74c2efe9 with scrape type 2
2026-03-27 10:40:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: faf909b0-c479-565e-b019-828c74c2efe9, identifier: CR52623
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F46%252F4c464dc6d412a2a21d980dd050dc07cb%252Fpa%252FEA40469_d57290df83bd8533e93e62eb684ba96f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_d57290df83bd8533e93e62eb684ba96f.jpg not downloaded yet
2026-03-27 10:40:28 [auto1.de] INFO: Found listing with ID: BK53036
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK53036%27 HTTP/1.1" 200 None
2026-03-27 10:40:28 [auto1.de] INFO: Scrape type for BK53036: 2
2026-03-27 10:40:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12eeedbd-107e-5689-b2b4-ee044ea48bfa with identifier: BK53036
2026-03-27 10:40:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12eeedbd-107e-5689-b2b4-ee044ea48bfa with scrape type 2
2026-03-27 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12eeedbd-107e-5689-b2b4-ee044ea48bfa with scrape type 2
2026-03-27 10:40:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12eeedbd-107e-5689-b2b4-ee044ea48bfa, identifier: BK53036
2026-03-27 10:40:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: faf909b0-c479-565e-b019-828c74c2efe9 with identifier: CR52623
2026-03-27 10:40:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: faf909b0-c479-565e-b019-828c74c2efe9 with identifier: CR52623
2026-03-27 10:40:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: faf909b0-c479-565e-b019-828c74c2efe9 with identifier: CR52623 to the API
2026-03-27 10:40:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:18:06Z',
 'fuel_type': 'diesel',
 'id': 'faf909b0-c479-565e-b019-828c74c2efe9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR52623',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 199818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-13',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi FT 280 K',
 'transmission': 'manual',
 'trim': 'FT 280 K',
 'year': 2009}
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR52623%27 HTTP/1.1" 200 None
2026-03-27 10:40:29 [auto1.de] INFO: Saving data for CR52623: {'auction_closing_time': 1774714686.0, 'created_time': 1773402579.945902, 'last_price_update_time': 1774608029.197221}
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR52623') HTTP/1.1" 204 0
2026-03-27 10:40:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12eeedbd-107e-5689-b2b4-ee044ea48bfa with identifier: BK53036
2026-03-27 10:40:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12eeedbd-107e-5689-b2b4-ee044ea48bfa with identifier: BK53036
2026-03-27 10:40:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12eeedbd-107e-5689-b2b4-ee044ea48bfa with identifier: BK53036 to the API
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:52:44Z',
 'fuel_type': 'diesel',
 'id': '12eeedbd-107e-5689-b2b4-ee044ea48bfa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK53036',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 158403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-16',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2012}
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK53036%27 HTTP/1.1" 200 None
2026-03-27 10:40:29 [auto1.de] INFO: Saving data for BK53036: {'auction_closing_time': 1774716764.0, 'created_time': 1774294786.521126, 'last_price_update_time': 1774608029.701634}
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK53036') HTTP/1.1" 204 0
2026-03-27 10:40:29 [auto1.de] INFO: Found listing with ID: BK49064
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK49064%27 HTTP/1.1" 200 None
2026-03-27 10:40:29 [auto1.de] INFO: Scrape type for BK49064: 2
2026-03-27 10:40:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45a1cb5c-a663-51f5-979a-ec8b11206b9d with identifier: BK49064
2026-03-27 10:40:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45a1cb5c-a663-51f5-979a-ec8b11206b9d with scrape type 2
2026-03-27 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45a1cb5c-a663-51f5-979a-ec8b11206b9d with scrape type 2
2026-03-27 10:40:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45a1cb5c-a663-51f5-979a-ec8b11206b9d, identifier: BK49064
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F46%252F4c464dc6d412a2a21d980dd050dc07cb%252Fpa%252FEA40469_36d0e0ba2f3fdacb9d3d0db3abc9ac43.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_36d0e0ba2f3fdacb9d3d0db3abc9ac43.jpg not downloaded yet
2026-03-27 10:40:29 [auto1.de] INFO: Found listing with ID: GX10720
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX10720%27 HTTP/1.1" 200 None
2026-03-27 10:40:29 [auto1.de] INFO: Scrape type for GX10720: 2
2026-03-27 10:40:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72ac3892-ede8-5be1-853a-840a83d82e17 with identifier: GX10720
2026-03-27 10:40:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72ac3892-ede8-5be1-853a-840a83d82e17 with scrape type 2
2026-03-27 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72ac3892-ede8-5be1-853a-840a83d82e17 with scrape type 2
2026-03-27 10:40:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72ac3892-ede8-5be1-853a-840a83d82e17, identifier: GX10720
2026-03-27 10:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_561ddb612d08ffb2bd071b3fe20a653b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45a1cb5c-a663-51f5-979a-ec8b11206b9d with identifier: BK49064
2026-03-27 10:40:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45a1cb5c-a663-51f5-979a-ec8b11206b9d with identifier: BK49064
2026-03-27 10:40:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45a1cb5c-a663-51f5-979a-ec8b11206b9d with identifier: BK49064 to the API
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:41:40Z',
 'fuel_type': 'petrol',
 'id': '45a1cb5c-a663-51f5-979a-ec8b11206b9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK49064',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 131467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-19',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.4 TSI Design',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2013}
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK49064%27 HTTP/1.1" 200 None
2026-03-27 10:40:30 [auto1.de] INFO: Saving data for BK49064: {'auction_closing_time': 1774716100.0, 'created_time': 1773307747.900012, 'last_price_update_time': 1774608030.36276}
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK49064') HTTP/1.1" 204 0
2026-03-27 10:40:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72ac3892-ede8-5be1-853a-840a83d82e17 with identifier: GX10720
2026-03-27 10:40:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72ac3892-ede8-5be1-853a-840a83d82e17 with identifier: GX10720
2026-03-27 10:40:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72ac3892-ede8-5be1-853a-840a83d82e17 with identifier: GX10720 to the API
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:03:07Z',
 'fuel_type': 'petrol',
 'id': '72ac3892-ede8-5be1-853a-840a83d82e17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX10720',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 124543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-13',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2014}
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX10720%27 HTTP/1.1" 200 None
2026-03-27 10:40:30 [auto1.de] INFO: Saving data for GX10720: {'auction_closing_time': 1774713787.0, 'created_time': 1773301478.649371, 'last_price_update_time': 1774608030.718716}
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX10720') HTTP/1.1" 204 0
2026-03-27 10:40:30 [auto1.de] INFO: Found listing with ID: HG64056
2026-03-27 10:40:30 [auto1.de] INFO: Found listing with ID: WK78247
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK78247%27 HTTP/1.1" 200 None
2026-03-27 10:40:30 [auto1.de] INFO: Scrape type for WK78247: 2
2026-03-27 10:40:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58001774-0a17-5d02-93f9-e4958e8e2009 with identifier: WK78247
2026-03-27 10:40:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58001774-0a17-5d02-93f9-e4958e8e2009 with scrape type 2
2026-03-27 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58001774-0a17-5d02-93f9-e4958e8e2009 with scrape type 2
2026-03-27 10:40:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58001774-0a17-5d02-93f9-e4958e8e2009, identifier: WK78247
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F46%252F4c464dc6d412a2a21d980dd050dc07cb%252Fpa%252FEA40469_d31be1d460385ac9e8129103eae86721.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_d31be1d460385ac9e8129103eae86721.jpg not downloaded yet
2026-03-27 10:40:30 [auto1.de] INFO: Found listing with ID: YE81869
2026-03-27 10:40:30 [auto1.de] INFO: Found listing with ID: LR76257
2026-03-27 10:40:30 [auto1.de] INFO: Found listing with ID: TE33138
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE33138%27 HTTP/1.1" 200 None
2026-03-27 10:40:30 [auto1.de] INFO: Scrape type for TE33138: 2
2026-03-27 10:40:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 013dee42-5b46-5376-9494-28a7b737d5d1 with identifier: TE33138
2026-03-27 10:40:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 013dee42-5b46-5376-9494-28a7b737d5d1 with scrape type 2
2026-03-27 10:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 013dee42-5b46-5376-9494-28a7b737d5d1 with scrape type 2
2026-03-27 10:40:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 013dee42-5b46-5376-9494-28a7b737d5d1, identifier: TE33138
2026-03-27 10:40:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58001774-0a17-5d02-93f9-e4958e8e2009 with identifier: WK78247
2026-03-27 10:40:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58001774-0a17-5d02-93f9-e4958e8e2009 with identifier: WK78247
2026-03-27 10:40:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58001774-0a17-5d02-93f9-e4958e8e2009 with identifier: WK78247 to the API
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:41:30Z',
 'fuel_type': 'petrol',
 'id': '58001774-0a17-5d02-93f9-e4958e8e2009',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK78247',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Panamera',
 'odometer': 145009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-30',
 'seller_name': None,
 'title': 'Porsche Panamera 3.6',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK78247%27 HTTP/1.1" 200 None
2026-03-27 10:40:31 [auto1.de] INFO: Saving data for WK78247: {'auction_closing_time': 1774716090.0, 'created_time': 1773775912.694358, 'last_price_update_time': 1774608031.756444}
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK78247') HTTP/1.1" 204 0
2026-03-27 10:40:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 013dee42-5b46-5376-9494-28a7b737d5d1 with identifier: TE33138
2026-03-27 10:40:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 013dee42-5b46-5376-9494-28a7b737d5d1 with identifier: TE33138
2026-03-27 10:40:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 013dee42-5b46-5376-9494-28a7b737d5d1 with identifier: TE33138 to the API
2026-03-27 10:40:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:01:49Z',
 'fuel_type': 'petrol',
 'id': '013dee42-5b46-5376-9494-28a7b737d5d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE33138',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'RCZ',
 'odometer': 116417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-28',
 'seller_name': None,
 'title': 'Peugeot RCZ 1.6 THP Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2012}
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE33138%27 HTTP/1.1" 200 None
2026-03-27 10:40:32 [auto1.de] INFO: Saving data for TE33138: {'auction_closing_time': 1774713709.0, 'created_time': 1774264872.736288, 'last_price_update_time': 1774608032.157668}
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE33138') HTTP/1.1" 204 0
2026-03-27 10:40:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-27 10:40:32 [auto1.de] INFO: Found listing with ID: SA94096
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA94096%27 HTTP/1.1" 200 None
2026-03-27 10:40:32 [auto1.de] INFO: Scrape type for SA94096: 2
2026-03-27 10:40:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4a256c9-b188-5fcc-843a-e6b4896b9835 with identifier: SA94096
2026-03-27 10:40:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4a256c9-b188-5fcc-843a-e6b4896b9835 with scrape type 2
2026-03-27 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4a256c9-b188-5fcc-843a-e6b4896b9835 with scrape type 2
2026-03-27 10:40:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4a256c9-b188-5fcc-843a-e6b4896b9835, identifier: SA94096
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F46%252F4c464dc6d412a2a21d980dd050dc07cb%252Fpa%252FEA40469_3af9102372cf9d2bc6bfe18b2aec55e9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_3af9102372cf9d2bc6bfe18b2aec55e9.jpg not downloaded yet
2026-03-27 10:40:32 [auto1.de] INFO: Found listing with ID: FB58638
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB58638%27 HTTP/1.1" 200 None
2026-03-27 10:40:32 [auto1.de] INFO: Scrape type for FB58638: 0
2026-03-27 10:40:32 [auto1.de] INFO: Found listing with ID: PU73268
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU73268%27 HTTP/1.1" 200 None
2026-03-27 10:40:32 [auto1.de] INFO: Scrape type for PU73268: 2
2026-03-27 10:40:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07c0d91a-4bd2-5b0f-9144-89bf7972298f with identifier: PU73268
2026-03-27 10:40:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07c0d91a-4bd2-5b0f-9144-89bf7972298f with scrape type 2
2026-03-27 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07c0d91a-4bd2-5b0f-9144-89bf7972298f with scrape type 2
2026-03-27 10:40:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07c0d91a-4bd2-5b0f-9144-89bf7972298f, identifier: PU73268
2026-03-27 10:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RG76834/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PP43066/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LU27790/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_d57290df83bd8533e93e62eb684ba96f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4a256c9-b188-5fcc-843a-e6b4896b9835 with identifier: SA94096
2026-03-27 10:40:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4a256c9-b188-5fcc-843a-e6b4896b9835 with identifier: SA94096
2026-03-27 10:40:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4a256c9-b188-5fcc-843a-e6b4896b9835 with identifier: SA94096 to the API
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:41:41Z',
 'fuel_type': 'petrol',
 'id': 'a4a256c9-b188-5fcc-843a-e6b4896b9835',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA94096',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 40963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-31',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2023}
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA94096%27 HTTP/1.1" 200 None
2026-03-27 10:40:32 [auto1.de] INFO: Saving data for SA94096: {'auction_closing_time': 1774716101.0, 'created_time': 1773307114.572102, 'last_price_update_time': 1774608032.953506}
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA94096') HTTP/1.1" 204 0
2026-03-27 10:40:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07c0d91a-4bd2-5b0f-9144-89bf7972298f with identifier: PU73268
2026-03-27 10:40:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-27 10:40:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:40:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07c0d91a-4bd2-5b0f-9144-89bf7972298f with identifier: PU73268
2026-03-27 10:40:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07c0d91a-4bd2-5b0f-9144-89bf7972298f with identifier: PU73268 to the API
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:27:18Z',
 'fuel_type': 'petrol',
 'id': '07c0d91a-4bd2-5b0f-9144-89bf7972298f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU73268',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 122365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-13',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU73268%27 HTTP/1.1" 200 None
2026-03-27 10:40:33 [auto1.de] INFO: Saving data for PU73268: {'auction_closing_time': 1774715238.0, 'created_time': 1772541052.119915, 'last_price_update_time': 1774608033.550515}
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU73268') HTTP/1.1" 204 0
2026-03-27 10:40:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003145d0>
2026-03-27 10:40:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea29f7e-cce3-5300-b779-898fd8dd79f3/bea29f7e-cce3-5300-b779-898fd8dd79f3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F46%252F4c464dc6d412a2a21d980dd050dc07cb%252Fpa%252FEA40469_561ddb612d08ffb2bd071b3fe20a653b.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_561ddb612d08ffb2bd071b3fe20a653b.jpg saved to cache
2026-03-27 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bea29f7e-cce3-5300-b779-898fd8dd79f3
2026-03-27 10:40:33 [auto1.de] INFO: Found listing with ID: ND38532
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND38532%27 HTTP/1.1" 200 None
2026-03-27 10:40:33 [auto1.de] INFO: Scrape type for ND38532: 2
2026-03-27 10:40:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58bfe349-cf26-5853-9df2-e562fedd2daf with identifier: ND38532
2026-03-27 10:40:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58bfe349-cf26-5853-9df2-e562fedd2daf with scrape type 2
2026-03-27 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58bfe349-cf26-5853-9df2-e562fedd2daf with scrape type 2
2026-03-27 10:40:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58bfe349-cf26-5853-9df2-e562fedd2daf, identifier: ND38532
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F46%252F4c464dc6d412a2a21d980dd050dc07cb%252Fpa%252FEA40469_016db5bbf6d7d41132becbbc64b5f328.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_016db5bbf6d7d41132becbbc64b5f328.jpg not downloaded yet
2026-03-27 10:40:33 [auto1.de] INFO: Found listing with ID: PF97511
2026-03-27 10:40:33 [auto1.de] INFO: Found listing with ID: SA71883
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA71883%27 HTTP/1.1" 200 None
2026-03-27 10:40:33 [auto1.de] INFO: Scrape type for SA71883: 2
2026-03-27 10:40:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b with identifier: SA71883
2026-03-27 10:40:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b with scrape type 2
2026-03-27 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b with scrape type 2
2026-03-27 10:40:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b, identifier: SA71883
2026-03-27 10:40:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58bfe349-cf26-5853-9df2-e562fedd2daf with identifier: ND38532
2026-03-27 10:40:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58bfe349-cf26-5853-9df2-e562fedd2daf with identifier: ND38532
2026-03-27 10:40:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58bfe349-cf26-5853-9df2-e562fedd2daf with identifier: ND38532 to the API
2026-03-27 10:40:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 390,
 'expiration_date': '2026-03-28T16:55:23Z',
 'fuel_type': 'petrol',
 'id': '58bfe349-cf26-5853-9df2-e562fedd2daf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND38532',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 85127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-01',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 43 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND38532%27 HTTP/1.1" 200 None
2026-03-27 10:40:34 [auto1.de] INFO: Saving data for ND38532: {'auction_closing_time': 1774716923.0, 'created_time': 1773307455.171278, 'last_price_update_time': 1774608034.25845}
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND38532') HTTP/1.1" 204 0
2026-03-27 10:40:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b with identifier: SA71883
2026-03-27 10:40:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b with identifier: SA71883
2026-03-27 10:40:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b with identifier: SA71883 to the API
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:18:40Z',
 'fuel_type': 'petrol',
 'id': '3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA71883',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 123196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-28',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2016}
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA71883%27 HTTP/1.1" 200 None
2026-03-27 10:40:35 [auto1.de] INFO: Saving data for SA71883: {'auction_closing_time': 1774714720.0, 'created_time': 1773307123.653284, 'last_price_update_time': 1774608035.042732}
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA71883') HTTP/1.1" 204 0
2026-03-27 10:40:35 [auto1.de] INFO: Found listing with ID: PK39186
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F46%252F4c464dc6d412a2a21d980dd050dc07cb%252Fpa%252FEA40469_1124ed2335c999a01f244e75758fb3d7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_1124ed2335c999a01f244e75758fb3d7.jpg not downloaded yet
2026-03-27 10:40:35 [auto1.de] INFO: Found listing with ID: XG94093
2026-03-27 10:40:35 [auto1.de] INFO: Found listing with ID: UH00039
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH00039%27 HTTP/1.1" 200 None
2026-03-27 10:40:35 [auto1.de] INFO: Scrape type for UH00039: 2
2026-03-27 10:40:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e with identifier: UH00039
2026-03-27 10:40:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e with scrape type 2
2026-03-27 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e with scrape type 2
2026-03-27 10:40:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e, identifier: UH00039
2026-03-27 10:40:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50162ec50>
2026-03-27 10:40:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea29f7e-cce3-5300-b779-898fd8dd79f3/bea29f7e-cce3-5300-b779-898fd8dd79f3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F46%252F4c464dc6d412a2a21d980dd050dc07cb%252Fpa%252FEA40469_d57290df83bd8533e93e62eb684ba96f.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_d57290df83bd8533e93e62eb684ba96f.jpg saved to cache
2026-03-27 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bea29f7e-cce3-5300-b779-898fd8dd79f3
2026-03-27 10:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_658c6203ff5ccda6712404bc015dd38e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_d31be1d460385ac9e8129103eae86721.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_36d0e0ba2f3fdacb9d3d0db3abc9ac43.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e with identifier: UH00039
2026-03-27 10:40:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e with identifier: UH00039
2026-03-27 10:40:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e with identifier: UH00039 to the API
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:54:30Z',
 'fuel_type': 'petrol',
 'id': '66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH00039',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo',
 'odometer': 139195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-26',
 'seller_name': None,
 'title': 'Ford Tourneo 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH00039%27 HTTP/1.1" 200 None
2026-03-27 10:40:35 [auto1.de] INFO: Saving data for UH00039: {'auction_closing_time': 1774716870.0, 'created_time': 1773858927.548276, 'last_price_update_time': 1774608035.683933}
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH00039') HTTP/1.1" 204 0
2026-03-27 10:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UC42370/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F46%252F4c464dc6d412a2a21d980dd050dc07cb%252Fpa%252FEA40469_1bf2b12c95f6f0c8a4936b930c42ecca.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_1bf2b12c95f6f0c8a4936b930c42ecca.jpg not downloaded yet
2026-03-27 10:40:35 [auto1.de] INFO: Found listing with ID: HX00306
2026-03-27 10:40:35 [auto1.de] INFO: Found listing with ID: DT83749
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT83749%27 HTTP/1.1" 200 None
2026-03-27 10:40:35 [auto1.de] INFO: Scrape type for DT83749: 2
2026-03-27 10:40:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d13efd5-a8d4-554f-9258-a54da15b0800 with identifier: DT83749
2026-03-27 10:40:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d13efd5-a8d4-554f-9258-a54da15b0800 with scrape type 2
2026-03-27 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d13efd5-a8d4-554f-9258-a54da15b0800 with scrape type 2
2026-03-27 10:40:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d13efd5-a8d4-554f-9258-a54da15b0800, identifier: DT83749
2026-03-27 10:40:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UH98886> (referer: https://www.auto1.com/v1/car-details-view/UH98886/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SP41921> (referer: https://www.auto1.com/v1/car-details-view/SP41921/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d13efd5-a8d4-554f-9258-a54da15b0800 with identifier: DT83749
2026-03-27 10:40:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d13efd5-a8d4-554f-9258-a54da15b0800 with identifier: DT83749
2026-03-27 10:40:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d13efd5-a8d4-554f-9258-a54da15b0800 with identifier: DT83749 to the API
2026-03-27 10:40:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:29:37Z',
 'fuel_type': 'diesel',
 'id': '9d13efd5-a8d4-554f-9258-a54da15b0800',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT83749',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 300627,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-23',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC',
 'transmission': 'automatic',
 'trim': 'T BlueTEC',
 'year': 2015}
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT83749%27 HTTP/1.1" 200 None
2026-03-27 10:40:36 [auto1.de] INFO: Saving data for DT83749: {'auction_closing_time': 1774715377.0, 'created_time': 1773303574.476472, 'last_price_update_time': 1774608036.23679}
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT83749') HTTP/1.1" 204 0
2026-03-27 10:40:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F46%252F4c464dc6d412a2a21d980dd050dc07cb%252Fpa%252FEA40469_00bc583172304f4384406fd64084988c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_00bc583172304f4384406fd64084988c.jpg not downloaded yet
2026-03-27 10:40:36 [auto1.de] INFO: Found listing with ID: XK87583
2026-03-27 10:40:36 [auto1.de] INFO: Found listing with ID: PU26229
2026-03-27 10:40:36 [auto1.de] INFO: Found listing with ID: HY47852
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY47852%27 HTTP/1.1" 200 None
2026-03-27 10:40:36 [auto1.de] INFO: Scrape type for HY47852: 2
2026-03-27 10:40:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ac0ffb0-805d-5c0a-b3f7-98d42792c665 with identifier: HY47852
2026-03-27 10:40:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ac0ffb0-805d-5c0a-b3f7-98d42792c665 with scrape type 2
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ac0ffb0-805d-5c0a-b3f7-98d42792c665 with scrape type 2
2026-03-27 10:40:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ac0ffb0-805d-5c0a-b3f7-98d42792c665, identifier: HY47852
2026-03-27 10:40:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501639150>
2026-03-27 10:40:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea29f7e-cce3-5300-b779-898fd8dd79f3/bea29f7e-cce3-5300-b779-898fd8dd79f3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F46%252F4c464dc6d412a2a21d980dd050dc07cb%252Fpa%252FEA40469_658c6203ff5ccda6712404bc015dd38e.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_658c6203ff5ccda6712404bc015dd38e.jpg saved to cache
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bea29f7e-cce3-5300-b779-898fd8dd79f3
2026-03-27 10:40:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50169be10>
2026-03-27 10:40:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea29f7e-cce3-5300-b779-898fd8dd79f3/bea29f7e-cce3-5300-b779-898fd8dd79f3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F46%252F4c464dc6d412a2a21d980dd050dc07cb%252Fpa%252FEA40469_d31be1d460385ac9e8129103eae86721.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_d31be1d460385ac9e8129103eae86721.jpg saved to cache
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bea29f7e-cce3-5300-b779-898fd8dd79f3
2026-03-27 10:40:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003f7e50>
2026-03-27 10:40:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea29f7e-cce3-5300-b779-898fd8dd79f3/bea29f7e-cce3-5300-b779-898fd8dd79f3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F46%252F4c464dc6d412a2a21d980dd050dc07cb%252Fpa%252FEA40469_36d0e0ba2f3fdacb9d3d0db3abc9ac43.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_36d0e0ba2f3fdacb9d3d0db3abc9ac43.jpg saved to cache
2026-03-27 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bea29f7e-cce3-5300-b779-898fd8dd79f3
2026-03-27 10:40:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ac0ffb0-805d-5c0a-b3f7-98d42792c665 with identifier: HY47852
2026-03-27 10:40:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ac0ffb0-805d-5c0a-b3f7-98d42792c665 with identifier: HY47852
2026-03-27 10:40:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ac0ffb0-805d-5c0a-b3f7-98d42792c665 with identifier: HY47852 to the API
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:46:25Z',
 'fuel_type': 'diesel',
 'id': '6ac0ffb0-805d-5c0a-b3f7-98d42792c665',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY47852',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 193655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-20',
 'seller_name': None,
 'title': 'BMW X1 xDrive 25d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY47852%27 HTTP/1.1" 200 None
2026-03-27 10:40:37 [auto1.de] INFO: Saving data for HY47852: {'auction_closing_time': 1774716385.0, 'created_time': 1773134432.947238, 'last_price_update_time': 1774608037.060319}
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY47852') HTTP/1.1" 204 0
2026-03-27 10:40:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_1124ed2335c999a01f244e75758fb3d7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:37 [auto1.de] INFO: Found listing with ID: VX14818
2026-03-27 10:40:37 [auto1.de] INFO: Found listing with ID: YP68247
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP68247%27 HTTP/1.1" 200 None
2026-03-27 10:40:37 [auto1.de] INFO: Scrape type for YP68247: 2
2026-03-27 10:40:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd9b49b6-c686-54c5-aa17-30e83c44ca5c with identifier: YP68247
2026-03-27 10:40:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd9b49b6-c686-54c5-aa17-30e83c44ca5c with scrape type 2
2026-03-27 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd9b49b6-c686-54c5-aa17-30e83c44ca5c with scrape type 2
2026-03-27 10:40:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd9b49b6-c686-54c5-aa17-30e83c44ca5c, identifier: YP68247
2026-03-27 10:40:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_016db5bbf6d7d41132becbbc64b5f328.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_3af9102372cf9d2bc6bfe18b2aec55e9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd9b49b6-c686-54c5-aa17-30e83c44ca5c with identifier: YP68247
2026-03-27 10:40:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd9b49b6-c686-54c5-aa17-30e83c44ca5c with identifier: YP68247
2026-03-27 10:40:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd9b49b6-c686-54c5-aa17-30e83c44ca5c with identifier: YP68247 to the API
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:20:03Z',
 'fuel_type': 'petrol',
 'id': 'dd9b49b6-c686-54c5-aa17-30e83c44ca5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP68247',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse Limousine',
 'odometer': 16621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse Limousine A 180 Mild-Hybrid Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2023}
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP68247%27 HTTP/1.1" 200 None
2026-03-27 10:40:37 [auto1.de] INFO: Saving data for YP68247: {'auction_closing_time': 1774714803.0, 'created_time': 1773401754.925079, 'last_price_update_time': 1774608037.673701}
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP68247') HTTP/1.1" 204 0
2026-03-27 10:40:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a319550-5d85-5f28-824e-6f9be8d2f892 with identifier: UH98886
2026-03-27 10:40:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a319550-5d85-5f28-824e-6f9be8d2f892 with scrape type 1
2026-03-27 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a319550-5d85-5f28-824e-6f9be8d2f892
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fef%252F6cef418517bf2dc3d4f64a3548483490%252Fpa%252FUH98886_7f007a04bd15664b07fb2fdcae8a6aac.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_7f007a04bd15664b07fb2fdcae8a6aac.jpg already downloaded
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fef%252F6cef418517bf2dc3d4f64a3548483490%252Fpa%252FUH98886_33ba896b09bbe51e818a11428425db70.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_33ba896b09bbe51e818a11428425db70.jpg already downloaded
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fef%252F6cef418517bf2dc3d4f64a3548483490%252Fpa%252FUH98886_cb2f3931e5962aeaf1215d1625d54d90.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_cb2f3931e5962aeaf1215d1625d54d90.jpg already downloaded
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fef%252F6cef418517bf2dc3d4f64a3548483490%252Fpa%252FUH98886_13ba2d1fa52655a59cf94296f3670c52.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_13ba2d1fa52655a59cf94296f3670c52.jpg already downloaded
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fef%252F6cef418517bf2dc3d4f64a3548483490%252Fpa%252FUH98886_69b79321e70d24f65ba8805c1085efdb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_69b79321e70d24f65ba8805c1085efdb.jpg already downloaded
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fef%252F6cef418517bf2dc3d4f64a3548483490%252Fpa%252FUH98886_ea4afe22fb1cf978c1f46589fa08d152.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_ea4afe22fb1cf978c1f46589fa08d152.jpg already downloaded
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fef%252F6cef418517bf2dc3d4f64a3548483490%252Fpa%252FUH98886_764fe55a55fd17df87b4120bce4ed606.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_764fe55a55fd17df87b4120bce4ed606.jpg already downloaded
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fef%252F6cef418517bf2dc3d4f64a3548483490%252Fpa%252FUH98886_fe4eb6b1ab9bcfc15e9ec37909bc50e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_fe4eb6b1ab9bcfc15e9ec37909bc50e5.jpg already downloaded
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fef%252F6cef418517bf2dc3d4f64a3548483490%252Fpa%252FUH98886_50169716b3cef088747c8eadd3116e4d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_50169716b3cef088747c8eadd3116e4d.jpg already downloaded
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fef%252F6cef418517bf2dc3d4f64a3548483490%252Fpa%252FUH98886_62ffb5e5c030fd69faa0f803de6356c1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_62ffb5e5c030fd69faa0f803de6356c1.jpg already downloaded
2026-03-27 10:40:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a319550-5d85-5f28-824e-6f9be8d2f892, identifier: UH98886
2026-03-27 10:40:38 [auto1.de] INFO: Channel: 24h | Page: 16 | totalHits: 10513 | hits on page: 40
2026-03-27 10:40:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55c5914a-085d-5791-ad81-66cf3b603e11 with identifier: SP41921
2026-03-27 10:40:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55c5914a-085d-5791-ad81-66cf3b603e11 with scrape type 1
2026-03-27 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55c5914a-085d-5791-ad81-66cf3b603e11
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2e%252F4f2eee0610b86fbd8472817cafbb8770%252Fpa%252FSP41921_4e450350953b691cba1d40cdaa0cfba7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_4e450350953b691cba1d40cdaa0cfba7.jpg already downloaded
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2e%252F4f2eee0610b86fbd8472817cafbb8770%252Fpa%252FSP41921_14c9bfb304900bfddafc7b6ebc48b856.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_14c9bfb304900bfddafc7b6ebc48b856.jpg already downloaded
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2e%252F4f2eee0610b86fbd8472817cafbb8770%252Fpa%252FSP41921_835f9a439f4a9fbc77a27073a5627430.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_835f9a439f4a9fbc77a27073a5627430.jpg already downloaded
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2e%252F4f2eee0610b86fbd8472817cafbb8770%252Fpa%252FSP41921_423b33664915f5c8a11dba88ec772523.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_423b33664915f5c8a11dba88ec772523.jpg already downloaded
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2e%252F4f2eee0610b86fbd8472817cafbb8770%252Fpa%252FSP41921_7fcaaeb7fe074a290d42b58288c440bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_7fcaaeb7fe074a290d42b58288c440bf.jpg already downloaded
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2e%252F4f2eee0610b86fbd8472817cafbb8770%252Fpa%252FSP41921_12f36eba5029b191884ddb0ba60ae817.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_12f36eba5029b191884ddb0ba60ae817.jpg already downloaded
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2e%252F4f2eee0610b86fbd8472817cafbb8770%252Fpa%252FSP41921_2b05b882f24ed6bce6f1f9cffe7a8aa3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_2b05b882f24ed6bce6f1f9cffe7a8aa3.jpg already downloaded
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2e%252F4f2eee0610b86fbd8472817cafbb8770%252Fpa%252FSP41921_7e51d36c4f68a796598b99eee32eff81.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_7e51d36c4f68a796598b99eee32eff81.jpg already downloaded
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2e%252F4f2eee0610b86fbd8472817cafbb8770%252Fpa%252FSP41921_6a39e78e73396e92b4d406b250730dce.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_6a39e78e73396e92b4d406b250730dce.jpg already downloaded
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F2e%252F4f2eee0610b86fbd8472817cafbb8770%252Fpa%252FSP41921_e950b2c551f6acfb48342c972414e3a8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_e950b2c551f6acfb48342c972414e3a8.jpg already downloaded
2026-03-27 10:40:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55c5914a-085d-5791-ad81-66cf3b603e11, identifier: SP41921
2026-03-27 10:40:38 [auto1.de] INFO: Found listing with ID: AP27918
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP27918%27 HTTP/1.1" 200 None
2026-03-27 10:40:38 [auto1.de] INFO: Scrape type for AP27918: 2
2026-03-27 10:40:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93d8ed02-68c0-584c-a6b9-9da3709cc07e with identifier: AP27918
2026-03-27 10:40:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93d8ed02-68c0-584c-a6b9-9da3709cc07e with scrape type 2
2026-03-27 10:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93d8ed02-68c0-584c-a6b9-9da3709cc07e with scrape type 2
2026-03-27 10:40:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93d8ed02-68c0-584c-a6b9-9da3709cc07e, identifier: AP27918
2026-03-27 10:40:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a319550-5d85-5f28-824e-6f9be8d2f892 with identifier: UH98886
2026-03-27 10:40:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a319550-5d85-5f28-824e-6f9be8d2f892 with identifier: UH98886
2026-03-27 10:40:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a319550-5d85-5f28-824e-6f9be8d2f892 with identifier: UH98886 to the API
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UH98886>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:15:22Z',
 'fuel_type': 'petrol',
 'id': '9a319550-5d85-5f28-824e-6f9be8d2f892',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH98886',
 'listing': 'auction',
 'location': 'DE, Hamburg',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 147857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_7f007a04bd15664b07fb2fdcae8a6aac.jpg',
                'https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_33ba896b09bbe51e818a11428425db70.jpg',
                'https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_cb2f3931e5962aeaf1215d1625d54d90.jpg',
                'https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_13ba2d1fa52655a59cf94296f3670c52.jpg',
                'https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_69b79321e70d24f65ba8805c1085efdb.jpg',
                'https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_ea4afe22fb1cf978c1f46589fa08d152.jpg',
                'https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_764fe55a55fd17df87b4120bce4ed606.jpg',
                'https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_fe4eb6b1ab9bcfc15e9ec37909bc50e5.jpg',
                'https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_50169716b3cef088747c8eadd3116e4d.jpg',
                'https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_62ffb5e5c030fd69faa0f803de6356c1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a319550-5d85-5f28-824e-6f9be8d2f892/9a319550-5d85-5f28-824e-6f9be8d2f892_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_7f007a04bd15664b07fb2fdcae8a6aac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a319550-5d85-5f28-824e-6f9be8d2f892/9a319550-5d85-5f28-824e-6f9be8d2f892_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1278893,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_33ba896b09bbe51e818a11428425db70.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a319550-5d85-5f28-824e-6f9be8d2f892/9a319550-5d85-5f28-824e-6f9be8d2f892_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1173839,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_cb2f3931e5962aeaf1215d1625d54d90.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a319550-5d85-5f28-824e-6f9be8d2f892/9a319550-5d85-5f28-824e-6f9be8d2f892_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1033961,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_13ba2d1fa52655a59cf94296f3670c52.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a319550-5d85-5f28-824e-6f9be8d2f892/9a319550-5d85-5f28-824e-6f9be8d2f892_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1192703,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_69b79321e70d24f65ba8805c1085efdb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a319550-5d85-5f28-824e-6f9be8d2f892/9a319550-5d85-5f28-824e-6f9be8d2f892_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_ea4afe22fb1cf978c1f46589fa08d152.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a319550-5d85-5f28-824e-6f9be8d2f892/9a319550-5d85-5f28-824e-6f9be8d2f892_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_764fe55a55fd17df87b4120bce4ed606.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a319550-5d85-5f28-824e-6f9be8d2f892/9a319550-5d85-5f28-824e-6f9be8d2f892_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_fe4eb6b1ab9bcfc15e9ec37909bc50e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a319550-5d85-5f28-824e-6f9be8d2f892/9a319550-5d85-5f28-824e-6f9be8d2f892_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1281320,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_50169716b3cef088747c8eadd3116e4d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a319550-5d85-5f28-824e-6f9be8d2f892/9a319550-5d85-5f28-824e-6f9be8d2f892_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/ef/6cef418517bf2dc3d4f64a3548483490/pa/UH98886_62ffb5e5c030fd69faa0f803de6356c1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2015}
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH98886%27 HTTP/1.1" 200 None
2026-03-27 10:40:38 [auto1.de] INFO: Saving data for UH98886: {'created_time': 1774608038.872887, 'last_price_update_time': 1774608038.872898, 'auction_closing_time': 1774714522.0}
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH98886') HTTP/1.1" 204 0
2026-03-27 10:40:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55c5914a-085d-5791-ad81-66cf3b603e11 with identifier: SP41921
2026-03-27 10:40:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55c5914a-085d-5791-ad81-66cf3b603e11 with identifier: SP41921
2026-03-27 10:40:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55c5914a-085d-5791-ad81-66cf3b603e11 with identifier: SP41921 to the API
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SP41921>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:53:10Z',
 'fuel_type': 'diesel',
 'id': '55c5914a-085d-5791-ad81-66cf3b603e11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP41921',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 178506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_4e450350953b691cba1d40cdaa0cfba7.jpg',
                'https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_14c9bfb304900bfddafc7b6ebc48b856.jpg',
                'https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_835f9a439f4a9fbc77a27073a5627430.jpg',
                'https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_423b33664915f5c8a11dba88ec772523.jpg',
                'https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_7fcaaeb7fe074a290d42b58288c440bf.jpg',
                'https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_12f36eba5029b191884ddb0ba60ae817.jpg',
                'https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_2b05b882f24ed6bce6f1f9cffe7a8aa3.jpg',
                'https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_7e51d36c4f68a796598b99eee32eff81.jpg',
                'https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_6a39e78e73396e92b4d406b250730dce.jpg',
                'https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_e950b2c551f6acfb48342c972414e3a8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c5914a-085d-5791-ad81-66cf3b603e11/55c5914a-085d-5791-ad81-66cf3b603e11_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_4e450350953b691cba1d40cdaa0cfba7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c5914a-085d-5791-ad81-66cf3b603e11/55c5914a-085d-5791-ad81-66cf3b603e11_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_14c9bfb304900bfddafc7b6ebc48b856.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c5914a-085d-5791-ad81-66cf3b603e11/55c5914a-085d-5791-ad81-66cf3b603e11_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_835f9a439f4a9fbc77a27073a5627430.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c5914a-085d-5791-ad81-66cf3b603e11/55c5914a-085d-5791-ad81-66cf3b603e11_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_423b33664915f5c8a11dba88ec772523.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c5914a-085d-5791-ad81-66cf3b603e11/55c5914a-085d-5791-ad81-66cf3b603e11_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_7fcaaeb7fe074a290d42b58288c440bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c5914a-085d-5791-ad81-66cf3b603e11/55c5914a-085d-5791-ad81-66cf3b603e11_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_12f36eba5029b191884ddb0ba60ae817.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c5914a-085d-5791-ad81-66cf3b603e11/55c5914a-085d-5791-ad81-66cf3b603e11_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_2b05b882f24ed6bce6f1f9cffe7a8aa3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c5914a-085d-5791-ad81-66cf3b603e11/55c5914a-085d-5791-ad81-66cf3b603e11_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_7e51d36c4f68a796598b99eee32eff81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c5914a-085d-5791-ad81-66cf3b603e11/55c5914a-085d-5791-ad81-66cf3b603e11_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_6a39e78e73396e92b4d406b250730dce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55c5914a-085d-5791-ad81-66cf3b603e11/55c5914a-085d-5791-ad81-66cf3b603e11_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/2e/4f2eee0610b86fbd8472817cafbb8770/pa/SP41921_e950b2c551f6acfb48342c972414e3a8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41921%27 HTTP/1.1" 200 None
2026-03-27 10:40:39 [auto1.de] INFO: Saving data for SP41921: {'created_time': 1774608039.338563, 'last_price_update_time': 1774608039.338575, 'auction_closing_time': 1774716790.0}
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP41921') HTTP/1.1" 204 0
2026-03-27 10:40:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93d8ed02-68c0-584c-a6b9-9da3709cc07e with identifier: AP27918
2026-03-27 10:40:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93d8ed02-68c0-584c-a6b9-9da3709cc07e with identifier: AP27918
2026-03-27 10:40:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93d8ed02-68c0-584c-a6b9-9da3709cc07e with identifier: AP27918 to the API
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:48:33Z',
 'fuel_type': 'petrol',
 'id': '93d8ed02-68c0-584c-a6b9-9da3709cc07e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP27918',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 134961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2016}
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP27918%27 HTTP/1.1" 200 None
2026-03-27 10:40:39 [auto1.de] INFO: Saving data for AP27918: {'auction_closing_time': 1774716513.0, 'created_time': 1773342116.085903, 'last_price_update_time': 1774608039.734332}
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP27918') HTTP/1.1" 204 0
2026-03-27 10:40:39 [auto1.de] INFO: Found listing with ID: TL23560
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL23560%27 HTTP/1.1" 200 None
2026-03-27 10:40:39 [auto1.de] INFO: Scrape type for TL23560: 2
2026-03-27 10:40:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b71fb49-9367-5d14-a749-7b3a6867db91 with identifier: TL23560
2026-03-27 10:40:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b71fb49-9367-5d14-a749-7b3a6867db91 with scrape type 2
2026-03-27 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b71fb49-9367-5d14-a749-7b3a6867db91 with scrape type 2
2026-03-27 10:40:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b71fb49-9367-5d14-a749-7b3a6867db91, identifier: TL23560
2026-03-27 10:40:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015e30d0>
2026-03-27 10:40:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea29f7e-cce3-5300-b779-898fd8dd79f3/bea29f7e-cce3-5300-b779-898fd8dd79f3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F46%252F4c464dc6d412a2a21d980dd050dc07cb%252Fpa%252FEA40469_1124ed2335c999a01f244e75758fb3d7.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_1124ed2335c999a01f244e75758fb3d7.jpg saved to cache
2026-03-27 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bea29f7e-cce3-5300-b779-898fd8dd79f3
2026-03-27 10:40:39 [auto1.de] INFO: Found listing with ID: DD70281
2026-03-27 10:40:39 [auto1.de] INFO: Found listing with ID: LS36397
2026-03-27 10:40:39 [auto1.de] INFO: Found listing with ID: ZR39643
2026-03-27 10:40:39 [auto1.de] INFO: Found listing with ID: LM98964
2026-03-27 10:40:39 [auto1.de] INFO: Found listing with ID: UD88757
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD88757%27 HTTP/1.1" 200 None
2026-03-27 10:40:39 [auto1.de] INFO: Scrape type for UD88757: 2
2026-03-27 10:40:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 958bc99d-032a-5912-b8cb-b363884515d8 with identifier: UD88757
2026-03-27 10:40:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 958bc99d-032a-5912-b8cb-b363884515d8 with scrape type 2
2026-03-27 10:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 958bc99d-032a-5912-b8cb-b363884515d8 with scrape type 2
2026-03-27 10:40:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 958bc99d-032a-5912-b8cb-b363884515d8, identifier: UD88757
2026-03-27 10:40:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b71fb49-9367-5d14-a749-7b3a6867db91 with identifier: TL23560
2026-03-27 10:40:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b71fb49-9367-5d14-a749-7b3a6867db91 with identifier: TL23560
2026-03-27 10:40:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b71fb49-9367-5d14-a749-7b3a6867db91 with identifier: TL23560 to the API
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:52:39Z',
 'fuel_type': 'petrol',
 'id': '1b71fb49-9367-5d14-a749-7b3a6867db91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL23560',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Sedici',
 'odometer': 103933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-29',
 'seller_name': None,
 'title': 'Fiat Sedici 1.6 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2010}
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL23560%27 HTTP/1.1" 200 None
2026-03-27 10:40:40 [auto1.de] INFO: Saving data for TL23560: {'auction_closing_time': 1774716759.0, 'created_time': 1774294390.48762, 'last_price_update_time': 1774608040.382303}
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL23560') HTTP/1.1" 204 0
2026-03-27 10:40:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017ecf10>
2026-03-27 10:40:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea29f7e-cce3-5300-b779-898fd8dd79f3/bea29f7e-cce3-5300-b779-898fd8dd79f3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F46%252F4c464dc6d412a2a21d980dd050dc07cb%252Fpa%252FEA40469_016db5bbf6d7d41132becbbc64b5f328.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_016db5bbf6d7d41132becbbc64b5f328.jpg saved to cache
2026-03-27 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bea29f7e-cce3-5300-b779-898fd8dd79f3
2026-03-27 10:40:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50175f450>
2026-03-27 10:40:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea29f7e-cce3-5300-b779-898fd8dd79f3/bea29f7e-cce3-5300-b779-898fd8dd79f3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F46%252F4c464dc6d412a2a21d980dd050dc07cb%252Fpa%252FEA40469_3af9102372cf9d2bc6bfe18b2aec55e9.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_3af9102372cf9d2bc6bfe18b2aec55e9.jpg saved to cache
2026-03-27 10:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bea29f7e-cce3-5300-b779-898fd8dd79f3
2026-03-27 10:40:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 958bc99d-032a-5912-b8cb-b363884515d8 with identifier: UD88757
2026-03-27 10:40:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 958bc99d-032a-5912-b8cb-b363884515d8 with identifier: UD88757
2026-03-27 10:40:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 958bc99d-032a-5912-b8cb-b363884515d8 with identifier: UD88757 to the API
2026-03-27 10:40:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:44:55Z',
 'fuel_type': 'petrol',
 'id': '958bc99d-032a-5912-b8cb-b363884515d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD88757',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 156121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-29',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Passion',
 'transmission': 'manual',
 'trim': 'Passion',
 'year': 2018}
2026-03-27 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD88757%27 HTTP/1.1" 200 None
2026-03-27 10:40:41 [auto1.de] INFO: Saving data for UD88757: {'auction_closing_time': 1774716295.0, 'created_time': 1773774349.746941, 'last_price_update_time': 1774608041.467623}
2026-03-27 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD88757') HTTP/1.1" 204 0
2026-03-27 10:40:41 [auto1.de] INFO: Found listing with ID: EJ40099
2026-03-27 10:40:41 [auto1.de] INFO: Found listing with ID: YR07443
2026-03-27 10:40:41 [auto1.de] INFO: Found listing with ID: UJ12211
2026-03-27 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ12211%27 HTTP/1.1" 200 None
2026-03-27 10:40:41 [auto1.de] INFO: Scrape type for UJ12211: 2
2026-03-27 10:40:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4166ded8-a037-5444-9372-94f93340ebbe with identifier: UJ12211
2026-03-27 10:40:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4166ded8-a037-5444-9372-94f93340ebbe with scrape type 2
2026-03-27 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4166ded8-a037-5444-9372-94f93340ebbe with scrape type 2
2026-03-27 10:40:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4166ded8-a037-5444-9372-94f93340ebbe, identifier: UJ12211
2026-03-27 10:40:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YT12990> (referer: https://www.auto1.com/v1/car-details-view/YT12990/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_1bf2b12c95f6f0c8a4936b930c42ecca.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_00bc583172304f4384406fd64084988c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:41 [auto1.de] INFO: Found listing with ID: CR82363
2026-03-27 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR82363%27 HTTP/1.1" 200 None
2026-03-27 10:40:41 [auto1.de] INFO: Scrape type for CR82363: 2
2026-03-27 10:40:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8115376a-7023-509e-b254-34d98d67b8b8 with identifier: CR82363
2026-03-27 10:40:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8115376a-7023-509e-b254-34d98d67b8b8 with scrape type 2
2026-03-27 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8115376a-7023-509e-b254-34d98d67b8b8 with scrape type 2
2026-03-27 10:40:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8115376a-7023-509e-b254-34d98d67b8b8, identifier: CR82363
2026-03-27 10:40:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4166ded8-a037-5444-9372-94f93340ebbe with identifier: UJ12211
2026-03-27 10:40:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4166ded8-a037-5444-9372-94f93340ebbe with identifier: UJ12211
2026-03-27 10:40:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4166ded8-a037-5444-9372-94f93340ebbe with identifier: UJ12211 to the API
2026-03-27 10:40:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:50:08Z',
 'fuel_type': 'petrol',
 'id': '4166ded8-a037-5444-9372-94f93340ebbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ12211',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 149391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-18',
 'seller_name': None,
 'title': 'Renault Megane 2.0 BOSE Edition',
 'transmission': 'automatic',
 'trim': 'BOSE Edition',
 'year': 2013}
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ12211%27 HTTP/1.1" 200 None
2026-03-27 10:40:42 [auto1.de] INFO: Saving data for UJ12211: {'auction_closing_time': 1774716608.0, 'created_time': 1774265321.633389, 'last_price_update_time': 1774608042.137639}
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ12211') HTTP/1.1" 204 0
2026-03-27 10:40:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8115376a-7023-509e-b254-34d98d67b8b8 with identifier: CR82363
2026-03-27 10:40:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8115376a-7023-509e-b254-34d98d67b8b8 with identifier: CR82363
2026-03-27 10:40:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8115376a-7023-509e-b254-34d98d67b8b8 with identifier: CR82363 to the API
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:08:06Z',
 'fuel_type': 'petrol',
 'id': '8115376a-7023-509e-b254-34d98d67b8b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR82363',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 142574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-19',
 'seller_name': None,
 'title': 'BMW 1er 120i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR82363%27 HTTP/1.1" 200 None
2026-03-27 10:40:42 [auto1.de] INFO: Saving data for CR82363: {'auction_closing_time': 1774714086.0, 'created_time': 1772728201.318158, 'last_price_update_time': 1774608042.749636}
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR82363') HTTP/1.1" 204 0
2026-03-27 10:40:42 [auto1.de] INFO: Found listing with ID: DG19497
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG19497%27 HTTP/1.1" 200 None
2026-03-27 10:40:42 [auto1.de] INFO: Scrape type for DG19497: 2
2026-03-27 10:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c60f48c-22d3-5757-b4e3-533f77f027f0 with identifier: DG19497
2026-03-27 10:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c60f48c-22d3-5757-b4e3-533f77f027f0 with scrape type 2
2026-03-27 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c60f48c-22d3-5757-b4e3-533f77f027f0 with scrape type 2
2026-03-27 10:40:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c60f48c-22d3-5757-b4e3-533f77f027f0, identifier: DG19497
2026-03-27 10:40:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_b58fbd4d7533f63a8df038cf9a0191f3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:42 [auto1.de] INFO: Found listing with ID: KR04535
2026-03-27 10:40:42 [auto1.de] INFO: Found listing with ID: BA02242
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA02242%27 HTTP/1.1" 200 None
2026-03-27 10:40:42 [auto1.de] INFO: Scrape type for BA02242: 2
2026-03-27 10:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 988c78ac-9879-586e-a5ff-3af448bc5097 with identifier: BA02242
2026-03-27 10:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 988c78ac-9879-586e-a5ff-3af448bc5097 with scrape type 2
2026-03-27 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 988c78ac-9879-586e-a5ff-3af448bc5097 with scrape type 2
2026-03-27 10:40:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 988c78ac-9879-586e-a5ff-3af448bc5097, identifier: BA02242
2026-03-27 10:40:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c60f48c-22d3-5757-b4e3-533f77f027f0 with identifier: DG19497
2026-03-27 10:40:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c60f48c-22d3-5757-b4e3-533f77f027f0 with identifier: DG19497
2026-03-27 10:40:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c60f48c-22d3-5757-b4e3-533f77f027f0 with identifier: DG19497 to the API
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:20:52Z',
 'fuel_type': 'diesel',
 'id': '9c60f48c-22d3-5757-b4e3-533f77f027f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG19497',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon Shooting Brake',
 'odometer': 64528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-31',
 'seller_name': None,
 'title': 'Volkswagen Arteon Shooting Brake 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG19497%27 HTTP/1.1" 200 None
2026-03-27 10:40:43 [auto1.de] INFO: Saving data for DG19497: {'auction_closing_time': 1774714852.0, 'created_time': 1773306129.995433, 'last_price_update_time': 1774608043.329061}
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG19497') HTTP/1.1" 204 0
2026-03-27 10:40:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DT14163/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SP19687/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ87943> (referer: https://www.auto1.com/v1/car-details-view/SJ87943/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AC15853/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 988c78ac-9879-586e-a5ff-3af448bc5097 with identifier: BA02242
2026-03-27 10:40:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 988c78ac-9879-586e-a5ff-3af448bc5097 with identifier: BA02242
2026-03-27 10:40:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 988c78ac-9879-586e-a5ff-3af448bc5097 with identifier: BA02242 to the API
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:16:50Z',
 'fuel_type': 'petrol',
 'id': '988c78ac-9879-586e-a5ff-3af448bc5097',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA02242',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 184407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA02242%27 HTTP/1.1" 200 None
2026-03-27 10:40:43 [auto1.de] INFO: Saving data for BA02242: {'auction_closing_time': 1774714610.0, 'created_time': 1773861701.373535, 'last_price_update_time': 1774608043.849261}
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA02242') HTTP/1.1" 204 0
2026-03-27 10:40:43 [auto1.de] INFO: Found listing with ID: KS23837
2026-03-27 10:40:43 [auto1.de] INFO: Found listing with ID: NY67891
2026-03-27 10:40:43 [auto1.de] INFO: Found listing with ID: FY25163
2026-03-27 10:40:43 [auto1.de] INFO: Found listing with ID: UX48590
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX48590%27 HTTP/1.1" 200 None
2026-03-27 10:40:43 [auto1.de] INFO: Scrape type for UX48590: 2
2026-03-27 10:40:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da8a9319-d6d8-5622-bed5-4f22327961fe with identifier: UX48590
2026-03-27 10:40:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da8a9319-d6d8-5622-bed5-4f22327961fe with scrape type 2
2026-03-27 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da8a9319-d6d8-5622-bed5-4f22327961fe with scrape type 2
2026-03-27 10:40:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da8a9319-d6d8-5622-bed5-4f22327961fe, identifier: UX48590
2026-03-27 10:40:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:43 [auto1.de] INFO: Found listing with ID: JC63536
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC63536%27 HTTP/1.1" 200 None
2026-03-27 10:40:44 [auto1.de] INFO: Scrape type for JC63536: 2
2026-03-27 10:40:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c7f6d67-bd1a-5d06-9127-4fe4e76a209d with identifier: JC63536
2026-03-27 10:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c7f6d67-bd1a-5d06-9127-4fe4e76a209d with scrape type 2
2026-03-27 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c7f6d67-bd1a-5d06-9127-4fe4e76a209d with scrape type 2
2026-03-27 10:40:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c7f6d67-bd1a-5d06-9127-4fe4e76a209d, identifier: JC63536
2026-03-27 10:40:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da8a9319-d6d8-5622-bed5-4f22327961fe with identifier: UX48590
2026-03-27 10:40:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da8a9319-d6d8-5622-bed5-4f22327961fe with identifier: UX48590
2026-03-27 10:40:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da8a9319-d6d8-5622-bed5-4f22327961fe with identifier: UX48590 to the API
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:25:55Z',
 'fuel_type': 'petrol',
 'id': 'da8a9319-d6d8-5622-bed5-4f22327961fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX48590',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 141876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-09',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2015}
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX48590%27 HTTP/1.1" 200 None
2026-03-27 10:40:44 [auto1.de] INFO: Saving data for UX48590: {'auction_closing_time': 1774715155.0, 'created_time': 1773859300.489328, 'last_price_update_time': 1774608044.581152}
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX48590') HTTP/1.1" 204 0
2026-03-27 10:40:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33b090c3-7679-5d79-9827-15456f1a02ca with identifier: YT12990
2026-03-27 10:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33b090c3-7679-5d79-9827-15456f1a02ca with scrape type 1
2026-03-27 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 33b090c3-7679-5d79-9827-15456f1a02ca
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fa1%252F77a1799b94a5923e966972ed11b27deb%252Fpa%252FYT12990_d7a05f2b631fed8a10876001d6972092.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_d7a05f2b631fed8a10876001d6972092.jpg not downloaded yet
2026-03-27 10:40:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50168a150>
2026-03-27 10:40:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea29f7e-cce3-5300-b779-898fd8dd79f3/bea29f7e-cce3-5300-b779-898fd8dd79f3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F46%252F4c464dc6d412a2a21d980dd050dc07cb%252Fpa%252FEA40469_1bf2b12c95f6f0c8a4936b930c42ecca.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_1bf2b12c95f6f0c8a4936b930c42ecca.jpg saved to cache
2026-03-27 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bea29f7e-cce3-5300-b779-898fd8dd79f3
2026-03-27 10:40:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500573490>
2026-03-27 10:40:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bea29f7e-cce3-5300-b779-898fd8dd79f3/bea29f7e-cce3-5300-b779-898fd8dd79f3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F46%252F4c464dc6d412a2a21d980dd050dc07cb%252Fpa%252FEA40469_00bc583172304f4384406fd64084988c.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_00bc583172304f4384406fd64084988c.jpg saved to cache
2026-03-27 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bea29f7e-cce3-5300-b779-898fd8dd79f3
2026-03-27 10:40:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bea29f7e-cce3-5300-b779-898fd8dd79f3, skipping ID generation
2026-03-27 10:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bea29f7e-cce3-5300-b779-898fd8dd79f3 with scrape type 1
2026-03-27 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bea29f7e-cce3-5300-b779-898fd8dd79f3 sending to next pipeline
2026-03-27 10:40:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bea29f7e-cce3-5300-b779-898fd8dd79f3, identifier: EA40469
2026-03-27 10:40:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c7f6d67-bd1a-5d06-9127-4fe4e76a209d with identifier: JC63536
2026-03-27 10:40:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c7f6d67-bd1a-5d06-9127-4fe4e76a209d with identifier: JC63536
2026-03-27 10:40:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c7f6d67-bd1a-5d06-9127-4fe4e76a209d with identifier: JC63536 to the API
2026-03-27 10:40:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:28:57Z',
 'fuel_type': 'petrol',
 'id': '0c7f6d67-bd1a-5d06-9127-4fe4e76a209d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC63536',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 205020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-10-15',
 'seller_name': None,
 'title': 'BMW 5er 520i',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC63536%27 HTTP/1.1" 200 None
2026-03-27 10:40:45 [auto1.de] INFO: Saving data for JC63536: {'auction_closing_time': 1774715337.0, 'created_time': 1773571978.063143, 'last_price_update_time': 1774608045.205325}
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC63536') HTTP/1.1" 204 0
2026-03-27 10:40:45 [auto1.de] INFO: Found listing with ID: GT07597
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT07597%27 HTTP/1.1" 200 None
2026-03-27 10:40:45 [auto1.de] INFO: Scrape type for GT07597: 2
2026-03-27 10:40:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94618181-a007-5681-a993-99cd06fd6684 with identifier: GT07597
2026-03-27 10:40:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94618181-a007-5681-a993-99cd06fd6684 with scrape type 2
2026-03-27 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94618181-a007-5681-a993-99cd06fd6684 with scrape type 2
2026-03-27 10:40:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94618181-a007-5681-a993-99cd06fd6684, identifier: GT07597
2026-03-27 10:40:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bea29f7e-cce3-5300-b779-898fd8dd79f3 with identifier: EA40469
2026-03-27 10:40:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bea29f7e-cce3-5300-b779-898fd8dd79f3 with identifier: EA40469
2026-03-27 10:40:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bea29f7e-cce3-5300-b779-898fd8dd79f3 with identifier: EA40469 to the API
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_00bc583172304f4384406fd64084988c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:00:42Z',
 'fuel_type': 'petrol',
 'id': 'bea29f7e-cce3-5300-b779-898fd8dd79f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA40469',
 'listing': 'auction',
 'location': 'DE, Zwickau',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 142888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bea29f7e-cce3-5300-b779-898fd8dd79f3/bea29f7e-cce3-5300-b779-898fd8dd79f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_561ddb612d08ffb2bd071b3fe20a653b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bea29f7e-cce3-5300-b779-898fd8dd79f3/bea29f7e-cce3-5300-b779-898fd8dd79f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_658c6203ff5ccda6712404bc015dd38e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bea29f7e-cce3-5300-b779-898fd8dd79f3/bea29f7e-cce3-5300-b779-898fd8dd79f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_d57290df83bd8533e93e62eb684ba96f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bea29f7e-cce3-5300-b779-898fd8dd79f3/bea29f7e-cce3-5300-b779-898fd8dd79f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_36d0e0ba2f3fdacb9d3d0db3abc9ac43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bea29f7e-cce3-5300-b779-898fd8dd79f3/bea29f7e-cce3-5300-b779-898fd8dd79f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_d31be1d460385ac9e8129103eae86721.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bea29f7e-cce3-5300-b779-898fd8dd79f3/bea29f7e-cce3-5300-b779-898fd8dd79f3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_3af9102372cf9d2bc6bfe18b2aec55e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bea29f7e-cce3-5300-b779-898fd8dd79f3/bea29f7e-cce3-5300-b779-898fd8dd79f3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_016db5bbf6d7d41132becbbc64b5f328.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bea29f7e-cce3-5300-b779-898fd8dd79f3/bea29f7e-cce3-5300-b779-898fd8dd79f3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_1124ed2335c999a01f244e75758fb3d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bea29f7e-cce3-5300-b779-898fd8dd79f3/bea29f7e-cce3-5300-b779-898fd8dd79f3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_1bf2b12c95f6f0c8a4936b930c42ecca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bea29f7e-cce3-5300-b779-898fd8dd79f3/bea29f7e-cce3-5300-b779-898fd8dd79f3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/46/4c464dc6d412a2a21d980dd050dc07cb/pa/EA40469_00bc583172304f4384406fd64084988c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2013}
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA40469%27 HTTP/1.1" 200 None
2026-03-27 10:40:45 [auto1.de] INFO: Saving data for EA40469: {'created_time': 1774608045.731351, 'last_price_update_time': 1774608045.731365, 'auction_closing_time': 1774713642.0}
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA40469') HTTP/1.1" 204 0
2026-03-27 10:40:45 [auto1.de] INFO: Found listing with ID: CM33145
2026-03-27 10:40:45 [auto1.de] INFO: Found listing with ID: PE91450
2026-03-27 10:40:45 [auto1.de] INFO: Found listing with ID: KE42269
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE42269%27 HTTP/1.1" 200 None
2026-03-27 10:40:45 [auto1.de] INFO: Scrape type for KE42269: 2
2026-03-27 10:40:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09fc1083-9f78-53bc-a60f-12850c60d0cc with identifier: KE42269
2026-03-27 10:40:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09fc1083-9f78-53bc-a60f-12850c60d0cc with scrape type 2
2026-03-27 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09fc1083-9f78-53bc-a60f-12850c60d0cc with scrape type 2
2026-03-27 10:40:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09fc1083-9f78-53bc-a60f-12850c60d0cc, identifier: KE42269
2026-03-27 10:40:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94618181-a007-5681-a993-99cd06fd6684 with identifier: GT07597
2026-03-27 10:40:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94618181-a007-5681-a993-99cd06fd6684 with identifier: GT07597
2026-03-27 10:40:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94618181-a007-5681-a993-99cd06fd6684 with identifier: GT07597 to the API
2026-03-27 10:40:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:53:16Z',
 'fuel_type': 'diesel',
 'id': '94618181-a007-5681-a993-99cd06fd6684',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT07597',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 272188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-28',
 'seller_name': None,
 'title': 'BMW 5er 525d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT07597%27 HTTP/1.1" 200 None
2026-03-27 10:40:46 [auto1.de] INFO: Saving data for GT07597: {'auction_closing_time': 1774716796.0, 'created_time': 1773306241.494342, 'last_price_update_time': 1774608046.254074}
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT07597') HTTP/1.1" 204 0
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fa1%252F77a1799b94a5923e966972ed11b27deb%252Fpa%252FYT12990_dee53865df98b1a499d878cc21124f95.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_dee53865df98b1a499d878cc21124f95.jpg not downloaded yet
2026-03-27 10:40:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:40:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003f5ad0>
2026-03-27 10:40:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd8496aa-ce74-5fca-b528-3e32ab32a063/fd8496aa-ce74-5fca-b528-3e32ab32a063_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F96%252Fb0962e4192393d84e9d793056f53a550%252Fpa%252FRU59623_b58fbd4d7533f63a8df038cf9a0191f3.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_b58fbd4d7533f63a8df038cf9a0191f3.jpg saved to cache
2026-03-27 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd8496aa-ce74-5fca-b528-3e32ab32a063
2026-03-27 10:40:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1225177-117f-5078-8146-1d685e4c4fa4 with identifier: SJ87943
2026-03-27 10:40:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1225177-117f-5078-8146-1d685e4c4fa4 with scrape type 1
2026-03-27 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1225177-117f-5078-8146-1d685e4c4fa4
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Feb%252F64ebe6d6fb9c57b8fdcf738aa5190061%252Fpa%252FSJ87943_0340cb6c02caf690e4d5a3fb96fa92c8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_0340cb6c02caf690e4d5a3fb96fa92c8.jpg not downloaded yet
2026-03-27 10:40:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09fc1083-9f78-53bc-a60f-12850c60d0cc with identifier: KE42269
2026-03-27 10:40:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09fc1083-9f78-53bc-a60f-12850c60d0cc with identifier: KE42269
2026-03-27 10:40:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09fc1083-9f78-53bc-a60f-12850c60d0cc with identifier: KE42269 to the API
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:32:33Z',
 'fuel_type': 'diesel',
 'id': '09fc1083-9f78-53bc-a60f-12850c60d0cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE42269',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 111953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-07',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2017}
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE42269%27 HTTP/1.1" 200 None
2026-03-27 10:40:46 [auto1.de] INFO: Saving data for KE42269: {'auction_closing_time': 1774715553.0, 'created_time': 1774291383.186723, 'last_price_update_time': 1774608046.853636}
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE42269') HTTP/1.1" 204 0
2026-03-27 10:40:46 [auto1.de] INFO: Found listing with ID: WD77905
2026-03-27 10:40:46 [auto1.de] INFO: Found listing with ID: CY56514
2026-03-27 10:40:46 [auto1.de] INFO: Found listing with ID: ZY38898
2026-03-27 10:40:46 [auto1.de] INFO: Found listing with ID: AH37368
2026-03-27 10:40:46 [auto1.de] INFO: Found listing with ID: NX41680
2026-03-27 10:40:46 [auto1.de] INFO: Found listing with ID: CV35791
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV35791%27 HTTP/1.1" 200 None
2026-03-27 10:40:46 [auto1.de] INFO: Scrape type for CV35791: 1
2026-03-27 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LU27790> (referer: https://www.auto1.com/v1/car-details-view/LU27790/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PP43066> (referer: https://www.auto1.com/v1/car-details-view/PP43066/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VC80296/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:46 [auto1.de] INFO: Found listing with ID: BV55429
2026-03-27 10:40:46 [auto1.de] INFO: Found listing with ID: HT48359
2026-03-27 10:40:46 [auto1.de] INFO: Found listing with ID: AW26352
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26352%27 HTTP/1.1" 200 None
2026-03-27 10:40:46 [auto1.de] INFO: Scrape type for AW26352: 2
2026-03-27 10:40:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8697a5a0-d1b7-5856-bfbb-ad5b7515585c with identifier: AW26352
2026-03-27 10:40:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8697a5a0-d1b7-5856-bfbb-ad5b7515585c with scrape type 2
2026-03-27 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8697a5a0-d1b7-5856-bfbb-ad5b7515585c with scrape type 2
2026-03-27 10:40:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8697a5a0-d1b7-5856-bfbb-ad5b7515585c, identifier: AW26352
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fa1%252F77a1799b94a5923e966972ed11b27deb%252Fpa%252FYT12990_5c51213b9be386aa04589a172499cd80.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_5c51213b9be386aa04589a172499cd80.jpg not downloaded yet
2026-03-27 10:40:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Feb%252F64ebe6d6fb9c57b8fdcf738aa5190061%252Fpa%252FSJ87943_e3e5eff34bec6d61d141c9d454d68be9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_e3e5eff34bec6d61d141c9d454d68be9.jpg not downloaded yet
2026-03-27 10:40:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8697a5a0-d1b7-5856-bfbb-ad5b7515585c with identifier: AW26352
2026-03-27 10:40:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8697a5a0-d1b7-5856-bfbb-ad5b7515585c with identifier: AW26352
2026-03-27 10:40:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8697a5a0-d1b7-5856-bfbb-ad5b7515585c with identifier: AW26352 to the API
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:56:27Z',
 'fuel_type': 'petrol',
 'id': '8697a5a0-d1b7-5856-bfbb-ad5b7515585c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW26352',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 99689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-12',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TFSI Mild-Hybrid ACT S line',
 'transmission': 'automatic',
 'trim': 'ACT S line',
 'year': 2020}
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26352%27 HTTP/1.1" 200 None
2026-03-27 10:40:47 [auto1.de] INFO: Saving data for AW26352: {'auction_closing_time': 1774716987.0, 'created_time': 1773686944.960894, 'last_price_update_time': 1774608047.868182}
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW26352') HTTP/1.1" 204 0
2026-03-27 10:40:47 [auto1.de] INFO: Found listing with ID: US02416
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02416%27 HTTP/1.1" 200 None
2026-03-27 10:40:48 [auto1.de] INFO: Scrape type for US02416: 2
2026-03-27 10:40:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28a63059-8058-5728-b6e8-d885d00603d7 with identifier: US02416
2026-03-27 10:40:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28a63059-8058-5728-b6e8-d885d00603d7 with scrape type 2
2026-03-27 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28a63059-8058-5728-b6e8-d885d00603d7 with scrape type 2
2026-03-27 10:40:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28a63059-8058-5728-b6e8-d885d00603d7, identifier: US02416
2026-03-27 10:40:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_3535111604e1f08e6bcd971003ff14ad.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:48 [auto1.de] INFO: Found listing with ID: YM40569
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM40569%27 HTTP/1.1" 200 None
2026-03-27 10:40:48 [auto1.de] INFO: Scrape type for YM40569: 2
2026-03-27 10:40:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87913c5e-f7ee-5805-8e0d-3222a563c492 with identifier: YM40569
2026-03-27 10:40:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87913c5e-f7ee-5805-8e0d-3222a563c492 with scrape type 2
2026-03-27 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87913c5e-f7ee-5805-8e0d-3222a563c492 with scrape type 2
2026-03-27 10:40:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87913c5e-f7ee-5805-8e0d-3222a563c492, identifier: YM40569
2026-03-27 10:40:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28a63059-8058-5728-b6e8-d885d00603d7 with identifier: US02416
2026-03-27 10:40:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28a63059-8058-5728-b6e8-d885d00603d7 with identifier: US02416
2026-03-27 10:40:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28a63059-8058-5728-b6e8-d885d00603d7 with identifier: US02416 to the API
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:15:44Z',
 'fuel_type': 'petrol',
 'id': '28a63059-8058-5728-b6e8-d885d00603d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US02416',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 148453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-30',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2008}
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02416%27 HTTP/1.1" 200 None
2026-03-27 10:40:48 [auto1.de] INFO: Saving data for US02416: {'auction_closing_time': 1774714544.0, 'created_time': 1773307836.987222, 'last_price_update_time': 1774608048.642209}
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US02416') HTTP/1.1" 204 0
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fa1%252F77a1799b94a5923e966972ed11b27deb%252Fpa%252FYT12990_0668cf5289e1c1965666d2ece4df1c07.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_0668cf5289e1c1965666d2ece4df1c07.jpg not downloaded yet
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Feb%252F64ebe6d6fb9c57b8fdcf738aa5190061%252Fpa%252FSJ87943_2895121e2769213cc6e6ac874e7ea75c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_2895121e2769213cc6e6ac874e7ea75c.jpg not downloaded yet
2026-03-27 10:40:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87913c5e-f7ee-5805-8e0d-3222a563c492 with identifier: YM40569
2026-03-27 10:40:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87913c5e-f7ee-5805-8e0d-3222a563c492 with identifier: YM40569
2026-03-27 10:40:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87913c5e-f7ee-5805-8e0d-3222a563c492 with identifier: YM40569 to the API
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:56:51Z',
 'fuel_type': 'petrol',
 'id': '87913c5e-f7ee-5805-8e0d-3222a563c492',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM40569',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Citigo',
 'odometer': 143743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-12',
 'seller_name': None,
 'title': 'Skoda Citigo 1.0 MPI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM40569%27 HTTP/1.1" 200 None
2026-03-27 10:40:49 [auto1.de] INFO: Saving data for YM40569: {'auction_closing_time': 1774717011.0, 'created_time': 1774264127.95052, 'last_price_update_time': 1774608049.060856}
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM40569') HTTP/1.1" 204 0
2026-03-27 10:40:49 [auto1.de] INFO: Found listing with ID: HF47887
2026-03-27 10:40:49 [auto1.de] INFO: Found listing with ID: BF26414
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF26414%27 HTTP/1.1" 200 None
2026-03-27 10:40:49 [auto1.de] INFO: Scrape type for BF26414: 2
2026-03-27 10:40:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e32be1cd-98d0-5a68-bb91-97a0376e72fe with identifier: BF26414
2026-03-27 10:40:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e32be1cd-98d0-5a68-bb91-97a0376e72fe with scrape type 2
2026-03-27 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e32be1cd-98d0-5a68-bb91-97a0376e72fe with scrape type 2
2026-03-27 10:40:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e32be1cd-98d0-5a68-bb91-97a0376e72fe, identifier: BF26414
2026-03-27 10:40:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb07bd82-b0bd-5075-8364-624ab9506f2f with identifier: LU27790
2026-03-27 10:40:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb07bd82-b0bd-5075-8364-624ab9506f2f with scrape type 1
2026-03-27 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fb07bd82-b0bd-5075-8364-624ab9506f2f
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F93%252F03936b8b295f29cc3e4f5d4dfbbebd02%252Fpa%252FLU27790_b045e3c87fa3076a6085bfc74706113e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_b045e3c87fa3076a6085bfc74706113e.jpg not downloaded yet
2026-03-27 10:40:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2239d488-0849-58ee-a1e7-739c9b060fb4 with identifier: PP43066
2026-03-27 10:40:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2239d488-0849-58ee-a1e7-739c9b060fb4 with scrape type 1
2026-03-27 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2239d488-0849-58ee-a1e7-739c9b060fb4
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F45%252F8e45a499f1f9b1cd8854984e907659ef%252Fpa%252FPP43066_d5bee75bbff7847838ef1c8dcf0f2b62.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_d5bee75bbff7847838ef1c8dcf0f2b62.jpg not downloaded yet
2026-03-27 10:40:49 [auto1.de] INFO: Found listing with ID: ZP61360
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP61360%27 HTTP/1.1" 200 None
2026-03-27 10:40:49 [auto1.de] INFO: Scrape type for ZP61360: 2
2026-03-27 10:40:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5429fbce-c6cf-594a-849c-75a0c5adb0b7 with identifier: ZP61360
2026-03-27 10:40:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5429fbce-c6cf-594a-849c-75a0c5adb0b7 with scrape type 2
2026-03-27 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5429fbce-c6cf-594a-849c-75a0c5adb0b7 with scrape type 2
2026-03-27 10:40:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5429fbce-c6cf-594a-849c-75a0c5adb0b7, identifier: ZP61360
2026-03-27 10:40:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e32be1cd-98d0-5a68-bb91-97a0376e72fe with identifier: BF26414
2026-03-27 10:40:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e32be1cd-98d0-5a68-bb91-97a0376e72fe with identifier: BF26414
2026-03-27 10:40:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e32be1cd-98d0-5a68-bb91-97a0376e72fe with identifier: BF26414 to the API
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:56:03Z',
 'fuel_type': 'diesel',
 'id': 'e32be1cd-98d0-5a68-bb91-97a0376e72fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF26414',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 140735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-04',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2019}
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF26414%27 HTTP/1.1" 200 None
2026-03-27 10:40:49 [auto1.de] INFO: Saving data for BF26414: {'auction_closing_time': 1774716963.0, 'created_time': 1773306051.811419, 'last_price_update_time': 1774608049.719821}
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF26414') HTTP/1.1" 204 0
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fa1%252F77a1799b94a5923e966972ed11b27deb%252Fpa%252FYT12990_2a3134b3cd88d93cca047e2e0cfb57bb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_2a3134b3cd88d93cca047e2e0cfb57bb.jpg not downloaded yet
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Feb%252F64ebe6d6fb9c57b8fdcf738aa5190061%252Fpa%252FSJ87943_ae29fd398c26824db1244db4a4b2bf35.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_ae29fd398c26824db1244db4a4b2bf35.jpg not downloaded yet
2026-03-27 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RG76834> (referer: https://www.auto1.com/v1/car-details-view/RG76834/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5429fbce-c6cf-594a-849c-75a0c5adb0b7 with identifier: ZP61360
2026-03-27 10:40:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5429fbce-c6cf-594a-849c-75a0c5adb0b7 with identifier: ZP61360
2026-03-27 10:40:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5429fbce-c6cf-594a-849c-75a0c5adb0b7 with identifier: ZP61360 to the API
2026-03-27 10:40:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:45:41Z',
 'fuel_type': 'petrol',
 'id': '5429fbce-c6cf-594a-849c-75a0c5adb0b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP61360',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 142946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-31',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Cool Edition',
 'transmission': 'manual',
 'trim': 'Cool Edition',
 'year': 2009}
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP61360%27 HTTP/1.1" 200 None
2026-03-27 10:40:50 [auto1.de] INFO: Saving data for ZP61360: {'auction_closing_time': 1774716341.0, 'created_time': 1774251393.89176, 'last_price_update_time': 1774608050.129834}
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP61360') HTTP/1.1" 204 0
2026-03-27 10:40:50 [auto1.de] INFO: Found listing with ID: GM59511
2026-03-27 10:40:50 [auto1.de] INFO: Found listing with ID: WP35313
2026-03-27 10:40:50 [auto1.de] INFO: Found listing with ID: AU29418
2026-03-27 10:40:50 [auto1.de] INFO: Found listing with ID: BR24647
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR24647%27 HTTP/1.1" 200 None
2026-03-27 10:40:50 [auto1.de] INFO: Scrape type for BR24647: 2
2026-03-27 10:40:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 867c14e7-d7da-5f28-89f0-2b601d5d4351 with identifier: BR24647
2026-03-27 10:40:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 867c14e7-d7da-5f28-89f0-2b601d5d4351 with scrape type 2
2026-03-27 10:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 867c14e7-d7da-5f28-89f0-2b601d5d4351 with scrape type 2
2026-03-27 10:40:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 867c14e7-d7da-5f28-89f0-2b601d5d4351, identifier: BR24647
2026-03-27 10:40:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F93%252F03936b8b295f29cc3e4f5d4dfbbebd02%252Fpa%252FLU27790_29b9abd9f50d02cde910939d46304051.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_29b9abd9f50d02cde910939d46304051.jpg not downloaded yet
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F45%252F8e45a499f1f9b1cd8854984e907659ef%252Fpa%252FPP43066_abbc2ac553c5e9cd35a4695855d72698.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_abbc2ac553c5e9cd35a4695855d72698.jpg not downloaded yet
2026-03-27 10:40:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:40:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018aedd0>
2026-03-27 10:40:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd8496aa-ce74-5fca-b528-3e32ab32a063/fd8496aa-ce74-5fca-b528-3e32ab32a063_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F96%252Fb0962e4192393d84e9d793056f53a550%252Fpa%252FRU59623_3535111604e1f08e6bcd971003ff14ad.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_3535111604e1f08e6bcd971003ff14ad.jpg saved to cache
2026-03-27 10:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fd8496aa-ce74-5fca-b528-3e32ab32a063
2026-03-27 10:40:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_0340cb6c02caf690e4d5a3fb96fa92c8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:50 [auto1.de] INFO: Found listing with ID: AE71125
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE71125%27 HTTP/1.1" 200 None
2026-03-27 10:40:50 [auto1.de] INFO: Scrape type for AE71125: 2
2026-03-27 10:40:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b489831-986d-54d2-a55c-242345021697 with identifier: AE71125
2026-03-27 10:40:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b489831-986d-54d2-a55c-242345021697 with scrape type 2
2026-03-27 10:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b489831-986d-54d2-a55c-242345021697 with scrape type 2
2026-03-27 10:40:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b489831-986d-54d2-a55c-242345021697, identifier: AE71125
2026-03-27 10:40:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 867c14e7-d7da-5f28-89f0-2b601d5d4351 with identifier: BR24647
2026-03-27 10:40:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 867c14e7-d7da-5f28-89f0-2b601d5d4351 with identifier: BR24647
2026-03-27 10:40:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 867c14e7-d7da-5f28-89f0-2b601d5d4351 with identifier: BR24647 to the API
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:42:28Z',
 'fuel_type': 'petrol',
 'id': '867c14e7-d7da-5f28-89f0-2b601d5d4351',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR24647',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 30706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2021}
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR24647%27 HTTP/1.1" 200 None
2026-03-27 10:40:50 [auto1.de] INFO: Saving data for BR24647: {'auction_closing_time': 1774716148.0, 'created_time': 1773302856.422645, 'last_price_update_time': 1774608050.995938}
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR24647') HTTP/1.1" 204 0
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fa1%252F77a1799b94a5923e966972ed11b27deb%252Fpa%252FYT12990_bd2d2e01832dd075b9690614dcc66c96.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_bd2d2e01832dd075b9690614dcc66c96.jpg not downloaded yet
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Feb%252F64ebe6d6fb9c57b8fdcf738aa5190061%252Fpa%252FSJ87943_0266816d277d1a2dbcda541117f35c17.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_0266816d277d1a2dbcda541117f35c17.jpg not downloaded yet
2026-03-27 10:40:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b489831-986d-54d2-a55c-242345021697 with identifier: AE71125
2026-03-27 10:40:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b489831-986d-54d2-a55c-242345021697 with identifier: AE71125
2026-03-27 10:40:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b489831-986d-54d2-a55c-242345021697 with identifier: AE71125 to the API
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:21:00Z',
 'fuel_type': 'diesel',
 'id': '2b489831-986d-54d2-a55c-242345021697',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE71125',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 248477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-01',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Edition Classic',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Edition Classic',
 'year': 2014}
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE71125%27 HTTP/1.1" 200 None
2026-03-27 10:40:51 [auto1.de] INFO: Saving data for AE71125: {'auction_closing_time': 1774714860.0, 'created_time': 1774293902.057252, 'last_price_update_time': 1774608051.394148}
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE71125') HTTP/1.1" 204 0
2026-03-27 10:40:51 [auto1.de] INFO: Found listing with ID: WX13584
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX13584%27 HTTP/1.1" 200 None
2026-03-27 10:40:51 [auto1.de] INFO: Scrape type for WX13584: 2
2026-03-27 10:40:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e93d99ec-6416-560c-8d3d-f92d0d7a68b5 with identifier: WX13584
2026-03-27 10:40:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e93d99ec-6416-560c-8d3d-f92d0d7a68b5 with scrape type 2
2026-03-27 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e93d99ec-6416-560c-8d3d-f92d0d7a68b5 with scrape type 2
2026-03-27 10:40:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e93d99ec-6416-560c-8d3d-f92d0d7a68b5, identifier: WX13584
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F93%252F03936b8b295f29cc3e4f5d4dfbbebd02%252Fpa%252FLU27790_298062d9221afdc082c402dc255d9061.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_298062d9221afdc082c402dc255d9061.jpg not downloaded yet
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F45%252F8e45a499f1f9b1cd8854984e907659ef%252Fpa%252FPP43066_a4f9a527c131b2f56d2ab2741e820022.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_a4f9a527c131b2f56d2ab2741e820022.jpg not downloaded yet
2026-03-27 10:40:51 [auto1.de] INFO: Found listing with ID: TF25150
2026-03-27 10:40:51 [auto1.de] INFO: Found listing with ID: HS66521
2026-03-27 10:40:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e93d99ec-6416-560c-8d3d-f92d0d7a68b5 with identifier: WX13584
2026-03-27 10:40:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e93d99ec-6416-560c-8d3d-f92d0d7a68b5 with identifier: WX13584
2026-03-27 10:40:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e93d99ec-6416-560c-8d3d-f92d0d7a68b5 with identifier: WX13584 to the API
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:39:47Z',
 'fuel_type': 'petrol',
 'id': 'e93d99ec-6416-560c-8d3d-f92d0d7a68b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX13584',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 49057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-21',
 'seller_name': None,
 'title': 'Fiat 500 0.9 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2018}
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX13584%27 HTTP/1.1" 200 None
2026-03-27 10:40:52 [auto1.de] INFO: Saving data for WX13584: {'auction_closing_time': 1774715987.0, 'created_time': 1774292306.281234, 'last_price_update_time': 1774608052.032506}
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX13584') HTTP/1.1" 204 0
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fa1%252F77a1799b94a5923e966972ed11b27deb%252Fpa%252FYT12990_ec2e911734ce8cc1d4acbb4c019bcac6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_ec2e911734ce8cc1d4acbb4c019bcac6.jpg not downloaded yet
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Feb%252F64ebe6d6fb9c57b8fdcf738aa5190061%252Fpa%252FSJ87943_5859a07e609596eceeb7b6744d463f4a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_5859a07e609596eceeb7b6744d463f4a.jpg not downloaded yet
2026-03-27 10:40:52 [auto1.de] INFO: Found listing with ID: CV64840
2026-03-27 10:40:52 [auto1.de] INFO: Found listing with ID: MV92547
2026-03-27 10:40:52 [auto1.de] INFO: Found listing with ID: RX49945
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX49945%27 HTTP/1.1" 200 None
2026-03-27 10:40:52 [auto1.de] INFO: Scrape type for RX49945: 2
2026-03-27 10:40:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c519ae2b-43ea-5bcb-bf09-a230dbcded80 with identifier: RX49945
2026-03-27 10:40:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c519ae2b-43ea-5bcb-bf09-a230dbcded80 with scrape type 2
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c519ae2b-43ea-5bcb-bf09-a230dbcded80 with scrape type 2
2026-03-27 10:40:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c519ae2b-43ea-5bcb-bf09-a230dbcded80, identifier: RX49945
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F93%252F03936b8b295f29cc3e4f5d4dfbbebd02%252Fpa%252FLU27790_b0cf5367367872b483371d7321de90d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_b0cf5367367872b483371d7321de90d6.jpg not downloaded yet
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F45%252F8e45a499f1f9b1cd8854984e907659ef%252Fpa%252FPP43066_528399ba51e7eecb79f56831151c586c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_528399ba51e7eecb79f56831151c586c.jpg not downloaded yet
2026-03-27 10:40:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c519ae2b-43ea-5bcb-bf09-a230dbcded80 with identifier: RX49945
2026-03-27 10:40:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c519ae2b-43ea-5bcb-bf09-a230dbcded80 with identifier: RX49945
2026-03-27 10:40:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c519ae2b-43ea-5bcb-bf09-a230dbcded80 with identifier: RX49945 to the API
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 199,
 'expiration_date': '2026-03-28T16:37:25Z',
 'fuel_type': 'diesel',
 'id': 'c519ae2b-43ea-5bcb-bf09-a230dbcded80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX49945',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 84708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-07',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Generation Six 4Motion',
 'transmission': 'automatic',
 'trim': 'Generation Six 4Motion',
 'year': 2019}
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX49945%27 HTTP/1.1" 200 None
2026-03-27 10:40:52 [auto1.de] INFO: Saving data for RX49945: {'auction_closing_time': 1774715845.0, 'created_time': 1773307362.034399, 'last_price_update_time': 1774608052.745803}
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX49945') HTTP/1.1" 204 0
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fa1%252F77a1799b94a5923e966972ed11b27deb%252Fpa%252FYT12990_87945a85d6993e53284d8f652ce5741b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_87945a85d6993e53284d8f652ce5741b.jpg not downloaded yet
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Feb%252F64ebe6d6fb9c57b8fdcf738aa5190061%252Fpa%252FSJ87943_9ae67efff1eb4942e9434e08ab6cd549.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_9ae67efff1eb4942e9434e08ab6cd549.jpg not downloaded yet
2026-03-27 10:40:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba9fe0ef-8338-5fda-b3fd-dac274aa566a with identifier: RG76834
2026-03-27 10:40:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba9fe0ef-8338-5fda-b3fd-dac274aa566a with scrape type 1
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item ba9fe0ef-8338-5fda-b3fd-dac274aa566a
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F43%252F20430613f230aeec2298fad05eb40650%252Fpa%252FRG76834_938fd27387841b98e89f545452eca3c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/43/20430613f230aeec2298fad05eb40650/pa/RG76834_938fd27387841b98e89f545452eca3c5.jpg already downloaded
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F43%252F20430613f230aeec2298fad05eb40650%252Fpa%252FRG76834_7dd9c1c51e98f02a68ba50e2d68a103b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/43/20430613f230aeec2298fad05eb40650/pa/RG76834_7dd9c1c51e98f02a68ba50e2d68a103b.jpg already downloaded
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F43%252F20430613f230aeec2298fad05eb40650%252Fpa%252FRG76834_c06d97c7e2a054dca21f2365a6909756.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/43/20430613f230aeec2298fad05eb40650/pa/RG76834_c06d97c7e2a054dca21f2365a6909756.jpg already downloaded
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F43%252F20430613f230aeec2298fad05eb40650%252Fpa%252FRG76834_6c488fe9a849d282a203119dfdc11605.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/43/20430613f230aeec2298fad05eb40650/pa/RG76834_6c488fe9a849d282a203119dfdc11605.jpg already downloaded
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F43%252F20430613f230aeec2298fad05eb40650%252Fpa%252FRG76834_d4756a9c2bf0fef532361492264d4609.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/43/20430613f230aeec2298fad05eb40650/pa/RG76834_d4756a9c2bf0fef532361492264d4609.jpg already downloaded
2026-03-27 10:40:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba9fe0ef-8338-5fda-b3fd-dac274aa566a, identifier: RG76834
2026-03-27 10:40:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501765a90>
2026-03-27 10:40:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1225177-117f-5078-8146-1d685e4c4fa4/d1225177-117f-5078-8146-1d685e4c4fa4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Feb%252F64ebe6d6fb9c57b8fdcf738aa5190061%252Fpa%252FSJ87943_0340cb6c02caf690e4d5a3fb96fa92c8.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_0340cb6c02caf690e4d5a3fb96fa92c8.jpg saved to cache
2026-03-27 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1225177-117f-5078-8146-1d685e4c4fa4
2026-03-27 10:40:53 [auto1.de] INFO: Found listing with ID: KM67977
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM67977%27 HTTP/1.1" 200 None
2026-03-27 10:40:53 [auto1.de] INFO: Scrape type for KM67977: 2
2026-03-27 10:40:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06d80ea7-a34e-5aae-afcf-dff2e9401bda with identifier: KM67977
2026-03-27 10:40:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06d80ea7-a34e-5aae-afcf-dff2e9401bda with scrape type 2
2026-03-27 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06d80ea7-a34e-5aae-afcf-dff2e9401bda with scrape type 2
2026-03-27 10:40:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06d80ea7-a34e-5aae-afcf-dff2e9401bda, identifier: KM67977
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F93%252F03936b8b295f29cc3e4f5d4dfbbebd02%252Fpa%252FLU27790_3700d1f79499df65e20c28d0cfb97789.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_3700d1f79499df65e20c28d0cfb97789.jpg not downloaded yet
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F45%252F8e45a499f1f9b1cd8854984e907659ef%252Fpa%252FPP43066_33596dae1152b516d4a089583f6f1135.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_33596dae1152b516d4a089583f6f1135.jpg not downloaded yet
2026-03-27 10:40:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba9fe0ef-8338-5fda-b3fd-dac274aa566a with identifier: RG76834
2026-03-27 10:40:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba9fe0ef-8338-5fda-b3fd-dac274aa566a with identifier: RG76834
2026-03-27 10:40:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba9fe0ef-8338-5fda-b3fd-dac274aa566a with identifier: RG76834 to the API
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RG76834>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:32:04Z',
 'fuel_type': 'petrol',
 'id': 'ba9fe0ef-8338-5fda-b3fd-dac274aa566a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG76834',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 133356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img20/43/20430613f230aeec2298fad05eb40650/pa/RG76834_938fd27387841b98e89f545452eca3c5.jpg',
                'https://img-pa.auto1.com/img20/43/20430613f230aeec2298fad05eb40650/pa/RG76834_7dd9c1c51e98f02a68ba50e2d68a103b.jpg',
                'https://img-pa.auto1.com/img20/43/20430613f230aeec2298fad05eb40650/pa/RG76834_c06d97c7e2a054dca21f2365a6909756.jpg',
                'https://img-pa.auto1.com/img20/43/20430613f230aeec2298fad05eb40650/pa/RG76834_6c488fe9a849d282a203119dfdc11605.jpg',
                'https://img-pa.auto1.com/img20/43/20430613f230aeec2298fad05eb40650/pa/RG76834_d4756a9c2bf0fef532361492264d4609.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9fe0ef-8338-5fda-b3fd-dac274aa566a/ba9fe0ef-8338-5fda-b3fd-dac274aa566a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/43/20430613f230aeec2298fad05eb40650/pa/RG76834_938fd27387841b98e89f545452eca3c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9fe0ef-8338-5fda-b3fd-dac274aa566a/ba9fe0ef-8338-5fda-b3fd-dac274aa566a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/43/20430613f230aeec2298fad05eb40650/pa/RG76834_7dd9c1c51e98f02a68ba50e2d68a103b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9fe0ef-8338-5fda-b3fd-dac274aa566a/ba9fe0ef-8338-5fda-b3fd-dac274aa566a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/43/20430613f230aeec2298fad05eb40650/pa/RG76834_c06d97c7e2a054dca21f2365a6909756.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9fe0ef-8338-5fda-b3fd-dac274aa566a/ba9fe0ef-8338-5fda-b3fd-dac274aa566a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/43/20430613f230aeec2298fad05eb40650/pa/RG76834_6c488fe9a849d282a203119dfdc11605.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9fe0ef-8338-5fda-b3fd-dac274aa566a/ba9fe0ef-8338-5fda-b3fd-dac274aa566a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/43/20430613f230aeec2298fad05eb40650/pa/RG76834_d4756a9c2bf0fef532361492264d4609.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Jazz 1.2 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG76834%27 HTTP/1.1" 200 None
2026-03-27 10:40:53 [auto1.de] INFO: Saving data for RG76834: {'created_time': 1774608053.998473, 'last_price_update_time': 1774608053.998484, 'auction_closing_time': 1774715524.0}
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG76834') HTTP/1.1" 204 0
2026-03-27 10:40:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06d80ea7-a34e-5aae-afcf-dff2e9401bda with identifier: KM67977
2026-03-27 10:40:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06d80ea7-a34e-5aae-afcf-dff2e9401bda with identifier: KM67977
2026-03-27 10:40:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06d80ea7-a34e-5aae-afcf-dff2e9401bda with identifier: KM67977 to the API
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:37:49Z',
 'fuel_type': 'diesel',
 'id': '06d80ea7-a34e-5aae-afcf-dff2e9401bda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM67977',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 144554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-28',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Alltrack BlueMotion 4Motion',
 'transmission': 'automatic',
 'trim': 'Alltrack BlueMotion 4Motion',
 'year': 2017}
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM67977%27 HTTP/1.1" 200 None
2026-03-27 10:40:54 [auto1.de] INFO: Saving data for KM67977: {'auction_closing_time': 1774715869.0, 'created_time': 1774264835.565672, 'last_price_update_time': 1774608054.357305}
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM67977') HTTP/1.1" 204 0
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fa1%252F77a1799b94a5923e966972ed11b27deb%252Fpa%252FYT12990_d2f6362f989f6f1a9c2ffc0de7f694e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_d2f6362f989f6f1a9c2ffc0de7f694e5.jpg not downloaded yet
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Feb%252F64ebe6d6fb9c57b8fdcf738aa5190061%252Fpa%252FSJ87943_4b676e708d21a6c6ff0b921537af9609.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_4b676e708d21a6c6ff0b921537af9609.jpg not downloaded yet
2026-03-27 10:40:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_7a93cdd858b0e85f6534958395f94457.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:54 [auto1.de] INFO: Found listing with ID: NK53054
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK53054%27 HTTP/1.1" 200 None
2026-03-27 10:40:54 [auto1.de] INFO: Scrape type for NK53054: 1
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F93%252F03936b8b295f29cc3e4f5d4dfbbebd02%252Fpa%252FLU27790_b0ed413aa50e1367d327674ec2b2a48e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_b0ed413aa50e1367d327674ec2b2a48e.jpg not downloaded yet
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F45%252F8e45a499f1f9b1cd8854984e907659ef%252Fpa%252FPP43066_32efd7a14e30c39eab808e6491aed3ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_32efd7a14e30c39eab808e6491aed3ea.jpg not downloaded yet
2026-03-27 10:40:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV46432/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JW30909/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC79950/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fa1%252F77a1799b94a5923e966972ed11b27deb%252Fpa%252FYT12990_e7412c8f8a5ee5930f390eea8279856e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_e7412c8f8a5ee5930f390eea8279856e.jpg not downloaded yet
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Feb%252F64ebe6d6fb9c57b8fdcf738aa5190061%252Fpa%252FSJ87943_acddc06ee17bed8d5da6c288437bb04e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_acddc06ee17bed8d5da6c288437bb04e.jpg not downloaded yet
2026-03-27 10:40:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:54 [auto1.de] INFO: Found listing with ID: ND18169
2026-03-27 10:40:54 [auto1.de] INFO: Found listing with ID: JM73266
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM73266%27 HTTP/1.1" 200 None
2026-03-27 10:40:54 [auto1.de] INFO: Scrape type for JM73266: 2
2026-03-27 10:40:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aebe9bb2-caa1-56ab-8a0c-652c0810d20a with identifier: JM73266
2026-03-27 10:40:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aebe9bb2-caa1-56ab-8a0c-652c0810d20a with scrape type 2
2026-03-27 10:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aebe9bb2-caa1-56ab-8a0c-652c0810d20a with scrape type 2
2026-03-27 10:40:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aebe9bb2-caa1-56ab-8a0c-652c0810d20a, identifier: JM73266
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F93%252F03936b8b295f29cc3e4f5d4dfbbebd02%252Fpa%252FLU27790_f8b8d3ac58e27b41030c0f15ffa3dac3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_f8b8d3ac58e27b41030c0f15ffa3dac3.jpg not downloaded yet
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F45%252F8e45a499f1f9b1cd8854984e907659ef%252Fpa%252FPP43066_3d33f2a73d28749588f48cb248755e21.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_3d33f2a73d28749588f48cb248755e21.jpg not downloaded yet
2026-03-27 10:40:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aebe9bb2-caa1-56ab-8a0c-652c0810d20a with identifier: JM73266
2026-03-27 10:40:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aebe9bb2-caa1-56ab-8a0c-652c0810d20a with identifier: JM73266
2026-03-27 10:40:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aebe9bb2-caa1-56ab-8a0c-652c0810d20a with identifier: JM73266 to the API
2026-03-27 10:40:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:56:37Z',
 'fuel_type': 'diesel',
 'id': 'aebe9bb2-caa1-56ab-8a0c-652c0810d20a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM73266',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 278252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-27',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'manual',
 'trim': 'RS',
 'year': 2015}
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM73266%27 HTTP/1.1" 200 None
2026-03-27 10:40:55 [auto1.de] INFO: Saving data for JM73266: {'auction_closing_time': 1774716997.0, 'created_time': 1773686258.796828, 'last_price_update_time': 1774608055.264243}
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM73266') HTTP/1.1" 204 0
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Feb%252F64ebe6d6fb9c57b8fdcf738aa5190061%252Fpa%252FSJ87943_77e938b9b20e636177f9ab7b1643f9ec.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_77e938b9b20e636177f9ab7b1643f9ec.jpg not downloaded yet
2026-03-27 10:40:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_33596dae1152b516d4a089583f6f1135.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:55 [auto1.de] INFO: Found listing with ID: UE28952
2026-03-27 10:40:55 [auto1.de] INFO: Found listing with ID: RZ86023
2026-03-27 10:40:55 [auto1.de] INFO: Found listing with ID: JV63052
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV63052%27 HTTP/1.1" 200 None
2026-03-27 10:40:55 [auto1.de] INFO: Scrape type for JV63052: 2
2026-03-27 10:40:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2775f533-8a1d-568a-9f06-dabd22d7b9b8 with identifier: JV63052
2026-03-27 10:40:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2775f533-8a1d-568a-9f06-dabd22d7b9b8 with scrape type 2
2026-03-27 10:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2775f533-8a1d-568a-9f06-dabd22d7b9b8 with scrape type 2
2026-03-27 10:40:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2775f533-8a1d-568a-9f06-dabd22d7b9b8, identifier: JV63052
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F93%252F03936b8b295f29cc3e4f5d4dfbbebd02%252Fpa%252FLU27790_124180c90f79767a3b5d10b8a96b5e7e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_124180c90f79767a3b5d10b8a96b5e7e.jpg not downloaded yet
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F45%252F8e45a499f1f9b1cd8854984e907659ef%252Fpa%252FPP43066_18f397d6cd20163078b226dcff167194.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_18f397d6cd20163078b226dcff167194.jpg not downloaded yet
2026-03-27 10:40:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2775f533-8a1d-568a-9f06-dabd22d7b9b8 with identifier: JV63052
2026-03-27 10:40:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2775f533-8a1d-568a-9f06-dabd22d7b9b8 with identifier: JV63052
2026-03-27 10:40:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2775f533-8a1d-568a-9f06-dabd22d7b9b8 with identifier: JV63052 to the API
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:13:13Z',
 'fuel_type': 'hybrid',
 'id': '2775f533-8a1d-568a-9f06-dabd22d7b9b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV63052',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 109185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-27',
 'seller_name': None,
 'title': 'Skoda Superb 1.4 Plug-in Hybrid Sportline iV',
 'transmission': 'automatic',
 'trim': 'Sportline iV',
 'year': 2021}
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV63052%27 HTTP/1.1" 200 None
2026-03-27 10:40:55 [auto1.de] INFO: Saving data for JV63052: {'auction_closing_time': 1774714393.0, 'created_time': 1773304030.229244, 'last_price_update_time': 1774608055.859408}
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV63052') HTTP/1.1" 204 0
2026-03-27 10:40:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:40:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501765c90>
2026-03-27 10:40:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd8496aa-ce74-5fca-b528-3e32ab32a063/fd8496aa-ce74-5fca-b528-3e32ab32a063_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F96%252Fb0962e4192393d84e9d793056f53a550%252Fpa%252FRU59623_7a93cdd858b0e85f6534958395f94457.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_7a93cdd858b0e85f6534958395f94457.jpg saved to cache
2026-03-27 10:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fd8496aa-ce74-5fca-b528-3e32ab32a063
2026-03-27 10:40:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd8496aa-ce74-5fca-b528-3e32ab32a063, skipping ID generation
2026-03-27 10:40:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd8496aa-ce74-5fca-b528-3e32ab32a063 with scrape type 1
2026-03-27 10:40:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd8496aa-ce74-5fca-b528-3e32ab32a063 sending to next pipeline
2026-03-27 10:40:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd8496aa-ce74-5fca-b528-3e32ab32a063, identifier: RU59623
2026-03-27 10:40:56 [auto1.de] INFO: Channel: 24h | Page: 17 | totalHits: 10514 | hits on page: 40
2026-03-27 10:40:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_32efd7a14e30c39eab808e6491aed3ea.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_4b676e708d21a6c6ff0b921537af9609.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:56 [auto1.de] INFO: Found listing with ID: ML83071
2026-03-27 10:40:56 [auto1.de] INFO: Found listing with ID: DF17432
2026-03-27 10:40:56 [auto1.de] INFO: Found listing with ID: JH37191
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH37191%27 HTTP/1.1" 200 None
2026-03-27 10:40:56 [auto1.de] INFO: Scrape type for JH37191: 2
2026-03-27 10:40:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1bd3a18-e3ab-51c4-be0b-f9150f153f4e with identifier: JH37191
2026-03-27 10:40:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1bd3a18-e3ab-51c4-be0b-f9150f153f4e with scrape type 2
2026-03-27 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1bd3a18-e3ab-51c4-be0b-f9150f153f4e with scrape type 2
2026-03-27 10:40:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1bd3a18-e3ab-51c4-be0b-f9150f153f4e, identifier: JH37191
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F93%252F03936b8b295f29cc3e4f5d4dfbbebd02%252Fpa%252FLU27790_e6b71954af3a0003494d6bf8ec8b21ab.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_e6b71954af3a0003494d6bf8ec8b21ab.jpg not downloaded yet
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F45%252F8e45a499f1f9b1cd8854984e907659ef%252Fpa%252FPP43066_8e9007513d0ffeeb4d8bb9762099fa55.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_8e9007513d0ffeeb4d8bb9762099fa55.jpg not downloaded yet
2026-03-27 10:40:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd8496aa-ce74-5fca-b528-3e32ab32a063 with identifier: RU59623
2026-03-27 10:40:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd8496aa-ce74-5fca-b528-3e32ab32a063 with identifier: RU59623
2026-03-27 10:40:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd8496aa-ce74-5fca-b528-3e32ab32a063 with identifier: RU59623 to the API
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_7a93cdd858b0e85f6534958395f94457.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:27:48Z',
 'fuel_type': 'diesel',
 'id': 'fd8496aa-ce74-5fca-b528-3e32ab32a063',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU59623',
 'listing': 'auction',
 'location': 'DE, Bad Neuenahr-Ahrweiler',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 249799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd8496aa-ce74-5fca-b528-3e32ab32a063/fd8496aa-ce74-5fca-b528-3e32ab32a063_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_9fb1a2392e30f07224d4755899fbea14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd8496aa-ce74-5fca-b528-3e32ab32a063/fd8496aa-ce74-5fca-b528-3e32ab32a063_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_d8b4e598127815c6b0d30b67f709d307.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd8496aa-ce74-5fca-b528-3e32ab32a063/fd8496aa-ce74-5fca-b528-3e32ab32a063_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_8f15222f8078f817c188f39f8903760b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd8496aa-ce74-5fca-b528-3e32ab32a063/fd8496aa-ce74-5fca-b528-3e32ab32a063_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2713501,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_b58fbd4d7533f63a8df038cf9a0191f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd8496aa-ce74-5fca-b528-3e32ab32a063/fd8496aa-ce74-5fca-b528-3e32ab32a063_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_a1880c3eb2371ddbd5f40f91238b9e54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd8496aa-ce74-5fca-b528-3e32ab32a063/fd8496aa-ce74-5fca-b528-3e32ab32a063_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_68f93287dc0e142bcd7867288f7f5da8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd8496aa-ce74-5fca-b528-3e32ab32a063/fd8496aa-ce74-5fca-b528-3e32ab32a063_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_4beec568a2d1ea9acc1de270c200dba3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd8496aa-ce74-5fca-b528-3e32ab32a063/fd8496aa-ce74-5fca-b528-3e32ab32a063_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_a5e3b91a00676341d286cbab581c278e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd8496aa-ce74-5fca-b528-3e32ab32a063/fd8496aa-ce74-5fca-b528-3e32ab32a063_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2644348,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_3535111604e1f08e6bcd971003ff14ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd8496aa-ce74-5fca-b528-3e32ab32a063/fd8496aa-ce74-5fca-b528-3e32ab32a063_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2683979,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/96/b0962e4192393d84e9d793056f53a550/pa/RU59623_7a93cdd858b0e85f6534958395f94457.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Lounge Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge Sport & Style BlueMotion Tech',
 'year': 2015}
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU59623%27 HTTP/1.1" 200 None
2026-03-27 10:40:56 [auto1.de] INFO: Saving data for RU59623: {'created_time': 1774608056.658455, 'last_price_update_time': 1774608056.658466, 'auction_closing_time': 1774715268.0}
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU59623') HTTP/1.1" 204 0
2026-03-27 10:40:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1bd3a18-e3ab-51c4-be0b-f9150f153f4e with identifier: JH37191
2026-03-27 10:40:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1bd3a18-e3ab-51c4-be0b-f9150f153f4e with identifier: JH37191
2026-03-27 10:40:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1bd3a18-e3ab-51c4-be0b-f9150f153f4e with identifier: JH37191 to the API
2026-03-27 10:40:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:23:27Z',
 'fuel_type': 'petrol',
 'id': 'a1bd3a18-e3ab-51c4-be0b-f9150f153f4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH37191',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 123424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-12',
 'seller_name': None,
 'title': 'Renault Captur 0.9 Energy Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2017}
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH37191%27 HTTP/1.1" 200 None
2026-03-27 10:40:57 [auto1.de] INFO: Saving data for JH37191: {'auction_closing_time': 1774715007.0, 'created_time': 1773305419.374864, 'last_price_update_time': 1774608057.13181}
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH37191') HTTP/1.1" 204 0
2026-03-27 10:40:57 [auto1.de] INFO: Found listing with ID: NB05774
2026-03-27 10:40:57 [auto1.de] INFO: Found listing with ID: BS14183
2026-03-27 10:40:57 [auto1.de] INFO: Found listing with ID: YN10477
2026-03-27 10:40:57 [auto1.de] INFO: Found listing with ID: FD55088
2026-03-27 10:40:57 [auto1.de] INFO: Found listing with ID: KJ55573
2026-03-27 10:40:57 [auto1.de] INFO: Found listing with ID: TJ39363
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ39363%27 HTTP/1.1" 200 None
2026-03-27 10:40:57 [auto1.de] INFO: Scrape type for TJ39363: 2
2026-03-27 10:40:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97a649c8-8819-5f61-b364-b382601f4676 with identifier: TJ39363
2026-03-27 10:40:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97a649c8-8819-5f61-b364-b382601f4676 with scrape type 2
2026-03-27 10:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97a649c8-8819-5f61-b364-b382601f4676 with scrape type 2
2026-03-27 10:40:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97a649c8-8819-5f61-b364-b382601f4676, identifier: TJ39363
2026-03-27 10:40:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501843ad0>
2026-03-27 10:40:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2239d488-0849-58ee-a1e7-739c9b060fb4/2239d488-0849-58ee-a1e7-739c9b060fb4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F45%252F8e45a499f1f9b1cd8854984e907659ef%252Fpa%252FPP43066_33596dae1152b516d4a089583f6f1135.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_33596dae1152b516d4a089583f6f1135.jpg saved to cache
2026-03-27 10:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2239d488-0849-58ee-a1e7-739c9b060fb4
2026-03-27 10:40:57 [auto1.de] INFO: Found listing with ID: CZ66164
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ66164%27 HTTP/1.1" 200 None
2026-03-27 10:40:57 [auto1.de] INFO: Scrape type for CZ66164: 2
2026-03-27 10:40:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6925f432-851a-527b-9873-a8d4e5692c61 with identifier: CZ66164
2026-03-27 10:40:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6925f432-851a-527b-9873-a8d4e5692c61 with scrape type 2
2026-03-27 10:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6925f432-851a-527b-9873-a8d4e5692c61 with scrape type 2
2026-03-27 10:40:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6925f432-851a-527b-9873-a8d4e5692c61, identifier: CZ66164
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F93%252F03936b8b295f29cc3e4f5d4dfbbebd02%252Fpa%252FLU27790_974c36888095eb34932b3f4e11bea3f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_974c36888095eb34932b3f4e11bea3f3.jpg not downloaded yet
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F45%252F8e45a499f1f9b1cd8854984e907659ef%252Fpa%252FPP43066_600a8b655ecb080c93ce24587192adc9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_600a8b655ecb080c93ce24587192adc9.jpg not downloaded yet
2026-03-27 10:40:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97a649c8-8819-5f61-b364-b382601f4676 with identifier: TJ39363
2026-03-27 10:40:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97a649c8-8819-5f61-b364-b382601f4676 with identifier: TJ39363
2026-03-27 10:40:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97a649c8-8819-5f61-b364-b382601f4676 with identifier: TJ39363 to the API
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:37:33Z',
 'fuel_type': 'diesel',
 'id': '97a649c8-8819-5f61-b364-b382601f4676',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ39363',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 198552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-12',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2013}
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ39363%27 HTTP/1.1" 200 None
2026-03-27 10:40:57 [auto1.de] INFO: Saving data for TJ39363: {'auction_closing_time': 1774715853.0, 'created_time': 1773686339.757991, 'last_price_update_time': 1774608057.804791}
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ39363') HTTP/1.1" 204 0
2026-03-27 10:40:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UC42370> (referer: https://www.auto1.com/v1/car-details-view/UC42370/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6925f432-851a-527b-9873-a8d4e5692c61 with identifier: CZ66164
2026-03-27 10:40:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6925f432-851a-527b-9873-a8d4e5692c61 with identifier: CZ66164
2026-03-27 10:40:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6925f432-851a-527b-9873-a8d4e5692c61 with identifier: CZ66164 to the API
2026-03-27 10:40:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:13:51Z',
 'fuel_type': 'petrol',
 'id': '6925f432-851a-527b-9873-a8d4e5692c61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ66164',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 78991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-13',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ66164%27 HTTP/1.1" 200 None
2026-03-27 10:40:58 [auto1.de] INFO: Saving data for CZ66164: {'auction_closing_time': 1774714431.0, 'created_time': 1773858950.525664, 'last_price_update_time': 1774608058.232933}
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ66164') HTTP/1.1" 204 0
2026-03-27 10:40:58 [auto1.de] INFO: Found listing with ID: KN66940
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN66940%27 HTTP/1.1" 200 None
2026-03-27 10:40:58 [auto1.de] INFO: Scrape type for KN66940: 2
2026-03-27 10:40:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cd42c97-d63b-5e49-a331-c4f704c080bf with identifier: KN66940
2026-03-27 10:40:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cd42c97-d63b-5e49-a331-c4f704c080bf with scrape type 2
2026-03-27 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cd42c97-d63b-5e49-a331-c4f704c080bf with scrape type 2
2026-03-27 10:40:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cd42c97-d63b-5e49-a331-c4f704c080bf, identifier: KN66940
2026-03-27 10:40:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50189bb10>
2026-03-27 10:40:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2239d488-0849-58ee-a1e7-739c9b060fb4/2239d488-0849-58ee-a1e7-739c9b060fb4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F45%252F8e45a499f1f9b1cd8854984e907659ef%252Fpa%252FPP43066_32efd7a14e30c39eab808e6491aed3ea.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_32efd7a14e30c39eab808e6491aed3ea.jpg saved to cache
2026-03-27 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2239d488-0849-58ee-a1e7-739c9b060fb4
2026-03-27 10:40:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:40:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500466690>
2026-03-27 10:40:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:40:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1225177-117f-5078-8146-1d685e4c4fa4/d1225177-117f-5078-8146-1d685e4c4fa4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Feb%252F64ebe6d6fb9c57b8fdcf738aa5190061%252Fpa%252FSJ87943_4b676e708d21a6c6ff0b921537af9609.jpg') HTTP/1.1" 204 0
2026-03-27 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_4b676e708d21a6c6ff0b921537af9609.jpg saved to cache
2026-03-27 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1225177-117f-5078-8146-1d685e4c4fa4
2026-03-27 10:40:58 [auto1.de] INFO: Found listing with ID: JS62021
2026-03-27 10:40:58 [auto1.de] INFO: Found listing with ID: NB05774
2026-03-27 10:40:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cd42c97-d63b-5e49-a331-c4f704c080bf with identifier: KN66940
2026-03-27 10:40:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cd42c97-d63b-5e49-a331-c4f704c080bf with identifier: KN66940
2026-03-27 10:40:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cd42c97-d63b-5e49-a331-c4f704c080bf with identifier: KN66940 to the API
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:13:53Z',
 'fuel_type': 'diesel',
 'id': '5cd42c97-d63b-5e49-a331-c4f704c080bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN66940',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 228471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-31',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 113 CDI lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2012}
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN66940%27 HTTP/1.1" 200 None
2026-03-27 10:40:58 [auto1.de] INFO: Saving data for KN66940: {'auction_closing_time': 1774714433.0, 'created_time': 1773831041.714024, 'last_price_update_time': 1774608058.781936}
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN66940') HTTP/1.1" 204 0
2026-03-27 10:40:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HM57840/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_124180c90f79767a3b5d10b8a96b5e7e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_18f397d6cd20163078b226dcff167194.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:40:58 [auto1.de] INFO: Found listing with ID: UN13511
2026-03-27 10:40:58 [auto1.de] INFO: Found listing with ID: SC19815
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC19815%27 HTTP/1.1" 200 None
2026-03-27 10:40:58 [auto1.de] INFO: Scrape type for SC19815: 2
2026-03-27 10:40:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d302ed0-f97e-5724-b442-502b501d15a4 with identifier: SC19815
2026-03-27 10:40:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d302ed0-f97e-5724-b442-502b501d15a4 with scrape type 2
2026-03-27 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d302ed0-f97e-5724-b442-502b501d15a4 with scrape type 2
2026-03-27 10:40:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d302ed0-f97e-5724-b442-502b501d15a4, identifier: SC19815
2026-03-27 10:40:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d302ed0-f97e-5724-b442-502b501d15a4 with identifier: SC19815
2026-03-27 10:40:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d302ed0-f97e-5724-b442-502b501d15a4 with identifier: SC19815
2026-03-27 10:40:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d302ed0-f97e-5724-b442-502b501d15a4 with identifier: SC19815 to the API
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:40:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:39:09Z',
 'fuel_type': 'petrol',
 'id': '1d302ed0-f97e-5724-b442-502b501d15a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC19815',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 49132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-15',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2019}
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC19815%27 HTTP/1.1" 200 None
2026-03-27 10:40:59 [auto1.de] INFO: Saving data for SC19815: {'auction_closing_time': 1774715949.0, 'created_time': 1773689006.285639, 'last_price_update_time': 1774608059.298015}
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC19815') HTTP/1.1" 204 0
2026-03-27 10:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA44697/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:40:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02e33a2d-6e43-5099-902d-7c9ab13bc33a with identifier: UC42370
2026-03-27 10:40:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02e33a2d-6e43-5099-902d-7c9ab13bc33a with scrape type 1
2026-03-27 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 02e33a2d-6e43-5099-902d-7c9ab13bc33a
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff4%252Fe3f45c4ca08f8fd145cb7e66acd9c46d%252Fpa%252FUC42370_941aec521b6c802f5ba875a32bdce4c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f4/e3f45c4ca08f8fd145cb7e66acd9c46d/pa/UC42370_941aec521b6c802f5ba875a32bdce4c5.jpg not downloaded yet
2026-03-27 10:40:59 [auto1.de] INFO: Found listing with ID: UV04147
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV04147%27 HTTP/1.1" 200 None
2026-03-27 10:40:59 [auto1.de] INFO: Scrape type for UV04147: 2
2026-03-27 10:40:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2d72083-c6bb-57af-b98d-4037629982b2 with identifier: UV04147
2026-03-27 10:40:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2d72083-c6bb-57af-b98d-4037629982b2 with scrape type 2
2026-03-27 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2d72083-c6bb-57af-b98d-4037629982b2 with scrape type 2
2026-03-27 10:40:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2d72083-c6bb-57af-b98d-4037629982b2, identifier: UV04147
2026-03-27 10:40:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:40:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2d72083-c6bb-57af-b98d-4037629982b2 with identifier: UV04147
2026-03-27 10:40:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2d72083-c6bb-57af-b98d-4037629982b2 with identifier: UV04147
2026-03-27 10:40:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2d72083-c6bb-57af-b98d-4037629982b2 with identifier: UV04147 to the API
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:40:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:59:08Z',
 'fuel_type': 'petrol',
 'id': 'b2d72083-c6bb-57af-b98d-4037629982b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV04147',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 209674,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-06',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2009}
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV04147%27 HTTP/1.1" 200 None
2026-03-27 10:41:00 [auto1.de] INFO: Saving data for UV04147: {'auction_closing_time': 1774717148.0, 'created_time': 1773305741.047526, 'last_price_update_time': 1774608060.052279}
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV04147') HTTP/1.1" 204 0
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff4%252Fe3f45c4ca08f8fd145cb7e66acd9c46d%252Fpa%252FUC42370_cfb2f7fa033ba1f8daf8fef530e2bdd2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f4/e3f45c4ca08f8fd145cb7e66acd9c46d/pa/UC42370_cfb2f7fa033ba1f8daf8fef530e2bdd2.jpg not downloaded yet
2026-03-27 10:41:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_8e9007513d0ffeeb4d8bb9762099fa55.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:00 [auto1.de] INFO: Found listing with ID: BC36387
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC36387%27 HTTP/1.1" 200 None
2026-03-27 10:41:00 [auto1.de] INFO: Scrape type for BC36387: 2
2026-03-27 10:41:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19bd8017-e7b4-51a2-9694-36cb39d848fd with identifier: BC36387
2026-03-27 10:41:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19bd8017-e7b4-51a2-9694-36cb39d848fd with scrape type 2
2026-03-27 10:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19bd8017-e7b4-51a2-9694-36cb39d848fd with scrape type 2
2026-03-27 10:41:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19bd8017-e7b4-51a2-9694-36cb39d848fd, identifier: BC36387
2026-03-27 10:41:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004899d0>
2026-03-27 10:41:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb07bd82-b0bd-5075-8364-624ab9506f2f/fb07bd82-b0bd-5075-8364-624ab9506f2f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F93%252F03936b8b295f29cc3e4f5d4dfbbebd02%252Fpa%252FLU27790_124180c90f79767a3b5d10b8a96b5e7e.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_124180c90f79767a3b5d10b8a96b5e7e.jpg saved to cache
2026-03-27 10:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fb07bd82-b0bd-5075-8364-624ab9506f2f
2026-03-27 10:41:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019a6210>
2026-03-27 10:41:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2239d488-0849-58ee-a1e7-739c9b060fb4/2239d488-0849-58ee-a1e7-739c9b060fb4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F45%252F8e45a499f1f9b1cd8854984e907659ef%252Fpa%252FPP43066_18f397d6cd20163078b226dcff167194.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_18f397d6cd20163078b226dcff167194.jpg saved to cache
2026-03-27 10:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2239d488-0849-58ee-a1e7-739c9b060fb4
2026-03-27 10:41:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_600a8b655ecb080c93ce24587192adc9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19bd8017-e7b4-51a2-9694-36cb39d848fd with identifier: BC36387
2026-03-27 10:41:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19bd8017-e7b4-51a2-9694-36cb39d848fd with identifier: BC36387
2026-03-27 10:41:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19bd8017-e7b4-51a2-9694-36cb39d848fd with identifier: BC36387 to the API
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:18:34Z',
 'fuel_type': 'petrol',
 'id': '19bd8017-e7b4-51a2-9694-36cb39d848fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC36387',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 120942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-01-23',
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC36387%27 HTTP/1.1" 200 None
2026-03-27 10:41:00 [auto1.de] INFO: Saving data for BC36387: {'auction_closing_time': 1774714714.0, 'created_time': 1773859125.080912, 'last_price_update_time': 1774608060.726722}
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC36387') HTTP/1.1" 204 0
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff4%252Fe3f45c4ca08f8fd145cb7e66acd9c46d%252Fpa%252FUC42370_70152070592dfd40802d98df09a2dee5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f4/e3f45c4ca08f8fd145cb7e66acd9c46d/pa/UC42370_70152070592dfd40802d98df09a2dee5.jpg not downloaded yet
2026-03-27 10:41:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_974c36888095eb34932b3f4e11bea3f3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:00 [auto1.de] INFO: Found listing with ID: UH90150
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH90150%27 HTTP/1.1" 200 None
2026-03-27 10:41:00 [auto1.de] INFO: Scrape type for UH90150: 2
2026-03-27 10:41:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eacf758b-42e1-5391-97c3-6f3dfe5ad8b8 with identifier: UH90150
2026-03-27 10:41:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eacf758b-42e1-5391-97c3-6f3dfe5ad8b8 with scrape type 2
2026-03-27 10:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eacf758b-42e1-5391-97c3-6f3dfe5ad8b8 with scrape type 2
2026-03-27 10:41:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eacf758b-42e1-5391-97c3-6f3dfe5ad8b8, identifier: UH90150
2026-03-27 10:41:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eacf758b-42e1-5391-97c3-6f3dfe5ad8b8 with identifier: UH90150
2026-03-27 10:41:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eacf758b-42e1-5391-97c3-6f3dfe5ad8b8 with identifier: UH90150
2026-03-27 10:41:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eacf758b-42e1-5391-97c3-6f3dfe5ad8b8 with identifier: UH90150 to the API
2026-03-27 10:41:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:45:01Z',
 'fuel_type': 'diesel',
 'id': 'eacf758b-42e1-5391-97c3-6f3dfe5ad8b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH90150',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 208948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-19',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Match BlueMotion',
 'transmission': 'manual',
 'trim': 'Match BlueMotion',
 'year': 2012}
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH90150%27 HTTP/1.1" 200 None
2026-03-27 10:41:01 [auto1.de] INFO: Saving data for UH90150: {'auction_closing_time': 1774716301.0, 'created_time': 1773382975.748667, 'last_price_update_time': 1774608061.28067}
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH90150') HTTP/1.1" 204 0
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff4%252Fe3f45c4ca08f8fd145cb7e66acd9c46d%252Fpa%252FUC42370_b03c9c507cb8b1e4b4781f594427e236.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f4/e3f45c4ca08f8fd145cb7e66acd9c46d/pa/UC42370_b03c9c507cb8b1e4b4781f594427e236.jpg not downloaded yet
2026-03-27 10:41:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_e6b71954af3a0003494d6bf8ec8b21ab.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:01 [auto1.de] INFO: Found listing with ID: AZ50044
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ50044%27 HTTP/1.1" 200 None
2026-03-27 10:41:01 [auto1.de] INFO: Scrape type for AZ50044: 2
2026-03-27 10:41:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 498896fd-63c0-565b-86e8-6e75805e561b with identifier: AZ50044
2026-03-27 10:41:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 498896fd-63c0-565b-86e8-6e75805e561b with scrape type 2
2026-03-27 10:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 498896fd-63c0-565b-86e8-6e75805e561b with scrape type 2
2026-03-27 10:41:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 498896fd-63c0-565b-86e8-6e75805e561b, identifier: AZ50044
2026-03-27 10:41:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FB90112/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 498896fd-63c0-565b-86e8-6e75805e561b with identifier: AZ50044
2026-03-27 10:41:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 498896fd-63c0-565b-86e8-6e75805e561b with identifier: AZ50044
2026-03-27 10:41:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 498896fd-63c0-565b-86e8-6e75805e561b with identifier: AZ50044 to the API
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:01:41Z',
 'fuel_type': 'diesel',
 'id': '498896fd-63c0-565b-86e8-6e75805e561b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ50044',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 335881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2010}
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ50044%27 HTTP/1.1" 200 None
2026-03-27 10:41:01 [auto1.de] INFO: Saving data for AZ50044: {'auction_closing_time': 1774713701.0, 'created_time': 1774291892.600597, 'last_price_update_time': 1774608061.797929}
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ50044') HTTP/1.1" 204 0
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff4%252Fe3f45c4ca08f8fd145cb7e66acd9c46d%252Fpa%252FUC42370_ef77810b72abbe5fac570075e3baaaf8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f4/e3f45c4ca08f8fd145cb7e66acd9c46d/pa/UC42370_ef77810b72abbe5fac570075e3baaaf8.jpg not downloaded yet
2026-03-27 10:41:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500320ed0>
2026-03-27 10:41:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2239d488-0849-58ee-a1e7-739c9b060fb4/2239d488-0849-58ee-a1e7-739c9b060fb4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F45%252F8e45a499f1f9b1cd8854984e907659ef%252Fpa%252FPP43066_8e9007513d0ffeeb4d8bb9762099fa55.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_8e9007513d0ffeeb4d8bb9762099fa55.jpg saved to cache
2026-03-27 10:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2239d488-0849-58ee-a1e7-739c9b060fb4
2026-03-27 10:41:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50168b490>
2026-03-27 10:41:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2239d488-0849-58ee-a1e7-739c9b060fb4/2239d488-0849-58ee-a1e7-739c9b060fb4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F45%252F8e45a499f1f9b1cd8854984e907659ef%252Fpa%252FPP43066_600a8b655ecb080c93ce24587192adc9.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_600a8b655ecb080c93ce24587192adc9.jpg saved to cache
2026-03-27 10:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2239d488-0849-58ee-a1e7-739c9b060fb4
2026-03-27 10:41:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50045dcd0>
2026-03-27 10:41:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb07bd82-b0bd-5075-8364-624ab9506f2f/fb07bd82-b0bd-5075-8364-624ab9506f2f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F93%252F03936b8b295f29cc3e4f5d4dfbbebd02%252Fpa%252FLU27790_974c36888095eb34932b3f4e11bea3f3.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_974c36888095eb34932b3f4e11bea3f3.jpg saved to cache
2026-03-27 10:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fb07bd82-b0bd-5075-8364-624ab9506f2f
2026-03-27 10:41:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/f4/e3f45c4ca08f8fd145cb7e66acd9c46d/pa/UC42370_941aec521b6c802f5ba875a32bdce4c5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:01 [auto1.de] INFO: Found listing with ID: JV68921
2026-03-27 10:41:01 [auto1.de] INFO: Found listing with ID: TU97792
2026-03-27 10:41:01 [auto1.de] INFO: Found listing with ID: VG31593
2026-03-27 10:41:01 [auto1.de] INFO: Found listing with ID: SF39323
2026-03-27 10:41:01 [auto1.de] INFO: Found listing with ID: DS71504
2026-03-27 10:41:01 [auto1.de] INFO: Found listing with ID: KP12697
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP12697%27 HTTP/1.1" 200 None
2026-03-27 10:41:01 [auto1.de] INFO: Scrape type for KP12697: 2
2026-03-27 10:41:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af85f408-3e5e-5540-9aab-d1b321ece4b1 with identifier: KP12697
2026-03-27 10:41:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af85f408-3e5e-5540-9aab-d1b321ece4b1 with scrape type 2
2026-03-27 10:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af85f408-3e5e-5540-9aab-d1b321ece4b1 with scrape type 2
2026-03-27 10:41:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af85f408-3e5e-5540-9aab-d1b321ece4b1, identifier: KP12697
2026-03-27 10:41:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af85f408-3e5e-5540-9aab-d1b321ece4b1 with identifier: KP12697
2026-03-27 10:41:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af85f408-3e5e-5540-9aab-d1b321ece4b1 with identifier: KP12697
2026-03-27 10:41:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af85f408-3e5e-5540-9aab-d1b321ece4b1 with identifier: KP12697 to the API
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:22:04Z',
 'fuel_type': 'petrol',
 'id': 'af85f408-3e5e-5540-9aab-d1b321ece4b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP12697',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 181041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-06',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2011}
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP12697%27 HTTP/1.1" 200 None
2026-03-27 10:41:02 [auto1.de] INFO: Saving data for KP12697: {'auction_closing_time': 1774714924.0, 'created_time': 1772544480.903056, 'last_price_update_time': 1774608062.502947}
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP12697') HTTP/1.1" 204 0
2026-03-27 10:41:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50161d710>
2026-03-27 10:41:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb07bd82-b0bd-5075-8364-624ab9506f2f/fb07bd82-b0bd-5075-8364-624ab9506f2f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F93%252F03936b8b295f29cc3e4f5d4dfbbebd02%252Fpa%252FLU27790_e6b71954af3a0003494d6bf8ec8b21ab.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_e6b71954af3a0003494d6bf8ec8b21ab.jpg saved to cache
2026-03-27 10:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fb07bd82-b0bd-5075-8364-624ab9506f2f
2026-03-27 10:41:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/f4/e3f45c4ca08f8fd145cb7e66acd9c46d/pa/UC42370_cfb2f7fa033ba1f8daf8fef530e2bdd2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:02 [auto1.de] INFO: Found listing with ID: XS31792
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS31792%27 HTTP/1.1" 200 None
2026-03-27 10:41:02 [auto1.de] INFO: Scrape type for XS31792: 2
2026-03-27 10:41:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a302eb6-04ad-5d88-9cef-63b3bda3f28a with identifier: XS31792
2026-03-27 10:41:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a302eb6-04ad-5d88-9cef-63b3bda3f28a with scrape type 2
2026-03-27 10:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a302eb6-04ad-5d88-9cef-63b3bda3f28a with scrape type 2
2026-03-27 10:41:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a302eb6-04ad-5d88-9cef-63b3bda3f28a, identifier: XS31792
2026-03-27 10:41:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KS78216/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a302eb6-04ad-5d88-9cef-63b3bda3f28a with identifier: XS31792
2026-03-27 10:41:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a302eb6-04ad-5d88-9cef-63b3bda3f28a with identifier: XS31792
2026-03-27 10:41:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a302eb6-04ad-5d88-9cef-63b3bda3f28a with identifier: XS31792 to the API
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:17:48Z',
 'fuel_type': 'petrol',
 'id': '8a302eb6-04ad-5d88-9cef-63b3bda3f28a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS31792',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 120214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-10',
 'seller_name': None,
 'title': 'Audi A6 45 TFSI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS31792%27 HTTP/1.1" 200 None
2026-03-27 10:41:03 [auto1.de] INFO: Saving data for XS31792: {'auction_closing_time': 1774714668.0, 'created_time': 1773303155.605887, 'last_price_update_time': 1774608063.075708}
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS31792') HTTP/1.1" 204 0
2026-03-27 10:41:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a68d0>
2026-03-27 10:41:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02e33a2d-6e43-5099-902d-7c9ab13bc33a/02e33a2d-6e43-5099-902d-7c9ab13bc33a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff4%252Fe3f45c4ca08f8fd145cb7e66acd9c46d%252Fpa%252FUC42370_941aec521b6c802f5ba875a32bdce4c5.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f4/e3f45c4ca08f8fd145cb7e66acd9c46d/pa/UC42370_941aec521b6c802f5ba875a32bdce4c5.jpg saved to cache
2026-03-27 10:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02e33a2d-6e43-5099-902d-7c9ab13bc33a
2026-03-27 10:41:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/f4/e3f45c4ca08f8fd145cb7e66acd9c46d/pa/UC42370_b03c9c507cb8b1e4b4781f594427e236.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:03 [auto1.de] INFO: Found listing with ID: FK36654
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK36654%27 HTTP/1.1" 200 None
2026-03-27 10:41:03 [auto1.de] INFO: Scrape type for FK36654: 2
2026-03-27 10:41:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e98327a-4893-5aa9-a9a1-70c274d8dc4e with identifier: FK36654
2026-03-27 10:41:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e98327a-4893-5aa9-a9a1-70c274d8dc4e with scrape type 2
2026-03-27 10:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e98327a-4893-5aa9-a9a1-70c274d8dc4e with scrape type 2
2026-03-27 10:41:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e98327a-4893-5aa9-a9a1-70c274d8dc4e, identifier: FK36654
2026-03-27 10:41:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e98327a-4893-5aa9-a9a1-70c274d8dc4e with identifier: FK36654
2026-03-27 10:41:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e98327a-4893-5aa9-a9a1-70c274d8dc4e with identifier: FK36654
2026-03-27 10:41:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e98327a-4893-5aa9-a9a1-70c274d8dc4e with identifier: FK36654 to the API
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:07:43Z',
 'fuel_type': 'diesel',
 'id': '0e98327a-4893-5aa9-a9a1-70c274d8dc4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK36654',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 160711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-03',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2013}
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK36654%27 HTTP/1.1" 200 None
2026-03-27 10:41:03 [auto1.de] INFO: Saving data for FK36654: {'auction_closing_time': 1774714063.0, 'created_time': 1774293273.349653, 'last_price_update_time': 1774608063.701207}
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK36654') HTTP/1.1" 204 0
2026-03-27 10:41:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/f4/e3f45c4ca08f8fd145cb7e66acd9c46d/pa/UC42370_70152070592dfd40802d98df09a2dee5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:03 [auto1.de] INFO: Found listing with ID: YH72749
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH72749%27 HTTP/1.1" 200 None
2026-03-27 10:41:03 [auto1.de] INFO: Scrape type for YH72749: 2
2026-03-27 10:41:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a38027e4-da34-5c38-ad8b-832c485af082 with identifier: YH72749
2026-03-27 10:41:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a38027e4-da34-5c38-ad8b-832c485af082 with scrape type 2
2026-03-27 10:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a38027e4-da34-5c38-ad8b-832c485af082 with scrape type 2
2026-03-27 10:41:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a38027e4-da34-5c38-ad8b-832c485af082, identifier: YH72749
2026-03-27 10:41:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL59666/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003c4390>
2026-03-27 10:41:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02e33a2d-6e43-5099-902d-7c9ab13bc33a/02e33a2d-6e43-5099-902d-7c9ab13bc33a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff4%252Fe3f45c4ca08f8fd145cb7e66acd9c46d%252Fpa%252FUC42370_cfb2f7fa033ba1f8daf8fef530e2bdd2.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f4/e3f45c4ca08f8fd145cb7e66acd9c46d/pa/UC42370_cfb2f7fa033ba1f8daf8fef530e2bdd2.jpg saved to cache
2026-03-27 10:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02e33a2d-6e43-5099-902d-7c9ab13bc33a
2026-03-27 10:41:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_e3e5eff34bec6d61d141c9d454d68be9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a38027e4-da34-5c38-ad8b-832c485af082 with identifier: YH72749
2026-03-27 10:41:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a38027e4-da34-5c38-ad8b-832c485af082 with identifier: YH72749
2026-03-27 10:41:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a38027e4-da34-5c38-ad8b-832c485af082 with identifier: YH72749 to the API
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:44:55Z',
 'fuel_type': 'petrol',
 'id': 'a38027e4-da34-5c38-ad8b-832c485af082',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH72749',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 99121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-21',
 'seller_name': None,
 'title': 'Volkswagen Beetle 2.0 TSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2012}
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH72749%27 HTTP/1.1" 200 None
2026-03-27 10:41:04 [auto1.de] INFO: Saving data for YH72749: {'auction_closing_time': 1774716295.0, 'created_time': 1773772543.630966, 'last_price_update_time': 1774608064.262525}
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH72749') HTTP/1.1" 204 0
2026-03-27 10:41:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/f4/e3f45c4ca08f8fd145cb7e66acd9c46d/pa/UC42370_ef77810b72abbe5fac570075e3baaaf8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:04 [auto1.de] INFO: Found listing with ID: BS83474
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS83474%27 HTTP/1.1" 200 None
2026-03-27 10:41:04 [auto1.de] INFO: Scrape type for BS83474: 2
2026-03-27 10:41:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c0f230c-2673-5c6a-850b-1043a2580dfb with identifier: BS83474
2026-03-27 10:41:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c0f230c-2673-5c6a-850b-1043a2580dfb with scrape type 2
2026-03-27 10:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c0f230c-2673-5c6a-850b-1043a2580dfb with scrape type 2
2026-03-27 10:41:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c0f230c-2673-5c6a-850b-1043a2580dfb, identifier: BS83474
2026-03-27 10:41:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501695350>
2026-03-27 10:41:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02e33a2d-6e43-5099-902d-7c9ab13bc33a/02e33a2d-6e43-5099-902d-7c9ab13bc33a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff4%252Fe3f45c4ca08f8fd145cb7e66acd9c46d%252Fpa%252FUC42370_b03c9c507cb8b1e4b4781f594427e236.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f4/e3f45c4ca08f8fd145cb7e66acd9c46d/pa/UC42370_b03c9c507cb8b1e4b4781f594427e236.jpg saved to cache
2026-03-27 10:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02e33a2d-6e43-5099-902d-7c9ab13bc33a
2026-03-27 10:41:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c0f230c-2673-5c6a-850b-1043a2580dfb with identifier: BS83474
2026-03-27 10:41:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c0f230c-2673-5c6a-850b-1043a2580dfb with identifier: BS83474
2026-03-27 10:41:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c0f230c-2673-5c6a-850b-1043a2580dfb with identifier: BS83474 to the API
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:36:51Z',
 'fuel_type': 'diesel',
 'id': '9c0f230c-2673-5c6a-850b-1043a2580dfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS83474',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 184613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-20',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 d Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2017}
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS83474%27 HTTP/1.1" 200 None
2026-03-27 10:41:04 [auto1.de] INFO: Saving data for BS83474: {'auction_closing_time': 1774715811.0, 'created_time': 1772543696.739905, 'last_price_update_time': 1774608064.856173}
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS83474') HTTP/1.1" 204 0
2026-03-27 10:41:04 [auto1.de] INFO: Found listing with ID: XX81034
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX81034%27 HTTP/1.1" 200 None
2026-03-27 10:41:04 [auto1.de] INFO: Scrape type for XX81034: 2
2026-03-27 10:41:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2587d3d4-9854-57c2-a48f-fd751d94b628 with identifier: XX81034
2026-03-27 10:41:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2587d3d4-9854-57c2-a48f-fd751d94b628 with scrape type 2
2026-03-27 10:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2587d3d4-9854-57c2-a48f-fd751d94b628 with scrape type 2
2026-03-27 10:41:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2587d3d4-9854-57c2-a48f-fd751d94b628, identifier: XX81034
2026-03-27 10:41:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2587d3d4-9854-57c2-a48f-fd751d94b628 with identifier: XX81034
2026-03-27 10:41:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2587d3d4-9854-57c2-a48f-fd751d94b628 with identifier: XX81034
2026-03-27 10:41:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2587d3d4-9854-57c2-a48f-fd751d94b628 with identifier: XX81034 to the API
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 215,
 'expiration_date': '2026-03-28T16:08:54Z',
 'fuel_type': 'diesel',
 'id': '2587d3d4-9854-57c2-a48f-fd751d94b628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX81034',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 221216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-01',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D5 Ocean Race AWD',
 'transmission': 'automatic',
 'trim': 'Ocean Race AWD',
 'year': 2012}
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX81034%27 HTTP/1.1" 200 None
2026-03-27 10:41:05 [auto1.de] INFO: Saving data for XX81034: {'auction_closing_time': 1774714134.0, 'created_time': 1773774223.806507, 'last_price_update_time': 1774608065.334386}
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX81034') HTTP/1.1" 204 0
2026-03-27 10:41:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50162f250>
2026-03-27 10:41:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02e33a2d-6e43-5099-902d-7c9ab13bc33a/02e33a2d-6e43-5099-902d-7c9ab13bc33a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff4%252Fe3f45c4ca08f8fd145cb7e66acd9c46d%252Fpa%252FUC42370_70152070592dfd40802d98df09a2dee5.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f4/e3f45c4ca08f8fd145cb7e66acd9c46d/pa/UC42370_70152070592dfd40802d98df09a2dee5.jpg saved to cache
2026-03-27 10:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02e33a2d-6e43-5099-902d-7c9ab13bc33a
2026-03-27 10:41:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004aba90>
2026-03-27 10:41:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1225177-117f-5078-8146-1d685e4c4fa4/d1225177-117f-5078-8146-1d685e4c4fa4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Feb%252F64ebe6d6fb9c57b8fdcf738aa5190061%252Fpa%252FSJ87943_e3e5eff34bec6d61d141c9d454d68be9.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_e3e5eff34bec6d61d141c9d454d68be9.jpg saved to cache
2026-03-27 10:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1225177-117f-5078-8146-1d685e4c4fa4
2026-03-27 10:41:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004aa690>
2026-03-27 10:41:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02e33a2d-6e43-5099-902d-7c9ab13bc33a/02e33a2d-6e43-5099-902d-7c9ab13bc33a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Ff4%252Fe3f45c4ca08f8fd145cb7e66acd9c46d%252Fpa%252FUC42370_ef77810b72abbe5fac570075e3baaaf8.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/f4/e3f45c4ca08f8fd145cb7e66acd9c46d/pa/UC42370_ef77810b72abbe5fac570075e3baaaf8.jpg saved to cache
2026-03-27 10:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02e33a2d-6e43-5099-902d-7c9ab13bc33a
2026-03-27 10:41:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02e33a2d-6e43-5099-902d-7c9ab13bc33a, skipping ID generation
2026-03-27 10:41:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02e33a2d-6e43-5099-902d-7c9ab13bc33a with scrape type 1
2026-03-27 10:41:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02e33a2d-6e43-5099-902d-7c9ab13bc33a sending to next pipeline
2026-03-27 10:41:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02e33a2d-6e43-5099-902d-7c9ab13bc33a, identifier: UC42370
2026-03-27 10:41:05 [auto1.de] INFO: Found listing with ID: WC52225
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC52225%27 HTTP/1.1" 200 None
2026-03-27 10:41:05 [auto1.de] INFO: Scrape type for WC52225: 2
2026-03-27 10:41:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b433e72-a5e0-54ef-8eb0-cb54c1041f3f with identifier: WC52225
2026-03-27 10:41:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b433e72-a5e0-54ef-8eb0-cb54c1041f3f with scrape type 2
2026-03-27 10:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b433e72-a5e0-54ef-8eb0-cb54c1041f3f with scrape type 2
2026-03-27 10:41:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b433e72-a5e0-54ef-8eb0-cb54c1041f3f, identifier: WC52225
2026-03-27 10:41:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV35791/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02e33a2d-6e43-5099-902d-7c9ab13bc33a with identifier: UC42370
2026-03-27 10:41:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02e33a2d-6e43-5099-902d-7c9ab13bc33a with identifier: UC42370
2026-03-27 10:41:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02e33a2d-6e43-5099-902d-7c9ab13bc33a with identifier: UC42370 to the API
2026-03-27 10:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge3/f4/e3f45c4ca08f8fd145cb7e66acd9c46d/pa/UC42370_ef77810b72abbe5fac570075e3baaaf8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:24:36Z',
 'fuel_type': 'petrol',
 'id': '02e33a2d-6e43-5099-902d-7c9ab13bc33a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC42370',
 'listing': 'auction',
 'location': 'DE, Bochum',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 66257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02e33a2d-6e43-5099-902d-7c9ab13bc33a/02e33a2d-6e43-5099-902d-7c9ab13bc33a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/f4/e3f45c4ca08f8fd145cb7e66acd9c46d/pa/UC42370_941aec521b6c802f5ba875a32bdce4c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02e33a2d-6e43-5099-902d-7c9ab13bc33a/02e33a2d-6e43-5099-902d-7c9ab13bc33a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/f4/e3f45c4ca08f8fd145cb7e66acd9c46d/pa/UC42370_cfb2f7fa033ba1f8daf8fef530e2bdd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02e33a2d-6e43-5099-902d-7c9ab13bc33a/02e33a2d-6e43-5099-902d-7c9ab13bc33a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/f4/e3f45c4ca08f8fd145cb7e66acd9c46d/pa/UC42370_70152070592dfd40802d98df09a2dee5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02e33a2d-6e43-5099-902d-7c9ab13bc33a/02e33a2d-6e43-5099-902d-7c9ab13bc33a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/f4/e3f45c4ca08f8fd145cb7e66acd9c46d/pa/UC42370_b03c9c507cb8b1e4b4781f594427e236.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02e33a2d-6e43-5099-902d-7c9ab13bc33a/02e33a2d-6e43-5099-902d-7c9ab13bc33a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/f4/e3f45c4ca08f8fd145cb7e66acd9c46d/pa/UC42370_ef77810b72abbe5fac570075e3baaaf8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.4 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2011}
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC42370%27 HTTP/1.1" 200 None
2026-03-27 10:41:06 [auto1.de] INFO: Saving data for UC42370: {'created_time': 1774608066.222625, 'last_price_update_time': 1774608066.22264, 'auction_closing_time': 1774715076.0}
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC42370') HTTP/1.1" 204 0
2026-03-27 10:41:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_3d33f2a73d28749588f48cb248755e21.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b433e72-a5e0-54ef-8eb0-cb54c1041f3f with identifier: WC52225
2026-03-27 10:41:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b433e72-a5e0-54ef-8eb0-cb54c1041f3f with identifier: WC52225
2026-03-27 10:41:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b433e72-a5e0-54ef-8eb0-cb54c1041f3f with identifier: WC52225 to the API
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:33:47Z',
 'fuel_type': 'petrol',
 'id': '2b433e72-a5e0-54ef-8eb0-cb54c1041f3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC52225',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 115829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-17',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2018}
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC52225%27 HTTP/1.1" 200 None
2026-03-27 10:41:06 [auto1.de] INFO: Saving data for WC52225: {'auction_closing_time': 1774715627.0, 'created_time': 1773861700.769657, 'last_price_update_time': 1774608066.701515}
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC52225') HTTP/1.1" 204 0
2026-03-27 10:41:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:06 [scrapy.extensions.logstats] INFO: Crawled 258 pages (at 31 pages/min), scraped 245 items (at 92 items/min)
2026-03-27 10:41:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 190MiB
2026-03-27 10:41:06 [auto1.de] INFO: Found listing with ID: BP39163
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39163%27 HTTP/1.1" 200 None
2026-03-27 10:41:06 [auto1.de] INFO: Scrape type for BP39163: 2
2026-03-27 10:41:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01d229ff-9da3-5223-935e-9efaab1f9dfb with identifier: BP39163
2026-03-27 10:41:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01d229ff-9da3-5223-935e-9efaab1f9dfb with scrape type 2
2026-03-27 10:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01d229ff-9da3-5223-935e-9efaab1f9dfb with scrape type 2
2026-03-27 10:41:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01d229ff-9da3-5223-935e-9efaab1f9dfb, identifier: BP39163
2026-03-27 10:41:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AC15853> (referer: https://www.auto1.com/v1/car-details-view/AC15853/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01d229ff-9da3-5223-935e-9efaab1f9dfb with identifier: BP39163
2026-03-27 10:41:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01d229ff-9da3-5223-935e-9efaab1f9dfb with identifier: BP39163
2026-03-27 10:41:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01d229ff-9da3-5223-935e-9efaab1f9dfb with identifier: BP39163 to the API
2026-03-27 10:41:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:19:08Z',
 'fuel_type': 'petrol',
 'id': '01d229ff-9da3-5223-935e-9efaab1f9dfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP39163',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 69580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-17',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport P200 Mild-Hybrid S AWD',
 'transmission': 'automatic',
 'trim': 'S AWD',
 'year': 2020}
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39163%27 HTTP/1.1" 200 None
2026-03-27 10:41:07 [auto1.de] INFO: Saving data for BP39163: {'auction_closing_time': 1774714748.0, 'created_time': 1773687721.834316, 'last_price_update_time': 1774608067.295309}
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP39163') HTTP/1.1" 204 0
2026-03-27 10:41:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VC80296> (referer: https://www.auto1.com/v1/car-details-view/VC80296/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_abbc2ac553c5e9cd35a4695855d72698.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:07 [auto1.de] INFO: Found listing with ID: ZE41577
2026-03-27 10:41:07 [auto1.de] INFO: Found listing with ID: LK89545
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK89545%27 HTTP/1.1" 200 None
2026-03-27 10:41:07 [auto1.de] INFO: Scrape type for LK89545: 2
2026-03-27 10:41:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb70ee21-5451-5415-98ab-70362eaed48a with identifier: LK89545
2026-03-27 10:41:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb70ee21-5451-5415-98ab-70362eaed48a with scrape type 2
2026-03-27 10:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb70ee21-5451-5415-98ab-70362eaed48a with scrape type 2
2026-03-27 10:41:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb70ee21-5451-5415-98ab-70362eaed48a, identifier: LK89545
2026-03-27 10:41:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HM57840> (referer: https://www.auto1.com/v1/car-details-view/HM57840/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017eddd0>
2026-03-27 10:41:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2239d488-0849-58ee-a1e7-739c9b060fb4/2239d488-0849-58ee-a1e7-739c9b060fb4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F45%252F8e45a499f1f9b1cd8854984e907659ef%252Fpa%252FPP43066_3d33f2a73d28749588f48cb248755e21.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_3d33f2a73d28749588f48cb248755e21.jpg saved to cache
2026-03-27 10:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2239d488-0849-58ee-a1e7-739c9b060fb4
2026-03-27 10:41:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb70ee21-5451-5415-98ab-70362eaed48a with identifier: LK89545
2026-03-27 10:41:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb70ee21-5451-5415-98ab-70362eaed48a with identifier: LK89545
2026-03-27 10:41:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb70ee21-5451-5415-98ab-70362eaed48a with identifier: LK89545 to the API
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:09:17Z',
 'fuel_type': 'diesel',
 'id': 'bb70ee21-5451-5415-98ab-70362eaed48a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK89545',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 149381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-22',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI SportLine',
 'transmission': 'automatic',
 'trim': 'SportLine',
 'year': 2019}
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK89545%27 HTTP/1.1" 200 None
2026-03-27 10:41:07 [auto1.de] INFO: Saving data for LK89545: {'auction_closing_time': 1774714157.0, 'created_time': 1774251386.456911, 'last_price_update_time': 1774608067.904897}
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK89545') HTTP/1.1" 204 0
2026-03-27 10:41:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:07 [auto1.de] INFO: Channel: 24h | Page: 18 | totalHits: 10515 | hits on page: 40
2026-03-27 10:41:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_f8b8d3ac58e27b41030c0f15ffa3dac3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:07 [auto1.de] INFO: Found listing with ID: EL79145
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL79145%27 HTTP/1.1" 200 None
2026-03-27 10:41:07 [auto1.de] INFO: Scrape type for EL79145: 2
2026-03-27 10:41:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d with identifier: EL79145
2026-03-27 10:41:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d with scrape type 2
2026-03-27 10:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d with scrape type 2
2026-03-27 10:41:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d, identifier: EL79145
2026-03-27 10:41:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dcf64c8-b58b-505c-b16b-6c757f623975 with identifier: AC15853
2026-03-27 10:41:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dcf64c8-b58b-505c-b16b-6c757f623975 with scrape type 1
2026-03-27 10:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2dcf64c8-b58b-505c-b16b-6c757f623975
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa1%252Ff1a16119c1719645d6b298b21c454d84%252Fpa%252FAC15853_fbdb4e92c8ba0d075da8f79f30164f59.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_fbdb4e92c8ba0d075da8f79f30164f59.jpg not downloaded yet
2026-03-27 10:41:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d with identifier: EL79145
2026-03-27 10:41:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d with identifier: EL79145
2026-03-27 10:41:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d with identifier: EL79145 to the API
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:38:14Z',
 'fuel_type': 'petrol',
 'id': 'e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL79145',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 96873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-21',
 'seller_name': None,
 'title': 'Seat Tarraco 2.0 TSI Xcellence 4Drive',
 'transmission': 'automatic',
 'trim': 'Xcellence 4Drive',
 'year': 2020}
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL79145%27 HTTP/1.1" 200 None
2026-03-27 10:41:08 [auto1.de] INFO: Saving data for EL79145: {'auction_closing_time': 1774715894.0, 'created_time': 1773861753.65887, 'last_price_update_time': 1774608068.480735}
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL79145') HTTP/1.1" 204 0
2026-03-27 10:41:08 [auto1.de] INFO: Found listing with ID: PD80009
2026-03-27 10:41:08 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ64082%27 HTTP/1.1" 200 None
2026-03-27 10:41:08 [auto1.de] INFO: Scrape type for PZ64082: 2
2026-03-27 10:41:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 930329d9-c3c2-5584-ac29-37e14b628783 with identifier: PZ64082
2026-03-27 10:41:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 930329d9-c3c2-5584-ac29-37e14b628783 with scrape type 2
2026-03-27 10:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 930329d9-c3c2-5584-ac29-37e14b628783 with scrape type 2
2026-03-27 10:41:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 930329d9-c3c2-5584-ac29-37e14b628783, identifier: PZ64082
2026-03-27 10:41:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79782f7c-8fc5-5326-b805-52f47039130d with identifier: VC80296
2026-03-27 10:41:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79782f7c-8fc5-5326-b805-52f47039130d with scrape type 1
2026-03-27 10:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79782f7c-8fc5-5326-b805-52f47039130d
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fa2%252F9ea2027d9546ff2cfbd0c98a12e84fc7%252Fpa%252FVC80296_5ebb0b55450ad08feb87facba6962896.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_5ebb0b55450ad08feb87facba6962896.jpg not downloaded yet
2026-03-27 10:41:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004a42d0>
2026-03-27 10:41:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2239d488-0849-58ee-a1e7-739c9b060fb4/2239d488-0849-58ee-a1e7-739c9b060fb4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F45%252F8e45a499f1f9b1cd8854984e907659ef%252Fpa%252FPP43066_abbc2ac553c5e9cd35a4695855d72698.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_abbc2ac553c5e9cd35a4695855d72698.jpg saved to cache
2026-03-27 10:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2239d488-0849-58ee-a1e7-739c9b060fb4
2026-03-27 10:41:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_77e938b9b20e636177f9ab7b1643f9ec.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_e7412c8f8a5ee5930f390eea8279856e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:08 [auto1.de] INFO: Found listing with ID: EJ65167
2026-03-27 10:41:08 [auto1.de] INFO: Found listing with ID: DM09688
2026-03-27 10:41:08 [auto1.de] INFO: Found listing with ID: FC63717
2026-03-27 10:41:08 [auto1.de] INFO: Found listing with ID: UC48235
2026-03-27 10:41:08 [auto1.de] INFO: Found listing with ID: JA64656
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA64656%27 HTTP/1.1" 200 None
2026-03-27 10:41:08 [auto1.de] INFO: Scrape type for JA64656: 2
2026-03-27 10:41:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 971d896d-b74a-5e01-b383-eff0db2ce72b with identifier: JA64656
2026-03-27 10:41:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 971d896d-b74a-5e01-b383-eff0db2ce72b with scrape type 2
2026-03-27 10:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 971d896d-b74a-5e01-b383-eff0db2ce72b with scrape type 2
2026-03-27 10:41:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 971d896d-b74a-5e01-b383-eff0db2ce72b, identifier: JA64656
2026-03-27 10:41:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 930329d9-c3c2-5584-ac29-37e14b628783 with identifier: PZ64082
2026-03-27 10:41:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 930329d9-c3c2-5584-ac29-37e14b628783 with identifier: PZ64082
2026-03-27 10:41:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 930329d9-c3c2-5584-ac29-37e14b628783 with identifier: PZ64082 to the API
2026-03-27 10:41:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:36:50Z',
 'fuel_type': 'diesel',
 'id': '930329d9-c3c2-5584-ac29-37e14b628783',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ64082',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 238797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ64082%27 HTTP/1.1" 200 None
2026-03-27 10:41:09 [auto1.de] INFO: Saving data for PZ64082: {'auction_closing_time': 1774715810.0, 'created_time': 1774265340.259852, 'last_price_update_time': 1774608069.198272}
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ64082') HTTP/1.1" 204 0
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa1%252Ff1a16119c1719645d6b298b21c454d84%252Fpa%252FAC15853_285f9da811a85d3eec01a7fbc92ed3d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_285f9da811a85d3eec01a7fbc92ed3d6.jpg not downloaded yet
2026-03-27 10:41:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_b0ed413aa50e1367d327674ec2b2a48e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 971d896d-b74a-5e01-b383-eff0db2ce72b with identifier: JA64656
2026-03-27 10:41:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 971d896d-b74a-5e01-b383-eff0db2ce72b with identifier: JA64656
2026-03-27 10:41:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 971d896d-b74a-5e01-b383-eff0db2ce72b with identifier: JA64656 to the API
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:29:52Z',
 'fuel_type': 'petrol',
 'id': '971d896d-b74a-5e01-b383-eff0db2ce72b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA64656',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 113122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-08',
 'seller_name': None,
 'title': 'BMW 3er 328i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA64656%27 HTTP/1.1" 200 None
2026-03-27 10:41:09 [auto1.de] INFO: Saving data for JA64656: {'auction_closing_time': 1774715392.0, 'created_time': 1773686205.133328, 'last_price_update_time': 1774608069.683218}
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA64656') HTTP/1.1" 204 0
2026-03-27 10:41:09 [auto1.de] INFO: Found listing with ID: TW84588
2026-03-27 10:41:09 [auto1.de] INFO: Found listing with ID: VM43459
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM43459%27 HTTP/1.1" 200 None
2026-03-27 10:41:09 [auto1.de] INFO: Scrape type for VM43459: 2
2026-03-27 10:41:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ed79bab-fe39-53ef-84f8-820605009848 with identifier: VM43459
2026-03-27 10:41:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ed79bab-fe39-53ef-84f8-820605009848 with scrape type 2
2026-03-27 10:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ed79bab-fe39-53ef-84f8-820605009848 with scrape type 2
2026-03-27 10:41:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ed79bab-fe39-53ef-84f8-820605009848, identifier: VM43459
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fa2%252F9ea2027d9546ff2cfbd0c98a12e84fc7%252Fpa%252FVC80296_44cfceea94a6201da63e5f7ee6124f7a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_44cfceea94a6201da63e5f7ee6124f7a.jpg not downloaded yet
2026-03-27 10:41:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1840c47c-e51b-5fee-bfff-05055c749594 with identifier: HM57840
2026-03-27 10:41:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1840c47c-e51b-5fee-bfff-05055c749594 with scrape type 1
2026-03-27 10:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1840c47c-e51b-5fee-bfff-05055c749594
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ff2%252Fe0f26fd8984653217e8a9ff63e89131a%252Fpa%252FHM57840_7db33f8d78064cc93fccca7d18c8862b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/f2/e0f26fd8984653217e8a9ff63e89131a/pa/HM57840_7db33f8d78064cc93fccca7d18c8862b.jpg not downloaded yet
2026-03-27 10:41:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500563950>
2026-03-27 10:41:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb07bd82-b0bd-5075-8364-624ab9506f2f/fb07bd82-b0bd-5075-8364-624ab9506f2f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F93%252F03936b8b295f29cc3e4f5d4dfbbebd02%252Fpa%252FLU27790_f8b8d3ac58e27b41030c0f15ffa3dac3.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_f8b8d3ac58e27b41030c0f15ffa3dac3.jpg saved to cache
2026-03-27 10:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fb07bd82-b0bd-5075-8364-624ab9506f2f
2026-03-27 10:41:09 [auto1.de] INFO: Found listing with ID: GT54447
2026-03-27 10:41:09 [auto1.de] INFO: Found listing with ID: SJ09412
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ09412%27 HTTP/1.1" 200 None
2026-03-27 10:41:09 [auto1.de] INFO: Scrape type for SJ09412: 2
2026-03-27 10:41:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b4c5809-2e22-5eb9-94e9-06b3bee7f363 with identifier: SJ09412
2026-03-27 10:41:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b4c5809-2e22-5eb9-94e9-06b3bee7f363 with scrape type 2
2026-03-27 10:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b4c5809-2e22-5eb9-94e9-06b3bee7f363 with scrape type 2
2026-03-27 10:41:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b4c5809-2e22-5eb9-94e9-06b3bee7f363, identifier: SJ09412
2026-03-27 10:41:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ed79bab-fe39-53ef-84f8-820605009848 with identifier: VM43459
2026-03-27 10:41:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ed79bab-fe39-53ef-84f8-820605009848 with identifier: VM43459
2026-03-27 10:41:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ed79bab-fe39-53ef-84f8-820605009848 with identifier: VM43459 to the API
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:06:17Z',
 'fuel_type': 'diesel',
 'id': '2ed79bab-fe39-53ef-84f8-820605009848',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM43459',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Exeo',
 'odometer': 274445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-09',
 'seller_name': None,
 'title': 'Seat Exeo 2.0 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2011}
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM43459%27 HTTP/1.1" 200 None
2026-03-27 10:41:10 [auto1.de] INFO: Saving data for VM43459: {'auction_closing_time': 1774713977.0, 'created_time': 1774263759.33833, 'last_price_update_time': 1774608070.391963}
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VM43459') HTTP/1.1" 204 0
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa1%252Ff1a16119c1719645d6b298b21c454d84%252Fpa%252FAC15853_216c839915bce3f4e8d5c7e89e5af16a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_216c839915bce3f4e8d5c7e89e5af16a.jpg not downloaded yet
2026-03-27 10:41:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b4c5809-2e22-5eb9-94e9-06b3bee7f363 with identifier: SJ09412
2026-03-27 10:41:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b4c5809-2e22-5eb9-94e9-06b3bee7f363 with identifier: SJ09412
2026-03-27 10:41:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b4c5809-2e22-5eb9-94e9-06b3bee7f363 with identifier: SJ09412 to the API
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:45:10Z',
 'fuel_type': 'diesel',
 'id': '9b4c5809-2e22-5eb9-94e9-06b3bee7f363',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ09412',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 209333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-05',
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ09412%27 HTTP/1.1" 200 None
2026-03-27 10:41:10 [auto1.de] INFO: Saving data for SJ09412: {'auction_closing_time': 1774716310.0, 'created_time': 1774262913.05438, 'last_price_update_time': 1774608070.794881}
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ09412') HTTP/1.1" 204 0
2026-03-27 10:41:10 [auto1.de] INFO: Found listing with ID: PZ11168
2026-03-27 10:41:10 [auto1.de] INFO: Found listing with ID: LB22457
2026-03-27 10:41:10 [auto1.de] INFO: Found listing with ID: EE19276
2026-03-27 10:41:10 [auto1.de] INFO: Found listing with ID: RR18814
2026-03-27 10:41:10 [auto1.de] INFO: Found listing with ID: VY28868
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY28868%27 HTTP/1.1" 200 None
2026-03-27 10:41:10 [auto1.de] INFO: Scrape type for VY28868: 2
2026-03-27 10:41:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c32d40a9-15fa-500c-b0f4-60221c3e94a7 with identifier: VY28868
2026-03-27 10:41:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32d40a9-15fa-500c-b0f4-60221c3e94a7 with scrape type 2
2026-03-27 10:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c32d40a9-15fa-500c-b0f4-60221c3e94a7 with scrape type 2
2026-03-27 10:41:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c32d40a9-15fa-500c-b0f4-60221c3e94a7, identifier: VY28868
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fa2%252F9ea2027d9546ff2cfbd0c98a12e84fc7%252Fpa%252FVC80296_426305e2afbf16c8a55a12ad2295e5ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_426305e2afbf16c8a55a12ad2295e5ea.jpg not downloaded yet
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ff2%252Fe0f26fd8984653217e8a9ff63e89131a%252Fpa%252FHM57840_aea5ecedbf7e1d351e2069423ed71496.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/f2/e0f26fd8984653217e8a9ff63e89131a/pa/HM57840_aea5ecedbf7e1d351e2069423ed71496.jpg not downloaded yet
2026-03-27 10:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC79950> (referer: https://www.auto1.com/v1/car-details-view/RC79950/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a08d0>
2026-03-27 10:41:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1225177-117f-5078-8146-1d685e4c4fa4/d1225177-117f-5078-8146-1d685e4c4fa4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Feb%252F64ebe6d6fb9c57b8fdcf738aa5190061%252Fpa%252FSJ87943_77e938b9b20e636177f9ab7b1643f9ec.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_77e938b9b20e636177f9ab7b1643f9ec.jpg saved to cache
2026-03-27 10:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1225177-117f-5078-8146-1d685e4c4fa4
2026-03-27 10:41:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500560d50>
2026-03-27 10:41:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33b090c3-7679-5d79-9827-15456f1a02ca/33b090c3-7679-5d79-9827-15456f1a02ca_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fa1%252F77a1799b94a5923e966972ed11b27deb%252Fpa%252FYT12990_e7412c8f8a5ee5930f390eea8279856e.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_e7412c8f8a5ee5930f390eea8279856e.jpg saved to cache
2026-03-27 10:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 33b090c3-7679-5d79-9827-15456f1a02ca
2026-03-27 10:41:11 [auto1.de] INFO: Found listing with ID: EN50331
2026-03-27 10:41:11 [auto1.de] INFO: Found listing with ID: ZY13516
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY13516%27 HTTP/1.1" 200 None
2026-03-27 10:41:11 [auto1.de] INFO: Scrape type for ZY13516: 2
2026-03-27 10:41:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a080e24-4ed6-588a-a4ab-8331d736c3ae with identifier: ZY13516
2026-03-27 10:41:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a080e24-4ed6-588a-a4ab-8331d736c3ae with scrape type 2
2026-03-27 10:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a080e24-4ed6-588a-a4ab-8331d736c3ae with scrape type 2
2026-03-27 10:41:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a080e24-4ed6-588a-a4ab-8331d736c3ae, identifier: ZY13516
2026-03-27 10:41:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c32d40a9-15fa-500c-b0f4-60221c3e94a7 with identifier: VY28868
2026-03-27 10:41:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c32d40a9-15fa-500c-b0f4-60221c3e94a7 with identifier: VY28868
2026-03-27 10:41:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c32d40a9-15fa-500c-b0f4-60221c3e94a7 with identifier: VY28868 to the API
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:35:08Z',
 'fuel_type': 'petrol',
 'id': 'c32d40a9-15fa-500c-b0f4-60221c3e94a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY28868',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 64405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-18',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
 'transmission': 'automatic',
 'trim': 'GTI Clubsport',
 'year': 2021}
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY28868%27 HTTP/1.1" 200 None
2026-03-27 10:41:11 [auto1.de] INFO: Saving data for VY28868: {'auction_closing_time': 1774715708.0, 'created_time': 1773308350.783117, 'last_price_update_time': 1774608071.786481}
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY28868') HTTP/1.1" 204 0
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa1%252Ff1a16119c1719645d6b298b21c454d84%252Fpa%252FAC15853_fcdb0f8b1d89a3e8af20f1c702265f71.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_fcdb0f8b1d89a3e8af20f1c702265f71.jpg not downloaded yet
2026-03-27 10:41:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003f9750>
2026-03-27 10:41:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb07bd82-b0bd-5075-8364-624ab9506f2f/fb07bd82-b0bd-5075-8364-624ab9506f2f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F93%252F03936b8b295f29cc3e4f5d4dfbbebd02%252Fpa%252FLU27790_b0ed413aa50e1367d327674ec2b2a48e.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_b0ed413aa50e1367d327674ec2b2a48e.jpg saved to cache
2026-03-27 10:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb07bd82-b0bd-5075-8364-624ab9506f2f
2026-03-27 10:41:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a080e24-4ed6-588a-a4ab-8331d736c3ae with identifier: ZY13516
2026-03-27 10:41:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a080e24-4ed6-588a-a4ab-8331d736c3ae with identifier: ZY13516
2026-03-27 10:41:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a080e24-4ed6-588a-a4ab-8331d736c3ae with identifier: ZY13516 to the API
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:23:19Z',
 'fuel_type': 'petrol',
 'id': '2a080e24-4ed6-588a-a4ab-8331d736c3ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY13516',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 251247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-22',
 'seller_name': None,
 'title': 'Skoda Octavia 1.5 TSI ACT Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2018}
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY13516%27 HTTP/1.1" 200 None
2026-03-27 10:41:12 [auto1.de] INFO: Saving data for ZY13516: {'auction_closing_time': 1774714999.0, 'created_time': 1773383143.923159, 'last_price_update_time': 1774608072.420694}
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY13516') HTTP/1.1" 204 0
2026-03-27 10:41:12 [auto1.de] INFO: Found listing with ID: YA68492
2026-03-27 10:41:12 [auto1.de] INFO: Found listing with ID: TC26510
2026-03-27 10:41:12 [auto1.de] INFO: Found listing with ID: BD72910
2026-03-27 10:41:12 [auto1.de] INFO: Found listing with ID: NR67134
2026-03-27 10:41:12 [auto1.de] INFO: Found listing with ID: FS96919
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS96919%27 HTTP/1.1" 200 None
2026-03-27 10:41:12 [auto1.de] INFO: Scrape type for FS96919: 2
2026-03-27 10:41:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11f5240c-8f9d-5c93-ab4c-1219b1cea46c with identifier: FS96919
2026-03-27 10:41:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11f5240c-8f9d-5c93-ab4c-1219b1cea46c with scrape type 2
2026-03-27 10:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11f5240c-8f9d-5c93-ab4c-1219b1cea46c with scrape type 2
2026-03-27 10:41:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11f5240c-8f9d-5c93-ab4c-1219b1cea46c, identifier: FS96919
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fa2%252F9ea2027d9546ff2cfbd0c98a12e84fc7%252Fpa%252FVC80296_0839ccb5bbe4f8f335d00d2d735084a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_0839ccb5bbe4f8f335d00d2d735084a7.jpg not downloaded yet
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ff2%252Fe0f26fd8984653217e8a9ff63e89131a%252Fpa%252FHM57840_5a892523a8e5f9e6d7a2b75acb73f13a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/f2/e0f26fd8984653217e8a9ff63e89131a/pa/HM57840_5a892523a8e5f9e6d7a2b75acb73f13a.jpg not downloaded yet
2026-03-27 10:41:12 [auto1.de] INFO: Found listing with ID: DL95499
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95499%27 HTTP/1.1" 200 None
2026-03-27 10:41:12 [auto1.de] INFO: Scrape type for DL95499: 2
2026-03-27 10:41:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c248a85-2033-5e21-80c8-16b658fa9f0b with identifier: DL95499
2026-03-27 10:41:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c248a85-2033-5e21-80c8-16b658fa9f0b with scrape type 2
2026-03-27 10:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c248a85-2033-5e21-80c8-16b658fa9f0b with scrape type 2
2026-03-27 10:41:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c248a85-2033-5e21-80c8-16b658fa9f0b, identifier: DL95499
2026-03-27 10:41:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11f5240c-8f9d-5c93-ab4c-1219b1cea46c with identifier: FS96919
2026-03-27 10:41:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11f5240c-8f9d-5c93-ab4c-1219b1cea46c with identifier: FS96919
2026-03-27 10:41:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11f5240c-8f9d-5c93-ab4c-1219b1cea46c with identifier: FS96919 to the API
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:23:00Z',
 'fuel_type': 'petrol',
 'id': '11f5240c-8f9d-5c93-ab4c-1219b1cea46c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS96919',
 'listing': 'auction',
 'make': 'Daihatsu',
 'model': 'Sirion',
 'odometer': 128330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-14',
 'seller_name': None,
 'title': 'Daihatsu Sirion 1.3',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS96919%27 HTTP/1.1" 200 None
2026-03-27 10:41:13 [auto1.de] INFO: Saving data for FS96919: {'auction_closing_time': 1774714980.0, 'created_time': 1773775082.393337, 'last_price_update_time': 1774608073.061628}
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS96919') HTTP/1.1" 204 0
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa1%252Ff1a16119c1719645d6b298b21c454d84%252Fpa%252FAC15853_a6eb169d49b3c91c01fd9863f06b13f2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_a6eb169d49b3c91c01fd9863f06b13f2.jpg not downloaded yet
2026-03-27 10:41:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KS78216> (referer: https://www.auto1.com/v1/car-details-view/KS78216/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d05fbefd-eebc-541e-8bfc-188e30d0f7a7 with identifier: RC79950
2026-03-27 10:41:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d05fbefd-eebc-541e-8bfc-188e30d0f7a7 with scrape type 1
2026-03-27 10:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d05fbefd-eebc-541e-8bfc-188e30d0f7a7
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fac%252F49acf5cd89df26b118879ba5a51a3526%252Fpa%252FRC79950_b823ef9cc88a6ec4a65dedd4d4d1acec.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_b823ef9cc88a6ec4a65dedd4d4d1acec.jpg already downloaded
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fac%252F49acf5cd89df26b118879ba5a51a3526%252Fpa%252FRC79950_8e868028928cf08423963a8b75426dc3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_8e868028928cf08423963a8b75426dc3.jpg already downloaded
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fac%252F49acf5cd89df26b118879ba5a51a3526%252Fpa%252FRC79950_aa0b1eae72c4c601c6c02941f322f038.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_aa0b1eae72c4c601c6c02941f322f038.jpg already downloaded
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fac%252F49acf5cd89df26b118879ba5a51a3526%252Fpa%252FRC79950_327fefa263c2368b4e73098613f6d436.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_327fefa263c2368b4e73098613f6d436.jpg already downloaded
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fac%252F49acf5cd89df26b118879ba5a51a3526%252Fpa%252FRC79950_b32b46985f9e290b6f6f5a8cfe3a848e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_b32b46985f9e290b6f6f5a8cfe3a848e.jpg already downloaded
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fac%252F49acf5cd89df26b118879ba5a51a3526%252Fpa%252FRC79950_ca0fe7b1c8bfc0bc71f267c6a46f23a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_ca0fe7b1c8bfc0bc71f267c6a46f23a1.jpg already downloaded
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fac%252F49acf5cd89df26b118879ba5a51a3526%252Fpa%252FRC79950_017b26b989b6ce572ebfa0c44adca688.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_017b26b989b6ce572ebfa0c44adca688.jpg already downloaded
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fac%252F49acf5cd89df26b118879ba5a51a3526%252Fpa%252FRC79950_094a4748447ffa0f5f1afe124f7ef33b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_094a4748447ffa0f5f1afe124f7ef33b.jpg already downloaded
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fac%252F49acf5cd89df26b118879ba5a51a3526%252Fpa%252FRC79950_b88b0addbb9aedc8e403badd852314d3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_b88b0addbb9aedc8e403badd852314d3.jpg already downloaded
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fac%252F49acf5cd89df26b118879ba5a51a3526%252Fpa%252FRC79950_f7ee9fc67d13343aeb49d0b2aafef984.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_f7ee9fc67d13343aeb49d0b2aafef984.jpg already downloaded
2026-03-27 10:41:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d05fbefd-eebc-541e-8bfc-188e30d0f7a7, identifier: RC79950
2026-03-27 10:41:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_3700d1f79499df65e20c28d0cfb97789.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_fbdb4e92c8ba0d075da8f79f30164f59.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_285f9da811a85d3eec01a7fbc92ed3d6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c248a85-2033-5e21-80c8-16b658fa9f0b with identifier: DL95499
2026-03-27 10:41:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c248a85-2033-5e21-80c8-16b658fa9f0b with identifier: DL95499
2026-03-27 10:41:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c248a85-2033-5e21-80c8-16b658fa9f0b with identifier: DL95499 to the API
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:47:44Z',
 'fuel_type': 'diesel',
 'id': '7c248a85-2033-5e21-80c8-16b658fa9f0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL95499',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 242886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-01',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2014}
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95499%27 HTTP/1.1" 200 None
2026-03-27 10:41:13 [auto1.de] INFO: Saving data for DL95499: {'auction_closing_time': 1774716464.0, 'created_time': 1773830263.126836, 'last_price_update_time': 1774608073.740528}
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL95499') HTTP/1.1" 204 0
2026-03-27 10:41:13 [auto1.de] INFO: Found listing with ID: UJ33462
2026-03-27 10:41:13 [auto1.de] INFO: Found listing with ID: MT56584
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT56584%27 HTTP/1.1" 200 None
2026-03-27 10:41:13 [auto1.de] INFO: Scrape type for MT56584: 2
2026-03-27 10:41:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 056e708f-fade-5e36-a291-087ac51a274b with identifier: MT56584
2026-03-27 10:41:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 056e708f-fade-5e36-a291-087ac51a274b with scrape type 2
2026-03-27 10:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 056e708f-fade-5e36-a291-087ac51a274b with scrape type 2
2026-03-27 10:41:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 056e708f-fade-5e36-a291-087ac51a274b, identifier: MT56584
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fa2%252F9ea2027d9546ff2cfbd0c98a12e84fc7%252Fpa%252FVC80296_ab88b54a7c5473063171cfb40bb8a9d1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_ab88b54a7c5473063171cfb40bb8a9d1.jpg not downloaded yet
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ff2%252Fe0f26fd8984653217e8a9ff63e89131a%252Fpa%252FHM57840_f7fc9cc9b845a994126fb7ced13a6a4d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/f2/e0f26fd8984653217e8a9ff63e89131a/pa/HM57840_f7fc9cc9b845a994126fb7ced13a6a4d.jpg not downloaded yet
2026-03-27 10:41:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV46432> (referer: https://www.auto1.com/v1/car-details-view/VV46432/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FB90112> (referer: https://www.auto1.com/v1/car-details-view/FB90112/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d05fbefd-eebc-541e-8bfc-188e30d0f7a7 with identifier: RC79950
2026-03-27 10:41:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d05fbefd-eebc-541e-8bfc-188e30d0f7a7 with identifier: RC79950
2026-03-27 10:41:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d05fbefd-eebc-541e-8bfc-188e30d0f7a7 with identifier: RC79950 to the API
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RC79950>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:18:36Z',
 'fuel_type': 'petrol',
 'id': 'd05fbefd-eebc-541e-8bfc-188e30d0f7a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC79950',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 141717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_b823ef9cc88a6ec4a65dedd4d4d1acec.jpg',
                'https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_8e868028928cf08423963a8b75426dc3.jpg',
                'https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_aa0b1eae72c4c601c6c02941f322f038.jpg',
                'https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_327fefa263c2368b4e73098613f6d436.jpg',
                'https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_b32b46985f9e290b6f6f5a8cfe3a848e.jpg',
                'https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_ca0fe7b1c8bfc0bc71f267c6a46f23a1.jpg',
                'https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_017b26b989b6ce572ebfa0c44adca688.jpg',
                'https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_094a4748447ffa0f5f1afe124f7ef33b.jpg',
                'https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_b88b0addbb9aedc8e403badd852314d3.jpg',
                'https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_f7ee9fc67d13343aeb49d0b2aafef984.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d05fbefd-eebc-541e-8bfc-188e30d0f7a7/d05fbefd-eebc-541e-8bfc-188e30d0f7a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_b823ef9cc88a6ec4a65dedd4d4d1acec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d05fbefd-eebc-541e-8bfc-188e30d0f7a7/d05fbefd-eebc-541e-8bfc-188e30d0f7a7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_8e868028928cf08423963a8b75426dc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d05fbefd-eebc-541e-8bfc-188e30d0f7a7/d05fbefd-eebc-541e-8bfc-188e30d0f7a7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_aa0b1eae72c4c601c6c02941f322f038.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d05fbefd-eebc-541e-8bfc-188e30d0f7a7/d05fbefd-eebc-541e-8bfc-188e30d0f7a7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_327fefa263c2368b4e73098613f6d436.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d05fbefd-eebc-541e-8bfc-188e30d0f7a7/d05fbefd-eebc-541e-8bfc-188e30d0f7a7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_b32b46985f9e290b6f6f5a8cfe3a848e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d05fbefd-eebc-541e-8bfc-188e30d0f7a7/d05fbefd-eebc-541e-8bfc-188e30d0f7a7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_ca0fe7b1c8bfc0bc71f267c6a46f23a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d05fbefd-eebc-541e-8bfc-188e30d0f7a7/d05fbefd-eebc-541e-8bfc-188e30d0f7a7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_017b26b989b6ce572ebfa0c44adca688.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d05fbefd-eebc-541e-8bfc-188e30d0f7a7/d05fbefd-eebc-541e-8bfc-188e30d0f7a7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_094a4748447ffa0f5f1afe124f7ef33b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d05fbefd-eebc-541e-8bfc-188e30d0f7a7/d05fbefd-eebc-541e-8bfc-188e30d0f7a7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3021246,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_b88b0addbb9aedc8e403badd852314d3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d05fbefd-eebc-541e-8bfc-188e30d0f7a7/d05fbefd-eebc-541e-8bfc-188e30d0f7a7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/ac/49acf5cd89df26b118879ba5a51a3526/pa/RC79950_f7ee9fc67d13343aeb49d0b2aafef984.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-07-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Match',
 'transmission': 'automatic',
 'trim': 'Match',
 'year': 2012}
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC79950%27 HTTP/1.1" 200 None
2026-03-27 10:41:14 [auto1.de] INFO: Saving data for RC79950: {'created_time': 1774608074.248467, 'last_price_update_time': 1774608074.248478, 'auction_closing_time': 1774714716.0}
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC79950') HTTP/1.1" 204 0
2026-03-27 10:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_d2f6362f989f6f1a9c2ffc0de7f694e5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:14 [auto1.de] INFO: Found listing with ID: PD80009
2026-03-27 10:41:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 056e708f-fade-5e36-a291-087ac51a274b with identifier: MT56584
2026-03-27 10:41:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 056e708f-fade-5e36-a291-087ac51a274b with identifier: MT56584
2026-03-27 10:41:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 056e708f-fade-5e36-a291-087ac51a274b with identifier: MT56584 to the API
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:11:48Z',
 'fuel_type': 'petrol',
 'id': '056e708f-fade-5e36-a291-087ac51a274b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT56584',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 155013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-13',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Monte Carlo',
 'transmission': 'manual',
 'trim': 'Monte Carlo',
 'year': 2013}
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT56584%27 HTTP/1.1" 200 None
2026-03-27 10:41:14 [auto1.de] INFO: Saving data for MT56584: {'auction_closing_time': 1774714308.0, 'created_time': 1774293430.642372, 'last_price_update_time': 1774608074.598279}
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT56584') HTTP/1.1" 204 0
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa1%252Ff1a16119c1719645d6b298b21c454d84%252Fpa%252FAC15853_1623b34406a2584bcd605985a8da651d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_1623b34406a2584bcd605985a8da651d.jpg not downloaded yet
2026-03-27 10:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_216c839915bce3f4e8d5c7e89e5af16a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:14 [auto1.de] INFO: Found listing with ID: HV11819
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV11819%27 HTTP/1.1" 200 None
2026-03-27 10:41:14 [auto1.de] INFO: Scrape type for HV11819: 2
2026-03-27 10:41:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45259066-683c-5962-b48c-293478f9b78f with identifier: HV11819
2026-03-27 10:41:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45259066-683c-5962-b48c-293478f9b78f with scrape type 2
2026-03-27 10:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45259066-683c-5962-b48c-293478f9b78f with scrape type 2
2026-03-27 10:41:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45259066-683c-5962-b48c-293478f9b78f, identifier: HV11819
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fa2%252F9ea2027d9546ff2cfbd0c98a12e84fc7%252Fpa%252FVC80296_8654186fe0074d29791e9ec0dcaa7641.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_8654186fe0074d29791e9ec0dcaa7641.jpg not downloaded yet
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ff2%252Fe0f26fd8984653217e8a9ff63e89131a%252Fpa%252FHM57840_0d59c3af5af088fad11c6bee1cc0db04.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/f2/e0f26fd8984653217e8a9ff63e89131a/pa/HM57840_0d59c3af5af088fad11c6bee1cc0db04.jpg not downloaded yet
2026-03-27 10:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK53054/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45259066-683c-5962-b48c-293478f9b78f with identifier: HV11819
2026-03-27 10:41:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45259066-683c-5962-b48c-293478f9b78f with identifier: HV11819
2026-03-27 10:41:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45259066-683c-5962-b48c-293478f9b78f with identifier: HV11819 to the API
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:52:54Z',
 'fuel_type': 'diesel',
 'id': '45259066-683c-5962-b48c-293478f9b78f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV11819',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand Tourneo Connect',
 'odometer': 106370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-04',
 'seller_name': None,
 'title': 'Ford Grand Tourneo Connect 1.5 EcoBlue TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2019}
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV11819%27 HTTP/1.1" 200 None
2026-03-27 10:41:15 [auto1.de] INFO: Saving data for HV11819: {'auction_closing_time': 1774716774.0, 'created_time': 1773224542.883645, 'last_price_update_time': 1774608075.388324}
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV11819') HTTP/1.1" 204 0
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa1%252Ff1a16119c1719645d6b298b21c454d84%252Fpa%252FAC15853_9a9ad9d298d2489d496cd3f6c5675a6c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_9a9ad9d298d2489d496cd3f6c5675a6c.jpg not downloaded yet
2026-03-27 10:41:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4bf374e-3d58-5714-8290-da8e35fc7eab with identifier: KS78216
2026-03-27 10:41:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4bf374e-3d58-5714-8290-da8e35fc7eab with scrape type 1
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d4bf374e-3d58-5714-8290-da8e35fc7eab
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Feb%252Fafeb943790601d52b06dca3fe2d8ab7f%252Fpa%252FKS78216_b395be25bb8677d41adc8c22ab7900b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_b395be25bb8677d41adc8c22ab7900b0.jpg not downloaded yet
2026-03-27 10:41:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50170d690>
2026-03-27 10:41:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb07bd82-b0bd-5075-8364-624ab9506f2f/fb07bd82-b0bd-5075-8364-624ab9506f2f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F93%252F03936b8b295f29cc3e4f5d4dfbbebd02%252Fpa%252FLU27790_3700d1f79499df65e20c28d0cfb97789.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_3700d1f79499df65e20c28d0cfb97789.jpg saved to cache
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb07bd82-b0bd-5075-8364-624ab9506f2f
2026-03-27 10:41:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003f4d10>
2026-03-27 10:41:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcf64c8-b58b-505c-b16b-6c757f623975/2dcf64c8-b58b-505c-b16b-6c757f623975_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa1%252Ff1a16119c1719645d6b298b21c454d84%252Fpa%252FAC15853_fbdb4e92c8ba0d075da8f79f30164f59.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_fbdb4e92c8ba0d075da8f79f30164f59.jpg saved to cache
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2dcf64c8-b58b-505c-b16b-6c757f623975
2026-03-27 10:41:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016cfb10>
2026-03-27 10:41:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcf64c8-b58b-505c-b16b-6c757f623975/2dcf64c8-b58b-505c-b16b-6c757f623975_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa1%252Ff1a16119c1719645d6b298b21c454d84%252Fpa%252FAC15853_285f9da811a85d3eec01a7fbc92ed3d6.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_285f9da811a85d3eec01a7fbc92ed3d6.jpg saved to cache
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2dcf64c8-b58b-505c-b16b-6c757f623975
2026-03-27 10:41:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 125ad95c-e2f3-5f4a-9884-95b2a29e5c4a with identifier: VV46432
2026-03-27 10:41:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 125ad95c-e2f3-5f4a-9884-95b2a29e5c4a with scrape type 1
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 125ad95c-e2f3-5f4a-9884-95b2a29e5c4a
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fb3%252F53b3cbaa6ec25310de2a427bab3f01d9%252Fpa%252FVV46432_c49f47298962886f4cbad1d814cfc1f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_c49f47298962886f4cbad1d814cfc1f6.jpg already downloaded
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fb3%252F53b3cbaa6ec25310de2a427bab3f01d9%252Fpa%252FVV46432_689b103524e1d0a8c6dc55217f9fc095.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_689b103524e1d0a8c6dc55217f9fc095.jpg already downloaded
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fb3%252F53b3cbaa6ec25310de2a427bab3f01d9%252Fpa%252FVV46432_15d18e35f66e5f5a643bd2f1de164072.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_15d18e35f66e5f5a643bd2f1de164072.jpg already downloaded
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fb3%252F53b3cbaa6ec25310de2a427bab3f01d9%252Fpa%252FVV46432_fb0e47c06e991ee4b66af372b38ef2a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_fb0e47c06e991ee4b66af372b38ef2a5.jpg already downloaded
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fb3%252F53b3cbaa6ec25310de2a427bab3f01d9%252Fpa%252FVV46432_b8d0b8e903c26c85a6780280d2967637.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_b8d0b8e903c26c85a6780280d2967637.jpg already downloaded
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fb3%252F53b3cbaa6ec25310de2a427bab3f01d9%252Fpa%252FVV46432_91be87a722bf9788e25942af05e9a0c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_91be87a722bf9788e25942af05e9a0c0.jpg already downloaded
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fb3%252F53b3cbaa6ec25310de2a427bab3f01d9%252Fpa%252FVV46432_e494a751c1306c0e5492ab852c922fce.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_e494a751c1306c0e5492ab852c922fce.jpg already downloaded
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fb3%252F53b3cbaa6ec25310de2a427bab3f01d9%252Fpa%252FVV46432_ed657394bd335156cb223e23ee0da33c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_ed657394bd335156cb223e23ee0da33c.jpg already downloaded
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fb3%252F53b3cbaa6ec25310de2a427bab3f01d9%252Fpa%252FVV46432_e9ab5362c1b40bf681a8b99fbb82f26a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_e9ab5362c1b40bf681a8b99fbb82f26a.jpg already downloaded
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fb3%252F53b3cbaa6ec25310de2a427bab3f01d9%252Fpa%252FVV46432_52b1d2bcb2dac9e89d645ae1f9ba95f2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_52b1d2bcb2dac9e89d645ae1f9ba95f2.jpg already downloaded
2026-03-27 10:41:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 125ad95c-e2f3-5f4a-9884-95b2a29e5c4a, identifier: VV46432
2026-03-27 10:41:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05b91194-de22-5a83-b2ca-b71431976efb with identifier: FB90112
2026-03-27 10:41:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05b91194-de22-5a83-b2ca-b71431976efb with scrape type 1
2026-03-27 10:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05b91194-de22-5a83-b2ca-b71431976efb
2026-03-27 10:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F9d%252F2b9dee9d2053e89d1278a01061ecc934%252Fpa%252FFB90112_31cc2177b21fb53a81d81f26aa3ed9e0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_31cc2177b21fb53a81d81f26aa3ed9e0.jpg not downloaded yet
2026-03-27 10:41:16 [auto1.de] INFO: Found listing with ID: NA53807
2026-03-27 10:41:16 [auto1.de] INFO: Found listing with ID: FP92588
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP92588%27 HTTP/1.1" 200 None
2026-03-27 10:41:16 [auto1.de] INFO: Scrape type for FP92588: 2
2026-03-27 10:41:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efa3c882-164d-5314-acbc-ed8d77b17f77 with identifier: FP92588
2026-03-27 10:41:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efa3c882-164d-5314-acbc-ed8d77b17f77 with scrape type 2
2026-03-27 10:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efa3c882-164d-5314-acbc-ed8d77b17f77 with scrape type 2
2026-03-27 10:41:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efa3c882-164d-5314-acbc-ed8d77b17f77, identifier: FP92588
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fa2%252F9ea2027d9546ff2cfbd0c98a12e84fc7%252Fpa%252FVC80296_6de99f1b19b2c3a04d70ae7dca19b29c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_6de99f1b19b2c3a04d70ae7dca19b29c.jpg not downloaded yet
2026-03-27 10:41:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 125ad95c-e2f3-5f4a-9884-95b2a29e5c4a with identifier: VV46432
2026-03-27 10:41:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 125ad95c-e2f3-5f4a-9884-95b2a29e5c4a with identifier: VV46432
2026-03-27 10:41:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 125ad95c-e2f3-5f4a-9884-95b2a29e5c4a with identifier: VV46432 to the API
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VV46432>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 367,
 'expiration_date': '2026-03-28T16:49:18Z',
 'fuel_type': 'petrol',
 'id': '125ad95c-e2f3-5f4a-9884-95b2a29e5c4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV46432',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Audi',
 'model': 'S5',
 'odometer': 4925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_c49f47298962886f4cbad1d814cfc1f6.jpg',
                'https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_689b103524e1d0a8c6dc55217f9fc095.jpg',
                'https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_15d18e35f66e5f5a643bd2f1de164072.jpg',
                'https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_fb0e47c06e991ee4b66af372b38ef2a5.jpg',
                'https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_b8d0b8e903c26c85a6780280d2967637.jpg',
                'https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_91be87a722bf9788e25942af05e9a0c0.jpg',
                'https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_e494a751c1306c0e5492ab852c922fce.jpg',
                'https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_ed657394bd335156cb223e23ee0da33c.jpg',
                'https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_e9ab5362c1b40bf681a8b99fbb82f26a.jpg',
                'https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_52b1d2bcb2dac9e89d645ae1f9ba95f2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_125ad95c-e2f3-5f4a-9884-95b2a29e5c4a/125ad95c-e2f3-5f4a-9884-95b2a29e5c4a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_c49f47298962886f4cbad1d814cfc1f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_125ad95c-e2f3-5f4a-9884-95b2a29e5c4a/125ad95c-e2f3-5f4a-9884-95b2a29e5c4a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_689b103524e1d0a8c6dc55217f9fc095.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_125ad95c-e2f3-5f4a-9884-95b2a29e5c4a/125ad95c-e2f3-5f4a-9884-95b2a29e5c4a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_15d18e35f66e5f5a643bd2f1de164072.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_125ad95c-e2f3-5f4a-9884-95b2a29e5c4a/125ad95c-e2f3-5f4a-9884-95b2a29e5c4a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_fb0e47c06e991ee4b66af372b38ef2a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_125ad95c-e2f3-5f4a-9884-95b2a29e5c4a/125ad95c-e2f3-5f4a-9884-95b2a29e5c4a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_b8d0b8e903c26c85a6780280d2967637.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_125ad95c-e2f3-5f4a-9884-95b2a29e5c4a/125ad95c-e2f3-5f4a-9884-95b2a29e5c4a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_91be87a722bf9788e25942af05e9a0c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_125ad95c-e2f3-5f4a-9884-95b2a29e5c4a/125ad95c-e2f3-5f4a-9884-95b2a29e5c4a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_e494a751c1306c0e5492ab852c922fce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_125ad95c-e2f3-5f4a-9884-95b2a29e5c4a/125ad95c-e2f3-5f4a-9884-95b2a29e5c4a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_ed657394bd335156cb223e23ee0da33c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_125ad95c-e2f3-5f4a-9884-95b2a29e5c4a/125ad95c-e2f3-5f4a-9884-95b2a29e5c4a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_e9ab5362c1b40bf681a8b99fbb82f26a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_125ad95c-e2f3-5f4a-9884-95b2a29e5c4a/125ad95c-e2f3-5f4a-9884-95b2a29e5c4a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/b3/53b3cbaa6ec25310de2a427bab3f01d9/pa/VV46432_52b1d2bcb2dac9e89d645ae1f9ba95f2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-08-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi S5 3.0 TFSI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2024}
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46432%27 HTTP/1.1" 200 None
2026-03-27 10:41:16 [auto1.de] INFO: Saving data for VV46432: {'created_time': 1774608076.490126, 'last_price_update_time': 1774608076.490137, 'auction_closing_time': 1774716558.0}
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV46432') HTTP/1.1" 204 0
2026-03-27 10:41:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_fcdb0f8b1d89a3e8af20f1c702265f71.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/f2/e0f26fd8984653217e8a9ff63e89131a/pa/HM57840_aea5ecedbf7e1d351e2069423ed71496.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/f2/e0f26fd8984653217e8a9ff63e89131a/pa/HM57840_5a892523a8e5f9e6d7a2b75acb73f13a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efa3c882-164d-5314-acbc-ed8d77b17f77 with identifier: FP92588
2026-03-27 10:41:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efa3c882-164d-5314-acbc-ed8d77b17f77 with identifier: FP92588
2026-03-27 10:41:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efa3c882-164d-5314-acbc-ed8d77b17f77 with identifier: FP92588 to the API
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:00:23Z',
 'fuel_type': 'petrol',
 'id': 'efa3c882-164d-5314-acbc-ed8d77b17f77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP92588',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 66848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-18',
 'seller_name': None,
 'title': 'Honda Civic 2.0 VTEC Type-R GT',
 'transmission': 'manual',
 'trim': 'Type-R GT',
 'year': 2018}
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP92588%27 HTTP/1.1" 200 None
2026-03-27 10:41:16 [auto1.de] INFO: Saving data for FP92588: {'auction_closing_time': 1774713623.0, 'created_time': 1773400835.273956, 'last_price_update_time': 1774608076.934345}
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP92588') HTTP/1.1" 204 0
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa1%252Ff1a16119c1719645d6b298b21c454d84%252Fpa%252FAC15853_9c17888e53da8a83a4c88e6b48ea21c4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_9c17888e53da8a83a4c88e6b48ea21c4.jpg not downloaded yet
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Feb%252Fafeb943790601d52b06dca3fe2d8ab7f%252Fpa%252FKS78216_a43dc5f30445dcfde337f7408e9b3e73.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_a43dc5f30445dcfde337f7408e9b3e73.jpg not downloaded yet
2026-03-27 10:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F9d%252F2b9dee9d2053e89d1278a01061ecc934%252Fpa%252FFB90112_219f3d413b1427bd3e611a0b60585cc5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_219f3d413b1427bd3e611a0b60585cc5.jpg not downloaded yet
2026-03-27 10:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_0839ccb5bbe4f8f335d00d2d735084a7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:17 [auto1.de] INFO: Found listing with ID: MZ26894
2026-03-27 10:41:17 [auto1.de] INFO: Found listing with ID: LB25198
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB25198%27 HTTP/1.1" 200 None
2026-03-27 10:41:17 [auto1.de] INFO: Scrape type for LB25198: 2
2026-03-27 10:41:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df76649b-e3e6-5f74-81f2-16f1dee725e3 with identifier: LB25198
2026-03-27 10:41:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df76649b-e3e6-5f74-81f2-16f1dee725e3 with scrape type 2
2026-03-27 10:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df76649b-e3e6-5f74-81f2-16f1dee725e3 with scrape type 2
2026-03-27 10:41:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df76649b-e3e6-5f74-81f2-16f1dee725e3, identifier: LB25198
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fa2%252F9ea2027d9546ff2cfbd0c98a12e84fc7%252Fpa%252FVC80296_d25d99774a0609fedbc657c23155071e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_d25d99774a0609fedbc657c23155071e.jpg not downloaded yet
2026-03-27 10:41:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016af090>
2026-03-27 10:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33b090c3-7679-5d79-9827-15456f1a02ca/33b090c3-7679-5d79-9827-15456f1a02ca_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fa1%252F77a1799b94a5923e966972ed11b27deb%252Fpa%252FYT12990_d2f6362f989f6f1a9c2ffc0de7f694e5.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_d2f6362f989f6f1a9c2ffc0de7f694e5.jpg saved to cache
2026-03-27 10:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 33b090c3-7679-5d79-9827-15456f1a02ca
2026-03-27 10:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50049e490>
2026-03-27 10:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcf64c8-b58b-505c-b16b-6c757f623975/2dcf64c8-b58b-505c-b16b-6c757f623975_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa1%252Ff1a16119c1719645d6b298b21c454d84%252Fpa%252FAC15853_216c839915bce3f4e8d5c7e89e5af16a.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_216c839915bce3f4e8d5c7e89e5af16a.jpg saved to cache
2026-03-27 10:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2dcf64c8-b58b-505c-b16b-6c757f623975
2026-03-27 10:41:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df76649b-e3e6-5f74-81f2-16f1dee725e3 with identifier: LB25198
2026-03-27 10:41:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df76649b-e3e6-5f74-81f2-16f1dee725e3 with identifier: LB25198
2026-03-27 10:41:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df76649b-e3e6-5f74-81f2-16f1dee725e3 with identifier: LB25198 to the API
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 435,
 'expiration_date': '2026-03-28T16:34:54Z',
 'fuel_type': 'diesel',
 'id': 'df76649b-e3e6-5f74-81f2-16f1dee725e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB25198',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ7',
 'odometer': 158917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-22',
 'seller_name': None,
 'title': 'Audi SQ7 4.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB25198%27 HTTP/1.1" 200 None
2026-03-27 10:41:17 [auto1.de] INFO: Saving data for LB25198: {'auction_closing_time': 1774715694.0, 'created_time': 1773861387.901099, 'last_price_update_time': 1774608077.791975}
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB25198') HTTP/1.1" 204 0
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa1%252Ff1a16119c1719645d6b298b21c454d84%252Fpa%252FAC15853_c792072f5fc68251b603390cd683b69a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_c792072f5fc68251b603390cd683b69a.jpg not downloaded yet
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Feb%252Fafeb943790601d52b06dca3fe2d8ab7f%252Fpa%252FKS78216_27ad9cdd060318a6178d5c9c00913fe1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_27ad9cdd060318a6178d5c9c00913fe1.jpg not downloaded yet
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F9d%252F2b9dee9d2053e89d1278a01061ecc934%252Fpa%252FFB90112_3480bb8503aa494b1720b1f47c313ead.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_3480bb8503aa494b1720b1f47c313ead.jpg not downloaded yet
2026-03-27 10:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA44697> (referer: https://www.auto1.com/v1/car-details-view/DA44697/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:17 [auto1.de] INFO: Found listing with ID: UX10113
2026-03-27 10:41:17 [auto1.de] INFO: Found listing with ID: YJ99770
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ99770%27 HTTP/1.1" 200 None
2026-03-27 10:41:17 [auto1.de] INFO: Scrape type for YJ99770: 0
2026-03-27 10:41:17 [auto1.de] INFO: Found listing with ID: NE66332
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE66332%27 HTTP/1.1" 200 None
2026-03-27 10:41:17 [auto1.de] INFO: Scrape type for NE66332: 1
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fa2%252F9ea2027d9546ff2cfbd0c98a12e84fc7%252Fpa%252FVC80296_392bb478063697c72caced94989e8c0a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_392bb478063697c72caced94989e8c0a.jpg not downloaded yet
2026-03-27 10:41:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015d32d0>
2026-03-27 10:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcf64c8-b58b-505c-b16b-6c757f623975/2dcf64c8-b58b-505c-b16b-6c757f623975_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa1%252Ff1a16119c1719645d6b298b21c454d84%252Fpa%252FAC15853_fcdb0f8b1d89a3e8af20f1c702265f71.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_fcdb0f8b1d89a3e8af20f1c702265f71.jpg saved to cache
2026-03-27 10:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2dcf64c8-b58b-505c-b16b-6c757f623975
2026-03-27 10:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001bbe90>
2026-03-27 10:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1840c47c-e51b-5fee-bfff-05055c749594/1840c47c-e51b-5fee-bfff-05055c749594_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ff2%252Fe0f26fd8984653217e8a9ff63e89131a%252Fpa%252FHM57840_aea5ecedbf7e1d351e2069423ed71496.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/f2/e0f26fd8984653217e8a9ff63e89131a/pa/HM57840_aea5ecedbf7e1d351e2069423ed71496.jpg saved to cache
2026-03-27 10:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1840c47c-e51b-5fee-bfff-05055c749594
2026-03-27 10:41:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a136d0>
2026-03-27 10:41:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1840c47c-e51b-5fee-bfff-05055c749594/1840c47c-e51b-5fee-bfff-05055c749594_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ff2%252Fe0f26fd8984653217e8a9ff63e89131a%252Fpa%252FHM57840_5a892523a8e5f9e6d7a2b75acb73f13a.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/f2/e0f26fd8984653217e8a9ff63e89131a/pa/HM57840_5a892523a8e5f9e6d7a2b75acb73f13a.jpg saved to cache
2026-03-27 10:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1840c47c-e51b-5fee-bfff-05055c749594
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa1%252Ff1a16119c1719645d6b298b21c454d84%252Fpa%252FAC15853_60af4e20455e82fad672fa5cfd156eef.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_60af4e20455e82fad672fa5cfd156eef.jpg not downloaded yet
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Feb%252Fafeb943790601d52b06dca3fe2d8ab7f%252Fpa%252FKS78216_e0132a3e05649fffda7f31d4b232736e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_e0132a3e05649fffda7f31d4b232736e.jpg not downloaded yet
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F9d%252F2b9dee9d2053e89d1278a01061ecc934%252Fpa%252FFB90112_cdfd49f8b782dabd61baf935dbace38e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_cdfd49f8b782dabd61baf935dbace38e.jpg not downloaded yet
2026-03-27 10:41:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015c4c50>
2026-03-27 10:41:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79782f7c-8fc5-5326-b805-52f47039130d/79782f7c-8fc5-5326-b805-52f47039130d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fa2%252F9ea2027d9546ff2cfbd0c98a12e84fc7%252Fpa%252FVC80296_0839ccb5bbe4f8f335d00d2d735084a7.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_0839ccb5bbe4f8f335d00d2d735084a7.jpg saved to cache
2026-03-27 10:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79782f7c-8fc5-5326-b805-52f47039130d
2026-03-27 10:41:18 [auto1.de] INFO: Found listing with ID: FU30780
2026-03-27 10:41:18 [auto1.de] INFO: Found listing with ID: RJ15430
2026-03-27 10:41:18 [auto1.de] INFO: Found listing with ID: XB16241
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB16241%27 HTTP/1.1" 200 None
2026-03-27 10:41:18 [auto1.de] INFO: Scrape type for XB16241: 2
2026-03-27 10:41:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0572a376-77bf-51a3-93ef-8de2f8eb6a82 with identifier: XB16241
2026-03-27 10:41:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0572a376-77bf-51a3-93ef-8de2f8eb6a82 with scrape type 2
2026-03-27 10:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0572a376-77bf-51a3-93ef-8de2f8eb6a82 with scrape type 2
2026-03-27 10:41:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0572a376-77bf-51a3-93ef-8de2f8eb6a82, identifier: XB16241
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fa2%252F9ea2027d9546ff2cfbd0c98a12e84fc7%252Fpa%252FVC80296_56288b7129d3e7a964b46a10e9fc7ac1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_56288b7129d3e7a964b46a10e9fc7ac1.jpg not downloaded yet
2026-03-27 10:41:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0572a376-77bf-51a3-93ef-8de2f8eb6a82 with identifier: XB16241
2026-03-27 10:41:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0572a376-77bf-51a3-93ef-8de2f8eb6a82 with identifier: XB16241
2026-03-27 10:41:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0572a376-77bf-51a3-93ef-8de2f8eb6a82 with identifier: XB16241 to the API
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:02:51Z',
 'fuel_type': 'diesel',
 'id': '0572a376-77bf-51a3-93ef-8de2f8eb6a82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB16241',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 145715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-25',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Active Start/Stop',
 'transmission': 'manual',
 'trim': 'Active Start/Stop',
 'year': 2017}
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB16241%27 HTTP/1.1" 200 None
2026-03-27 10:41:18 [auto1.de] INFO: Saving data for XB16241: {'auction_closing_time': 1774713771.0, 'created_time': 1773775601.776793, 'last_price_update_time': 1774608078.633723}
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB16241') HTTP/1.1" 204 0
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Feb%252Fafeb943790601d52b06dca3fe2d8ab7f%252Fpa%252FKS78216_133c9c764b3e51bc54185d62c3c4606e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_133c9c764b3e51bc54185d62c3c4606e.jpg not downloaded yet
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F9d%252F2b9dee9d2053e89d1278a01061ecc934%252Fpa%252FFB90112_a8f18c2987f3593104a2a4695fde0965.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_a8f18c2987f3593104a2a4695fde0965.jpg not downloaded yet
2026-03-27 10:41:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01346f00-0669-5426-b2ed-c2a65de6f861 with identifier: DA44697
2026-03-27 10:41:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01346f00-0669-5426-b2ed-c2a65de6f861 with scrape type 1
2026-03-27 10:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 01346f00-0669-5426-b2ed-c2a65de6f861
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F3a%252F003a87fc1e304cab85b63b21ae5a0cf3%252Fpa%252FDA44697_8ce0c1dc0162581e817c8d3dd0ef202c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/3a/003a87fc1e304cab85b63b21ae5a0cf3/pa/DA44697_8ce0c1dc0162581e817c8d3dd0ef202c.jpg not downloaded yet
2026-03-27 10:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_219f3d413b1427bd3e611a0b60585cc5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_31cc2177b21fb53a81d81f26aa3ed9e0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:18 [auto1.de] INFO: Found listing with ID: EP05122
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP05122%27 HTTP/1.1" 200 None
2026-03-27 10:41:18 [auto1.de] INFO: Scrape type for EP05122: 2
2026-03-27 10:41:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7267485-db74-570b-a230-cc5d837feab2 with identifier: EP05122
2026-03-27 10:41:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7267485-db74-570b-a230-cc5d837feab2 with scrape type 2
2026-03-27 10:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7267485-db74-570b-a230-cc5d837feab2 with scrape type 2
2026-03-27 10:41:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7267485-db74-570b-a230-cc5d837feab2, identifier: EP05122
2026-03-27 10:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_a43dc5f30445dcfde337f7408e9b3e73.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7267485-db74-570b-a230-cc5d837feab2 with identifier: EP05122
2026-03-27 10:41:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7267485-db74-570b-a230-cc5d837feab2 with identifier: EP05122
2026-03-27 10:41:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7267485-db74-570b-a230-cc5d837feab2 with identifier: EP05122 to the API
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:43:23Z',
 'fuel_type': 'diesel',
 'id': 'a7267485-db74-570b-a230-cc5d837feab2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP05122',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vectra',
 'odometer': 238179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-21',
 'seller_name': None,
 'title': 'Opel Vectra 3.0 V6 CDTI Cosmo Plus',
 'transmission': 'automatic',
 'trim': 'Cosmo Plus',
 'year': 2007}
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP05122%27 HTTP/1.1" 200 None
2026-03-27 10:41:19 [auto1.de] INFO: Saving data for EP05122: {'auction_closing_time': 1774716203.0, 'created_time': 1773686292.837456, 'last_price_update_time': 1774608079.225194}
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP05122') HTTP/1.1" 204 0
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Feb%252Fafeb943790601d52b06dca3fe2d8ab7f%252Fpa%252FKS78216_a53cab26dc4f962fde86791e46ed79f2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_a53cab26dc4f962fde86791e46ed79f2.jpg not downloaded yet
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F9d%252F2b9dee9d2053e89d1278a01061ecc934%252Fpa%252FFB90112_2b53f9f40ca582daf2e367b6ffc544ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_2b53f9f40ca582daf2e367b6ffc544ea.jpg not downloaded yet
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F3a%252F003a87fc1e304cab85b63b21ae5a0cf3%252Fpa%252FDA44697_4869f58ae848544c0b20a793460a3bb0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/3a/003a87fc1e304cab85b63b21ae5a0cf3/pa/DA44697_4869f58ae848544c0b20a793460a3bb0.jpg not downloaded yet
2026-03-27 10:41:19 [auto1.de] INFO: Found listing with ID: BD12559
2026-03-27 10:41:19 [auto1.de] INFO: Found listing with ID: HE81981
2026-03-27 10:41:19 [auto1.de] INFO: Found listing with ID: NN62521
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN62521%27 HTTP/1.1" 200 None
2026-03-27 10:41:19 [auto1.de] INFO: Scrape type for NN62521: 1
2026-03-27 10:41:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_9a9ad9d298d2489d496cd3f6c5675a6c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Feb%252Fafeb943790601d52b06dca3fe2d8ab7f%252Fpa%252FKS78216_e13e62fe62efd6883849565ea10dce88.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_e13e62fe62efd6883849565ea10dce88.jpg not downloaded yet
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F9d%252F2b9dee9d2053e89d1278a01061ecc934%252Fpa%252FFB90112_251396d64f587d4f6e6562b2a4934f80.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_251396d64f587d4f6e6562b2a4934f80.jpg not downloaded yet
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F3a%252F003a87fc1e304cab85b63b21ae5a0cf3%252Fpa%252FDA44697_54601251334906e24bf704f5f2b3ce50.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/3a/003a87fc1e304cab85b63b21ae5a0cf3/pa/DA44697_54601251334906e24bf704f5f2b3ce50.jpg not downloaded yet
2026-03-27 10:41:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_b395be25bb8677d41adc8c22ab7900b0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:19 [auto1.de] INFO: Found listing with ID: RF33157
2026-03-27 10:41:19 [auto1.de] INFO: Found listing with ID: MA81482
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81482%27 HTTP/1.1" 200 None
2026-03-27 10:41:19 [auto1.de] INFO: Scrape type for MA81482: 2
2026-03-27 10:41:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 710a572e-edd9-5abc-8bae-0b24e758d3ab with identifier: MA81482
2026-03-27 10:41:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 710a572e-edd9-5abc-8bae-0b24e758d3ab with scrape type 2
2026-03-27 10:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 710a572e-edd9-5abc-8bae-0b24e758d3ab with scrape type 2
2026-03-27 10:41:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 710a572e-edd9-5abc-8bae-0b24e758d3ab, identifier: MA81482
2026-03-27 10:41:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV35791> (referer: https://www.auto1.com/v1/car-details-view/CV35791/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 710a572e-edd9-5abc-8bae-0b24e758d3ab with identifier: MA81482
2026-03-27 10:41:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 710a572e-edd9-5abc-8bae-0b24e758d3ab with identifier: MA81482
2026-03-27 10:41:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 710a572e-edd9-5abc-8bae-0b24e758d3ab with identifier: MA81482 to the API
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:15:59Z',
 'fuel_type': 'petrol',
 'id': '710a572e-edd9-5abc-8bae-0b24e758d3ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA81482',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 107265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-20',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2021}
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81482%27 HTTP/1.1" 200 None
2026-03-27 10:41:19 [auto1.de] INFO: Saving data for MA81482: {'auction_closing_time': 1774714559.0, 'created_time': 1773402369.125346, 'last_price_update_time': 1774608079.906927}
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA81482') HTTP/1.1" 204 0
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Feb%252Fafeb943790601d52b06dca3fe2d8ab7f%252Fpa%252FKS78216_f38bc4aae1fc1c4611fff377f748e886.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_f38bc4aae1fc1c4611fff377f748e886.jpg not downloaded yet
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F9d%252F2b9dee9d2053e89d1278a01061ecc934%252Fpa%252FFB90112_b7ee48d2c2c922bc4ab1cd5f2c4e2f98.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_b7ee48d2c2c922bc4ab1cd5f2c4e2f98.jpg not downloaded yet
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F3a%252F003a87fc1e304cab85b63b21ae5a0cf3%252Fpa%252FDA44697_8fc8725ca2fa0fd2de3a69a76ce93273.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/3a/003a87fc1e304cab85b63b21ae5a0cf3/pa/DA44697_8fc8725ca2fa0fd2de3a69a76ce93273.jpg not downloaded yet
2026-03-27 10:41:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50172b350>
2026-03-27 10:41:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05b91194-de22-5a83-b2ca-b71431976efb/05b91194-de22-5a83-b2ca-b71431976efb_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F9d%252F2b9dee9d2053e89d1278a01061ecc934%252Fpa%252FFB90112_219f3d413b1427bd3e611a0b60585cc5.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_219f3d413b1427bd3e611a0b60585cc5.jpg saved to cache
2026-03-27 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05b91194-de22-5a83-b2ca-b71431976efb
2026-03-27 10:41:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015d7e90>
2026-03-27 10:41:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05b91194-de22-5a83-b2ca-b71431976efb/05b91194-de22-5a83-b2ca-b71431976efb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F9d%252F2b9dee9d2053e89d1278a01061ecc934%252Fpa%252FFB90112_31cc2177b21fb53a81d81f26aa3ed9e0.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_31cc2177b21fb53a81d81f26aa3ed9e0.jpg saved to cache
2026-03-27 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05b91194-de22-5a83-b2ca-b71431976efb
2026-03-27 10:41:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017292d0>
2026-03-27 10:41:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4bf374e-3d58-5714-8290-da8e35fc7eab/d4bf374e-3d58-5714-8290-da8e35fc7eab_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Feb%252Fafeb943790601d52b06dca3fe2d8ab7f%252Fpa%252FKS78216_a43dc5f30445dcfde337f7408e9b3e73.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_a43dc5f30445dcfde337f7408e9b3e73.jpg saved to cache
2026-03-27 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d4bf374e-3d58-5714-8290-da8e35fc7eab
2026-03-27 10:41:20 [auto1.de] INFO: Found listing with ID: DB46013
2026-03-27 10:41:20 [auto1.de] INFO: Found listing with ID: TJ83975
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ83975%27 HTTP/1.1" 200 None
2026-03-27 10:41:20 [auto1.de] INFO: Scrape type for TJ83975: 2
2026-03-27 10:41:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6e319ce-b6fd-5a9f-9e4e-9272ce540652 with identifier: TJ83975
2026-03-27 10:41:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6e319ce-b6fd-5a9f-9e4e-9272ce540652 with scrape type 2
2026-03-27 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6e319ce-b6fd-5a9f-9e4e-9272ce540652 with scrape type 2
2026-03-27 10:41:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6e319ce-b6fd-5a9f-9e4e-9272ce540652, identifier: TJ83975
2026-03-27 10:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/f2/e0f26fd8984653217e8a9ff63e89131a/pa/HM57840_0d59c3af5af088fad11c6bee1cc0db04.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6e319ce-b6fd-5a9f-9e4e-9272ce540652 with identifier: TJ83975
2026-03-27 10:41:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6e319ce-b6fd-5a9f-9e4e-9272ce540652 with identifier: TJ83975
2026-03-27 10:41:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6e319ce-b6fd-5a9f-9e4e-9272ce540652 with identifier: TJ83975 to the API
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:34:47Z',
 'fuel_type': 'diesel',
 'id': 'e6e319ce-b6fd-5a9f-9e4e-9272ce540652',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ83975',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Cruze',
 'odometer': 212091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-21',
 'seller_name': None,
 'title': 'Chevrolet Cruze 2.0 Diesel LTZ',
 'transmission': 'automatic',
 'trim': 'LTZ',
 'year': 2013}
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ83975%27 HTTP/1.1" 200 None
2026-03-27 10:41:20 [auto1.de] INFO: Saving data for TJ83975: {'auction_closing_time': 1774715687.0, 'created_time': 1774291420.187291, 'last_price_update_time': 1774608080.680086}
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ83975') HTTP/1.1" 204 0
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Feb%252Fafeb943790601d52b06dca3fe2d8ab7f%252Fpa%252FKS78216_f8cc58f05d0585bb088cc4cd0f65ce44.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_f8cc58f05d0585bb088cc4cd0f65ce44.jpg not downloaded yet
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F9d%252F2b9dee9d2053e89d1278a01061ecc934%252Fpa%252FFB90112_43a8e400d467e1958f0d7fbfbceb646a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_43a8e400d467e1958f0d7fbfbceb646a.jpg not downloaded yet
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F3a%252F003a87fc1e304cab85b63b21ae5a0cf3%252Fpa%252FDA44697_bd32d44df9e0da9469415cdb8a5e4892.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/3a/003a87fc1e304cab85b63b21ae5a0cf3/pa/DA44697_bd32d44df9e0da9469415cdb8a5e4892.jpg not downloaded yet
2026-03-27 10:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JW30909> (referer: https://www.auto1.com/v1/car-details-view/JW30909/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016cf710>
2026-03-27 10:41:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcf64c8-b58b-505c-b16b-6c757f623975/2dcf64c8-b58b-505c-b16b-6c757f623975_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa1%252Ff1a16119c1719645d6b298b21c454d84%252Fpa%252FAC15853_9a9ad9d298d2489d496cd3f6c5675a6c.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_9a9ad9d298d2489d496cd3f6c5675a6c.jpg saved to cache
2026-03-27 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2dcf64c8-b58b-505c-b16b-6c757f623975
2026-03-27 10:41:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50186e710>
2026-03-27 10:41:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4bf374e-3d58-5714-8290-da8e35fc7eab/d4bf374e-3d58-5714-8290-da8e35fc7eab_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Feb%252Fafeb943790601d52b06dca3fe2d8ab7f%252Fpa%252FKS78216_b395be25bb8677d41adc8c22ab7900b0.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_b395be25bb8677d41adc8c22ab7900b0.jpg saved to cache
2026-03-27 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4bf374e-3d58-5714-8290-da8e35fc7eab
2026-03-27 10:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_8654186fe0074d29791e9ec0dcaa7641.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:20 [auto1.de] INFO: Found listing with ID: ZN02812
2026-03-27 10:41:20 [auto1.de] INFO: Found listing with ID: CW50467
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW50467%27 HTTP/1.1" 200 None
2026-03-27 10:41:20 [auto1.de] INFO: Scrape type for CW50467: 2
2026-03-27 10:41:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df07608e-c87f-5488-a469-d61f37992642 with identifier: CW50467
2026-03-27 10:41:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df07608e-c87f-5488-a469-d61f37992642 with scrape type 2
2026-03-27 10:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df07608e-c87f-5488-a469-d61f37992642 with scrape type 2
2026-03-27 10:41:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df07608e-c87f-5488-a469-d61f37992642, identifier: CW50467
2026-03-27 10:41:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df07608e-c87f-5488-a469-d61f37992642 with identifier: CW50467
2026-03-27 10:41:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df07608e-c87f-5488-a469-d61f37992642 with identifier: CW50467
2026-03-27 10:41:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df07608e-c87f-5488-a469-d61f37992642 with identifier: CW50467 to the API
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-28T16:03:50Z',
 'fuel_type': 'petrol',
 'id': 'df07608e-c87f-5488-a469-d61f37992642',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW50467',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 281116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-11',
 'seller_name': None,
 'title': 'Toyota Avensis 1.6',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW50467%27 HTTP/1.1" 200 None
2026-03-27 10:41:21 [auto1.de] INFO: Saving data for CW50467: {'auction_closing_time': 1774713830.0, 'created_time': 1774291204.065733, 'last_price_update_time': 1774608081.29371}
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW50467') HTTP/1.1" 204 0
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Feb%252Fafeb943790601d52b06dca3fe2d8ab7f%252Fpa%252FKS78216_cb292725b625ed78d6eab925a0b7991c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_cb292725b625ed78d6eab925a0b7991c.jpg not downloaded yet
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F9d%252F2b9dee9d2053e89d1278a01061ecc934%252Fpa%252FFB90112_019657119c91b8cde7d4fe5687ce0436.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_019657119c91b8cde7d4fe5687ce0436.jpg not downloaded yet
2026-03-27 10:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_acddc06ee17bed8d5da6c288437bb04e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_9ae67efff1eb4942e9434e08ab6cd549.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_56288b7129d3e7a964b46a10e9fc7ac1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:21 [auto1.de] INFO: Found listing with ID: AB49272
2026-03-27 10:41:21 [auto1.de] INFO: Found listing with ID: BW18754
2026-03-27 10:41:21 [auto1.de] INFO: Found listing with ID: MF02392
2026-03-27 10:41:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d19f4928-f2b1-5682-97e3-2b0388039e04 with identifier: CV35791
2026-03-27 10:41:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d19f4928-f2b1-5682-97e3-2b0388039e04 with scrape type 1
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d19f4928-f2b1-5682-97e3-2b0388039e04
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F33%252Fce331667e10a8554465a22e2010aaae1%252Fpa%252FCV35791_abc16f177aa2b20e0e43aae5e7c42e5a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_abc16f177aa2b20e0e43aae5e7c42e5a.jpg not downloaded yet
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50ff21d10>
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1840c47c-e51b-5fee-bfff-05055c749594/1840c47c-e51b-5fee-bfff-05055c749594_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ff2%252Fe0f26fd8984653217e8a9ff63e89131a%252Fpa%252FHM57840_0d59c3af5af088fad11c6bee1cc0db04.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/f2/e0f26fd8984653217e8a9ff63e89131a/pa/HM57840_0d59c3af5af088fad11c6bee1cc0db04.jpg saved to cache
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1840c47c-e51b-5fee-bfff-05055c749594
2026-03-27 10:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_cdfd49f8b782dabd61baf935dbace38e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/3a/003a87fc1e304cab85b63b21ae5a0cf3/pa/DA44697_8ce0c1dc0162581e817c8d3dd0ef202c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F33%252Fce331667e10a8554465a22e2010aaae1%252Fpa%252FCV35791_3d0c17f56242737c3ba5fd5222a4f02b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_3d0c17f56242737c3ba5fd5222a4f02b.jpg not downloaded yet
2026-03-27 10:41:21 [crawlers.middlewares.id_gen_middleware] INFO: Duplicate ID generated for item: 39a73000-d2ce-5a52-b8f5-a36cdb240ebf with identifier: JW30909, dropping item
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d1ad0>
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79782f7c-8fc5-5326-b805-52f47039130d/79782f7c-8fc5-5326-b805-52f47039130d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fa2%252F9ea2027d9546ff2cfbd0c98a12e84fc7%252Fpa%252FVC80296_8654186fe0074d29791e9ec0dcaa7641.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_8654186fe0074d29791e9ec0dcaa7641.jpg saved to cache
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79782f7c-8fc5-5326-b805-52f47039130d
2026-03-27 10:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/3a/003a87fc1e304cab85b63b21ae5a0cf3/pa/DA44697_8fc8725ca2fa0fd2de3a69a76ce93273.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F33%252Fce331667e10a8554465a22e2010aaae1%252Fpa%252FCV35791_57a75deb7feda4e44464f7eb900a2df6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_57a75deb7feda4e44464f7eb900a2df6.jpg not downloaded yet
2026-03-27 10:41:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002fd390>
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1225177-117f-5078-8146-1d685e4c4fa4/d1225177-117f-5078-8146-1d685e4c4fa4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Feb%252F64ebe6d6fb9c57b8fdcf738aa5190061%252Fpa%252FSJ87943_acddc06ee17bed8d5da6c288437bb04e.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_acddc06ee17bed8d5da6c288437bb04e.jpg saved to cache
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1225177-117f-5078-8146-1d685e4c4fa4
2026-03-27 10:41:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016f6710>
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1225177-117f-5078-8146-1d685e4c4fa4/d1225177-117f-5078-8146-1d685e4c4fa4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Feb%252F64ebe6d6fb9c57b8fdcf738aa5190061%252Fpa%252FSJ87943_9ae67efff1eb4942e9434e08ab6cd549.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_9ae67efff1eb4942e9434e08ab6cd549.jpg saved to cache
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1225177-117f-5078-8146-1d685e4c4fa4
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016add50>
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79782f7c-8fc5-5326-b805-52f47039130d/79782f7c-8fc5-5326-b805-52f47039130d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fa2%252F9ea2027d9546ff2cfbd0c98a12e84fc7%252Fpa%252FVC80296_56288b7129d3e7a964b46a10e9fc7ac1.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_56288b7129d3e7a964b46a10e9fc7ac1.jpg saved to cache
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79782f7c-8fc5-5326-b805-52f47039130d
2026-03-27 10:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/3a/003a87fc1e304cab85b63b21ae5a0cf3/pa/DA44697_54601251334906e24bf704f5f2b3ce50.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/3a/003a87fc1e304cab85b63b21ae5a0cf3/pa/DA44697_4869f58ae848544c0b20a793460a3bb0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F33%252Fce331667e10a8554465a22e2010aaae1%252Fpa%252FCV35791_eb8a095226803bdd3158cfa5106ed3d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_eb8a095226803bdd3158cfa5106ed3d8.jpg not downloaded yet
2026-03-27 10:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_b7ee48d2c2c922bc4ab1cd5f2c4e2f98.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500594b50>
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05b91194-de22-5a83-b2ca-b71431976efb/05b91194-de22-5a83-b2ca-b71431976efb_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F9d%252F2b9dee9d2053e89d1278a01061ecc934%252Fpa%252FFB90112_cdfd49f8b782dabd61baf935dbace38e.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_cdfd49f8b782dabd61baf935dbace38e.jpg saved to cache
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05b91194-de22-5a83-b2ca-b71431976efb
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019a6f10>
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01346f00-0669-5426-b2ed-c2a65de6f861/01346f00-0669-5426-b2ed-c2a65de6f861_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F3a%252F003a87fc1e304cab85b63b21ae5a0cf3%252Fpa%252FDA44697_8ce0c1dc0162581e817c8d3dd0ef202c.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/3a/003a87fc1e304cab85b63b21ae5a0cf3/pa/DA44697_8ce0c1dc0162581e817c8d3dd0ef202c.jpg saved to cache
2026-03-27 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01346f00-0669-5426-b2ed-c2a65de6f861
2026-03-27 10:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_251396d64f587d4f6e6562b2a4934f80.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_f38bc4aae1fc1c4611fff377f748e886.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F33%252Fce331667e10a8554465a22e2010aaae1%252Fpa%252FCV35791_23924e26205f246243ab75b3e75c0204.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_23924e26205f246243ab75b3e75c0204.jpg not downloaded yet
2026-03-27 10:41:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK53054> (referer: https://www.auto1.com/v1/car-details-view/NK53054/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F33%252Fce331667e10a8554465a22e2010aaae1%252Fpa%252FCV35791_302bbcf805a9060cc16f0aaf53ad7924.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_302bbcf805a9060cc16f0aaf53ad7924.jpg not downloaded yet
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500554710>
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01346f00-0669-5426-b2ed-c2a65de6f861/01346f00-0669-5426-b2ed-c2a65de6f861_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F3a%252F003a87fc1e304cab85b63b21ae5a0cf3%252Fpa%252FDA44697_8fc8725ca2fa0fd2de3a69a76ce93273.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/3a/003a87fc1e304cab85b63b21ae5a0cf3/pa/DA44697_8fc8725ca2fa0fd2de3a69a76ce93273.jpg saved to cache
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 01346f00-0669-5426-b2ed-c2a65de6f861
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d22d0>
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01346f00-0669-5426-b2ed-c2a65de6f861/01346f00-0669-5426-b2ed-c2a65de6f861_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F3a%252F003a87fc1e304cab85b63b21ae5a0cf3%252Fpa%252FDA44697_54601251334906e24bf704f5f2b3ce50.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/3a/003a87fc1e304cab85b63b21ae5a0cf3/pa/DA44697_54601251334906e24bf704f5f2b3ce50.jpg saved to cache
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01346f00-0669-5426-b2ed-c2a65de6f861
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50040da10>
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01346f00-0669-5426-b2ed-c2a65de6f861/01346f00-0669-5426-b2ed-c2a65de6f861_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F3a%252F003a87fc1e304cab85b63b21ae5a0cf3%252Fpa%252FDA44697_4869f58ae848544c0b20a793460a3bb0.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/3a/003a87fc1e304cab85b63b21ae5a0cf3/pa/DA44697_4869f58ae848544c0b20a793460a3bb0.jpg saved to cache
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 01346f00-0669-5426-b2ed-c2a65de6f861
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015da590>
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05b91194-de22-5a83-b2ca-b71431976efb/05b91194-de22-5a83-b2ca-b71431976efb_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F9d%252F2b9dee9d2053e89d1278a01061ecc934%252Fpa%252FFB90112_b7ee48d2c2c922bc4ab1cd5f2c4e2f98.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_b7ee48d2c2c922bc4ab1cd5f2c4e2f98.jpg saved to cache
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05b91194-de22-5a83-b2ca-b71431976efb
2026-03-27 10:41:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_019657119c91b8cde7d4fe5687ce0436.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F33%252Fce331667e10a8554465a22e2010aaae1%252Fpa%252FCV35791_1c71c12f21c89934167161d344915466.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_1c71c12f21c89934167161d344915466.jpg not downloaded yet
2026-03-27 10:41:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_abc16f177aa2b20e0e43aae5e7c42e5a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_f8cc58f05d0585bb088cc4cd0f65ce44.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016d3f90>
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05b91194-de22-5a83-b2ca-b71431976efb/05b91194-de22-5a83-b2ca-b71431976efb_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F9d%252F2b9dee9d2053e89d1278a01061ecc934%252Fpa%252FFB90112_251396d64f587d4f6e6562b2a4934f80.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_251396d64f587d4f6e6562b2a4934f80.jpg saved to cache
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05b91194-de22-5a83-b2ca-b71431976efb
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016d3fd0>
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4bf374e-3d58-5714-8290-da8e35fc7eab/d4bf374e-3d58-5714-8290-da8e35fc7eab_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Feb%252Fafeb943790601d52b06dca3fe2d8ab7f%252Fpa%252FKS78216_f38bc4aae1fc1c4611fff377f748e886.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_f38bc4aae1fc1c4611fff377f748e886.jpg saved to cache
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d4bf374e-3d58-5714-8290-da8e35fc7eab
2026-03-27 10:41:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96419e94-377d-57d7-9b8a-a7e029e76ed9 with identifier: NK53054
2026-03-27 10:41:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96419e94-377d-57d7-9b8a-a7e029e76ed9 with scrape type 1
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96419e94-377d-57d7-9b8a-a7e029e76ed9
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb2%252Fdfb204e412105b71692b23363f212337%252Fpa%252FNK53054_4d68a5f917892930dfbbf935536e1140.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_4d68a5f917892930dfbbf935536e1140.jpg already downloaded
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb2%252Fdfb204e412105b71692b23363f212337%252Fpa%252FNK53054_f6db08a563504193bacf0a254ae2f493.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_f6db08a563504193bacf0a254ae2f493.jpg already downloaded
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb2%252Fdfb204e412105b71692b23363f212337%252Fpa%252FNK53054_18e0582488366906fd773cbba49fccb8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_18e0582488366906fd773cbba49fccb8.jpg already downloaded
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb2%252Fdfb204e412105b71692b23363f212337%252Fpa%252FNK53054_b4d803e43f867ef44a4b8b2ec47d24f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_b4d803e43f867ef44a4b8b2ec47d24f5.jpg already downloaded
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb2%252Fdfb204e412105b71692b23363f212337%252Fpa%252FNK53054_911896dca9c14ced2644942df860b548.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_911896dca9c14ced2644942df860b548.jpg already downloaded
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb2%252Fdfb204e412105b71692b23363f212337%252Fpa%252FNK53054_0d2e616e89be9a0d7bce9f51542a0866.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_0d2e616e89be9a0d7bce9f51542a0866.jpg already downloaded
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb2%252Fdfb204e412105b71692b23363f212337%252Fpa%252FNK53054_93e1e0595571a7e4cbc56719a387a5c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_93e1e0595571a7e4cbc56719a387a5c5.jpg already downloaded
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb2%252Fdfb204e412105b71692b23363f212337%252Fpa%252FNK53054_99f7735c4b64a64da3dcfcbd0d37f33a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_99f7735c4b64a64da3dcfcbd0d37f33a.jpg already downloaded
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb2%252Fdfb204e412105b71692b23363f212337%252Fpa%252FNK53054_bc8a3cf91dd0d321d23b3d9cdfd61e56.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_bc8a3cf91dd0d321d23b3d9cdfd61e56.jpg already downloaded
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb2%252Fdfb204e412105b71692b23363f212337%252Fpa%252FNK53054_8570da494f9421fe92daf98334633c7c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_8570da494f9421fe92daf98334633c7c.jpg already downloaded
2026-03-27 10:41:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96419e94-377d-57d7-9b8a-a7e029e76ed9, identifier: NK53054
2026-03-27 10:41:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/3a/003a87fc1e304cab85b63b21ae5a0cf3/pa/DA44697_bd32d44df9e0da9469415cdb8a5e4892.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F33%252Fce331667e10a8554465a22e2010aaae1%252Fpa%252FCV35791_ef7bac10b425c5a4c91a75ed4e75b68d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_ef7bac10b425c5a4c91a75ed4e75b68d.jpg not downloaded yet
2026-03-27 10:41:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96419e94-377d-57d7-9b8a-a7e029e76ed9 with identifier: NK53054
2026-03-27 10:41:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96419e94-377d-57d7-9b8a-a7e029e76ed9 with identifier: NK53054
2026-03-27 10:41:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96419e94-377d-57d7-9b8a-a7e029e76ed9 with identifier: NK53054 to the API
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NK53054>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:08:57Z',
 'fuel_type': 'petrol',
 'id': '96419e94-377d-57d7-9b8a-a7e029e76ed9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK53054',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 83922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_4d68a5f917892930dfbbf935536e1140.jpg',
                'https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_f6db08a563504193bacf0a254ae2f493.jpg',
                'https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_18e0582488366906fd773cbba49fccb8.jpg',
                'https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_b4d803e43f867ef44a4b8b2ec47d24f5.jpg',
                'https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_911896dca9c14ced2644942df860b548.jpg',
                'https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_0d2e616e89be9a0d7bce9f51542a0866.jpg',
                'https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_93e1e0595571a7e4cbc56719a387a5c5.jpg',
                'https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_99f7735c4b64a64da3dcfcbd0d37f33a.jpg',
                'https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_bc8a3cf91dd0d321d23b3d9cdfd61e56.jpg',
                'https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_8570da494f9421fe92daf98334633c7c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96419e94-377d-57d7-9b8a-a7e029e76ed9/96419e94-377d-57d7-9b8a-a7e029e76ed9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2407998,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_4d68a5f917892930dfbbf935536e1140.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96419e94-377d-57d7-9b8a-a7e029e76ed9/96419e94-377d-57d7-9b8a-a7e029e76ed9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_f6db08a563504193bacf0a254ae2f493.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96419e94-377d-57d7-9b8a-a7e029e76ed9/96419e94-377d-57d7-9b8a-a7e029e76ed9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_18e0582488366906fd773cbba49fccb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96419e94-377d-57d7-9b8a-a7e029e76ed9/96419e94-377d-57d7-9b8a-a7e029e76ed9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_b4d803e43f867ef44a4b8b2ec47d24f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96419e94-377d-57d7-9b8a-a7e029e76ed9/96419e94-377d-57d7-9b8a-a7e029e76ed9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_911896dca9c14ced2644942df860b548.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96419e94-377d-57d7-9b8a-a7e029e76ed9/96419e94-377d-57d7-9b8a-a7e029e76ed9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2468926,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_0d2e616e89be9a0d7bce9f51542a0866.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96419e94-377d-57d7-9b8a-a7e029e76ed9/96419e94-377d-57d7-9b8a-a7e029e76ed9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_93e1e0595571a7e4cbc56719a387a5c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96419e94-377d-57d7-9b8a-a7e029e76ed9/96419e94-377d-57d7-9b8a-a7e029e76ed9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_99f7735c4b64a64da3dcfcbd0d37f33a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96419e94-377d-57d7-9b8a-a7e029e76ed9/96419e94-377d-57d7-9b8a-a7e029e76ed9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_bc8a3cf91dd0d321d23b3d9cdfd61e56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96419e94-377d-57d7-9b8a-a7e029e76ed9/96419e94-377d-57d7-9b8a-a7e029e76ed9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b2/dfb204e412105b71692b23363f212337/pa/NK53054_8570da494f9421fe92daf98334633c7c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-16',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.2 TSI Club BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Club BlueMotion Tech',
 'year': 2016}
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK53054%27 HTTP/1.1" 200 None
2026-03-27 10:41:23 [auto1.de] INFO: Saving data for NK53054: {'created_time': 1774608083.567906, 'last_price_update_time': 1774608083.567917, 'auction_closing_time': 1774714137.0}
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK53054') HTTP/1.1" 204 0
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F33%252Fce331667e10a8554465a22e2010aaae1%252Fpa%252FCV35791_3ba070eb32a4455d6ec8094b44e46b2a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_3ba070eb32a4455d6ec8094b44e46b2a.jpg not downloaded yet
2026-03-27 10:41:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50045b0d0>
2026-03-27 10:41:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05b91194-de22-5a83-b2ca-b71431976efb/05b91194-de22-5a83-b2ca-b71431976efb_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F9d%252F2b9dee9d2053e89d1278a01061ecc934%252Fpa%252FFB90112_019657119c91b8cde7d4fe5687ce0436.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_019657119c91b8cde7d4fe5687ce0436.jpg saved to cache
2026-03-27 10:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 05b91194-de22-5a83-b2ca-b71431976efb
2026-03-27 10:41:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001cf410>
2026-03-27 10:41:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19f4928-f2b1-5682-97e3-2b0388039e04/d19f4928-f2b1-5682-97e3-2b0388039e04_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F33%252Fce331667e10a8554465a22e2010aaae1%252Fpa%252FCV35791_abc16f177aa2b20e0e43aae5e7c42e5a.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_abc16f177aa2b20e0e43aae5e7c42e5a.jpg saved to cache
2026-03-27 10:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d19f4928-f2b1-5682-97e3-2b0388039e04
2026-03-27 10:41:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501651e10>
2026-03-27 10:41:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4bf374e-3d58-5714-8290-da8e35fc7eab/d4bf374e-3d58-5714-8290-da8e35fc7eab_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Feb%252Fafeb943790601d52b06dca3fe2d8ab7f%252Fpa%252FKS78216_f8cc58f05d0585bb088cc4cd0f65ce44.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_f8cc58f05d0585bb088cc4cd0f65ce44.jpg saved to cache
2026-03-27 10:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d4bf374e-3d58-5714-8290-da8e35fc7eab
2026-03-27 10:41:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_57a75deb7feda4e44464f7eb900a2df6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_cb292725b625ed78d6eab925a0b7991c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_3d0c17f56242737c3ba5fd5222a4f02b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F33%252Fce331667e10a8554465a22e2010aaae1%252Fpa%252FCV35791_cf4b26385b4b8c122337dd772a2dca0c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_cf4b26385b4b8c122337dd772a2dca0c.jpg not downloaded yet
2026-03-27 10:41:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500503e10>
2026-03-27 10:41:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01346f00-0669-5426-b2ed-c2a65de6f861/01346f00-0669-5426-b2ed-c2a65de6f861_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F3a%252F003a87fc1e304cab85b63b21ae5a0cf3%252Fpa%252FDA44697_bd32d44df9e0da9469415cdb8a5e4892.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/3a/003a87fc1e304cab85b63b21ae5a0cf3/pa/DA44697_bd32d44df9e0da9469415cdb8a5e4892.jpg saved to cache
2026-03-27 10:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 01346f00-0669-5426-b2ed-c2a65de6f861
2026-03-27 10:41:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01346f00-0669-5426-b2ed-c2a65de6f861, skipping ID generation
2026-03-27 10:41:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01346f00-0669-5426-b2ed-c2a65de6f861 with scrape type 1
2026-03-27 10:41:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01346f00-0669-5426-b2ed-c2a65de6f861 sending to next pipeline
2026-03-27 10:41:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01346f00-0669-5426-b2ed-c2a65de6f861, identifier: DA44697
2026-03-27 10:41:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01346f00-0669-5426-b2ed-c2a65de6f861 with identifier: DA44697
2026-03-27 10:41:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01346f00-0669-5426-b2ed-c2a65de6f861 with identifier: DA44697
2026-03-27 10:41:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01346f00-0669-5426-b2ed-c2a65de6f861 with identifier: DA44697 to the API
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img00/3a/003a87fc1e304cab85b63b21ae5a0cf3/pa/DA44697_bd32d44df9e0da9469415cdb8a5e4892.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.9L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:20:35Z',
 'fuel_type': 'diesel',
 'id': '01346f00-0669-5426-b2ed-c2a65de6f861',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA44697',
 'listing': 'auction',
 'location': 'DE, Siegen',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 266392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01346f00-0669-5426-b2ed-c2a65de6f861/01346f00-0669-5426-b2ed-c2a65de6f861_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/3a/003a87fc1e304cab85b63b21ae5a0cf3/pa/DA44697_8ce0c1dc0162581e817c8d3dd0ef202c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01346f00-0669-5426-b2ed-c2a65de6f861/01346f00-0669-5426-b2ed-c2a65de6f861_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/3a/003a87fc1e304cab85b63b21ae5a0cf3/pa/DA44697_4869f58ae848544c0b20a793460a3bb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01346f00-0669-5426-b2ed-c2a65de6f861/01346f00-0669-5426-b2ed-c2a65de6f861_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/3a/003a87fc1e304cab85b63b21ae5a0cf3/pa/DA44697_54601251334906e24bf704f5f2b3ce50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01346f00-0669-5426-b2ed-c2a65de6f861/01346f00-0669-5426-b2ed-c2a65de6f861_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59072,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/3a/003a87fc1e304cab85b63b21ae5a0cf3/pa/DA44697_8fc8725ca2fa0fd2de3a69a76ce93273.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01346f00-0669-5426-b2ed-c2a65de6f861/01346f00-0669-5426-b2ed-c2a65de6f861_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/3a/003a87fc1e304cab85b63b21ae5a0cf3/pa/DA44697_bd32d44df9e0da9469415cdb8a5e4892.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2008}
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA44697%27 HTTP/1.1" 200 None
2026-03-27 10:41:24 [auto1.de] INFO: Saving data for DA44697: {'created_time': 1774608084.370593, 'last_price_update_time': 1774608084.370606, 'auction_closing_time': 1774714835.0}
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA44697') HTTP/1.1" 204 0
2026-03-27 10:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_eb8a095226803bdd3158cfa5106ed3d8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_23924e26205f246243ab75b3e75c0204.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501894850>
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19f4928-f2b1-5682-97e3-2b0388039e04/d19f4928-f2b1-5682-97e3-2b0388039e04_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F33%252Fce331667e10a8554465a22e2010aaae1%252Fpa%252FCV35791_57a75deb7feda4e44464f7eb900a2df6.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_57a75deb7feda4e44464f7eb900a2df6.jpg saved to cache
2026-03-27 10:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d19f4928-f2b1-5682-97e3-2b0388039e04
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501622f50>
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4bf374e-3d58-5714-8290-da8e35fc7eab/d4bf374e-3d58-5714-8290-da8e35fc7eab_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Feb%252Fafeb943790601d52b06dca3fe2d8ab7f%252Fpa%252FKS78216_cb292725b625ed78d6eab925a0b7991c.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_cb292725b625ed78d6eab925a0b7991c.jpg saved to cache
2026-03-27 10:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d4bf374e-3d58-5714-8290-da8e35fc7eab
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002dcc90>
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19f4928-f2b1-5682-97e3-2b0388039e04/d19f4928-f2b1-5682-97e3-2b0388039e04_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F33%252Fce331667e10a8554465a22e2010aaae1%252Fpa%252FCV35791_3d0c17f56242737c3ba5fd5222a4f02b.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_3d0c17f56242737c3ba5fd5222a4f02b.jpg saved to cache
2026-03-27 10:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d19f4928-f2b1-5682-97e3-2b0388039e04
2026-03-27 10:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_302bbcf805a9060cc16f0aaf53ad7924.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_e13e62fe62efd6883849565ea10dce88.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_9c17888e53da8a83a4c88e6b48ea21c4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501845ad0>
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19f4928-f2b1-5682-97e3-2b0388039e04/d19f4928-f2b1-5682-97e3-2b0388039e04_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F33%252Fce331667e10a8554465a22e2010aaae1%252Fpa%252FCV35791_eb8a095226803bdd3158cfa5106ed3d8.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_eb8a095226803bdd3158cfa5106ed3d8.jpg saved to cache
2026-03-27 10:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d19f4928-f2b1-5682-97e3-2b0388039e04
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501872d10>
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19f4928-f2b1-5682-97e3-2b0388039e04/d19f4928-f2b1-5682-97e3-2b0388039e04_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F33%252Fce331667e10a8554465a22e2010aaae1%252Fpa%252FCV35791_23924e26205f246243ab75b3e75c0204.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_23924e26205f246243ab75b3e75c0204.jpg saved to cache
2026-03-27 10:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d19f4928-f2b1-5682-97e3-2b0388039e04
2026-03-27 10:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_5ebb0b55450ad08feb87facba6962896.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001e2550>
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19f4928-f2b1-5682-97e3-2b0388039e04/d19f4928-f2b1-5682-97e3-2b0388039e04_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F33%252Fce331667e10a8554465a22e2010aaae1%252Fpa%252FCV35791_302bbcf805a9060cc16f0aaf53ad7924.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_302bbcf805a9060cc16f0aaf53ad7924.jpg saved to cache
2026-03-27 10:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d19f4928-f2b1-5682-97e3-2b0388039e04
2026-03-27 10:41:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016f7e10>
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4bf374e-3d58-5714-8290-da8e35fc7eab/d4bf374e-3d58-5714-8290-da8e35fc7eab_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Feb%252Fafeb943790601d52b06dca3fe2d8ab7f%252Fpa%252FKS78216_e13e62fe62efd6883849565ea10dce88.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_e13e62fe62efd6883849565ea10dce88.jpg saved to cache
2026-03-27 10:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d4bf374e-3d58-5714-8290-da8e35fc7eab
2026-03-27 10:41:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017288d0>
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcf64c8-b58b-505c-b16b-6c757f623975/2dcf64c8-b58b-505c-b16b-6c757f623975_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa1%252Ff1a16119c1719645d6b298b21c454d84%252Fpa%252FAC15853_9c17888e53da8a83a4c88e6b48ea21c4.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_9c17888e53da8a83a4c88e6b48ea21c4.jpg saved to cache
2026-03-27 10:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2dcf64c8-b58b-505c-b16b-6c757f623975
2026-03-27 10:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_1c71c12f21c89934167161d344915466.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_6de99f1b19b2c3a04d70ae7dca19b29c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_a53cab26dc4f962fde86791e46ed79f2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_2b53f9f40ca582daf2e367b6ffc544ea.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016aa7d0>
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79782f7c-8fc5-5326-b805-52f47039130d/79782f7c-8fc5-5326-b805-52f47039130d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fa2%252F9ea2027d9546ff2cfbd0c98a12e84fc7%252Fpa%252FVC80296_5ebb0b55450ad08feb87facba6962896.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_5ebb0b55450ad08feb87facba6962896.jpg saved to cache
2026-03-27 10:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79782f7c-8fc5-5326-b805-52f47039130d
2026-03-27 10:41:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501958e10>
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19f4928-f2b1-5682-97e3-2b0388039e04/d19f4928-f2b1-5682-97e3-2b0388039e04_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F33%252Fce331667e10a8554465a22e2010aaae1%252Fpa%252FCV35791_1c71c12f21c89934167161d344915466.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_1c71c12f21c89934167161d344915466.jpg saved to cache
2026-03-27 10:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d19f4928-f2b1-5682-97e3-2b0388039e04
2026-03-27 10:41:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501871710>
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79782f7c-8fc5-5326-b805-52f47039130d/79782f7c-8fc5-5326-b805-52f47039130d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fa2%252F9ea2027d9546ff2cfbd0c98a12e84fc7%252Fpa%252FVC80296_6de99f1b19b2c3a04d70ae7dca19b29c.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_6de99f1b19b2c3a04d70ae7dca19b29c.jpg saved to cache
2026-03-27 10:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79782f7c-8fc5-5326-b805-52f47039130d
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50049c650>
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4bf374e-3d58-5714-8290-da8e35fc7eab/d4bf374e-3d58-5714-8290-da8e35fc7eab_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Feb%252Fafeb943790601d52b06dca3fe2d8ab7f%252Fpa%252FKS78216_a53cab26dc4f962fde86791e46ed79f2.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_a53cab26dc4f962fde86791e46ed79f2.jpg saved to cache
2026-03-27 10:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d4bf374e-3d58-5714-8290-da8e35fc7eab
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500557b90>
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05b91194-de22-5a83-b2ca-b71431976efb/05b91194-de22-5a83-b2ca-b71431976efb_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F9d%252F2b9dee9d2053e89d1278a01061ecc934%252Fpa%252FFB90112_2b53f9f40ca582daf2e367b6ffc544ea.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_2b53f9f40ca582daf2e367b6ffc544ea.jpg saved to cache
2026-03-27 10:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05b91194-de22-5a83-b2ca-b71431976efb
2026-03-27 10:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_133c9c764b3e51bc54185d62c3c4606e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_e0132a3e05649fffda7f31d4b232736e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_60af4e20455e82fad672fa5cfd156eef.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_cf4b26385b4b8c122337dd772a2dca0c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_43a8e400d467e1958f0d7fbfbceb646a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_3ba070eb32a4455d6ec8094b44e46b2a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_ef7bac10b425c5a4c91a75ed4e75b68d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_a8f18c2987f3593104a2a4695fde0965.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/f2/e0f26fd8984653217e8a9ff63e89131a/pa/HM57840_f7fc9cc9b845a994126fb7ced13a6a4d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016ae990>
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4bf374e-3d58-5714-8290-da8e35fc7eab/d4bf374e-3d58-5714-8290-da8e35fc7eab_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Feb%252Fafeb943790601d52b06dca3fe2d8ab7f%252Fpa%252FKS78216_133c9c764b3e51bc54185d62c3c4606e.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_133c9c764b3e51bc54185d62c3c4606e.jpg saved to cache
2026-03-27 10:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d4bf374e-3d58-5714-8290-da8e35fc7eab
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001e30d0>
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4bf374e-3d58-5714-8290-da8e35fc7eab/d4bf374e-3d58-5714-8290-da8e35fc7eab_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Feb%252Fafeb943790601d52b06dca3fe2d8ab7f%252Fpa%252FKS78216_e0132a3e05649fffda7f31d4b232736e.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_e0132a3e05649fffda7f31d4b232736e.jpg saved to cache
2026-03-27 10:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d4bf374e-3d58-5714-8290-da8e35fc7eab
2026-03-27 10:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_27ad9cdd060318a6178d5c9c00913fe1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_3480bb8503aa494b1720b1f47c313ead.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_c792072f5fc68251b603390cd683b69a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001c9f50>
2026-03-27 10:41:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcf64c8-b58b-505c-b16b-6c757f623975/2dcf64c8-b58b-505c-b16b-6c757f623975_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa1%252Ff1a16119c1719645d6b298b21c454d84%252Fpa%252FAC15853_60af4e20455e82fad672fa5cfd156eef.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_60af4e20455e82fad672fa5cfd156eef.jpg saved to cache
2026-03-27 10:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2dcf64c8-b58b-505c-b16b-6c757f623975
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50182b990>
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19f4928-f2b1-5682-97e3-2b0388039e04/d19f4928-f2b1-5682-97e3-2b0388039e04_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F33%252Fce331667e10a8554465a22e2010aaae1%252Fpa%252FCV35791_cf4b26385b4b8c122337dd772a2dca0c.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_cf4b26385b4b8c122337dd772a2dca0c.jpg saved to cache
2026-03-27 10:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d19f4928-f2b1-5682-97e3-2b0388039e04
2026-03-27 10:41:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50186d3d0>
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05b91194-de22-5a83-b2ca-b71431976efb/05b91194-de22-5a83-b2ca-b71431976efb_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F9d%252F2b9dee9d2053e89d1278a01061ecc934%252Fpa%252FFB90112_43a8e400d467e1958f0d7fbfbceb646a.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_43a8e400d467e1958f0d7fbfbceb646a.jpg saved to cache
2026-03-27 10:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 05b91194-de22-5a83-b2ca-b71431976efb
2026-03-27 10:41:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501733bd0>
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19f4928-f2b1-5682-97e3-2b0388039e04/d19f4928-f2b1-5682-97e3-2b0388039e04_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F33%252Fce331667e10a8554465a22e2010aaae1%252Fpa%252FCV35791_3ba070eb32a4455d6ec8094b44e46b2a.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_3ba070eb32a4455d6ec8094b44e46b2a.jpg saved to cache
2026-03-27 10:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d19f4928-f2b1-5682-97e3-2b0388039e04
2026-03-27 10:41:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002dfad0>
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19f4928-f2b1-5682-97e3-2b0388039e04/d19f4928-f2b1-5682-97e3-2b0388039e04_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F33%252Fce331667e10a8554465a22e2010aaae1%252Fpa%252FCV35791_ef7bac10b425c5a4c91a75ed4e75b68d.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_ef7bac10b425c5a4c91a75ed4e75b68d.jpg saved to cache
2026-03-27 10:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d19f4928-f2b1-5682-97e3-2b0388039e04
2026-03-27 10:41:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d19f4928-f2b1-5682-97e3-2b0388039e04, skipping ID generation
2026-03-27 10:41:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d19f4928-f2b1-5682-97e3-2b0388039e04 with scrape type 1
2026-03-27 10:41:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d19f4928-f2b1-5682-97e3-2b0388039e04 sending to next pipeline
2026-03-27 10:41:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d19f4928-f2b1-5682-97e3-2b0388039e04, identifier: CV35791
2026-03-27 10:41:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500588690>
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05b91194-de22-5a83-b2ca-b71431976efb/05b91194-de22-5a83-b2ca-b71431976efb_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F9d%252F2b9dee9d2053e89d1278a01061ecc934%252Fpa%252FFB90112_a8f18c2987f3593104a2a4695fde0965.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_a8f18c2987f3593104a2a4695fde0965.jpg saved to cache
2026-03-27 10:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05b91194-de22-5a83-b2ca-b71431976efb
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001cc410>
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1840c47c-e51b-5fee-bfff-05055c749594/1840c47c-e51b-5fee-bfff-05055c749594_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ff2%252Fe0f26fd8984653217e8a9ff63e89131a%252Fpa%252FHM57840_f7fc9cc9b845a994126fb7ced13a6a4d.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/f2/e0f26fd8984653217e8a9ff63e89131a/pa/HM57840_f7fc9cc9b845a994126fb7ced13a6a4d.jpg saved to cache
2026-03-27 10:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1840c47c-e51b-5fee-bfff-05055c749594
2026-03-27 10:41:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d19f4928-f2b1-5682-97e3-2b0388039e04 with identifier: CV35791
2026-03-27 10:41:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d19f4928-f2b1-5682-97e3-2b0388039e04 with identifier: CV35791
2026-03-27 10:41:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d19f4928-f2b1-5682-97e3-2b0388039e04 with identifier: CV35791 to the API
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_ef7bac10b425c5a4c91a75ed4e75b68d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:23:36Z',
 'fuel_type': 'petrol',
 'id': 'd19f4928-f2b1-5682-97e3-2b0388039e04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV35791',
 'listing': 'auction',
 'location': 'DE, Augsburg',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 127010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19f4928-f2b1-5682-97e3-2b0388039e04/d19f4928-f2b1-5682-97e3-2b0388039e04_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_abc16f177aa2b20e0e43aae5e7c42e5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19f4928-f2b1-5682-97e3-2b0388039e04/d19f4928-f2b1-5682-97e3-2b0388039e04_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_3d0c17f56242737c3ba5fd5222a4f02b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19f4928-f2b1-5682-97e3-2b0388039e04/d19f4928-f2b1-5682-97e3-2b0388039e04_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_57a75deb7feda4e44464f7eb900a2df6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19f4928-f2b1-5682-97e3-2b0388039e04/d19f4928-f2b1-5682-97e3-2b0388039e04_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_eb8a095226803bdd3158cfa5106ed3d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19f4928-f2b1-5682-97e3-2b0388039e04/d19f4928-f2b1-5682-97e3-2b0388039e04_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_23924e26205f246243ab75b3e75c0204.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19f4928-f2b1-5682-97e3-2b0388039e04/d19f4928-f2b1-5682-97e3-2b0388039e04_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_302bbcf805a9060cc16f0aaf53ad7924.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19f4928-f2b1-5682-97e3-2b0388039e04/d19f4928-f2b1-5682-97e3-2b0388039e04_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_1c71c12f21c89934167161d344915466.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19f4928-f2b1-5682-97e3-2b0388039e04/d19f4928-f2b1-5682-97e3-2b0388039e04_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2882924,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_ef7bac10b425c5a4c91a75ed4e75b68d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19f4928-f2b1-5682-97e3-2b0388039e04/d19f4928-f2b1-5682-97e3-2b0388039e04_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2975896,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_3ba070eb32a4455d6ec8094b44e46b2a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19f4928-f2b1-5682-97e3-2b0388039e04/d19f4928-f2b1-5682-97e3-2b0388039e04_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/33/ce331667e10a8554465a22e2010aaae1/pa/CV35791_cf4b26385b4b8c122337dd772a2dca0c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Dream Team 2WD',
 'transmission': 'manual',
 'trim': 'Dream Team 2WD',
 'year': 2014}
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV35791%27 HTTP/1.1" 200 None
2026-03-27 10:41:27 [auto1.de] INFO: Saving data for CV35791: {'created_time': 1774608087.324686, 'last_price_update_time': 1774608087.324696, 'auction_closing_time': 1774715016.0}
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV35791') HTTP/1.1" 204 0
2026-03-27 10:41:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003c4d50>
2026-03-27 10:41:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4bf374e-3d58-5714-8290-da8e35fc7eab/d4bf374e-3d58-5714-8290-da8e35fc7eab_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Feb%252Fafeb943790601d52b06dca3fe2d8ab7f%252Fpa%252FKS78216_27ad9cdd060318a6178d5c9c00913fe1.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_27ad9cdd060318a6178d5c9c00913fe1.jpg saved to cache
2026-03-27 10:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d4bf374e-3d58-5714-8290-da8e35fc7eab
2026-03-27 10:41:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4bf374e-3d58-5714-8290-da8e35fc7eab, skipping ID generation
2026-03-27 10:41:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4bf374e-3d58-5714-8290-da8e35fc7eab with scrape type 1
2026-03-27 10:41:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4bf374e-3d58-5714-8290-da8e35fc7eab sending to next pipeline
2026-03-27 10:41:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4bf374e-3d58-5714-8290-da8e35fc7eab, identifier: KS78216
2026-03-27 10:41:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_426305e2afbf16c8a55a12ad2295e5ea.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4bf374e-3d58-5714-8290-da8e35fc7eab with identifier: KS78216
2026-03-27 10:41:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4bf374e-3d58-5714-8290-da8e35fc7eab with identifier: KS78216
2026-03-27 10:41:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4bf374e-3d58-5714-8290-da8e35fc7eab with identifier: KS78216 to the API
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_27ad9cdd060318a6178d5c9c00913fe1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 680,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 3',
 'engine': '1.3L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:17:12Z',
 'fuel_type': 'petrol',
 'id': 'd4bf374e-3d58-5714-8290-da8e35fc7eab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS78216',
 'listing': 'auction',
 'location': 'DE, Sulzbach-Rosenberg',
 'make': 'Suzuki',
 'model': 'Jimny',
 'odometer': 87652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4bf374e-3d58-5714-8290-da8e35fc7eab/d4bf374e-3d58-5714-8290-da8e35fc7eab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_b395be25bb8677d41adc8c22ab7900b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4bf374e-3d58-5714-8290-da8e35fc7eab/d4bf374e-3d58-5714-8290-da8e35fc7eab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_a43dc5f30445dcfde337f7408e9b3e73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4bf374e-3d58-5714-8290-da8e35fc7eab/d4bf374e-3d58-5714-8290-da8e35fc7eab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_27ad9cdd060318a6178d5c9c00913fe1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4bf374e-3d58-5714-8290-da8e35fc7eab/d4bf374e-3d58-5714-8290-da8e35fc7eab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_e0132a3e05649fffda7f31d4b232736e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4bf374e-3d58-5714-8290-da8e35fc7eab/d4bf374e-3d58-5714-8290-da8e35fc7eab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308671,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_133c9c764b3e51bc54185d62c3c4606e.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4bf374e-3d58-5714-8290-da8e35fc7eab/d4bf374e-3d58-5714-8290-da8e35fc7eab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_a53cab26dc4f962fde86791e46ed79f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4bf374e-3d58-5714-8290-da8e35fc7eab/d4bf374e-3d58-5714-8290-da8e35fc7eab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334477,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_e13e62fe62efd6883849565ea10dce88.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4bf374e-3d58-5714-8290-da8e35fc7eab/d4bf374e-3d58-5714-8290-da8e35fc7eab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_f38bc4aae1fc1c4611fff377f748e886.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4bf374e-3d58-5714-8290-da8e35fc7eab/d4bf374e-3d58-5714-8290-da8e35fc7eab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_f8cc58f05d0585bb088cc4cd0f65ce44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4bf374e-3d58-5714-8290-da8e35fc7eab/d4bf374e-3d58-5714-8290-da8e35fc7eab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/eb/afeb943790601d52b06dca3fe2d8ab7f/pa/KS78216_cb292725b625ed78d6eab925a0b7991c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-01-23',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Suzuki Jimny 1.3 Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2006}
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS78216%27 HTTP/1.1" 200 None
2026-03-27 10:41:27 [auto1.de] INFO: Saving data for KS78216: {'created_time': 1774608087.854586, 'last_price_update_time': 1774608087.854599, 'auction_closing_time': 1774714632.0}
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS78216') HTTP/1.1" 204 0
2026-03-27 10:41:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a1f190>
2026-03-27 10:41:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05b91194-de22-5a83-b2ca-b71431976efb/05b91194-de22-5a83-b2ca-b71431976efb_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F9d%252F2b9dee9d2053e89d1278a01061ecc934%252Fpa%252FFB90112_3480bb8503aa494b1720b1f47c313ead.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_3480bb8503aa494b1720b1f47c313ead.jpg saved to cache
2026-03-27 10:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05b91194-de22-5a83-b2ca-b71431976efb
2026-03-27 10:41:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05b91194-de22-5a83-b2ca-b71431976efb, skipping ID generation
2026-03-27 10:41:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05b91194-de22-5a83-b2ca-b71431976efb with scrape type 1
2026-03-27 10:41:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05b91194-de22-5a83-b2ca-b71431976efb sending to next pipeline
2026-03-27 10:41:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05b91194-de22-5a83-b2ca-b71431976efb, identifier: FB90112
2026-03-27 10:41:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50040d650>
2026-03-27 10:41:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcf64c8-b58b-505c-b16b-6c757f623975/2dcf64c8-b58b-505c-b16b-6c757f623975_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa1%252Ff1a16119c1719645d6b298b21c454d84%252Fpa%252FAC15853_c792072f5fc68251b603390cd683b69a.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_c792072f5fc68251b603390cd683b69a.jpg saved to cache
2026-03-27 10:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2dcf64c8-b58b-505c-b16b-6c757f623975
2026-03-27 10:41:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05b91194-de22-5a83-b2ca-b71431976efb with identifier: FB90112
2026-03-27 10:41:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05b91194-de22-5a83-b2ca-b71431976efb with identifier: FB90112
2026-03-27 10:41:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05b91194-de22-5a83-b2ca-b71431976efb with identifier: FB90112 to the API
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_3480bb8503aa494b1720b1f47c313ead.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:39:46Z',
 'fuel_type': 'diesel',
 'id': '05b91194-de22-5a83-b2ca-b71431976efb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB90112',
 'listing': 'auction',
 'location': 'DE, Tradein',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 234839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05b91194-de22-5a83-b2ca-b71431976efb/05b91194-de22-5a83-b2ca-b71431976efb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_31cc2177b21fb53a81d81f26aa3ed9e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05b91194-de22-5a83-b2ca-b71431976efb/05b91194-de22-5a83-b2ca-b71431976efb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_219f3d413b1427bd3e611a0b60585cc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05b91194-de22-5a83-b2ca-b71431976efb/05b91194-de22-5a83-b2ca-b71431976efb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_3480bb8503aa494b1720b1f47c313ead.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05b91194-de22-5a83-b2ca-b71431976efb/05b91194-de22-5a83-b2ca-b71431976efb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_cdfd49f8b782dabd61baf935dbace38e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05b91194-de22-5a83-b2ca-b71431976efb/05b91194-de22-5a83-b2ca-b71431976efb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3182343,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_a8f18c2987f3593104a2a4695fde0965.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05b91194-de22-5a83-b2ca-b71431976efb/05b91194-de22-5a83-b2ca-b71431976efb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_2b53f9f40ca582daf2e367b6ffc544ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05b91194-de22-5a83-b2ca-b71431976efb/05b91194-de22-5a83-b2ca-b71431976efb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_251396d64f587d4f6e6562b2a4934f80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05b91194-de22-5a83-b2ca-b71431976efb/05b91194-de22-5a83-b2ca-b71431976efb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_b7ee48d2c2c922bc4ab1cd5f2c4e2f98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05b91194-de22-5a83-b2ca-b71431976efb/05b91194-de22-5a83-b2ca-b71431976efb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3230024,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_43a8e400d467e1958f0d7fbfbceb646a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05b91194-de22-5a83-b2ca-b71431976efb/05b91194-de22-5a83-b2ca-b71431976efb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/9d/2b9dee9d2053e89d1278a01061ecc934/pa/FB90112_019657119c91b8cde7d4fe5687ce0436.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'S line Sportpaket plus',
 'year': 2011}
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB90112%27 HTTP/1.1" 200 None
2026-03-27 10:41:28 [auto1.de] INFO: Saving data for FB90112: {'created_time': 1774608088.526271, 'last_price_update_time': 1774608088.526282, 'auction_closing_time': 1774715986.0}
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB90112') HTTP/1.1" 204 0
2026-03-27 10:41:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501761e90>
2026-03-27 10:41:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79782f7c-8fc5-5326-b805-52f47039130d/79782f7c-8fc5-5326-b805-52f47039130d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fa2%252F9ea2027d9546ff2cfbd0c98a12e84fc7%252Fpa%252FVC80296_426305e2afbf16c8a55a12ad2295e5ea.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_426305e2afbf16c8a55a12ad2295e5ea.jpg saved to cache
2026-03-27 10:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79782f7c-8fc5-5326-b805-52f47039130d
2026-03-27 10:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_87945a85d6993e53284d8f652ce5741b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/f2/e0f26fd8984653217e8a9ff63e89131a/pa/HM57840_7db33f8d78064cc93fccca7d18c8862b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_44cfceea94a6201da63e5f7ee6124f7a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_392bb478063697c72caced94989e8c0a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_a6eb169d49b3c91c01fd9863f06b13f2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_1623b34406a2584bcd605985a8da651d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_d25d99774a0609fedbc657c23155071e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_ab88b54a7c5473063171cfb40bb8a9d1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_b0cf5367367872b483371d7321de90d6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500323d10>
2026-03-27 10:41:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33b090c3-7679-5d79-9827-15456f1a02ca/33b090c3-7679-5d79-9827-15456f1a02ca_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fa1%252F77a1799b94a5923e966972ed11b27deb%252Fpa%252FYT12990_87945a85d6993e53284d8f652ce5741b.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_87945a85d6993e53284d8f652ce5741b.jpg saved to cache
2026-03-27 10:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 33b090c3-7679-5d79-9827-15456f1a02ca
2026-03-27 10:41:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50040e450>
2026-03-27 10:41:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1840c47c-e51b-5fee-bfff-05055c749594/1840c47c-e51b-5fee-bfff-05055c749594_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ff2%252Fe0f26fd8984653217e8a9ff63e89131a%252Fpa%252FHM57840_7db33f8d78064cc93fccca7d18c8862b.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/f2/e0f26fd8984653217e8a9ff63e89131a/pa/HM57840_7db33f8d78064cc93fccca7d18c8862b.jpg saved to cache
2026-03-27 10:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1840c47c-e51b-5fee-bfff-05055c749594
2026-03-27 10:41:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1840c47c-e51b-5fee-bfff-05055c749594, skipping ID generation
2026-03-27 10:41:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1840c47c-e51b-5fee-bfff-05055c749594 with scrape type 1
2026-03-27 10:41:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1840c47c-e51b-5fee-bfff-05055c749594 sending to next pipeline
2026-03-27 10:41:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1840c47c-e51b-5fee-bfff-05055c749594, identifier: HM57840
2026-03-27 10:41:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017437d0>
2026-03-27 10:41:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79782f7c-8fc5-5326-b805-52f47039130d/79782f7c-8fc5-5326-b805-52f47039130d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fa2%252F9ea2027d9546ff2cfbd0c98a12e84fc7%252Fpa%252FVC80296_44cfceea94a6201da63e5f7ee6124f7a.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_44cfceea94a6201da63e5f7ee6124f7a.jpg saved to cache
2026-03-27 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79782f7c-8fc5-5326-b805-52f47039130d
2026-03-27 10:41:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50045a790>
2026-03-27 10:41:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79782f7c-8fc5-5326-b805-52f47039130d/79782f7c-8fc5-5326-b805-52f47039130d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fa2%252F9ea2027d9546ff2cfbd0c98a12e84fc7%252Fpa%252FVC80296_392bb478063697c72caced94989e8c0a.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_392bb478063697c72caced94989e8c0a.jpg saved to cache
2026-03-27 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79782f7c-8fc5-5326-b805-52f47039130d
2026-03-27 10:41:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501760ed0>
2026-03-27 10:41:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcf64c8-b58b-505c-b16b-6c757f623975/2dcf64c8-b58b-505c-b16b-6c757f623975_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa1%252Ff1a16119c1719645d6b298b21c454d84%252Fpa%252FAC15853_a6eb169d49b3c91c01fd9863f06b13f2.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_a6eb169d49b3c91c01fd9863f06b13f2.jpg saved to cache
2026-03-27 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2dcf64c8-b58b-505c-b16b-6c757f623975
2026-03-27 10:41:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50044a690>
2026-03-27 10:41:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dcf64c8-b58b-505c-b16b-6c757f623975/2dcf64c8-b58b-505c-b16b-6c757f623975_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fa1%252Ff1a16119c1719645d6b298b21c454d84%252Fpa%252FAC15853_1623b34406a2584bcd605985a8da651d.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_1623b34406a2584bcd605985a8da651d.jpg saved to cache
2026-03-27 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2dcf64c8-b58b-505c-b16b-6c757f623975
2026-03-27 10:41:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2dcf64c8-b58b-505c-b16b-6c757f623975, skipping ID generation
2026-03-27 10:41:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dcf64c8-b58b-505c-b16b-6c757f623975 with scrape type 1
2026-03-27 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2dcf64c8-b58b-505c-b16b-6c757f623975 sending to next pipeline
2026-03-27 10:41:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2dcf64c8-b58b-505c-b16b-6c757f623975, identifier: AC15853
2026-03-27 10:41:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015d1150>
2026-03-27 10:41:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79782f7c-8fc5-5326-b805-52f47039130d/79782f7c-8fc5-5326-b805-52f47039130d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fa2%252F9ea2027d9546ff2cfbd0c98a12e84fc7%252Fpa%252FVC80296_d25d99774a0609fedbc657c23155071e.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_d25d99774a0609fedbc657c23155071e.jpg saved to cache
2026-03-27 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79782f7c-8fc5-5326-b805-52f47039130d
2026-03-27 10:41:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50045ac50>
2026-03-27 10:41:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79782f7c-8fc5-5326-b805-52f47039130d/79782f7c-8fc5-5326-b805-52f47039130d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fa2%252F9ea2027d9546ff2cfbd0c98a12e84fc7%252Fpa%252FVC80296_ab88b54a7c5473063171cfb40bb8a9d1.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_ab88b54a7c5473063171cfb40bb8a9d1.jpg saved to cache
2026-03-27 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79782f7c-8fc5-5326-b805-52f47039130d
2026-03-27 10:41:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79782f7c-8fc5-5326-b805-52f47039130d, skipping ID generation
2026-03-27 10:41:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79782f7c-8fc5-5326-b805-52f47039130d with scrape type 1
2026-03-27 10:41:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79782f7c-8fc5-5326-b805-52f47039130d sending to next pipeline
2026-03-27 10:41:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79782f7c-8fc5-5326-b805-52f47039130d, identifier: VC80296
2026-03-27 10:41:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1840c47c-e51b-5fee-bfff-05055c749594 with identifier: HM57840
2026-03-27 10:41:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1840c47c-e51b-5fee-bfff-05055c749594 with identifier: HM57840
2026-03-27 10:41:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1840c47c-e51b-5fee-bfff-05055c749594 with identifier: HM57840 to the API
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge0/f2/e0f26fd8984653217e8a9ff63e89131a/pa/HM57840_7db33f8d78064cc93fccca7d18c8862b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:52:18Z',
 'fuel_type': 'petrol',
 'id': '1840c47c-e51b-5fee-bfff-05055c749594',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM57840',
 'listing': 'auction',
 'location': 'DE, Reinbek',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 103504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1840c47c-e51b-5fee-bfff-05055c749594/1840c47c-e51b-5fee-bfff-05055c749594_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/f2/e0f26fd8984653217e8a9ff63e89131a/pa/HM57840_7db33f8d78064cc93fccca7d18c8862b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1840c47c-e51b-5fee-bfff-05055c749594/1840c47c-e51b-5fee-bfff-05055c749594_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/f2/e0f26fd8984653217e8a9ff63e89131a/pa/HM57840_aea5ecedbf7e1d351e2069423ed71496.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1840c47c-e51b-5fee-bfff-05055c749594/1840c47c-e51b-5fee-bfff-05055c749594_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/f2/e0f26fd8984653217e8a9ff63e89131a/pa/HM57840_5a892523a8e5f9e6d7a2b75acb73f13a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1840c47c-e51b-5fee-bfff-05055c749594/1840c47c-e51b-5fee-bfff-05055c749594_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/f2/e0f26fd8984653217e8a9ff63e89131a/pa/HM57840_f7fc9cc9b845a994126fb7ced13a6a4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1840c47c-e51b-5fee-bfff-05055c749594/1840c47c-e51b-5fee-bfff-05055c749594_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/f2/e0f26fd8984653217e8a9ff63e89131a/pa/HM57840_0d59c3af5af088fad11c6bee1cc0db04.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.1 ClearTec Inform',
 'transmission': 'manual',
 'trim': 'ClearTec Inform',
 'year': 2009}
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM57840%27 HTTP/1.1" 200 None
2026-03-27 10:41:30 [auto1.de] INFO: Saving data for HM57840: {'created_time': 1774608090.429291, 'last_price_update_time': 1774608090.429302, 'auction_closing_time': 1774716738.0}
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM57840') HTTP/1.1" 204 0
2026-03-27 10:41:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2dcf64c8-b58b-505c-b16b-6c757f623975 with identifier: AC15853
2026-03-27 10:41:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2dcf64c8-b58b-505c-b16b-6c757f623975 with identifier: AC15853
2026-03-27 10:41:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2dcf64c8-b58b-505c-b16b-6c757f623975 with identifier: AC15853 to the API
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_1623b34406a2584bcd605985a8da651d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:48:35Z',
 'fuel_type': 'diesel',
 'id': '2dcf64c8-b58b-505c-b16b-6c757f623975',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC15853',
 'listing': 'auction',
 'location': 'DE, Jena',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 183771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dcf64c8-b58b-505c-b16b-6c757f623975/2dcf64c8-b58b-505c-b16b-6c757f623975_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_fbdb4e92c8ba0d075da8f79f30164f59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dcf64c8-b58b-505c-b16b-6c757f623975/2dcf64c8-b58b-505c-b16b-6c757f623975_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_285f9da811a85d3eec01a7fbc92ed3d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dcf64c8-b58b-505c-b16b-6c757f623975/2dcf64c8-b58b-505c-b16b-6c757f623975_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_216c839915bce3f4e8d5c7e89e5af16a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dcf64c8-b58b-505c-b16b-6c757f623975/2dcf64c8-b58b-505c-b16b-6c757f623975_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_fcdb0f8b1d89a3e8af20f1c702265f71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dcf64c8-b58b-505c-b16b-6c757f623975/2dcf64c8-b58b-505c-b16b-6c757f623975_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2560268,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_a6eb169d49b3c91c01fd9863f06b13f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dcf64c8-b58b-505c-b16b-6c757f623975/2dcf64c8-b58b-505c-b16b-6c757f623975_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2555126,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_1623b34406a2584bcd605985a8da651d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dcf64c8-b58b-505c-b16b-6c757f623975/2dcf64c8-b58b-505c-b16b-6c757f623975_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_9a9ad9d298d2489d496cd3f6c5675a6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dcf64c8-b58b-505c-b16b-6c757f623975/2dcf64c8-b58b-505c-b16b-6c757f623975_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2414401,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_9c17888e53da8a83a4c88e6b48ea21c4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dcf64c8-b58b-505c-b16b-6c757f623975/2dcf64c8-b58b-505c-b16b-6c757f623975_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_c792072f5fc68251b603390cd683b69a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dcf64c8-b58b-505c-b16b-6c757f623975/2dcf64c8-b58b-505c-b16b-6c757f623975_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/a1/f1a16119c1719645d6b298b21c454d84/pa/AC15853_60af4e20455e82fad672fa5cfd156eef.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d 4Matic Style',
 'transmission': 'automatic',
 'trim': '4Matic Style',
 'year': 2021}
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC15853%27 HTTP/1.1" 200 None
2026-03-27 10:41:30 [auto1.de] INFO: Saving data for AC15853: {'created_time': 1774608090.883994, 'last_price_update_time': 1774608090.884007, 'auction_closing_time': 1774716515.0}
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC15853') HTTP/1.1" 204 0
2026-03-27 10:41:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79782f7c-8fc5-5326-b805-52f47039130d with identifier: VC80296
2026-03-27 10:41:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79782f7c-8fc5-5326-b805-52f47039130d with identifier: VC80296
2026-03-27 10:41:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79782f7c-8fc5-5326-b805-52f47039130d with identifier: VC80296 to the API
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_ab88b54a7c5473063171cfb40bb8a9d1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:06:55Z',
 'fuel_type': 'diesel',
 'id': '79782f7c-8fc5-5326-b805-52f47039130d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC80296',
 'listing': 'auction',
 'location': 'DE, Eschwege',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 179501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79782f7c-8fc5-5326-b805-52f47039130d/79782f7c-8fc5-5326-b805-52f47039130d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3341460,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_5ebb0b55450ad08feb87facba6962896.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79782f7c-8fc5-5326-b805-52f47039130d/79782f7c-8fc5-5326-b805-52f47039130d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_44cfceea94a6201da63e5f7ee6124f7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79782f7c-8fc5-5326-b805-52f47039130d/79782f7c-8fc5-5326-b805-52f47039130d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_426305e2afbf16c8a55a12ad2295e5ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79782f7c-8fc5-5326-b805-52f47039130d/79782f7c-8fc5-5326-b805-52f47039130d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_0839ccb5bbe4f8f335d00d2d735084a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79782f7c-8fc5-5326-b805-52f47039130d/79782f7c-8fc5-5326-b805-52f47039130d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4121960,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_ab88b54a7c5473063171cfb40bb8a9d1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79782f7c-8fc5-5326-b805-52f47039130d/79782f7c-8fc5-5326-b805-52f47039130d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_8654186fe0074d29791e9ec0dcaa7641.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79782f7c-8fc5-5326-b805-52f47039130d/79782f7c-8fc5-5326-b805-52f47039130d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2926857,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_6de99f1b19b2c3a04d70ae7dca19b29c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79782f7c-8fc5-5326-b805-52f47039130d/79782f7c-8fc5-5326-b805-52f47039130d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3505644,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_d25d99774a0609fedbc657c23155071e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79782f7c-8fc5-5326-b805-52f47039130d/79782f7c-8fc5-5326-b805-52f47039130d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3653163,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_392bb478063697c72caced94989e8c0a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79782f7c-8fc5-5326-b805-52f47039130d/79782f7c-8fc5-5326-b805-52f47039130d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/a2/9ea2027d9546ff2cfbd0c98a12e84fc7/pa/VC80296_56288b7129d3e7a964b46a10e9fc7ac1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2009}
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC80296%27 HTTP/1.1" 200 None
2026-03-27 10:41:31 [auto1.de] INFO: Saving data for VC80296: {'created_time': 1774608091.518063, 'last_price_update_time': 1774608091.518075, 'auction_closing_time': 1774714015.0}
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC80296') HTTP/1.1" 204 0
2026-03-27 10:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_5859a07e609596eceeb7b6744d463f4a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_528399ba51e7eecb79f56831151c586c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE66332/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016ae950>
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb07bd82-b0bd-5075-8364-624ab9506f2f/fb07bd82-b0bd-5075-8364-624ab9506f2f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F93%252F03936b8b295f29cc3e4f5d4dfbbebd02%252Fpa%252FLU27790_b0cf5367367872b483371d7321de90d6.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_b0cf5367367872b483371d7321de90d6.jpg saved to cache
2026-03-27 10:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb07bd82-b0bd-5075-8364-624ab9506f2f
2026-03-27 10:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_ec2e911734ce8cc1d4acbb4c019bcac6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_a4f9a527c131b2f56d2ab2741e820022.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_0266816d277d1a2dbcda541117f35c17.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_bd2d2e01832dd075b9690614dcc66c96.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_298062d9221afdc082c402dc255d9061.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a11210>
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1225177-117f-5078-8146-1d685e4c4fa4/d1225177-117f-5078-8146-1d685e4c4fa4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Feb%252F64ebe6d6fb9c57b8fdcf738aa5190061%252Fpa%252FSJ87943_5859a07e609596eceeb7b6744d463f4a.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_5859a07e609596eceeb7b6744d463f4a.jpg saved to cache
2026-03-27 10:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1225177-117f-5078-8146-1d685e4c4fa4
2026-03-27 10:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_2a3134b3cd88d93cca047e2e0cfb57bb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_29b9abd9f50d02cde910939d46304051.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003fa990>
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2239d488-0849-58ee-a1e7-739c9b060fb4/2239d488-0849-58ee-a1e7-739c9b060fb4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F45%252F8e45a499f1f9b1cd8854984e907659ef%252Fpa%252FPP43066_528399ba51e7eecb79f56831151c586c.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_528399ba51e7eecb79f56831151c586c.jpg saved to cache
2026-03-27 10:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2239d488-0849-58ee-a1e7-739c9b060fb4
2026-03-27 10:41:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50163b0d0>
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33b090c3-7679-5d79-9827-15456f1a02ca/33b090c3-7679-5d79-9827-15456f1a02ca_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fa1%252F77a1799b94a5923e966972ed11b27deb%252Fpa%252FYT12990_ec2e911734ce8cc1d4acbb4c019bcac6.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_ec2e911734ce8cc1d4acbb4c019bcac6.jpg saved to cache
2026-03-27 10:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 33b090c3-7679-5d79-9827-15456f1a02ca
2026-03-27 10:41:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500316b50>
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2239d488-0849-58ee-a1e7-739c9b060fb4/2239d488-0849-58ee-a1e7-739c9b060fb4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F45%252F8e45a499f1f9b1cd8854984e907659ef%252Fpa%252FPP43066_a4f9a527c131b2f56d2ab2741e820022.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_a4f9a527c131b2f56d2ab2741e820022.jpg saved to cache
2026-03-27 10:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2239d488-0849-58ee-a1e7-739c9b060fb4
2026-03-27 10:41:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501653650>
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1225177-117f-5078-8146-1d685e4c4fa4/d1225177-117f-5078-8146-1d685e4c4fa4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Feb%252F64ebe6d6fb9c57b8fdcf738aa5190061%252Fpa%252FSJ87943_0266816d277d1a2dbcda541117f35c17.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_0266816d277d1a2dbcda541117f35c17.jpg saved to cache
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1225177-117f-5078-8146-1d685e4c4fa4
2026-03-27 10:41:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001b9dd0>
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33b090c3-7679-5d79-9827-15456f1a02ca/33b090c3-7679-5d79-9827-15456f1a02ca_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fa1%252F77a1799b94a5923e966972ed11b27deb%252Fpa%252FYT12990_bd2d2e01832dd075b9690614dcc66c96.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_bd2d2e01832dd075b9690614dcc66c96.jpg saved to cache
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 33b090c3-7679-5d79-9827-15456f1a02ca
2026-03-27 10:41:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50195a990>
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb07bd82-b0bd-5075-8364-624ab9506f2f/fb07bd82-b0bd-5075-8364-624ab9506f2f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F93%252F03936b8b295f29cc3e4f5d4dfbbebd02%252Fpa%252FLU27790_298062d9221afdc082c402dc255d9061.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_298062d9221afdc082c402dc255d9061.jpg saved to cache
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb07bd82-b0bd-5075-8364-624ab9506f2f
2026-03-27 10:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_ae29fd398c26824db1244db4a4b2bf35.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500349650>
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33b090c3-7679-5d79-9827-15456f1a02ca/33b090c3-7679-5d79-9827-15456f1a02ca_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fa1%252F77a1799b94a5923e966972ed11b27deb%252Fpa%252FYT12990_2a3134b3cd88d93cca047e2e0cfb57bb.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_2a3134b3cd88d93cca047e2e0cfb57bb.jpg saved to cache
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 33b090c3-7679-5d79-9827-15456f1a02ca
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500349850>
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb07bd82-b0bd-5075-8364-624ab9506f2f/fb07bd82-b0bd-5075-8364-624ab9506f2f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F93%252F03936b8b295f29cc3e4f5d4dfbbebd02%252Fpa%252FLU27790_29b9abd9f50d02cde910939d46304051.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_29b9abd9f50d02cde910939d46304051.jpg saved to cache
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb07bd82-b0bd-5075-8364-624ab9506f2f
2026-03-27 10:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_d7a05f2b631fed8a10876001d6972092.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_dee53865df98b1a499d878cc21124f95.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN62521/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002ff610>
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1225177-117f-5078-8146-1d685e4c4fa4/d1225177-117f-5078-8146-1d685e4c4fa4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Feb%252F64ebe6d6fb9c57b8fdcf738aa5190061%252Fpa%252FSJ87943_ae29fd398c26824db1244db4a4b2bf35.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_ae29fd398c26824db1244db4a4b2bf35.jpg saved to cache
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1225177-117f-5078-8146-1d685e4c4fa4
2026-03-27 10:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_b045e3c87fa3076a6085bfc74706113e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_0668cf5289e1c1965666d2ece4df1c07.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_5c51213b9be386aa04589a172499cd80.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500555590>
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33b090c3-7679-5d79-9827-15456f1a02ca/33b090c3-7679-5d79-9827-15456f1a02ca_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fa1%252F77a1799b94a5923e966972ed11b27deb%252Fpa%252FYT12990_d7a05f2b631fed8a10876001d6972092.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_d7a05f2b631fed8a10876001d6972092.jpg saved to cache
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33b090c3-7679-5d79-9827-15456f1a02ca
2026-03-27 10:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_4e211a694001af73c913e9105fcea276.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_d5bee75bbff7847838ef1c8dcf0f2b62.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_2895121e2769213cc6e6ac874e7ea75c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_f2b02ec6248bd95fafffbb2bb194f797.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_fc8565b96d58b2f884868faaa2817d17.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50373d9d0>
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33b090c3-7679-5d79-9827-15456f1a02ca/33b090c3-7679-5d79-9827-15456f1a02ca_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fa1%252F77a1799b94a5923e966972ed11b27deb%252Fpa%252FYT12990_dee53865df98b1a499d878cc21124f95.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_dee53865df98b1a499d878cc21124f95.jpg saved to cache
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 33b090c3-7679-5d79-9827-15456f1a02ca
2026-03-27 10:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_1e98396b6f306e0e70d7a6be733304f3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:32 [auto1.de] INFO: Channel: 24h | Page: 19 | totalHits: 10522 | hits on page: 40
2026-03-27 10:41:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501847f90>
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb07bd82-b0bd-5075-8364-624ab9506f2f/fb07bd82-b0bd-5075-8364-624ab9506f2f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F93%252F03936b8b295f29cc3e4f5d4dfbbebd02%252Fpa%252FLU27790_b045e3c87fa3076a6085bfc74706113e.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_b045e3c87fa3076a6085bfc74706113e.jpg saved to cache
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb07bd82-b0bd-5075-8364-624ab9506f2f
2026-03-27 10:41:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb07bd82-b0bd-5075-8364-624ab9506f2f, skipping ID generation
2026-03-27 10:41:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb07bd82-b0bd-5075-8364-624ab9506f2f with scrape type 1
2026-03-27 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb07bd82-b0bd-5075-8364-624ab9506f2f sending to next pipeline
2026-03-27 10:41:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb07bd82-b0bd-5075-8364-624ab9506f2f, identifier: LU27790
2026-03-27 10:41:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501873650>
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33b090c3-7679-5d79-9827-15456f1a02ca/33b090c3-7679-5d79-9827-15456f1a02ca_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fa1%252F77a1799b94a5923e966972ed11b27deb%252Fpa%252FYT12990_0668cf5289e1c1965666d2ece4df1c07.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_0668cf5289e1c1965666d2ece4df1c07.jpg saved to cache
2026-03-27 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 33b090c3-7679-5d79-9827-15456f1a02ca
2026-03-27 10:41:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002ff050>
2026-03-27 10:41:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33b090c3-7679-5d79-9827-15456f1a02ca/33b090c3-7679-5d79-9827-15456f1a02ca_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fa1%252F77a1799b94a5923e966972ed11b27deb%252Fpa%252FYT12990_5c51213b9be386aa04589a172499cd80.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_5c51213b9be386aa04589a172499cd80.jpg saved to cache
2026-03-27 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 33b090c3-7679-5d79-9827-15456f1a02ca
2026-03-27 10:41:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33b090c3-7679-5d79-9827-15456f1a02ca, skipping ID generation
2026-03-27 10:41:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33b090c3-7679-5d79-9827-15456f1a02ca with scrape type 1
2026-03-27 10:41:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33b090c3-7679-5d79-9827-15456f1a02ca sending to next pipeline
2026-03-27 10:41:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33b090c3-7679-5d79-9827-15456f1a02ca, identifier: YT12990
2026-03-27 10:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_f6ba6c394d6a9d7817b4678211e4394f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb07bd82-b0bd-5075-8364-624ab9506f2f with identifier: LU27790
2026-03-27 10:41:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb07bd82-b0bd-5075-8364-624ab9506f2f with identifier: LU27790
2026-03-27 10:41:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb07bd82-b0bd-5075-8364-624ab9506f2f with identifier: LU27790 to the API
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_b045e3c87fa3076a6085bfc74706113e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:12:55Z',
 'fuel_type': 'diesel',
 'id': 'fb07bd82-b0bd-5075-8364-624ab9506f2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU27790',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 56213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb07bd82-b0bd-5075-8364-624ab9506f2f/fb07bd82-b0bd-5075-8364-624ab9506f2f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2736381,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_b045e3c87fa3076a6085bfc74706113e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb07bd82-b0bd-5075-8364-624ab9506f2f/fb07bd82-b0bd-5075-8364-624ab9506f2f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_29b9abd9f50d02cde910939d46304051.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb07bd82-b0bd-5075-8364-624ab9506f2f/fb07bd82-b0bd-5075-8364-624ab9506f2f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2909971,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_298062d9221afdc082c402dc255d9061.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb07bd82-b0bd-5075-8364-624ab9506f2f/fb07bd82-b0bd-5075-8364-624ab9506f2f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_b0cf5367367872b483371d7321de90d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb07bd82-b0bd-5075-8364-624ab9506f2f/fb07bd82-b0bd-5075-8364-624ab9506f2f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2835106,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_3700d1f79499df65e20c28d0cfb97789.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb07bd82-b0bd-5075-8364-624ab9506f2f/fb07bd82-b0bd-5075-8364-624ab9506f2f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_b0ed413aa50e1367d327674ec2b2a48e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb07bd82-b0bd-5075-8364-624ab9506f2f/fb07bd82-b0bd-5075-8364-624ab9506f2f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_f8b8d3ac58e27b41030c0f15ffa3dac3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb07bd82-b0bd-5075-8364-624ab9506f2f/fb07bd82-b0bd-5075-8364-624ab9506f2f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_124180c90f79767a3b5d10b8a96b5e7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb07bd82-b0bd-5075-8364-624ab9506f2f/fb07bd82-b0bd-5075-8364-624ab9506f2f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_e6b71954af3a0003494d6bf8ec8b21ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb07bd82-b0bd-5075-8364-624ab9506f2f/fb07bd82-b0bd-5075-8364-624ab9506f2f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/93/03936b8b295f29cc3e4f5d4dfbbebd02/pa/LU27790_974c36888095eb34932b3f4e11bea3f3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-17',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI One D BAKER STREET',
 'transmission': 'manual',
 'trim': 'BAKER STREET',
 'year': 2013}
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU27790%27 HTTP/1.1" 200 None
2026-03-27 10:41:33 [auto1.de] INFO: Saving data for LU27790: {'created_time': 1774608093.989997, 'last_price_update_time': 1774608093.990011, 'auction_closing_time': 1774714375.0}
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU27790') HTTP/1.1" 204 0
2026-03-27 10:41:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33b090c3-7679-5d79-9827-15456f1a02ca with identifier: YT12990
2026-03-27 10:41:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33b090c3-7679-5d79-9827-15456f1a02ca with identifier: YT12990
2026-03-27 10:41:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33b090c3-7679-5d79-9827-15456f1a02ca with identifier: YT12990 to the API
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_5c51213b9be386aa04589a172499cd80.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:36:18Z',
 'fuel_type': 'petrol',
 'id': '33b090c3-7679-5d79-9827-15456f1a02ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT12990',
 'listing': 'auction',
 'location': 'DE, Chemnitz',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 67771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33b090c3-7679-5d79-9827-15456f1a02ca/33b090c3-7679-5d79-9827-15456f1a02ca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_d7a05f2b631fed8a10876001d6972092.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33b090c3-7679-5d79-9827-15456f1a02ca/33b090c3-7679-5d79-9827-15456f1a02ca_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_dee53865df98b1a499d878cc21124f95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33b090c3-7679-5d79-9827-15456f1a02ca/33b090c3-7679-5d79-9827-15456f1a02ca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2846056,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_5c51213b9be386aa04589a172499cd80.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33b090c3-7679-5d79-9827-15456f1a02ca/33b090c3-7679-5d79-9827-15456f1a02ca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2734432,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_0668cf5289e1c1965666d2ece4df1c07.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33b090c3-7679-5d79-9827-15456f1a02ca/33b090c3-7679-5d79-9827-15456f1a02ca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_2a3134b3cd88d93cca047e2e0cfb57bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33b090c3-7679-5d79-9827-15456f1a02ca/33b090c3-7679-5d79-9827-15456f1a02ca_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2380807,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_bd2d2e01832dd075b9690614dcc66c96.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33b090c3-7679-5d79-9827-15456f1a02ca/33b090c3-7679-5d79-9827-15456f1a02ca_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2330612,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_ec2e911734ce8cc1d4acbb4c019bcac6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33b090c3-7679-5d79-9827-15456f1a02ca/33b090c3-7679-5d79-9827-15456f1a02ca_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_87945a85d6993e53284d8f652ce5741b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33b090c3-7679-5d79-9827-15456f1a02ca/33b090c3-7679-5d79-9827-15456f1a02ca_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2882903,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_d2f6362f989f6f1a9c2ffc0de7f694e5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33b090c3-7679-5d79-9827-15456f1a02ca/33b090c3-7679-5d79-9827-15456f1a02ca_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/a1/77a1799b94a5923e966972ed11b27deb/pa/YT12990_e7412c8f8a5ee5930f390eea8279856e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-08-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Suzuki Swift 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2016}
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT12990%27 HTTP/1.1" 200 None
2026-03-27 10:41:34 [auto1.de] INFO: Saving data for YT12990: {'created_time': 1774608094.754815, 'last_price_update_time': 1774608094.754829, 'auction_closing_time': 1774715778.0}
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT12990') HTTP/1.1" 204 0
2026-03-27 10:41:34 [auto1.de] INFO: Found listing with ID: DB46013
2026-03-27 10:41:34 [auto1.de] INFO: Found listing with ID: TJ83975
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ83975%27 HTTP/1.1" 200 None
2026-03-27 10:41:34 [auto1.de] INFO: Scrape type for TJ83975: 0
2026-03-27 10:41:34 [auto1.de] INFO: Found listing with ID: ZN02812
2026-03-27 10:41:34 [auto1.de] INFO: Found listing with ID: CW50467
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW50467%27 HTTP/1.1" 200 None
2026-03-27 10:41:34 [auto1.de] INFO: Scrape type for CW50467: 0
2026-03-27 10:41:34 [auto1.de] INFO: Found listing with ID: AB49272
2026-03-27 10:41:34 [auto1.de] INFO: Found listing with ID: BW18754
2026-03-27 10:41:34 [auto1.de] INFO: Found listing with ID: MF02392
2026-03-27 10:41:34 [auto1.de] INFO: Found listing with ID: BN30919
2026-03-27 10:41:34 [auto1.de] INFO: Found listing with ID: KH74255
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH74255%27 HTTP/1.1" 200 None
2026-03-27 10:41:34 [auto1.de] INFO: Scrape type for KH74255: 2
2026-03-27 10:41:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11029a6c-6e5f-562f-aff9-b34fe1b6565c with identifier: KH74255
2026-03-27 10:41:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11029a6c-6e5f-562f-aff9-b34fe1b6565c with scrape type 2
2026-03-27 10:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11029a6c-6e5f-562f-aff9-b34fe1b6565c with scrape type 2
2026-03-27 10:41:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11029a6c-6e5f-562f-aff9-b34fe1b6565c, identifier: KH74255
2026-03-27 10:41:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11029a6c-6e5f-562f-aff9-b34fe1b6565c with identifier: KH74255
2026-03-27 10:41:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11029a6c-6e5f-562f-aff9-b34fe1b6565c with identifier: KH74255
2026-03-27 10:41:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11029a6c-6e5f-562f-aff9-b34fe1b6565c with identifier: KH74255 to the API
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:52:40Z',
 'fuel_type': 'petrol',
 'id': '11029a6c-6e5f-562f-aff9-b34fe1b6565c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH74255',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 15350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-23',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2024}
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH74255%27 HTTP/1.1" 200 None
2026-03-27 10:41:35 [auto1.de] INFO: Saving data for KH74255: {'auction_closing_time': 1774716760.0, 'created_time': 1773305913.564122, 'last_price_update_time': 1774608095.643375}
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH74255') HTTP/1.1" 204 0
2026-03-27 10:41:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE66332> (referer: https://www.auto1.com/v1/car-details-view/NE66332/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DT14163> (referer: https://www.auto1.com/v1/car-details-view/DT14163/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SP19687> (referer: https://www.auto1.com/v1/car-details-view/SP19687/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019524d0>
2026-03-27 10:41:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc4cd8e-8bcf-5a22-bd34-30f574283794/0cc4cd8e-8bcf-5a22-bd34-30f574283794_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd1%252F03d1a09115e43a4640830b4d1f7c4eae%252Fpa%252FYR74432_4e211a694001af73c913e9105fcea276.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_4e211a694001af73c913e9105fcea276.jpg saved to cache
2026-03-27 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0cc4cd8e-8bcf-5a22-bd34-30f574283794
2026-03-27 10:41:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015fd7d0>
2026-03-27 10:41:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2239d488-0849-58ee-a1e7-739c9b060fb4/2239d488-0849-58ee-a1e7-739c9b060fb4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F45%252F8e45a499f1f9b1cd8854984e907659ef%252Fpa%252FPP43066_d5bee75bbff7847838ef1c8dcf0f2b62.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_d5bee75bbff7847838ef1c8dcf0f2b62.jpg saved to cache
2026-03-27 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2239d488-0849-58ee-a1e7-739c9b060fb4
2026-03-27 10:41:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2239d488-0849-58ee-a1e7-739c9b060fb4, skipping ID generation
2026-03-27 10:41:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2239d488-0849-58ee-a1e7-739c9b060fb4 with scrape type 1
2026-03-27 10:41:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2239d488-0849-58ee-a1e7-739c9b060fb4 sending to next pipeline
2026-03-27 10:41:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2239d488-0849-58ee-a1e7-739c9b060fb4, identifier: PP43066
2026-03-27 10:41:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500453250>
2026-03-27 10:41:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1225177-117f-5078-8146-1d685e4c4fa4/d1225177-117f-5078-8146-1d685e4c4fa4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Feb%252F64ebe6d6fb9c57b8fdcf738aa5190061%252Fpa%252FSJ87943_2895121e2769213cc6e6ac874e7ea75c.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_2895121e2769213cc6e6ac874e7ea75c.jpg saved to cache
2026-03-27 10:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1225177-117f-5078-8146-1d685e4c4fa4
2026-03-27 10:41:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1225177-117f-5078-8146-1d685e4c4fa4, skipping ID generation
2026-03-27 10:41:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1225177-117f-5078-8146-1d685e4c4fa4 with scrape type 1
2026-03-27 10:41:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1225177-117f-5078-8146-1d685e4c4fa4 sending to next pipeline
2026-03-27 10:41:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1225177-117f-5078-8146-1d685e4c4fa4, identifier: SJ87943
2026-03-27 10:41:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501952110>
2026-03-27 10:41:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc4cd8e-8bcf-5a22-bd34-30f574283794/0cc4cd8e-8bcf-5a22-bd34-30f574283794_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd1%252F03d1a09115e43a4640830b4d1f7c4eae%252Fpa%252FYR74432_f2b02ec6248bd95fafffbb2bb194f797.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_f2b02ec6248bd95fafffbb2bb194f797.jpg saved to cache
2026-03-27 10:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0cc4cd8e-8bcf-5a22-bd34-30f574283794
2026-03-27 10:41:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015fe710>
2026-03-27 10:41:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc4cd8e-8bcf-5a22-bd34-30f574283794/0cc4cd8e-8bcf-5a22-bd34-30f574283794_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd1%252F03d1a09115e43a4640830b4d1f7c4eae%252Fpa%252FYR74432_fc8565b96d58b2f884868faaa2817d17.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_fc8565b96d58b2f884868faaa2817d17.jpg saved to cache
2026-03-27 10:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0cc4cd8e-8bcf-5a22-bd34-30f574283794
2026-03-27 10:41:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50035ebd0>
2026-03-27 10:41:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc4cd8e-8bcf-5a22-bd34-30f574283794/0cc4cd8e-8bcf-5a22-bd34-30f574283794_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd1%252F03d1a09115e43a4640830b4d1f7c4eae%252Fpa%252FYR74432_1e98396b6f306e0e70d7a6be733304f3.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_1e98396b6f306e0e70d7a6be733304f3.jpg saved to cache
2026-03-27 10:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0cc4cd8e-8bcf-5a22-bd34-30f574283794
2026-03-27 10:41:36 [auto1.de] INFO: Found listing with ID: UN34708
2026-03-27 10:41:36 [auto1.de] INFO: Found listing with ID: SG28437
2026-03-27 10:41:36 [auto1.de] INFO: Found listing with ID: KA22944
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA22944%27 HTTP/1.1" 200 None
2026-03-27 10:41:36 [auto1.de] INFO: Scrape type for KA22944: 2
2026-03-27 10:41:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffe7bf2c-8332-5993-a017-b632a06576a0 with identifier: KA22944
2026-03-27 10:41:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffe7bf2c-8332-5993-a017-b632a06576a0 with scrape type 2
2026-03-27 10:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffe7bf2c-8332-5993-a017-b632a06576a0 with scrape type 2
2026-03-27 10:41:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffe7bf2c-8332-5993-a017-b632a06576a0, identifier: KA22944
2026-03-27 10:41:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2239d488-0849-58ee-a1e7-739c9b060fb4 with identifier: PP43066
2026-03-27 10:41:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2239d488-0849-58ee-a1e7-739c9b060fb4 with identifier: PP43066
2026-03-27 10:41:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2239d488-0849-58ee-a1e7-739c9b060fb4 with identifier: PP43066 to the API
2026-03-27 10:41:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_d5bee75bbff7847838ef1c8dcf0f2b62.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': 'Taxi',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:05:07Z',
 'fuel_type': 'diesel',
 'id': '2239d488-0849-58ee-a1e7-739c9b060fb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP43066',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 262535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2239d488-0849-58ee-a1e7-739c9b060fb4/2239d488-0849-58ee-a1e7-739c9b060fb4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2800385,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_d5bee75bbff7847838ef1c8dcf0f2b62.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2239d488-0849-58ee-a1e7-739c9b060fb4/2239d488-0849-58ee-a1e7-739c9b060fb4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2580203,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_abbc2ac553c5e9cd35a4695855d72698.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2239d488-0849-58ee-a1e7-739c9b060fb4/2239d488-0849-58ee-a1e7-739c9b060fb4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2457752,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_a4f9a527c131b2f56d2ab2741e820022.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2239d488-0849-58ee-a1e7-739c9b060fb4/2239d488-0849-58ee-a1e7-739c9b060fb4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_528399ba51e7eecb79f56831151c586c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2239d488-0849-58ee-a1e7-739c9b060fb4/2239d488-0849-58ee-a1e7-739c9b060fb4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_33596dae1152b516d4a089583f6f1135.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2239d488-0849-58ee-a1e7-739c9b060fb4/2239d488-0849-58ee-a1e7-739c9b060fb4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_32efd7a14e30c39eab808e6491aed3ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2239d488-0849-58ee-a1e7-739c9b060fb4/2239d488-0849-58ee-a1e7-739c9b060fb4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_3d33f2a73d28749588f48cb248755e21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2239d488-0849-58ee-a1e7-739c9b060fb4/2239d488-0849-58ee-a1e7-739c9b060fb4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_18f397d6cd20163078b226dcff167194.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2239d488-0849-58ee-a1e7-739c9b060fb4/2239d488-0849-58ee-a1e7-739c9b060fb4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_8e9007513d0ffeeb4d8bb9762099fa55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2239d488-0849-58ee-a1e7-739c9b060fb4/2239d488-0849-58ee-a1e7-739c9b060fb4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/45/8e45a499f1f9b1cd8854984e907659ef/pa/PP43066_600a8b655ecb080c93ce24587192adc9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2016}
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP43066%27 HTTP/1.1" 200 None
2026-03-27 10:41:37 [auto1.de] INFO: Saving data for PP43066: {'created_time': 1774608097.238384, 'last_price_update_time': 1774608097.238395, 'auction_closing_time': 1774713907.0}
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP43066') HTTP/1.1" 204 0
2026-03-27 10:41:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1225177-117f-5078-8146-1d685e4c4fa4 with identifier: SJ87943
2026-03-27 10:41:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1225177-117f-5078-8146-1d685e4c4fa4 with identifier: SJ87943
2026-03-27 10:41:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1225177-117f-5078-8146-1d685e4c4fa4 with identifier: SJ87943 to the API
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_2895121e2769213cc6e6ac874e7ea75c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:05:59Z',
 'fuel_type': 'petrol',
 'id': 'd1225177-117f-5078-8146-1d685e4c4fa4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ87943',
 'listing': 'auction',
 'location': 'DE, Delmenhorst',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 63681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1225177-117f-5078-8146-1d685e4c4fa4/d1225177-117f-5078-8146-1d685e4c4fa4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_0340cb6c02caf690e4d5a3fb96fa92c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1225177-117f-5078-8146-1d685e4c4fa4/d1225177-117f-5078-8146-1d685e4c4fa4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2341373,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_e3e5eff34bec6d61d141c9d454d68be9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1225177-117f-5078-8146-1d685e4c4fa4/d1225177-117f-5078-8146-1d685e4c4fa4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2277408,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_2895121e2769213cc6e6ac874e7ea75c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1225177-117f-5078-8146-1d685e4c4fa4/d1225177-117f-5078-8146-1d685e4c4fa4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_ae29fd398c26824db1244db4a4b2bf35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1225177-117f-5078-8146-1d685e4c4fa4/d1225177-117f-5078-8146-1d685e4c4fa4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2250718,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_0266816d277d1a2dbcda541117f35c17.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1225177-117f-5078-8146-1d685e4c4fa4/d1225177-117f-5078-8146-1d685e4c4fa4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_5859a07e609596eceeb7b6744d463f4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1225177-117f-5078-8146-1d685e4c4fa4/d1225177-117f-5078-8146-1d685e4c4fa4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1895247,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_9ae67efff1eb4942e9434e08ab6cd549.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1225177-117f-5078-8146-1d685e4c4fa4/d1225177-117f-5078-8146-1d685e4c4fa4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_4b676e708d21a6c6ff0b921537af9609.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1225177-117f-5078-8146-1d685e4c4fa4/d1225177-117f-5078-8146-1d685e4c4fa4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2028159,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_acddc06ee17bed8d5da6c288437bb04e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1225177-117f-5078-8146-1d685e4c4fa4/d1225177-117f-5078-8146-1d685e4c4fa4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2111064,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/eb/64ebe6d6fb9c57b8fdcf738aa5190061/pa/SJ87943_77e938b9b20e636177f9ab7b1643f9ec.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2016}
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ87943%27 HTTP/1.1" 200 None
2026-03-27 10:41:37 [auto1.de] INFO: Saving data for SJ87943: {'created_time': 1774608097.64536, 'last_price_update_time': 1774608097.645373, 'auction_closing_time': 1774713959.0}
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ87943') HTTP/1.1" 204 0
2026-03-27 10:41:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffe7bf2c-8332-5993-a017-b632a06576a0 with identifier: KA22944
2026-03-27 10:41:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffe7bf2c-8332-5993-a017-b632a06576a0 with identifier: KA22944
2026-03-27 10:41:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffe7bf2c-8332-5993-a017-b632a06576a0 with identifier: KA22944 to the API
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 207,
 'expiration_date': '2026-03-28T16:48:34Z',
 'fuel_type': 'petrol',
 'id': 'ffe7bf2c-8332-5993-a017-b632a06576a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA22944',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 19724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-21',
 'seller_name': None,
 'title': 'Audi A1 Sportback 40 TFSI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2023}
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA22944%27 HTTP/1.1" 200 None
2026-03-27 10:41:37 [auto1.de] INFO: Saving data for KA22944: {'auction_closing_time': 1774716514.0, 'created_time': 1773302355.530143, 'last_price_update_time': 1774608097.999192}
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA22944') HTTP/1.1" 204 0
2026-03-27 10:41:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019727d0>
2026-03-27 10:41:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc4cd8e-8bcf-5a22-bd34-30f574283794/0cc4cd8e-8bcf-5a22-bd34-30f574283794_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fd1%252F03d1a09115e43a4640830b4d1f7c4eae%252Fpa%252FYR74432_f6ba6c394d6a9d7817b4678211e4394f.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_f6ba6c394d6a9d7817b4678211e4394f.jpg saved to cache
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0cc4cd8e-8bcf-5a22-bd34-30f574283794
2026-03-27 10:41:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cc4cd8e-8bcf-5a22-bd34-30f574283794, skipping ID generation
2026-03-27 10:41:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cc4cd8e-8bcf-5a22-bd34-30f574283794 with scrape type 1
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0cc4cd8e-8bcf-5a22-bd34-30f574283794 sending to next pipeline
2026-03-27 10:41:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cc4cd8e-8bcf-5a22-bd34-30f574283794, identifier: YR74432
2026-03-27 10:41:38 [auto1.de] INFO: Found listing with ID: SX47208
2026-03-27 10:41:38 [auto1.de] INFO: Found listing with ID: DE69910
2026-03-27 10:41:38 [auto1.de] INFO: Found listing with ID: YA26169
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA26169%27 HTTP/1.1" 200 None
2026-03-27 10:41:38 [auto1.de] INFO: Scrape type for YA26169: 2
2026-03-27 10:41:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef283e63-9dec-5dd6-a117-903b00f9602c with identifier: YA26169
2026-03-27 10:41:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef283e63-9dec-5dd6-a117-903b00f9602c with scrape type 2
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef283e63-9dec-5dd6-a117-903b00f9602c with scrape type 2
2026-03-27 10:41:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef283e63-9dec-5dd6-a117-903b00f9602c, identifier: YA26169
2026-03-27 10:41:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cc4cd8e-8bcf-5a22-bd34-30f574283794 with identifier: YR74432
2026-03-27 10:41:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cc4cd8e-8bcf-5a22-bd34-30f574283794 with identifier: YR74432
2026-03-27 10:41:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cc4cd8e-8bcf-5a22-bd34-30f574283794 with identifier: YR74432 to the API
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_f6ba6c394d6a9d7817b4678211e4394f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:53:03Z',
 'fuel_type': 'petrol',
 'id': '0cc4cd8e-8bcf-5a22-bd34-30f574283794',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR74432',
 'listing': 'auction',
 'location': 'DE, Jena',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 150471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc4cd8e-8bcf-5a22-bd34-30f574283794/0cc4cd8e-8bcf-5a22-bd34-30f574283794_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_fc8565b96d58b2f884868faaa2817d17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc4cd8e-8bcf-5a22-bd34-30f574283794/0cc4cd8e-8bcf-5a22-bd34-30f574283794_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_f2b02ec6248bd95fafffbb2bb194f797.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc4cd8e-8bcf-5a22-bd34-30f574283794/0cc4cd8e-8bcf-5a22-bd34-30f574283794_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_f6ba6c394d6a9d7817b4678211e4394f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc4cd8e-8bcf-5a22-bd34-30f574283794/0cc4cd8e-8bcf-5a22-bd34-30f574283794_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_1e98396b6f306e0e70d7a6be733304f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc4cd8e-8bcf-5a22-bd34-30f574283794/0cc4cd8e-8bcf-5a22-bd34-30f574283794_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_4e211a694001af73c913e9105fcea276.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc4cd8e-8bcf-5a22-bd34-30f574283794/0cc4cd8e-8bcf-5a22-bd34-30f574283794_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/d1/03d1a09115e43a4640830b4d1f7c4eae/pa/YR74432_f68dade3b33b9dbe73634e2f0e9228eb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR74432%27 HTTP/1.1" 200 None
2026-03-27 10:41:38 [auto1.de] INFO: Saving data for YR74432: {'created_time': 1774608098.64953, 'last_price_update_time': 1774608098.649544, 'auction_closing_time': 1774716783.0}
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR74432') HTTP/1.1" 204 0
2026-03-27 10:41:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab5da82e-724a-586e-b7ef-180593adb7e7 with identifier: NE66332
2026-03-27 10:41:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab5da82e-724a-586e-b7ef-180593adb7e7 with scrape type 1
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ab5da82e-724a-586e-b7ef-180593adb7e7
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F94%252Fc8940cc6caa6d6755816e2c422a26c78%252Fpa%252FNE66332_bad8cead68e61d2ffe373dc1cb49f4f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_bad8cead68e61d2ffe373dc1cb49f4f1.jpg not downloaded yet
2026-03-27 10:41:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa13f493-6256-58de-97be-419bd5af40a4 with identifier: DT14163
2026-03-27 10:41:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa13f493-6256-58de-97be-419bd5af40a4 with scrape type 1
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa13f493-6256-58de-97be-419bd5af40a4
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F78%252F767889bc4e35ecdf4eb2de9d4801bcdc%252Fpa%252FDT14163_dd9a683bc7c8a88b158576d5a9efc09f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_dd9a683bc7c8a88b158576d5a9efc09f.jpg not downloaded yet
2026-03-27 10:41:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d96ab93a-d552-5c2c-9238-406f18cf2b9b with identifier: SP19687
2026-03-27 10:41:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d96ab93a-d552-5c2c-9238-406f18cf2b9b with scrape type 1
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d96ab93a-d552-5c2c-9238-406f18cf2b9b
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F49%252F2f494169d95e541e5e018bef243be092%252Fpa%252FSP19687_2ef56d3b545481a378f8e2068958c4c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_2ef56d3b545481a378f8e2068958c4c5.jpg not downloaded yet
2026-03-27 10:41:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef283e63-9dec-5dd6-a117-903b00f9602c with identifier: YA26169
2026-03-27 10:41:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef283e63-9dec-5dd6-a117-903b00f9602c with identifier: YA26169
2026-03-27 10:41:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef283e63-9dec-5dd6-a117-903b00f9602c with identifier: YA26169 to the API
2026-03-27 10:41:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:12Z',
 'fuel_type': 'petrol',
 'id': 'ef283e63-9dec-5dd6-a117-903b00f9602c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA26169',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 54778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-09',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2022}
2026-03-27 10:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA26169%27 HTTP/1.1" 200 None
2026-03-27 10:41:39 [auto1.de] INFO: Saving data for YA26169: {'auction_closing_time': 1774715712.0, 'created_time': 1773401405.254514, 'last_price_update_time': 1774608099.988851}
2026-03-27 10:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA26169') HTTP/1.1" 204 0
2026-03-27 10:41:40 [auto1.de] INFO: Found listing with ID: PL64975
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL64975%27 HTTP/1.1" 200 None
2026-03-27 10:41:40 [auto1.de] INFO: Scrape type for PL64975: 2
2026-03-27 10:41:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d678ceb2-4da1-5e44-849d-a154c1377168 with identifier: PL64975
2026-03-27 10:41:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d678ceb2-4da1-5e44-849d-a154c1377168 with scrape type 2
2026-03-27 10:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d678ceb2-4da1-5e44-849d-a154c1377168 with scrape type 2
2026-03-27 10:41:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d678ceb2-4da1-5e44-849d-a154c1377168, identifier: PL64975
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F94%252Fc8940cc6caa6d6755816e2c422a26c78%252Fpa%252FNE66332_5ef5f00fd17d56b958a5e1fdc2a4affc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_5ef5f00fd17d56b958a5e1fdc2a4affc.jpg not downloaded yet
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F78%252F767889bc4e35ecdf4eb2de9d4801bcdc%252Fpa%252FDT14163_79d8cbd6b915e56198a126c7d5bdd4ba.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_79d8cbd6b915e56198a126c7d5bdd4ba.jpg not downloaded yet
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F49%252F2f494169d95e541e5e018bef243be092%252Fpa%252FSP19687_a249db42d85a327e1c26e46aeb3a2ca4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_a249db42d85a327e1c26e46aeb3a2ca4.jpg not downloaded yet
2026-03-27 10:41:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d678ceb2-4da1-5e44-849d-a154c1377168 with identifier: PL64975
2026-03-27 10:41:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d678ceb2-4da1-5e44-849d-a154c1377168 with identifier: PL64975
2026-03-27 10:41:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d678ceb2-4da1-5e44-849d-a154c1377168 with identifier: PL64975 to the API
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:42:48Z',
 'fuel_type': 'hybrid',
 'id': 'd678ceb2-4da1-5e44-849d-a154c1377168',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL64975',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Prius',
 'odometer': 112537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-10',
 'seller_name': None,
 'title': 'Toyota Prius 1.5',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL64975%27 HTTP/1.1" 200 None
2026-03-27 10:41:40 [auto1.de] INFO: Saving data for PL64975: {'auction_closing_time': 1774716168.0, 'created_time': 1774291369.830317, 'last_price_update_time': 1774608100.8384}
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL64975') HTTP/1.1" 204 0
2026-03-27 10:41:40 [auto1.de] INFO: Found listing with ID: MX79326
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX79326%27 HTTP/1.1" 200 None
2026-03-27 10:41:40 [auto1.de] INFO: Scrape type for MX79326: 2
2026-03-27 10:41:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebaa4533-b143-5fda-bf73-c29838d4feb1 with identifier: MX79326
2026-03-27 10:41:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebaa4533-b143-5fda-bf73-c29838d4feb1 with scrape type 2
2026-03-27 10:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebaa4533-b143-5fda-bf73-c29838d4feb1 with scrape type 2
2026-03-27 10:41:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebaa4533-b143-5fda-bf73-c29838d4feb1, identifier: MX79326
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F94%252Fc8940cc6caa6d6755816e2c422a26c78%252Fpa%252FNE66332_a680c6cefa10d1d2a53701145bd1343e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_a680c6cefa10d1d2a53701145bd1343e.jpg not downloaded yet
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F78%252F767889bc4e35ecdf4eb2de9d4801bcdc%252Fpa%252FDT14163_4fab50cced97b25a2275c7093eb6e0ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_4fab50cced97b25a2275c7093eb6e0ef.jpg not downloaded yet
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F49%252F2f494169d95e541e5e018bef243be092%252Fpa%252FSP19687_5efcb8c1e3abed69d5b01a2ff92c1705.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_5efcb8c1e3abed69d5b01a2ff92c1705.jpg not downloaded yet
2026-03-27 10:41:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebaa4533-b143-5fda-bf73-c29838d4feb1 with identifier: MX79326
2026-03-27 10:41:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebaa4533-b143-5fda-bf73-c29838d4feb1 with identifier: MX79326
2026-03-27 10:41:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebaa4533-b143-5fda-bf73-c29838d4feb1 with identifier: MX79326 to the API
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:16:52Z',
 'fuel_type': 'petrol',
 'id': 'ebaa4533-b143-5fda-bf73-c29838d4feb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX79326',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 127027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-14',
 'seller_name': None,
 'title': 'Citroen C3 1.4 Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2008}
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX79326%27 HTTP/1.1" 200 None
2026-03-27 10:41:41 [auto1.de] INFO: Saving data for MX79326: {'auction_closing_time': 1774714612.0, 'created_time': 1774290986.750902, 'last_price_update_time': 1774608101.40069}
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX79326') HTTP/1.1" 204 0
2026-03-27 10:41:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_dd9a683bc7c8a88b158576d5a9efc09f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:41 [auto1.de] INFO: Found listing with ID: GG89012
2026-03-27 10:41:41 [auto1.de] INFO: Found listing with ID: JB86141
2026-03-27 10:41:41 [auto1.de] INFO: Found listing with ID: LG78390
2026-03-27 10:41:41 [auto1.de] INFO: Found listing with ID: BX10295
2026-03-27 10:41:41 [auto1.de] INFO: Found listing with ID: XT91998
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91998%27 HTTP/1.1" 200 None
2026-03-27 10:41:41 [auto1.de] INFO: Scrape type for XT91998: 2
2026-03-27 10:41:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b6ff8f5-36d4-5d7c-b547-c6d0355e5106 with identifier: XT91998
2026-03-27 10:41:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b6ff8f5-36d4-5d7c-b547-c6d0355e5106 with scrape type 2
2026-03-27 10:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b6ff8f5-36d4-5d7c-b547-c6d0355e5106 with scrape type 2
2026-03-27 10:41:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b6ff8f5-36d4-5d7c-b547-c6d0355e5106, identifier: XT91998
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F94%252Fc8940cc6caa6d6755816e2c422a26c78%252Fpa%252FNE66332_e38e62ecc8e769a47ae8a0180eae7c06.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_e38e62ecc8e769a47ae8a0180eae7c06.jpg not downloaded yet
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F78%252F767889bc4e35ecdf4eb2de9d4801bcdc%252Fpa%252FDT14163_e174044b55147668720dc93c906cf060.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_e174044b55147668720dc93c906cf060.jpg not downloaded yet
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F49%252F2f494169d95e541e5e018bef243be092%252Fpa%252FSP19687_c650de835dbb3527afe65cf6ae852bf4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_c650de835dbb3527afe65cf6ae852bf4.jpg not downloaded yet
2026-03-27 10:41:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b6ff8f5-36d4-5d7c-b547-c6d0355e5106 with identifier: XT91998
2026-03-27 10:41:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b6ff8f5-36d4-5d7c-b547-c6d0355e5106 with identifier: XT91998
2026-03-27 10:41:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b6ff8f5-36d4-5d7c-b547-c6d0355e5106 with identifier: XT91998 to the API
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:51:33Z',
 'fuel_type': 'petrol',
 'id': '7b6ff8f5-36d4-5d7c-b547-c6d0355e5106',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT91998',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 43450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-26',
 'seller_name': None,
 'title': 'Seat Ateca 1.4 TSI ACT Xcellence 4Drive',
 'transmission': 'automatic',
 'trim': 'Xcellence 4Drive',
 'year': 2018}
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91998%27 HTTP/1.1" 200 None
2026-03-27 10:41:41 [auto1.de] INFO: Saving data for XT91998: {'auction_closing_time': 1774716693.0, 'created_time': 1773381016.251702, 'last_price_update_time': 1774608101.976699}
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT91998') HTTP/1.1" 204 0
2026-03-27 10:41:42 [auto1.de] INFO: Found listing with ID: GK82878
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK82878%27 HTTP/1.1" 200 None
2026-03-27 10:41:42 [auto1.de] INFO: Scrape type for GK82878: 2
2026-03-27 10:41:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04ed7688-e5aa-58a2-a68a-12a6a4cd819f with identifier: GK82878
2026-03-27 10:41:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04ed7688-e5aa-58a2-a68a-12a6a4cd819f with scrape type 2
2026-03-27 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04ed7688-e5aa-58a2-a68a-12a6a4cd819f with scrape type 2
2026-03-27 10:41:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04ed7688-e5aa-58a2-a68a-12a6a4cd819f, identifier: GK82878
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F94%252Fc8940cc6caa6d6755816e2c422a26c78%252Fpa%252FNE66332_04e78b9dab2fae9edd943269869ac538.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_04e78b9dab2fae9edd943269869ac538.jpg not downloaded yet
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F78%252F767889bc4e35ecdf4eb2de9d4801bcdc%252Fpa%252FDT14163_53e3b01819fbdd7f13ecd8e1ac1604d9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_53e3b01819fbdd7f13ecd8e1ac1604d9.jpg not downloaded yet
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F49%252F2f494169d95e541e5e018bef243be092%252Fpa%252FSP19687_cc2671f6b490dad99c48c505672d9251.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_cc2671f6b490dad99c48c505672d9251.jpg not downloaded yet
2026-03-27 10:41:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XG24427/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY74387/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04ed7688-e5aa-58a2-a68a-12a6a4cd819f with identifier: GK82878
2026-03-27 10:41:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04ed7688-e5aa-58a2-a68a-12a6a4cd819f with identifier: GK82878
2026-03-27 10:41:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04ed7688-e5aa-58a2-a68a-12a6a4cd819f with identifier: GK82878 to the API
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:02:10Z',
 'fuel_type': 'petrol',
 'id': '04ed7688-e5aa-58a2-a68a-12a6a4cd819f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK82878',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 122549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-19',
 'seller_name': None,
 'title': 'Mazda 6 1.8 Active Sport',
 'transmission': 'manual',
 'trim': 'Active Sport',
 'year': 2007}
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK82878%27 HTTP/1.1" 200 None
2026-03-27 10:41:42 [auto1.de] INFO: Saving data for GK82878: {'auction_closing_time': 1774713730.0, 'created_time': 1773345580.268085, 'last_price_update_time': 1774608102.609814}
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK82878') HTTP/1.1" 204 0
2026-03-27 10:41:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:42 [auto1.de] INFO: Found listing with ID: EF82631
2026-03-27 10:41:42 [auto1.de] INFO: Found listing with ID: CG37659
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG37659%27 HTTP/1.1" 200 None
2026-03-27 10:41:42 [auto1.de] INFO: Scrape type for CG37659: 2
2026-03-27 10:41:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ded9a852-ba97-547d-8c7f-c0e9363d3a45 with identifier: CG37659
2026-03-27 10:41:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ded9a852-ba97-547d-8c7f-c0e9363d3a45 with scrape type 2
2026-03-27 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ded9a852-ba97-547d-8c7f-c0e9363d3a45 with scrape type 2
2026-03-27 10:41:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ded9a852-ba97-547d-8c7f-c0e9363d3a45, identifier: CG37659
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F94%252Fc8940cc6caa6d6755816e2c422a26c78%252Fpa%252FNE66332_2c7f5304620808e8258de42e45f4e2ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_2c7f5304620808e8258de42e45f4e2ea.jpg not downloaded yet
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F78%252F767889bc4e35ecdf4eb2de9d4801bcdc%252Fpa%252FDT14163_95851372e25c28607d0bf41f5793c860.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_95851372e25c28607d0bf41f5793c860.jpg not downloaded yet
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F49%252F2f494169d95e541e5e018bef243be092%252Fpa%252FSP19687_99c9520c71d6f73357bf5ecc7e411354.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_99c9520c71d6f73357bf5ecc7e411354.jpg not downloaded yet
2026-03-27 10:41:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001cd990>
2026-03-27 10:41:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa13f493-6256-58de-97be-419bd5af40a4/aa13f493-6256-58de-97be-419bd5af40a4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F78%252F767889bc4e35ecdf4eb2de9d4801bcdc%252Fpa%252FDT14163_dd9a683bc7c8a88b158576d5a9efc09f.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_dd9a683bc7c8a88b158576d5a9efc09f.jpg saved to cache
2026-03-27 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa13f493-6256-58de-97be-419bd5af40a4
2026-03-27 10:41:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ded9a852-ba97-547d-8c7f-c0e9363d3a45 with identifier: CG37659
2026-03-27 10:41:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ded9a852-ba97-547d-8c7f-c0e9363d3a45 with identifier: CG37659
2026-03-27 10:41:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ded9a852-ba97-547d-8c7f-c0e9363d3a45 with identifier: CG37659 to the API
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:41:25Z',
 'fuel_type': 'diesel',
 'id': 'ded9a852-ba97-547d-8c7f-c0e9363d3a45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG37659',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 127702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-27',
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG37659%27 HTTP/1.1" 200 None
2026-03-27 10:41:43 [auto1.de] INFO: Saving data for CG37659: {'auction_closing_time': 1774716085.0, 'created_time': 1773380140.319742, 'last_price_update_time': 1774608103.259677}
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG37659') HTTP/1.1" 204 0
2026-03-27 10:41:43 [auto1.de] INFO: Found listing with ID: HU16718
2026-03-27 10:41:43 [auto1.de] INFO: Found listing with ID: GV33356
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV33356%27 HTTP/1.1" 200 None
2026-03-27 10:41:43 [auto1.de] INFO: Scrape type for GV33356: 2
2026-03-27 10:41:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 141b9907-123c-5e4e-aa39-3105849030d0 with identifier: GV33356
2026-03-27 10:41:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 141b9907-123c-5e4e-aa39-3105849030d0 with scrape type 2
2026-03-27 10:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 141b9907-123c-5e4e-aa39-3105849030d0 with scrape type 2
2026-03-27 10:41:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 141b9907-123c-5e4e-aa39-3105849030d0, identifier: GV33356
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F94%252Fc8940cc6caa6d6755816e2c422a26c78%252Fpa%252FNE66332_ff2932b4185eb2319ebc3042a1934bfa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_ff2932b4185eb2319ebc3042a1934bfa.jpg not downloaded yet
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F78%252F767889bc4e35ecdf4eb2de9d4801bcdc%252Fpa%252FDT14163_f669831bf7849029195bbfcd4d488817.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_f669831bf7849029195bbfcd4d488817.jpg not downloaded yet
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F49%252F2f494169d95e541e5e018bef243be092%252Fpa%252FSP19687_a8e96069190fa3daacf7f5d6b14502d2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_a8e96069190fa3daacf7f5d6b14502d2.jpg not downloaded yet
2026-03-27 10:41:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 141b9907-123c-5e4e-aa39-3105849030d0 with identifier: GV33356
2026-03-27 10:41:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 141b9907-123c-5e4e-aa39-3105849030d0 with identifier: GV33356
2026-03-27 10:41:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 141b9907-123c-5e4e-aa39-3105849030d0 with identifier: GV33356 to the API
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:08:50Z',
 'fuel_type': 'petrol',
 'id': '141b9907-123c-5e4e-aa39-3105849030d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV33356',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 189332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-30',
 'seller_name': None,
 'title': 'Opel Zafira 1.6 Design Edition',
 'transmission': 'manual',
 'trim': 'Design Edition',
 'year': 2011}
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV33356%27 HTTP/1.1" 200 None
2026-03-27 10:41:43 [auto1.de] INFO: Saving data for GV33356: {'auction_closing_time': 1774714130.0, 'created_time': 1773304581.608919, 'last_price_update_time': 1774608103.861153}
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV33356') HTTP/1.1" 204 0
2026-03-27 10:41:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_53e3b01819fbdd7f13ecd8e1ac1604d9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:43 [auto1.de] INFO: Found listing with ID: EY45109
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY45109%27 HTTP/1.1" 200 None
2026-03-27 10:41:43 [auto1.de] INFO: Scrape type for EY45109: 2
2026-03-27 10:41:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e91feca9-5fc7-57b4-aa02-9fa16808159e with identifier: EY45109
2026-03-27 10:41:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e91feca9-5fc7-57b4-aa02-9fa16808159e with scrape type 2
2026-03-27 10:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e91feca9-5fc7-57b4-aa02-9fa16808159e with scrape type 2
2026-03-27 10:41:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e91feca9-5fc7-57b4-aa02-9fa16808159e, identifier: EY45109
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F94%252Fc8940cc6caa6d6755816e2c422a26c78%252Fpa%252FNE66332_c0e080b7359cfe6580e556b4f7abb312.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_c0e080b7359cfe6580e556b4f7abb312.jpg not downloaded yet
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F78%252F767889bc4e35ecdf4eb2de9d4801bcdc%252Fpa%252FDT14163_1dddfb608ce7f9332a43b9f1bebbda52.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_1dddfb608ce7f9332a43b9f1bebbda52.jpg not downloaded yet
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F49%252F2f494169d95e541e5e018bef243be092%252Fpa%252FSP19687_41a345559bb242fe5279eb267ae75183.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_41a345559bb242fe5279eb267ae75183.jpg not downloaded yet
2026-03-27 10:41:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e91feca9-5fc7-57b4-aa02-9fa16808159e with identifier: EY45109
2026-03-27 10:41:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e91feca9-5fc7-57b4-aa02-9fa16808159e with identifier: EY45109
2026-03-27 10:41:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e91feca9-5fc7-57b4-aa02-9fa16808159e with identifier: EY45109 to the API
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:57:47Z',
 'fuel_type': 'petrol',
 'id': 'e91feca9-5fc7-57b4-aa02-9fa16808159e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY45109',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 138328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-21',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.4 Turbo Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY45109%27 HTTP/1.1" 200 None
2026-03-27 10:41:44 [auto1.de] INFO: Saving data for EY45109: {'auction_closing_time': 1774717067.0, 'created_time': 1773772543.133384, 'last_price_update_time': 1774608104.420255}
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY45109') HTTP/1.1" 204 0
2026-03-27 10:41:44 [auto1.de] INFO: Found listing with ID: HA99169
2026-03-27 10:41:44 [auto1.de] INFO: Found listing with ID: VY38504
2026-03-27 10:41:44 [auto1.de] INFO: Found listing with ID: AV25336
2026-03-27 10:41:44 [auto1.de] INFO: Found listing with ID: ZV87570
2026-03-27 10:41:44 [auto1.de] INFO: Found listing with ID: NH13691
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH13691%27 HTTP/1.1" 200 None
2026-03-27 10:41:44 [auto1.de] INFO: Scrape type for NH13691: 2
2026-03-27 10:41:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34f648d1-f500-5c5b-8807-9ea32ce3ffd9 with identifier: NH13691
2026-03-27 10:41:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34f648d1-f500-5c5b-8807-9ea32ce3ffd9 with scrape type 2
2026-03-27 10:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34f648d1-f500-5c5b-8807-9ea32ce3ffd9 with scrape type 2
2026-03-27 10:41:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34f648d1-f500-5c5b-8807-9ea32ce3ffd9, identifier: NH13691
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F94%252Fc8940cc6caa6d6755816e2c422a26c78%252Fpa%252FNE66332_6f5987b6cef83c6eabf1bfcf2ba75efb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_6f5987b6cef83c6eabf1bfcf2ba75efb.jpg not downloaded yet
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F78%252F767889bc4e35ecdf4eb2de9d4801bcdc%252Fpa%252FDT14163_be0cf815dc46475395663e87dfb124e9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_be0cf815dc46475395663e87dfb124e9.jpg not downloaded yet
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F49%252F2f494169d95e541e5e018bef243be092%252Fpa%252FSP19687_8654fed50fa0ca9d0207c7e24e6808f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_8654fed50fa0ca9d0207c7e24e6808f1.jpg not downloaded yet
2026-03-27 10:41:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34f648d1-f500-5c5b-8807-9ea32ce3ffd9 with identifier: NH13691
2026-03-27 10:41:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34f648d1-f500-5c5b-8807-9ea32ce3ffd9 with identifier: NH13691
2026-03-27 10:41:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34f648d1-f500-5c5b-8807-9ea32ce3ffd9 with identifier: NH13691 to the API
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:41:23Z',
 'fuel_type': 'petrol',
 'id': '34f648d1-f500-5c5b-8807-9ea32ce3ffd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH13691',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 105251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-05',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH13691%27 HTTP/1.1" 200 None
2026-03-27 10:41:44 [auto1.de] INFO: Saving data for NH13691: {'auction_closing_time': 1774716083.0, 'created_time': 1773830144.010198, 'last_price_update_time': 1774608104.945127}
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH13691') HTTP/1.1" 204 0
2026-03-27 10:41:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004dc690>
2026-03-27 10:41:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa13f493-6256-58de-97be-419bd5af40a4/aa13f493-6256-58de-97be-419bd5af40a4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F78%252F767889bc4e35ecdf4eb2de9d4801bcdc%252Fpa%252FDT14163_53e3b01819fbdd7f13ecd8e1ac1604d9.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_53e3b01819fbdd7f13ecd8e1ac1604d9.jpg saved to cache
2026-03-27 10:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa13f493-6256-58de-97be-419bd5af40a4
2026-03-27 10:41:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_a8e96069190fa3daacf7f5d6b14502d2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:45 [auto1.de] INFO: Found listing with ID: YV09971
2026-03-27 10:41:45 [auto1.de] INFO: Found listing with ID: SJ02075
2026-03-27 10:41:45 [auto1.de] INFO: Found listing with ID: HX18202
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX18202%27 HTTP/1.1" 200 None
2026-03-27 10:41:45 [auto1.de] INFO: Scrape type for HX18202: 2
2026-03-27 10:41:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327 with identifier: HX18202
2026-03-27 10:41:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327 with scrape type 2
2026-03-27 10:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327 with scrape type 2
2026-03-27 10:41:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327, identifier: HX18202
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F94%252Fc8940cc6caa6d6755816e2c422a26c78%252Fpa%252FNE66332_c8e00f977f3bed28bf75e413abb79e2b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_c8e00f977f3bed28bf75e413abb79e2b.jpg not downloaded yet
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F78%252F767889bc4e35ecdf4eb2de9d4801bcdc%252Fpa%252FDT14163_27eafb9c6fd3ba981111060212168e47.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_27eafb9c6fd3ba981111060212168e47.jpg not downloaded yet
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F49%252F2f494169d95e541e5e018bef243be092%252Fpa%252FSP19687_3044e75697a02ffaadabf9e9ea7433bc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_3044e75697a02ffaadabf9e9ea7433bc.jpg not downloaded yet
2026-03-27 10:41:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327 with identifier: HX18202
2026-03-27 10:41:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327 with identifier: HX18202
2026-03-27 10:41:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327 with identifier: HX18202 to the API
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:07:46Z',
 'fuel_type': 'petrol',
 'id': '89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX18202',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 109637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-03',
 'seller_name': None,
 'title': 'Seat Alhambra 1.4 TSI FR-Line',
 'transmission': 'automatic',
 'trim': 'FR-Line',
 'year': 2017}
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX18202%27 HTTP/1.1" 200 None
2026-03-27 10:41:45 [auto1.de] INFO: Saving data for HX18202: {'auction_closing_time': 1774714066.0, 'created_time': 1774290982.724862, 'last_price_update_time': 1774608105.644447}
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX18202') HTTP/1.1" 204 0
2026-03-27 10:41:45 [auto1.de] INFO: Found listing with ID: BZ09697
2026-03-27 10:41:45 [auto1.de] INFO: Found listing with ID: DM27996
2026-03-27 10:41:45 [auto1.de] INFO: Found listing with ID: CT53994
2026-03-27 10:41:45 [auto1.de] INFO: Found listing with ID: KP72429
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72429%27 HTTP/1.1" 200 None
2026-03-27 10:41:45 [auto1.de] INFO: Scrape type for KP72429: 2
2026-03-27 10:41:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34befb9a-7dd6-5454-b9b1-c05fb88e5ab6 with identifier: KP72429
2026-03-27 10:41:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34befb9a-7dd6-5454-b9b1-c05fb88e5ab6 with scrape type 2
2026-03-27 10:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34befb9a-7dd6-5454-b9b1-c05fb88e5ab6 with scrape type 2
2026-03-27 10:41:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34befb9a-7dd6-5454-b9b1-c05fb88e5ab6, identifier: KP72429
2026-03-27 10:41:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34befb9a-7dd6-5454-b9b1-c05fb88e5ab6 with identifier: KP72429
2026-03-27 10:41:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34befb9a-7dd6-5454-b9b1-c05fb88e5ab6 with identifier: KP72429
2026-03-27 10:41:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34befb9a-7dd6-5454-b9b1-c05fb88e5ab6 with identifier: KP72429 to the API
2026-03-27 10:41:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:33:22Z',
 'fuel_type': 'petrol',
 'id': '34befb9a-7dd6-5454-b9b1-c05fb88e5ab6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP72429',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 92911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-16',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI GT Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line 4WD',
 'year': 2019}
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72429%27 HTTP/1.1" 200 None
2026-03-27 10:41:46 [auto1.de] INFO: Saving data for KP72429: {'auction_closing_time': 1774715602.0, 'created_time': 1773383440.157252, 'last_price_update_time': 1774608106.133499}
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP72429') HTTP/1.1" 204 0
2026-03-27 10:41:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC49554/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZC71941/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001e1250>
2026-03-27 10:41:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d96ab93a-d552-5c2c-9238-406f18cf2b9b/d96ab93a-d552-5c2c-9238-406f18cf2b9b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F49%252F2f494169d95e541e5e018bef243be092%252Fpa%252FSP19687_a8e96069190fa3daacf7f5d6b14502d2.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_a8e96069190fa3daacf7f5d6b14502d2.jpg saved to cache
2026-03-27 10:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d96ab93a-d552-5c2c-9238-406f18cf2b9b
2026-03-27 10:41:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_8654fed50fa0ca9d0207c7e24e6808f1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN62521> (referer: https://www.auto1.com/v1/car-details-view/NN62521/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL59666> (referer: https://www.auto1.com/v1/car-details-view/NL59666/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MY92722/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BJ13428/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME89657/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:46 [auto1.de] INFO: Channel: 24h | Page: 20 | totalHits: 10523 | hits on page: 40
2026-03-27 10:41:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:46 [auto1.de] INFO: Found listing with ID: KP72429
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72429%27 HTTP/1.1" 200 None
2026-03-27 10:41:46 [auto1.de] INFO: Scrape type for KP72429: 0
2026-03-27 10:41:46 [auto1.de] INFO: Found listing with ID: TL87064
2026-03-27 10:41:46 [auto1.de] INFO: Found listing with ID: WW12135
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW12135%27 HTTP/1.1" 200 None
2026-03-27 10:41:46 [auto1.de] INFO: Scrape type for WW12135: 2
2026-03-27 10:41:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1706d7f4-4bbf-579d-92b5-87c72bdd2eed with identifier: WW12135
2026-03-27 10:41:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1706d7f4-4bbf-579d-92b5-87c72bdd2eed with scrape type 2
2026-03-27 10:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1706d7f4-4bbf-579d-92b5-87c72bdd2eed with scrape type 2
2026-03-27 10:41:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1706d7f4-4bbf-579d-92b5-87c72bdd2eed, identifier: WW12135
2026-03-27 10:41:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1706d7f4-4bbf-579d-92b5-87c72bdd2eed with identifier: WW12135
2026-03-27 10:41:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1706d7f4-4bbf-579d-92b5-87c72bdd2eed with identifier: WW12135
2026-03-27 10:41:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1706d7f4-4bbf-579d-92b5-87c72bdd2eed with identifier: WW12135 to the API
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:42:30Z',
 'fuel_type': 'petrol',
 'id': '1706d7f4-4bbf-579d-92b5-87c72bdd2eed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW12135',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 43320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-23',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.2 TSI Club BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Club BlueMotion Tech',
 'year': 2015}
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW12135%27 HTTP/1.1" 200 None
2026-03-27 10:41:46 [auto1.de] INFO: Saving data for WW12135: {'auction_closing_time': 1774716150.0, 'created_time': 1774251382.950715, 'last_price_update_time': 1774608106.824995}
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW12135') HTTP/1.1" 204 0
2026-03-27 10:41:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_27eafb9c6fd3ba981111060212168e47.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_c8e00f977f3bed28bf75e413abb79e2b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:46 [auto1.de] INFO: Found listing with ID: WS69855
2026-03-27 10:41:46 [auto1.de] INFO: Found listing with ID: DB25597
2026-03-27 10:41:46 [auto1.de] INFO: Found listing with ID: PH96915
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH96915%27 HTTP/1.1" 200 None
2026-03-27 10:41:46 [auto1.de] INFO: Scrape type for PH96915: 2
2026-03-27 10:41:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 545c7f75-9ff7-5f91-94be-70af58c45add with identifier: PH96915
2026-03-27 10:41:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 545c7f75-9ff7-5f91-94be-70af58c45add with scrape type 2
2026-03-27 10:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 545c7f75-9ff7-5f91-94be-70af58c45add with scrape type 2
2026-03-27 10:41:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 545c7f75-9ff7-5f91-94be-70af58c45add, identifier: PH96915
2026-03-27 10:41:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_3044e75697a02ffaadabf9e9ea7433bc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 545c7f75-9ff7-5f91-94be-70af58c45add with identifier: PH96915
2026-03-27 10:41:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 545c7f75-9ff7-5f91-94be-70af58c45add with identifier: PH96915
2026-03-27 10:41:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 545c7f75-9ff7-5f91-94be-70af58c45add with identifier: PH96915 to the API
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-28T16:43:27Z',
 'fuel_type': 'diesel',
 'id': '545c7f75-9ff7-5f91-94be-70af58c45add',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH96915',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 51274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH96915%27 HTTP/1.1" 200 None
2026-03-27 10:41:47 [auto1.de] INFO: Saving data for PH96915: {'auction_closing_time': 1774716207.0, 'created_time': 1773775869.779726, 'last_price_update_time': 1774608107.322125}
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH96915') HTTP/1.1" 204 0
2026-03-27 10:41:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001e3850>
2026-03-27 10:41:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d96ab93a-d552-5c2c-9238-406f18cf2b9b/d96ab93a-d552-5c2c-9238-406f18cf2b9b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F49%252F2f494169d95e541e5e018bef243be092%252Fpa%252FSP19687_8654fed50fa0ca9d0207c7e24e6808f1.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_8654fed50fa0ca9d0207c7e24e6808f1.jpg saved to cache
2026-03-27 10:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d96ab93a-d552-5c2c-9238-406f18cf2b9b
2026-03-27 10:41:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3901b9a-4202-5c28-9f8c-178cdfe5d4ec with identifier: NN62521
2026-03-27 10:41:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3901b9a-4202-5c28-9f8c-178cdfe5d4ec with scrape type 1
2026-03-27 10:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e3901b9a-4202-5c28-9f8c-178cdfe5d4ec
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Ff4%252F00f49ec0c931dc810841839172b0d510%252Fpa%252FNN62521_05a5342cba0f83b244bb0e783cea69e0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/f4/00f49ec0c931dc810841839172b0d510/pa/NN62521_05a5342cba0f83b244bb0e783cea69e0.jpg already downloaded
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Ff4%252F00f49ec0c931dc810841839172b0d510%252Fpa%252FNN62521_5a7e964dffbf0896a4a081832830ffda.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/f4/00f49ec0c931dc810841839172b0d510/pa/NN62521_5a7e964dffbf0896a4a081832830ffda.jpg already downloaded
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Ff4%252F00f49ec0c931dc810841839172b0d510%252Fpa%252FNN62521_9d62e1d2bc825ea6540fefd398d53a57.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/f4/00f49ec0c931dc810841839172b0d510/pa/NN62521_9d62e1d2bc825ea6540fefd398d53a57.jpg already downloaded
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Ff4%252F00f49ec0c931dc810841839172b0d510%252Fpa%252FNN62521_0b1115ca57ea3b6dfd4bec72f289288b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/f4/00f49ec0c931dc810841839172b0d510/pa/NN62521_0b1115ca57ea3b6dfd4bec72f289288b.jpg already downloaded
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Ff4%252F00f49ec0c931dc810841839172b0d510%252Fpa%252FNN62521_4680f32c42426568d5d1c6f129a8627d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/f4/00f49ec0c931dc810841839172b0d510/pa/NN62521_4680f32c42426568d5d1c6f129a8627d.jpg already downloaded
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Ff4%252F00f49ec0c931dc810841839172b0d510%252Fpa%252FNN62521_81df2efcb09e917d73823a5c0059e423.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/f4/00f49ec0c931dc810841839172b0d510/pa/NN62521_81df2efcb09e917d73823a5c0059e423.jpg already downloaded
2026-03-27 10:41:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3901b9a-4202-5c28-9f8c-178cdfe5d4ec, identifier: NN62521
2026-03-27 10:41:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4466ed50-5955-5583-a8aa-05d304311dea with identifier: NL59666
2026-03-27 10:41:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4466ed50-5955-5583-a8aa-05d304311dea with scrape type 1
2026-03-27 10:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F08%252F4208b7b27af2168e20bc9a21c53695fc%252Fpa%252FNL59666_ac1f3efe227006d991c08c7b3c8f9357.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_ac1f3efe227006d991c08c7b3c8f9357.jpg not downloaded yet
2026-03-27 10:41:47 [auto1.de] INFO: Found listing with ID: MZ98399
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ98399%27 HTTP/1.1" 200 None
2026-03-27 10:41:47 [auto1.de] INFO: Scrape type for MZ98399: 2
2026-03-27 10:41:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d55f978b-941e-589d-a126-ef9779bc91b6 with identifier: MZ98399
2026-03-27 10:41:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d55f978b-941e-589d-a126-ef9779bc91b6 with scrape type 2
2026-03-27 10:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d55f978b-941e-589d-a126-ef9779bc91b6 with scrape type 2
2026-03-27 10:41:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d55f978b-941e-589d-a126-ef9779bc91b6, identifier: MZ98399
2026-03-27 10:41:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3901b9a-4202-5c28-9f8c-178cdfe5d4ec with identifier: NN62521
2026-03-27 10:41:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3901b9a-4202-5c28-9f8c-178cdfe5d4ec with identifier: NN62521
2026-03-27 10:41:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3901b9a-4202-5c28-9f8c-178cdfe5d4ec with identifier: NN62521 to the API
2026-03-27 10:41:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NN62521>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:31:34Z',
 'fuel_type': 'petrol',
 'id': 'e3901b9a-4202-5c28-9f8c-178cdfe5d4ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN62521',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 165137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img00/f4/00f49ec0c931dc810841839172b0d510/pa/NN62521_05a5342cba0f83b244bb0e783cea69e0.jpg',
                'https://img-pa.auto1.com/img00/f4/00f49ec0c931dc810841839172b0d510/pa/NN62521_5a7e964dffbf0896a4a081832830ffda.jpg',
                'https://img-pa.auto1.com/img00/f4/00f49ec0c931dc810841839172b0d510/pa/NN62521_9d62e1d2bc825ea6540fefd398d53a57.jpg',
                'https://img-pa.auto1.com/img00/f4/00f49ec0c931dc810841839172b0d510/pa/NN62521_0b1115ca57ea3b6dfd4bec72f289288b.jpg',
                'https://img-pa.auto1.com/img00/f4/00f49ec0c931dc810841839172b0d510/pa/NN62521_4680f32c42426568d5d1c6f129a8627d.jpg',
                'https://img-pa.auto1.com/img00/f4/00f49ec0c931dc810841839172b0d510/pa/NN62521_81df2efcb09e917d73823a5c0059e423.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3901b9a-4202-5c28-9f8c-178cdfe5d4ec/e3901b9a-4202-5c28-9f8c-178cdfe5d4ec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/f4/00f49ec0c931dc810841839172b0d510/pa/NN62521_05a5342cba0f83b244bb0e783cea69e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3901b9a-4202-5c28-9f8c-178cdfe5d4ec/e3901b9a-4202-5c28-9f8c-178cdfe5d4ec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/f4/00f49ec0c931dc810841839172b0d510/pa/NN62521_5a7e964dffbf0896a4a081832830ffda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3901b9a-4202-5c28-9f8c-178cdfe5d4ec/e3901b9a-4202-5c28-9f8c-178cdfe5d4ec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/f4/00f49ec0c931dc810841839172b0d510/pa/NN62521_9d62e1d2bc825ea6540fefd398d53a57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3901b9a-4202-5c28-9f8c-178cdfe5d4ec/e3901b9a-4202-5c28-9f8c-178cdfe5d4ec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/f4/00f49ec0c931dc810841839172b0d510/pa/NN62521_0b1115ca57ea3b6dfd4bec72f289288b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3901b9a-4202-5c28-9f8c-178cdfe5d4ec/e3901b9a-4202-5c28-9f8c-178cdfe5d4ec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/f4/00f49ec0c931dc810841839172b0d510/pa/NN62521_4680f32c42426568d5d1c6f129a8627d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3901b9a-4202-5c28-9f8c-178cdfe5d4ec/e3901b9a-4202-5c28-9f8c-178cdfe5d4ec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/f4/00f49ec0c931dc810841839172b0d510/pa/NN62521_81df2efcb09e917d73823a5c0059e423.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-07-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.4 TCe BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2012}
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN62521%27 HTTP/1.1" 200 None
2026-03-27 10:41:48 [auto1.de] INFO: Saving data for NN62521: {'created_time': 1774608108.251702, 'last_price_update_time': 1774608108.251714, 'auction_closing_time': 1774715494.0}
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN62521') HTTP/1.1" 204 0
2026-03-27 10:41:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d55f978b-941e-589d-a126-ef9779bc91b6 with identifier: MZ98399
2026-03-27 10:41:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d55f978b-941e-589d-a126-ef9779bc91b6 with identifier: MZ98399
2026-03-27 10:41:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d55f978b-941e-589d-a126-ef9779bc91b6 with identifier: MZ98399 to the API
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:07:09Z',
 'fuel_type': 'diesel',
 'id': 'd55f978b-941e-589d-a126-ef9779bc91b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ98399',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 106846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-21',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2016}
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ98399%27 HTTP/1.1" 200 None
2026-03-27 10:41:48 [auto1.de] INFO: Saving data for MZ98399: {'auction_closing_time': 1774714029.0, 'created_time': 1773772625.722903, 'last_price_update_time': 1774608108.615565}
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ98399') HTTP/1.1" 204 0
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F08%252F4208b7b27af2168e20bc9a21c53695fc%252Fpa%252FNL59666_33dabe2e40ee15f5e7e317b744e0f6a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_33dabe2e40ee15f5e7e317b744e0f6a7.jpg not downloaded yet
2026-03-27 10:41:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50162f850>
2026-03-27 10:41:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa13f493-6256-58de-97be-419bd5af40a4/aa13f493-6256-58de-97be-419bd5af40a4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F78%252F767889bc4e35ecdf4eb2de9d4801bcdc%252Fpa%252FDT14163_27eafb9c6fd3ba981111060212168e47.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_27eafb9c6fd3ba981111060212168e47.jpg saved to cache
2026-03-27 10:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa13f493-6256-58de-97be-419bd5af40a4
2026-03-27 10:41:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50169b410>
2026-03-27 10:41:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5da82e-724a-586e-b7ef-180593adb7e7/ab5da82e-724a-586e-b7ef-180593adb7e7_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F94%252Fc8940cc6caa6d6755816e2c422a26c78%252Fpa%252FNE66332_c8e00f977f3bed28bf75e413abb79e2b.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_c8e00f977f3bed28bf75e413abb79e2b.jpg saved to cache
2026-03-27 10:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab5da82e-724a-586e-b7ef-180593adb7e7
2026-03-27 10:41:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_6f5987b6cef83c6eabf1bfcf2ba75efb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:48 [auto1.de] INFO: Found listing with ID: LN73181
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN73181%27 HTTP/1.1" 200 None
2026-03-27 10:41:48 [auto1.de] INFO: Scrape type for LN73181: 2
2026-03-27 10:41:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faf6b590-2465-5226-bcdb-a5e3f0b6181c with identifier: LN73181
2026-03-27 10:41:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faf6b590-2465-5226-bcdb-a5e3f0b6181c with scrape type 2
2026-03-27 10:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faf6b590-2465-5226-bcdb-a5e3f0b6181c with scrape type 2
2026-03-27 10:41:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: faf6b590-2465-5226-bcdb-a5e3f0b6181c, identifier: LN73181
2026-03-27 10:41:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_41a345559bb242fe5279eb267ae75183.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_be0cf815dc46475395663e87dfb124e9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: faf6b590-2465-5226-bcdb-a5e3f0b6181c with identifier: LN73181
2026-03-27 10:41:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: faf6b590-2465-5226-bcdb-a5e3f0b6181c with identifier: LN73181
2026-03-27 10:41:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: faf6b590-2465-5226-bcdb-a5e3f0b6181c with identifier: LN73181 to the API
2026-03-27 10:41:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:15:32Z',
 'fuel_type': 'diesel',
 'id': 'faf6b590-2465-5226-bcdb-a5e3f0b6181c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN73181',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 168467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-09',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2013}
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN73181%27 HTTP/1.1" 200 None
2026-03-27 10:41:49 [auto1.de] INFO: Saving data for LN73181: {'auction_closing_time': 1774714532.0, 'created_time': 1773305947.44444, 'last_price_update_time': 1774608109.214674}
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN73181') HTTP/1.1" 204 0
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F08%252F4208b7b27af2168e20bc9a21c53695fc%252Fpa%252FNL59666_c6622c24fea21f7c9621461432ae8d32.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_c6622c24fea21f7c9621461432ae8d32.jpg not downloaded yet
2026-03-27 10:41:49 [auto1.de] INFO: Found listing with ID: LT47109
2026-03-27 10:41:49 [auto1.de] INFO: Found listing with ID: ZT78140
2026-03-27 10:41:49 [auto1.de] INFO: Found listing with ID: UY19816
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY19816%27 HTTP/1.1" 200 None
2026-03-27 10:41:49 [auto1.de] INFO: Scrape type for UY19816: 2
2026-03-27 10:41:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf72fab7-c316-5479-aa5c-244c6e38af95 with identifier: UY19816
2026-03-27 10:41:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf72fab7-c316-5479-aa5c-244c6e38af95 with scrape type 2
2026-03-27 10:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf72fab7-c316-5479-aa5c-244c6e38af95 with scrape type 2
2026-03-27 10:41:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf72fab7-c316-5479-aa5c-244c6e38af95, identifier: UY19816
2026-03-27 10:41:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003f4510>
2026-03-27 10:41:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d96ab93a-d552-5c2c-9238-406f18cf2b9b/d96ab93a-d552-5c2c-9238-406f18cf2b9b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F49%252F2f494169d95e541e5e018bef243be092%252Fpa%252FSP19687_3044e75697a02ffaadabf9e9ea7433bc.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_3044e75697a02ffaadabf9e9ea7433bc.jpg saved to cache
2026-03-27 10:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d96ab93a-d552-5c2c-9238-406f18cf2b9b
2026-03-27 10:41:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf72fab7-c316-5479-aa5c-244c6e38af95 with identifier: UY19816
2026-03-27 10:41:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf72fab7-c316-5479-aa5c-244c6e38af95 with identifier: UY19816
2026-03-27 10:41:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf72fab7-c316-5479-aa5c-244c6e38af95 with identifier: UY19816 to the API
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:28:22Z',
 'fuel_type': 'hybrid',
 'id': 'bf72fab7-c316-5479-aa5c-244c6e38af95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY19816',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7',
 'odometer': 19391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-30',
 'seller_name': None,
 'title': 'DS Automobiles DS7 1.6 E-Tense Hybrid 4x2 Rivoli',
 'transmission': 'automatic',
 'trim': '4x2 Rivoli',
 'year': 2022}
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY19816%27 HTTP/1.1" 200 None
2026-03-27 10:41:49 [auto1.de] INFO: Saving data for UY19816: {'auction_closing_time': 1774715302.0, 'created_time': 1773775973.304739, 'last_price_update_time': 1774608109.964171}
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY19816') HTTP/1.1" 204 0
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F08%252F4208b7b27af2168e20bc9a21c53695fc%252Fpa%252FNL59666_f056d6d3dab7eab2ab32898f09d6ebc1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_f056d6d3dab7eab2ab32898f09d6ebc1.jpg not downloaded yet
2026-03-27 10:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_1dddfb608ce7f9332a43b9f1bebbda52.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:50 [auto1.de] INFO: Found listing with ID: EJ97789
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ97789%27 HTTP/1.1" 200 None
2026-03-27 10:41:50 [auto1.de] INFO: Scrape type for EJ97789: 2
2026-03-27 10:41:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d212b88-77e7-51df-a6a5-ddfe5688546a with identifier: EJ97789
2026-03-27 10:41:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d212b88-77e7-51df-a6a5-ddfe5688546a with scrape type 2
2026-03-27 10:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d212b88-77e7-51df-a6a5-ddfe5688546a with scrape type 2
2026-03-27 10:41:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d212b88-77e7-51df-a6a5-ddfe5688546a, identifier: EJ97789
2026-03-27 10:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_f669831bf7849029195bbfcd4d488817.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_c0e080b7359cfe6580e556b4f7abb312.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d212b88-77e7-51df-a6a5-ddfe5688546a with identifier: EJ97789
2026-03-27 10:41:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d212b88-77e7-51df-a6a5-ddfe5688546a with identifier: EJ97789
2026-03-27 10:41:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d212b88-77e7-51df-a6a5-ddfe5688546a with identifier: EJ97789 to the API
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:14:38Z',
 'fuel_type': 'diesel',
 'id': '8d212b88-77e7-51df-a6a5-ddfe5688546a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ97789',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 226588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2017}
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ97789%27 HTTP/1.1" 200 None
2026-03-27 10:41:50 [auto1.de] INFO: Saving data for EJ97789: {'auction_closing_time': 1774714478.0, 'created_time': 1773381311.037357, 'last_price_update_time': 1774608110.490244}
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ97789') HTTP/1.1" 204 0
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F08%252F4208b7b27af2168e20bc9a21c53695fc%252Fpa%252FNL59666_1d304093129ce99dd02543cbd3054aa6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_1d304093129ce99dd02543cbd3054aa6.jpg not downloaded yet
2026-03-27 10:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB84550/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003f5750>
2026-03-27 10:41:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5da82e-724a-586e-b7ef-180593adb7e7/ab5da82e-724a-586e-b7ef-180593adb7e7_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F94%252Fc8940cc6caa6d6755816e2c422a26c78%252Fpa%252FNE66332_6f5987b6cef83c6eabf1bfcf2ba75efb.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_6f5987b6cef83c6eabf1bfcf2ba75efb.jpg saved to cache
2026-03-27 10:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab5da82e-724a-586e-b7ef-180593adb7e7
2026-03-27 10:41:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017ec850>
2026-03-27 10:41:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d96ab93a-d552-5c2c-9238-406f18cf2b9b/d96ab93a-d552-5c2c-9238-406f18cf2b9b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F49%252F2f494169d95e541e5e018bef243be092%252Fpa%252FSP19687_41a345559bb242fe5279eb267ae75183.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_41a345559bb242fe5279eb267ae75183.jpg saved to cache
2026-03-27 10:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d96ab93a-d552-5c2c-9238-406f18cf2b9b
2026-03-27 10:41:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500471410>
2026-03-27 10:41:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa13f493-6256-58de-97be-419bd5af40a4/aa13f493-6256-58de-97be-419bd5af40a4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F78%252F767889bc4e35ecdf4eb2de9d4801bcdc%252Fpa%252FDT14163_be0cf815dc46475395663e87dfb124e9.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_be0cf815dc46475395663e87dfb124e9.jpg saved to cache
2026-03-27 10:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa13f493-6256-58de-97be-419bd5af40a4
2026-03-27 10:41:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:50 [auto1.de] INFO: Found listing with ID: SY85938
2026-03-27 10:41:50 [auto1.de] INFO: Found listing with ID: WP81367
2026-03-27 10:41:50 [auto1.de] INFO: Found listing with ID: GU30537
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU30537%27 HTTP/1.1" 200 None
2026-03-27 10:41:50 [auto1.de] INFO: Scrape type for GU30537: 2
2026-03-27 10:41:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77f20a95-fc35-532b-adcb-a222c15e6a67 with identifier: GU30537
2026-03-27 10:41:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77f20a95-fc35-532b-adcb-a222c15e6a67 with scrape type 2
2026-03-27 10:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77f20a95-fc35-532b-adcb-a222c15e6a67 with scrape type 2
2026-03-27 10:41:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77f20a95-fc35-532b-adcb-a222c15e6a67, identifier: GU30537
2026-03-27 10:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HR97485/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77f20a95-fc35-532b-adcb-a222c15e6a67 with identifier: GU30537
2026-03-27 10:41:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77f20a95-fc35-532b-adcb-a222c15e6a67 with identifier: GU30537
2026-03-27 10:41:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77f20a95-fc35-532b-adcb-a222c15e6a67 with identifier: GU30537 to the API
2026-03-27 10:41:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:49:51Z',
 'fuel_type': 'petrol',
 'id': '77f20a95-fc35-532b-adcb-a222c15e6a67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU30537',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 162304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-18',
 'seller_name': None,
 'title': 'Opel Zafira 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2007}
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU30537%27 HTTP/1.1" 200 None
2026-03-27 10:41:51 [auto1.de] INFO: Saving data for GU30537: {'auction_closing_time': 1774716591.0, 'created_time': 1773134912.862582, 'last_price_update_time': 1774608111.220053}
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU30537') HTTP/1.1" 204 0
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F08%252F4208b7b27af2168e20bc9a21c53695fc%252Fpa%252FNL59666_0c530f6904ca4d431b59e93328f0cec0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_0c530f6904ca4d431b59e93328f0cec0.jpg not downloaded yet
2026-03-27 10:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY74387> (referer: https://www.auto1.com/v1/car-details-view/RY74387/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:51 [auto1.de] INFO: Found listing with ID: DU96107
2026-03-27 10:41:51 [auto1.de] INFO: Found listing with ID: VS89530
2026-03-27 10:41:51 [auto1.de] INFO: Found listing with ID: LB66833
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB66833%27 HTTP/1.1" 200 None
2026-03-27 10:41:51 [auto1.de] INFO: Scrape type for LB66833: 2
2026-03-27 10:41:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a6be496-8bbe-51da-98a3-28cae4b041ab with identifier: LB66833
2026-03-27 10:41:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a6be496-8bbe-51da-98a3-28cae4b041ab with scrape type 2
2026-03-27 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a6be496-8bbe-51da-98a3-28cae4b041ab with scrape type 2
2026-03-27 10:41:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a6be496-8bbe-51da-98a3-28cae4b041ab, identifier: LB66833
2026-03-27 10:41:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016301d0>
2026-03-27 10:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa13f493-6256-58de-97be-419bd5af40a4/aa13f493-6256-58de-97be-419bd5af40a4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F78%252F767889bc4e35ecdf4eb2de9d4801bcdc%252Fpa%252FDT14163_1dddfb608ce7f9332a43b9f1bebbda52.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_1dddfb608ce7f9332a43b9f1bebbda52.jpg saved to cache
2026-03-27 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa13f493-6256-58de-97be-419bd5af40a4
2026-03-27 10:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500437590>
2026-03-27 10:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa13f493-6256-58de-97be-419bd5af40a4/aa13f493-6256-58de-97be-419bd5af40a4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F78%252F767889bc4e35ecdf4eb2de9d4801bcdc%252Fpa%252FDT14163_f669831bf7849029195bbfcd4d488817.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_f669831bf7849029195bbfcd4d488817.jpg saved to cache
2026-03-27 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa13f493-6256-58de-97be-419bd5af40a4
2026-03-27 10:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001e8ad0>
2026-03-27 10:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5da82e-724a-586e-b7ef-180593adb7e7/ab5da82e-724a-586e-b7ef-180593adb7e7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F94%252Fc8940cc6caa6d6755816e2c422a26c78%252Fpa%252FNE66332_c0e080b7359cfe6580e556b4f7abb312.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_c0e080b7359cfe6580e556b4f7abb312.jpg saved to cache
2026-03-27 10:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab5da82e-724a-586e-b7ef-180593adb7e7
2026-03-27 10:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_f056d6d3dab7eab2ab32898f09d6ebc1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a6be496-8bbe-51da-98a3-28cae4b041ab with identifier: LB66833
2026-03-27 10:41:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a6be496-8bbe-51da-98a3-28cae4b041ab with identifier: LB66833
2026-03-27 10:41:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a6be496-8bbe-51da-98a3-28cae4b041ab with identifier: LB66833 to the API
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:54:20Z',
 'fuel_type': 'petrol',
 'id': '8a6be496-8bbe-51da-98a3-28cae4b041ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB66833',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 37838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-13',
 'seller_name': None,
 'title': 'Renault Captur 1.0 TCe Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2020}
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB66833%27 HTTP/1.1" 200 None
2026-03-27 10:41:51 [auto1.de] INFO: Saving data for LB66833: {'auction_closing_time': 1774716860.0, 'created_time': 1773772561.424565, 'last_price_update_time': 1774608111.890522}
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB66833') HTTP/1.1" 204 0
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F08%252F4208b7b27af2168e20bc9a21c53695fc%252Fpa%252FNL59666_b8f4bb91c6842dcb41355b3182b359f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_b8f4bb91c6842dcb41355b3182b359f8.jpg not downloaded yet
2026-03-27 10:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_33dabe2e40ee15f5e7e317b744e0f6a7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_c6622c24fea21f7c9621461432ae8d32.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:52 [auto1.de] INFO: Found listing with ID: EJ80862
2026-03-27 10:41:52 [auto1.de] INFO: Found listing with ID: LS10539
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS10539%27 HTTP/1.1" 200 None
2026-03-27 10:41:52 [auto1.de] INFO: Scrape type for LS10539: 2
2026-03-27 10:41:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd95f7bb-756c-55be-993f-8699e40389ea with identifier: LS10539
2026-03-27 10:41:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd95f7bb-756c-55be-993f-8699e40389ea with scrape type 2
2026-03-27 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd95f7bb-756c-55be-993f-8699e40389ea with scrape type 2
2026-03-27 10:41:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd95f7bb-756c-55be-993f-8699e40389ea, identifier: LS10539
2026-03-27 10:41:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd95f7bb-756c-55be-993f-8699e40389ea with identifier: LS10539
2026-03-27 10:41:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd95f7bb-756c-55be-993f-8699e40389ea with identifier: LS10539
2026-03-27 10:41:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd95f7bb-756c-55be-993f-8699e40389ea with identifier: LS10539 to the API
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:28:25Z',
 'fuel_type': 'diesel',
 'id': 'bd95f7bb-756c-55be-993f-8699e40389ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS10539',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 228824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-30',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.9 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2010}
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS10539%27 HTTP/1.1" 200 None
2026-03-27 10:41:52 [auto1.de] INFO: Saving data for LS10539: {'auction_closing_time': 1774715305.0, 'created_time': 1773686158.237784, 'last_price_update_time': 1774608112.562816}
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS10539') HTTP/1.1" 204 0
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F08%252F4208b7b27af2168e20bc9a21c53695fc%252Fpa%252FNL59666_36fd4c4598d53cd110e1e7922af9470a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_36fd4c4598d53cd110e1e7922af9470a.jpg not downloaded yet
2026-03-27 10:41:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89cefb2c-9a32-56da-9cb2-dec0ee44e74f with identifier: RY74387
2026-03-27 10:41:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89cefb2c-9a32-56da-9cb2-dec0ee44e74f with scrape type 1
2026-03-27 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89cefb2c-9a32-56da-9cb2-dec0ee44e74f
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc9%252F3fc986e50d8eef8936587fb5768548af%252Fpa%252FRY74387_fa2dd3d338cd72a4f36b439cb0170c8f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_fa2dd3d338cd72a4f36b439cb0170c8f.jpg not downloaded yet
2026-03-27 10:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_bad8cead68e61d2ffe373dc1cb49f4f1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_cb63fff881bdad45658ff86898617053.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:52 [auto1.de] INFO: Found listing with ID: BP65975
2026-03-27 10:41:52 [auto1.de] INFO: Found listing with ID: PD01129
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD01129%27 HTTP/1.1" 200 None
2026-03-27 10:41:52 [auto1.de] INFO: Scrape type for PD01129: 2
2026-03-27 10:41:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 364104c5-2621-520a-b0b0-e2269758fae5 with identifier: PD01129
2026-03-27 10:41:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 364104c5-2621-520a-b0b0-e2269758fae5 with scrape type 2
2026-03-27 10:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 364104c5-2621-520a-b0b0-e2269758fae5 with scrape type 2
2026-03-27 10:41:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 364104c5-2621-520a-b0b0-e2269758fae5, identifier: PD01129
2026-03-27 10:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XG24427> (referer: https://www.auto1.com/v1/car-details-view/XG24427/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_ac1f3efe227006d991c08c7b3c8f9357.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 364104c5-2621-520a-b0b0-e2269758fae5 with identifier: PD01129
2026-03-27 10:41:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 364104c5-2621-520a-b0b0-e2269758fae5 with identifier: PD01129
2026-03-27 10:41:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 364104c5-2621-520a-b0b0-e2269758fae5 with identifier: PD01129 to the API
2026-03-27 10:41:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:12:05Z',
 'fuel_type': 'diesel',
 'id': '364104c5-2621-520a-b0b0-e2269758fae5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD01129',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 215400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-04',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro Ambition',
 'transmission': 'automatic',
 'trim': 'quattro Ambition',
 'year': 2015}
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD01129%27 HTTP/1.1" 200 None
2026-03-27 10:41:53 [auto1.de] INFO: Saving data for PD01129: {'auction_closing_time': 1774714325.0, 'created_time': 1774293468.080514, 'last_price_update_time': 1774608113.223324}
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD01129') HTTP/1.1" 204 0
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F08%252F4208b7b27af2168e20bc9a21c53695fc%252Fpa%252FNL59666_24a29a0591d604c94e97525a7eeff74a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_24a29a0591d604c94e97525a7eeff74a.jpg not downloaded yet
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc9%252F3fc986e50d8eef8936587fb5768548af%252Fpa%252FRY74387_321b34cf260d2500450b61f7cd610383.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_321b34cf260d2500450b61f7cd610383.jpg not downloaded yet
2026-03-27 10:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016d1b10>
2026-03-27 10:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F08%252F4208b7b27af2168e20bc9a21c53695fc%252Fpa%252FNL59666_f056d6d3dab7eab2ab32898f09d6ebc1.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_f056d6d3dab7eab2ab32898f09d6ebc1.jpg saved to cache
2026-03-27 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-03-27 10:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003c2ed0>
2026-03-27 10:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F08%252F4208b7b27af2168e20bc9a21c53695fc%252Fpa%252FNL59666_33dabe2e40ee15f5e7e317b744e0f6a7.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_33dabe2e40ee15f5e7e317b744e0f6a7.jpg saved to cache
2026-03-27 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-03-27 10:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015cd950>
2026-03-27 10:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F08%252F4208b7b27af2168e20bc9a21c53695fc%252Fpa%252FNL59666_c6622c24fea21f7c9621461432ae8d32.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_c6622c24fea21f7c9621461432ae8d32.jpg saved to cache
2026-03-27 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-03-27 10:41:53 [auto1.de] INFO: Found listing with ID: YS06113
2026-03-27 10:41:53 [auto1.de] INFO: Found listing with ID: SL44411
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL44411%27 HTTP/1.1" 200 None
2026-03-27 10:41:53 [auto1.de] INFO: Scrape type for SL44411: 2
2026-03-27 10:41:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34d1df71-673f-532d-90c4-f7829d23ae38 with identifier: SL44411
2026-03-27 10:41:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34d1df71-673f-532d-90c4-f7829d23ae38 with scrape type 2
2026-03-27 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34d1df71-673f-532d-90c4-f7829d23ae38 with scrape type 2
2026-03-27 10:41:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34d1df71-673f-532d-90c4-f7829d23ae38, identifier: SL44411
2026-03-27 10:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_1d304093129ce99dd02543cbd3054aa6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_0c530f6904ca4d431b59e93328f0cec0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34d1df71-673f-532d-90c4-f7829d23ae38 with identifier: SL44411
2026-03-27 10:41:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34d1df71-673f-532d-90c4-f7829d23ae38 with identifier: SL44411
2026-03-27 10:41:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34d1df71-673f-532d-90c4-f7829d23ae38 with identifier: SL44411 to the API
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:52:44Z',
 'fuel_type': 'petrol',
 'id': '34d1df71-673f-532d-90c4-f7829d23ae38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL44411',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 234069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL44411%27 HTTP/1.1" 200 None
2026-03-27 10:41:53 [auto1.de] INFO: Saving data for SL44411: {'auction_closing_time': 1774716764.0, 'created_time': 1773381763.482062, 'last_price_update_time': 1774608113.894081}
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL44411') HTTP/1.1" 204 0
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F08%252F4208b7b27af2168e20bc9a21c53695fc%252Fpa%252FNL59666_ec1d4f1546272e912f0dc1025cbd894a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_ec1d4f1546272e912f0dc1025cbd894a.jpg not downloaded yet
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc9%252F3fc986e50d8eef8936587fb5768548af%252Fpa%252FRY74387_559f7ae05a64fc588a1d834766748c42.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_559f7ae05a64fc588a1d834766748c42.jpg not downloaded yet
2026-03-27 10:41:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50169af10>
2026-03-27 10:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5da82e-724a-586e-b7ef-180593adb7e7/ab5da82e-724a-586e-b7ef-180593adb7e7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F94%252Fc8940cc6caa6d6755816e2c422a26c78%252Fpa%252FNE66332_bad8cead68e61d2ffe373dc1cb49f4f1.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_bad8cead68e61d2ffe373dc1cb49f4f1.jpg saved to cache
2026-03-27 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab5da82e-724a-586e-b7ef-180593adb7e7
2026-03-27 10:41:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501940a50>
2026-03-27 10:41:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baeb855d-c619-571d-8227-3504a3316b6a/baeb855d-c619-571d-8227-3504a3316b6a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F7f%252F637fa7854170f3d48d6f7a0cfd19cb04%252Fpa%252FLH67751_cb63fff881bdad45658ff86898617053.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_cb63fff881bdad45658ff86898617053.jpg saved to cache
2026-03-27 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item baeb855d-c619-571d-8227-3504a3316b6a
2026-03-27 10:41:54 [auto1.de] INFO: Found listing with ID: ZL98433
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL98433%27 HTTP/1.1" 200 None
2026-03-27 10:41:54 [auto1.de] INFO: Scrape type for ZL98433: 2
2026-03-27 10:41:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe7c6c83-8cea-5593-9025-a8b9a3523c06 with identifier: ZL98433
2026-03-27 10:41:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe7c6c83-8cea-5593-9025-a8b9a3523c06 with scrape type 2
2026-03-27 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe7c6c83-8cea-5593-9025-a8b9a3523c06 with scrape type 2
2026-03-27 10:41:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe7c6c83-8cea-5593-9025-a8b9a3523c06, identifier: ZL98433
2026-03-27 10:41:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe7c6c83-8cea-5593-9025-a8b9a3523c06 with identifier: ZL98433
2026-03-27 10:41:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe7c6c83-8cea-5593-9025-a8b9a3523c06 with identifier: ZL98433
2026-03-27 10:41:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe7c6c83-8cea-5593-9025-a8b9a3523c06 with identifier: ZL98433 to the API
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:05:53Z',
 'fuel_type': 'petrol',
 'id': 'fe7c6c83-8cea-5593-9025-a8b9a3523c06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL98433',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 25456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-23',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TSI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2023}
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL98433%27 HTTP/1.1" 200 None
2026-03-27 10:41:54 [auto1.de] INFO: Saving data for ZL98433: {'auction_closing_time': 1774713953.0, 'created_time': 1774291354.381908, 'last_price_update_time': 1774608114.696875}
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL98433') HTTP/1.1" 204 0
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc9%252F3fc986e50d8eef8936587fb5768548af%252Fpa%252FRY74387_bc021d89e01322c142a4b86ee44d77e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_bc021d89e01322c142a4b86ee44d77e5.jpg not downloaded yet
2026-03-27 10:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_2ef56d3b545481a378f8e2068958c4c5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_5efcb8c1e3abed69d5b01a2ff92c1705.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:54 [auto1.de] INFO: Found listing with ID: VJ30367
2026-03-27 10:41:54 [auto1.de] INFO: Found listing with ID: RE17291
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17291%27 HTTP/1.1" 200 None
2026-03-27 10:41:54 [auto1.de] INFO: Scrape type for RE17291: 2
2026-03-27 10:41:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d325fbd-37b0-5063-80f7-7e252e004c80 with identifier: RE17291
2026-03-27 10:41:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d325fbd-37b0-5063-80f7-7e252e004c80 with scrape type 2
2026-03-27 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d325fbd-37b0-5063-80f7-7e252e004c80 with scrape type 2
2026-03-27 10:41:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d325fbd-37b0-5063-80f7-7e252e004c80, identifier: RE17291
2026-03-27 10:41:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3aea76f-6bbe-50f5-b2e0-c358667c15fa with identifier: XG24427
2026-03-27 10:41:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3aea76f-6bbe-50f5-b2e0-c358667c15fa with scrape type 1
2026-03-27 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3aea76f-6bbe-50f5-b2e0-c358667c15fa
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F71%252Fb47185a0b558a2051a0d6e3efdadae5f%252Fpa%252FXG24427_a16d532c5122c67862635cd034118d94.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_a16d532c5122c67862635cd034118d94.jpg not downloaded yet
2026-03-27 10:41:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001f53d0>
2026-03-27 10:41:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F08%252F4208b7b27af2168e20bc9a21c53695fc%252Fpa%252FNL59666_ac1f3efe227006d991c08c7b3c8f9357.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_ac1f3efe227006d991c08c7b3c8f9357.jpg saved to cache
2026-03-27 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-03-27 10:41:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500594d90>
2026-03-27 10:41:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F08%252F4208b7b27af2168e20bc9a21c53695fc%252Fpa%252FNL59666_1d304093129ce99dd02543cbd3054aa6.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_1d304093129ce99dd02543cbd3054aa6.jpg saved to cache
2026-03-27 10:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-03-27 10:41:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015c6290>
2026-03-27 10:41:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F08%252F4208b7b27af2168e20bc9a21c53695fc%252Fpa%252FNL59666_0c530f6904ca4d431b59e93328f0cec0.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_0c530f6904ca4d431b59e93328f0cec0.jpg saved to cache
2026-03-27 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-03-27 10:41:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d325fbd-37b0-5063-80f7-7e252e004c80 with identifier: RE17291
2026-03-27 10:41:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d325fbd-37b0-5063-80f7-7e252e004c80 with identifier: RE17291
2026-03-27 10:41:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d325fbd-37b0-5063-80f7-7e252e004c80 with identifier: RE17291 to the API
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:02:08Z',
 'fuel_type': 'petrol',
 'id': '9d325fbd-37b0-5063-80f7-7e252e004c80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE17291',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 177698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-27',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2014}
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17291%27 HTTP/1.1" 200 None
2026-03-27 10:41:55 [auto1.de] INFO: Saving data for RE17291: {'auction_closing_time': 1774713728.0, 'created_time': 1773773948.019418, 'last_price_update_time': 1774608115.470757}
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE17291') HTTP/1.1" 204 0
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc9%252F3fc986e50d8eef8936587fb5768548af%252Fpa%252FRY74387_39e3aec6a4fcae152e111c7c2f41f84c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_39e3aec6a4fcae152e111c7c2f41f84c.jpg not downloaded yet
2026-03-27 10:41:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MY92722> (referer: https://www.auto1.com/v1/car-details-view/MY92722/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BJ13428> (referer: https://www.auto1.com/v1/car-details-view/BJ13428/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME89657> (referer: https://www.auto1.com/v1/car-details-view/ME89657/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:55 [auto1.de] INFO: Found listing with ID: JJ95706
2026-03-27 10:41:55 [auto1.de] INFO: Found listing with ID: RJ05854
2026-03-27 10:41:55 [auto1.de] INFO: Found listing with ID: SD97280
2026-03-27 10:41:55 [auto1.de] INFO: Found listing with ID: SG31546
2026-03-27 10:41:55 [auto1.de] INFO: Found listing with ID: HE92439
2026-03-27 10:41:55 [auto1.de] INFO: Found listing with ID: HL98851
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL98851%27 HTTP/1.1" 200 None
2026-03-27 10:41:55 [auto1.de] INFO: Scrape type for HL98851: 2
2026-03-27 10:41:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6323b91-00df-5647-b5e8-8623102b58c4 with identifier: HL98851
2026-03-27 10:41:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6323b91-00df-5647-b5e8-8623102b58c4 with scrape type 2
2026-03-27 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6323b91-00df-5647-b5e8-8623102b58c4 with scrape type 2
2026-03-27 10:41:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6323b91-00df-5647-b5e8-8623102b58c4, identifier: HL98851
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F71%252Fb47185a0b558a2051a0d6e3efdadae5f%252Fpa%252FXG24427_68dfe95472b49c8ecc409afca030b0e6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_68dfe95472b49c8ecc409afca030b0e6.jpg not downloaded yet
2026-03-27 10:41:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZC71941> (referer: https://www.auto1.com/v1/car-details-view/ZC71941/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6323b91-00df-5647-b5e8-8623102b58c4 with identifier: HL98851
2026-03-27 10:41:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6323b91-00df-5647-b5e8-8623102b58c4 with identifier: HL98851
2026-03-27 10:41:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6323b91-00df-5647-b5e8-8623102b58c4 with identifier: HL98851 to the API
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:10:31Z',
 'fuel_type': 'petrol',
 'id': 'a6323b91-00df-5647-b5e8-8623102b58c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL98851',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 102031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-30',
 'seller_name': None,
 'title': 'Dacia Duster 1.6 Delsey 4x4',
 'transmission': 'manual',
 'trim': 'Delsey 4x4',
 'year': 2012}
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL98851%27 HTTP/1.1" 200 None
2026-03-27 10:41:56 [auto1.de] INFO: Saving data for HL98851: {'auction_closing_time': 1774714231.0, 'created_time': 1774293107.489128, 'last_price_update_time': 1774608116.083736}
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL98851') HTTP/1.1" 204 0
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc9%252F3fc986e50d8eef8936587fb5768548af%252Fpa%252FRY74387_1cc4bcfd54ed3e30f2ed1e138fe2754c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_1cc4bcfd54ed3e30f2ed1e138fe2754c.jpg not downloaded yet
2026-03-27 10:41:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50186e710>
2026-03-27 10:41:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d96ab93a-d552-5c2c-9238-406f18cf2b9b/d96ab93a-d552-5c2c-9238-406f18cf2b9b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F49%252F2f494169d95e541e5e018bef243be092%252Fpa%252FSP19687_2ef56d3b545481a378f8e2068958c4c5.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_2ef56d3b545481a378f8e2068958c4c5.jpg saved to cache
2026-03-27 10:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d96ab93a-d552-5c2c-9238-406f18cf2b9b
2026-03-27 10:41:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50035ebd0>
2026-03-27 10:41:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d96ab93a-d552-5c2c-9238-406f18cf2b9b/d96ab93a-d552-5c2c-9238-406f18cf2b9b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F49%252F2f494169d95e541e5e018bef243be092%252Fpa%252FSP19687_5efcb8c1e3abed69d5b01a2ff92c1705.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_5efcb8c1e3abed69d5b01a2ff92c1705.jpg saved to cache
2026-03-27 10:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d96ab93a-d552-5c2c-9238-406f18cf2b9b
2026-03-27 10:41:56 [auto1.de] INFO: Found listing with ID: YT67181
2026-03-27 10:41:56 [auto1.de] INFO: Found listing with ID: VV03695
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV03695%27 HTTP/1.1" 200 None
2026-03-27 10:41:56 [auto1.de] INFO: Scrape type for VV03695: 2
2026-03-27 10:41:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 764d0d0e-80d8-5831-b147-5d81d0335d48 with identifier: VV03695
2026-03-27 10:41:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 764d0d0e-80d8-5831-b147-5d81d0335d48 with scrape type 2
2026-03-27 10:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 764d0d0e-80d8-5831-b147-5d81d0335d48 with scrape type 2
2026-03-27 10:41:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 764d0d0e-80d8-5831-b147-5d81d0335d48, identifier: VV03695
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F71%252Fb47185a0b558a2051a0d6e3efdadae5f%252Fpa%252FXG24427_537739e53cd5f38d4c426caa7f91d2cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_537739e53cd5f38d4c426caa7f91d2cc.jpg not downloaded yet
2026-03-27 10:41:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 764d0d0e-80d8-5831-b147-5d81d0335d48 with identifier: VV03695
2026-03-27 10:41:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 764d0d0e-80d8-5831-b147-5d81d0335d48 with identifier: VV03695
2026-03-27 10:41:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 764d0d0e-80d8-5831-b147-5d81d0335d48 with identifier: VV03695 to the API
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:21:07Z',
 'fuel_type': 'petrol',
 'id': '764d0d0e-80d8-5831-b147-5d81d0335d48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV03695',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 116170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-15',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2012}
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV03695%27 HTTP/1.1" 200 None
2026-03-27 10:41:56 [auto1.de] INFO: Saving data for VV03695: {'auction_closing_time': 1774714867.0, 'created_time': 1773831719.042165, 'last_price_update_time': 1774608116.969892}
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV03695') HTTP/1.1" 204 0
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc9%252F3fc986e50d8eef8936587fb5768548af%252Fpa%252FRY74387_3d6d889e053613e046185cdc48bd7f80.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_3d6d889e053613e046185cdc48bd7f80.jpg not downloaded yet
2026-03-27 10:41:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caa7f59e-3138-5b9a-b132-35704fa2c10d with identifier: MY92722
2026-03-27 10:41:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caa7f59e-3138-5b9a-b132-35704fa2c10d with scrape type 1
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item caa7f59e-3138-5b9a-b132-35704fa2c10d
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9b%252Fdf9bd3b157037f0c9cd13e89772d6e95%252Fpa%252FMY92722_cb540362cac1bbe1104f8168bf10b053.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_cb540362cac1bbe1104f8168bf10b053.jpg not downloaded yet
2026-03-27 10:41:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc47f720-0a2b-59f0-a249-ab17fbc46c7b with identifier: BJ13428
2026-03-27 10:41:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc47f720-0a2b-59f0-a249-ab17fbc46c7b with scrape type 1
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc47f720-0a2b-59f0-a249-ab17fbc46c7b
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F1c%252F6a1ca83bb557168b14f4c98b0d711296%252Fpa%252FBJ13428_502a23a39d69d2acab54360ea3346803.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_502a23a39d69d2acab54360ea3346803.jpg not downloaded yet
2026-03-27 10:41:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a with identifier: ME89657
2026-03-27 10:41:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a with scrape type 1
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee63a8179d6de831c9d3d2594a100%252Fpa%252FME89657_e976ff167bc50c70eb302ed600ecc17c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_e976ff167bc50c70eb302ed600ecc17c.jpg not downloaded yet
2026-03-27 10:41:57 [auto1.de] INFO: Found listing with ID: CD36219
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36219%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [auto1.de] INFO: Scrape type for CD36219: 2
2026-03-27 10:41:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47a2dfd1-58f1-5510-aa50-f467d04c87c5 with identifier: CD36219
2026-03-27 10:41:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47a2dfd1-58f1-5510-aa50-f467d04c87c5 with scrape type 2
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47a2dfd1-58f1-5510-aa50-f467d04c87c5 with scrape type 2
2026-03-27 10:41:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47a2dfd1-58f1-5510-aa50-f467d04c87c5, identifier: CD36219
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F71%252Fb47185a0b558a2051a0d6e3efdadae5f%252Fpa%252FXG24427_006e990975662e7b3dd0cd969c43e921.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_006e990975662e7b3dd0cd969c43e921.jpg not downloaded yet
2026-03-27 10:41:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47a2dfd1-58f1-5510-aa50-f467d04c87c5 with identifier: CD36219
2026-03-27 10:41:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47a2dfd1-58f1-5510-aa50-f467d04c87c5 with identifier: CD36219
2026-03-27 10:41:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47a2dfd1-58f1-5510-aa50-f467d04c87c5 with identifier: CD36219 to the API
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:21:11Z',
 'fuel_type': 'petrol',
 'id': '47a2dfd1-58f1-5510-aa50-f467d04c87c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD36219',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 112948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-20',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2011}
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36219%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [auto1.de] INFO: Saving data for CD36219: {'auction_closing_time': 1774714871.0, 'created_time': 1773382997.07571, 'last_price_update_time': 1774608117.63767}
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD36219') HTTP/1.1" 204 0
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc9%252F3fc986e50d8eef8936587fb5768548af%252Fpa%252FRY74387_81ff52e1f3a00173713513a0969cbf75.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_81ff52e1f3a00173713513a0969cbf75.jpg not downloaded yet
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9b%252Fdf9bd3b157037f0c9cd13e89772d6e95%252Fpa%252FMY92722_38cddca4fcf7b8804619013e6e4dd2d1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_38cddca4fcf7b8804619013e6e4dd2d1.jpg not downloaded yet
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F1c%252F6a1ca83bb557168b14f4c98b0d711296%252Fpa%252FBJ13428_d6938e7750c228bcf538a9524cf5541e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_d6938e7750c228bcf538a9524cf5541e.jpg not downloaded yet
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee63a8179d6de831c9d3d2594a100%252Fpa%252FME89657_f287b7441e14da8757fe0e9be77ae5c1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_f287b7441e14da8757fe0e9be77ae5c1.jpg not downloaded yet
2026-03-27 10:41:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0 with identifier: ZC71941
2026-03-27 10:41:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0 with scrape type 1
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F29%252Fae29526039dad33e76e3a99f5347e51e%252Fpa%252FZC71941_56631e18ccdd8a208524258adfa448ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_56631e18ccdd8a208524258adfa448ea.jpg not downloaded yet
2026-03-27 10:41:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_cc2671f6b490dad99c48c505672d9251.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:57 [auto1.de] INFO: Found listing with ID: RZ61544
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ61544%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [auto1.de] INFO: Scrape type for RZ61544: 1
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F71%252Fb47185a0b558a2051a0d6e3efdadae5f%252Fpa%252FXG24427_a20e52e05c4c81c2e45e304232c23101.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_a20e52e05c4c81c2e45e304232c23101.jpg not downloaded yet
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc9%252F3fc986e50d8eef8936587fb5768548af%252Fpa%252FRY74387_c8052d8bc92ad29e86fb5aa67d68c18d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_c8052d8bc92ad29e86fb5aa67d68c18d.jpg not downloaded yet
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9b%252Fdf9bd3b157037f0c9cd13e89772d6e95%252Fpa%252FMY92722_90c180465f580476f019b8dcf482ee49.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_90c180465f580476f019b8dcf482ee49.jpg not downloaded yet
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F1c%252F6a1ca83bb557168b14f4c98b0d711296%252Fpa%252FBJ13428_9e005b99adce709b9cd0171e898cc68d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_9e005b99adce709b9cd0171e898cc68d.jpg not downloaded yet
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee63a8179d6de831c9d3d2594a100%252Fpa%252FME89657_2bf716de9e5fd73e7e3d5ea8f18e5176.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_2bf716de9e5fd73e7e3d5ea8f18e5176.jpg not downloaded yet
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F29%252Fae29526039dad33e76e3a99f5347e51e%252Fpa%252FZC71941_32f8b5e79a6aafc631d9f0b9c8888c1b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_32f8b5e79a6aafc631d9f0b9c8888c1b.jpg not downloaded yet
2026-03-27 10:41:57 [auto1.de] INFO: Found listing with ID: SL28048
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL28048%27 HTTP/1.1" 200 None
2026-03-27 10:41:57 [auto1.de] INFO: Scrape type for SL28048: 2
2026-03-27 10:41:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb42f229-94a6-52e3-89d6-8ba9c7b2164a with identifier: SL28048
2026-03-27 10:41:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb42f229-94a6-52e3-89d6-8ba9c7b2164a with scrape type 2
2026-03-27 10:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb42f229-94a6-52e3-89d6-8ba9c7b2164a with scrape type 2
2026-03-27 10:41:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb42f229-94a6-52e3-89d6-8ba9c7b2164a, identifier: SL28048
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F71%252Fb47185a0b558a2051a0d6e3efdadae5f%252Fpa%252FXG24427_acfc19dbc745ee0aab6077d6d11cf584.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_acfc19dbc745ee0aab6077d6d11cf584.jpg not downloaded yet
2026-03-27 10:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_bc021d89e01322c142a4b86ee44d77e5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb42f229-94a6-52e3-89d6-8ba9c7b2164a with identifier: SL28048
2026-03-27 10:41:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb42f229-94a6-52e3-89d6-8ba9c7b2164a with identifier: SL28048
2026-03-27 10:41:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb42f229-94a6-52e3-89d6-8ba9c7b2164a with identifier: SL28048 to the API
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:44:17Z',
 'fuel_type': 'petrol',
 'id': 'eb42f229-94a6-52e3-89d6-8ba9c7b2164a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL28048',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 122257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-07',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL28048%27 HTTP/1.1" 200 None
2026-03-27 10:41:58 [auto1.de] INFO: Saving data for SL28048: {'auction_closing_time': 1774716257.0, 'created_time': 1773399707.236227, 'last_price_update_time': 1774608118.414185}
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL28048') HTTP/1.1" 204 0
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc9%252F3fc986e50d8eef8936587fb5768548af%252Fpa%252FRY74387_a7e93442277e62291553a5c23de88f7c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_a7e93442277e62291553a5c23de88f7c.jpg not downloaded yet
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9b%252Fdf9bd3b157037f0c9cd13e89772d6e95%252Fpa%252FMY92722_b11046f6c8b283932e6ae222a75905db.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_b11046f6c8b283932e6ae222a75905db.jpg not downloaded yet
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F1c%252F6a1ca83bb557168b14f4c98b0d711296%252Fpa%252FBJ13428_b7490fe03ced72b76059351d120a6895.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_b7490fe03ced72b76059351d120a6895.jpg not downloaded yet
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee63a8179d6de831c9d3d2594a100%252Fpa%252FME89657_141011daed1d2b838a98fc3b613945f4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_141011daed1d2b838a98fc3b613945f4.jpg not downloaded yet
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F29%252Fae29526039dad33e76e3a99f5347e51e%252Fpa%252FZC71941_29c0f4ffd457b62360ab69d7d2c4c2a8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_29c0f4ffd457b62360ab69d7d2c4c2a8.jpg not downloaded yet
2026-03-27 10:41:58 [auto1.de] INFO: Channel: 24h | Page: 21 | totalHits: 10524 | hits on page: 40
2026-03-27 10:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_39e3aec6a4fcae152e111c7c2f41f84c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_1cc4bcfd54ed3e30f2ed1e138fe2754c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:58 [auto1.de] INFO: Found listing with ID: RV99753
2026-03-27 10:41:58 [auto1.de] INFO: Found listing with ID: FP37093
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F71%252Fb47185a0b558a2051a0d6e3efdadae5f%252Fpa%252FXG24427_3c0db70b2f9721934d5757ef01d2f38a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_3c0db70b2f9721934d5757ef01d2f38a.jpg not downloaded yet
2026-03-27 10:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_68dfe95472b49c8ecc409afca030b0e6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9b%252Fdf9bd3b157037f0c9cd13e89772d6e95%252Fpa%252FMY92722_398e6d01ef916ffc5fdc425b59fd8a99.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_398e6d01ef916ffc5fdc425b59fd8a99.jpg not downloaded yet
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F1c%252F6a1ca83bb557168b14f4c98b0d711296%252Fpa%252FBJ13428_4c79ac28ada5782c12a61a84ee179fa1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_4c79ac28ada5782c12a61a84ee179fa1.jpg not downloaded yet
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee63a8179d6de831c9d3d2594a100%252Fpa%252FME89657_7567a68f3c4907771d441ed91f56323d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_7567a68f3c4907771d441ed91f56323d.jpg not downloaded yet
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F29%252Fae29526039dad33e76e3a99f5347e51e%252Fpa%252FZC71941_5cdc87324074a11c45ea449abebc16f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_5cdc87324074a11c45ea449abebc16f0.jpg not downloaded yet
2026-03-27 10:41:58 [auto1.de] INFO: Found listing with ID: FP37093
2026-03-27 10:41:58 [auto1.de] INFO: Found listing with ID: HT39177
2026-03-27 10:41:58 [auto1.de] INFO: Found listing with ID: FG21922
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG21922%27 HTTP/1.1" 200 None
2026-03-27 10:41:58 [auto1.de] INFO: Scrape type for FG21922: 2
2026-03-27 10:41:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a19041cf-b367-503c-a784-1156b1400523 with identifier: FG21922
2026-03-27 10:41:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a19041cf-b367-503c-a784-1156b1400523 with scrape type 2
2026-03-27 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a19041cf-b367-503c-a784-1156b1400523 with scrape type 2
2026-03-27 10:41:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a19041cf-b367-503c-a784-1156b1400523, identifier: FG21922
2026-03-27 10:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB84550> (referer: https://www.auto1.com/v1/car-details-view/BB84550/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:41:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:41:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:41:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001b8850>
2026-03-27 10:41:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d96ab93a-d552-5c2c-9238-406f18cf2b9b/d96ab93a-d552-5c2c-9238-406f18cf2b9b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F49%252F2f494169d95e541e5e018bef243be092%252Fpa%252FSP19687_cc2671f6b490dad99c48c505672d9251.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_cc2671f6b490dad99c48c505672d9251.jpg saved to cache
2026-03-27 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d96ab93a-d552-5c2c-9238-406f18cf2b9b
2026-03-27 10:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_559f7ae05a64fc588a1d834766748c42.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F71%252Fb47185a0b558a2051a0d6e3efdadae5f%252Fpa%252FXG24427_1c79ad07c14d3fce80041af4c59f9fb5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_1c79ad07c14d3fce80041af4c59f9fb5.jpg not downloaded yet
2026-03-27 10:41:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a19041cf-b367-503c-a784-1156b1400523 with identifier: FG21922
2026-03-27 10:41:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a19041cf-b367-503c-a784-1156b1400523 with identifier: FG21922
2026-03-27 10:41:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a19041cf-b367-503c-a784-1156b1400523 with identifier: FG21922 to the API
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:41:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-28T16:56:59Z',
 'fuel_type': 'petrol',
 'id': 'a19041cf-b367-503c-a784-1156b1400523',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG21922',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 163277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-26',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 500 BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2013}
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG21922%27 HTTP/1.1" 200 None
2026-03-27 10:41:59 [auto1.de] INFO: Saving data for FG21922: {'auction_closing_time': 1774717019.0, 'created_time': 1773428276.187695, 'last_price_update_time': 1774608119.552419}
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG21922') HTTP/1.1" 204 0
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9b%252Fdf9bd3b157037f0c9cd13e89772d6e95%252Fpa%252FMY92722_9f6a57228eae1f602303335d601ed41b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_9f6a57228eae1f602303335d601ed41b.jpg not downloaded yet
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F1c%252F6a1ca83bb557168b14f4c98b0d711296%252Fpa%252FBJ13428_1ac6e9713d473d11330db7603b7f8f53.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_1ac6e9713d473d11330db7603b7f8f53.jpg not downloaded yet
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee63a8179d6de831c9d3d2594a100%252Fpa%252FME89657_b2d1d508c2fc08b0d1587ab1ca260db2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_b2d1d508c2fc08b0d1587ab1ca260db2.jpg not downloaded yet
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F29%252Fae29526039dad33e76e3a99f5347e51e%252Fpa%252FZC71941_e26a37d448b10afcc06101180dbfee26.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_e26a37d448b10afcc06101180dbfee26.jpg not downloaded yet
2026-03-27 10:41:59 [auto1.de] INFO: Found listing with ID: YV93929
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV93929%27 HTTP/1.1" 200 None
2026-03-27 10:41:59 [auto1.de] INFO: Scrape type for YV93929: 2
2026-03-27 10:41:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf83a435-efcc-5fd5-931b-6b7d552a6ed3 with identifier: YV93929
2026-03-27 10:41:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf83a435-efcc-5fd5-931b-6b7d552a6ed3 with scrape type 2
2026-03-27 10:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf83a435-efcc-5fd5-931b-6b7d552a6ed3 with scrape type 2
2026-03-27 10:41:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf83a435-efcc-5fd5-931b-6b7d552a6ed3, identifier: YV93929
2026-03-27 10:41:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:41:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50040cd50>
2026-03-27 10:41:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:41:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cefb2c-9a32-56da-9cb2-dec0ee44e74f/89cefb2c-9a32-56da-9cb2-dec0ee44e74f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc9%252F3fc986e50d8eef8936587fb5768548af%252Fpa%252FRY74387_bc021d89e01322c142a4b86ee44d77e5.jpg') HTTP/1.1" 204 0
2026-03-27 10:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_bc021d89e01322c142a4b86ee44d77e5.jpg saved to cache
2026-03-27 10:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 89cefb2c-9a32-56da-9cb2-dec0ee44e74f
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F71%252Fb47185a0b558a2051a0d6e3efdadae5f%252Fpa%252FXG24427_0441911cd34496bf516297a3ad37e96a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_0441911cd34496bf516297a3ad37e96a.jpg not downloaded yet
2026-03-27 10:41:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf83a435-efcc-5fd5-931b-6b7d552a6ed3 with identifier: YV93929
2026-03-27 10:41:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf83a435-efcc-5fd5-931b-6b7d552a6ed3 with identifier: YV93929
2026-03-27 10:41:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf83a435-efcc-5fd5-931b-6b7d552a6ed3 with identifier: YV93929 to the API
2026-03-27 10:41:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-28T16:02:00Z',
 'fuel_type': 'petrol',
 'id': 'cf83a435-efcc-5fd5-931b-6b7d552a6ed3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV93929',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 106494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-10',
 'seller_name': None,
 'title': 'Ford Focus 2.3 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2019}
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV93929%27 HTTP/1.1" 200 None
2026-03-27 10:42:00 [auto1.de] INFO: Saving data for YV93929: {'auction_closing_time': 1774713720.0, 'created_time': 1773772703.753748, 'last_price_update_time': 1774608120.254383}
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV93929') HTTP/1.1" 204 0
2026-03-27 10:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_fa2dd3d338cd72a4f36b439cb0170c8f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_24a29a0591d604c94e97525a7eeff74a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_321b34cf260d2500450b61f7cd610383.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9b%252Fdf9bd3b157037f0c9cd13e89772d6e95%252Fpa%252FMY92722_d0327312ae10e8db22dcccb77d9606a4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_d0327312ae10e8db22dcccb77d9606a4.jpg not downloaded yet
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F1c%252F6a1ca83bb557168b14f4c98b0d711296%252Fpa%252FBJ13428_4b21d55408663bafd0152ccfa392dbf6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_4b21d55408663bafd0152ccfa392dbf6.jpg not downloaded yet
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee63a8179d6de831c9d3d2594a100%252Fpa%252FME89657_9eb5c5c415022e47b7dc0de8d7a2bbfa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_9eb5c5c415022e47b7dc0de8d7a2bbfa.jpg not downloaded yet
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F29%252Fae29526039dad33e76e3a99f5347e51e%252Fpa%252FZC71941_c5ad14523ca38ca7c4bbb2a388959814.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_c5ad14523ca38ca7c4bbb2a388959814.jpg not downloaded yet
2026-03-27 10:42:00 [auto1.de] INFO: Found listing with ID: BV10728
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV10728%27 HTTP/1.1" 200 None
2026-03-27 10:42:00 [auto1.de] INFO: Scrape type for BV10728: 1
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F71%252Fb47185a0b558a2051a0d6e3efdadae5f%252Fpa%252FXG24427_7860b6a729b38a7bdd430b3b2518ae38.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_7860b6a729b38a7bdd430b3b2518ae38.jpg not downloaded yet
2026-03-27 10:42:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500406450>
2026-03-27 10:42:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cefb2c-9a32-56da-9cb2-dec0ee44e74f/89cefb2c-9a32-56da-9cb2-dec0ee44e74f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc9%252F3fc986e50d8eef8936587fb5768548af%252Fpa%252FRY74387_39e3aec6a4fcae152e111c7c2f41f84c.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_39e3aec6a4fcae152e111c7c2f41f84c.jpg saved to cache
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 89cefb2c-9a32-56da-9cb2-dec0ee44e74f
2026-03-27 10:42:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019714d0>
2026-03-27 10:42:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cefb2c-9a32-56da-9cb2-dec0ee44e74f/89cefb2c-9a32-56da-9cb2-dec0ee44e74f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc9%252F3fc986e50d8eef8936587fb5768548af%252Fpa%252FRY74387_1cc4bcfd54ed3e30f2ed1e138fe2754c.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_1cc4bcfd54ed3e30f2ed1e138fe2754c.jpg saved to cache
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 89cefb2c-9a32-56da-9cb2-dec0ee44e74f
2026-03-27 10:42:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003c0690>
2026-03-27 10:42:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3aea76f-6bbe-50f5-b2e0-c358667c15fa/d3aea76f-6bbe-50f5-b2e0-c358667c15fa_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F71%252Fb47185a0b558a2051a0d6e3efdadae5f%252Fpa%252FXG24427_68dfe95472b49c8ecc409afca030b0e6.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_68dfe95472b49c8ecc409afca030b0e6.jpg saved to cache
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3aea76f-6bbe-50f5-b2e0-c358667c15fa
2026-03-27 10:42:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ee2ffb3-d991-522e-a064-81a9c082e71b with identifier: BB84550
2026-03-27 10:42:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ee2ffb3-d991-522e-a064-81a9c082e71b with scrape type 1
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6ee2ffb3-d991-522e-a064-81a9c082e71b
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0e%252Fb00e5b094d73afab5067aa60017dac63%252Fpa%252FBB84550_be0b643d033c2fe6598ce050aa69c0e6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_be0b643d033c2fe6598ce050aa69c0e6.jpg not downloaded yet
2026-03-27 10:42:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501840d50>
2026-03-27 10:42:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cefb2c-9a32-56da-9cb2-dec0ee44e74f/89cefb2c-9a32-56da-9cb2-dec0ee44e74f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc9%252F3fc986e50d8eef8936587fb5768548af%252Fpa%252FRY74387_559f7ae05a64fc588a1d834766748c42.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_559f7ae05a64fc588a1d834766748c42.jpg saved to cache
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 89cefb2c-9a32-56da-9cb2-dec0ee44e74f
2026-03-27 10:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_e976ff167bc50c70eb302ed600ecc17c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9b%252Fdf9bd3b157037f0c9cd13e89772d6e95%252Fpa%252FMY92722_b45c6184c44938307713c2d834584216.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_b45c6184c44938307713c2d834584216.jpg not downloaded yet
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F1c%252F6a1ca83bb557168b14f4c98b0d711296%252Fpa%252FBJ13428_5e97472585465776e50e8670a4bec7bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_5e97472585465776e50e8670a4bec7bf.jpg not downloaded yet
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee63a8179d6de831c9d3d2594a100%252Fpa%252FME89657_2c51dcb8ee88e64b3b3b4dd416d988b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_2c51dcb8ee88e64b3b3b4dd416d988b5.jpg not downloaded yet
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F29%252Fae29526039dad33e76e3a99f5347e51e%252Fpa%252FZC71941_45f20404c9aaffb816e1e8b586ba356d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_45f20404c9aaffb816e1e8b586ba356d.jpg not downloaded yet
2026-03-27 10:42:00 [auto1.de] INFO: Found listing with ID: WT86563
2026-03-27 10:42:00 [auto1.de] INFO: Found listing with ID: JU52980
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU52980%27 HTTP/1.1" 200 None
2026-03-27 10:42:00 [auto1.de] INFO: Scrape type for JU52980: 2
2026-03-27 10:42:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 950bb0b9-ec6f-505c-9aa3-10fe8a8fa948 with identifier: JU52980
2026-03-27 10:42:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 950bb0b9-ec6f-505c-9aa3-10fe8a8fa948 with scrape type 2
2026-03-27 10:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 950bb0b9-ec6f-505c-9aa3-10fe8a8fa948 with scrape type 2
2026-03-27 10:42:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 950bb0b9-ec6f-505c-9aa3-10fe8a8fa948, identifier: JU52980
2026-03-27 10:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HR97485> (referer: https://www.auto1.com/v1/car-details-view/HR97485/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 950bb0b9-ec6f-505c-9aa3-10fe8a8fa948 with identifier: JU52980
2026-03-27 10:42:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 950bb0b9-ec6f-505c-9aa3-10fe8a8fa948 with identifier: JU52980
2026-03-27 10:42:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 950bb0b9-ec6f-505c-9aa3-10fe8a8fa948 with identifier: JU52980 to the API
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:26:49Z',
 'fuel_type': 'diesel',
 'id': '950bb0b9-ec6f-505c-9aa3-10fe8a8fa948',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU52980',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Fiorino',
 'odometer': 24373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-15',
 'seller_name': None,
 'title': 'Fiat Fiorino 1.3 M-Jet SX',
 'transmission': 'manual',
 'trim': 'SX',
 'year': 2022}
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU52980%27 HTTP/1.1" 200 None
2026-03-27 10:42:01 [auto1.de] INFO: Saving data for JU52980: {'auction_closing_time': 1774715209.0, 'created_time': 1773303993.65365, 'last_price_update_time': 1774608121.501588}
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU52980') HTTP/1.1" 204 0
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0e%252Fb00e5b094d73afab5067aa60017dac63%252Fpa%252FBB84550_ec1e392e440c9b55b9bc8432654351ad.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_ec1e392e440c9b55b9bc8432654351ad.jpg not downloaded yet
2026-03-27 10:42:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_29c0f4ffd457b62360ab69d7d2c4c2a8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9b%252Fdf9bd3b157037f0c9cd13e89772d6e95%252Fpa%252FMY92722_32c183f631844a97d3c711ede9c7a024.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_32c183f631844a97d3c711ede9c7a024.jpg not downloaded yet
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F1c%252F6a1ca83bb557168b14f4c98b0d711296%252Fpa%252FBJ13428_a464e3a5f7d3a7aecb4da8c0690aa20f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_a464e3a5f7d3a7aecb4da8c0690aa20f.jpg not downloaded yet
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee63a8179d6de831c9d3d2594a100%252Fpa%252FME89657_f0e74d5ad39da42a162750360c97a99a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_f0e74d5ad39da42a162750360c97a99a.jpg not downloaded yet
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F29%252Fae29526039dad33e76e3a99f5347e51e%252Fpa%252FZC71941_492f54b2d81702a74f0b8f282f2095dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_492f54b2d81702a74f0b8f282f2095dd.jpg not downloaded yet
2026-03-27 10:42:01 [auto1.de] INFO: Found listing with ID: AJ83009
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ83009%27 HTTP/1.1" 200 None
2026-03-27 10:42:01 [auto1.de] INFO: Scrape type for AJ83009: 1
2026-03-27 10:42:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50172a790>
2026-03-27 10:42:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cefb2c-9a32-56da-9cb2-dec0ee44e74f/89cefb2c-9a32-56da-9cb2-dec0ee44e74f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc9%252F3fc986e50d8eef8936587fb5768548af%252Fpa%252FRY74387_fa2dd3d338cd72a4f36b439cb0170c8f.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_fa2dd3d338cd72a4f36b439cb0170c8f.jpg saved to cache
2026-03-27 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89cefb2c-9a32-56da-9cb2-dec0ee44e74f
2026-03-27 10:42:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500225b90>
2026-03-27 10:42:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F08%252F4208b7b27af2168e20bc9a21c53695fc%252Fpa%252FNL59666_24a29a0591d604c94e97525a7eeff74a.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_24a29a0591d604c94e97525a7eeff74a.jpg saved to cache
2026-03-27 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-03-27 10:42:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501689c90>
2026-03-27 10:42:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cefb2c-9a32-56da-9cb2-dec0ee44e74f/89cefb2c-9a32-56da-9cb2-dec0ee44e74f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc9%252F3fc986e50d8eef8936587fb5768548af%252Fpa%252FRY74387_321b34cf260d2500450b61f7cd610383.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_321b34cf260d2500450b61f7cd610383.jpg saved to cache
2026-03-27 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 89cefb2c-9a32-56da-9cb2-dec0ee44e74f
2026-03-27 10:42:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_141011daed1d2b838a98fc3b613945f4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_56631e18ccdd8a208524258adfa448ea.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_32f8b5e79a6aafc631d9f0b9c8888c1b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0e%252Fb00e5b094d73afab5067aa60017dac63%252Fpa%252FBB84550_3c01c303b59eba74fcb54b6baa35a21c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_3c01c303b59eba74fcb54b6baa35a21c.jpg not downloaded yet
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9b%252Fdf9bd3b157037f0c9cd13e89772d6e95%252Fpa%252FMY92722_44bc9da39f764496a1cd9f372e54abff.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_44bc9da39f764496a1cd9f372e54abff.jpg not downloaded yet
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F1c%252F6a1ca83bb557168b14f4c98b0d711296%252Fpa%252FBJ13428_542b390a0620f4ade5e384337a50608c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_542b390a0620f4ade5e384337a50608c.jpg not downloaded yet
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee63a8179d6de831c9d3d2594a100%252Fpa%252FME89657_218c180f3a240c9299e08c1f31d7bb0d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_218c180f3a240c9299e08c1f31d7bb0d.jpg not downloaded yet
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F29%252Fae29526039dad33e76e3a99f5347e51e%252Fpa%252FZC71941_a3d07f980340f70f4f6337420861fa31.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_a3d07f980340f70f4f6337420861fa31.jpg not downloaded yet
2026-03-27 10:42:02 [auto1.de] INFO: Found listing with ID: EX93586
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX93586%27 HTTP/1.1" 200 None
2026-03-27 10:42:02 [auto1.de] INFO: Scrape type for EX93586: 2
2026-03-27 10:42:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af135d60-e418-55af-b1fa-1f4cb862f2d9 with identifier: EX93586
2026-03-27 10:42:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af135d60-e418-55af-b1fa-1f4cb862f2d9 with scrape type 2
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af135d60-e418-55af-b1fa-1f4cb862f2d9 with scrape type 2
2026-03-27 10:42:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af135d60-e418-55af-b1fa-1f4cb862f2d9, identifier: EX93586
2026-03-27 10:42:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015fe7d0>
2026-03-27 10:42:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca1e339-af0d-51ec-a9c0-bf60c09fb49a/4ca1e339-af0d-51ec-a9c0-bf60c09fb49a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee63a8179d6de831c9d3d2594a100%252Fpa%252FME89657_e976ff167bc50c70eb302ed600ecc17c.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_e976ff167bc50c70eb302ed600ecc17c.jpg saved to cache
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a
2026-03-27 10:42:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb3055c5-de0b-5042-804a-6e47029758da with identifier: HR97485
2026-03-27 10:42:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb3055c5-de0b-5042-804a-6e47029758da with scrape type 1
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb3055c5-de0b-5042-804a-6e47029758da
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Ff1%252F36f1952e749d6231c0c73deaf3862b76%252Fpa%252FHR97485_08de699f471f207938286e66c810d18b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_08de699f471f207938286e66c810d18b.jpg not downloaded yet
2026-03-27 10:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_5cdc87324074a11c45ea449abebc16f0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af135d60-e418-55af-b1fa-1f4cb862f2d9 with identifier: EX93586
2026-03-27 10:42:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af135d60-e418-55af-b1fa-1f4cb862f2d9 with identifier: EX93586
2026-03-27 10:42:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af135d60-e418-55af-b1fa-1f4cb862f2d9 with identifier: EX93586 to the API
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-28T16:22:08Z',
 'fuel_type': 'petrol',
 'id': 'af135d60-e418-55af-b1fa-1f4cb862f2d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX93586',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 85561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-17',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Turbo HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2018}
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX93586%27 HTTP/1.1" 200 None
2026-03-27 10:42:03 [auto1.de] INFO: Saving data for EX93586: {'auction_closing_time': 1774714928.0, 'created_time': 1773383145.111176, 'last_price_update_time': 1774608123.116322}
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX93586') HTTP/1.1" 204 0
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0e%252Fb00e5b094d73afab5067aa60017dac63%252Fpa%252FBB84550_78c4fe4ab944e2b6676f5b3ab172aadd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_78c4fe4ab944e2b6676f5b3ab172aadd.jpg not downloaded yet
2026-03-27 10:42:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50037e290>
2026-03-27 10:42:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0/d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F29%252Fae29526039dad33e76e3a99f5347e51e%252Fpa%252FZC71941_29c0f4ffd457b62360ab69d7d2c4c2a8.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_29c0f4ffd457b62360ab69d7d2c4c2a8.jpg saved to cache
2026-03-27 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0
2026-03-27 10:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_e26a37d448b10afcc06101180dbfee26.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_7567a68f3c4907771d441ed91f56323d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F29%252Fae29526039dad33e76e3a99f5347e51e%252Fpa%252FZC71941_ade7e2eb439476379537166a2947dba8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_ade7e2eb439476379537166a2947dba8.jpg not downloaded yet
2026-03-27 10:42:03 [auto1.de] INFO: Found listing with ID: YH44518
2026-03-27 10:42:03 [auto1.de] INFO: Found listing with ID: TF11415
2026-03-27 10:42:03 [auto1.de] INFO: Found listing with ID: PS26933
2026-03-27 10:42:03 [auto1.de] INFO: Found listing with ID: JB35967
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB35967%27 HTTP/1.1" 200 None
2026-03-27 10:42:03 [auto1.de] INFO: Scrape type for JB35967: 2
2026-03-27 10:42:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53 with identifier: JB35967
2026-03-27 10:42:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53 with scrape type 2
2026-03-27 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53 with scrape type 2
2026-03-27 10:42:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53, identifier: JB35967
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Ff1%252F36f1952e749d6231c0c73deaf3862b76%252Fpa%252FHR97485_653e698f53a86724f99fa3b6498416f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_653e698f53a86724f99fa3b6498416f8.jpg not downloaded yet
2026-03-27 10:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_0441911cd34496bf516297a3ad37e96a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53 with identifier: JB35967
2026-03-27 10:42:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53 with identifier: JB35967
2026-03-27 10:42:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53 with identifier: JB35967 to the API
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:56:58Z',
 'fuel_type': 'diesel',
 'id': '9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB35967',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 102835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-15',
 'seller_name': None,
 'title': 'Volkswagen Beetle 2.0 TDI Design BlueMotion',
 'transmission': 'manual',
 'trim': 'Design BlueMotion',
 'year': 2018}
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB35967%27 HTTP/1.1" 200 None
2026-03-27 10:42:03 [auto1.de] INFO: Saving data for JB35967: {'auction_closing_time': 1774717018.0, 'created_time': 1773427072.237348, 'last_price_update_time': 1774608123.738784}
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB35967') HTTP/1.1" 204 0
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0e%252Fb00e5b094d73afab5067aa60017dac63%252Fpa%252FBB84550_f8b357c02aa157fb82636e5d36e55cd5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_f8b357c02aa157fb82636e5d36e55cd5.jpg not downloaded yet
2026-03-27 10:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d86d0>
2026-03-27 10:42:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca1e339-af0d-51ec-a9c0-bf60c09fb49a/4ca1e339-af0d-51ec-a9c0-bf60c09fb49a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee63a8179d6de831c9d3d2594a100%252Fpa%252FME89657_141011daed1d2b838a98fc3b613945f4.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_141011daed1d2b838a98fc3b613945f4.jpg saved to cache
2026-03-27 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a
2026-03-27 10:42:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501762f10>
2026-03-27 10:42:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0/d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F29%252Fae29526039dad33e76e3a99f5347e51e%252Fpa%252FZC71941_56631e18ccdd8a208524258adfa448ea.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_56631e18ccdd8a208524258adfa448ea.jpg saved to cache
2026-03-27 10:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0
2026-03-27 10:42:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50032f5d0>
2026-03-27 10:42:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0/d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F29%252Fae29526039dad33e76e3a99f5347e51e%252Fpa%252FZC71941_32f8b5e79a6aafc631d9f0b9c8888c1b.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_32f8b5e79a6aafc631d9f0b9c8888c1b.jpg saved to cache
2026-03-27 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0
2026-03-27 10:42:04 [auto1.de] INFO: Found listing with ID: ER78775
2026-03-27 10:42:04 [auto1.de] INFO: Found listing with ID: HB08106
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB08106%27 HTTP/1.1" 200 None
2026-03-27 10:42:04 [auto1.de] INFO: Scrape type for HB08106: 2
2026-03-27 10:42:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704 with identifier: HB08106
2026-03-27 10:42:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704 with scrape type 2
2026-03-27 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704 with scrape type 2
2026-03-27 10:42:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704, identifier: HB08106
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Ff1%252F36f1952e749d6231c0c73deaf3862b76%252Fpa%252FHR97485_9b9c72de0153e6f498c51f51c66c8061.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_9b9c72de0153e6f498c51f51c66c8061.jpg not downloaded yet
2026-03-27 10:42:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_b2d1d508c2fc08b0d1587ab1ca260db2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704 with identifier: HB08106
2026-03-27 10:42:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704 with identifier: HB08106
2026-03-27 10:42:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704 with identifier: HB08106 to the API
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:39:39Z',
 'fuel_type': 'petrol',
 'id': '5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB08106',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 43854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-15',
 'seller_name': None,
 'title': 'BMW 1er 128ti',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB08106%27 HTTP/1.1" 200 None
2026-03-27 10:42:04 [auto1.de] INFO: Saving data for HB08106: {'auction_closing_time': 1774715979.0, 'created_time': 1774291074.517515, 'last_price_update_time': 1774608124.599036}
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB08106') HTTP/1.1" 204 0
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0e%252Fb00e5b094d73afab5067aa60017dac63%252Fpa%252FBB84550_729cc40f0f6a02263d4359b68d5331e9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_729cc40f0f6a02263d4359b68d5331e9.jpg not downloaded yet
2026-03-27 10:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500229f50>
2026-03-27 10:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0/d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F29%252Fae29526039dad33e76e3a99f5347e51e%252Fpa%252FZC71941_5cdc87324074a11c45ea449abebc16f0.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_5cdc87324074a11c45ea449abebc16f0.jpg saved to cache
2026-03-27 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0
2026-03-27 10:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016dcf90>
2026-03-27 10:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0/d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F29%252Fae29526039dad33e76e3a99f5347e51e%252Fpa%252FZC71941_e26a37d448b10afcc06101180dbfee26.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_e26a37d448b10afcc06101180dbfee26.jpg saved to cache
2026-03-27 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0
2026-03-27 10:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003f4e10>
2026-03-27 10:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca1e339-af0d-51ec-a9c0-bf60c09fb49a/4ca1e339-af0d-51ec-a9c0-bf60c09fb49a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee63a8179d6de831c9d3d2594a100%252Fpa%252FME89657_7567a68f3c4907771d441ed91f56323d.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_7567a68f3c4907771d441ed91f56323d.jpg saved to cache
2026-03-27 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a
2026-03-27 10:42:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_45f20404c9aaffb816e1e8b586ba356d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:04 [auto1.de] INFO: Found listing with ID: ZZ59930
2026-03-27 10:42:04 [auto1.de] INFO: Found listing with ID: BP45840
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP45840%27 HTTP/1.1" 200 None
2026-03-27 10:42:04 [auto1.de] INFO: Scrape type for BP45840: 2
2026-03-27 10:42:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cac7daf9-4f1f-581d-9946-7adb467dc4e5 with identifier: BP45840
2026-03-27 10:42:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cac7daf9-4f1f-581d-9946-7adb467dc4e5 with scrape type 2
2026-03-27 10:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cac7daf9-4f1f-581d-9946-7adb467dc4e5 with scrape type 2
2026-03-27 10:42:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cac7daf9-4f1f-581d-9946-7adb467dc4e5, identifier: BP45840
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Ff1%252F36f1952e749d6231c0c73deaf3862b76%252Fpa%252FHR97485_428c3ab86f20859be3a11385ee4576ad.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_428c3ab86f20859be3a11385ee4576ad.jpg not downloaded yet
2026-03-27 10:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500236c10>
2026-03-27 10:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3aea76f-6bbe-50f5-b2e0-c358667c15fa/d3aea76f-6bbe-50f5-b2e0-c358667c15fa_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F71%252Fb47185a0b558a2051a0d6e3efdadae5f%252Fpa%252FXG24427_0441911cd34496bf516297a3ad37e96a.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_0441911cd34496bf516297a3ad37e96a.jpg saved to cache
2026-03-27 10:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3aea76f-6bbe-50f5-b2e0-c358667c15fa
2026-03-27 10:42:05 [auto1.de] INFO: Channel: 24h | Page: 22 | totalHits: 10525 | hits on page: 40
2026-03-27 10:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_2c51dcb8ee88e64b3b3b4dd416d988b5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_ec1e392e440c9b55b9bc8432654351ad.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cac7daf9-4f1f-581d-9946-7adb467dc4e5 with identifier: BP45840
2026-03-27 10:42:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cac7daf9-4f1f-581d-9946-7adb467dc4e5 with identifier: BP45840
2026-03-27 10:42:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cac7daf9-4f1f-581d-9946-7adb467dc4e5 with identifier: BP45840 to the API
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:59:41Z',
 'fuel_type': 'petrol',
 'id': 'cac7daf9-4f1f-581d-9946-7adb467dc4e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP45840',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 161583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-16',
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2019}
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP45840%27 HTTP/1.1" 200 None
2026-03-27 10:42:05 [auto1.de] INFO: Saving data for BP45840: {'auction_closing_time': 1774717181.0, 'created_time': 1773304994.395862, 'last_price_update_time': 1774608125.424476}
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP45840') HTTP/1.1" 204 0
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0e%252Fb00e5b094d73afab5067aa60017dac63%252Fpa%252FBB84550_cb9942f3c65d5d43745b9cb8cb589b02.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_cb9942f3c65d5d43745b9cb8cb589b02.jpg not downloaded yet
2026-03-27 10:42:05 [auto1.de] INFO: Found listing with ID: NM34350
2026-03-27 10:42:05 [auto1.de] INFO: Found listing with ID: FZ89308
2026-03-27 10:42:05 [auto1.de] INFO: Found listing with ID: CE41516
2026-03-27 10:42:05 [auto1.de] INFO: Found listing with ID: TT79830
2026-03-27 10:42:05 [auto1.de] INFO: Found listing with ID: EP39271
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP39271%27 HTTP/1.1" 200 None
2026-03-27 10:42:05 [auto1.de] INFO: Scrape type for EP39271: 2
2026-03-27 10:42:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f25a1eae-a566-552b-9c2b-1e095580e88b with identifier: EP39271
2026-03-27 10:42:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f25a1eae-a566-552b-9c2b-1e095580e88b with scrape type 2
2026-03-27 10:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f25a1eae-a566-552b-9c2b-1e095580e88b with scrape type 2
2026-03-27 10:42:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f25a1eae-a566-552b-9c2b-1e095580e88b, identifier: EP39271
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Ff1%252F36f1952e749d6231c0c73deaf3862b76%252Fpa%252FHR97485_a8d713a62ee4d7d303c9fd9c14929553.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_a8d713a62ee4d7d303c9fd9c14929553.jpg not downloaded yet
2026-03-27 10:42:05 [auto1.de] INFO: Found listing with ID: CH61883
2026-03-27 10:42:05 [auto1.de] INFO: Found listing with ID: AJ71122
2026-03-27 10:42:05 [auto1.de] INFO: Found listing with ID: DK64287
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK64287%27 HTTP/1.1" 200 None
2026-03-27 10:42:05 [auto1.de] INFO: Scrape type for DK64287: 2
2026-03-27 10:42:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d0ae62d-2e3f-5e99-891c-05aaaed55274 with identifier: DK64287
2026-03-27 10:42:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d0ae62d-2e3f-5e99-891c-05aaaed55274 with scrape type 2
2026-03-27 10:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d0ae62d-2e3f-5e99-891c-05aaaed55274 with scrape type 2
2026-03-27 10:42:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d0ae62d-2e3f-5e99-891c-05aaaed55274, identifier: DK64287
2026-03-27 10:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BV10728/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016dfb90>
2026-03-27 10:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca1e339-af0d-51ec-a9c0-bf60c09fb49a/4ca1e339-af0d-51ec-a9c0-bf60c09fb49a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee63a8179d6de831c9d3d2594a100%252Fpa%252FME89657_b2d1d508c2fc08b0d1587ab1ca260db2.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_b2d1d508c2fc08b0d1587ab1ca260db2.jpg saved to cache
2026-03-27 10:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a
2026-03-27 10:42:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f25a1eae-a566-552b-9c2b-1e095580e88b with identifier: EP39271
2026-03-27 10:42:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f25a1eae-a566-552b-9c2b-1e095580e88b with identifier: EP39271
2026-03-27 10:42:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f25a1eae-a566-552b-9c2b-1e095580e88b with identifier: EP39271 to the API
2026-03-27 10:42:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 260,
 'expiration_date': '2026-03-28T16:03:02Z',
 'fuel_type': 'petrol',
 'id': 'f25a1eae-a566-552b-9c2b-1e095580e88b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP39271',
 'listing': 'auction',
 'make': 'Dodge',
 'model': 'Nitro',
 'odometer': 60711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-30',
 'seller_name': None,
 'title': 'Dodge Nitro 4.0 V6 R/T',
 'transmission': 'automatic',
 'trim': 'R/T',
 'year': 2017}
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP39271%27 HTTP/1.1" 200 None
2026-03-27 10:42:06 [auto1.de] INFO: Saving data for EP39271: {'auction_closing_time': 1774713782.0, 'created_time': 1774263221.629681, 'last_price_update_time': 1774608126.130951}
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP39271') HTTP/1.1" 204 0
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0e%252Fb00e5b094d73afab5067aa60017dac63%252Fpa%252FBB84550_8b7c75aa62cbf62c83ac4ce79012a93f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_8b7c75aa62cbf62c83ac4ce79012a93f.jpg not downloaded yet
2026-03-27 10:42:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d0ae62d-2e3f-5e99-891c-05aaaed55274 with identifier: DK64287
2026-03-27 10:42:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d0ae62d-2e3f-5e99-891c-05aaaed55274 with identifier: DK64287
2026-03-27 10:42:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d0ae62d-2e3f-5e99-891c-05aaaed55274 with identifier: DK64287 to the API
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:34:09Z',
 'fuel_type': 'diesel',
 'id': '9d0ae62d-2e3f-5e99-891c-05aaaed55274',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK64287',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 155870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-26',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambition 4x4',
 'transmission': 'automatic',
 'trim': 'Ambition 4x4',
 'year': 2017}
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK64287%27 HTTP/1.1" 200 None
2026-03-27 10:42:06 [auto1.de] INFO: Saving data for DK64287: {'auction_closing_time': 1774715649.0, 'created_time': 1773775604.571182, 'last_price_update_time': 1774608126.778463}
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK64287') HTTP/1.1" 204 0
2026-03-27 10:42:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501768e50>
2026-03-27 10:42:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0/d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F29%252Fae29526039dad33e76e3a99f5347e51e%252Fpa%252FZC71941_45f20404c9aaffb816e1e8b586ba356d.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_45f20404c9aaffb816e1e8b586ba356d.jpg saved to cache
2026-03-27 10:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0
2026-03-27 10:42:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_78c4fe4ab944e2b6676f5b3ab172aadd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_5e97472585465776e50e8670a4bec7bf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_b45c6184c44938307713c2d834584216.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:06 [auto1.de] INFO: Found listing with ID: GM12066
2026-03-27 10:42:06 [auto1.de] INFO: Found listing with ID: EC74122
2026-03-27 10:42:06 [auto1.de] INFO: Found listing with ID: LH09734
2026-03-27 10:42:06 [auto1.de] INFO: Found listing with ID: YE66083
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE66083%27 HTTP/1.1" 200 None
2026-03-27 10:42:06 [auto1.de] INFO: Scrape type for YE66083: 2
2026-03-27 10:42:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87da8ecd-f582-5461-a39b-0520f7579417 with identifier: YE66083
2026-03-27 10:42:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87da8ecd-f582-5461-a39b-0520f7579417 with scrape type 2
2026-03-27 10:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87da8ecd-f582-5461-a39b-0520f7579417 with scrape type 2
2026-03-27 10:42:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87da8ecd-f582-5461-a39b-0520f7579417, identifier: YE66083
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Ff1%252F36f1952e749d6231c0c73deaf3862b76%252Fpa%252FHR97485_d490e7cdee25bff998988ffd9ab12799.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_d490e7cdee25bff998988ffd9ab12799.jpg not downloaded yet
2026-03-27 10:42:06 [auto1.de] INFO: Found listing with ID: SV69616
2026-03-27 10:42:06 [auto1.de] INFO: Found listing with ID: DF45808
2026-03-27 10:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF45808%27 HTTP/1.1" 200 None
2026-03-27 10:42:07 [auto1.de] INFO: Scrape type for DF45808: 2
2026-03-27 10:42:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 875dfa3d-a4a6-527f-be7f-46ae90a5ed3f with identifier: DF45808
2026-03-27 10:42:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 875dfa3d-a4a6-527f-be7f-46ae90a5ed3f with scrape type 2
2026-03-27 10:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 875dfa3d-a4a6-527f-be7f-46ae90a5ed3f with scrape type 2
2026-03-27 10:42:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 875dfa3d-a4a6-527f-be7f-46ae90a5ed3f, identifier: DF45808
2026-03-27 10:42:07 [scrapy.extensions.logstats] INFO: Crawled 303 pages (at 45 pages/min), scraped 320 items (at 75 items/min)
2026-03-27 10:42:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 10:42:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87da8ecd-f582-5461-a39b-0520f7579417 with identifier: YE66083
2026-03-27 10:42:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87da8ecd-f582-5461-a39b-0520f7579417 with identifier: YE66083
2026-03-27 10:42:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87da8ecd-f582-5461-a39b-0520f7579417 with identifier: YE66083 to the API
2026-03-27 10:42:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:26:36Z',
 'fuel_type': 'hybrid',
 'id': '87da8ecd-f582-5461-a39b-0520f7579417',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE66083',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 45331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-15',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300e T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2023}
2026-03-27 10:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE66083%27 HTTP/1.1" 200 None
2026-03-27 10:42:07 [auto1.de] INFO: Saving data for YE66083: {'auction_closing_time': 1774715196.0, 'created_time': 1773775921.971273, 'last_price_update_time': 1774608127.745031}
2026-03-27 10:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE66083') HTTP/1.1" 204 0
2026-03-27 10:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0e%252Fb00e5b094d73afab5067aa60017dac63%252Fpa%252FBB84550_b33a76c2ec1b0bf962fa0eb3379fce98.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_b33a76c2ec1b0bf962fa0eb3379fce98.jpg not downloaded yet
2026-03-27 10:42:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 875dfa3d-a4a6-527f-be7f-46ae90a5ed3f with identifier: DF45808
2026-03-27 10:42:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 875dfa3d-a4a6-527f-be7f-46ae90a5ed3f with identifier: DF45808
2026-03-27 10:42:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 875dfa3d-a4a6-527f-be7f-46ae90a5ed3f with identifier: DF45808 to the API
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:49:25Z',
 'fuel_type': 'diesel',
 'id': '875dfa3d-a4a6-527f-be7f-46ae90a5ed3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF45808',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 272344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-06',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI R-Line Edition',
 'transmission': 'automatic',
 'trim': 'R-Line Edition',
 'year': 2009}
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF45808%27 HTTP/1.1" 200 None
2026-03-27 10:42:08 [auto1.de] INFO: Saving data for DF45808: {'auction_closing_time': 1774716565.0, 'created_time': 1773401295.068261, 'last_price_update_time': 1774608128.527438}
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF45808') HTTP/1.1" 204 0
2026-03-27 10:42:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501959f10>
2026-03-27 10:42:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca1e339-af0d-51ec-a9c0-bf60c09fb49a/4ca1e339-af0d-51ec-a9c0-bf60c09fb49a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee63a8179d6de831c9d3d2594a100%252Fpa%252FME89657_2c51dcb8ee88e64b3b3b4dd416d988b5.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_2c51dcb8ee88e64b3b3b4dd416d988b5.jpg saved to cache
2026-03-27 10:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a
2026-03-27 10:42:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50039a610>
2026-03-27 10:42:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ee2ffb3-d991-522e-a064-81a9c082e71b/6ee2ffb3-d991-522e-a064-81a9c082e71b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0e%252Fb00e5b094d73afab5067aa60017dac63%252Fpa%252FBB84550_ec1e392e440c9b55b9bc8432654351ad.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_ec1e392e440c9b55b9bc8432654351ad.jpg saved to cache
2026-03-27 10:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ee2ffb3-d991-522e-a064-81a9c082e71b
2026-03-27 10:42:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_b8f4bb91c6842dcb41355b3182b359f8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:08 [auto1.de] INFO: Found listing with ID: VE65204
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE65204%27 HTTP/1.1" 200 None
2026-03-27 10:42:08 [auto1.de] INFO: Scrape type for VE65204: 2
2026-03-27 10:42:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae377aab-f6b2-5016-a441-7a4a9e9d7d37 with identifier: VE65204
2026-03-27 10:42:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae377aab-f6b2-5016-a441-7a4a9e9d7d37 with scrape type 2
2026-03-27 10:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae377aab-f6b2-5016-a441-7a4a9e9d7d37 with scrape type 2
2026-03-27 10:42:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae377aab-f6b2-5016-a441-7a4a9e9d7d37, identifier: VE65204
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Ff1%252F36f1952e749d6231c0c73deaf3862b76%252Fpa%252FHR97485_dd5872264f45a37b342c5f3db4aa2a84.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_dd5872264f45a37b342c5f3db4aa2a84.jpg not downloaded yet
2026-03-27 10:42:08 [auto1.de] INFO: Found listing with ID: ZN63350
2026-03-27 10:42:08 [auto1.de] INFO: Found listing with ID: WD52714
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD52714%27 HTTP/1.1" 200 None
2026-03-27 10:42:08 [auto1.de] INFO: Scrape type for WD52714: 1
2026-03-27 10:42:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae377aab-f6b2-5016-a441-7a4a9e9d7d37 with identifier: VE65204
2026-03-27 10:42:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae377aab-f6b2-5016-a441-7a4a9e9d7d37 with identifier: VE65204
2026-03-27 10:42:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae377aab-f6b2-5016-a441-7a4a9e9d7d37 with identifier: VE65204 to the API
2026-03-27 10:42:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:45:20Z',
 'fuel_type': 'diesel',
 'id': 'ae377aab-f6b2-5016-a441-7a4a9e9d7d37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE65204',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 134735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-31',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2018}
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE65204%27 HTTP/1.1" 200 None
2026-03-27 10:42:09 [auto1.de] INFO: Saving data for VE65204: {'auction_closing_time': 1774716320.0, 'created_time': 1774263232.331561, 'last_price_update_time': 1774608129.130386}
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE65204') HTTP/1.1" 204 0
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0e%252Fb00e5b094d73afab5067aa60017dac63%252Fpa%252FBB84550_ec682dfd80a23436a6a61e2c3cd6f5dc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_ec682dfd80a23436a6a61e2c3cd6f5dc.jpg not downloaded yet
2026-03-27 10:42:09 [auto1.de] INFO: Found listing with ID: KU58060
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU58060%27 HTTP/1.1" 200 None
2026-03-27 10:42:09 [auto1.de] INFO: Scrape type for KU58060: 2
2026-03-27 10:42:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbfca0e1-a683-53be-bb8a-c3faa05ff005 with identifier: KU58060
2026-03-27 10:42:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbfca0e1-a683-53be-bb8a-c3faa05ff005 with scrape type 2
2026-03-27 10:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbfca0e1-a683-53be-bb8a-c3faa05ff005 with scrape type 2
2026-03-27 10:42:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbfca0e1-a683-53be-bb8a-c3faa05ff005, identifier: KU58060
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Ff1%252F36f1952e749d6231c0c73deaf3862b76%252Fpa%252FHR97485_8e1dbb780ca7b373044c67874ded7a48.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_8e1dbb780ca7b373044c67874ded7a48.jpg not downloaded yet
2026-03-27 10:42:09 [auto1.de] INFO: Found listing with ID: DY67323
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY67323%27 HTTP/1.1" 200 None
2026-03-27 10:42:09 [auto1.de] INFO: Scrape type for DY67323: 2
2026-03-27 10:42:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccfb5977-0cd9-5059-94f2-2521608a8435 with identifier: DY67323
2026-03-27 10:42:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccfb5977-0cd9-5059-94f2-2521608a8435 with scrape type 2
2026-03-27 10:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccfb5977-0cd9-5059-94f2-2521608a8435 with scrape type 2
2026-03-27 10:42:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccfb5977-0cd9-5059-94f2-2521608a8435, identifier: DY67323
2026-03-27 10:42:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002c9b90>
2026-03-27 10:42:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ee2ffb3-d991-522e-a064-81a9c082e71b/6ee2ffb3-d991-522e-a064-81a9c082e71b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0e%252Fb00e5b094d73afab5067aa60017dac63%252Fpa%252FBB84550_78c4fe4ab944e2b6676f5b3ab172aadd.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_78c4fe4ab944e2b6676f5b3ab172aadd.jpg saved to cache
2026-03-27 10:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ee2ffb3-d991-522e-a064-81a9c082e71b
2026-03-27 10:42:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002235d0>
2026-03-27 10:42:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc47f720-0a2b-59f0-a249-ab17fbc46c7b/dc47f720-0a2b-59f0-a249-ab17fbc46c7b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F1c%252F6a1ca83bb557168b14f4c98b0d711296%252Fpa%252FBJ13428_5e97472585465776e50e8670a4bec7bf.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_5e97472585465776e50e8670a4bec7bf.jpg saved to cache
2026-03-27 10:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc47f720-0a2b-59f0-a249-ab17fbc46c7b
2026-03-27 10:42:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500317c50>
2026-03-27 10:42:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caa7f59e-3138-5b9a-b132-35704fa2c10d/caa7f59e-3138-5b9a-b132-35704fa2c10d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9b%252Fdf9bd3b157037f0c9cd13e89772d6e95%252Fpa%252FMY92722_b45c6184c44938307713c2d834584216.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_b45c6184c44938307713c2d834584216.jpg saved to cache
2026-03-27 10:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item caa7f59e-3138-5b9a-b132-35704fa2c10d
2026-03-27 10:42:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_a3d07f980340f70f4f6337420861fa31.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_08de699f471f207938286e66c810d18b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbfca0e1-a683-53be-bb8a-c3faa05ff005 with identifier: KU58060
2026-03-27 10:42:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbfca0e1-a683-53be-bb8a-c3faa05ff005 with identifier: KU58060
2026-03-27 10:42:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbfca0e1-a683-53be-bb8a-c3faa05ff005 with identifier: KU58060 to the API
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:53:17Z',
 'fuel_type': 'petrol',
 'id': 'fbfca0e1-a683-53be-bb8a-c3faa05ff005',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU58060',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 38446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-22',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 TSI Edition 20 4Motion',
 'transmission': 'automatic',
 'trim': 'Edition 20 4Motion',
 'year': 2022}
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU58060%27 HTTP/1.1" 200 None
2026-03-27 10:42:10 [auto1.de] INFO: Saving data for KU58060: {'auction_closing_time': 1774716797.0, 'created_time': 1773773986.817217, 'last_price_update_time': 1774608130.084466}
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU58060') HTTP/1.1" 204 0
2026-03-27 10:42:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccfb5977-0cd9-5059-94f2-2521608a8435 with identifier: DY67323
2026-03-27 10:42:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccfb5977-0cd9-5059-94f2-2521608a8435 with identifier: DY67323
2026-03-27 10:42:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccfb5977-0cd9-5059-94f2-2521608a8435 with identifier: DY67323 to the API
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:42:21Z',
 'fuel_type': 'hybrid',
 'id': 'ccfb5977-0cd9-5059-94f2-2521608a8435',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY67323',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 57125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-28',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSIe',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY67323%27 HTTP/1.1" 200 None
2026-03-27 10:42:10 [auto1.de] INFO: Saving data for DY67323: {'auction_closing_time': 1774716141.0, 'created_time': 1773133804.462022, 'last_price_update_time': 1774608130.462063}
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY67323') HTTP/1.1" 204 0
2026-03-27 10:42:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_653e698f53a86724f99fa3b6498416f8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:10 [auto1.de] INFO: Found listing with ID: WV16405
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV16405%27 HTTP/1.1" 200 None
2026-03-27 10:42:10 [auto1.de] INFO: Scrape type for WV16405: 2
2026-03-27 10:42:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9ea9934-f283-5868-8c91-7b56cdd1fd6a with identifier: WV16405
2026-03-27 10:42:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9ea9934-f283-5868-8c91-7b56cdd1fd6a with scrape type 2
2026-03-27 10:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9ea9934-f283-5868-8c91-7b56cdd1fd6a with scrape type 2
2026-03-27 10:42:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9ea9934-f283-5868-8c91-7b56cdd1fd6a, identifier: WV16405
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Ff1%252F36f1952e749d6231c0c73deaf3862b76%252Fpa%252FHR97485_4e964b3c8419caebf2943d247143aadd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_4e964b3c8419caebf2943d247143aadd.jpg not downloaded yet
2026-03-27 10:42:10 [auto1.de] INFO: Found listing with ID: GV91046
2026-03-27 10:42:10 [auto1.de] INFO: Found listing with ID: CW59742
2026-03-27 10:42:10 [auto1.de] INFO: Found listing with ID: LK48428
2026-03-27 10:42:10 [auto1.de] INFO: Found listing with ID: WP61796
2026-03-27 10:42:10 [auto1.de] INFO: Found listing with ID: HM04457
2026-03-27 10:42:10 [auto1.de] INFO: Found listing with ID: DE42625
2026-03-27 10:42:10 [auto1.de] INFO: Found listing with ID: AX24898
2026-03-27 10:42:10 [auto1.de] INFO: Found listing with ID: FA59135
2026-03-27 10:42:10 [auto1.de] INFO: Found listing with ID: MU44330
2026-03-27 10:42:10 [auto1.de] INFO: Found listing with ID: NF75522
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF75522%27 HTTP/1.1" 200 None
2026-03-27 10:42:10 [auto1.de] INFO: Scrape type for NF75522: 2
2026-03-27 10:42:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3238025c-6061-5233-9191-0baaae62f2c3 with identifier: NF75522
2026-03-27 10:42:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3238025c-6061-5233-9191-0baaae62f2c3 with scrape type 2
2026-03-27 10:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3238025c-6061-5233-9191-0baaae62f2c3 with scrape type 2
2026-03-27 10:42:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3238025c-6061-5233-9191-0baaae62f2c3, identifier: NF75522
2026-03-27 10:42:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:42:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501762b10>
2026-03-27 10:42:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F08%252F4208b7b27af2168e20bc9a21c53695fc%252Fpa%252FNL59666_b8f4bb91c6842dcb41355b3182b359f8.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_b8f4bb91c6842dcb41355b3182b359f8.jpg saved to cache
2026-03-27 10:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-03-27 10:42:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9ea9934-f283-5868-8c91-7b56cdd1fd6a with identifier: WV16405
2026-03-27 10:42:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9ea9934-f283-5868-8c91-7b56cdd1fd6a with identifier: WV16405
2026-03-27 10:42:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9ea9934-f283-5868-8c91-7b56cdd1fd6a with identifier: WV16405 to the API
2026-03-27 10:42:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:24:35Z',
 'fuel_type': 'diesel',
 'id': 'a9ea9934-f283-5868-8c91-7b56cdd1fd6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV16405',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 128224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-11',
 'seller_name': None,
 'title': 'BMW 3er 320d Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2019}
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV16405%27 HTTP/1.1" 200 None
2026-03-27 10:42:11 [auto1.de] INFO: Saving data for WV16405: {'auction_closing_time': 1774715075.0, 'created_time': 1773859008.536862, 'last_price_update_time': 1774608131.211781}
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV16405') HTTP/1.1" 204 0
2026-03-27 10:42:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3238025c-6061-5233-9191-0baaae62f2c3 with identifier: NF75522
2026-03-27 10:42:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3238025c-6061-5233-9191-0baaae62f2c3 with identifier: NF75522
2026-03-27 10:42:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3238025c-6061-5233-9191-0baaae62f2c3 with identifier: NF75522 to the API
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-28T16:12:49Z',
 'fuel_type': 'diesel',
 'id': '3238025c-6061-5233-9191-0baaae62f2c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF75522',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 72616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-24',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2019}
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF75522%27 HTTP/1.1" 200 None
2026-03-27 10:42:11 [auto1.de] INFO: Saving data for NF75522: {'auction_closing_time': 1774714369.0, 'created_time': 1774264606.462797, 'last_price_update_time': 1774608131.67533}
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF75522') HTTP/1.1" 204 0
2026-03-27 10:42:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_729cc40f0f6a02263d4359b68d5331e9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:11 [auto1.de] INFO: Found listing with ID: VJ38627
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ38627%27 HTTP/1.1" 200 None
2026-03-27 10:42:11 [auto1.de] INFO: Scrape type for VJ38627: 2
2026-03-27 10:42:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a with identifier: VJ38627
2026-03-27 10:42:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a with scrape type 2
2026-03-27 10:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a with scrape type 2
2026-03-27 10:42:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a, identifier: VJ38627
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Ff1%252F36f1952e749d6231c0c73deaf3862b76%252Fpa%252FHR97485_9cf3331f63fd31e9d96fa7276397dbe2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_9cf3331f63fd31e9d96fa7276397dbe2.jpg not downloaded yet
2026-03-27 10:42:11 [auto1.de] INFO: Found listing with ID: EJ83325
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ83325%27 HTTP/1.1" 200 None
2026-03-27 10:42:11 [auto1.de] INFO: Scrape type for EJ83325: 1
2026-03-27 10:42:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50032dbd0>
2026-03-27 10:42:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0/d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F29%252Fae29526039dad33e76e3a99f5347e51e%252Fpa%252FZC71941_a3d07f980340f70f4f6337420861fa31.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_a3d07f980340f70f4f6337420861fa31.jpg saved to cache
2026-03-27 10:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0
2026-03-27 10:42:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500453050>
2026-03-27 10:42:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb3055c5-de0b-5042-804a-6e47029758da/bb3055c5-de0b-5042-804a-6e47029758da_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Ff1%252F36f1952e749d6231c0c73deaf3862b76%252Fpa%252FHR97485_08de699f471f207938286e66c810d18b.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_08de699f471f207938286e66c810d18b.jpg saved to cache
2026-03-27 10:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb3055c5-de0b-5042-804a-6e47029758da
2026-03-27 10:42:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_9b9c72de0153e6f498c51f51c66c8061.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a with identifier: VJ38627
2026-03-27 10:42:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a with identifier: VJ38627
2026-03-27 10:42:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a with identifier: VJ38627 to the API
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-28T16:54:42Z',
 'fuel_type': 'hybrid',
 'id': '00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ38627',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 161252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-02',
 'seller_name': None,
 'title': 'Audi Q5 50 TFSIe quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ38627%27 HTTP/1.1" 200 None
2026-03-27 10:42:12 [auto1.de] INFO: Saving data for VJ38627: {'auction_closing_time': 1774716882.0, 'created_time': 1773772524.461254, 'last_price_update_time': 1774608132.390728}
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ38627') HTTP/1.1" 204 0
2026-03-27 10:42:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003c2750>
2026-03-27 10:42:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb3055c5-de0b-5042-804a-6e47029758da/bb3055c5-de0b-5042-804a-6e47029758da_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Ff1%252F36f1952e749d6231c0c73deaf3862b76%252Fpa%252FHR97485_653e698f53a86724f99fa3b6498416f8.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_653e698f53a86724f99fa3b6498416f8.jpg saved to cache
2026-03-27 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb3055c5-de0b-5042-804a-6e47029758da
2026-03-27 10:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_ade7e2eb439476379537166a2947dba8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:12 [auto1.de] INFO: Found listing with ID: XU64075
2026-03-27 10:42:12 [auto1.de] INFO: Found listing with ID: MU33695
2026-03-27 10:42:12 [auto1.de] INFO: Found listing with ID: LU00556
2026-03-27 10:42:12 [auto1.de] INFO: Found listing with ID: XR06088
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR06088%27 HTTP/1.1" 200 None
2026-03-27 10:42:12 [auto1.de] INFO: Scrape type for XR06088: 2
2026-03-27 10:42:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a950c4cb-e475-5f41-a41a-cfc268e8ce08 with identifier: XR06088
2026-03-27 10:42:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a950c4cb-e475-5f41-a41a-cfc268e8ce08 with scrape type 2
2026-03-27 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a950c4cb-e475-5f41-a41a-cfc268e8ce08 with scrape type 2
2026-03-27 10:42:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a950c4cb-e475-5f41-a41a-cfc268e8ce08, identifier: XR06088
2026-03-27 10:42:12 [auto1.de] INFO: Found listing with ID: KX79678
2026-03-27 10:42:12 [auto1.de] INFO: Found listing with ID: GA28860
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA28860%27 HTTP/1.1" 200 None
2026-03-27 10:42:12 [auto1.de] INFO: Scrape type for GA28860: 2
2026-03-27 10:42:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dab1ca00-fb3f-5739-8785-2c59c1349aa6 with identifier: GA28860
2026-03-27 10:42:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dab1ca00-fb3f-5739-8785-2c59c1349aa6 with scrape type 2
2026-03-27 10:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dab1ca00-fb3f-5739-8785-2c59c1349aa6 with scrape type 2
2026-03-27 10:42:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dab1ca00-fb3f-5739-8785-2c59c1349aa6, identifier: GA28860
2026-03-27 10:42:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_cb9942f3c65d5d43745b9cb8cb589b02.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a950c4cb-e475-5f41-a41a-cfc268e8ce08 with identifier: XR06088
2026-03-27 10:42:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a950c4cb-e475-5f41-a41a-cfc268e8ce08 with identifier: XR06088
2026-03-27 10:42:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a950c4cb-e475-5f41-a41a-cfc268e8ce08 with identifier: XR06088 to the API
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:41:30Z',
 'fuel_type': 'electro',
 'id': 'a950c4cb-e475-5f41-a41a-cfc268e8ce08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR06088',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.4',
 'odometer': 93134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-20',
 'seller_name': None,
 'title': 'Volkswagen ID.4 electric drive 150 kW Family Pro Performance',
 'transmission': 'automatic',
 'trim': 'Family Pro Performance',
 'year': 2021}
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR06088%27 HTTP/1.1" 200 None
2026-03-27 10:42:13 [auto1.de] INFO: Saving data for XR06088: {'auction_closing_time': 1774716090.0, 'created_time': 1774330543.487411, 'last_price_update_time': 1774608133.057092}
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR06088') HTTP/1.1" 204 0
2026-03-27 10:42:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dab1ca00-fb3f-5739-8785-2c59c1349aa6 with identifier: GA28860
2026-03-27 10:42:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dab1ca00-fb3f-5739-8785-2c59c1349aa6 with identifier: GA28860
2026-03-27 10:42:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dab1ca00-fb3f-5739-8785-2c59c1349aa6 with identifier: GA28860 to the API
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:54:27Z',
 'fuel_type': 'diesel',
 'id': 'dab1ca00-fb3f-5739-8785-2c59c1349aa6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA28860',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Grand Sport',
 'odometer': 186474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-19',
 'seller_name': None,
 'title': 'Opel Insignia Grand Sport 2.0 CDTI Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2019}
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA28860%27 HTTP/1.1" 200 None
2026-03-27 10:42:13 [auto1.de] INFO: Saving data for GA28860: {'auction_closing_time': 1774716867.0, 'created_time': 1773775730.393811, 'last_price_update_time': 1774608133.473524}
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA28860') HTTP/1.1" 204 0
2026-03-27 10:42:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002ca910>
2026-03-27 10:42:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ee2ffb3-d991-522e-a064-81a9c082e71b/6ee2ffb3-d991-522e-a064-81a9c082e71b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0e%252Fb00e5b094d73afab5067aa60017dac63%252Fpa%252FBB84550_729cc40f0f6a02263d4359b68d5331e9.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_729cc40f0f6a02263d4359b68d5331e9.jpg saved to cache
2026-03-27 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ee2ffb3-d991-522e-a064-81a9c082e71b
2026-03-27 10:42:13 [auto1.de] INFO: Found listing with ID: LU75285
2026-03-27 10:42:13 [auto1.de] INFO: Found listing with ID: LH51780
2026-03-27 10:42:13 [auto1.de] INFO: Found listing with ID: YD55328
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD55328%27 HTTP/1.1" 200 None
2026-03-27 10:42:13 [auto1.de] INFO: Scrape type for YD55328: 2
2026-03-27 10:42:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64981901-77f8-5c58-9f59-24ac9625466a with identifier: YD55328
2026-03-27 10:42:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64981901-77f8-5c58-9f59-24ac9625466a with scrape type 2
2026-03-27 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64981901-77f8-5c58-9f59-24ac9625466a with scrape type 2
2026-03-27 10:42:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64981901-77f8-5c58-9f59-24ac9625466a, identifier: YD55328
2026-03-27 10:42:13 [auto1.de] INFO: Found listing with ID: NB80689
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB80689%27 HTTP/1.1" 200 None
2026-03-27 10:42:13 [auto1.de] INFO: Scrape type for NB80689: 2
2026-03-27 10:42:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3e94735-3121-58c7-88ea-84870541eb6a with identifier: NB80689
2026-03-27 10:42:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3e94735-3121-58c7-88ea-84870541eb6a with scrape type 2
2026-03-27 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3e94735-3121-58c7-88ea-84870541eb6a with scrape type 2
2026-03-27 10:42:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3e94735-3121-58c7-88ea-84870541eb6a, identifier: NB80689
2026-03-27 10:42:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50049a1d0>
2026-03-27 10:42:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb3055c5-de0b-5042-804a-6e47029758da/bb3055c5-de0b-5042-804a-6e47029758da_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Ff1%252F36f1952e749d6231c0c73deaf3862b76%252Fpa%252FHR97485_9b9c72de0153e6f498c51f51c66c8061.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_9b9c72de0153e6f498c51f51c66c8061.jpg saved to cache
2026-03-27 10:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb3055c5-de0b-5042-804a-6e47029758da
2026-03-27 10:42:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_8b7c75aa62cbf62c83ac4ce79012a93f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64981901-77f8-5c58-9f59-24ac9625466a with identifier: YD55328
2026-03-27 10:42:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64981901-77f8-5c58-9f59-24ac9625466a with identifier: YD55328
2026-03-27 10:42:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64981901-77f8-5c58-9f59-24ac9625466a with identifier: YD55328 to the API
2026-03-27 10:42:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:58:13Z',
 'fuel_type': 'diesel',
 'id': '64981901-77f8-5c58-9f59-24ac9625466a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD55328',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 84322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-02',
 'seller_name': None,
 'title': 'Kia Sorento 2.2 CRDi Platinum Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Platinum Edition 4WD',
 'year': 2019}
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD55328%27 HTTP/1.1" 200 None
2026-03-27 10:42:14 [auto1.de] INFO: Saving data for YD55328: {'auction_closing_time': 1774717093.0, 'created_time': 1773381308.776175, 'last_price_update_time': 1774608134.215083}
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD55328') HTTP/1.1" 204 0
2026-03-27 10:42:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3e94735-3121-58c7-88ea-84870541eb6a with identifier: NB80689
2026-03-27 10:42:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3e94735-3121-58c7-88ea-84870541eb6a with identifier: NB80689
2026-03-27 10:42:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3e94735-3121-58c7-88ea-84870541eb6a with identifier: NB80689 to the API
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:41:26Z',
 'fuel_type': 'petrol',
 'id': 'a3e94735-3121-58c7-88ea-84870541eb6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB80689',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 183366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB80689%27 HTTP/1.1" 200 None
2026-03-27 10:42:14 [auto1.de] INFO: Saving data for NB80689: {'auction_closing_time': 1774716086.0, 'created_time': 1773775996.657466, 'last_price_update_time': 1774608134.746912}
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB80689') HTTP/1.1" 204 0
2026-03-27 10:42:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018409d0>
2026-03-27 10:42:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0/d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F29%252Fae29526039dad33e76e3a99f5347e51e%252Fpa%252FZC71941_ade7e2eb439476379537166a2947dba8.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_ade7e2eb439476379537166a2947dba8.jpg saved to cache
2026-03-27 10:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0
2026-03-27 10:42:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_a8d713a62ee4d7d303c9fd9c14929553.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:14 [auto1.de] INFO: Found listing with ID: VG52113
2026-03-27 10:42:14 [auto1.de] INFO: Found listing with ID: SA68147
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA68147%27 HTTP/1.1" 200 None
2026-03-27 10:42:14 [auto1.de] INFO: Scrape type for SA68147: 2
2026-03-27 10:42:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0 with identifier: SA68147
2026-03-27 10:42:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0 with scrape type 2
2026-03-27 10:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0 with scrape type 2
2026-03-27 10:42:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0, identifier: SA68147
2026-03-27 10:42:14 [auto1.de] INFO: Found listing with ID: NN79660
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN79660%27 HTTP/1.1" 200 None
2026-03-27 10:42:14 [auto1.de] INFO: Scrape type for NN79660: 2
2026-03-27 10:42:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ab8c9ee-88fa-56a1-bfe5-5139cebf843d with identifier: NN79660
2026-03-27 10:42:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ab8c9ee-88fa-56a1-bfe5-5139cebf843d with scrape type 2
2026-03-27 10:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ab8c9ee-88fa-56a1-bfe5-5139cebf843d with scrape type 2
2026-03-27 10:42:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ab8c9ee-88fa-56a1-bfe5-5139cebf843d, identifier: NN79660
2026-03-27 10:42:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001dd690>
2026-03-27 10:42:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ee2ffb3-d991-522e-a064-81a9c082e71b/6ee2ffb3-d991-522e-a064-81a9c082e71b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0e%252Fb00e5b094d73afab5067aa60017dac63%252Fpa%252FBB84550_cb9942f3c65d5d43745b9cb8cb589b02.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_cb9942f3c65d5d43745b9cb8cb589b02.jpg saved to cache
2026-03-27 10:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ee2ffb3-d991-522e-a064-81a9c082e71b
2026-03-27 10:42:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_d490e7cdee25bff998988ffd9ab12799.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0 with identifier: SA68147
2026-03-27 10:42:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0 with identifier: SA68147
2026-03-27 10:42:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0 with identifier: SA68147 to the API
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:24:27Z',
 'fuel_type': 'diesel',
 'id': '2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA68147',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 167646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-03',
 'seller_name': None,
 'title': 'BMW 2er 214d Active Tourer Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2015}
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA68147%27 HTTP/1.1" 200 None
2026-03-27 10:42:15 [auto1.de] INFO: Saving data for SA68147: {'auction_closing_time': 1774715067.0, 'created_time': 1773224388.456892, 'last_price_update_time': 1774608135.492851}
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA68147') HTTP/1.1" 204 0
2026-03-27 10:42:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ab8c9ee-88fa-56a1-bfe5-5139cebf843d with identifier: NN79660
2026-03-27 10:42:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ab8c9ee-88fa-56a1-bfe5-5139cebf843d with identifier: NN79660
2026-03-27 10:42:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ab8c9ee-88fa-56a1-bfe5-5139cebf843d with identifier: NN79660 to the API
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:17:22Z',
 'fuel_type': 'diesel',
 'id': '5ab8c9ee-88fa-56a1-bfe5-5139cebf843d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN79660',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-12-15',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 317 CDI Kasten L2',
 'transmission': 'automatic',
 'trim': 'Kasten L2',
 'year': 2025}
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN79660%27 HTTP/1.1" 200 None
2026-03-27 10:42:15 [auto1.de] INFO: Saving data for NN79660: {'auction_closing_time': 1774714642.0, 'created_time': 1773304162.915518, 'last_price_update_time': 1774608135.935052}
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN79660') HTTP/1.1" 204 0
2026-03-27 10:42:15 [auto1.de] INFO: Found listing with ID: CH61883
2026-03-27 10:42:15 [auto1.de] INFO: Found listing with ID: JL37437
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL37437%27 HTTP/1.1" 200 None
2026-03-27 10:42:15 [auto1.de] INFO: Scrape type for JL37437: 2
2026-03-27 10:42:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7db25ba-476e-5bef-b9f9-71b27ebce11c with identifier: JL37437
2026-03-27 10:42:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7db25ba-476e-5bef-b9f9-71b27ebce11c with scrape type 2
2026-03-27 10:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7db25ba-476e-5bef-b9f9-71b27ebce11c with scrape type 2
2026-03-27 10:42:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7db25ba-476e-5bef-b9f9-71b27ebce11c, identifier: JL37437
2026-03-27 10:42:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501890250>
2026-03-27 10:42:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ee2ffb3-d991-522e-a064-81a9c082e71b/6ee2ffb3-d991-522e-a064-81a9c082e71b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0e%252Fb00e5b094d73afab5067aa60017dac63%252Fpa%252FBB84550_8b7c75aa62cbf62c83ac4ce79012a93f.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_8b7c75aa62cbf62c83ac4ce79012a93f.jpg saved to cache
2026-03-27 10:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ee2ffb3-d991-522e-a064-81a9c082e71b
2026-03-27 10:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_ec682dfd80a23436a6a61e2c3cd6f5dc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7db25ba-476e-5bef-b9f9-71b27ebce11c with identifier: JL37437
2026-03-27 10:42:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7db25ba-476e-5bef-b9f9-71b27ebce11c with identifier: JL37437
2026-03-27 10:42:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7db25ba-476e-5bef-b9f9-71b27ebce11c with identifier: JL37437 to the API
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:09:43Z',
 'fuel_type': 'diesel',
 'id': 'a7db25ba-476e-5bef-b9f9-71b27ebce11c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL37437',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T4 Transporter',
 'odometer': 181174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1995-02-14',
 'seller_name': None,
 'title': 'Volkswagen T4 Transporter 1.9 Turbodiesel Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 1995}
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL37437%27 HTTP/1.1" 200 None
2026-03-27 10:42:16 [auto1.de] INFO: Saving data for JL37437: {'auction_closing_time': 1774714183.0, 'created_time': 1773382135.095408, 'last_price_update_time': 1774608136.551662}
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL37437') HTTP/1.1" 204 0
2026-03-27 10:42:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501847650>
2026-03-27 10:42:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb3055c5-de0b-5042-804a-6e47029758da/bb3055c5-de0b-5042-804a-6e47029758da_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Ff1%252F36f1952e749d6231c0c73deaf3862b76%252Fpa%252FHR97485_a8d713a62ee4d7d303c9fd9c14929553.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_a8d713a62ee4d7d303c9fd9c14929553.jpg saved to cache
2026-03-27 10:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb3055c5-de0b-5042-804a-6e47029758da
2026-03-27 10:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_4e964b3c8419caebf2943d247143aadd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:16 [auto1.de] INFO: Found listing with ID: DG62846
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG62846%27 HTTP/1.1" 200 None
2026-03-27 10:42:16 [auto1.de] INFO: Scrape type for DG62846: 2
2026-03-27 10:42:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5400fba-3052-52cc-9d93-1ee91d165148 with identifier: DG62846
2026-03-27 10:42:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5400fba-3052-52cc-9d93-1ee91d165148 with scrape type 2
2026-03-27 10:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5400fba-3052-52cc-9d93-1ee91d165148 with scrape type 2
2026-03-27 10:42:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5400fba-3052-52cc-9d93-1ee91d165148, identifier: DG62846
2026-03-27 10:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BV10728> (referer: https://www.auto1.com/v1/car-details-view/BV10728/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_8e1dbb780ca7b373044c67874ded7a48.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5400fba-3052-52cc-9d93-1ee91d165148 with identifier: DG62846
2026-03-27 10:42:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5400fba-3052-52cc-9d93-1ee91d165148 with identifier: DG62846
2026-03-27 10:42:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5400fba-3052-52cc-9d93-1ee91d165148 with identifier: DG62846 to the API
2026-03-27 10:42:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:16:20Z',
 'fuel_type': 'petrol',
 'id': 'd5400fba-3052-52cc-9d93-1ee91d165148',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG62846',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 57628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-31',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG62846%27 HTTP/1.1" 200 None
2026-03-27 10:42:17 [auto1.de] INFO: Saving data for DG62846: {'auction_closing_time': 1774714580.0, 'created_time': 1773659096.375404, 'last_price_update_time': 1774608137.157223}
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG62846') HTTP/1.1" 204 0
2026-03-27 10:42:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d43d0>
2026-03-27 10:42:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb3055c5-de0b-5042-804a-6e47029758da/bb3055c5-de0b-5042-804a-6e47029758da_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Ff1%252F36f1952e749d6231c0c73deaf3862b76%252Fpa%252FHR97485_d490e7cdee25bff998988ffd9ab12799.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_d490e7cdee25bff998988ffd9ab12799.jpg saved to cache
2026-03-27 10:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb3055c5-de0b-5042-804a-6e47029758da
2026-03-27 10:42:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:17 [auto1.de] INFO: Found listing with ID: VV98645
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV98645%27 HTTP/1.1" 200 None
2026-03-27 10:42:17 [auto1.de] INFO: Scrape type for VV98645: 2
2026-03-27 10:42:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb4722b5-fc94-57d1-b572-f0cc66851d4c with identifier: VV98645
2026-03-27 10:42:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb4722b5-fc94-57d1-b572-f0cc66851d4c with scrape type 2
2026-03-27 10:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb4722b5-fc94-57d1-b572-f0cc66851d4c with scrape type 2
2026-03-27 10:42:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb4722b5-fc94-57d1-b572-f0cc66851d4c, identifier: VV98645
2026-03-27 10:42:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WD52714/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_a16d532c5122c67862635cd034118d94.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_537739e53cd5f38d4c426caa7f91d2cc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb4722b5-fc94-57d1-b572-f0cc66851d4c with identifier: VV98645
2026-03-27 10:42:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb4722b5-fc94-57d1-b572-f0cc66851d4c with identifier: VV98645
2026-03-27 10:42:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb4722b5-fc94-57d1-b572-f0cc66851d4c with identifier: VV98645 to the API
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:48:58Z',
 'fuel_type': 'diesel',
 'id': 'eb4722b5-fc94-57d1-b572-f0cc66851d4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV98645',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 153771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-19',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium X',
 'transmission': 'automatic',
 'trim': 'Titanium X',
 'year': 2014}
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV98645%27 HTTP/1.1" 200 None
2026-03-27 10:42:17 [auto1.de] INFO: Saving data for VV98645: {'auction_closing_time': 1774716538.0, 'created_time': 1774292360.758484, 'last_price_update_time': 1774608137.679812}
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV98645') HTTP/1.1" 204 0
2026-03-27 10:42:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_9cf3331f63fd31e9d96fa7276397dbe2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:17 [auto1.de] INFO: Found listing with ID: JV89856
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV89856%27 HTTP/1.1" 200 None
2026-03-27 10:42:17 [auto1.de] INFO: Scrape type for JV89856: 2
2026-03-27 10:42:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90fe141c-7c36-5dbf-9580-66dd0d7bfd94 with identifier: JV89856
2026-03-27 10:42:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90fe141c-7c36-5dbf-9580-66dd0d7bfd94 with scrape type 2
2026-03-27 10:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90fe141c-7c36-5dbf-9580-66dd0d7bfd94 with scrape type 2
2026-03-27 10:42:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90fe141c-7c36-5dbf-9580-66dd0d7bfd94, identifier: JV89856
2026-03-27 10:42:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500448ed0>
2026-03-27 10:42:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ee2ffb3-d991-522e-a064-81a9c082e71b/6ee2ffb3-d991-522e-a064-81a9c082e71b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0e%252Fb00e5b094d73afab5067aa60017dac63%252Fpa%252FBB84550_ec682dfd80a23436a6a61e2c3cd6f5dc.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_ec682dfd80a23436a6a61e2c3cd6f5dc.jpg saved to cache
2026-03-27 10:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6ee2ffb3-d991-522e-a064-81a9c082e71b
2026-03-27 10:42:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002fd850>
2026-03-27 10:42:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb3055c5-de0b-5042-804a-6e47029758da/bb3055c5-de0b-5042-804a-6e47029758da_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Ff1%252F36f1952e749d6231c0c73deaf3862b76%252Fpa%252FHR97485_4e964b3c8419caebf2943d247143aadd.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_4e964b3c8419caebf2943d247143aadd.jpg saved to cache
2026-03-27 10:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb3055c5-de0b-5042-804a-6e47029758da
2026-03-27 10:42:17 [auto1.de] INFO: Channel: 24h | Page: 23 | totalHits: 10528 | hits on page: 40
2026-03-27 10:42:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba53aa0c-91b5-55de-8110-22e30ff94ffb with identifier: BV10728
2026-03-27 10:42:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba53aa0c-91b5-55de-8110-22e30ff94ffb with scrape type 1
2026-03-27 10:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ba53aa0c-91b5-55de-8110-22e30ff94ffb
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F11%252F8311ab6eb1be754516d091deb637cadc%252Fpa%252FBV10728_dacb25884b20e92aedb8909c7f8cd889.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_dacb25884b20e92aedb8909c7f8cd889.jpg already downloaded
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F11%252F8311ab6eb1be754516d091deb637cadc%252Fpa%252FBV10728_d63ddc85aa8f57c9c61b5c71933a8489.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_d63ddc85aa8f57c9c61b5c71933a8489.jpg already downloaded
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F11%252F8311ab6eb1be754516d091deb637cadc%252Fpa%252FBV10728_247e0f539e6368984232f88a113fb7c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_247e0f539e6368984232f88a113fb7c0.jpg already downloaded
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F11%252F8311ab6eb1be754516d091deb637cadc%252Fpa%252FBV10728_ad210e8cc5d22525931f9e1a70062eb1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_ad210e8cc5d22525931f9e1a70062eb1.jpg already downloaded
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F11%252F8311ab6eb1be754516d091deb637cadc%252Fpa%252FBV10728_37fb15a13b9494aac2d07bc42b0ef737.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_37fb15a13b9494aac2d07bc42b0ef737.jpg already downloaded
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F11%252F8311ab6eb1be754516d091deb637cadc%252Fpa%252FBV10728_2ab3425110f1f1405ecdd72cd9d2784a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_2ab3425110f1f1405ecdd72cd9d2784a.jpg already downloaded
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F11%252F8311ab6eb1be754516d091deb637cadc%252Fpa%252FBV10728_bbc3e0772d32cdbe7afe556f754c42fb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_bbc3e0772d32cdbe7afe556f754c42fb.jpg already downloaded
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F11%252F8311ab6eb1be754516d091deb637cadc%252Fpa%252FBV10728_a88277387c2d40c9d46c60e3ab676230.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_a88277387c2d40c9d46c60e3ab676230.jpg already downloaded
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F11%252F8311ab6eb1be754516d091deb637cadc%252Fpa%252FBV10728_69150dee14cb929a102aa6351f4c5903.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_69150dee14cb929a102aa6351f4c5903.jpg already downloaded
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F11%252F8311ab6eb1be754516d091deb637cadc%252Fpa%252FBV10728_8a5e6531f1ba565fc0d898d02ff9ddeb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_8a5e6531f1ba565fc0d898d02ff9ddeb.jpg already downloaded
2026-03-27 10:42:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba53aa0c-91b5-55de-8110-22e30ff94ffb, identifier: BV10728
2026-03-27 10:42:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50175cbd0>
2026-03-27 10:42:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb3055c5-de0b-5042-804a-6e47029758da/bb3055c5-de0b-5042-804a-6e47029758da_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Ff1%252F36f1952e749d6231c0c73deaf3862b76%252Fpa%252FHR97485_8e1dbb780ca7b373044c67874ded7a48.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_8e1dbb780ca7b373044c67874ded7a48.jpg saved to cache
2026-03-27 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb3055c5-de0b-5042-804a-6e47029758da
2026-03-27 10:42:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_ec1d4f1546272e912f0dc1025cbd894a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90fe141c-7c36-5dbf-9580-66dd0d7bfd94 with identifier: JV89856
2026-03-27 10:42:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90fe141c-7c36-5dbf-9580-66dd0d7bfd94 with identifier: JV89856
2026-03-27 10:42:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90fe141c-7c36-5dbf-9580-66dd0d7bfd94 with identifier: JV89856 to the API
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:53:23Z',
 'fuel_type': 'petrol',
 'id': '90fe141c-7c36-5dbf-9580-66dd0d7bfd94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV89856',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 24250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-17',
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2020}
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV89856%27 HTTP/1.1" 200 None
2026-03-27 10:42:18 [auto1.de] INFO: Saving data for JV89856: {'auction_closing_time': 1774716803.0, 'created_time': 1773687305.07223, 'last_price_update_time': 1774608138.605128}
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV89856') HTTP/1.1" 204 0
2026-03-27 10:42:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba53aa0c-91b5-55de-8110-22e30ff94ffb with identifier: BV10728
2026-03-27 10:42:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba53aa0c-91b5-55de-8110-22e30ff94ffb with identifier: BV10728
2026-03-27 10:42:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba53aa0c-91b5-55de-8110-22e30ff94ffb with identifier: BV10728 to the API
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BV10728>
{'auction_title': '',
 'c_o_2_emission_value': 193,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:41:19Z',
 'fuel_type': 'diesel',
 'id': 'ba53aa0c-91b5-55de-8110-22e30ff94ffb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV10728',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Volkswagen',
 'model': 'T5 Kombi',
 'odometer': 180868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_dacb25884b20e92aedb8909c7f8cd889.jpg',
                'https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_d63ddc85aa8f57c9c61b5c71933a8489.jpg',
                'https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_247e0f539e6368984232f88a113fb7c0.jpg',
                'https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_ad210e8cc5d22525931f9e1a70062eb1.jpg',
                'https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_37fb15a13b9494aac2d07bc42b0ef737.jpg',
                'https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_2ab3425110f1f1405ecdd72cd9d2784a.jpg',
                'https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_bbc3e0772d32cdbe7afe556f754c42fb.jpg',
                'https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_a88277387c2d40c9d46c60e3ab676230.jpg',
                'https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_69150dee14cb929a102aa6351f4c5903.jpg',
                'https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_8a5e6531f1ba565fc0d898d02ff9ddeb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba53aa0c-91b5-55de-8110-22e30ff94ffb/ba53aa0c-91b5-55de-8110-22e30ff94ffb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_dacb25884b20e92aedb8909c7f8cd889.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba53aa0c-91b5-55de-8110-22e30ff94ffb/ba53aa0c-91b5-55de-8110-22e30ff94ffb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_d63ddc85aa8f57c9c61b5c71933a8489.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba53aa0c-91b5-55de-8110-22e30ff94ffb/ba53aa0c-91b5-55de-8110-22e30ff94ffb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_247e0f539e6368984232f88a113fb7c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba53aa0c-91b5-55de-8110-22e30ff94ffb/ba53aa0c-91b5-55de-8110-22e30ff94ffb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_ad210e8cc5d22525931f9e1a70062eb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba53aa0c-91b5-55de-8110-22e30ff94ffb/ba53aa0c-91b5-55de-8110-22e30ff94ffb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_37fb15a13b9494aac2d07bc42b0ef737.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba53aa0c-91b5-55de-8110-22e30ff94ffb/ba53aa0c-91b5-55de-8110-22e30ff94ffb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_2ab3425110f1f1405ecdd72cd9d2784a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba53aa0c-91b5-55de-8110-22e30ff94ffb/ba53aa0c-91b5-55de-8110-22e30ff94ffb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_bbc3e0772d32cdbe7afe556f754c42fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba53aa0c-91b5-55de-8110-22e30ff94ffb/ba53aa0c-91b5-55de-8110-22e30ff94ffb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_a88277387c2d40c9d46c60e3ab676230.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba53aa0c-91b5-55de-8110-22e30ff94ffb/ba53aa0c-91b5-55de-8110-22e30ff94ffb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_69150dee14cb929a102aa6351f4c5903.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba53aa0c-91b5-55de-8110-22e30ff94ffb/ba53aa0c-91b5-55de-8110-22e30ff94ffb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/11/8311ab6eb1be754516d091deb637cadc/pa/BV10728_8a5e6531f1ba565fc0d898d02ff9ddeb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-12',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Volkswagen T5 Kombi 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV10728%27 HTTP/1.1" 200 None
2026-03-27 10:42:18 [auto1.de] INFO: Saving data for BV10728: {'created_time': 1774608138.995601, 'last_price_update_time': 1774608138.995612, 'auction_closing_time': 1774716079.0}
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV10728') HTTP/1.1" 204 0
2026-03-27 10:42:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_b33a76c2ec1b0bf962fa0eb3379fce98.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_dd5872264f45a37b342c5f3db4aa2a84.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:19 [auto1.de] INFO: Found listing with ID: JY04435
2026-03-27 10:42:19 [auto1.de] INFO: Found listing with ID: PL79897
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL79897%27 HTTP/1.1" 200 None
2026-03-27 10:42:19 [auto1.de] INFO: Scrape type for PL79897: 2
2026-03-27 10:42:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbb187ba-a4f7-5da6-991d-f766bc2c40f5 with identifier: PL79897
2026-03-27 10:42:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbb187ba-a4f7-5da6-991d-f766bc2c40f5 with scrape type 2
2026-03-27 10:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbb187ba-a4f7-5da6-991d-f766bc2c40f5 with scrape type 2
2026-03-27 10:42:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dbb187ba-a4f7-5da6-991d-f766bc2c40f5, identifier: PL79897
2026-03-27 10:42:19 [auto1.de] INFO: Found listing with ID: JW09174
2026-03-27 10:42:19 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB25738%27 HTTP/1.1" 200 None
2026-03-27 10:42:19 [auto1.de] INFO: Scrape type for RB25738: 2
2026-03-27 10:42:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c1a2099-0c16-53e5-aca6-4a76cc3efb45 with identifier: RB25738
2026-03-27 10:42:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c1a2099-0c16-53e5-aca6-4a76cc3efb45 with scrape type 2
2026-03-27 10:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c1a2099-0c16-53e5-aca6-4a76cc3efb45 with scrape type 2
2026-03-27 10:42:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c1a2099-0c16-53e5-aca6-4a76cc3efb45, identifier: RB25738
2026-03-27 10:42:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EJ83325/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_218c180f3a240c9299e08c1f31d7bb0d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dbb187ba-a4f7-5da6-991d-f766bc2c40f5 with identifier: PL79897
2026-03-27 10:42:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dbb187ba-a4f7-5da6-991d-f766bc2c40f5 with identifier: PL79897
2026-03-27 10:42:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dbb187ba-a4f7-5da6-991d-f766bc2c40f5 with identifier: PL79897 to the API
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:55:23Z',
 'fuel_type': 'petrol',
 'id': 'dbb187ba-a4f7-5da6-991d-f766bc2c40f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL79897',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 25279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-28',
 'seller_name': None,
 'title': 'Citroen C4 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2023}
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL79897%27 HTTP/1.1" 200 None
2026-03-27 10:42:19 [auto1.de] INFO: Saving data for PL79897: {'auction_closing_time': 1774716923.0, 'created_time': 1774293908.438891, 'last_price_update_time': 1774608139.657747}
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL79897') HTTP/1.1" 204 0
2026-03-27 10:42:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c1a2099-0c16-53e5-aca6-4a76cc3efb45 with identifier: RB25738
2026-03-27 10:42:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c1a2099-0c16-53e5-aca6-4a76cc3efb45 with identifier: RB25738
2026-03-27 10:42:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c1a2099-0c16-53e5-aca6-4a76cc3efb45 with identifier: RB25738 to the API
2026-03-27 10:42:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:26:26Z',
 'fuel_type': 'diesel',
 'id': '0c1a2099-0c16-53e5-aca6-4a76cc3efb45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB25738',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 196698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-06',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2017}
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB25738%27 HTTP/1.1" 200 None
2026-03-27 10:42:20 [auto1.de] INFO: Saving data for RB25738: {'auction_closing_time': 1774715186.0, 'created_time': 1773775461.967046, 'last_price_update_time': 1774608140.137649}
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB25738') HTTP/1.1" 204 0
2026-03-27 10:42:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:42:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a8710>
2026-03-27 10:42:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3aea76f-6bbe-50f5-b2e0-c358667c15fa/d3aea76f-6bbe-50f5-b2e0-c358667c15fa_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F71%252Fb47185a0b558a2051a0d6e3efdadae5f%252Fpa%252FXG24427_a16d532c5122c67862635cd034118d94.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_a16d532c5122c67862635cd034118d94.jpg saved to cache
2026-03-27 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3aea76f-6bbe-50f5-b2e0-c358667c15fa
2026-03-27 10:42:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:42:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017c6dd0>
2026-03-27 10:42:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3aea76f-6bbe-50f5-b2e0-c358667c15fa/d3aea76f-6bbe-50f5-b2e0-c358667c15fa_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F71%252Fb47185a0b558a2051a0d6e3efdadae5f%252Fpa%252FXG24427_537739e53cd5f38d4c426caa7f91d2cc.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_537739e53cd5f38d4c426caa7f91d2cc.jpg saved to cache
2026-03-27 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3aea76f-6bbe-50f5-b2e0-c358667c15fa
2026-03-27 10:42:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d3550>
2026-03-27 10:42:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb3055c5-de0b-5042-804a-6e47029758da/bb3055c5-de0b-5042-804a-6e47029758da_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Ff1%252F36f1952e749d6231c0c73deaf3862b76%252Fpa%252FHR97485_9cf3331f63fd31e9d96fa7276397dbe2.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_9cf3331f63fd31e9d96fa7276397dbe2.jpg saved to cache
2026-03-27 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb3055c5-de0b-5042-804a-6e47029758da
2026-03-27 10:42:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_542b390a0620f4ade5e384337a50608c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:20 [auto1.de] INFO: Found listing with ID: KG22409
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG22409%27 HTTP/1.1" 200 None
2026-03-27 10:42:20 [auto1.de] INFO: Scrape type for KG22409: 2
2026-03-27 10:42:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c9e8a1f-2169-5a61-a85c-c33e75f596c2 with identifier: KG22409
2026-03-27 10:42:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c9e8a1f-2169-5a61-a85c-c33e75f596c2 with scrape type 2
2026-03-27 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c9e8a1f-2169-5a61-a85c-c33e75f596c2 with scrape type 2
2026-03-27 10:42:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c9e8a1f-2169-5a61-a85c-c33e75f596c2, identifier: KG22409
2026-03-27 10:42:20 [auto1.de] INFO: Found listing with ID: TB33384
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB33384%27 HTTP/1.1" 200 None
2026-03-27 10:42:20 [auto1.de] INFO: Scrape type for TB33384: 2
2026-03-27 10:42:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7693f19-c320-5040-bb7b-fb5236ae8153 with identifier: TB33384
2026-03-27 10:42:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7693f19-c320-5040-bb7b-fb5236ae8153 with scrape type 2
2026-03-27 10:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7693f19-c320-5040-bb7b-fb5236ae8153 with scrape type 2
2026-03-27 10:42:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7693f19-c320-5040-bb7b-fb5236ae8153, identifier: TB33384
2026-03-27 10:42:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c9e8a1f-2169-5a61-a85c-c33e75f596c2 with identifier: KG22409
2026-03-27 10:42:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c9e8a1f-2169-5a61-a85c-c33e75f596c2 with identifier: KG22409
2026-03-27 10:42:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c9e8a1f-2169-5a61-a85c-c33e75f596c2 with identifier: KG22409 to the API
2026-03-27 10:42:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:19:12Z',
 'fuel_type': 'diesel',
 'id': '8c9e8a1f-2169-5a61-a85c-c33e75f596c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG22409',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 239016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-30',
 'seller_name': None,
 'title': 'BMW 5er 530d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG22409%27 HTTP/1.1" 200 None
2026-03-27 10:42:21 [auto1.de] INFO: Saving data for KG22409: {'auction_closing_time': 1774714752.0, 'created_time': 1773305406.813429, 'last_price_update_time': 1774608141.161467}
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG22409') HTTP/1.1" 204 0
2026-03-27 10:42:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7693f19-c320-5040-bb7b-fb5236ae8153 with identifier: TB33384
2026-03-27 10:42:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7693f19-c320-5040-bb7b-fb5236ae8153 with identifier: TB33384
2026-03-27 10:42:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7693f19-c320-5040-bb7b-fb5236ae8153 with identifier: TB33384 to the API
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 201,
 'expiration_date': '2026-03-28T16:17:14Z',
 'fuel_type': 'diesel',
 'id': 'b7693f19-c320-5040-bb7b-fb5236ae8153',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB33384',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 84430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-11',
 'seller_name': None,
 'title': 'BMW 5er 520d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB33384%27 HTTP/1.1" 200 None
2026-03-27 10:42:21 [auto1.de] INFO: Saving data for TB33384: {'auction_closing_time': 1774714634.0, 'created_time': 1773307184.877723, 'last_price_update_time': 1774608141.720122}
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB33384') HTTP/1.1" 204 0
2026-03-27 10:42:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:42:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016ae950>
2026-03-27 10:42:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F08%252F4208b7b27af2168e20bc9a21c53695fc%252Fpa%252FNL59666_ec1d4f1546272e912f0dc1025cbd894a.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_ec1d4f1546272e912f0dc1025cbd894a.jpg saved to cache
2026-03-27 10:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-03-27 10:42:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001e2dd0>
2026-03-27 10:42:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ee2ffb3-d991-522e-a064-81a9c082e71b/6ee2ffb3-d991-522e-a064-81a9c082e71b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0e%252Fb00e5b094d73afab5067aa60017dac63%252Fpa%252FBB84550_b33a76c2ec1b0bf962fa0eb3379fce98.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_b33a76c2ec1b0bf962fa0eb3379fce98.jpg saved to cache
2026-03-27 10:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6ee2ffb3-d991-522e-a064-81a9c082e71b
2026-03-27 10:42:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501769d90>
2026-03-27 10:42:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb3055c5-de0b-5042-804a-6e47029758da/bb3055c5-de0b-5042-804a-6e47029758da_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Ff1%252F36f1952e749d6231c0c73deaf3862b76%252Fpa%252FHR97485_dd5872264f45a37b342c5f3db4aa2a84.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_dd5872264f45a37b342c5f3db4aa2a84.jpg saved to cache
2026-03-27 10:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb3055c5-de0b-5042-804a-6e47029758da
2026-03-27 10:42:21 [auto1.de] INFO: Found listing with ID: HD41373
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD41373%27 HTTP/1.1" 200 None
2026-03-27 10:42:21 [auto1.de] INFO: Scrape type for HD41373: 2
2026-03-27 10:42:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f85bf86-1906-540b-ae61-c658748f15ce with identifier: HD41373
2026-03-27 10:42:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f85bf86-1906-540b-ae61-c658748f15ce with scrape type 2
2026-03-27 10:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f85bf86-1906-540b-ae61-c658748f15ce with scrape type 2
2026-03-27 10:42:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f85bf86-1906-540b-ae61-c658748f15ce, identifier: HD41373
2026-03-27 10:42:22 [auto1.de] INFO: Found listing with ID: ET35150
2026-03-27 10:42:22 [auto1.de] INFO: Found listing with ID: SD64601
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD64601%27 HTTP/1.1" 200 None
2026-03-27 10:42:22 [auto1.de] INFO: Scrape type for SD64601: 2
2026-03-27 10:42:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4608e656-4065-5d6d-87b2-6ea468e3d790 with identifier: SD64601
2026-03-27 10:42:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4608e656-4065-5d6d-87b2-6ea468e3d790 with scrape type 2
2026-03-27 10:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4608e656-4065-5d6d-87b2-6ea468e3d790 with scrape type 2
2026-03-27 10:42:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4608e656-4065-5d6d-87b2-6ea468e3d790, identifier: SD64601
2026-03-27 10:42:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500350f50>
2026-03-27 10:42:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca1e339-af0d-51ec-a9c0-bf60c09fb49a/4ca1e339-af0d-51ec-a9c0-bf60c09fb49a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee63a8179d6de831c9d3d2594a100%252Fpa%252FME89657_218c180f3a240c9299e08c1f31d7bb0d.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_218c180f3a240c9299e08c1f31d7bb0d.jpg saved to cache
2026-03-27 10:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a
2026-03-27 10:42:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_492f54b2d81702a74f0b8f282f2095dd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f85bf86-1906-540b-ae61-c658748f15ce with identifier: HD41373
2026-03-27 10:42:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f85bf86-1906-540b-ae61-c658748f15ce with identifier: HD41373
2026-03-27 10:42:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f85bf86-1906-540b-ae61-c658748f15ce with identifier: HD41373 to the API
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:53:17Z',
 'fuel_type': 'diesel',
 'id': '9f85bf86-1906-540b-ae61-c658748f15ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD41373',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 187442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-19',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD41373%27 HTTP/1.1" 200 None
2026-03-27 10:42:22 [auto1.de] INFO: Saving data for HD41373: {'auction_closing_time': 1774716797.0, 'created_time': 1773776049.998221, 'last_price_update_time': 1774608142.782651}
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD41373') HTTP/1.1" 204 0
2026-03-27 10:42:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4608e656-4065-5d6d-87b2-6ea468e3d790 with identifier: SD64601
2026-03-27 10:42:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4608e656-4065-5d6d-87b2-6ea468e3d790 with identifier: SD64601
2026-03-27 10:42:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4608e656-4065-5d6d-87b2-6ea468e3d790 with identifier: SD64601 to the API
2026-03-27 10:42:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:14:23Z',
 'fuel_type': 'petrol',
 'id': '4608e656-4065-5d6d-87b2-6ea468e3d790',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD64601',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 124575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-17',
 'seller_name': None,
 'title': 'Renault Megane 1.2 Paris',
 'transmission': 'manual',
 'trim': 'Paris',
 'year': 2013}
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD64601%27 HTTP/1.1" 200 None
2026-03-27 10:42:23 [auto1.de] INFO: Saving data for SD64601: {'auction_closing_time': 1774714463.0, 'created_time': 1773772536.411584, 'last_price_update_time': 1774608143.185994}
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD64601') HTTP/1.1" 204 0
2026-03-27 10:42:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500497e50>
2026-03-27 10:42:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc47f720-0a2b-59f0-a249-ab17fbc46c7b/dc47f720-0a2b-59f0-a249-ab17fbc46c7b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F1c%252F6a1ca83bb557168b14f4c98b0d711296%252Fpa%252FBJ13428_542b390a0620f4ade5e384337a50608c.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_542b390a0620f4ade5e384337a50608c.jpg saved to cache
2026-03-27 10:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dc47f720-0a2b-59f0-a249-ab17fbc46c7b
2026-03-27 10:42:23 [auto1.de] INFO: Found listing with ID: YX31470
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX31470%27 HTTP/1.1" 200 None
2026-03-27 10:42:23 [auto1.de] INFO: Scrape type for YX31470: 2
2026-03-27 10:42:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16114773-44e1-55d2-8dc9-4677562bd431 with identifier: YX31470
2026-03-27 10:42:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16114773-44e1-55d2-8dc9-4677562bd431 with scrape type 2
2026-03-27 10:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16114773-44e1-55d2-8dc9-4677562bd431 with scrape type 2
2026-03-27 10:42:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16114773-44e1-55d2-8dc9-4677562bd431, identifier: YX31470
2026-03-27 10:42:23 [auto1.de] INFO: Found listing with ID: PA30689
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA30689%27 HTTP/1.1" 200 None
2026-03-27 10:42:23 [auto1.de] INFO: Scrape type for PA30689: 2
2026-03-27 10:42:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b759d130-765d-505a-8a0b-7214f4dc3273 with identifier: PA30689
2026-03-27 10:42:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b759d130-765d-505a-8a0b-7214f4dc3273 with scrape type 2
2026-03-27 10:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b759d130-765d-505a-8a0b-7214f4dc3273 with scrape type 2
2026-03-27 10:42:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b759d130-765d-505a-8a0b-7214f4dc3273, identifier: PA30689
2026-03-27 10:42:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AJ83009/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16114773-44e1-55d2-8dc9-4677562bd431 with identifier: YX31470
2026-03-27 10:42:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16114773-44e1-55d2-8dc9-4677562bd431 with identifier: YX31470
2026-03-27 10:42:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16114773-44e1-55d2-8dc9-4677562bd431 with identifier: YX31470 to the API
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-28T16:24:51Z',
 'fuel_type': 'diesel',
 'id': '16114773-44e1-55d2-8dc9-4677562bd431',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX31470',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 196991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-22',
 'seller_name': None,
 'title': 'BMW X6 xDrive 40d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-27 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX31470%27 HTTP/1.1" 200 None
2026-03-27 10:42:24 [auto1.de] INFO: Saving data for YX31470: {'auction_closing_time': 1774715091.0, 'created_time': 1773467112.562213, 'last_price_update_time': 1774608144.006253}
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YX31470') HTTP/1.1" 204 0
2026-03-27 10:42:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b759d130-765d-505a-8a0b-7214f4dc3273 with identifier: PA30689
2026-03-27 10:42:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b759d130-765d-505a-8a0b-7214f4dc3273 with identifier: PA30689
2026-03-27 10:42:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b759d130-765d-505a-8a0b-7214f4dc3273 with identifier: PA30689 to the API
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:18:57Z',
 'fuel_type': 'diesel',
 'id': 'b759d130-765d-505a-8a0b-7214f4dc3273',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA30689',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 176638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-02',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2013}
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA30689%27 HTTP/1.1" 200 None
2026-03-27 10:42:24 [auto1.de] INFO: Saving data for PA30689: {'auction_closing_time': 1774714737.0, 'created_time': 1774294385.743561, 'last_price_update_time': 1774608144.487285}
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA30689') HTTP/1.1" 204 0
2026-03-27 10:42:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:24 [auto1.de] INFO: Found listing with ID: PC35903
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC35903%27 HTTP/1.1" 200 None
2026-03-27 10:42:24 [auto1.de] INFO: Scrape type for PC35903: 2
2026-03-27 10:42:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63c61a93-29a7-57cb-a99f-b685e5dea09c with identifier: PC35903
2026-03-27 10:42:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63c61a93-29a7-57cb-a99f-b685e5dea09c with scrape type 2
2026-03-27 10:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63c61a93-29a7-57cb-a99f-b685e5dea09c with scrape type 2
2026-03-27 10:42:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63c61a93-29a7-57cb-a99f-b685e5dea09c, identifier: PC35903
2026-03-27 10:42:24 [auto1.de] INFO: Found listing with ID: KC98509
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC98509%27 HTTP/1.1" 200 None
2026-03-27 10:42:24 [auto1.de] INFO: Scrape type for KC98509: 2
2026-03-27 10:42:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e32fb9f9-eae3-5351-b884-495dfcd6aafa with identifier: KC98509
2026-03-27 10:42:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e32fb9f9-eae3-5351-b884-495dfcd6aafa with scrape type 2
2026-03-27 10:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e32fb9f9-eae3-5351-b884-495dfcd6aafa with scrape type 2
2026-03-27 10:42:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e32fb9f9-eae3-5351-b884-495dfcd6aafa, identifier: KC98509
2026-03-27 10:42:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500494ad0>
2026-03-27 10:42:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0/d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F29%252Fae29526039dad33e76e3a99f5347e51e%252Fpa%252FZC71941_492f54b2d81702a74f0b8f282f2095dd.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_492f54b2d81702a74f0b8f282f2095dd.jpg saved to cache
2026-03-27 10:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0
2026-03-27 10:42:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_f0e74d5ad39da42a162750360c97a99a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_a464e3a5f7d3a7aecb4da8c0690aa20f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_be0b643d033c2fe6598ce050aa69c0e6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_32c183f631844a97d3c711ede9c7a024.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63c61a93-29a7-57cb-a99f-b685e5dea09c with identifier: PC35903
2026-03-27 10:42:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63c61a93-29a7-57cb-a99f-b685e5dea09c with identifier: PC35903
2026-03-27 10:42:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63c61a93-29a7-57cb-a99f-b685e5dea09c with identifier: PC35903 to the API
2026-03-27 10:42:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:05:50Z',
 'fuel_type': 'petrol',
 'id': '63c61a93-29a7-57cb-a99f-b685e5dea09c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC35903',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 88460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-20',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2009}
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC35903%27 HTTP/1.1" 200 None
2026-03-27 10:42:25 [auto1.de] INFO: Saving data for PC35903: {'auction_closing_time': 1774713950.0, 'created_time': 1773399707.834131, 'last_price_update_time': 1774608145.185978}
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC35903') HTTP/1.1" 204 0
2026-03-27 10:42:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e32fb9f9-eae3-5351-b884-495dfcd6aafa with identifier: KC98509
2026-03-27 10:42:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e32fb9f9-eae3-5351-b884-495dfcd6aafa with identifier: KC98509
2026-03-27 10:42:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e32fb9f9-eae3-5351-b884-495dfcd6aafa with identifier: KC98509 to the API
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:36:58Z',
 'fuel_type': 'diesel',
 'id': 'e32fb9f9-eae3-5351-b884-495dfcd6aafa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC98509',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 250642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-28',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC98509%27 HTTP/1.1" 200 None
2026-03-27 10:42:25 [auto1.de] INFO: Saving data for KC98509: {'auction_closing_time': 1774715818.0, 'created_time': 1774293697.003453, 'last_price_update_time': 1774608145.679226}
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC98509') HTTP/1.1" 204 0
2026-03-27 10:42:25 [auto1.de] INFO: Found listing with ID: YJ23133
2026-03-27 10:42:25 [auto1.de] INFO: Found listing with ID: GD48947
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD48947%27 HTTP/1.1" 200 None
2026-03-27 10:42:25 [auto1.de] INFO: Scrape type for GD48947: 2
2026-03-27 10:42:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e74d3abc-421f-5100-aa4f-fbc197713ee8 with identifier: GD48947
2026-03-27 10:42:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e74d3abc-421f-5100-aa4f-fbc197713ee8 with scrape type 2
2026-03-27 10:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e74d3abc-421f-5100-aa4f-fbc197713ee8 with scrape type 2
2026-03-27 10:42:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e74d3abc-421f-5100-aa4f-fbc197713ee8, identifier: GD48947
2026-03-27 10:42:25 [auto1.de] INFO: Found listing with ID: SA82608
2026-03-27 10:42:25 [auto1.de] INFO: Found listing with ID: WZ21973
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ21973%27 HTTP/1.1" 200 None
2026-03-27 10:42:25 [auto1.de] INFO: Scrape type for WZ21973: 2
2026-03-27 10:42:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8190a8f7-7760-5055-b346-917965981869 with identifier: WZ21973
2026-03-27 10:42:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8190a8f7-7760-5055-b346-917965981869 with scrape type 2
2026-03-27 10:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8190a8f7-7760-5055-b346-917965981869 with scrape type 2
2026-03-27 10:42:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8190a8f7-7760-5055-b346-917965981869, identifier: WZ21973
2026-03-27 10:42:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e74d3abc-421f-5100-aa4f-fbc197713ee8 with identifier: GD48947
2026-03-27 10:42:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e74d3abc-421f-5100-aa4f-fbc197713ee8 with identifier: GD48947
2026-03-27 10:42:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e74d3abc-421f-5100-aa4f-fbc197713ee8 with identifier: GD48947 to the API
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:23:25Z',
 'fuel_type': 'petrol',
 'id': 'e74d3abc-421f-5100-aa4f-fbc197713ee8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD48947',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 106187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-16',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD48947%27 HTTP/1.1" 200 None
2026-03-27 10:42:26 [auto1.de] INFO: Saving data for GD48947: {'auction_closing_time': 1774715005.0, 'created_time': 1773341710.167857, 'last_price_update_time': 1774608146.439058}
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD48947') HTTP/1.1" 204 0
2026-03-27 10:42:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8190a8f7-7760-5055-b346-917965981869 with identifier: WZ21973
2026-03-27 10:42:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8190a8f7-7760-5055-b346-917965981869 with identifier: WZ21973
2026-03-27 10:42:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8190a8f7-7760-5055-b346-917965981869 with identifier: WZ21973 to the API
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 50,
 'expiration_date': '2026-03-28T16:01:38Z',
 'fuel_type': 'petrol',
 'id': '8190a8f7-7760-5055-b346-917965981869',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ21973',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Lupo',
 'odometer': 80907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-02-28',
 'seller_name': None,
 'title': 'Volkswagen Lupo 1.0 Rave',
 'transmission': 'manual',
 'trim': 'Rave',
 'year': 2005}
2026-03-27 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ21973%27 HTTP/1.1" 200 None
2026-03-27 10:42:27 [auto1.de] INFO: Saving data for WZ21973: {'auction_closing_time': 1774713698.0, 'created_time': 1774118809.300286, 'last_price_update_time': 1774608147.097465}
2026-03-27 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ21973') HTTP/1.1" 204 0
2026-03-27 10:42:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_9eb5c5c415022e47b7dc0de8d7a2bbfa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:27 [auto1.de] INFO: Found listing with ID: SD67792
2026-03-27 10:42:27 [auto1.de] INFO: Found listing with ID: JS29851
2026-03-27 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS29851%27 HTTP/1.1" 200 None
2026-03-27 10:42:27 [auto1.de] INFO: Scrape type for JS29851: 2
2026-03-27 10:42:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7abbbe02-7b71-5312-a9dd-9c6332e77b83 with identifier: JS29851
2026-03-27 10:42:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7abbbe02-7b71-5312-a9dd-9c6332e77b83 with scrape type 2
2026-03-27 10:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7abbbe02-7b71-5312-a9dd-9c6332e77b83 with scrape type 2
2026-03-27 10:42:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7abbbe02-7b71-5312-a9dd-9c6332e77b83, identifier: JS29851
2026-03-27 10:42:27 [auto1.de] INFO: Found listing with ID: PR56411
2026-03-27 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR56411%27 HTTP/1.1" 200 None
2026-03-27 10:42:27 [auto1.de] INFO: Scrape type for PR56411: 2
2026-03-27 10:42:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54827405-4c25-51bb-abc2-5e8043bc3c6d with identifier: PR56411
2026-03-27 10:42:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54827405-4c25-51bb-abc2-5e8043bc3c6d with scrape type 2
2026-03-27 10:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54827405-4c25-51bb-abc2-5e8043bc3c6d with scrape type 2
2026-03-27 10:42:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54827405-4c25-51bb-abc2-5e8043bc3c6d, identifier: PR56411
2026-03-27 10:42:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_3c01c303b59eba74fcb54b6baa35a21c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_4b21d55408663bafd0152ccfa392dbf6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_7860b6a729b38a7bdd430b3b2518ae38.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7abbbe02-7b71-5312-a9dd-9c6332e77b83 with identifier: JS29851
2026-03-27 10:42:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7abbbe02-7b71-5312-a9dd-9c6332e77b83 with identifier: JS29851
2026-03-27 10:42:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7abbbe02-7b71-5312-a9dd-9c6332e77b83 with identifier: JS29851 to the API
2026-03-27 10:42:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:48:09Z',
 'fuel_type': 'diesel',
 'id': '7abbbe02-7b71-5312-a9dd-9c6332e77b83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS29851',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 295365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-28',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2011}
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS29851%27 HTTP/1.1" 200 None
2026-03-27 10:42:29 [auto1.de] INFO: Saving data for JS29851: {'auction_closing_time': 1774716489.0, 'created_time': 1774294352.430586, 'last_price_update_time': 1774608149.009141}
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS29851') HTTP/1.1" 204 0
2026-03-27 10:42:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54827405-4c25-51bb-abc2-5e8043bc3c6d with identifier: PR56411
2026-03-27 10:42:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54827405-4c25-51bb-abc2-5e8043bc3c6d with identifier: PR56411
2026-03-27 10:42:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54827405-4c25-51bb-abc2-5e8043bc3c6d with identifier: PR56411 to the API
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:52:01Z',
 'fuel_type': 'petrol',
 'id': '54827405-4c25-51bb-abc2-5e8043bc3c6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR56411',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 142346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-13',
 'seller_name': None,
 'title': 'Volvo V90 2.0 T4 R-Design',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2018}
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR56411%27 HTTP/1.1" 200 None
2026-03-27 10:42:29 [auto1.de] INFO: Saving data for PR56411: {'auction_closing_time': 1774716721.0, 'created_time': 1773858952.110516, 'last_price_update_time': 1774608149.420679}
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR56411') HTTP/1.1" 204 0
2026-03-27 10:42:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50037f910>
2026-03-27 10:42:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca1e339-af0d-51ec-a9c0-bf60c09fb49a/4ca1e339-af0d-51ec-a9c0-bf60c09fb49a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee63a8179d6de831c9d3d2594a100%252Fpa%252FME89657_f0e74d5ad39da42a162750360c97a99a.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_f0e74d5ad39da42a162750360c97a99a.jpg saved to cache
2026-03-27 10:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a
2026-03-27 10:42:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501972d50>
2026-03-27 10:42:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc47f720-0a2b-59f0-a249-ab17fbc46c7b/dc47f720-0a2b-59f0-a249-ab17fbc46c7b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F1c%252F6a1ca83bb557168b14f4c98b0d711296%252Fpa%252FBJ13428_a464e3a5f7d3a7aecb4da8c0690aa20f.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_a464e3a5f7d3a7aecb4da8c0690aa20f.jpg saved to cache
2026-03-27 10:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dc47f720-0a2b-59f0-a249-ab17fbc46c7b
2026-03-27 10:42:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501654110>
2026-03-27 10:42:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ee2ffb3-d991-522e-a064-81a9c082e71b/6ee2ffb3-d991-522e-a064-81a9c082e71b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0e%252Fb00e5b094d73afab5067aa60017dac63%252Fpa%252FBB84550_be0b643d033c2fe6598ce050aa69c0e6.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_be0b643d033c2fe6598ce050aa69c0e6.jpg saved to cache
2026-03-27 10:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ee2ffb3-d991-522e-a064-81a9c082e71b
2026-03-27 10:42:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50020e1d0>
2026-03-27 10:42:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caa7f59e-3138-5b9a-b132-35704fa2c10d/caa7f59e-3138-5b9a-b132-35704fa2c10d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9b%252Fdf9bd3b157037f0c9cd13e89772d6e95%252Fpa%252FMY92722_32c183f631844a97d3c711ede9c7a024.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_32c183f631844a97d3c711ede9c7a024.jpg saved to cache
2026-03-27 10:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item caa7f59e-3138-5b9a-b132-35704fa2c10d
2026-03-27 10:42:29 [auto1.de] INFO: Found listing with ID: JW09174
2026-03-27 10:42:29 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB25738%27 HTTP/1.1" 200 None
2026-03-27 10:42:29 [auto1.de] INFO: Scrape type for RB25738: 0
2026-03-27 10:42:29 [auto1.de] INFO: Found listing with ID: TB33384
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB33384%27 HTTP/1.1" 200 None
2026-03-27 10:42:29 [auto1.de] INFO: Scrape type for TB33384: 0
2026-03-27 10:42:29 [auto1.de] INFO: Found listing with ID: SD72223
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD72223%27 HTTP/1.1" 200 None
2026-03-27 10:42:29 [auto1.de] INFO: Scrape type for SD72223: 1
2026-03-27 10:42:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501749ad0>
2026-03-27 10:42:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca1e339-af0d-51ec-a9c0-bf60c09fb49a/4ca1e339-af0d-51ec-a9c0-bf60c09fb49a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee63a8179d6de831c9d3d2594a100%252Fpa%252FME89657_9eb5c5c415022e47b7dc0de8d7a2bbfa.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_9eb5c5c415022e47b7dc0de8d7a2bbfa.jpg saved to cache
2026-03-27 10:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a
2026-03-27 10:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_d0327312ae10e8db22dcccb77d9606a4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:29 [auto1.de] INFO: Found listing with ID: EH74831
2026-03-27 10:42:29 [auto1.de] INFO: Found listing with ID: CA50565
2026-03-27 10:42:29 [auto1.de] INFO: Found listing with ID: JB08013
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB08013%27 HTTP/1.1" 200 None
2026-03-27 10:42:29 [auto1.de] INFO: Scrape type for JB08013: 2
2026-03-27 10:42:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40e6d0ad-e90b-5313-b0d3-eac18c29479b with identifier: JB08013
2026-03-27 10:42:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40e6d0ad-e90b-5313-b0d3-eac18c29479b with scrape type 2
2026-03-27 10:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40e6d0ad-e90b-5313-b0d3-eac18c29479b with scrape type 2
2026-03-27 10:42:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40e6d0ad-e90b-5313-b0d3-eac18c29479b, identifier: JB08013
2026-03-27 10:42:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_1ac6e9713d473d11330db7603b7f8f53.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40e6d0ad-e90b-5313-b0d3-eac18c29479b with identifier: JB08013
2026-03-27 10:42:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40e6d0ad-e90b-5313-b0d3-eac18c29479b with identifier: JB08013
2026-03-27 10:42:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40e6d0ad-e90b-5313-b0d3-eac18c29479b with identifier: JB08013 to the API
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:34:35Z',
 'fuel_type': 'petrol',
 'id': '40e6d0ad-e90b-5313-b0d3-eac18c29479b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB08013',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 131935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-26',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 SIDI Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2018}
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB08013%27 HTTP/1.1" 200 None
2026-03-27 10:42:30 [auto1.de] INFO: Saving data for JB08013: {'auction_closing_time': 1774715675.0, 'created_time': 1773401925.625186, 'last_price_update_time': 1774608150.559695}
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB08013') HTTP/1.1" 204 0
2026-03-27 10:42:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:42:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500458c90>
2026-03-27 10:42:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ee2ffb3-d991-522e-a064-81a9c082e71b/6ee2ffb3-d991-522e-a064-81a9c082e71b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0e%252Fb00e5b094d73afab5067aa60017dac63%252Fpa%252FBB84550_3c01c303b59eba74fcb54b6baa35a21c.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_3c01c303b59eba74fcb54b6baa35a21c.jpg saved to cache
2026-03-27 10:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ee2ffb3-d991-522e-a064-81a9c082e71b
2026-03-27 10:42:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003393d0>
2026-03-27 10:42:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc47f720-0a2b-59f0-a249-ab17fbc46c7b/dc47f720-0a2b-59f0-a249-ab17fbc46c7b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F1c%252F6a1ca83bb557168b14f4c98b0d711296%252Fpa%252FBJ13428_4b21d55408663bafd0152ccfa392dbf6.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_4b21d55408663bafd0152ccfa392dbf6.jpg saved to cache
2026-03-27 10:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc47f720-0a2b-59f0-a249-ab17fbc46c7b
2026-03-27 10:42:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015e2350>
2026-03-27 10:42:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3aea76f-6bbe-50f5-b2e0-c358667c15fa/d3aea76f-6bbe-50f5-b2e0-c358667c15fa_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F71%252Fb47185a0b558a2051a0d6e3efdadae5f%252Fpa%252FXG24427_7860b6a729b38a7bdd430b3b2518ae38.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_7860b6a729b38a7bdd430b3b2518ae38.jpg saved to cache
2026-03-27 10:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3aea76f-6bbe-50f5-b2e0-c358667c15fa
2026-03-27 10:42:30 [auto1.de] INFO: Found listing with ID: XR26970
2026-03-27 10:42:30 [auto1.de] INFO: Found listing with ID: LT21646
2026-03-27 10:42:30 [auto1.de] INFO: Found listing with ID: UE57150
2026-03-27 10:42:30 [auto1.de] INFO: Found listing with ID: DK31638
2026-03-27 10:42:30 [auto1.de] INFO: Found listing with ID: WE87101
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE87101%27 HTTP/1.1" 200 None
2026-03-27 10:42:30 [auto1.de] INFO: Scrape type for WE87101: 2
2026-03-27 10:42:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75645dd4-8e13-5fc9-af5e-123ac71bf0ed with identifier: WE87101
2026-03-27 10:42:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75645dd4-8e13-5fc9-af5e-123ac71bf0ed with scrape type 2
2026-03-27 10:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75645dd4-8e13-5fc9-af5e-123ac71bf0ed with scrape type 2
2026-03-27 10:42:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75645dd4-8e13-5fc9-af5e-123ac71bf0ed, identifier: WE87101
2026-03-27 10:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_9f6a57228eae1f602303335d601ed41b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_1c79ad07c14d3fce80041af4c59f9fb5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75645dd4-8e13-5fc9-af5e-123ac71bf0ed with identifier: WE87101
2026-03-27 10:42:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75645dd4-8e13-5fc9-af5e-123ac71bf0ed with identifier: WE87101
2026-03-27 10:42:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75645dd4-8e13-5fc9-af5e-123ac71bf0ed with identifier: WE87101 to the API
2026-03-27 10:42:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:13:10Z',
 'fuel_type': 'diesel',
 'id': '75645dd4-8e13-5fc9-af5e-123ac71bf0ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE87101',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 213012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-25',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE87101%27 HTTP/1.1" 200 None
2026-03-27 10:42:31 [auto1.de] INFO: Saving data for WE87101: {'auction_closing_time': 1774714390.0, 'created_time': 1773305537.484248, 'last_price_update_time': 1774608151.413563}
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE87101') HTTP/1.1" 204 0
2026-03-27 10:42:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EJ83325> (referer: https://www.auto1.com/v1/car-details-view/EJ83325/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_f8b357c02aa157fb82636e5d36e55cd5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_4c79ac28ada5782c12a61a84ee179fa1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:31 [auto1.de] INFO: Found listing with ID: HB50510
2026-03-27 10:42:31 [auto1.de] INFO: Found listing with ID: CK11382
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK11382%27 HTTP/1.1" 200 None
2026-03-27 10:42:31 [auto1.de] INFO: Scrape type for CK11382: 2
2026-03-27 10:42:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a0d12bf-fe4a-5afa-b364-f03b4fc1f749 with identifier: CK11382
2026-03-27 10:42:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a0d12bf-fe4a-5afa-b364-f03b4fc1f749 with scrape type 2
2026-03-27 10:42:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a0d12bf-fe4a-5afa-b364-f03b4fc1f749 with scrape type 2
2026-03-27 10:42:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a0d12bf-fe4a-5afa-b364-f03b4fc1f749, identifier: CK11382
2026-03-27 10:42:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d8610>
2026-03-27 10:42:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caa7f59e-3138-5b9a-b132-35704fa2c10d/caa7f59e-3138-5b9a-b132-35704fa2c10d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9b%252Fdf9bd3b157037f0c9cd13e89772d6e95%252Fpa%252FMY92722_d0327312ae10e8db22dcccb77d9606a4.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_d0327312ae10e8db22dcccb77d9606a4.jpg saved to cache
2026-03-27 10:42:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item caa7f59e-3138-5b9a-b132-35704fa2c10d
2026-03-27 10:42:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001bab90>
2026-03-27 10:42:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc47f720-0a2b-59f0-a249-ab17fbc46c7b/dc47f720-0a2b-59f0-a249-ab17fbc46c7b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F1c%252F6a1ca83bb557168b14f4c98b0d711296%252Fpa%252FBJ13428_1ac6e9713d473d11330db7603b7f8f53.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_1ac6e9713d473d11330db7603b7f8f53.jpg saved to cache
2026-03-27 10:42:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc47f720-0a2b-59f0-a249-ab17fbc46c7b
2026-03-27 10:42:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a0d12bf-fe4a-5afa-b364-f03b4fc1f749 with identifier: CK11382
2026-03-27 10:42:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a0d12bf-fe4a-5afa-b364-f03b4fc1f749 with identifier: CK11382
2026-03-27 10:42:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a0d12bf-fe4a-5afa-b364-f03b4fc1f749 with identifier: CK11382 to the API
2026-03-27 10:42:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:35:35Z',
 'fuel_type': 'diesel',
 'id': '8a0d12bf-fe4a-5afa-b364-f03b4fc1f749',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK11382',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 216450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-30',
 'seller_name': None,
 'title': 'Renault Megane 1.9 dCi BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2011}
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK11382%27 HTTP/1.1" 200 None
2026-03-27 10:42:32 [auto1.de] INFO: Saving data for CK11382: {'auction_closing_time': 1774715735.0, 'created_time': 1773429299.121517, 'last_price_update_time': 1774608152.393538}
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK11382') HTTP/1.1" 204 0
2026-03-27 10:42:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WD52714> (referer: https://www.auto1.com/v1/car-details-view/WD52714/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:32 [auto1.de] INFO: Found listing with ID: WP04220
2026-03-27 10:42:32 [auto1.de] INFO: Found listing with ID: XP96351
2026-03-27 10:42:32 [auto1.de] INFO: Found listing with ID: SR18060
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR18060%27 HTTP/1.1" 200 None
2026-03-27 10:42:32 [auto1.de] INFO: Scrape type for SR18060: 2
2026-03-27 10:42:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e94f724-ab19-5609-b614-27fc9bcc81e4 with identifier: SR18060
2026-03-27 10:42:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e94f724-ab19-5609-b614-27fc9bcc81e4 with scrape type 2
2026-03-27 10:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e94f724-ab19-5609-b614-27fc9bcc81e4 with scrape type 2
2026-03-27 10:42:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e94f724-ab19-5609-b614-27fc9bcc81e4, identifier: SR18060
2026-03-27 10:42:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c5c90>
2026-03-27 10:42:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caa7f59e-3138-5b9a-b132-35704fa2c10d/caa7f59e-3138-5b9a-b132-35704fa2c10d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9b%252Fdf9bd3b157037f0c9cd13e89772d6e95%252Fpa%252FMY92722_9f6a57228eae1f602303335d601ed41b.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_9f6a57228eae1f602303335d601ed41b.jpg saved to cache
2026-03-27 10:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item caa7f59e-3138-5b9a-b132-35704fa2c10d
2026-03-27 10:42:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50183f590>
2026-03-27 10:42:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3aea76f-6bbe-50f5-b2e0-c358667c15fa/d3aea76f-6bbe-50f5-b2e0-c358667c15fa_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F71%252Fb47185a0b558a2051a0d6e3efdadae5f%252Fpa%252FXG24427_1c79ad07c14d3fce80041af4c59f9fb5.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_1c79ad07c14d3fce80041af4c59f9fb5.jpg saved to cache
2026-03-27 10:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3aea76f-6bbe-50f5-b2e0-c358667c15fa
2026-03-27 10:42:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_3c0db70b2f9721934d5757ef01d2f38a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e94f724-ab19-5609-b614-27fc9bcc81e4 with identifier: SR18060
2026-03-27 10:42:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e94f724-ab19-5609-b614-27fc9bcc81e4 with identifier: SR18060
2026-03-27 10:42:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e94f724-ab19-5609-b614-27fc9bcc81e4 with identifier: SR18060 to the API
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:28:05Z',
 'fuel_type': 'petrol',
 'id': '7e94f724-ab19-5609-b614-27fc9bcc81e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR18060',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 112397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-29',
 'seller_name': None,
 'title': 'Opel Meriva 1.8 Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2008}
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR18060%27 HTTP/1.1" 200 None
2026-03-27 10:42:33 [auto1.de] INFO: Saving data for SR18060: {'auction_closing_time': 1774715285.0, 'created_time': 1773306171.017235, 'last_price_update_time': 1774608153.076324}
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR18060') HTTP/1.1" 204 0
2026-03-27 10:42:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cad041a1-6711-5ad4-98a5-636fc7f72769 with identifier: EJ83325
2026-03-27 10:42:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cad041a1-6711-5ad4-98a5-636fc7f72769 with scrape type 1
2026-03-27 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cad041a1-6711-5ad4-98a5-636fc7f72769
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F87%252Fb587189fdd842af71f0b58466ef1c0a3%252Fpa%252FEJ83325_0a0d53db4441527cc2cffacb67a146fe.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_0a0d53db4441527cc2cffacb67a146fe.jpg already downloaded
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F87%252Fb587189fdd842af71f0b58466ef1c0a3%252Fpa%252FEJ83325_5a08c49642c8c4be2fae395ae7979ec8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_5a08c49642c8c4be2fae395ae7979ec8.jpg already downloaded
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F87%252Fb587189fdd842af71f0b58466ef1c0a3%252Fpa%252FEJ83325_7d5c0793c9f6e9664bc90bfed48bcf76.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_7d5c0793c9f6e9664bc90bfed48bcf76.jpg already downloaded
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F87%252Fb587189fdd842af71f0b58466ef1c0a3%252Fpa%252FEJ83325_50fbf10ebb3e3f4a7091f1803eb22d89.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_50fbf10ebb3e3f4a7091f1803eb22d89.jpg already downloaded
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F87%252Fb587189fdd842af71f0b58466ef1c0a3%252Fpa%252FEJ83325_fb86a464556be5f0cedee292341ff036.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_fb86a464556be5f0cedee292341ff036.jpg already downloaded
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F87%252Fb587189fdd842af71f0b58466ef1c0a3%252Fpa%252FEJ83325_a4341cea6fa2870219a0c51946ce3c60.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_a4341cea6fa2870219a0c51946ce3c60.jpg already downloaded
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F87%252Fb587189fdd842af71f0b58466ef1c0a3%252Fpa%252FEJ83325_43219d69b54424be3099546a7252cea8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_43219d69b54424be3099546a7252cea8.jpg already downloaded
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F87%252Fb587189fdd842af71f0b58466ef1c0a3%252Fpa%252FEJ83325_d740278c0d1f63d72b1cd857ecd1e9cb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_d740278c0d1f63d72b1cd857ecd1e9cb.jpg already downloaded
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F87%252Fb587189fdd842af71f0b58466ef1c0a3%252Fpa%252FEJ83325_c0bf5e56f10a334acde9e9367fcc57b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_c0bf5e56f10a334acde9e9367fcc57b5.jpg already downloaded
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F87%252Fb587189fdd842af71f0b58466ef1c0a3%252Fpa%252FEJ83325_27dc70daa5b2efffc38539e7fd15e776.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_27dc70daa5b2efffc38539e7fd15e776.jpg already downloaded
2026-03-27 10:42:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cad041a1-6711-5ad4-98a5-636fc7f72769, identifier: EJ83325
2026-03-27 10:42:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:42:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501654dd0>
2026-03-27 10:42:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ee2ffb3-d991-522e-a064-81a9c082e71b/6ee2ffb3-d991-522e-a064-81a9c082e71b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F0e%252Fb00e5b094d73afab5067aa60017dac63%252Fpa%252FBB84550_f8b357c02aa157fb82636e5d36e55cd5.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_f8b357c02aa157fb82636e5d36e55cd5.jpg saved to cache
2026-03-27 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ee2ffb3-d991-522e-a064-81a9c082e71b
2026-03-27 10:42:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ee2ffb3-d991-522e-a064-81a9c082e71b, skipping ID generation
2026-03-27 10:42:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ee2ffb3-d991-522e-a064-81a9c082e71b with scrape type 1
2026-03-27 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ee2ffb3-d991-522e-a064-81a9c082e71b sending to next pipeline
2026-03-27 10:42:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ee2ffb3-d991-522e-a064-81a9c082e71b, identifier: BB84550
2026-03-27 10:42:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50039a350>
2026-03-27 10:42:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc47f720-0a2b-59f0-a249-ab17fbc46c7b/dc47f720-0a2b-59f0-a249-ab17fbc46c7b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F1c%252F6a1ca83bb557168b14f4c98b0d711296%252Fpa%252FBJ13428_4c79ac28ada5782c12a61a84ee179fa1.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_4c79ac28ada5782c12a61a84ee179fa1.jpg saved to cache
2026-03-27 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc47f720-0a2b-59f0-a249-ab17fbc46c7b
2026-03-27 10:42:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_a7e93442277e62291553a5c23de88f7c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_b7490fe03ced72b76059351d120a6895.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:33 [auto1.de] INFO: Found listing with ID: EP38579
2026-03-27 10:42:33 [auto1.de] INFO: Found listing with ID: EJ54624
2026-03-27 10:42:33 [auto1.de] INFO: Found listing with ID: BJ60837
2026-03-27 10:42:33 [auto1.de] INFO: Found listing with ID: TV47355
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV47355%27 HTTP/1.1" 200 None
2026-03-27 10:42:33 [auto1.de] INFO: Scrape type for TV47355: 2
2026-03-27 10:42:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c3cdf52-59c3-5208-b551-6bc3db9ad5d5 with identifier: TV47355
2026-03-27 10:42:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c3cdf52-59c3-5208-b551-6bc3db9ad5d5 with scrape type 2
2026-03-27 10:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c3cdf52-59c3-5208-b551-6bc3db9ad5d5 with scrape type 2
2026-03-27 10:42:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c3cdf52-59c3-5208-b551-6bc3db9ad5d5, identifier: TV47355
2026-03-27 10:42:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cad041a1-6711-5ad4-98a5-636fc7f72769 with identifier: EJ83325
2026-03-27 10:42:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cad041a1-6711-5ad4-98a5-636fc7f72769 with identifier: EJ83325
2026-03-27 10:42:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cad041a1-6711-5ad4-98a5-636fc7f72769 with identifier: EJ83325 to the API
2026-03-27 10:42:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EJ83325>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:22:29Z',
 'fuel_type': 'petrol',
 'id': 'cad041a1-6711-5ad4-98a5-636fc7f72769',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ83325',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 31095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_0a0d53db4441527cc2cffacb67a146fe.jpg',
                'https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_5a08c49642c8c4be2fae395ae7979ec8.jpg',
                'https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_7d5c0793c9f6e9664bc90bfed48bcf76.jpg',
                'https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_50fbf10ebb3e3f4a7091f1803eb22d89.jpg',
                'https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_fb86a464556be5f0cedee292341ff036.jpg',
                'https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_a4341cea6fa2870219a0c51946ce3c60.jpg',
                'https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_43219d69b54424be3099546a7252cea8.jpg',
                'https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_d740278c0d1f63d72b1cd857ecd1e9cb.jpg',
                'https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_c0bf5e56f10a334acde9e9367fcc57b5.jpg',
                'https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_27dc70daa5b2efffc38539e7fd15e776.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cad041a1-6711-5ad4-98a5-636fc7f72769/cad041a1-6711-5ad4-98a5-636fc7f72769_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_0a0d53db4441527cc2cffacb67a146fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cad041a1-6711-5ad4-98a5-636fc7f72769/cad041a1-6711-5ad4-98a5-636fc7f72769_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_5a08c49642c8c4be2fae395ae7979ec8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cad041a1-6711-5ad4-98a5-636fc7f72769/cad041a1-6711-5ad4-98a5-636fc7f72769_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_7d5c0793c9f6e9664bc90bfed48bcf76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cad041a1-6711-5ad4-98a5-636fc7f72769/cad041a1-6711-5ad4-98a5-636fc7f72769_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_50fbf10ebb3e3f4a7091f1803eb22d89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cad041a1-6711-5ad4-98a5-636fc7f72769/cad041a1-6711-5ad4-98a5-636fc7f72769_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_fb86a464556be5f0cedee292341ff036.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cad041a1-6711-5ad4-98a5-636fc7f72769/cad041a1-6711-5ad4-98a5-636fc7f72769_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_a4341cea6fa2870219a0c51946ce3c60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cad041a1-6711-5ad4-98a5-636fc7f72769/cad041a1-6711-5ad4-98a5-636fc7f72769_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_43219d69b54424be3099546a7252cea8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cad041a1-6711-5ad4-98a5-636fc7f72769/cad041a1-6711-5ad4-98a5-636fc7f72769_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_d740278c0d1f63d72b1cd857ecd1e9cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cad041a1-6711-5ad4-98a5-636fc7f72769/cad041a1-6711-5ad4-98a5-636fc7f72769_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91072,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_c0bf5e56f10a334acde9e9367fcc57b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cad041a1-6711-5ad4-98a5-636fc7f72769/cad041a1-6711-5ad4-98a5-636fc7f72769_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/87/b587189fdd842af71f0b58466ef1c0a3/pa/EJ83325_27dc70daa5b2efffc38539e7fd15e776.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ83325%27 HTTP/1.1" 200 None
2026-03-27 10:42:34 [auto1.de] INFO: Saving data for EJ83325: {'created_time': 1774608154.574378, 'last_price_update_time': 1774608154.574391, 'auction_closing_time': 1774714949.0}
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ83325') HTTP/1.1" 204 0
2026-03-27 10:42:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ee2ffb3-d991-522e-a064-81a9c082e71b with identifier: BB84550
2026-03-27 10:42:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ee2ffb3-d991-522e-a064-81a9c082e71b with identifier: BB84550
2026-03-27 10:42:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ee2ffb3-d991-522e-a064-81a9c082e71b with identifier: BB84550 to the API
2026-03-27 10:42:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_f8b357c02aa157fb82636e5d36e55cd5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:26:55Z',
 'fuel_type': 'petrol',
 'id': '6ee2ffb3-d991-522e-a064-81a9c082e71b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB84550',
 'listing': 'auction',
 'location': 'DE, Rostock',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 106866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ee2ffb3-d991-522e-a064-81a9c082e71b/6ee2ffb3-d991-522e-a064-81a9c082e71b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_be0b643d033c2fe6598ce050aa69c0e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ee2ffb3-d991-522e-a064-81a9c082e71b/6ee2ffb3-d991-522e-a064-81a9c082e71b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_ec1e392e440c9b55b9bc8432654351ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ee2ffb3-d991-522e-a064-81a9c082e71b/6ee2ffb3-d991-522e-a064-81a9c082e71b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2440494,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_3c01c303b59eba74fcb54b6baa35a21c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ee2ffb3-d991-522e-a064-81a9c082e71b/6ee2ffb3-d991-522e-a064-81a9c082e71b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_78c4fe4ab944e2b6676f5b3ab172aadd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ee2ffb3-d991-522e-a064-81a9c082e71b/6ee2ffb3-d991-522e-a064-81a9c082e71b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2573543,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_f8b357c02aa157fb82636e5d36e55cd5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ee2ffb3-d991-522e-a064-81a9c082e71b/6ee2ffb3-d991-522e-a064-81a9c082e71b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_729cc40f0f6a02263d4359b68d5331e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ee2ffb3-d991-522e-a064-81a9c082e71b/6ee2ffb3-d991-522e-a064-81a9c082e71b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_cb9942f3c65d5d43745b9cb8cb589b02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ee2ffb3-d991-522e-a064-81a9c082e71b/6ee2ffb3-d991-522e-a064-81a9c082e71b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_8b7c75aa62cbf62c83ac4ce79012a93f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ee2ffb3-d991-522e-a064-81a9c082e71b/6ee2ffb3-d991-522e-a064-81a9c082e71b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_b33a76c2ec1b0bf962fa0eb3379fce98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ee2ffb3-d991-522e-a064-81a9c082e71b/6ee2ffb3-d991-522e-a064-81a9c082e71b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/0e/b00e5b094d73afab5067aa60017dac63/pa/BB84550_ec682dfd80a23436a6a61e2c3cd6f5dc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.6 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2011}
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB84550%27 HTTP/1.1" 200 None
2026-03-27 10:42:35 [auto1.de] INFO: Saving data for BB84550: {'created_time': 1774608155.165573, 'last_price_update_time': 1774608155.165588, 'auction_closing_time': 1774715215.0}
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB84550') HTTP/1.1" 204 0
2026-03-27 10:42:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c3cdf52-59c3-5208-b551-6bc3db9ad5d5 with identifier: TV47355
2026-03-27 10:42:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c3cdf52-59c3-5208-b551-6bc3db9ad5d5 with identifier: TV47355
2026-03-27 10:42:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c3cdf52-59c3-5208-b551-6bc3db9ad5d5 with identifier: TV47355 to the API
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:45:38Z',
 'fuel_type': 'petrol',
 'id': '6c3cdf52-59c3-5208-b551-6bc3db9ad5d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV47355',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'BRZ',
 'odometer': 17574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-14',
 'seller_name': None,
 'title': 'Subaru BRZ 2.0 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2018}
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV47355%27 HTTP/1.1" 200 None
2026-03-27 10:42:35 [auto1.de] INFO: Saving data for TV47355: {'auction_closing_time': 1774716338.0, 'created_time': 1773307327.403504, 'last_price_update_time': 1774608155.671506}
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV47355') HTTP/1.1" 204 0
2026-03-27 10:42:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AJ83009> (referer: https://www.auto1.com/v1/car-details-view/AJ83009/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 541348c9-84cf-5aab-b956-6ff98c877dbc with identifier: WD52714
2026-03-27 10:42:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 541348c9-84cf-5aab-b956-6ff98c877dbc with scrape type 1
2026-03-27 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 541348c9-84cf-5aab-b956-6ff98c877dbc
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fed%252Fb2ede1040f3ad7c6c2863504b8b4b4c4%252Fpa%252FWD52714_3f0de11bac55d3b91b739f01b1285c12.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_3f0de11bac55d3b91b739f01b1285c12.jpg already downloaded
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fed%252Fb2ede1040f3ad7c6c2863504b8b4b4c4%252Fpa%252FWD52714_e9e803d9fffd1b3f90f7e1635c716629.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_e9e803d9fffd1b3f90f7e1635c716629.jpg already downloaded
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fed%252Fb2ede1040f3ad7c6c2863504b8b4b4c4%252Fpa%252FWD52714_28d4e8a4c84f28c3bec60ecaf37f0dc3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_28d4e8a4c84f28c3bec60ecaf37f0dc3.jpg already downloaded
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fed%252Fb2ede1040f3ad7c6c2863504b8b4b4c4%252Fpa%252FWD52714_bcaafc0e9460c0762b7a089dcf448aad.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_bcaafc0e9460c0762b7a089dcf448aad.jpg already downloaded
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fed%252Fb2ede1040f3ad7c6c2863504b8b4b4c4%252Fpa%252FWD52714_3e4344061dccfb3d2f191389b44e46f7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_3e4344061dccfb3d2f191389b44e46f7.jpg already downloaded
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fed%252Fb2ede1040f3ad7c6c2863504b8b4b4c4%252Fpa%252FWD52714_d8da7797e112a026a58b5a09cd7a3d47.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_d8da7797e112a026a58b5a09cd7a3d47.jpg already downloaded
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fed%252Fb2ede1040f3ad7c6c2863504b8b4b4c4%252Fpa%252FWD52714_6127481b016014fb562ccbddade587e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_6127481b016014fb562ccbddade587e5.jpg already downloaded
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fed%252Fb2ede1040f3ad7c6c2863504b8b4b4c4%252Fpa%252FWD52714_c992c193e6e0e69dae43298476c36e41.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_c992c193e6e0e69dae43298476c36e41.jpg already downloaded
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fed%252Fb2ede1040f3ad7c6c2863504b8b4b4c4%252Fpa%252FWD52714_d245b2a0aadaaed35e38580c91a8af77.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_d245b2a0aadaaed35e38580c91a8af77.jpg already downloaded
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fed%252Fb2ede1040f3ad7c6c2863504b8b4b4c4%252Fpa%252FWD52714_ba14f72db9e28b934d31a0e1cd9a1b5c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_ba14f72db9e28b934d31a0e1cd9a1b5c.jpg already downloaded
2026-03-27 10:42:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 541348c9-84cf-5aab-b956-6ff98c877dbc, identifier: WD52714
2026-03-27 10:42:36 [auto1.de] INFO: Found listing with ID: MK04993
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK04993%27 HTTP/1.1" 200 None
2026-03-27 10:42:36 [auto1.de] INFO: Scrape type for MK04993: 2
2026-03-27 10:42:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bc3b66c-4eee-50e6-8696-fbd62b006d81 with identifier: MK04993
2026-03-27 10:42:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bc3b66c-4eee-50e6-8696-fbd62b006d81 with scrape type 2
2026-03-27 10:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bc3b66c-4eee-50e6-8696-fbd62b006d81 with scrape type 2
2026-03-27 10:42:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bc3b66c-4eee-50e6-8696-fbd62b006d81, identifier: MK04993
2026-03-27 10:42:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD72223/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 541348c9-84cf-5aab-b956-6ff98c877dbc with identifier: WD52714
2026-03-27 10:42:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 541348c9-84cf-5aab-b956-6ff98c877dbc with identifier: WD52714
2026-03-27 10:42:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 541348c9-84cf-5aab-b956-6ff98c877dbc with identifier: WD52714 to the API
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WD52714>
{'auction_title': '',
 'c_o_2_emission_value': 224,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '4.4L',
 'engine_horse_power': 450,
 'expiration_date': '2026-03-28T16:35:15Z',
 'fuel_type': 'petrol',
 'id': '541348c9-84cf-5aab-b956-6ff98c877dbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD52714',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 115888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_3f0de11bac55d3b91b739f01b1285c12.jpg',
                'https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_e9e803d9fffd1b3f90f7e1635c716629.jpg',
                'https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_28d4e8a4c84f28c3bec60ecaf37f0dc3.jpg',
                'https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_bcaafc0e9460c0762b7a089dcf448aad.jpg',
                'https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_3e4344061dccfb3d2f191389b44e46f7.jpg',
                'https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_d8da7797e112a026a58b5a09cd7a3d47.jpg',
                'https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_6127481b016014fb562ccbddade587e5.jpg',
                'https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_c992c193e6e0e69dae43298476c36e41.jpg',
                'https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_d245b2a0aadaaed35e38580c91a8af77.jpg',
                'https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_ba14f72db9e28b934d31a0e1cd9a1b5c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_541348c9-84cf-5aab-b956-6ff98c877dbc/541348c9-84cf-5aab-b956-6ff98c877dbc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_3f0de11bac55d3b91b739f01b1285c12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_541348c9-84cf-5aab-b956-6ff98c877dbc/541348c9-84cf-5aab-b956-6ff98c877dbc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_e9e803d9fffd1b3f90f7e1635c716629.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_541348c9-84cf-5aab-b956-6ff98c877dbc/541348c9-84cf-5aab-b956-6ff98c877dbc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_28d4e8a4c84f28c3bec60ecaf37f0dc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_541348c9-84cf-5aab-b956-6ff98c877dbc/541348c9-84cf-5aab-b956-6ff98c877dbc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_bcaafc0e9460c0762b7a089dcf448aad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_541348c9-84cf-5aab-b956-6ff98c877dbc/541348c9-84cf-5aab-b956-6ff98c877dbc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_3e4344061dccfb3d2f191389b44e46f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_541348c9-84cf-5aab-b956-6ff98c877dbc/541348c9-84cf-5aab-b956-6ff98c877dbc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_d8da7797e112a026a58b5a09cd7a3d47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_541348c9-84cf-5aab-b956-6ff98c877dbc/541348c9-84cf-5aab-b956-6ff98c877dbc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_6127481b016014fb562ccbddade587e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_541348c9-84cf-5aab-b956-6ff98c877dbc/541348c9-84cf-5aab-b956-6ff98c877dbc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_c992c193e6e0e69dae43298476c36e41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_541348c9-84cf-5aab-b956-6ff98c877dbc/541348c9-84cf-5aab-b956-6ff98c877dbc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_d245b2a0aadaaed35e38580c91a8af77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_541348c9-84cf-5aab-b956-6ff98c877dbc/541348c9-84cf-5aab-b956-6ff98c877dbc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/ed/b2ede1040f3ad7c6c2863504b8b4b4c4/pa/WD52714_ba14f72db9e28b934d31a0e1cd9a1b5c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 50i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD52714%27 HTTP/1.1" 200 None
2026-03-27 10:42:36 [auto1.de] INFO: Saving data for WD52714: {'created_time': 1774608156.661404, 'last_price_update_time': 1774608156.661417, 'auction_closing_time': 1774715715.0}
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD52714') HTTP/1.1" 204 0
2026-03-27 10:42:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_acfc19dbc745ee0aab6077d6d11cf584.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bc3b66c-4eee-50e6-8696-fbd62b006d81 with identifier: MK04993
2026-03-27 10:42:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bc3b66c-4eee-50e6-8696-fbd62b006d81 with identifier: MK04993
2026-03-27 10:42:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bc3b66c-4eee-50e6-8696-fbd62b006d81 with identifier: MK04993 to the API
2026-03-27 10:42:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:03:56Z',
 'fuel_type': 'diesel',
 'id': '3bc3b66c-4eee-50e6-8696-fbd62b006d81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK04993',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 322462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-21',
 'seller_name': None,
 'title': 'Skoda Yeti 2.0 TDI Active Plus Edition',
 'transmission': 'manual',
 'trim': 'Active Plus Edition',
 'year': 2012}
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK04993%27 HTTP/1.1" 200 None
2026-03-27 10:42:37 [auto1.de] INFO: Saving data for MK04993: {'auction_closing_time': 1774713836.0, 'created_time': 1773303164.589758, 'last_price_update_time': 1774608157.133347}
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK04993') HTTP/1.1" 204 0
2026-03-27 10:42:37 [auto1.de] INFO: Found listing with ID: DW90276
2026-03-27 10:42:37 [auto1.de] INFO: Found listing with ID: VN95277
2026-03-27 10:42:37 [auto1.de] INFO: Found listing with ID: CZ09118
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ09118%27 HTTP/1.1" 200 None
2026-03-27 10:42:37 [auto1.de] INFO: Scrape type for CZ09118: 2
2026-03-27 10:42:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b124c392-0426-5da5-a312-448a6fee290b with identifier: CZ09118
2026-03-27 10:42:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b124c392-0426-5da5-a312-448a6fee290b with scrape type 2
2026-03-27 10:42:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b124c392-0426-5da5-a312-448a6fee290b with scrape type 2
2026-03-27 10:42:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b124c392-0426-5da5-a312-448a6fee290b, identifier: CZ09118
2026-03-27 10:42:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500430490>
2026-03-27 10:42:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3aea76f-6bbe-50f5-b2e0-c358667c15fa/d3aea76f-6bbe-50f5-b2e0-c358667c15fa_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F71%252Fb47185a0b558a2051a0d6e3efdadae5f%252Fpa%252FXG24427_3c0db70b2f9721934d5757ef01d2f38a.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_3c0db70b2f9721934d5757ef01d2f38a.jpg saved to cache
2026-03-27 10:42:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3aea76f-6bbe-50f5-b2e0-c358667c15fa
2026-03-27 10:42:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50191ca50>
2026-03-27 10:42:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cefb2c-9a32-56da-9cb2-dec0ee44e74f/89cefb2c-9a32-56da-9cb2-dec0ee44e74f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc9%252F3fc986e50d8eef8936587fb5768548af%252Fpa%252FRY74387_a7e93442277e62291553a5c23de88f7c.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_a7e93442277e62291553a5c23de88f7c.jpg saved to cache
2026-03-27 10:42:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 89cefb2c-9a32-56da-9cb2-dec0ee44e74f
2026-03-27 10:42:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50170c790>
2026-03-27 10:42:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc47f720-0a2b-59f0-a249-ab17fbc46c7b/dc47f720-0a2b-59f0-a249-ab17fbc46c7b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F1c%252F6a1ca83bb557168b14f4c98b0d711296%252Fpa%252FBJ13428_b7490fe03ced72b76059351d120a6895.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_b7490fe03ced72b76059351d120a6895.jpg saved to cache
2026-03-27 10:42:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc47f720-0a2b-59f0-a249-ab17fbc46c7b
2026-03-27 10:42:37 [auto1.de] INFO: Channel: 24h | Page: 24 | totalHits: 10529 | hits on page: 40
2026-03-27 10:42:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9 with identifier: AJ83009
2026-03-27 10:42:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9 with scrape type 1
2026-03-27 10:42:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F35%252F233591f858a6924a526d6a12a8e90be4%252Fpa%252FAJ83009_82146f7e4f3bd0080dabaececd1f7a9a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/35/233591f858a6924a526d6a12a8e90be4/pa/AJ83009_82146f7e4f3bd0080dabaececd1f7a9a.jpg not downloaded yet
2026-03-27 10:42:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_2bf716de9e5fd73e7e3d5ea8f18e5176.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_9e005b99adce709b9cd0171e898cc68d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b124c392-0426-5da5-a312-448a6fee290b with identifier: CZ09118
2026-03-27 10:42:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b124c392-0426-5da5-a312-448a6fee290b with identifier: CZ09118
2026-03-27 10:42:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b124c392-0426-5da5-a312-448a6fee290b with identifier: CZ09118 to the API
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:44:25Z',
 'fuel_type': 'diesel',
 'id': 'b124c392-0426-5da5-a312-448a6fee290b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ09118',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 124628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-27',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Center-Line 2WD',
 'transmission': 'manual',
 'trim': 'Center-Line 2WD',
 'year': 2013}
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ09118%27 HTTP/1.1" 200 None
2026-03-27 10:42:38 [auto1.de] INFO: Saving data for CZ09118: {'auction_closing_time': 1774716265.0, 'created_time': 1773380777.39668, 'last_price_update_time': 1774608158.105395}
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ09118') HTTP/1.1" 204 0
2026-03-27 10:42:38 [auto1.de] INFO: Found listing with ID: YN35790
2026-03-27 10:42:38 [auto1.de] INFO: Found listing with ID: XP57282
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP57282%27 HTTP/1.1" 200 None
2026-03-27 10:42:38 [auto1.de] INFO: Scrape type for XP57282: 2
2026-03-27 10:42:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cf53482-cc35-5f32-8bdd-bd28d0971f95 with identifier: XP57282
2026-03-27 10:42:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cf53482-cc35-5f32-8bdd-bd28d0971f95 with scrape type 2
2026-03-27 10:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cf53482-cc35-5f32-8bdd-bd28d0971f95 with scrape type 2
2026-03-27 10:42:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cf53482-cc35-5f32-8bdd-bd28d0971f95, identifier: XP57282
2026-03-27 10:42:38 [auto1.de] INFO: Found listing with ID: NL95797
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL95797%27 HTTP/1.1" 200 None
2026-03-27 10:42:38 [auto1.de] INFO: Scrape type for NL95797: 2
2026-03-27 10:42:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8492b6fc-bacf-5dde-9866-4dd9dedca18d with identifier: NL95797
2026-03-27 10:42:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8492b6fc-bacf-5dde-9866-4dd9dedca18d with scrape type 2
2026-03-27 10:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8492b6fc-bacf-5dde-9866-4dd9dedca18d with scrape type 2
2026-03-27 10:42:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8492b6fc-bacf-5dde-9866-4dd9dedca18d, identifier: NL95797
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F35%252F233591f858a6924a526d6a12a8e90be4%252Fpa%252FAJ83009_4fee8f4dbc76f2585bf5454f0be0573e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/35/233591f858a6924a526d6a12a8e90be4/pa/AJ83009_4fee8f4dbc76f2585bf5454f0be0573e.jpg not downloaded yet
2026-03-27 10:42:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501969f50>
2026-03-27 10:42:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3aea76f-6bbe-50f5-b2e0-c358667c15fa/d3aea76f-6bbe-50f5-b2e0-c358667c15fa_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F71%252Fb47185a0b558a2051a0d6e3efdadae5f%252Fpa%252FXG24427_acfc19dbc745ee0aab6077d6d11cf584.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_acfc19dbc745ee0aab6077d6d11cf584.jpg saved to cache
2026-03-27 10:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3aea76f-6bbe-50f5-b2e0-c358667c15fa
2026-03-27 10:42:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cf53482-cc35-5f32-8bdd-bd28d0971f95 with identifier: XP57282
2026-03-27 10:42:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cf53482-cc35-5f32-8bdd-bd28d0971f95 with identifier: XP57282
2026-03-27 10:42:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cf53482-cc35-5f32-8bdd-bd28d0971f95 with identifier: XP57282 to the API
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:16:49Z',
 'fuel_type': 'petrol',
 'id': '5cf53482-cc35-5f32-8bdd-bd28d0971f95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP57282',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 104722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-13',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP57282%27 HTTP/1.1" 200 None
2026-03-27 10:42:38 [auto1.de] INFO: Saving data for XP57282: {'auction_closing_time': 1774714609.0, 'created_time': 1773381586.467769, 'last_price_update_time': 1774608158.89638}
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP57282') HTTP/1.1" 204 0
2026-03-27 10:42:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8492b6fc-bacf-5dde-9866-4dd9dedca18d with identifier: NL95797
2026-03-27 10:42:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8492b6fc-bacf-5dde-9866-4dd9dedca18d with identifier: NL95797
2026-03-27 10:42:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8492b6fc-bacf-5dde-9866-4dd9dedca18d with identifier: NL95797 to the API
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:09:45Z',
 'fuel_type': 'petrol',
 'id': '8492b6fc-bacf-5dde-9866-4dd9dedca18d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL95797',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 212684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-06-22',
 'seller_name': None,
 'title': 'BMW 3er 323i',
 'transmission': 'automatic',
 'trim': '',
 'year': 1998}
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL95797%27 HTTP/1.1" 200 None
2026-03-27 10:42:39 [auto1.de] INFO: Saving data for NL95797: {'auction_closing_time': 1774714185.0, 'created_time': 1773304505.260979, 'last_price_update_time': 1774608159.393031}
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL95797') HTTP/1.1" 204 0
2026-03-27 10:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_90c180465f580476f019b8dcf482ee49.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:39 [auto1.de] INFO: Found listing with ID: CF02627
2026-03-27 10:42:39 [auto1.de] INFO: Found listing with ID: TJ67594
2026-03-27 10:42:39 [auto1.de] INFO: Found listing with ID: AW80803
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW80803%27 HTTP/1.1" 200 None
2026-03-27 10:42:39 [auto1.de] INFO: Scrape type for AW80803: 2
2026-03-27 10:42:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4023a4d-bbf6-5c67-8337-e0ce3cfc3037 with identifier: AW80803
2026-03-27 10:42:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4023a4d-bbf6-5c67-8337-e0ce3cfc3037 with scrape type 2
2026-03-27 10:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4023a4d-bbf6-5c67-8337-e0ce3cfc3037 with scrape type 2
2026-03-27 10:42:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4023a4d-bbf6-5c67-8337-e0ce3cfc3037, identifier: AW80803
2026-03-27 10:42:39 [auto1.de] INFO: Found listing with ID: NV13181
2026-03-27 10:42:39 [auto1.de] INFO: Found listing with ID: BS26605
2026-03-27 10:42:39 [auto1.de] INFO: Found listing with ID: TD26953
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD26953%27 HTTP/1.1" 200 None
2026-03-27 10:42:39 [auto1.de] INFO: Scrape type for TD26953: 2
2026-03-27 10:42:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a876a45-a5c3-5dc1-9582-b545d2f499d4 with identifier: TD26953
2026-03-27 10:42:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a876a45-a5c3-5dc1-9582-b545d2f499d4 with scrape type 2
2026-03-27 10:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a876a45-a5c3-5dc1-9582-b545d2f499d4 with scrape type 2
2026-03-27 10:42:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a876a45-a5c3-5dc1-9582-b545d2f499d4, identifier: TD26953
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F35%252F233591f858a6924a526d6a12a8e90be4%252Fpa%252FAJ83009_936d9f9d1b400fb4b19498fc2d1379c4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/35/233591f858a6924a526d6a12a8e90be4/pa/AJ83009_936d9f9d1b400fb4b19498fc2d1379c4.jpg not downloaded yet
2026-03-27 10:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_a20e52e05c4c81c2e45e304232c23101.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_c8052d8bc92ad29e86fb5aa67d68c18d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4023a4d-bbf6-5c67-8337-e0ce3cfc3037 with identifier: AW80803
2026-03-27 10:42:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4023a4d-bbf6-5c67-8337-e0ce3cfc3037 with identifier: AW80803
2026-03-27 10:42:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4023a4d-bbf6-5c67-8337-e0ce3cfc3037 with identifier: AW80803 to the API
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:25:08Z',
 'fuel_type': 'hybrid',
 'id': 'b4023a4d-bbf6-5c67-8337-e0ce3cfc3037',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW80803',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 21405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-15',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 250e Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2024}
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW80803%27 HTTP/1.1" 200 None
2026-03-27 10:42:40 [auto1.de] INFO: Saving data for AW80803: {'auction_closing_time': 1774715108.0, 'created_time': 1772728430.984605, 'last_price_update_time': 1774608160.099765}
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW80803') HTTP/1.1" 204 0
2026-03-27 10:42:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a876a45-a5c3-5dc1-9582-b545d2f499d4 with identifier: TD26953
2026-03-27 10:42:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a876a45-a5c3-5dc1-9582-b545d2f499d4 with identifier: TD26953
2026-03-27 10:42:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a876a45-a5c3-5dc1-9582-b545d2f499d4 with identifier: TD26953 to the API
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:57:27Z',
 'fuel_type': 'diesel',
 'id': '7a876a45-a5c3-5dc1-9582-b545d2f499d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD26953',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 209908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD26953%27 HTTP/1.1" 200 None
2026-03-27 10:42:40 [auto1.de] INFO: Saving data for TD26953: {'auction_closing_time': 1774717047.0, 'created_time': 1773686361.194888, 'last_price_update_time': 1774608160.469981}
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD26953') HTTP/1.1" 204 0
2026-03-27 10:42:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016de810>
2026-03-27 10:42:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca1e339-af0d-51ec-a9c0-bf60c09fb49a/4ca1e339-af0d-51ec-a9c0-bf60c09fb49a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee63a8179d6de831c9d3d2594a100%252Fpa%252FME89657_2bf716de9e5fd73e7e3d5ea8f18e5176.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_2bf716de9e5fd73e7e3d5ea8f18e5176.jpg saved to cache
2026-03-27 10:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a
2026-03-27 10:42:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500451c50>
2026-03-27 10:42:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc47f720-0a2b-59f0-a249-ab17fbc46c7b/dc47f720-0a2b-59f0-a249-ab17fbc46c7b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F1c%252F6a1ca83bb557168b14f4c98b0d711296%252Fpa%252FBJ13428_9e005b99adce709b9cd0171e898cc68d.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_9e005b99adce709b9cd0171e898cc68d.jpg saved to cache
2026-03-27 10:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc47f720-0a2b-59f0-a249-ab17fbc46c7b
2026-03-27 10:42:40 [auto1.de] INFO: Found listing with ID: SR77795
2026-03-27 10:42:40 [auto1.de] INFO: Found listing with ID: LM29335
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM29335%27 HTTP/1.1" 200 None
2026-03-27 10:42:40 [auto1.de] INFO: Scrape type for LM29335: 2
2026-03-27 10:42:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffc3c853-802f-5962-991c-25050f35a253 with identifier: LM29335
2026-03-27 10:42:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffc3c853-802f-5962-991c-25050f35a253 with scrape type 2
2026-03-27 10:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffc3c853-802f-5962-991c-25050f35a253 with scrape type 2
2026-03-27 10:42:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffc3c853-802f-5962-991c-25050f35a253, identifier: LM29335
2026-03-27 10:42:40 [auto1.de] INFO: Found listing with ID: SK86846
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK86846%27 HTTP/1.1" 200 None
2026-03-27 10:42:40 [auto1.de] INFO: Scrape type for SK86846: 2
2026-03-27 10:42:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b255f93a-f3a6-5684-9880-b9238c99a1d2 with identifier: SK86846
2026-03-27 10:42:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b255f93a-f3a6-5684-9880-b9238c99a1d2 with scrape type 2
2026-03-27 10:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b255f93a-f3a6-5684-9880-b9238c99a1d2 with scrape type 2
2026-03-27 10:42:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b255f93a-f3a6-5684-9880-b9238c99a1d2, identifier: SK86846
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F35%252F233591f858a6924a526d6a12a8e90be4%252Fpa%252FAJ83009_7718fc208416289d5be769ada2dac0f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/35/233591f858a6924a526d6a12a8e90be4/pa/AJ83009_7718fc208416289d5be769ada2dac0f6.jpg not downloaded yet
2026-03-27 10:42:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffc3c853-802f-5962-991c-25050f35a253 with identifier: LM29335
2026-03-27 10:42:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffc3c853-802f-5962-991c-25050f35a253 with identifier: LM29335
2026-03-27 10:42:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffc3c853-802f-5962-991c-25050f35a253 with identifier: LM29335 to the API
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:16:35Z',
 'fuel_type': 'diesel',
 'id': 'ffc3c853-802f-5962-991c-25050f35a253',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM29335',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 188568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2017}
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM29335%27 HTTP/1.1" 200 None
2026-03-27 10:42:41 [auto1.de] INFO: Saving data for LM29335: {'auction_closing_time': 1774714595.0, 'created_time': 1773830710.363106, 'last_price_update_time': 1774608161.301747}
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM29335') HTTP/1.1" 204 0
2026-03-27 10:42:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b255f93a-f3a6-5684-9880-b9238c99a1d2 with identifier: SK86846
2026-03-27 10:42:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b255f93a-f3a6-5684-9880-b9238c99a1d2 with identifier: SK86846
2026-03-27 10:42:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b255f93a-f3a6-5684-9880-b9238c99a1d2 with identifier: SK86846 to the API
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 355,
 'expiration_date': '2026-03-28T16:02:55Z',
 'fuel_type': 'petrol',
 'id': 'b255f93a-f3a6-5684-9880-b9238c99a1d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK86846',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 161946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-01',
 'seller_name': None,
 'title': 'BMW X5 4.8i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK86846%27 HTTP/1.1" 200 None
2026-03-27 10:42:41 [auto1.de] INFO: Saving data for SK86846: {'auction_closing_time': 1774713775.0, 'created_time': 1773830968.221129, 'last_price_update_time': 1774608161.842046}
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK86846') HTTP/1.1" 204 0
2026-03-27 10:42:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a2e10>
2026-03-27 10:42:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caa7f59e-3138-5b9a-b132-35704fa2c10d/caa7f59e-3138-5b9a-b132-35704fa2c10d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9b%252Fdf9bd3b157037f0c9cd13e89772d6e95%252Fpa%252FMY92722_90c180465f580476f019b8dcf482ee49.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_90c180465f580476f019b8dcf482ee49.jpg saved to cache
2026-03-27 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item caa7f59e-3138-5b9a-b132-35704fa2c10d
2026-03-27 10:42:41 [auto1.de] INFO: Found listing with ID: NL95797
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL95797%27 HTTP/1.1" 200 None
2026-03-27 10:42:41 [auto1.de] INFO: Scrape type for NL95797: 0
2026-03-27 10:42:41 [auto1.de] INFO: Found listing with ID: DW78199
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW78199%27 HTTP/1.1" 200 None
2026-03-27 10:42:41 [auto1.de] INFO: Scrape type for DW78199: 2
2026-03-27 10:42:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56e1608e-d7cf-5a1a-9f42-3a8d91e81082 with identifier: DW78199
2026-03-27 10:42:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56e1608e-d7cf-5a1a-9f42-3a8d91e81082 with scrape type 2
2026-03-27 10:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56e1608e-d7cf-5a1a-9f42-3a8d91e81082 with scrape type 2
2026-03-27 10:42:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56e1608e-d7cf-5a1a-9f42-3a8d91e81082, identifier: DW78199
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F35%252F233591f858a6924a526d6a12a8e90be4%252Fpa%252FAJ83009_6fdbc8e2b375dfda195c5c43a3132ead.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/35/233591f858a6924a526d6a12a8e90be4/pa/AJ83009_6fdbc8e2b375dfda195c5c43a3132ead.jpg not downloaded yet
2026-03-27 10:42:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501729d50>
2026-03-27 10:42:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3aea76f-6bbe-50f5-b2e0-c358667c15fa/d3aea76f-6bbe-50f5-b2e0-c358667c15fa_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F71%252Fb47185a0b558a2051a0d6e3efdadae5f%252Fpa%252FXG24427_a20e52e05c4c81c2e45e304232c23101.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_a20e52e05c4c81c2e45e304232c23101.jpg saved to cache
2026-03-27 10:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3aea76f-6bbe-50f5-b2e0-c358667c15fa
2026-03-27 10:42:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50180a750>
2026-03-27 10:42:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cefb2c-9a32-56da-9cb2-dec0ee44e74f/89cefb2c-9a32-56da-9cb2-dec0ee44e74f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc9%252F3fc986e50d8eef8936587fb5768548af%252Fpa%252FRY74387_c8052d8bc92ad29e86fb5aa67d68c18d.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_c8052d8bc92ad29e86fb5aa67d68c18d.jpg saved to cache
2026-03-27 10:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 89cefb2c-9a32-56da-9cb2-dec0ee44e74f
2026-03-27 10:42:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_f287b7441e14da8757fe0e9be77ae5c1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_d6938e7750c228bcf538a9524cf5541e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_38cddca4fcf7b8804619013e6e4dd2d1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56e1608e-d7cf-5a1a-9f42-3a8d91e81082 with identifier: DW78199
2026-03-27 10:42:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56e1608e-d7cf-5a1a-9f42-3a8d91e81082 with identifier: DW78199
2026-03-27 10:42:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56e1608e-d7cf-5a1a-9f42-3a8d91e81082 with identifier: DW78199 to the API
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:47:32Z',
 'fuel_type': 'petrol',
 'id': '56e1608e-d7cf-5a1a-9f42-3a8d91e81082',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW78199',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 46733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-29',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW78199%27 HTTP/1.1" 200 None
2026-03-27 10:42:42 [auto1.de] INFO: Saving data for DW78199: {'auction_closing_time': 1774716452.0, 'created_time': 1773304343.368967, 'last_price_update_time': 1774608162.771616}
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW78199') HTTP/1.1" 204 0
2026-03-27 10:42:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:42 [auto1.de] INFO: Found listing with ID: CV81199
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV81199%27 HTTP/1.1" 200 None
2026-03-27 10:42:42 [auto1.de] INFO: Scrape type for CV81199: 2
2026-03-27 10:42:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d6086a7-abd0-529e-8d19-e032a96ef630 with identifier: CV81199
2026-03-27 10:42:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d6086a7-abd0-529e-8d19-e032a96ef630 with scrape type 2
2026-03-27 10:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d6086a7-abd0-529e-8d19-e032a96ef630 with scrape type 2
2026-03-27 10:42:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d6086a7-abd0-529e-8d19-e032a96ef630, identifier: CV81199
2026-03-27 10:42:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d6086a7-abd0-529e-8d19-e032a96ef630 with identifier: CV81199
2026-03-27 10:42:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d6086a7-abd0-529e-8d19-e032a96ef630 with identifier: CV81199
2026-03-27 10:42:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d6086a7-abd0-529e-8d19-e032a96ef630 with identifier: CV81199 to the API
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:25:22Z',
 'fuel_type': 'petrol',
 'id': '0d6086a7-abd0-529e-8d19-e032a96ef630',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV81199',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 79840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-18',
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Sendo 2WD',
 'transmission': 'manual',
 'trim': 'Sendo 2WD',
 'year': 2014}
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV81199%27 HTTP/1.1" 200 None
2026-03-27 10:42:43 [auto1.de] INFO: Saving data for CV81199: {'auction_closing_time': 1774715122.0, 'created_time': 1773775629.093129, 'last_price_update_time': 1774608163.307726}
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV81199') HTTP/1.1" 204 0
2026-03-27 10:42:43 [auto1.de] INFO: Found listing with ID: EC25925
2026-03-27 10:42:43 [auto1.de] INFO: Found listing with ID: UC14298
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC14298%27 HTTP/1.1" 200 None
2026-03-27 10:42:43 [auto1.de] INFO: Scrape type for UC14298: 1
2026-03-27 10:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_006e990975662e7b3dd0cd969c43e921.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_502a23a39d69d2acab54360ea3346803.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50186d9d0>
2026-03-27 10:42:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ca1e339-af0d-51ec-a9c0-bf60c09fb49a/4ca1e339-af0d-51ec-a9c0-bf60c09fb49a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F6e%252Fcc6ee63a8179d6de831c9d3d2594a100%252Fpa%252FME89657_f287b7441e14da8757fe0e9be77ae5c1.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_f287b7441e14da8757fe0e9be77ae5c1.jpg saved to cache
2026-03-27 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a
2026-03-27 10:42:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a, skipping ID generation
2026-03-27 10:42:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a with scrape type 1
2026-03-27 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a sending to next pipeline
2026-03-27 10:42:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a, identifier: ME89657
2026-03-27 10:42:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50186e950>
2026-03-27 10:42:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc47f720-0a2b-59f0-a249-ab17fbc46c7b/dc47f720-0a2b-59f0-a249-ab17fbc46c7b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F1c%252F6a1ca83bb557168b14f4c98b0d711296%252Fpa%252FBJ13428_d6938e7750c228bcf538a9524cf5541e.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_d6938e7750c228bcf538a9524cf5541e.jpg saved to cache
2026-03-27 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc47f720-0a2b-59f0-a249-ab17fbc46c7b
2026-03-27 10:42:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500394f10>
2026-03-27 10:42:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caa7f59e-3138-5b9a-b132-35704fa2c10d/caa7f59e-3138-5b9a-b132-35704fa2c10d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9b%252Fdf9bd3b157037f0c9cd13e89772d6e95%252Fpa%252FMY92722_38cddca4fcf7b8804619013e6e4dd2d1.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_38cddca4fcf7b8804619013e6e4dd2d1.jpg saved to cache
2026-03-27 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item caa7f59e-3138-5b9a-b132-35704fa2c10d
2026-03-27 10:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_81ff52e1f3a00173713513a0969cbf75.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:43 [auto1.de] INFO: Found listing with ID: XM89515
2026-03-27 10:42:43 [auto1.de] INFO: Found listing with ID: VX34650
2026-03-27 10:42:43 [auto1.de] INFO: Found listing with ID: AZ37362
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ37362%27 HTTP/1.1" 200 None
2026-03-27 10:42:43 [auto1.de] INFO: Scrape type for AZ37362: 2
2026-03-27 10:42:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c378422-00d0-5dec-93ef-2380983fa76e with identifier: AZ37362
2026-03-27 10:42:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c378422-00d0-5dec-93ef-2380983fa76e with scrape type 2
2026-03-27 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c378422-00d0-5dec-93ef-2380983fa76e with scrape type 2
2026-03-27 10:42:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c378422-00d0-5dec-93ef-2380983fa76e, identifier: AZ37362
2026-03-27 10:42:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a with identifier: ME89657
2026-03-27 10:42:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a with identifier: ME89657
2026-03-27 10:42:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a with identifier: ME89657 to the API
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_f287b7441e14da8757fe0e9be77ae5c1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:25:00Z',
 'fuel_type': 'diesel',
 'id': '4ca1e339-af0d-51ec-a9c0-bf60c09fb49a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME89657',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 84326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca1e339-af0d-51ec-a9c0-bf60c09fb49a/4ca1e339-af0d-51ec-a9c0-bf60c09fb49a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_e976ff167bc50c70eb302ed600ecc17c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca1e339-af0d-51ec-a9c0-bf60c09fb49a/4ca1e339-af0d-51ec-a9c0-bf60c09fb49a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_f287b7441e14da8757fe0e9be77ae5c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca1e339-af0d-51ec-a9c0-bf60c09fb49a/4ca1e339-af0d-51ec-a9c0-bf60c09fb49a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_2bf716de9e5fd73e7e3d5ea8f18e5176.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca1e339-af0d-51ec-a9c0-bf60c09fb49a/4ca1e339-af0d-51ec-a9c0-bf60c09fb49a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_141011daed1d2b838a98fc3b613945f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca1e339-af0d-51ec-a9c0-bf60c09fb49a/4ca1e339-af0d-51ec-a9c0-bf60c09fb49a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_7567a68f3c4907771d441ed91f56323d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca1e339-af0d-51ec-a9c0-bf60c09fb49a/4ca1e339-af0d-51ec-a9c0-bf60c09fb49a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_b2d1d508c2fc08b0d1587ab1ca260db2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca1e339-af0d-51ec-a9c0-bf60c09fb49a/4ca1e339-af0d-51ec-a9c0-bf60c09fb49a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_9eb5c5c415022e47b7dc0de8d7a2bbfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca1e339-af0d-51ec-a9c0-bf60c09fb49a/4ca1e339-af0d-51ec-a9c0-bf60c09fb49a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_2c51dcb8ee88e64b3b3b4dd416d988b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca1e339-af0d-51ec-a9c0-bf60c09fb49a/4ca1e339-af0d-51ec-a9c0-bf60c09fb49a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_f0e74d5ad39da42a162750360c97a99a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca1e339-af0d-51ec-a9c0-bf60c09fb49a/4ca1e339-af0d-51ec-a9c0-bf60c09fb49a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/6e/cc6ee63a8179d6de831c9d3d2594a100/pa/ME89657_218c180f3a240c9299e08c1f31d7bb0d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-08',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 Blue-HDi Control M',
 'transmission': 'manual',
 'trim': 'Control M',
 'year': 2019}
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME89657%27 HTTP/1.1" 200 None
2026-03-27 10:42:44 [auto1.de] INFO: Saving data for ME89657: {'created_time': 1774608164.120512, 'last_price_update_time': 1774608164.120524, 'auction_closing_time': 1774715100.0}
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME89657') HTTP/1.1" 204 0
2026-03-27 10:42:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c378422-00d0-5dec-93ef-2380983fa76e with identifier: AZ37362
2026-03-27 10:42:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c378422-00d0-5dec-93ef-2380983fa76e with identifier: AZ37362
2026-03-27 10:42:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c378422-00d0-5dec-93ef-2380983fa76e with identifier: AZ37362 to the API
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:14:41Z',
 'fuel_type': 'petrol',
 'id': '7c378422-00d0-5dec-93ef-2380983fa76e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ37362',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 145058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-18',
 'seller_name': None,
 'title': 'Suzuki Swift 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2016}
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ37362%27 HTTP/1.1" 200 None
2026-03-27 10:42:44 [auto1.de] INFO: Saving data for AZ37362: {'auction_closing_time': 1774714481.0, 'created_time': 1774262560.543079, 'last_price_update_time': 1774608164.495167}
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ37362') HTTP/1.1" 204 0
2026-03-27 10:42:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:44 [auto1.de] INFO: Found listing with ID: AS09440
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS09440%27 HTTP/1.1" 200 None
2026-03-27 10:42:44 [auto1.de] INFO: Scrape type for AS09440: 2
2026-03-27 10:42:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 675cf196-b202-5fca-90af-a3c77b8bb2f3 with identifier: AS09440
2026-03-27 10:42:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 675cf196-b202-5fca-90af-a3c77b8bb2f3 with scrape type 2
2026-03-27 10:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 675cf196-b202-5fca-90af-a3c77b8bb2f3 with scrape type 2
2026-03-27 10:42:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 675cf196-b202-5fca-90af-a3c77b8bb2f3, identifier: AS09440
2026-03-27 10:42:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RZ61544/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD72223> (referer: https://www.auto1.com/v1/car-details-view/SD72223/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_cb540362cac1bbe1104f8168bf10b053.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/35/233591f858a6924a526d6a12a8e90be4/pa/AJ83009_4fee8f4dbc76f2585bf5454f0be0573e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 675cf196-b202-5fca-90af-a3c77b8bb2f3 with identifier: AS09440
2026-03-27 10:42:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 675cf196-b202-5fca-90af-a3c77b8bb2f3 with identifier: AS09440
2026-03-27 10:42:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 675cf196-b202-5fca-90af-a3c77b8bb2f3 with identifier: AS09440 to the API
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:16:19Z',
 'fuel_type': 'diesel',
 'id': '675cf196-b202-5fca-90af-a3c77b8bb2f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS09440',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 60319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-19',
 'seller_name': None,
 'title': 'Renault Trafic 2.0 dCi L1H1 3,0t Komfort',
 'transmission': 'manual',
 'trim': 'L1H1 3,0t Komfort',
 'year': 2019}
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS09440%27 HTTP/1.1" 200 None
2026-03-27 10:42:44 [auto1.de] INFO: Saving data for AS09440: {'auction_closing_time': 1774714579.0, 'created_time': 1774251399.23677, 'last_price_update_time': 1774608164.999546}
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS09440') HTTP/1.1" 204 0
2026-03-27 10:42:45 [auto1.de] INFO: Found listing with ID: LG36185
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG36185%27 HTTP/1.1" 200 None
2026-03-27 10:42:45 [auto1.de] INFO: Scrape type for LG36185: 2
2026-03-27 10:42:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 591283d8-b198-55d6-a2df-cf90c3877490 with identifier: LG36185
2026-03-27 10:42:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 591283d8-b198-55d6-a2df-cf90c3877490 with scrape type 2
2026-03-27 10:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 591283d8-b198-55d6-a2df-cf90c3877490 with scrape type 2
2026-03-27 10:42:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 591283d8-b198-55d6-a2df-cf90c3877490, identifier: LG36185
2026-03-27 10:42:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001e5350>
2026-03-27 10:42:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3aea76f-6bbe-50f5-b2e0-c358667c15fa/d3aea76f-6bbe-50f5-b2e0-c358667c15fa_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F71%252Fb47185a0b558a2051a0d6e3efdadae5f%252Fpa%252FXG24427_006e990975662e7b3dd0cd969c43e921.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_006e990975662e7b3dd0cd969c43e921.jpg saved to cache
2026-03-27 10:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3aea76f-6bbe-50f5-b2e0-c358667c15fa
2026-03-27 10:42:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3aea76f-6bbe-50f5-b2e0-c358667c15fa, skipping ID generation
2026-03-27 10:42:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3aea76f-6bbe-50f5-b2e0-c358667c15fa with scrape type 1
2026-03-27 10:42:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3aea76f-6bbe-50f5-b2e0-c358667c15fa sending to next pipeline
2026-03-27 10:42:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3aea76f-6bbe-50f5-b2e0-c358667c15fa, identifier: XG24427
2026-03-27 10:42:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d9790>
2026-03-27 10:42:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc47f720-0a2b-59f0-a249-ab17fbc46c7b/dc47f720-0a2b-59f0-a249-ab17fbc46c7b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F1c%252F6a1ca83bb557168b14f4c98b0d711296%252Fpa%252FBJ13428_502a23a39d69d2acab54360ea3346803.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_502a23a39d69d2acab54360ea3346803.jpg saved to cache
2026-03-27 10:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc47f720-0a2b-59f0-a249-ab17fbc46c7b
2026-03-27 10:42:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc47f720-0a2b-59f0-a249-ab17fbc46c7b, skipping ID generation
2026-03-27 10:42:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc47f720-0a2b-59f0-a249-ab17fbc46c7b with scrape type 1
2026-03-27 10:42:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc47f720-0a2b-59f0-a249-ab17fbc46c7b sending to next pipeline
2026-03-27 10:42:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc47f720-0a2b-59f0-a249-ab17fbc46c7b, identifier: BJ13428
2026-03-27 10:42:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015d7050>
2026-03-27 10:42:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cefb2c-9a32-56da-9cb2-dec0ee44e74f/89cefb2c-9a32-56da-9cb2-dec0ee44e74f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc9%252F3fc986e50d8eef8936587fb5768548af%252Fpa%252FRY74387_81ff52e1f3a00173713513a0969cbf75.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_81ff52e1f3a00173713513a0969cbf75.jpg saved to cache
2026-03-27 10:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 89cefb2c-9a32-56da-9cb2-dec0ee44e74f
2026-03-27 10:42:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_c5ad14523ca38ca7c4bbb2a388959814.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/35/233591f858a6924a526d6a12a8e90be4/pa/AJ83009_82146f7e4f3bd0080dabaececd1f7a9a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 591283d8-b198-55d6-a2df-cf90c3877490 with identifier: LG36185
2026-03-27 10:42:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 591283d8-b198-55d6-a2df-cf90c3877490 with identifier: LG36185
2026-03-27 10:42:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 591283d8-b198-55d6-a2df-cf90c3877490 with identifier: LG36185 to the API
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:04:48Z',
 'fuel_type': 'petrol',
 'id': '591283d8-b198-55d6-a2df-cf90c3877490',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG36185',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 162440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-31',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Team Edition',
 'transmission': 'manual',
 'trim': 'Team Edition',
 'year': 2008}
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG36185%27 HTTP/1.1" 200 None
2026-03-27 10:42:45 [auto1.de] INFO: Saving data for LG36185: {'auction_closing_time': 1774713888.0, 'created_time': 1773401981.478406, 'last_price_update_time': 1774608165.854379}
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG36185') HTTP/1.1" 204 0
2026-03-27 10:42:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3aea76f-6bbe-50f5-b2e0-c358667c15fa with identifier: XG24427
2026-03-27 10:42:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3aea76f-6bbe-50f5-b2e0-c358667c15fa with identifier: XG24427
2026-03-27 10:42:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3aea76f-6bbe-50f5-b2e0-c358667c15fa with identifier: XG24427 to the API
2026-03-27 10:42:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_006e990975662e7b3dd0cd969c43e921.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:12:52Z',
 'fuel_type': 'diesel',
 'id': 'd3aea76f-6bbe-50f5-b2e0-c358667c15fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG24427',
 'listing': 'auction',
 'location': 'DE, Montabaur',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 251784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3aea76f-6bbe-50f5-b2e0-c358667c15fa/d3aea76f-6bbe-50f5-b2e0-c358667c15fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2941937,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_a16d532c5122c67862635cd034118d94.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3aea76f-6bbe-50f5-b2e0-c358667c15fa/d3aea76f-6bbe-50f5-b2e0-c358667c15fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_68dfe95472b49c8ecc409afca030b0e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3aea76f-6bbe-50f5-b2e0-c358667c15fa/d3aea76f-6bbe-50f5-b2e0-c358667c15fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2941852,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_537739e53cd5f38d4c426caa7f91d2cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3aea76f-6bbe-50f5-b2e0-c358667c15fa/d3aea76f-6bbe-50f5-b2e0-c358667c15fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_006e990975662e7b3dd0cd969c43e921.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3aea76f-6bbe-50f5-b2e0-c358667c15fa/d3aea76f-6bbe-50f5-b2e0-c358667c15fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_a20e52e05c4c81c2e45e304232c23101.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3aea76f-6bbe-50f5-b2e0-c358667c15fa/d3aea76f-6bbe-50f5-b2e0-c358667c15fa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_acfc19dbc745ee0aab6077d6d11cf584.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3aea76f-6bbe-50f5-b2e0-c358667c15fa/d3aea76f-6bbe-50f5-b2e0-c358667c15fa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_3c0db70b2f9721934d5757ef01d2f38a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3aea76f-6bbe-50f5-b2e0-c358667c15fa/d3aea76f-6bbe-50f5-b2e0-c358667c15fa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_1c79ad07c14d3fce80041af4c59f9fb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3aea76f-6bbe-50f5-b2e0-c358667c15fa/d3aea76f-6bbe-50f5-b2e0-c358667c15fa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_0441911cd34496bf516297a3ad37e96a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3aea76f-6bbe-50f5-b2e0-c358667c15fa/d3aea76f-6bbe-50f5-b2e0-c358667c15fa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/71/b47185a0b558a2051a0d6e3efdadae5f/pa/XG24427_7860b6a729b38a7bdd430b3b2518ae38.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-27 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG24427%27 HTTP/1.1" 200 None
2026-03-27 10:42:46 [auto1.de] INFO: Saving data for XG24427: {'created_time': 1774608166.312778, 'last_price_update_time': 1774608166.312793, 'auction_closing_time': 1774714372.0}
2026-03-27 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG24427') HTTP/1.1" 204 0
2026-03-27 10:42:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc47f720-0a2b-59f0-a249-ab17fbc46c7b with identifier: BJ13428
2026-03-27 10:42:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc47f720-0a2b-59f0-a249-ab17fbc46c7b with identifier: BJ13428
2026-03-27 10:42:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc47f720-0a2b-59f0-a249-ab17fbc46c7b with identifier: BJ13428 to the API
2026-03-27 10:42:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_502a23a39d69d2acab54360ea3346803.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:15:42Z',
 'fuel_type': 'petrol',
 'id': 'dc47f720-0a2b-59f0-a249-ab17fbc46c7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ13428',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 96997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc47f720-0a2b-59f0-a249-ab17fbc46c7b/dc47f720-0a2b-59f0-a249-ab17fbc46c7b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_502a23a39d69d2acab54360ea3346803.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc47f720-0a2b-59f0-a249-ab17fbc46c7b/dc47f720-0a2b-59f0-a249-ab17fbc46c7b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_d6938e7750c228bcf538a9524cf5541e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc47f720-0a2b-59f0-a249-ab17fbc46c7b/dc47f720-0a2b-59f0-a249-ab17fbc46c7b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_9e005b99adce709b9cd0171e898cc68d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc47f720-0a2b-59f0-a249-ab17fbc46c7b/dc47f720-0a2b-59f0-a249-ab17fbc46c7b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_b7490fe03ced72b76059351d120a6895.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc47f720-0a2b-59f0-a249-ab17fbc46c7b/dc47f720-0a2b-59f0-a249-ab17fbc46c7b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_4c79ac28ada5782c12a61a84ee179fa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc47f720-0a2b-59f0-a249-ab17fbc46c7b/dc47f720-0a2b-59f0-a249-ab17fbc46c7b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_1ac6e9713d473d11330db7603b7f8f53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc47f720-0a2b-59f0-a249-ab17fbc46c7b/dc47f720-0a2b-59f0-a249-ab17fbc46c7b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_4b21d55408663bafd0152ccfa392dbf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc47f720-0a2b-59f0-a249-ab17fbc46c7b/dc47f720-0a2b-59f0-a249-ab17fbc46c7b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_5e97472585465776e50e8670a4bec7bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc47f720-0a2b-59f0-a249-ab17fbc46c7b/dc47f720-0a2b-59f0-a249-ab17fbc46c7b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_a464e3a5f7d3a7aecb4da8c0690aa20f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc47f720-0a2b-59f0-a249-ab17fbc46c7b/dc47f720-0a2b-59f0-a249-ab17fbc46c7b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/1c/6a1ca83bb557168b14f4c98b0d711296/pa/BJ13428_542b390a0620f4ade5e384337a50608c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ13428%27 HTTP/1.1" 200 None
2026-03-27 10:42:47 [auto1.de] INFO: Saving data for BJ13428: {'created_time': 1774608167.353307, 'last_price_update_time': 1774608167.353322, 'auction_closing_time': 1774714542.0}
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ13428') HTTP/1.1" 204 0
2026-03-27 10:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_44bc9da39f764496a1cd9f372e54abff.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:47 [auto1.de] INFO: Found listing with ID: JE48122
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE48122%27 HTTP/1.1" 200 None
2026-03-27 10:42:47 [auto1.de] INFO: Scrape type for JE48122: 2
2026-03-27 10:42:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49de4338-c687-5252-8e6e-de7ca7a210f4 with identifier: JE48122
2026-03-27 10:42:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49de4338-c687-5252-8e6e-de7ca7a210f4 with scrape type 2
2026-03-27 10:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49de4338-c687-5252-8e6e-de7ca7a210f4 with scrape type 2
2026-03-27 10:42:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49de4338-c687-5252-8e6e-de7ca7a210f4, identifier: JE48122
2026-03-27 10:42:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cef0cdd-d5af-5f11-82bd-d2799e0558a4 with identifier: SD72223
2026-03-27 10:42:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cef0cdd-d5af-5f11-82bd-d2799e0558a4 with scrape type 1
2026-03-27 10:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8cef0cdd-d5af-5f11-82bd-d2799e0558a4
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fb7%252F0eb7a39aaa53ee4fe527bfe7931c2bc9%252Fpa%252FSD72223_b173e4957a470630da5393be48bbe86a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_b173e4957a470630da5393be48bbe86a.jpg not downloaded yet
2026-03-27 10:42:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001bb050>
2026-03-27 10:42:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caa7f59e-3138-5b9a-b132-35704fa2c10d/caa7f59e-3138-5b9a-b132-35704fa2c10d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9b%252Fdf9bd3b157037f0c9cd13e89772d6e95%252Fpa%252FMY92722_cb540362cac1bbe1104f8168bf10b053.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_cb540362cac1bbe1104f8168bf10b053.jpg saved to cache
2026-03-27 10:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item caa7f59e-3138-5b9a-b132-35704fa2c10d
2026-03-27 10:42:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500352a10>
2026-03-27 10:42:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9/86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F35%252F233591f858a6924a526d6a12a8e90be4%252Fpa%252FAJ83009_4fee8f4dbc76f2585bf5454f0be0573e.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/35/233591f858a6924a526d6a12a8e90be4/pa/AJ83009_4fee8f4dbc76f2585bf5454f0be0573e.jpg saved to cache
2026-03-27 10:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9
2026-03-27 10:42:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49de4338-c687-5252-8e6e-de7ca7a210f4 with identifier: JE48122
2026-03-27 10:42:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49de4338-c687-5252-8e6e-de7ca7a210f4 with identifier: JE48122
2026-03-27 10:42:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49de4338-c687-5252-8e6e-de7ca7a210f4 with identifier: JE48122 to the API
2026-03-27 10:42:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 355,
 'expiration_date': '2026-03-28T16:39:08Z',
 'fuel_type': 'petrol',
 'id': '49de4338-c687-5252-8e6e-de7ca7a210f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE48122',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 120901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-11',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE48122%27 HTTP/1.1" 200 None
2026-03-27 10:42:48 [auto1.de] INFO: Saving data for JE48122: {'auction_closing_time': 1774715948.0, 'created_time': 1773858956.559618, 'last_price_update_time': 1774608168.243954}
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE48122') HTTP/1.1" 204 0
2026-03-27 10:42:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_428c3ab86f20859be3a11385ee4576ad.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/35/233591f858a6924a526d6a12a8e90be4/pa/AJ83009_936d9f9d1b400fb4b19498fc2d1379c4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/35/233591f858a6924a526d6a12a8e90be4/pa/AJ83009_7718fc208416289d5be769ada2dac0f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:48 [auto1.de] INFO: Found listing with ID: BH48904
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH48904%27 HTTP/1.1" 200 None
2026-03-27 10:42:48 [auto1.de] INFO: Scrape type for BH48904: 2
2026-03-27 10:42:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d265f54-893f-5175-a7fa-5e2db4b057f9 with identifier: BH48904
2026-03-27 10:42:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d265f54-893f-5175-a7fa-5e2db4b057f9 with scrape type 2
2026-03-27 10:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d265f54-893f-5175-a7fa-5e2db4b057f9 with scrape type 2
2026-03-27 10:42:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d265f54-893f-5175-a7fa-5e2db4b057f9, identifier: BH48904
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fb7%252F0eb7a39aaa53ee4fe527bfe7931c2bc9%252Fpa%252FSD72223_f56b7b3e262ffe1ba8aa6b9192c3b194.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_f56b7b3e262ffe1ba8aa6b9192c3b194.jpg not downloaded yet
2026-03-27 10:42:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_3d6d889e053613e046185cdc48bd7f80.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d265f54-893f-5175-a7fa-5e2db4b057f9 with identifier: BH48904
2026-03-27 10:42:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d265f54-893f-5175-a7fa-5e2db4b057f9 with identifier: BH48904
2026-03-27 10:42:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d265f54-893f-5175-a7fa-5e2db4b057f9 with identifier: BH48904 to the API
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:53:57Z',
 'fuel_type': 'petrol',
 'id': '3d265f54-893f-5175-a7fa-5e2db4b057f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH48904',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 135257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-15',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH48904%27 HTTP/1.1" 200 None
2026-03-27 10:42:48 [auto1.de] INFO: Saving data for BH48904: {'auction_closing_time': 1774716837.0, 'created_time': 1773429304.492301, 'last_price_update_time': 1774608168.896942}
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH48904') HTTP/1.1" 204 0
2026-03-27 10:42:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:42:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501787f50>
2026-03-27 10:42:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0/d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F29%252Fae29526039dad33e76e3a99f5347e51e%252Fpa%252FZC71941_c5ad14523ca38ca7c4bbb2a388959814.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_c5ad14523ca38ca7c4bbb2a388959814.jpg saved to cache
2026-03-27 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0
2026-03-27 10:42:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0, skipping ID generation
2026-03-27 10:42:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0 with scrape type 1
2026-03-27 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0 sending to next pipeline
2026-03-27 10:42:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0, identifier: ZC71941
2026-03-27 10:42:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50033a010>
2026-03-27 10:42:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9/86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F35%252F233591f858a6924a526d6a12a8e90be4%252Fpa%252FAJ83009_82146f7e4f3bd0080dabaececd1f7a9a.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/35/233591f858a6924a526d6a12a8e90be4/pa/AJ83009_82146f7e4f3bd0080dabaececd1f7a9a.jpg saved to cache
2026-03-27 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9
2026-03-27 10:42:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:42:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016ad3d0>
2026-03-27 10:42:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caa7f59e-3138-5b9a-b132-35704fa2c10d/caa7f59e-3138-5b9a-b132-35704fa2c10d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9b%252Fdf9bd3b157037f0c9cd13e89772d6e95%252Fpa%252FMY92722_44bc9da39f764496a1cd9f372e54abff.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_44bc9da39f764496a1cd9f372e54abff.jpg saved to cache
2026-03-27 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item caa7f59e-3138-5b9a-b132-35704fa2c10d
2026-03-27 10:42:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/35/233591f858a6924a526d6a12a8e90be4/pa/AJ83009_6fdbc8e2b375dfda195c5c43a3132ead.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:49 [auto1.de] INFO: Found listing with ID: DW00961
2026-03-27 10:42:49 [auto1.de] INFO: Found listing with ID: KF96570
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96570%27 HTTP/1.1" 200 None
2026-03-27 10:42:49 [auto1.de] INFO: Scrape type for KF96570: 2
2026-03-27 10:42:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49549133-b2d6-51ef-961b-e38cbc7b2dab with identifier: KF96570
2026-03-27 10:42:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49549133-b2d6-51ef-961b-e38cbc7b2dab with scrape type 2
2026-03-27 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49549133-b2d6-51ef-961b-e38cbc7b2dab with scrape type 2
2026-03-27 10:42:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49549133-b2d6-51ef-961b-e38cbc7b2dab, identifier: KF96570
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fb7%252F0eb7a39aaa53ee4fe527bfe7931c2bc9%252Fpa%252FSD72223_eda2ace9b5e8211f5fbf2389df2c8aa0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_eda2ace9b5e8211f5fbf2389df2c8aa0.jpg not downloaded yet
2026-03-27 10:42:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0 with identifier: ZC71941
2026-03-27 10:42:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0 with identifier: ZC71941
2026-03-27 10:42:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0 with identifier: ZC71941 to the API
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_c5ad14523ca38ca7c4bbb2a388959814.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 180,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 235,
 'expiration_date': '2026-03-28T16:45:18Z',
 'fuel_type': 'diesel',
 'id': 'd2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC71941',
 'listing': 'auction',
 'location': 'DE, Korbach',
 'make': 'BMW',
 'model': '5er',
 'odometer': 174015,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0/d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_56631e18ccdd8a208524258adfa448ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0/d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_32f8b5e79a6aafc631d9f0b9c8888c1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0/d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_29c0f4ffd457b62360ab69d7d2c4c2a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0/d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_5cdc87324074a11c45ea449abebc16f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0/d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_e26a37d448b10afcc06101180dbfee26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0/d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2323656,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_c5ad14523ca38ca7c4bbb2a388959814.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0/d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_45f20404c9aaffb816e1e8b586ba356d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0/d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_492f54b2d81702a74f0b8f282f2095dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0/d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_a3d07f980340f70f4f6337420861fa31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0/d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/29/ae29526039dad33e76e3a99f5347e51e/pa/ZC71941_ade7e2eb439476379537166a2947dba8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 530d Edition Sport',
 'transmission': 'automatic',
 'trim': 'Edition Sport',
 'year': 2009}
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC71941%27 HTTP/1.1" 200 None
2026-03-27 10:42:49 [auto1.de] INFO: Saving data for ZC71941: {'created_time': 1774608169.874358, 'last_price_update_time': 1774608169.874368, 'auction_closing_time': 1774716318.0}
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC71941') HTTP/1.1" 204 0
2026-03-27 10:42:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49549133-b2d6-51ef-961b-e38cbc7b2dab with identifier: KF96570
2026-03-27 10:42:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49549133-b2d6-51ef-961b-e38cbc7b2dab with identifier: KF96570
2026-03-27 10:42:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49549133-b2d6-51ef-961b-e38cbc7b2dab with identifier: KF96570 to the API
2026-03-27 10:42:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:16:35Z',
 'fuel_type': 'diesel',
 'id': '49549133-b2d6-51ef-961b-e38cbc7b2dab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF96570',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 224583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-05',
 'seller_name': None,
 'title': 'BMW 3er 320d xDrive Sport Line',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line',
 'year': 2017}
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96570%27 HTTP/1.1" 200 None
2026-03-27 10:42:50 [auto1.de] INFO: Saving data for KF96570: {'auction_closing_time': 1774714595.0, 'created_time': 1773775307.509811, 'last_price_update_time': 1774608170.366418}
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF96570') HTTP/1.1" 204 0
2026-03-27 10:42:50 [auto1.de] INFO: Channel: 24h | Page: 25 | totalHits: 10531 | hits on page: 40
2026-03-27 10:42:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:42:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500572690>
2026-03-27 10:42:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb3055c5-de0b-5042-804a-6e47029758da/bb3055c5-de0b-5042-804a-6e47029758da_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Ff1%252F36f1952e749d6231c0c73deaf3862b76%252Fpa%252FHR97485_428c3ab86f20859be3a11385ee4576ad.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_428c3ab86f20859be3a11385ee4576ad.jpg saved to cache
2026-03-27 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb3055c5-de0b-5042-804a-6e47029758da
2026-03-27 10:42:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb3055c5-de0b-5042-804a-6e47029758da, skipping ID generation
2026-03-27 10:42:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb3055c5-de0b-5042-804a-6e47029758da with scrape type 1
2026-03-27 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb3055c5-de0b-5042-804a-6e47029758da sending to next pipeline
2026-03-27 10:42:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb3055c5-de0b-5042-804a-6e47029758da, identifier: HR97485
2026-03-27 10:42:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500494cd0>
2026-03-27 10:42:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9/86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F35%252F233591f858a6924a526d6a12a8e90be4%252Fpa%252FAJ83009_936d9f9d1b400fb4b19498fc2d1379c4.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/35/233591f858a6924a526d6a12a8e90be4/pa/AJ83009_936d9f9d1b400fb4b19498fc2d1379c4.jpg saved to cache
2026-03-27 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9
2026-03-27 10:42:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501654790>
2026-03-27 10:42:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9/86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F35%252F233591f858a6924a526d6a12a8e90be4%252Fpa%252FAJ83009_7718fc208416289d5be769ada2dac0f6.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/35/233591f858a6924a526d6a12a8e90be4/pa/AJ83009_7718fc208416289d5be769ada2dac0f6.jpg saved to cache
2026-03-27 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9
2026-03-27 10:42:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_99c9520c71d6f73357bf5ecc7e411354.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:50 [auto1.de] INFO: Found listing with ID: FG75722
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG75722%27 HTTP/1.1" 200 None
2026-03-27 10:42:50 [auto1.de] INFO: Scrape type for FG75722: 2
2026-03-27 10:42:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cde0ec8c-45aa-5e02-b369-316e5f37737a with identifier: FG75722
2026-03-27 10:42:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cde0ec8c-45aa-5e02-b369-316e5f37737a with scrape type 2
2026-03-27 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cde0ec8c-45aa-5e02-b369-316e5f37737a with scrape type 2
2026-03-27 10:42:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cde0ec8c-45aa-5e02-b369-316e5f37737a, identifier: FG75722
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fb7%252F0eb7a39aaa53ee4fe527bfe7931c2bc9%252Fpa%252FSD72223_f086830629df5a7b90481f55f4432232.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_f086830629df5a7b90481f55f4432232.jpg not downloaded yet
2026-03-27 10:42:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UC14298/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb3055c5-de0b-5042-804a-6e47029758da with identifier: HR97485
2026-03-27 10:42:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb3055c5-de0b-5042-804a-6e47029758da with identifier: HR97485
2026-03-27 10:42:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb3055c5-de0b-5042-804a-6e47029758da with identifier: HR97485 to the API
2026-03-27 10:42:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_428c3ab86f20859be3a11385ee4576ad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:22:27Z',
 'fuel_type': 'petrol',
 'id': 'bb3055c5-de0b-5042-804a-6e47029758da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR97485',
 'listing': 'auction',
 'location': 'DE, Frankfurt',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 189513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb3055c5-de0b-5042-804a-6e47029758da/bb3055c5-de0b-5042-804a-6e47029758da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_08de699f471f207938286e66c810d18b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb3055c5-de0b-5042-804a-6e47029758da/bb3055c5-de0b-5042-804a-6e47029758da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_653e698f53a86724f99fa3b6498416f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb3055c5-de0b-5042-804a-6e47029758da/bb3055c5-de0b-5042-804a-6e47029758da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_9b9c72de0153e6f498c51f51c66c8061.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb3055c5-de0b-5042-804a-6e47029758da/bb3055c5-de0b-5042-804a-6e47029758da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3261569,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_428c3ab86f20859be3a11385ee4576ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb3055c5-de0b-5042-804a-6e47029758da/bb3055c5-de0b-5042-804a-6e47029758da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_a8d713a62ee4d7d303c9fd9c14929553.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb3055c5-de0b-5042-804a-6e47029758da/bb3055c5-de0b-5042-804a-6e47029758da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_d490e7cdee25bff998988ffd9ab12799.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb3055c5-de0b-5042-804a-6e47029758da/bb3055c5-de0b-5042-804a-6e47029758da_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_dd5872264f45a37b342c5f3db4aa2a84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb3055c5-de0b-5042-804a-6e47029758da/bb3055c5-de0b-5042-804a-6e47029758da_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_8e1dbb780ca7b373044c67874ded7a48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb3055c5-de0b-5042-804a-6e47029758da/bb3055c5-de0b-5042-804a-6e47029758da_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_4e964b3c8419caebf2943d247143aadd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb3055c5-de0b-5042-804a-6e47029758da/bb3055c5-de0b-5042-804a-6e47029758da_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/f1/36f1952e749d6231c0c73deaf3862b76/pa/HR97485_9cf3331f63fd31e9d96fa7276397dbe2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2009}
2026-03-27 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR97485%27 HTTP/1.1" 200 None
2026-03-27 10:42:51 [auto1.de] INFO: Saving data for HR97485: {'created_time': 1774608171.667674, 'last_price_update_time': 1774608171.667684, 'auction_closing_time': 1774714947.0}
2026-03-27 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR97485') HTTP/1.1" 204 0
2026-03-27 10:42:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501823390>
2026-03-27 10:42:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cefb2c-9a32-56da-9cb2-dec0ee44e74f/89cefb2c-9a32-56da-9cb2-dec0ee44e74f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc9%252F3fc986e50d8eef8936587fb5768548af%252Fpa%252FRY74387_3d6d889e053613e046185cdc48bd7f80.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_3d6d889e053613e046185cdc48bd7f80.jpg saved to cache
2026-03-27 10:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 89cefb2c-9a32-56da-9cb2-dec0ee44e74f
2026-03-27 10:42:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89cefb2c-9a32-56da-9cb2-dec0ee44e74f, skipping ID generation
2026-03-27 10:42:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89cefb2c-9a32-56da-9cb2-dec0ee44e74f with scrape type 1
2026-03-27 10:42:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89cefb2c-9a32-56da-9cb2-dec0ee44e74f sending to next pipeline
2026-03-27 10:42:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89cefb2c-9a32-56da-9cb2-dec0ee44e74f, identifier: RY74387
2026-03-27 10:42:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cde0ec8c-45aa-5e02-b369-316e5f37737a with identifier: FG75722
2026-03-27 10:42:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cde0ec8c-45aa-5e02-b369-316e5f37737a with identifier: FG75722
2026-03-27 10:42:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cde0ec8c-45aa-5e02-b369-316e5f37737a with identifier: FG75722 to the API
2026-03-27 10:42:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:32:46Z',
 'fuel_type': 'petrol',
 'id': 'cde0ec8c-45aa-5e02-b369-316e5f37737a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG75722',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 105146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-13',
 'seller_name': None,
 'title': 'Audi Q2 40 TFSI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG75722%27 HTTP/1.1" 200 None
2026-03-27 10:42:52 [auto1.de] INFO: Saving data for FG75722: {'auction_closing_time': 1774715566.0, 'created_time': 1773689318.878938, 'last_price_update_time': 1774608172.456853}
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG75722') HTTP/1.1" 204 0
2026-03-27 10:42:52 [auto1.de] INFO: Found listing with ID: TU33144
2026-03-27 10:42:52 [auto1.de] INFO: Found listing with ID: KX98394
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX98394%27 HTTP/1.1" 200 None
2026-03-27 10:42:52 [auto1.de] INFO: Scrape type for KX98394: 2
2026-03-27 10:42:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: beca0e64-c4a9-5fcd-b4e4-3500af629c35 with identifier: KX98394
2026-03-27 10:42:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beca0e64-c4a9-5fcd-b4e4-3500af629c35 with scrape type 2
2026-03-27 10:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item beca0e64-c4a9-5fcd-b4e4-3500af629c35 with scrape type 2
2026-03-27 10:42:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: beca0e64-c4a9-5fcd-b4e4-3500af629c35, identifier: KX98394
2026-03-27 10:42:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89cefb2c-9a32-56da-9cb2-dec0ee44e74f with identifier: RY74387
2026-03-27 10:42:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89cefb2c-9a32-56da-9cb2-dec0ee44e74f with identifier: RY74387
2026-03-27 10:42:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89cefb2c-9a32-56da-9cb2-dec0ee44e74f with identifier: RY74387 to the API
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_3d6d889e053613e046185cdc48bd7f80.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:41:26Z',
 'fuel_type': 'petrol',
 'id': '89cefb2c-9a32-56da-9cb2-dec0ee44e74f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY74387',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 131453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cefb2c-9a32-56da-9cb2-dec0ee44e74f/89cefb2c-9a32-56da-9cb2-dec0ee44e74f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_fa2dd3d338cd72a4f36b439cb0170c8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cefb2c-9a32-56da-9cb2-dec0ee44e74f/89cefb2c-9a32-56da-9cb2-dec0ee44e74f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_321b34cf260d2500450b61f7cd610383.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cefb2c-9a32-56da-9cb2-dec0ee44e74f/89cefb2c-9a32-56da-9cb2-dec0ee44e74f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_559f7ae05a64fc588a1d834766748c42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cefb2c-9a32-56da-9cb2-dec0ee44e74f/89cefb2c-9a32-56da-9cb2-dec0ee44e74f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_bc021d89e01322c142a4b86ee44d77e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cefb2c-9a32-56da-9cb2-dec0ee44e74f/89cefb2c-9a32-56da-9cb2-dec0ee44e74f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_39e3aec6a4fcae152e111c7c2f41f84c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cefb2c-9a32-56da-9cb2-dec0ee44e74f/89cefb2c-9a32-56da-9cb2-dec0ee44e74f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_1cc4bcfd54ed3e30f2ed1e138fe2754c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cefb2c-9a32-56da-9cb2-dec0ee44e74f/89cefb2c-9a32-56da-9cb2-dec0ee44e74f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_3d6d889e053613e046185cdc48bd7f80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cefb2c-9a32-56da-9cb2-dec0ee44e74f/89cefb2c-9a32-56da-9cb2-dec0ee44e74f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_81ff52e1f3a00173713513a0969cbf75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cefb2c-9a32-56da-9cb2-dec0ee44e74f/89cefb2c-9a32-56da-9cb2-dec0ee44e74f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_c8052d8bc92ad29e86fb5aa67d68c18d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89cefb2c-9a32-56da-9cb2-dec0ee44e74f/89cefb2c-9a32-56da-9cb2-dec0ee44e74f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/c9/3fc986e50d8eef8936587fb5768548af/pa/RY74387_a7e93442277e62291553a5c23de88f7c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Yeti 1.4 TSI Adventure',
 'transmission': 'automatic',
 'trim': 'Adventure',
 'year': 2014}
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY74387%27 HTTP/1.1" 200 None
2026-03-27 10:42:52 [auto1.de] INFO: Saving data for RY74387: {'created_time': 1774608172.975299, 'last_price_update_time': 1774608172.97531, 'auction_closing_time': 1774716086.0}
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY74387') HTTP/1.1" 204 0
2026-03-27 10:42:53 [auto1.de] INFO: Found listing with ID: DU27539
2026-03-27 10:42:53 [auto1.de] INFO: Found listing with ID: AA34634
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA34634%27 HTTP/1.1" 200 None
2026-03-27 10:42:53 [auto1.de] INFO: Scrape type for AA34634: 2
2026-03-27 10:42:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97 with identifier: AA34634
2026-03-27 10:42:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97 with scrape type 2
2026-03-27 10:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97 with scrape type 2
2026-03-27 10:42:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97, identifier: AA34634
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fb7%252F0eb7a39aaa53ee4fe527bfe7931c2bc9%252Fpa%252FSD72223_08798b8f6c9923eda450ae5965713a8e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_08798b8f6c9923eda450ae5965713a8e.jpg not downloaded yet
2026-03-27 10:42:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: beca0e64-c4a9-5fcd-b4e4-3500af629c35 with identifier: KX98394
2026-03-27 10:42:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: beca0e64-c4a9-5fcd-b4e4-3500af629c35 with identifier: KX98394
2026-03-27 10:42:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: beca0e64-c4a9-5fcd-b4e4-3500af629c35 with identifier: KX98394 to the API
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:28:45Z',
 'fuel_type': 'petrol',
 'id': 'beca0e64-c4a9-5fcd-b4e4-3500af629c35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX98394',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 57974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-18',
 'seller_name': None,
 'title': 'Kia Rio 1.2 UEFA Euro 2016',
 'transmission': 'manual',
 'trim': 'UEFA Euro 2016',
 'year': 2016}
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX98394%27 HTTP/1.1" 200 None
2026-03-27 10:42:53 [auto1.de] INFO: Saving data for KX98394: {'auction_closing_time': 1774715325.0, 'created_time': 1773772690.331679, 'last_price_update_time': 1774608173.670254}
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX98394') HTTP/1.1" 204 0
2026-03-27 10:42:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d5990>
2026-03-27 10:42:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9/86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F35%252F233591f858a6924a526d6a12a8e90be4%252Fpa%252FAJ83009_6fdbc8e2b375dfda195c5c43a3132ead.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/35/233591f858a6924a526d6a12a8e90be4/pa/AJ83009_6fdbc8e2b375dfda195c5c43a3132ead.jpg saved to cache
2026-03-27 10:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9
2026-03-27 10:42:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9, skipping ID generation
2026-03-27 10:42:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9 with scrape type 1
2026-03-27 10:42:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9 sending to next pipeline
2026-03-27 10:42:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9, identifier: AJ83009
2026-03-27 10:42:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97 with identifier: AA34634
2026-03-27 10:42:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97 with identifier: AA34634
2026-03-27 10:42:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97 with identifier: AA34634 to the API
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:02:12Z',
 'fuel_type': 'diesel',
 'id': 'da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA34634',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 212830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-20',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2015}
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA34634%27 HTTP/1.1" 200 None
2026-03-27 10:42:54 [auto1.de] INFO: Saving data for AA34634: {'auction_closing_time': 1774713732.0, 'created_time': 1773305407.164739, 'last_price_update_time': 1774608174.467019}
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA34634') HTTP/1.1" 204 0
2026-03-27 10:42:54 [auto1.de] INFO: Found listing with ID: ZL15649
2026-03-27 10:42:54 [auto1.de] INFO: Found listing with ID: JL65692
2026-03-27 10:42:54 [auto1.de] INFO: Found listing with ID: CW96119
2026-03-27 10:42:54 [auto1.de] INFO: Found listing with ID: GE96921
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE96921%27 HTTP/1.1" 200 None
2026-03-27 10:42:54 [auto1.de] INFO: Scrape type for GE96921: 2
2026-03-27 10:42:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d39dd74-0625-51b9-ac43-4aed8c9fc7e2 with identifier: GE96921
2026-03-27 10:42:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d39dd74-0625-51b9-ac43-4aed8c9fc7e2 with scrape type 2
2026-03-27 10:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d39dd74-0625-51b9-ac43-4aed8c9fc7e2 with scrape type 2
2026-03-27 10:42:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d39dd74-0625-51b9-ac43-4aed8c9fc7e2, identifier: GE96921
2026-03-27 10:42:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC49554> (referer: https://www.auto1.com/v1/car-details-view/RC49554/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:42:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9 with identifier: AJ83009
2026-03-27 10:42:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9 with identifier: AJ83009
2026-03-27 10:42:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9 with identifier: AJ83009 to the API
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img23/35/233591f858a6924a526d6a12a8e90be4/pa/AJ83009_6fdbc8e2b375dfda195c5c43a3132ead.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:05:47Z',
 'fuel_type': 'petrol',
 'id': '86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ83009',
 'listing': 'auction',
 'location': 'DE, Dresden',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 99995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9/86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/35/233591f858a6924a526d6a12a8e90be4/pa/AJ83009_82146f7e4f3bd0080dabaececd1f7a9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9/86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/35/233591f858a6924a526d6a12a8e90be4/pa/AJ83009_4fee8f4dbc76f2585bf5454f0be0573e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9/86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/35/233591f858a6924a526d6a12a8e90be4/pa/AJ83009_936d9f9d1b400fb4b19498fc2d1379c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9/86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/35/233591f858a6924a526d6a12a8e90be4/pa/AJ83009_7718fc208416289d5be769ada2dac0f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9/86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/35/233591f858a6924a526d6a12a8e90be4/pa/AJ83009_6fdbc8e2b375dfda195c5c43a3132ead.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.3 Fun',
 'transmission': 'manual',
 'trim': 'Fun',
 'year': 2006}
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ83009%27 HTTP/1.1" 200 None
2026-03-27 10:42:55 [auto1.de] INFO: Saving data for AJ83009: {'created_time': 1774608175.05267, 'last_price_update_time': 1774608175.052682, 'auction_closing_time': 1774713947.0}
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ83009') HTTP/1.1" 204 0
2026-03-27 10:42:55 [auto1.de] INFO: Found listing with ID: WV94095
2026-03-27 10:42:55 [auto1.de] INFO: Found listing with ID: MC22222
2026-03-27 10:42:55 [auto1.de] INFO: Found listing with ID: KF91285
2026-03-27 10:42:55 [auto1.de] INFO: Found listing with ID: RB77182
2026-03-27 10:42:55 [auto1.de] INFO: Found listing with ID: KE73798
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE73798%27 HTTP/1.1" 200 None
2026-03-27 10:42:55 [auto1.de] INFO: Scrape type for KE73798: 2
2026-03-27 10:42:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71af4e97-4731-5ae3-ad4c-183eef459ec3 with identifier: KE73798
2026-03-27 10:42:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71af4e97-4731-5ae3-ad4c-183eef459ec3 with scrape type 2
2026-03-27 10:42:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71af4e97-4731-5ae3-ad4c-183eef459ec3 with scrape type 2
2026-03-27 10:42:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71af4e97-4731-5ae3-ad4c-183eef459ec3, identifier: KE73798
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fb7%252F0eb7a39aaa53ee4fe527bfe7931c2bc9%252Fpa%252FSD72223_7650cd29c131cc13c01b0b1ef018c39b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_7650cd29c131cc13c01b0b1ef018c39b.jpg not downloaded yet
2026-03-27 10:42:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d39dd74-0625-51b9-ac43-4aed8c9fc7e2 with identifier: GE96921
2026-03-27 10:42:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d39dd74-0625-51b9-ac43-4aed8c9fc7e2 with identifier: GE96921
2026-03-27 10:42:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d39dd74-0625-51b9-ac43-4aed8c9fc7e2 with identifier: GE96921 to the API
2026-03-27 10:42:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:47:36Z',
 'fuel_type': 'petrol',
 'id': '7d39dd74-0625-51b9-ac43-4aed8c9fc7e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE96921',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 43651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-25',
 'seller_name': None,
 'title': 'Cupra Formentor 1.5 TSI ACT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE96921%27 HTTP/1.1" 200 None
2026-03-27 10:42:57 [auto1.de] INFO: Saving data for GE96921: {'auction_closing_time': 1774716456.0, 'created_time': 1773861194.299167, 'last_price_update_time': 1774608177.56195}
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE96921') HTTP/1.1" 204 0
2026-03-27 10:42:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:42:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501786950>
2026-03-27 10:42:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:42:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d96ab93a-d552-5c2c-9238-406f18cf2b9b/d96ab93a-d552-5c2c-9238-406f18cf2b9b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F49%252F2f494169d95e541e5e018bef243be092%252Fpa%252FSP19687_99c9520c71d6f73357bf5ecc7e411354.jpg') HTTP/1.1" 204 0
2026-03-27 10:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_99c9520c71d6f73357bf5ecc7e411354.jpg saved to cache
2026-03-27 10:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d96ab93a-d552-5c2c-9238-406f18cf2b9b
2026-03-27 10:42:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71af4e97-4731-5ae3-ad4c-183eef459ec3 with identifier: KE73798
2026-03-27 10:42:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71af4e97-4731-5ae3-ad4c-183eef459ec3 with identifier: KE73798
2026-03-27 10:42:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71af4e97-4731-5ae3-ad4c-183eef459ec3 with identifier: KE73798 to the API
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:03:02Z',
 'fuel_type': 'petrol',
 'id': '71af4e97-4731-5ae3-ad4c-183eef459ec3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE73798',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 120659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-20',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2015}
2026-03-27 10:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE73798%27 HTTP/1.1" 200 None
2026-03-27 10:42:58 [auto1.de] INFO: Saving data for KE73798: {'auction_closing_time': 1774713782.0, 'created_time': 1773306577.065688, 'last_price_update_time': 1774608178.006645}
2026-03-27 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE73798') HTTP/1.1" 204 0
2026-03-27 10:42:58 [auto1.de] INFO: Found listing with ID: YN77653
2026-03-27 10:42:58 [auto1.de] INFO: Found listing with ID: CH51511
2026-03-27 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH51511%27 HTTP/1.1" 200 None
2026-03-27 10:42:58 [auto1.de] INFO: Scrape type for CH51511: 2
2026-03-27 10:42:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 738521a3-734e-5a8e-b4c5-86f182dcd005 with identifier: CH51511
2026-03-27 10:42:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 738521a3-734e-5a8e-b4c5-86f182dcd005 with scrape type 2
2026-03-27 10:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 738521a3-734e-5a8e-b4c5-86f182dcd005 with scrape type 2
2026-03-27 10:42:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 738521a3-734e-5a8e-b4c5-86f182dcd005, identifier: CH51511
2026-03-27 10:42:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_f086830629df5a7b90481f55f4432232.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_eda2ace9b5e8211f5fbf2389df2c8aa0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:42:58 [auto1.de] INFO: Found listing with ID: TS61714
2026-03-27 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS61714%27 HTTP/1.1" 200 None
2026-03-27 10:42:58 [auto1.de] INFO: Scrape type for TS61714: 2
2026-03-27 10:42:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 644920f7-8d9d-5b33-9bcf-dee042fe0efe with identifier: TS61714
2026-03-27 10:42:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 644920f7-8d9d-5b33-9bcf-dee042fe0efe with scrape type 2
2026-03-27 10:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 644920f7-8d9d-5b33-9bcf-dee042fe0efe with scrape type 2
2026-03-27 10:42:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 644920f7-8d9d-5b33-9bcf-dee042fe0efe, identifier: TS61714
2026-03-27 10:42:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 738521a3-734e-5a8e-b4c5-86f182dcd005 with identifier: CH51511
2026-03-27 10:42:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 738521a3-734e-5a8e-b4c5-86f182dcd005 with identifier: CH51511
2026-03-27 10:42:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 738521a3-734e-5a8e-b4c5-86f182dcd005 with identifier: CH51511 to the API
2026-03-27 10:42:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:42:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:29:34Z',
 'fuel_type': 'diesel',
 'id': '738521a3-734e-5a8e-b4c5-86f182dcd005',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH51511',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 165863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-31',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d T BlueTEC Avantgarde',
 'transmission': 'manual',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2017}
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH51511%27 HTTP/1.1" 200 None
2026-03-27 10:42:59 [auto1.de] INFO: Saving data for CH51511: {'auction_closing_time': 1774715374.0, 'created_time': 1774262488.817953, 'last_price_update_time': 1774608179.735493}
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH51511') HTTP/1.1" 204 0
2026-03-27 10:42:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:42:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca620246-94fc-52d2-85f0-43551625c43c with identifier: RC49554
2026-03-27 10:42:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca620246-94fc-52d2-85f0-43551625c43c with scrape type 1
2026-03-27 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ca620246-94fc-52d2-85f0-43551625c43c
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a117b96ff9057942e4a3e55f4aab25d%252Fpa%252FRC49554_06ba8128675fe3d1f3addc2ad1572c71.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_06ba8128675fe3d1f3addc2ad1572c71.jpg already downloaded
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a117b96ff9057942e4a3e55f4aab25d%252Fpa%252FRC49554_6b7dcc4b9fc6a9528ed9dc421351cf7a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_6b7dcc4b9fc6a9528ed9dc421351cf7a.jpg already downloaded
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a117b96ff9057942e4a3e55f4aab25d%252Fpa%252FRC49554_389cf0ffc71fe5f3df5fa2be67912eec.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_389cf0ffc71fe5f3df5fa2be67912eec.jpg already downloaded
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a117b96ff9057942e4a3e55f4aab25d%252Fpa%252FRC49554_ea74e9c31e046cc843edada217cbb5dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_ea74e9c31e046cc843edada217cbb5dd.jpg already downloaded
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a117b96ff9057942e4a3e55f4aab25d%252Fpa%252FRC49554_76b08fbe0d0ecaf40bd2169884f07ca3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_76b08fbe0d0ecaf40bd2169884f07ca3.jpg already downloaded
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a117b96ff9057942e4a3e55f4aab25d%252Fpa%252FRC49554_d27943f67dd8218de174fb761c66bcc2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_d27943f67dd8218de174fb761c66bcc2.jpg already downloaded
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a117b96ff9057942e4a3e55f4aab25d%252Fpa%252FRC49554_ced1fefe61f4a516ef2f51f5417b36a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_ced1fefe61f4a516ef2f51f5417b36a3.jpg already downloaded
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a117b96ff9057942e4a3e55f4aab25d%252Fpa%252FRC49554_5efa77a5cf89f5318a69c1052f39af9d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_5efa77a5cf89f5318a69c1052f39af9d.jpg already downloaded
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a117b96ff9057942e4a3e55f4aab25d%252Fpa%252FRC49554_1a6fcff07308a54979e2afe18d75ab6f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_1a6fcff07308a54979e2afe18d75ab6f.jpg already downloaded
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F11%252F8a117b96ff9057942e4a3e55f4aab25d%252Fpa%252FRC49554_ad4d56496ee7d90398eaf75cf69f3eab.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_ad4d56496ee7d90398eaf75cf69f3eab.jpg already downloaded
2026-03-27 10:43:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca620246-94fc-52d2-85f0-43551625c43c, identifier: RC49554
2026-03-27 10:43:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_b173e4957a470630da5393be48bbe86a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_f56b7b3e262ffe1ba8aa6b9192c3b194.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 644920f7-8d9d-5b33-9bcf-dee042fe0efe with identifier: TS61714
2026-03-27 10:43:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 644920f7-8d9d-5b33-9bcf-dee042fe0efe with identifier: TS61714
2026-03-27 10:43:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 644920f7-8d9d-5b33-9bcf-dee042fe0efe with identifier: TS61714 to the API
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:37:20Z',
 'fuel_type': 'petrol',
 'id': '644920f7-8d9d-5b33-9bcf-dee042fe0efe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS61714',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 111922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-28',
 'seller_name': None,
 'title': 'Citroen C3 1.2 e-VTi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2015}
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS61714%27 HTTP/1.1" 200 None
2026-03-27 10:43:00 [auto1.de] INFO: Saving data for TS61714: {'auction_closing_time': 1774715840.0, 'created_time': 1773657830.042563, 'last_price_update_time': 1774608180.470539}
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS61714') HTTP/1.1" 204 0
2026-03-27 10:43:00 [auto1.de] INFO: Found listing with ID: BJ86438
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ86438%27 HTTP/1.1" 200 None
2026-03-27 10:43:00 [auto1.de] INFO: Scrape type for BJ86438: 2
2026-03-27 10:43:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 710dfe6e-ecd1-5759-b245-a32a27224915 with identifier: BJ86438
2026-03-27 10:43:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 710dfe6e-ecd1-5759-b245-a32a27224915 with scrape type 2
2026-03-27 10:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 710dfe6e-ecd1-5759-b245-a32a27224915 with scrape type 2
2026-03-27 10:43:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 710dfe6e-ecd1-5759-b245-a32a27224915, identifier: BJ86438
2026-03-27 10:43:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca620246-94fc-52d2-85f0-43551625c43c with identifier: RC49554
2026-03-27 10:43:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca620246-94fc-52d2-85f0-43551625c43c with identifier: RC49554
2026-03-27 10:43:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca620246-94fc-52d2-85f0-43551625c43c with identifier: RC49554 to the API
2026-03-27 10:43:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RC49554>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:03:58Z',
 'fuel_type': 'petrol',
 'id': 'ca620246-94fc-52d2-85f0-43551625c43c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC49554',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 215543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_06ba8128675fe3d1f3addc2ad1572c71.jpg',
                'https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_6b7dcc4b9fc6a9528ed9dc421351cf7a.jpg',
                'https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_389cf0ffc71fe5f3df5fa2be67912eec.jpg',
                'https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_ea74e9c31e046cc843edada217cbb5dd.jpg',
                'https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_76b08fbe0d0ecaf40bd2169884f07ca3.jpg',
                'https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_d27943f67dd8218de174fb761c66bcc2.jpg',
                'https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_ced1fefe61f4a516ef2f51f5417b36a3.jpg',
                'https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_5efa77a5cf89f5318a69c1052f39af9d.jpg',
                'https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_1a6fcff07308a54979e2afe18d75ab6f.jpg',
                'https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_ad4d56496ee7d90398eaf75cf69f3eab.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca620246-94fc-52d2-85f0-43551625c43c/ca620246-94fc-52d2-85f0-43551625c43c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_06ba8128675fe3d1f3addc2ad1572c71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca620246-94fc-52d2-85f0-43551625c43c/ca620246-94fc-52d2-85f0-43551625c43c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_6b7dcc4b9fc6a9528ed9dc421351cf7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca620246-94fc-52d2-85f0-43551625c43c/ca620246-94fc-52d2-85f0-43551625c43c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2428069,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_389cf0ffc71fe5f3df5fa2be67912eec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca620246-94fc-52d2-85f0-43551625c43c/ca620246-94fc-52d2-85f0-43551625c43c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_ea74e9c31e046cc843edada217cbb5dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca620246-94fc-52d2-85f0-43551625c43c/ca620246-94fc-52d2-85f0-43551625c43c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_76b08fbe0d0ecaf40bd2169884f07ca3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca620246-94fc-52d2-85f0-43551625c43c/ca620246-94fc-52d2-85f0-43551625c43c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_d27943f67dd8218de174fb761c66bcc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca620246-94fc-52d2-85f0-43551625c43c/ca620246-94fc-52d2-85f0-43551625c43c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_ced1fefe61f4a516ef2f51f5417b36a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca620246-94fc-52d2-85f0-43551625c43c/ca620246-94fc-52d2-85f0-43551625c43c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2065040,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_5efa77a5cf89f5318a69c1052f39af9d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca620246-94fc-52d2-85f0-43551625c43c/ca620246-94fc-52d2-85f0-43551625c43c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_1a6fcff07308a54979e2afe18d75ab6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca620246-94fc-52d2-85f0-43551625c43c/ca620246-94fc-52d2-85f0-43551625c43c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/11/8a117b96ff9057942e4a3e55f4aab25d/pa/RC49554_ad4d56496ee7d90398eaf75cf69f3eab.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touran 1.2 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2013}
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC49554%27 HTTP/1.1" 200 None
2026-03-27 10:43:01 [auto1.de] INFO: Saving data for RC49554: {'created_time': 1774608181.587662, 'last_price_update_time': 1774608181.587674, 'auction_closing_time': 1774713838.0}
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC49554') HTTP/1.1" 204 0
2026-03-27 10:43:01 [auto1.de] INFO: Found listing with ID: VN50855
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN50855%27 HTTP/1.1" 200 None
2026-03-27 10:43:01 [auto1.de] INFO: Scrape type for VN50855: 2
2026-03-27 10:43:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5ea6603-3a6d-5597-9c71-cef18cd9effd with identifier: VN50855
2026-03-27 10:43:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5ea6603-3a6d-5597-9c71-cef18cd9effd with scrape type 2
2026-03-27 10:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5ea6603-3a6d-5597-9c71-cef18cd9effd with scrape type 2
2026-03-27 10:43:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5ea6603-3a6d-5597-9c71-cef18cd9effd, identifier: VN50855
2026-03-27 10:43:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 710dfe6e-ecd1-5759-b245-a32a27224915 with identifier: BJ86438
2026-03-27 10:43:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 710dfe6e-ecd1-5759-b245-a32a27224915 with identifier: BJ86438
2026-03-27 10:43:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 710dfe6e-ecd1-5759-b245-a32a27224915 with identifier: BJ86438 to the API
2026-03-27 10:43:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:07:30Z',
 'fuel_type': 'petrol',
 'id': '710dfe6e-ecd1-5759-b245-a32a27224915',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ86438',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 44971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-05',
 'seller_name': None,
 'title': 'Dacia Duster 1.3 TCe Prestige',
 'transmission': 'automatic',
 'trim': 'Prestige',
 'year': 2022}
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ86438%27 HTTP/1.1" 200 None
2026-03-27 10:43:02 [auto1.de] INFO: Saving data for BJ86438: {'auction_closing_time': 1774714050.0, 'created_time': 1773689325.288322, 'last_price_update_time': 1774608182.145793}
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ86438') HTTP/1.1" 204 0
2026-03-27 10:43:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_2c7f5304620808e8258de42e45f4e2ea.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5ea6603-3a6d-5597-9c71-cef18cd9effd with identifier: VN50855
2026-03-27 10:43:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5ea6603-3a6d-5597-9c71-cef18cd9effd with identifier: VN50855
2026-03-27 10:43:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5ea6603-3a6d-5597-9c71-cef18cd9effd with identifier: VN50855 to the API
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:26:50Z',
 'fuel_type': 'petrol',
 'id': 'a5ea6603-3a6d-5597-9c71-cef18cd9effd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN50855',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 141178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-24',
 'seller_name': None,
 'title': 'BMW 3er 320i GT xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2019}
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN50855%27 HTTP/1.1" 200 None
2026-03-27 10:43:02 [auto1.de] INFO: Saving data for VN50855: {'auction_closing_time': 1774715210.0, 'created_time': 1773308186.079954, 'last_price_update_time': 1774608182.494942}
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN50855') HTTP/1.1" 204 0
2026-03-27 10:43:02 [auto1.de] INFO: Found listing with ID: WK71622
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK71622%27 HTTP/1.1" 200 None
2026-03-27 10:43:02 [auto1.de] INFO: Scrape type for WK71622: 2
2026-03-27 10:43:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a73de4cc-bcff-56d8-9b06-21e32eb0beee with identifier: WK71622
2026-03-27 10:43:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a73de4cc-bcff-56d8-9b06-21e32eb0beee with scrape type 2
2026-03-27 10:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a73de4cc-bcff-56d8-9b06-21e32eb0beee with scrape type 2
2026-03-27 10:43:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a73de4cc-bcff-56d8-9b06-21e32eb0beee, identifier: WK71622
2026-03-27 10:43:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50189bc50>
2026-03-27 10:43:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cef0cdd-d5af-5f11-82bd-d2799e0558a4/8cef0cdd-d5af-5f11-82bd-d2799e0558a4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fb7%252F0eb7a39aaa53ee4fe527bfe7931c2bc9%252Fpa%252FSD72223_f086830629df5a7b90481f55f4432232.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_f086830629df5a7b90481f55f4432232.jpg saved to cache
2026-03-27 10:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8cef0cdd-d5af-5f11-82bd-d2799e0558a4
2026-03-27 10:43:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500230a50>
2026-03-27 10:43:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cef0cdd-d5af-5f11-82bd-d2799e0558a4/8cef0cdd-d5af-5f11-82bd-d2799e0558a4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fb7%252F0eb7a39aaa53ee4fe527bfe7931c2bc9%252Fpa%252FSD72223_eda2ace9b5e8211f5fbf2389df2c8aa0.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_eda2ace9b5e8211f5fbf2389df2c8aa0.jpg saved to cache
2026-03-27 10:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8cef0cdd-d5af-5f11-82bd-d2799e0558a4
2026-03-27 10:43:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_04e78b9dab2fae9edd943269869ac538.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_95851372e25c28607d0bf41f5793c860.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:02 [auto1.de] INFO: Found listing with ID: XH41107
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH41107%27 HTTP/1.1" 200 None
2026-03-27 10:43:02 [auto1.de] INFO: Scrape type for XH41107: 2
2026-03-27 10:43:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abd48081-2a26-54d5-b6c7-5a0e42b898fd with identifier: XH41107
2026-03-27 10:43:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abd48081-2a26-54d5-b6c7-5a0e42b898fd with scrape type 2
2026-03-27 10:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abd48081-2a26-54d5-b6c7-5a0e42b898fd with scrape type 2
2026-03-27 10:43:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abd48081-2a26-54d5-b6c7-5a0e42b898fd, identifier: XH41107
2026-03-27 10:43:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a73de4cc-bcff-56d8-9b06-21e32eb0beee with identifier: WK71622
2026-03-27 10:43:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a73de4cc-bcff-56d8-9b06-21e32eb0beee with identifier: WK71622
2026-03-27 10:43:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a73de4cc-bcff-56d8-9b06-21e32eb0beee with identifier: WK71622 to the API
2026-03-27 10:43:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:54:40Z',
 'fuel_type': 'diesel',
 'id': 'a73de4cc-bcff-56d8-9b06-21e32eb0beee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK71622',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 169073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-26',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK71622%27 HTTP/1.1" 200 None
2026-03-27 10:43:03 [auto1.de] INFO: Saving data for WK71622: {'auction_closing_time': 1774716880.0, 'created_time': 1773830234.05917, 'last_price_update_time': 1774608183.192325}
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK71622') HTTP/1.1" 204 0
2026-03-27 10:43:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abd48081-2a26-54d5-b6c7-5a0e42b898fd with identifier: XH41107
2026-03-27 10:43:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abd48081-2a26-54d5-b6c7-5a0e42b898fd with identifier: XH41107
2026-03-27 10:43:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abd48081-2a26-54d5-b6c7-5a0e42b898fd with identifier: XH41107 to the API
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:15:59Z',
 'fuel_type': 'petrol',
 'id': 'abd48081-2a26-54d5-b6c7-5a0e42b898fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH41107',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 75971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-30',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2020}
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH41107%27 HTTP/1.1" 200 None
2026-03-27 10:43:03 [auto1.de] INFO: Saving data for XH41107: {'auction_closing_time': 1774714559.0, 'created_time': 1774291419.585148, 'last_price_update_time': 1774608183.65717}
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH41107') HTTP/1.1" 204 0
2026-03-27 10:43:03 [auto1.de] INFO: Found listing with ID: ZV84359
2026-03-27 10:43:03 [auto1.de] INFO: Found listing with ID: VX13516
2026-03-27 10:43:03 [auto1.de] INFO: Found listing with ID: ED74506
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED74506%27 HTTP/1.1" 200 None
2026-03-27 10:43:03 [auto1.de] INFO: Scrape type for ED74506: 2
2026-03-27 10:43:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c4dea7a-2c50-5334-a5b0-26b2400eabdd with identifier: ED74506
2026-03-27 10:43:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c4dea7a-2c50-5334-a5b0-26b2400eabdd with scrape type 2
2026-03-27 10:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c4dea7a-2c50-5334-a5b0-26b2400eabdd with scrape type 2
2026-03-27 10:43:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c4dea7a-2c50-5334-a5b0-26b2400eabdd, identifier: ED74506
2026-03-27 10:43:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501628450>
2026-03-27 10:43:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cef0cdd-d5af-5f11-82bd-d2799e0558a4/8cef0cdd-d5af-5f11-82bd-d2799e0558a4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fb7%252F0eb7a39aaa53ee4fe527bfe7931c2bc9%252Fpa%252FSD72223_b173e4957a470630da5393be48bbe86a.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_b173e4957a470630da5393be48bbe86a.jpg saved to cache
2026-03-27 10:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8cef0cdd-d5af-5f11-82bd-d2799e0558a4
2026-03-27 10:43:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50039bb50>
2026-03-27 10:43:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cef0cdd-d5af-5f11-82bd-d2799e0558a4/8cef0cdd-d5af-5f11-82bd-d2799e0558a4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fb7%252F0eb7a39aaa53ee4fe527bfe7931c2bc9%252Fpa%252FSD72223_f56b7b3e262ffe1ba8aa6b9192c3b194.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_f56b7b3e262ffe1ba8aa6b9192c3b194.jpg saved to cache
2026-03-27 10:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8cef0cdd-d5af-5f11-82bd-d2799e0558a4
2026-03-27 10:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_e174044b55147668720dc93c906cf060.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:03 [auto1.de] INFO: Found listing with ID: VJ90236
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ90236%27 HTTP/1.1" 200 None
2026-03-27 10:43:03 [auto1.de] INFO: Scrape type for VJ90236: 1
2026-03-27 10:43:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c4dea7a-2c50-5334-a5b0-26b2400eabdd with identifier: ED74506
2026-03-27 10:43:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c4dea7a-2c50-5334-a5b0-26b2400eabdd with identifier: ED74506
2026-03-27 10:43:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c4dea7a-2c50-5334-a5b0-26b2400eabdd with identifier: ED74506 to the API
2026-03-27 10:43:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:50:13Z',
 'fuel_type': 'petrol',
 'id': '5c4dea7a-2c50-5334-a5b0-26b2400eabdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED74506',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 172690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-18',
 'seller_name': None,
 'title': 'Audi A5 2.0 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED74506%27 HTTP/1.1" 200 None
2026-03-27 10:43:04 [auto1.de] INFO: Saving data for ED74506: {'auction_closing_time': 1774716613.0, 'created_time': 1774263626.30485, 'last_price_update_time': 1774608184.255029}
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED74506') HTTP/1.1" 204 0
2026-03-27 10:43:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_b11046f6c8b283932e6ae222a75905db.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:04 [auto1.de] INFO: Found listing with ID: TR21109
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR21109%27 HTTP/1.1" 200 None
2026-03-27 10:43:04 [auto1.de] INFO: Scrape type for TR21109: 2
2026-03-27 10:43:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f0284cf-ee0b-5b38-8cf4-c16dde999800 with identifier: TR21109
2026-03-27 10:43:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f0284cf-ee0b-5b38-8cf4-c16dde999800 with scrape type 2
2026-03-27 10:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f0284cf-ee0b-5b38-8cf4-c16dde999800 with scrape type 2
2026-03-27 10:43:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f0284cf-ee0b-5b38-8cf4-c16dde999800, identifier: TR21109
2026-03-27 10:43:04 [auto1.de] INFO: Found listing with ID: TV17454
2026-03-27 10:43:04 [auto1.de] INFO: Found listing with ID: WZ35506
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ35506%27 HTTP/1.1" 200 None
2026-03-27 10:43:04 [auto1.de] INFO: Scrape type for WZ35506: 2
2026-03-27 10:43:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2 with identifier: WZ35506
2026-03-27 10:43:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2 with scrape type 2
2026-03-27 10:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2 with scrape type 2
2026-03-27 10:43:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2, identifier: WZ35506
2026-03-27 10:43:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f0284cf-ee0b-5b38-8cf4-c16dde999800 with identifier: TR21109
2026-03-27 10:43:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f0284cf-ee0b-5b38-8cf4-c16dde999800 with identifier: TR21109
2026-03-27 10:43:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f0284cf-ee0b-5b38-8cf4-c16dde999800 with identifier: TR21109 to the API
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-28T16:02:43Z',
 'fuel_type': 'diesel',
 'id': '5f0284cf-ee0b-5b38-8cf4-c16dde999800',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR21109',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 92408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-28',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2016}
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR21109%27 HTTP/1.1" 200 None
2026-03-27 10:43:04 [auto1.de] INFO: Saving data for TR21109: {'auction_closing_time': 1774713763.0, 'created_time': 1774292362.178927, 'last_price_update_time': 1774608184.95294}
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR21109') HTTP/1.1" 204 0
2026-03-27 10:43:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501953550>
2026-03-27 10:43:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5da82e-724a-586e-b7ef-180593adb7e7/ab5da82e-724a-586e-b7ef-180593adb7e7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F94%252Fc8940cc6caa6d6755816e2c422a26c78%252Fpa%252FNE66332_2c7f5304620808e8258de42e45f4e2ea.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_2c7f5304620808e8258de42e45f4e2ea.jpg saved to cache
2026-03-27 10:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab5da82e-724a-586e-b7ef-180593adb7e7
2026-03-27 10:43:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018ade10>
2026-03-27 10:43:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5da82e-724a-586e-b7ef-180593adb7e7/ab5da82e-724a-586e-b7ef-180593adb7e7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F94%252Fc8940cc6caa6d6755816e2c422a26c78%252Fpa%252FNE66332_04e78b9dab2fae9edd943269869ac538.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_04e78b9dab2fae9edd943269869ac538.jpg saved to cache
2026-03-27 10:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab5da82e-724a-586e-b7ef-180593adb7e7
2026-03-27 10:43:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500458310>
2026-03-27 10:43:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa13f493-6256-58de-97be-419bd5af40a4/aa13f493-6256-58de-97be-419bd5af40a4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F78%252F767889bc4e35ecdf4eb2de9d4801bcdc%252Fpa%252FDT14163_95851372e25c28607d0bf41f5793c860.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_95851372e25c28607d0bf41f5793c860.jpg saved to cache
2026-03-27 10:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa13f493-6256-58de-97be-419bd5af40a4
2026-03-27 10:43:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_e38e62ecc8e769a47ae8a0180eae7c06.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_7650cd29c131cc13c01b0b1ef018c39b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2 with identifier: WZ35506
2026-03-27 10:43:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2 with identifier: WZ35506
2026-03-27 10:43:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2 with identifier: WZ35506 to the API
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:25:26Z',
 'fuel_type': 'diesel',
 'id': 'b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ35506',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 199490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-08',
 'seller_name': None,
 'title': 'BMW 1er 120d xDrive Sport Line',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line',
 'year': 2016}
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ35506%27 HTTP/1.1" 200 None
2026-03-27 10:43:05 [auto1.de] INFO: Saving data for WZ35506: {'auction_closing_time': 1774715126.0, 'created_time': 1773303641.468646, 'last_price_update_time': 1774608185.44641}
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ35506') HTTP/1.1" 204 0
2026-03-27 10:43:05 [auto1.de] INFO: Found listing with ID: EX10887
2026-03-27 10:43:05 [auto1.de] INFO: Found listing with ID: GA75258
2026-03-27 10:43:05 [auto1.de] INFO: Found listing with ID: WT60095
2026-03-27 10:43:05 [auto1.de] INFO: Found listing with ID: AG53647
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG53647%27 HTTP/1.1" 200 None
2026-03-27 10:43:05 [auto1.de] INFO: Scrape type for AG53647: 2
2026-03-27 10:43:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 284816dc-12a7-55b7-bbee-4c7e07c556db with identifier: AG53647
2026-03-27 10:43:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 284816dc-12a7-55b7-bbee-4c7e07c556db with scrape type 2
2026-03-27 10:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 284816dc-12a7-55b7-bbee-4c7e07c556db with scrape type 2
2026-03-27 10:43:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 284816dc-12a7-55b7-bbee-4c7e07c556db, identifier: AG53647
2026-03-27 10:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_08798b8f6c9923eda450ae5965713a8e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:05 [auto1.de] INFO: Found listing with ID: GG98787
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG98787%27 HTTP/1.1" 200 None
2026-03-27 10:43:05 [auto1.de] INFO: Scrape type for GG98787: 2
2026-03-27 10:43:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 201b1528-c597-568e-a491-95d8e6b5118b with identifier: GG98787
2026-03-27 10:43:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 201b1528-c597-568e-a491-95d8e6b5118b with scrape type 2
2026-03-27 10:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 201b1528-c597-568e-a491-95d8e6b5118b with scrape type 2
2026-03-27 10:43:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 201b1528-c597-568e-a491-95d8e6b5118b, identifier: GG98787
2026-03-27 10:43:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 284816dc-12a7-55b7-bbee-4c7e07c556db with identifier: AG53647
2026-03-27 10:43:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 284816dc-12a7-55b7-bbee-4c7e07c556db with identifier: AG53647
2026-03-27 10:43:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 284816dc-12a7-55b7-bbee-4c7e07c556db with identifier: AG53647 to the API
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:20:35Z',
 'fuel_type': 'diesel',
 'id': '284816dc-12a7-55b7-bbee-4c7e07c556db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG53647',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 248853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-22',
 'seller_name': None,
 'title': 'BMW 3er 330d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG53647%27 HTTP/1.1" 200 None
2026-03-27 10:43:06 [auto1.de] INFO: Saving data for AG53647: {'auction_closing_time': 1774714835.0, 'created_time': 1774380863.864437, 'last_price_update_time': 1774608186.074047}
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG53647') HTTP/1.1" 204 0
2026-03-27 10:43:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501743c90>
2026-03-27 10:43:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa13f493-6256-58de-97be-419bd5af40a4/aa13f493-6256-58de-97be-419bd5af40a4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F78%252F767889bc4e35ecdf4eb2de9d4801bcdc%252Fpa%252FDT14163_e174044b55147668720dc93c906cf060.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_e174044b55147668720dc93c906cf060.jpg saved to cache
2026-03-27 10:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa13f493-6256-58de-97be-419bd5af40a4
2026-03-27 10:43:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50045c190>
2026-03-27 10:43:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caa7f59e-3138-5b9a-b132-35704fa2c10d/caa7f59e-3138-5b9a-b132-35704fa2c10d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9b%252Fdf9bd3b157037f0c9cd13e89772d6e95%252Fpa%252FMY92722_b11046f6c8b283932e6ae222a75905db.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_b11046f6c8b283932e6ae222a75905db.jpg saved to cache
2026-03-27 10:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item caa7f59e-3138-5b9a-b132-35704fa2c10d
2026-03-27 10:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_398e6d01ef916ffc5fdc425b59fd8a99.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 201b1528-c597-568e-a491-95d8e6b5118b with identifier: GG98787
2026-03-27 10:43:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 201b1528-c597-568e-a491-95d8e6b5118b with identifier: GG98787
2026-03-27 10:43:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 201b1528-c597-568e-a491-95d8e6b5118b with identifier: GG98787 to the API
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:07:52Z',
 'fuel_type': 'diesel',
 'id': '201b1528-c597-568e-a491-95d8e6b5118b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG98787',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 174877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-24',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Team BlueMotion',
 'transmission': 'manual',
 'trim': 'Team BlueMotion',
 'year': 2011}
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG98787%27 HTTP/1.1" 200 None
2026-03-27 10:43:06 [auto1.de] INFO: Saving data for GG98787: {'auction_closing_time': 1774714072.0, 'created_time': 1774263223.255215, 'last_price_update_time': 1774608186.740546}
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG98787') HTTP/1.1" 204 0
2026-03-27 10:43:06 [auto1.de] INFO: Found listing with ID: HS53864
2026-03-27 10:43:06 [auto1.de] INFO: Found listing with ID: RZ52630
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ52630%27 HTTP/1.1" 200 None
2026-03-27 10:43:06 [auto1.de] INFO: Scrape type for RZ52630: 2
2026-03-27 10:43:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1795d8cc-6e31-5450-a9fe-2de425f44477 with identifier: RZ52630
2026-03-27 10:43:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1795d8cc-6e31-5450-a9fe-2de425f44477 with scrape type 2
2026-03-27 10:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1795d8cc-6e31-5450-a9fe-2de425f44477 with scrape type 2
2026-03-27 10:43:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1795d8cc-6e31-5450-a9fe-2de425f44477, identifier: RZ52630
2026-03-27 10:43:06 [auto1.de] INFO: Found listing with ID: KU38253
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU38253%27 HTTP/1.1" 200 None
2026-03-27 10:43:06 [auto1.de] INFO: Scrape type for KU38253: 2
2026-03-27 10:43:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d84746ac-2602-5139-8e5d-b1962f4a5128 with identifier: KU38253
2026-03-27 10:43:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d84746ac-2602-5139-8e5d-b1962f4a5128 with scrape type 2
2026-03-27 10:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d84746ac-2602-5139-8e5d-b1962f4a5128 with scrape type 2
2026-03-27 10:43:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d84746ac-2602-5139-8e5d-b1962f4a5128, identifier: KU38253
2026-03-27 10:43:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1795d8cc-6e31-5450-a9fe-2de425f44477 with identifier: RZ52630
2026-03-27 10:43:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1795d8cc-6e31-5450-a9fe-2de425f44477 with identifier: RZ52630
2026-03-27 10:43:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1795d8cc-6e31-5450-a9fe-2de425f44477 with identifier: RZ52630 to the API
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:49:00Z',
 'fuel_type': 'petrol',
 'id': '1795d8cc-6e31-5450-a9fe-2de425f44477',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ52630',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 263004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-04-25',
 'seller_name': None,
 'title': 'Volvo V70 2.4 R',
 'transmission': 'manual',
 'trim': '',
 'year': 2000}
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ52630%27 HTTP/1.1" 200 None
2026-03-27 10:43:07 [auto1.de] INFO: Saving data for RZ52630: {'auction_closing_time': 1774716540.0, 'created_time': 1774291891.655727, 'last_price_update_time': 1774608187.306164}
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ52630') HTTP/1.1" 204 0
2026-03-27 10:43:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_a680c6cefa10d1d2a53701145bd1343e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_79d8cbd6b915e56198a126c7d5bdd4ba.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:07 [scrapy.extensions.logstats] INFO: Crawled 319 pages (at 16 pages/min), scraped 402 items (at 82 items/min)
2026-03-27 10:43:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 10:43:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d84746ac-2602-5139-8e5d-b1962f4a5128 with identifier: KU38253
2026-03-27 10:43:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d84746ac-2602-5139-8e5d-b1962f4a5128 with identifier: KU38253
2026-03-27 10:43:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d84746ac-2602-5139-8e5d-b1962f4a5128 with identifier: KU38253 to the API
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-28T16:01:02Z',
 'fuel_type': 'petrol',
 'id': 'd84746ac-2602-5139-8e5d-b1962f4a5128',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU38253',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 40593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-05',
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ 4Drive',
 'year': 2021}
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU38253%27 HTTP/1.1" 200 None
2026-03-27 10:43:07 [auto1.de] INFO: Saving data for KU38253: {'auction_closing_time': 1774713662.0, 'created_time': 1773306876.57381, 'last_price_update_time': 1774608187.699796}
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU38253') HTTP/1.1" 204 0
2026-03-27 10:43:07 [auto1.de] INFO: Found listing with ID: AH97983
2026-03-27 10:43:07 [auto1.de] INFO: Found listing with ID: GY78752
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY78752%27 HTTP/1.1" 200 None
2026-03-27 10:43:07 [auto1.de] INFO: Scrape type for GY78752: 2
2026-03-27 10:43:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 499baf1a-a7ea-5fb3-bc3f-9a390b546ffe with identifier: GY78752
2026-03-27 10:43:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 499baf1a-a7ea-5fb3-bc3f-9a390b546ffe with scrape type 2
2026-03-27 10:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 499baf1a-a7ea-5fb3-bc3f-9a390b546ffe with scrape type 2
2026-03-27 10:43:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 499baf1a-a7ea-5fb3-bc3f-9a390b546ffe, identifier: GY78752
2026-03-27 10:43:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50170e890>
2026-03-27 10:43:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5da82e-724a-586e-b7ef-180593adb7e7/ab5da82e-724a-586e-b7ef-180593adb7e7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F94%252Fc8940cc6caa6d6755816e2c422a26c78%252Fpa%252FNE66332_e38e62ecc8e769a47ae8a0180eae7c06.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_e38e62ecc8e769a47ae8a0180eae7c06.jpg saved to cache
2026-03-27 10:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab5da82e-724a-586e-b7ef-180593adb7e7
2026-03-27 10:43:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501897ed0>
2026-03-27 10:43:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cef0cdd-d5af-5f11-82bd-d2799e0558a4/8cef0cdd-d5af-5f11-82bd-d2799e0558a4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fb7%252F0eb7a39aaa53ee4fe527bfe7931c2bc9%252Fpa%252FSD72223_7650cd29c131cc13c01b0b1ef018c39b.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_7650cd29c131cc13c01b0b1ef018c39b.jpg saved to cache
2026-03-27 10:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8cef0cdd-d5af-5f11-82bd-d2799e0558a4
2026-03-27 10:43:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50057c550>
2026-03-27 10:43:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cef0cdd-d5af-5f11-82bd-d2799e0558a4/8cef0cdd-d5af-5f11-82bd-d2799e0558a4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fb7%252F0eb7a39aaa53ee4fe527bfe7931c2bc9%252Fpa%252FSD72223_08798b8f6c9923eda450ae5965713a8e.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_08798b8f6c9923eda450ae5965713a8e.jpg saved to cache
2026-03-27 10:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8cef0cdd-d5af-5f11-82bd-d2799e0558a4
2026-03-27 10:43:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8cef0cdd-d5af-5f11-82bd-d2799e0558a4, skipping ID generation
2026-03-27 10:43:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cef0cdd-d5af-5f11-82bd-d2799e0558a4 with scrape type 1
2026-03-27 10:43:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8cef0cdd-d5af-5f11-82bd-d2799e0558a4 sending to next pipeline
2026-03-27 10:43:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cef0cdd-d5af-5f11-82bd-d2799e0558a4, identifier: SD72223
2026-03-27 10:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_a249db42d85a327e1c26e46aeb3a2ca4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:08 [auto1.de] INFO: Found listing with ID: DR94699
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR94699%27 HTTP/1.1" 200 None
2026-03-27 10:43:08 [auto1.de] INFO: Scrape type for DR94699: 2
2026-03-27 10:43:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96ecbeff-bd40-54df-908e-1b9c5783b25a with identifier: DR94699
2026-03-27 10:43:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96ecbeff-bd40-54df-908e-1b9c5783b25a with scrape type 2
2026-03-27 10:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96ecbeff-bd40-54df-908e-1b9c5783b25a with scrape type 2
2026-03-27 10:43:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96ecbeff-bd40-54df-908e-1b9c5783b25a, identifier: DR94699
2026-03-27 10:43:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 499baf1a-a7ea-5fb3-bc3f-9a390b546ffe with identifier: GY78752
2026-03-27 10:43:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 499baf1a-a7ea-5fb3-bc3f-9a390b546ffe with identifier: GY78752
2026-03-27 10:43:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 499baf1a-a7ea-5fb3-bc3f-9a390b546ffe with identifier: GY78752 to the API
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:11:17Z',
 'fuel_type': 'diesel',
 'id': '499baf1a-a7ea-5fb3-bc3f-9a390b546ffe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY78752',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 268358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-14',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.5 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2005}
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY78752%27 HTTP/1.1" 200 None
2026-03-27 10:43:08 [auto1.de] INFO: Saving data for GY78752: {'auction_closing_time': 1774714277.0, 'created_time': 1773859002.832086, 'last_price_update_time': 1774608188.580923}
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY78752') HTTP/1.1" 204 0
2026-03-27 10:43:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cef0cdd-d5af-5f11-82bd-d2799e0558a4 with identifier: SD72223
2026-03-27 10:43:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cef0cdd-d5af-5f11-82bd-d2799e0558a4 with identifier: SD72223
2026-03-27 10:43:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cef0cdd-d5af-5f11-82bd-d2799e0558a4 with identifier: SD72223 to the API
2026-03-27 10:43:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_08798b8f6c9923eda450ae5965713a8e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:49:00Z',
 'fuel_type': 'petrol',
 'id': '8cef0cdd-d5af-5f11-82bd-d2799e0558a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD72223',
 'listing': 'auction',
 'location': 'Hannover',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 36920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cef0cdd-d5af-5f11-82bd-d2799e0558a4/8cef0cdd-d5af-5f11-82bd-d2799e0558a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_b173e4957a470630da5393be48bbe86a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cef0cdd-d5af-5f11-82bd-d2799e0558a4/8cef0cdd-d5af-5f11-82bd-d2799e0558a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_f56b7b3e262ffe1ba8aa6b9192c3b194.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cef0cdd-d5af-5f11-82bd-d2799e0558a4/8cef0cdd-d5af-5f11-82bd-d2799e0558a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_eda2ace9b5e8211f5fbf2389df2c8aa0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cef0cdd-d5af-5f11-82bd-d2799e0558a4/8cef0cdd-d5af-5f11-82bd-d2799e0558a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_f086830629df5a7b90481f55f4432232.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cef0cdd-d5af-5f11-82bd-d2799e0558a4/8cef0cdd-d5af-5f11-82bd-d2799e0558a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_08798b8f6c9923eda450ae5965713a8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cef0cdd-d5af-5f11-82bd-d2799e0558a4/8cef0cdd-d5af-5f11-82bd-d2799e0558a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/b7/0eb7a39aaa53ee4fe527bfe7931c2bc9/pa/SD72223_7650cd29c131cc13c01b0b1ef018c39b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 Campus Authentique',
 'transmission': 'manual',
 'trim': 'Campus Authentique',
 'year': 2009}
2026-03-27 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD72223%27 HTTP/1.1" 200 None
2026-03-27 10:43:09 [auto1.de] INFO: Saving data for SD72223: {'created_time': 1774608189.655334, 'last_price_update_time': 1774608189.655346, 'auction_closing_time': 1774716540.0}
2026-03-27 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD72223') HTTP/1.1" 204 0
2026-03-27 10:43:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96ecbeff-bd40-54df-908e-1b9c5783b25a with identifier: DR94699
2026-03-27 10:43:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96ecbeff-bd40-54df-908e-1b9c5783b25a with identifier: DR94699
2026-03-27 10:43:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96ecbeff-bd40-54df-908e-1b9c5783b25a with identifier: DR94699 to the API
2026-03-27 10:43:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:39:00Z',
 'fuel_type': 'diesel',
 'id': '96ecbeff-bd40-54df-908e-1b9c5783b25a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR94699',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 157714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-08',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2020}
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR94699%27 HTTP/1.1" 200 None
2026-03-27 10:43:10 [auto1.de] INFO: Saving data for DR94699: {'auction_closing_time': 1774715940.0, 'created_time': 1773308162.650486, 'last_price_update_time': 1774608190.068451}
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR94699') HTTP/1.1" 204 0
2026-03-27 10:43:10 [auto1.de] INFO: Found listing with ID: ED00109
2026-03-27 10:43:10 [auto1.de] INFO: Found listing with ID: XR43208
2026-03-27 10:43:10 [auto1.de] INFO: Found listing with ID: TV77789
2026-03-27 10:43:10 [auto1.de] INFO: Found listing with ID: KN65444
2026-03-27 10:43:10 [auto1.de] INFO: Found listing with ID: LK29782
2026-03-27 10:43:10 [auto1.de] INFO: Found listing with ID: TF26076
2026-03-27 10:43:10 [auto1.de] INFO: Found listing with ID: EB33579
2026-03-27 10:43:10 [auto1.de] INFO: Found listing with ID: TF63689
2026-03-27 10:43:10 [auto1.de] INFO: Found listing with ID: WW95477
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW95477%27 HTTP/1.1" 200 None
2026-03-27 10:43:10 [auto1.de] INFO: Scrape type for WW95477: 2
2026-03-27 10:43:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56d97398-df78-57fd-99da-7f74d24771f7 with identifier: WW95477
2026-03-27 10:43:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56d97398-df78-57fd-99da-7f74d24771f7 with scrape type 2
2026-03-27 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56d97398-df78-57fd-99da-7f74d24771f7 with scrape type 2
2026-03-27 10:43:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56d97398-df78-57fd-99da-7f74d24771f7, identifier: WW95477
2026-03-27 10:43:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503f39b90>
2026-03-27 10:43:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caa7f59e-3138-5b9a-b132-35704fa2c10d/caa7f59e-3138-5b9a-b132-35704fa2c10d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F9b%252Fdf9bd3b157037f0c9cd13e89772d6e95%252Fpa%252FMY92722_398e6d01ef916ffc5fdc425b59fd8a99.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_398e6d01ef916ffc5fdc425b59fd8a99.jpg saved to cache
2026-03-27 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item caa7f59e-3138-5b9a-b132-35704fa2c10d
2026-03-27 10:43:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: caa7f59e-3138-5b9a-b132-35704fa2c10d, skipping ID generation
2026-03-27 10:43:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caa7f59e-3138-5b9a-b132-35704fa2c10d with scrape type 1
2026-03-27 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item caa7f59e-3138-5b9a-b132-35704fa2c10d sending to next pipeline
2026-03-27 10:43:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: caa7f59e-3138-5b9a-b132-35704fa2c10d, identifier: MY92722
2026-03-27 10:43:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_5ef5f345b86e28f8d914eb4066f4d245.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:10 [auto1.de] INFO: Found listing with ID: JU77482
2026-03-27 10:43:10 [auto1.de] INFO: Found listing with ID: BV74864
2026-03-27 10:43:10 [auto1.de] INFO: Found listing with ID: NX68514
2026-03-27 10:43:10 [auto1.de] INFO: Found listing with ID: TU33144
2026-03-27 10:43:10 [auto1.de] INFO: Found listing with ID: KX98394
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX98394%27 HTTP/1.1" 200 None
2026-03-27 10:43:10 [auto1.de] INFO: Scrape type for KX98394: 0
2026-03-27 10:43:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56d97398-df78-57fd-99da-7f74d24771f7 with identifier: WW95477
2026-03-27 10:43:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56d97398-df78-57fd-99da-7f74d24771f7 with identifier: WW95477
2026-03-27 10:43:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56d97398-df78-57fd-99da-7f74d24771f7 with identifier: WW95477 to the API
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:10:48Z',
 'fuel_type': 'diesel',
 'id': '56d97398-df78-57fd-99da-7f74d24771f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW95477',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 97915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-08',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2019}
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW95477%27 HTTP/1.1" 200 None
2026-03-27 10:43:10 [auto1.de] INFO: Saving data for WW95477: {'auction_closing_time': 1774714248.0, 'created_time': 1773304781.249491, 'last_price_update_time': 1774608190.793911}
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW95477') HTTP/1.1" 204 0
2026-03-27 10:43:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RZ61544> (referer: https://www.auto1.com/v1/car-details-view/RZ61544/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UC14298> (referer: https://www.auto1.com/v1/car-details-view/UC14298/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: caa7f59e-3138-5b9a-b132-35704fa2c10d with identifier: MY92722
2026-03-27 10:43:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: caa7f59e-3138-5b9a-b132-35704fa2c10d with identifier: MY92722
2026-03-27 10:43:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: caa7f59e-3138-5b9a-b132-35704fa2c10d with identifier: MY92722 to the API
2026-03-27 10:43:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_398e6d01ef916ffc5fdc425b59fd8a99.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:54:28Z',
 'fuel_type': 'diesel',
 'id': 'caa7f59e-3138-5b9a-b132-35704fa2c10d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY92722',
 'listing': 'auction',
 'location': 'DE, Cham',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 223823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caa7f59e-3138-5b9a-b132-35704fa2c10d/caa7f59e-3138-5b9a-b132-35704fa2c10d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_cb540362cac1bbe1104f8168bf10b053.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caa7f59e-3138-5b9a-b132-35704fa2c10d/caa7f59e-3138-5b9a-b132-35704fa2c10d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_38cddca4fcf7b8804619013e6e4dd2d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caa7f59e-3138-5b9a-b132-35704fa2c10d/caa7f59e-3138-5b9a-b132-35704fa2c10d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_90c180465f580476f019b8dcf482ee49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caa7f59e-3138-5b9a-b132-35704fa2c10d/caa7f59e-3138-5b9a-b132-35704fa2c10d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2939236,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_b11046f6c8b283932e6ae222a75905db.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caa7f59e-3138-5b9a-b132-35704fa2c10d/caa7f59e-3138-5b9a-b132-35704fa2c10d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3337101,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_398e6d01ef916ffc5fdc425b59fd8a99.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caa7f59e-3138-5b9a-b132-35704fa2c10d/caa7f59e-3138-5b9a-b132-35704fa2c10d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_9f6a57228eae1f602303335d601ed41b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caa7f59e-3138-5b9a-b132-35704fa2c10d/caa7f59e-3138-5b9a-b132-35704fa2c10d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_d0327312ae10e8db22dcccb77d9606a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caa7f59e-3138-5b9a-b132-35704fa2c10d/caa7f59e-3138-5b9a-b132-35704fa2c10d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_b45c6184c44938307713c2d834584216.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caa7f59e-3138-5b9a-b132-35704fa2c10d/caa7f59e-3138-5b9a-b132-35704fa2c10d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_32c183f631844a97d3c711ede9c7a024.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caa7f59e-3138-5b9a-b132-35704fa2c10d/caa7f59e-3138-5b9a-b132-35704fa2c10d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3057971,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/9b/df9bd3b157037f0c9cd13e89772d6e95/pa/MY92722_44bc9da39f764496a1cd9f372e54abff.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY92722%27 HTTP/1.1" 200 None
2026-03-27 10:43:11 [auto1.de] INFO: Saving data for MY92722: {'created_time': 1774608191.339699, 'last_price_update_time': 1774608191.33971, 'auction_closing_time': 1774716868.0}
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY92722') HTTP/1.1" 204 0
2026-03-27 10:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_58aabe4cc635a2f9c0e935510bf6c0ca.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:11 [auto1.de] INFO: Found listing with ID: CZ94450
2026-03-27 10:43:11 [auto1.de] INFO: Found listing with ID: WW16724
2026-03-27 10:43:11 [auto1.de] INFO: Found listing with ID: SC70285
2026-03-27 10:43:11 [auto1.de] INFO: Found listing with ID: HJ79355
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ79355%27 HTTP/1.1" 200 None
2026-03-27 10:43:11 [auto1.de] INFO: Scrape type for HJ79355: 2
2026-03-27 10:43:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8737b35-09db-5ffe-a6f5-bf867542d5dd with identifier: HJ79355
2026-03-27 10:43:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8737b35-09db-5ffe-a6f5-bf867542d5dd with scrape type 2
2026-03-27 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8737b35-09db-5ffe-a6f5-bf867542d5dd with scrape type 2
2026-03-27 10:43:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8737b35-09db-5ffe-a6f5-bf867542d5dd, identifier: HJ79355
2026-03-27 10:43:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8737b35-09db-5ffe-a6f5-bf867542d5dd with identifier: HJ79355
2026-03-27 10:43:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8737b35-09db-5ffe-a6f5-bf867542d5dd with identifier: HJ79355
2026-03-27 10:43:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8737b35-09db-5ffe-a6f5-bf867542d5dd with identifier: HJ79355 to the API
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:57:54Z',
 'fuel_type': 'diesel',
 'id': 'b8737b35-09db-5ffe-a6f5-bf867542d5dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ79355',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 181415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-07',
 'seller_name': None,
 'title': 'Audi A3 Limousine 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ79355%27 HTTP/1.1" 200 None
2026-03-27 10:43:11 [auto1.de] INFO: Saving data for HJ79355: {'auction_closing_time': 1774717074.0, 'created_time': 1773831886.630188, 'last_price_update_time': 1774608191.804506}
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ79355') HTTP/1.1" 204 0
2026-03-27 10:43:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a3250>
2026-03-27 10:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5da82e-724a-586e-b7ef-180593adb7e7/ab5da82e-724a-586e-b7ef-180593adb7e7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F94%252Fc8940cc6caa6d6755816e2c422a26c78%252Fpa%252FNE66332_a680c6cefa10d1d2a53701145bd1343e.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_a680c6cefa10d1d2a53701145bd1343e.jpg saved to cache
2026-03-27 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab5da82e-724a-586e-b7ef-180593adb7e7
2026-03-27 10:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003f7950>
2026-03-27 10:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa13f493-6256-58de-97be-419bd5af40a4/aa13f493-6256-58de-97be-419bd5af40a4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F78%252F767889bc4e35ecdf4eb2de9d4801bcdc%252Fpa%252FDT14163_79d8cbd6b915e56198a126c7d5bdd4ba.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_79d8cbd6b915e56198a126c7d5bdd4ba.jpg saved to cache
2026-03-27 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa13f493-6256-58de-97be-419bd5af40a4
2026-03-27 10:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500343bd0>
2026-03-27 10:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d96ab93a-d552-5c2c-9238-406f18cf2b9b/d96ab93a-d552-5c2c-9238-406f18cf2b9b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F49%252F2f494169d95e541e5e018bef243be092%252Fpa%252FSP19687_a249db42d85a327e1c26e46aeb3a2ca4.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_a249db42d85a327e1c26e46aeb3a2ca4.jpg saved to cache
2026-03-27 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d96ab93a-d552-5c2c-9238-406f18cf2b9b
2026-03-27 10:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_913da465ad7f0f9e04d0741dfc95da27.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:11 [auto1.de] INFO: Found listing with ID: TV60687
2026-03-27 10:43:11 [auto1.de] INFO: Found listing with ID: DJ77655
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ77655%27 HTTP/1.1" 200 None
2026-03-27 10:43:11 [auto1.de] INFO: Scrape type for DJ77655: 2
2026-03-27 10:43:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7e69ea0-969a-5b3a-b99f-7c04949eec5a with identifier: DJ77655
2026-03-27 10:43:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7e69ea0-969a-5b3a-b99f-7c04949eec5a with scrape type 2
2026-03-27 10:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7e69ea0-969a-5b3a-b99f-7c04949eec5a with scrape type 2
2026-03-27 10:43:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7e69ea0-969a-5b3a-b99f-7c04949eec5a, identifier: DJ77655
2026-03-27 10:43:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7e69ea0-969a-5b3a-b99f-7c04949eec5a with identifier: DJ77655
2026-03-27 10:43:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7e69ea0-969a-5b3a-b99f-7c04949eec5a with identifier: DJ77655
2026-03-27 10:43:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7e69ea0-969a-5b3a-b99f-7c04949eec5a with identifier: DJ77655 to the API
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 450,
 'expiration_date': '2026-03-28T16:39:07Z',
 'fuel_type': 'petrol',
 'id': 'c7e69ea0-969a-5b3a-b99f-7c04949eec5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ77655',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 141354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-14',
 'seller_name': None,
 'title': 'BMW X5 xDrive 50i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ77655%27 HTTP/1.1" 200 None
2026-03-27 10:43:12 [auto1.de] INFO: Saving data for DJ77655: {'auction_closing_time': 1774715947.0, 'created_time': 1774294487.95957, 'last_price_update_time': 1774608192.476442}
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ77655') HTTP/1.1" 204 0
2026-03-27 10:43:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50160e550>
2026-03-27 10:43:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baeb855d-c619-571d-8227-3504a3316b6a/baeb855d-c619-571d-8227-3504a3316b6a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F7f%252F637fa7854170f3d48d6f7a0cfd19cb04%252Fpa%252FLH67751_5ef5f345b86e28f8d914eb4066f4d245.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_5ef5f345b86e28f8d914eb4066f4d245.jpg saved to cache
2026-03-27 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item baeb855d-c619-571d-8227-3504a3316b6a
2026-03-27 10:43:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e2398aa-6391-5d9a-8764-60c8a064515d with identifier: RZ61544
2026-03-27 10:43:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e2398aa-6391-5d9a-8764-60c8a064515d with scrape type 1
2026-03-27 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6e2398aa-6391-5d9a-8764-60c8a064515d
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffa%252Fbbfa78be3985f83a152a91d666500ec8%252Fpa%252FRZ61544_fc4cf9f6a0cfed5ad44ceb728b6480ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fa/bbfa78be3985f83a152a91d666500ec8/pa/RZ61544_fc4cf9f6a0cfed5ad44ceb728b6480ac.jpg not downloaded yet
2026-03-27 10:43:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18cedc76-8d4f-5334-a121-75261363c320 with identifier: UC14298
2026-03-27 10:43:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18cedc76-8d4f-5334-a121-75261363c320 with scrape type 1
2026-03-27 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 18cedc76-8d4f-5334-a121-75261363c320
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd4%252Fb9d427aec9d80fce259af2ee9d093163%252Fpa%252FUC14298_578ca30e57beda37e3ed14f5ce86dc7e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d4/b9d427aec9d80fce259af2ee9d093163/pa/UC14298_578ca30e57beda37e3ed14f5ce86dc7e.jpg not downloaded yet
2026-03-27 10:43:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50057e050>
2026-03-27 10:43:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baeb855d-c619-571d-8227-3504a3316b6a/baeb855d-c619-571d-8227-3504a3316b6a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F7f%252F637fa7854170f3d48d6f7a0cfd19cb04%252Fpa%252FLH67751_58aabe4cc635a2f9c0e935510bf6c0ca.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_58aabe4cc635a2f9c0e935510bf6c0ca.jpg saved to cache
2026-03-27 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item baeb855d-c619-571d-8227-3504a3316b6a
2026-03-27 10:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_012738705aeee4ba6f321cc8223d437d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:12 [auto1.de] INFO: Found listing with ID: DX68266
2026-03-27 10:43:12 [auto1.de] INFO: Found listing with ID: JL50388
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL50388%27 HTTP/1.1" 200 None
2026-03-27 10:43:12 [auto1.de] INFO: Scrape type for JL50388: 2
2026-03-27 10:43:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2a3c5e7-e8fe-5f43-9035-59aa7760c088 with identifier: JL50388
2026-03-27 10:43:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2a3c5e7-e8fe-5f43-9035-59aa7760c088 with scrape type 2
2026-03-27 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2a3c5e7-e8fe-5f43-9035-59aa7760c088 with scrape type 2
2026-03-27 10:43:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2a3c5e7-e8fe-5f43-9035-59aa7760c088, identifier: JL50388
2026-03-27 10:43:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_dd10c6ec69e67243b7f23a7bcbccf290.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_951af2390d3f225bd87e4172494cf056.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2a3c5e7-e8fe-5f43-9035-59aa7760c088 with identifier: JL50388
2026-03-27 10:43:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2a3c5e7-e8fe-5f43-9035-59aa7760c088 with identifier: JL50388
2026-03-27 10:43:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2a3c5e7-e8fe-5f43-9035-59aa7760c088 with identifier: JL50388 to the API
2026-03-27 10:43:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:10:55Z',
 'fuel_type': 'diesel',
 'id': 'a2a3c5e7-e8fe-5f43-9035-59aa7760c088',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL50388',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 229957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-27',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL50388%27 HTTP/1.1" 200 None
2026-03-27 10:43:13 [auto1.de] INFO: Saving data for JL50388: {'auction_closing_time': 1774714255.0, 'created_time': 1773383867.613555, 'last_price_update_time': 1774608193.184413}
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL50388') HTTP/1.1" 204 0
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffa%252Fbbfa78be3985f83a152a91d666500ec8%252Fpa%252FRZ61544_5c6dc7c550c9333336f6a1f5e69d3655.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fa/bbfa78be3985f83a152a91d666500ec8/pa/RZ61544_5c6dc7c550c9333336f6a1f5e69d3655.jpg not downloaded yet
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd4%252Fb9d427aec9d80fce259af2ee9d093163%252Fpa%252FUC14298_9ee0bac851739e4434b00f42a8cd34ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d4/b9d427aec9d80fce259af2ee9d093163/pa/UC14298_9ee0bac851739e4434b00f42a8cd34ce.jpg not downloaded yet
2026-03-27 10:43:13 [auto1.de] INFO: Found listing with ID: RM40239
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM40239%27 HTTP/1.1" 200 None
2026-03-27 10:43:13 [auto1.de] INFO: Scrape type for RM40239: 2
2026-03-27 10:43:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 649bbf99-953f-5080-840d-6d3ea40eafda with identifier: RM40239
2026-03-27 10:43:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 649bbf99-953f-5080-840d-6d3ea40eafda with scrape type 2
2026-03-27 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 649bbf99-953f-5080-840d-6d3ea40eafda with scrape type 2
2026-03-27 10:43:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 649bbf99-953f-5080-840d-6d3ea40eafda, identifier: RM40239
2026-03-27 10:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004dcc50>
2026-03-27 10:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baeb855d-c619-571d-8227-3504a3316b6a/baeb855d-c619-571d-8227-3504a3316b6a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F7f%252F637fa7854170f3d48d6f7a0cfd19cb04%252Fpa%252FLH67751_913da465ad7f0f9e04d0741dfc95da27.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_913da465ad7f0f9e04d0741dfc95da27.jpg saved to cache
2026-03-27 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item baeb855d-c619-571d-8227-3504a3316b6a
2026-03-27 10:43:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 649bbf99-953f-5080-840d-6d3ea40eafda with identifier: RM40239
2026-03-27 10:43:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 649bbf99-953f-5080-840d-6d3ea40eafda with identifier: RM40239
2026-03-27 10:43:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 649bbf99-953f-5080-840d-6d3ea40eafda with identifier: RM40239 to the API
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:56:22Z',
 'fuel_type': 'diesel',
 'id': '649bbf99-953f-5080-840d-6d3ea40eafda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM40239',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 251786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-20',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Standard',
 'transmission': 'manual',
 'trim': 'Standard',
 'year': 2012}
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM40239%27 HTTP/1.1" 200 None
2026-03-27 10:43:13 [auto1.de] INFO: Saving data for RM40239: {'auction_closing_time': 1774716982.0, 'created_time': 1773401627.645399, 'last_price_update_time': 1774608193.767316}
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM40239') HTTP/1.1" 204 0
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffa%252Fbbfa78be3985f83a152a91d666500ec8%252Fpa%252FRZ61544_81d3cce274ee79f36ce04f844211441a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fa/bbfa78be3985f83a152a91d666500ec8/pa/RZ61544_81d3cce274ee79f36ce04f844211441a.jpg not downloaded yet
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd4%252Fb9d427aec9d80fce259af2ee9d093163%252Fpa%252FUC14298_6f3c6e11b443d88b6f6997cbb7bfa88d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d4/b9d427aec9d80fce259af2ee9d093163/pa/UC14298_6f3c6e11b443d88b6f6997cbb7bfa88d.jpg not downloaded yet
2026-03-27 10:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_b6d99bc214b66c904e82fa6d6acb9a7c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffa%252Fbbfa78be3985f83a152a91d666500ec8%252Fpa%252FRZ61544_397419d5877ac1fe252eb96a51592919.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fa/bbfa78be3985f83a152a91d666500ec8/pa/RZ61544_397419d5877ac1fe252eb96a51592919.jpg not downloaded yet
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd4%252Fb9d427aec9d80fce259af2ee9d093163%252Fpa%252FUC14298_20724e9fc9d522b8f06add83133637f4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d4/b9d427aec9d80fce259af2ee9d093163/pa/UC14298_20724e9fc9d522b8f06add83133637f4.jpg not downloaded yet
2026-03-27 10:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501809910>
2026-03-27 10:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baeb855d-c619-571d-8227-3504a3316b6a/baeb855d-c619-571d-8227-3504a3316b6a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F7f%252F637fa7854170f3d48d6f7a0cfd19cb04%252Fpa%252FLH67751_012738705aeee4ba6f321cc8223d437d.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_012738705aeee4ba6f321cc8223d437d.jpg saved to cache
2026-03-27 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item baeb855d-c619-571d-8227-3504a3316b6a
2026-03-27 10:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501784f90>
2026-03-27 10:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baeb855d-c619-571d-8227-3504a3316b6a/baeb855d-c619-571d-8227-3504a3316b6a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F7f%252F637fa7854170f3d48d6f7a0cfd19cb04%252Fpa%252FLH67751_dd10c6ec69e67243b7f23a7bcbccf290.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_dd10c6ec69e67243b7f23a7bcbccf290.jpg saved to cache
2026-03-27 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item baeb855d-c619-571d-8227-3504a3316b6a
2026-03-27 10:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a8bd0>
2026-03-27 10:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baeb855d-c619-571d-8227-3504a3316b6a/baeb855d-c619-571d-8227-3504a3316b6a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F7f%252F637fa7854170f3d48d6f7a0cfd19cb04%252Fpa%252FLH67751_951af2390d3f225bd87e4172494cf056.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_951af2390d3f225bd87e4172494cf056.jpg saved to cache
2026-03-27 10:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item baeb855d-c619-571d-8227-3504a3316b6a
2026-03-27 10:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_4517175ecd8595ebfa30d21168fe04bb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffa%252Fbbfa78be3985f83a152a91d666500ec8%252Fpa%252FRZ61544_bc840c1eb5abc4fe73deb1a7cbbf68ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fa/bbfa78be3985f83a152a91d666500ec8/pa/RZ61544_bc840c1eb5abc4fe73deb1a7cbbf68ae.jpg not downloaded yet
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd4%252Fb9d427aec9d80fce259af2ee9d093163%252Fpa%252FUC14298_afb914579a7014c0a4a82f15e22938e7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d4/b9d427aec9d80fce259af2ee9d093163/pa/UC14298_afb914579a7014c0a4a82f15e22938e7.jpg not downloaded yet
2026-03-27 10:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/d4/b9d427aec9d80fce259af2ee9d093163/pa/UC14298_578ca30e57beda37e3ed14f5ce86dc7e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_36fd4c4598d53cd110e1e7922af9470a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017edb90>
2026-03-27 10:43:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baeb855d-c619-571d-8227-3504a3316b6a/baeb855d-c619-571d-8227-3504a3316b6a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F7f%252F637fa7854170f3d48d6f7a0cfd19cb04%252Fpa%252FLH67751_b6d99bc214b66c904e82fa6d6acb9a7c.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_b6d99bc214b66c904e82fa6d6acb9a7c.jpg saved to cache
2026-03-27 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item baeb855d-c619-571d-8227-3504a3316b6a
2026-03-27 10:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_ff2932b4185eb2319ebc3042a1934bfa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001e5290>
2026-03-27 10:43:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baeb855d-c619-571d-8227-3504a3316b6a/baeb855d-c619-571d-8227-3504a3316b6a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F7f%252F637fa7854170f3d48d6f7a0cfd19cb04%252Fpa%252FLH67751_4517175ecd8595ebfa30d21168fe04bb.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_4517175ecd8595ebfa30d21168fe04bb.jpg saved to cache
2026-03-27 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item baeb855d-c619-571d-8227-3504a3316b6a
2026-03-27 10:43:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: baeb855d-c619-571d-8227-3504a3316b6a, skipping ID generation
2026-03-27 10:43:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baeb855d-c619-571d-8227-3504a3316b6a with scrape type 1
2026-03-27 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item baeb855d-c619-571d-8227-3504a3316b6a sending to next pipeline
2026-03-27 10:43:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: baeb855d-c619-571d-8227-3504a3316b6a, identifier: LH67751
2026-03-27 10:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_c650de835dbb3527afe65cf6ae852bf4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: baeb855d-c619-571d-8227-3504a3316b6a with identifier: LH67751
2026-03-27 10:43:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: baeb855d-c619-571d-8227-3504a3316b6a with identifier: LH67751
2026-03-27 10:43:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: baeb855d-c619-571d-8227-3504a3316b6a with identifier: LH67751 to the API
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_4517175ecd8595ebfa30d21168fe04bb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:37:22Z',
 'fuel_type': 'petrol',
 'id': 'baeb855d-c619-571d-8227-3504a3316b6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH67751',
 'listing': 'auction',
 'location': 'DE, Hildesheim',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 65035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baeb855d-c619-571d-8227-3504a3316b6a/baeb855d-c619-571d-8227-3504a3316b6a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_4517175ecd8595ebfa30d21168fe04bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baeb855d-c619-571d-8227-3504a3316b6a/baeb855d-c619-571d-8227-3504a3316b6a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_b6d99bc214b66c904e82fa6d6acb9a7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baeb855d-c619-571d-8227-3504a3316b6a/baeb855d-c619-571d-8227-3504a3316b6a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_951af2390d3f225bd87e4172494cf056.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baeb855d-c619-571d-8227-3504a3316b6a/baeb855d-c619-571d-8227-3504a3316b6a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_dd10c6ec69e67243b7f23a7bcbccf290.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baeb855d-c619-571d-8227-3504a3316b6a/baeb855d-c619-571d-8227-3504a3316b6a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_012738705aeee4ba6f321cc8223d437d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baeb855d-c619-571d-8227-3504a3316b6a/baeb855d-c619-571d-8227-3504a3316b6a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_913da465ad7f0f9e04d0741dfc95da27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baeb855d-c619-571d-8227-3504a3316b6a/baeb855d-c619-571d-8227-3504a3316b6a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_5ef5f345b86e28f8d914eb4066f4d245.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baeb855d-c619-571d-8227-3504a3316b6a/baeb855d-c619-571d-8227-3504a3316b6a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_58aabe4cc635a2f9c0e935510bf6c0ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baeb855d-c619-571d-8227-3504a3316b6a/baeb855d-c619-571d-8227-3504a3316b6a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2518618,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_cb63fff881bdad45658ff86898617053.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baeb855d-c619-571d-8227-3504a3316b6a/baeb855d-c619-571d-8227-3504a3316b6a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2463243,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/7f/637fa7854170f3d48d6f7a0cfd19cb04/pa/LH67751_8f42b7c490184e4703310d05862eff52.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.2 TCe Luxe',
 'transmission': 'automatic',
 'trim': 'Luxe',
 'year': 2014}
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH67751%27 HTTP/1.1" 200 None
2026-03-27 10:43:14 [auto1.de] INFO: Saving data for LH67751: {'created_time': 1774608194.716891, 'last_price_update_time': 1774608194.716904, 'auction_closing_time': 1774715842.0}
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LH67751') HTTP/1.1" 204 0
2026-03-27 10:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/fa/bbfa78be3985f83a152a91d666500ec8/pa/RZ61544_397419d5877ac1fe252eb96a51592919.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/fa/bbfa78be3985f83a152a91d666500ec8/pa/RZ61544_fc4cf9f6a0cfed5ad44ceb728b6480ac.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/d4/b9d427aec9d80fce259af2ee9d093163/pa/UC14298_6f3c6e11b443d88b6f6997cbb7bfa88d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/d4/b9d427aec9d80fce259af2ee9d093163/pa/UC14298_20724e9fc9d522b8f06add83133637f4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/d4/b9d427aec9d80fce259af2ee9d093163/pa/UC14298_afb914579a7014c0a4a82f15e22938e7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500398250>
2026-03-27 10:43:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18cedc76-8d4f-5334-a121-75261363c320/18cedc76-8d4f-5334-a121-75261363c320_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd4%252Fb9d427aec9d80fce259af2ee9d093163%252Fpa%252FUC14298_578ca30e57beda37e3ed14f5ce86dc7e.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d4/b9d427aec9d80fce259af2ee9d093163/pa/UC14298_578ca30e57beda37e3ed14f5ce86dc7e.jpg saved to cache
2026-03-27 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18cedc76-8d4f-5334-a121-75261363c320
2026-03-27 10:43:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a3210>
2026-03-27 10:43:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F08%252F4208b7b27af2168e20bc9a21c53695fc%252Fpa%252FNL59666_36fd4c4598d53cd110e1e7922af9470a.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_36fd4c4598d53cd110e1e7922af9470a.jpg saved to cache
2026-03-27 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4466ed50-5955-5583-a8aa-05d304311dea
2026-03-27 10:43:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4466ed50-5955-5583-a8aa-05d304311dea, skipping ID generation
2026-03-27 10:43:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4466ed50-5955-5583-a8aa-05d304311dea with scrape type 1
2026-03-27 10:43:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4466ed50-5955-5583-a8aa-05d304311dea sending to next pipeline
2026-03-27 10:43:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4466ed50-5955-5583-a8aa-05d304311dea, identifier: NL59666
2026-03-27 10:43:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a0450>
2026-03-27 10:43:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5da82e-724a-586e-b7ef-180593adb7e7/ab5da82e-724a-586e-b7ef-180593adb7e7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F94%252Fc8940cc6caa6d6755816e2c422a26c78%252Fpa%252FNE66332_ff2932b4185eb2319ebc3042a1934bfa.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_ff2932b4185eb2319ebc3042a1934bfa.jpg saved to cache
2026-03-27 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab5da82e-724a-586e-b7ef-180593adb7e7
2026-03-27 10:43:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001e5450>
2026-03-27 10:43:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d96ab93a-d552-5c2c-9238-406f18cf2b9b/d96ab93a-d552-5c2c-9238-406f18cf2b9b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F49%252F2f494169d95e541e5e018bef243be092%252Fpa%252FSP19687_c650de835dbb3527afe65cf6ae852bf4.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_c650de835dbb3527afe65cf6ae852bf4.jpg saved to cache
2026-03-27 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d96ab93a-d552-5c2c-9238-406f18cf2b9b
2026-03-27 10:43:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d96ab93a-d552-5c2c-9238-406f18cf2b9b, skipping ID generation
2026-03-27 10:43:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d96ab93a-d552-5c2c-9238-406f18cf2b9b with scrape type 1
2026-03-27 10:43:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d96ab93a-d552-5c2c-9238-406f18cf2b9b sending to next pipeline
2026-03-27 10:43:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d96ab93a-d552-5c2c-9238-406f18cf2b9b, identifier: SP19687
2026-03-27 10:43:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4466ed50-5955-5583-a8aa-05d304311dea with identifier: NL59666
2026-03-27 10:43:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4466ed50-5955-5583-a8aa-05d304311dea with identifier: NL59666
2026-03-27 10:43:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4466ed50-5955-5583-a8aa-05d304311dea with identifier: NL59666 to the API
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_36fd4c4598d53cd110e1e7922af9470a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:24:03Z',
 'fuel_type': 'diesel',
 'id': '4466ed50-5955-5583-a8aa-05d304311dea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL59666',
 'listing': 'auction',
 'location': 'DE, Weiden',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 286049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_ac1f3efe227006d991c08c7b3c8f9357.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_33dabe2e40ee15f5e7e317b744e0f6a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_c6622c24fea21f7c9621461432ae8d32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_f056d6d3dab7eab2ab32898f09d6ebc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_1d304093129ce99dd02543cbd3054aa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_0c530f6904ca4d431b59e93328f0cec0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2467536,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_b8f4bb91c6842dcb41355b3182b359f8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2632929,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_36fd4c4598d53cd110e1e7922af9470a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_24a29a0591d604c94e97525a7eeff74a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4466ed50-5955-5583-a8aa-05d304311dea/4466ed50-5955-5583-a8aa-05d304311dea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2688644,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/08/4208b7b27af2168e20bc9a21c53695fc/pa/NL59666_ec1d4f1546272e912f0dc1025cbd894a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2016}
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59666%27 HTTP/1.1" 200 None
2026-03-27 10:43:15 [auto1.de] INFO: Saving data for NL59666: {'created_time': 1774608195.746186, 'last_price_update_time': 1774608195.746197, 'auction_closing_time': 1774715043.0}
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL59666') HTTP/1.1" 204 0
2026-03-27 10:43:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d96ab93a-d552-5c2c-9238-406f18cf2b9b with identifier: SP19687
2026-03-27 10:43:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d96ab93a-d552-5c2c-9238-406f18cf2b9b with identifier: SP19687
2026-03-27 10:43:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d96ab93a-d552-5c2c-9238-406f18cf2b9b with identifier: SP19687 to the API
2026-03-27 10:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_c650de835dbb3527afe65cf6ae852bf4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 192,
 'expiration_date': '2026-03-28T16:56:37Z',
 'fuel_type': 'petrol',
 'id': 'd96ab93a-d552-5c2c-9238-406f18cf2b9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP19687',
 'listing': 'auction',
 'location': 'DE, Lüneburg',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 93614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d96ab93a-d552-5c2c-9238-406f18cf2b9b/d96ab93a-d552-5c2c-9238-406f18cf2b9b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2905140,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_2ef56d3b545481a378f8e2068958c4c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d96ab93a-d552-5c2c-9238-406f18cf2b9b/d96ab93a-d552-5c2c-9238-406f18cf2b9b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_a249db42d85a327e1c26e46aeb3a2ca4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d96ab93a-d552-5c2c-9238-406f18cf2b9b/d96ab93a-d552-5c2c-9238-406f18cf2b9b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2587543,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_5efcb8c1e3abed69d5b01a2ff92c1705.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d96ab93a-d552-5c2c-9238-406f18cf2b9b/d96ab93a-d552-5c2c-9238-406f18cf2b9b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2220906,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_c650de835dbb3527afe65cf6ae852bf4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d96ab93a-d552-5c2c-9238-406f18cf2b9b/d96ab93a-d552-5c2c-9238-406f18cf2b9b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2893799,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_cc2671f6b490dad99c48c505672d9251.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d96ab93a-d552-5c2c-9238-406f18cf2b9b/d96ab93a-d552-5c2c-9238-406f18cf2b9b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_99c9520c71d6f73357bf5ecc7e411354.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d96ab93a-d552-5c2c-9238-406f18cf2b9b/d96ab93a-d552-5c2c-9238-406f18cf2b9b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_a8e96069190fa3daacf7f5d6b14502d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d96ab93a-d552-5c2c-9238-406f18cf2b9b/d96ab93a-d552-5c2c-9238-406f18cf2b9b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_41a345559bb242fe5279eb267ae75183.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d96ab93a-d552-5c2c-9238-406f18cf2b9b/d96ab93a-d552-5c2c-9238-406f18cf2b9b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_8654fed50fa0ca9d0207c7e24e6808f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d96ab93a-d552-5c2c-9238-406f18cf2b9b/d96ab93a-d552-5c2c-9238-406f18cf2b9b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/49/2f494169d95e541e5e018bef243be092/pa/SP19687_3044e75697a02ffaadabf9e9ea7433bc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Clubman Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP19687%27 HTTP/1.1" 200 None
2026-03-27 10:43:16 [auto1.de] INFO: Saving data for SP19687: {'created_time': 1774608196.173304, 'last_price_update_time': 1774608196.173319, 'auction_closing_time': 1774716997.0}
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP19687') HTTP/1.1" 204 0
2026-03-27 10:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FZ16195> (referer: https://www.auto1.com/v1/car-details-view/FZ16195/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM20101/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ90236/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001fcb90>
2026-03-27 10:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e2398aa-6391-5d9a-8764-60c8a064515d/6e2398aa-6391-5d9a-8764-60c8a064515d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffa%252Fbbfa78be3985f83a152a91d666500ec8%252Fpa%252FRZ61544_397419d5877ac1fe252eb96a51592919.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fa/bbfa78be3985f83a152a91d666500ec8/pa/RZ61544_397419d5877ac1fe252eb96a51592919.jpg saved to cache
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e2398aa-6391-5d9a-8764-60c8a064515d
2026-03-27 10:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501891e10>
2026-03-27 10:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e2398aa-6391-5d9a-8764-60c8a064515d/6e2398aa-6391-5d9a-8764-60c8a064515d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffa%252Fbbfa78be3985f83a152a91d666500ec8%252Fpa%252FRZ61544_fc4cf9f6a0cfed5ad44ceb728b6480ac.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fa/bbfa78be3985f83a152a91d666500ec8/pa/RZ61544_fc4cf9f6a0cfed5ad44ceb728b6480ac.jpg saved to cache
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e2398aa-6391-5d9a-8764-60c8a064515d
2026-03-27 10:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c6550>
2026-03-27 10:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18cedc76-8d4f-5334-a121-75261363c320/18cedc76-8d4f-5334-a121-75261363c320_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd4%252Fb9d427aec9d80fce259af2ee9d093163%252Fpa%252FUC14298_6f3c6e11b443d88b6f6997cbb7bfa88d.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d4/b9d427aec9d80fce259af2ee9d093163/pa/UC14298_6f3c6e11b443d88b6f6997cbb7bfa88d.jpg saved to cache
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18cedc76-8d4f-5334-a121-75261363c320
2026-03-27 10:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d7e50>
2026-03-27 10:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18cedc76-8d4f-5334-a121-75261363c320/18cedc76-8d4f-5334-a121-75261363c320_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd4%252Fb9d427aec9d80fce259af2ee9d093163%252Fpa%252FUC14298_20724e9fc9d522b8f06add83133637f4.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d4/b9d427aec9d80fce259af2ee9d093163/pa/UC14298_20724e9fc9d522b8f06add83133637f4.jpg saved to cache
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18cedc76-8d4f-5334-a121-75261363c320
2026-03-27 10:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a0b90>
2026-03-27 10:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18cedc76-8d4f-5334-a121-75261363c320/18cedc76-8d4f-5334-a121-75261363c320_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd4%252Fb9d427aec9d80fce259af2ee9d093163%252Fpa%252FUC14298_afb914579a7014c0a4a82f15e22938e7.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d4/b9d427aec9d80fce259af2ee9d093163/pa/UC14298_afb914579a7014c0a4a82f15e22938e7.jpg saved to cache
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18cedc76-8d4f-5334-a121-75261363c320
2026-03-27 10:43:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b313f4b8-a704-58de-820f-6f7a018d6704 with identifier: FZ16195
2026-03-27 10:43:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b313f4b8-a704-58de-820f-6f7a018d6704 with scrape type 1
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b313f4b8-a704-58de-820f-6f7a018d6704
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F2e%252F852e24585015684ad7f28c0eb8e94716%252Fpa%252FFZ16195_1efe5668c8034efa650683798b0ff3de.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_1efe5668c8034efa650683798b0ff3de.jpg already downloaded
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F2e%252F852e24585015684ad7f28c0eb8e94716%252Fpa%252FFZ16195_b26bbb91289ca935d3772314daea372e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_b26bbb91289ca935d3772314daea372e.jpg already downloaded
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F2e%252F852e24585015684ad7f28c0eb8e94716%252Fpa%252FFZ16195_4b4b19cfb7c0b243124af1a7a2c68ebf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_4b4b19cfb7c0b243124af1a7a2c68ebf.jpg already downloaded
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F2e%252F852e24585015684ad7f28c0eb8e94716%252Fpa%252FFZ16195_1ba17c532cd2d1bcdfdb4aa0521c8336.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_1ba17c532cd2d1bcdfdb4aa0521c8336.jpg already downloaded
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F2e%252F852e24585015684ad7f28c0eb8e94716%252Fpa%252FFZ16195_30f182b12cfefd63d0cf89957045c822.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_30f182b12cfefd63d0cf89957045c822.jpg already downloaded
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F2e%252F852e24585015684ad7f28c0eb8e94716%252Fpa%252FFZ16195_0e9c3c7949d8c5e1fd69ad331b385503.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_0e9c3c7949d8c5e1fd69ad331b385503.jpg already downloaded
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F2e%252F852e24585015684ad7f28c0eb8e94716%252Fpa%252FFZ16195_cbbafc04d69b99e49a89c152865590ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_cbbafc04d69b99e49a89c152865590ac.jpg already downloaded
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F2e%252F852e24585015684ad7f28c0eb8e94716%252Fpa%252FFZ16195_ebdc1bc762fd3f475347ece7e1659d69.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_ebdc1bc762fd3f475347ece7e1659d69.jpg already downloaded
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F2e%252F852e24585015684ad7f28c0eb8e94716%252Fpa%252FFZ16195_9c5ef23c9617299e9f60d529b531d32c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_9c5ef23c9617299e9f60d529b531d32c.jpg already downloaded
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F2e%252F852e24585015684ad7f28c0eb8e94716%252Fpa%252FFZ16195_885664ecd67f67356498091b7d5ddd63.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_885664ecd67f67356498091b7d5ddd63.jpg already downloaded
2026-03-27 10:43:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b313f4b8-a704-58de-820f-6f7a018d6704, identifier: FZ16195
2026-03-27 10:43:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b313f4b8-a704-58de-820f-6f7a018d6704 with identifier: FZ16195
2026-03-27 10:43:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b313f4b8-a704-58de-820f-6f7a018d6704 with identifier: FZ16195
2026-03-27 10:43:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b313f4b8-a704-58de-820f-6f7a018d6704 with identifier: FZ16195 to the API
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FZ16195>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:00:39Z',
 'fuel_type': 'diesel',
 'id': 'b313f4b8-a704-58de-820f-6f7a018d6704',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ16195',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 194715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_1efe5668c8034efa650683798b0ff3de.jpg',
                'https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_b26bbb91289ca935d3772314daea372e.jpg',
                'https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_4b4b19cfb7c0b243124af1a7a2c68ebf.jpg',
                'https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_1ba17c532cd2d1bcdfdb4aa0521c8336.jpg',
                'https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_30f182b12cfefd63d0cf89957045c822.jpg',
                'https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_0e9c3c7949d8c5e1fd69ad331b385503.jpg',
                'https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_cbbafc04d69b99e49a89c152865590ac.jpg',
                'https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_ebdc1bc762fd3f475347ece7e1659d69.jpg',
                'https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_9c5ef23c9617299e9f60d529b531d32c.jpg',
                'https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_885664ecd67f67356498091b7d5ddd63.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b313f4b8-a704-58de-820f-6f7a018d6704/b313f4b8-a704-58de-820f-6f7a018d6704_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_1efe5668c8034efa650683798b0ff3de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b313f4b8-a704-58de-820f-6f7a018d6704/b313f4b8-a704-58de-820f-6f7a018d6704_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_b26bbb91289ca935d3772314daea372e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b313f4b8-a704-58de-820f-6f7a018d6704/b313f4b8-a704-58de-820f-6f7a018d6704_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_4b4b19cfb7c0b243124af1a7a2c68ebf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b313f4b8-a704-58de-820f-6f7a018d6704/b313f4b8-a704-58de-820f-6f7a018d6704_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_1ba17c532cd2d1bcdfdb4aa0521c8336.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b313f4b8-a704-58de-820f-6f7a018d6704/b313f4b8-a704-58de-820f-6f7a018d6704_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_30f182b12cfefd63d0cf89957045c822.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b313f4b8-a704-58de-820f-6f7a018d6704/b313f4b8-a704-58de-820f-6f7a018d6704_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_0e9c3c7949d8c5e1fd69ad331b385503.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b313f4b8-a704-58de-820f-6f7a018d6704/b313f4b8-a704-58de-820f-6f7a018d6704_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_cbbafc04d69b99e49a89c152865590ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b313f4b8-a704-58de-820f-6f7a018d6704/b313f4b8-a704-58de-820f-6f7a018d6704_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_ebdc1bc762fd3f475347ece7e1659d69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b313f4b8-a704-58de-820f-6f7a018d6704/b313f4b8-a704-58de-820f-6f7a018d6704_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_9c5ef23c9617299e9f60d529b531d32c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b313f4b8-a704-58de-820f-6f7a018d6704/b313f4b8-a704-58de-820f-6f7a018d6704_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/2e/852e24585015684ad7f28c0eb8e94716/pa/FZ16195_885664ecd67f67356498091b7d5ddd63.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-08-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2012}
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ16195%27 HTTP/1.1" 200 None
2026-03-27 10:43:17 [auto1.de] INFO: Saving data for FZ16195: {'created_time': 1774608197.075871, 'last_price_update_time': 1774608197.075884, 'auction_closing_time': 1774713639.0}
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ16195') HTTP/1.1" 204 0
2026-03-27 10:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_3973b6b7e91d364ab639ba76dd90dcb4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH87632/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/fa/bbfa78be3985f83a152a91d666500ec8/pa/RZ61544_81d3cce274ee79f36ce04f844211441a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/fa/bbfa78be3985f83a152a91d666500ec8/pa/RZ61544_bc840c1eb5abc4fe73deb1a7cbbf68ae.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/d4/b9d427aec9d80fce259af2ee9d093163/pa/UC14298_9ee0bac851739e4434b00f42a8cd34ce.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/fa/bbfa78be3985f83a152a91d666500ec8/pa/RZ61544_5c6dc7c550c9333336f6a1f5e69d3655.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_5ef5f00fd17d56b958a5e1fdc2a4affc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_4fab50cced97b25a2275c7093eb6e0ef.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR69139/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017c7650>
2026-03-27 10:43:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bec28c5-1c2b-5132-b3c4-e1281ca87221/4bec28c5-1c2b-5132-b3c4-e1281ca87221_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F5c%252F775cd089272398646fea44d9acd12938%252Fpa%252FSV60739_3973b6b7e91d364ab639ba76dd90dcb4.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_3973b6b7e91d364ab639ba76dd90dcb4.jpg saved to cache
2026-03-27 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4bec28c5-1c2b-5132-b3c4-e1281ca87221
2026-03-27 10:43:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001e67d0>
2026-03-27 10:43:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e2398aa-6391-5d9a-8764-60c8a064515d/6e2398aa-6391-5d9a-8764-60c8a064515d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffa%252Fbbfa78be3985f83a152a91d666500ec8%252Fpa%252FRZ61544_81d3cce274ee79f36ce04f844211441a.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fa/bbfa78be3985f83a152a91d666500ec8/pa/RZ61544_81d3cce274ee79f36ce04f844211441a.jpg saved to cache
2026-03-27 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e2398aa-6391-5d9a-8764-60c8a064515d
2026-03-27 10:43:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500572dd0>
2026-03-27 10:43:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e2398aa-6391-5d9a-8764-60c8a064515d/6e2398aa-6391-5d9a-8764-60c8a064515d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffa%252Fbbfa78be3985f83a152a91d666500ec8%252Fpa%252FRZ61544_bc840c1eb5abc4fe73deb1a7cbbf68ae.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fa/bbfa78be3985f83a152a91d666500ec8/pa/RZ61544_bc840c1eb5abc4fe73deb1a7cbbf68ae.jpg saved to cache
2026-03-27 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e2398aa-6391-5d9a-8764-60c8a064515d
2026-03-27 10:43:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001e4ad0>
2026-03-27 10:43:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18cedc76-8d4f-5334-a121-75261363c320/18cedc76-8d4f-5334-a121-75261363c320_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd4%252Fb9d427aec9d80fce259af2ee9d093163%252Fpa%252FUC14298_9ee0bac851739e4434b00f42a8cd34ce.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d4/b9d427aec9d80fce259af2ee9d093163/pa/UC14298_9ee0bac851739e4434b00f42a8cd34ce.jpg saved to cache
2026-03-27 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18cedc76-8d4f-5334-a121-75261363c320
2026-03-27 10:43:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18cedc76-8d4f-5334-a121-75261363c320, skipping ID generation
2026-03-27 10:43:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18cedc76-8d4f-5334-a121-75261363c320 with scrape type 1
2026-03-27 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18cedc76-8d4f-5334-a121-75261363c320 sending to next pipeline
2026-03-27 10:43:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18cedc76-8d4f-5334-a121-75261363c320, identifier: UC14298
2026-03-27 10:43:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50178fc10>
2026-03-27 10:43:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e2398aa-6391-5d9a-8764-60c8a064515d/6e2398aa-6391-5d9a-8764-60c8a064515d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ffa%252Fbbfa78be3985f83a152a91d666500ec8%252Fpa%252FRZ61544_5c6dc7c550c9333336f6a1f5e69d3655.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/fa/bbfa78be3985f83a152a91d666500ec8/pa/RZ61544_5c6dc7c550c9333336f6a1f5e69d3655.jpg saved to cache
2026-03-27 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e2398aa-6391-5d9a-8764-60c8a064515d
2026-03-27 10:43:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e2398aa-6391-5d9a-8764-60c8a064515d, skipping ID generation
2026-03-27 10:43:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e2398aa-6391-5d9a-8764-60c8a064515d with scrape type 1
2026-03-27 10:43:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e2398aa-6391-5d9a-8764-60c8a064515d sending to next pipeline
2026-03-27 10:43:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e2398aa-6391-5d9a-8764-60c8a064515d, identifier: RZ61544
2026-03-27 10:43:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18cedc76-8d4f-5334-a121-75261363c320 with identifier: UC14298
2026-03-27 10:43:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18cedc76-8d4f-5334-a121-75261363c320 with identifier: UC14298
2026-03-27 10:43:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18cedc76-8d4f-5334-a121-75261363c320 with identifier: UC14298 to the API
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb9/d4/b9d427aec9d80fce259af2ee9d093163/pa/UC14298_9ee0bac851739e4434b00f42a8cd34ce.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:38:25Z',
 'fuel_type': 'petrol',
 'id': '18cedc76-8d4f-5334-a121-75261363c320',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC14298',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 149490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18cedc76-8d4f-5334-a121-75261363c320/18cedc76-8d4f-5334-a121-75261363c320_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/d4/b9d427aec9d80fce259af2ee9d093163/pa/UC14298_578ca30e57beda37e3ed14f5ce86dc7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18cedc76-8d4f-5334-a121-75261363c320/18cedc76-8d4f-5334-a121-75261363c320_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/d4/b9d427aec9d80fce259af2ee9d093163/pa/UC14298_9ee0bac851739e4434b00f42a8cd34ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18cedc76-8d4f-5334-a121-75261363c320/18cedc76-8d4f-5334-a121-75261363c320_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/d4/b9d427aec9d80fce259af2ee9d093163/pa/UC14298_6f3c6e11b443d88b6f6997cbb7bfa88d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18cedc76-8d4f-5334-a121-75261363c320/18cedc76-8d4f-5334-a121-75261363c320_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/d4/b9d427aec9d80fce259af2ee9d093163/pa/UC14298_20724e9fc9d522b8f06add83133637f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18cedc76-8d4f-5334-a121-75261363c320/18cedc76-8d4f-5334-a121-75261363c320_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/d4/b9d427aec9d80fce259af2ee9d093163/pa/UC14298_afb914579a7014c0a4a82f15e22938e7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Move up!',
 'transmission': 'manual',
 'trim': 'Move',
 'year': 2012}
2026-03-27 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC14298%27 HTTP/1.1" 200 None
2026-03-27 10:43:18 [auto1.de] INFO: Saving data for UC14298: {'created_time': 1774608198.022563, 'last_price_update_time': 1774608198.022581, 'auction_closing_time': 1774715905.0}
2026-03-27 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC14298') HTTP/1.1" 204 0
2026-03-27 10:43:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e2398aa-6391-5d9a-8764-60c8a064515d with identifier: RZ61544
2026-03-27 10:43:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e2398aa-6391-5d9a-8764-60c8a064515d with identifier: RZ61544
2026-03-27 10:43:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e2398aa-6391-5d9a-8764-60c8a064515d with identifier: RZ61544 to the API
2026-03-27 10:43:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/fa/bbfa78be3985f83a152a91d666500ec8/pa/RZ61544_5c6dc7c550c9333336f6a1f5e69d3655.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:32:36Z',
 'fuel_type': 'petrol',
 'id': '6e2398aa-6391-5d9a-8764-60c8a064515d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ61544',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 146949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2398aa-6391-5d9a-8764-60c8a064515d/6e2398aa-6391-5d9a-8764-60c8a064515d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/fa/bbfa78be3985f83a152a91d666500ec8/pa/RZ61544_fc4cf9f6a0cfed5ad44ceb728b6480ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2398aa-6391-5d9a-8764-60c8a064515d/6e2398aa-6391-5d9a-8764-60c8a064515d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/fa/bbfa78be3985f83a152a91d666500ec8/pa/RZ61544_5c6dc7c550c9333336f6a1f5e69d3655.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2398aa-6391-5d9a-8764-60c8a064515d/6e2398aa-6391-5d9a-8764-60c8a064515d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/fa/bbfa78be3985f83a152a91d666500ec8/pa/RZ61544_81d3cce274ee79f36ce04f844211441a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2398aa-6391-5d9a-8764-60c8a064515d/6e2398aa-6391-5d9a-8764-60c8a064515d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/fa/bbfa78be3985f83a152a91d666500ec8/pa/RZ61544_397419d5877ac1fe252eb96a51592919.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2398aa-6391-5d9a-8764-60c8a064515d/6e2398aa-6391-5d9a-8764-60c8a064515d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/fa/bbfa78be3985f83a152a91d666500ec8/pa/RZ61544_bc840c1eb5abc4fe73deb1a7cbbf68ae.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2009}
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ61544%27 HTTP/1.1" 200 None
2026-03-27 10:43:19 [auto1.de] INFO: Saving data for RZ61544: {'created_time': 1774608199.150279, 'last_price_update_time': 1774608199.150288, 'auction_closing_time': 1774715556.0}
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ61544') HTTP/1.1" 204 0
2026-03-27 10:43:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_6b5dae8596f5011ff0c954011312a2c0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_115c6444a768219d74ddd25109d791e8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_5054ba213cf48a440e7bacdf802760b3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001e4d10>
2026-03-27 10:43:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5da82e-724a-586e-b7ef-180593adb7e7/ab5da82e-724a-586e-b7ef-180593adb7e7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F94%252Fc8940cc6caa6d6755816e2c422a26c78%252Fpa%252FNE66332_5ef5f00fd17d56b958a5e1fdc2a4affc.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_5ef5f00fd17d56b958a5e1fdc2a4affc.jpg saved to cache
2026-03-27 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab5da82e-724a-586e-b7ef-180593adb7e7
2026-03-27 10:43:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab5da82e-724a-586e-b7ef-180593adb7e7, skipping ID generation
2026-03-27 10:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab5da82e-724a-586e-b7ef-180593adb7e7 with scrape type 1
2026-03-27 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab5da82e-724a-586e-b7ef-180593adb7e7 sending to next pipeline
2026-03-27 10:43:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab5da82e-724a-586e-b7ef-180593adb7e7, identifier: NE66332
2026-03-27 10:43:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001e1a10>
2026-03-27 10:43:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa13f493-6256-58de-97be-419bd5af40a4/aa13f493-6256-58de-97be-419bd5af40a4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F78%252F767889bc4e35ecdf4eb2de9d4801bcdc%252Fpa%252FDT14163_4fab50cced97b25a2275c7093eb6e0ef.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_4fab50cced97b25a2275c7093eb6e0ef.jpg saved to cache
2026-03-27 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa13f493-6256-58de-97be-419bd5af40a4
2026-03-27 10:43:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa13f493-6256-58de-97be-419bd5af40a4, skipping ID generation
2026-03-27 10:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa13f493-6256-58de-97be-419bd5af40a4 with scrape type 1
2026-03-27 10:43:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa13f493-6256-58de-97be-419bd5af40a4 sending to next pipeline
2026-03-27 10:43:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa13f493-6256-58de-97be-419bd5af40a4, identifier: DT14163
2026-03-27 10:43:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab5da82e-724a-586e-b7ef-180593adb7e7 with identifier: NE66332
2026-03-27 10:43:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab5da82e-724a-586e-b7ef-180593adb7e7 with identifier: NE66332
2026-03-27 10:43:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab5da82e-724a-586e-b7ef-180593adb7e7 with identifier: NE66332 to the API
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_5ef5f00fd17d56b958a5e1fdc2a4affc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 194,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:36:28Z',
 'fuel_type': 'petrol',
 'id': 'ab5da82e-724a-586e-b7ef-180593adb7e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE66332',
 'listing': 'auction',
 'location': 'DE, Hannover',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 128126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5da82e-724a-586e-b7ef-180593adb7e7/ab5da82e-724a-586e-b7ef-180593adb7e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2515084,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_bad8cead68e61d2ffe373dc1cb49f4f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5da82e-724a-586e-b7ef-180593adb7e7/ab5da82e-724a-586e-b7ef-180593adb7e7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2660087,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_5ef5f00fd17d56b958a5e1fdc2a4affc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5da82e-724a-586e-b7ef-180593adb7e7/ab5da82e-724a-586e-b7ef-180593adb7e7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_a680c6cefa10d1d2a53701145bd1343e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5da82e-724a-586e-b7ef-180593adb7e7/ab5da82e-724a-586e-b7ef-180593adb7e7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_e38e62ecc8e769a47ae8a0180eae7c06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5da82e-724a-586e-b7ef-180593adb7e7/ab5da82e-724a-586e-b7ef-180593adb7e7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_04e78b9dab2fae9edd943269869ac538.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5da82e-724a-586e-b7ef-180593adb7e7/ab5da82e-724a-586e-b7ef-180593adb7e7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_2c7f5304620808e8258de42e45f4e2ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5da82e-724a-586e-b7ef-180593adb7e7/ab5da82e-724a-586e-b7ef-180593adb7e7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2598858,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_ff2932b4185eb2319ebc3042a1934bfa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5da82e-724a-586e-b7ef-180593adb7e7/ab5da82e-724a-586e-b7ef-180593adb7e7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_c0e080b7359cfe6580e556b4f7abb312.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5da82e-724a-586e-b7ef-180593adb7e7/ab5da82e-724a-586e-b7ef-180593adb7e7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_6f5987b6cef83c6eabf1bfcf2ba75efb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5da82e-724a-586e-b7ef-180593adb7e7/ab5da82e-724a-586e-b7ef-180593adb7e7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/94/c8940cc6caa6d6755816e2c422a26c78/pa/NE66332_c8e00f977f3bed28bf75e413abb79e2b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford S-Max 2.0 Flexifuel Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE66332%27 HTTP/1.1" 200 None
2026-03-27 10:43:20 [auto1.de] INFO: Saving data for NE66332: {'created_time': 1774608200.071266, 'last_price_update_time': 1774608200.071279, 'auction_closing_time': 1774715788.0}
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE66332') HTTP/1.1" 204 0
2026-03-27 10:43:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa13f493-6256-58de-97be-419bd5af40a4 with identifier: DT14163
2026-03-27 10:43:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa13f493-6256-58de-97be-419bd5af40a4 with identifier: DT14163
2026-03-27 10:43:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa13f493-6256-58de-97be-419bd5af40a4 with identifier: DT14163 to the API
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_4fab50cced97b25a2275c7093eb6e0ef.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:12:40Z',
 'fuel_type': 'petrol',
 'id': 'aa13f493-6256-58de-97be-419bd5af40a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT14163',
 'listing': 'auction',
 'location': 'DE, Esslingen am Neckar',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 160241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa13f493-6256-58de-97be-419bd5af40a4/aa13f493-6256-58de-97be-419bd5af40a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_dd9a683bc7c8a88b158576d5a9efc09f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa13f493-6256-58de-97be-419bd5af40a4/aa13f493-6256-58de-97be-419bd5af40a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_79d8cbd6b915e56198a126c7d5bdd4ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa13f493-6256-58de-97be-419bd5af40a4/aa13f493-6256-58de-97be-419bd5af40a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2972567,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_4fab50cced97b25a2275c7093eb6e0ef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa13f493-6256-58de-97be-419bd5af40a4/aa13f493-6256-58de-97be-419bd5af40a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_e174044b55147668720dc93c906cf060.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa13f493-6256-58de-97be-419bd5af40a4/aa13f493-6256-58de-97be-419bd5af40a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_53e3b01819fbdd7f13ecd8e1ac1604d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa13f493-6256-58de-97be-419bd5af40a4/aa13f493-6256-58de-97be-419bd5af40a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_95851372e25c28607d0bf41f5793c860.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa13f493-6256-58de-97be-419bd5af40a4/aa13f493-6256-58de-97be-419bd5af40a4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_f669831bf7849029195bbfcd4d488817.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa13f493-6256-58de-97be-419bd5af40a4/aa13f493-6256-58de-97be-419bd5af40a4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_1dddfb608ce7f9332a43b9f1bebbda52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa13f493-6256-58de-97be-419bd5af40a4/aa13f493-6256-58de-97be-419bd5af40a4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_be0cf815dc46475395663e87dfb124e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa13f493-6256-58de-97be-419bd5af40a4/aa13f493-6256-58de-97be-419bd5af40a4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/78/767889bc4e35ecdf4eb2de9d4801bcdc/pa/DT14163_27eafb9c6fd3ba981111060212168e47.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 1.4 TSI ACT Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT14163%27 HTTP/1.1" 200 None
2026-03-27 10:43:20 [auto1.de] INFO: Saving data for DT14163: {'created_time': 1774608200.555856, 'last_price_update_time': 1774608200.555866, 'auction_closing_time': 1774714360.0}
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT14163') HTTP/1.1" 204 0
2026-03-27 10:43:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ90236> (referer: https://www.auto1.com/v1/car-details-view/VJ90236/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001d6010>
2026-03-27 10:43:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bec28c5-1c2b-5132-b3c4-e1281ca87221/4bec28c5-1c2b-5132-b3c4-e1281ca87221_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F5c%252F775cd089272398646fea44d9acd12938%252Fpa%252FSV60739_6b5dae8596f5011ff0c954011312a2c0.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_6b5dae8596f5011ff0c954011312a2c0.jpg saved to cache
2026-03-27 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4bec28c5-1c2b-5132-b3c4-e1281ca87221
2026-03-27 10:43:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a5b10>
2026-03-27 10:43:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bec28c5-1c2b-5132-b3c4-e1281ca87221/4bec28c5-1c2b-5132-b3c4-e1281ca87221_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F5c%252F775cd089272398646fea44d9acd12938%252Fpa%252FSV60739_115c6444a768219d74ddd25109d791e8.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_115c6444a768219d74ddd25109d791e8.jpg saved to cache
2026-03-27 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4bec28c5-1c2b-5132-b3c4-e1281ca87221
2026-03-27 10:43:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018ad610>
2026-03-27 10:43:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bec28c5-1c2b-5132-b3c4-e1281ca87221/4bec28c5-1c2b-5132-b3c4-e1281ca87221_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F5c%252F775cd089272398646fea44d9acd12938%252Fpa%252FSV60739_5054ba213cf48a440e7bacdf802760b3.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_5054ba213cf48a440e7bacdf802760b3.jpg saved to cache
2026-03-27 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4bec28c5-1c2b-5132-b3c4-e1281ca87221
2026-03-27 10:43:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65ce3f8a-36b1-5e83-952b-6cfd301db4fa with identifier: VJ90236
2026-03-27 10:43:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65ce3f8a-36b1-5e83-952b-6cfd301db4fa with scrape type 1
2026-03-27 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 65ce3f8a-36b1-5e83-952b-6cfd301db4fa
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fda%252F12da8c01325db5f9d992135d10ae9a5b%252Fpa%252FVJ90236_d1a8350fc46a6c56df2f8b201247bec4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/da/12da8c01325db5f9d992135d10ae9a5b/pa/VJ90236_d1a8350fc46a6c56df2f8b201247bec4.jpg already downloaded
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fda%252F12da8c01325db5f9d992135d10ae9a5b%252Fpa%252FVJ90236_828f3160cd75b8bd103a1ca1a60c9d8f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/da/12da8c01325db5f9d992135d10ae9a5b/pa/VJ90236_828f3160cd75b8bd103a1ca1a60c9d8f.jpg already downloaded
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fda%252F12da8c01325db5f9d992135d10ae9a5b%252Fpa%252FVJ90236_88503748ea3deeea0adb50bf7b8c4af8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/da/12da8c01325db5f9d992135d10ae9a5b/pa/VJ90236_88503748ea3deeea0adb50bf7b8c4af8.jpg already downloaded
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fda%252F12da8c01325db5f9d992135d10ae9a5b%252Fpa%252FVJ90236_fd6451a220355e2b5f7bafae61109c10.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/da/12da8c01325db5f9d992135d10ae9a5b/pa/VJ90236_fd6451a220355e2b5f7bafae61109c10.jpg already downloaded
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fda%252F12da8c01325db5f9d992135d10ae9a5b%252Fpa%252FVJ90236_12de02b17ea5889b428a2aaffdae944f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/da/12da8c01325db5f9d992135d10ae9a5b/pa/VJ90236_12de02b17ea5889b428a2aaffdae944f.jpg already downloaded
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fda%252F12da8c01325db5f9d992135d10ae9a5b%252Fpa%252FVJ90236_0cef3ae74943d04749954d56fa09acb1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/da/12da8c01325db5f9d992135d10ae9a5b/pa/VJ90236_0cef3ae74943d04749954d56fa09acb1.jpg already downloaded
2026-03-27 10:43:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65ce3f8a-36b1-5e83-952b-6cfd301db4fa, identifier: VJ90236
2026-03-27 10:43:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65ce3f8a-36b1-5e83-952b-6cfd301db4fa with identifier: VJ90236
2026-03-27 10:43:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65ce3f8a-36b1-5e83-952b-6cfd301db4fa with identifier: VJ90236
2026-03-27 10:43:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65ce3f8a-36b1-5e83-952b-6cfd301db4fa with identifier: VJ90236 to the API
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VJ90236>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:05:07Z',
 'fuel_type': 'petrol',
 'id': '65ce3f8a-36b1-5e83-952b-6cfd301db4fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ90236',
 'listing': 'auction',
 'location': 'DE, Kippenheim',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 136123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img12/da/12da8c01325db5f9d992135d10ae9a5b/pa/VJ90236_d1a8350fc46a6c56df2f8b201247bec4.jpg',
                'https://img-pa.auto1.com/img12/da/12da8c01325db5f9d992135d10ae9a5b/pa/VJ90236_828f3160cd75b8bd103a1ca1a60c9d8f.jpg',
                'https://img-pa.auto1.com/img12/da/12da8c01325db5f9d992135d10ae9a5b/pa/VJ90236_88503748ea3deeea0adb50bf7b8c4af8.jpg',
                'https://img-pa.auto1.com/img12/da/12da8c01325db5f9d992135d10ae9a5b/pa/VJ90236_fd6451a220355e2b5f7bafae61109c10.jpg',
                'https://img-pa.auto1.com/img12/da/12da8c01325db5f9d992135d10ae9a5b/pa/VJ90236_12de02b17ea5889b428a2aaffdae944f.jpg',
                'https://img-pa.auto1.com/img12/da/12da8c01325db5f9d992135d10ae9a5b/pa/VJ90236_0cef3ae74943d04749954d56fa09acb1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ce3f8a-36b1-5e83-952b-6cfd301db4fa/65ce3f8a-36b1-5e83-952b-6cfd301db4fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/da/12da8c01325db5f9d992135d10ae9a5b/pa/VJ90236_d1a8350fc46a6c56df2f8b201247bec4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ce3f8a-36b1-5e83-952b-6cfd301db4fa/65ce3f8a-36b1-5e83-952b-6cfd301db4fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/da/12da8c01325db5f9d992135d10ae9a5b/pa/VJ90236_828f3160cd75b8bd103a1ca1a60c9d8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ce3f8a-36b1-5e83-952b-6cfd301db4fa/65ce3f8a-36b1-5e83-952b-6cfd301db4fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/da/12da8c01325db5f9d992135d10ae9a5b/pa/VJ90236_88503748ea3deeea0adb50bf7b8c4af8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ce3f8a-36b1-5e83-952b-6cfd301db4fa/65ce3f8a-36b1-5e83-952b-6cfd301db4fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/da/12da8c01325db5f9d992135d10ae9a5b/pa/VJ90236_fd6451a220355e2b5f7bafae61109c10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ce3f8a-36b1-5e83-952b-6cfd301db4fa/65ce3f8a-36b1-5e83-952b-6cfd301db4fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/da/12da8c01325db5f9d992135d10ae9a5b/pa/VJ90236_12de02b17ea5889b428a2aaffdae944f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ce3f8a-36b1-5e83-952b-6cfd301db4fa/65ce3f8a-36b1-5e83-952b-6cfd301db4fa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/da/12da8c01325db5f9d992135d10ae9a5b/pa/VJ90236_0cef3ae74943d04749954d56fa09acb1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-11-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Champions Edition',
 'transmission': 'manual',
 'trim': 'Champions Edition',
 'year': 2012}
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ90236%27 HTTP/1.1" 200 None
2026-03-27 10:43:21 [auto1.de] INFO: Saving data for VJ90236: {'created_time': 1774608201.391241, 'last_price_update_time': 1774608201.391252, 'auction_closing_time': 1774713907.0}
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ90236') HTTP/1.1" 204 0
2026-03-27 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_cc6b361c941fc33e487ed0b01910d1f0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_8a6f5cc4da7e5dbbc978afc0a204862f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_4d2485d25343751142d5599848a019b8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FR69790/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZA85073/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_9ae9b8db22220a8b00942dac15721d2b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_5f23f4ac70fed011fd887c3fafaaea84.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_c8cc3ac158b1ba4d9c93cdd3b1da7df2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_23b1e980c02978524e50f102fcba9707.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_9f5f963b2f409d1b00221d554bcee0bf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_a778cdd559a85a46b49692f085f57127.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500496510>
2026-03-27 10:43:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d453b8a3-059e-559b-b7ec-9fa99a243447/d453b8a3-059e-559b-b7ec-9fa99a243447_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F60%252F8160f483c73924e043577efa0bba0e1d%252Fpa%252FSV13508_cc6b361c941fc33e487ed0b01910d1f0.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_cc6b361c941fc33e487ed0b01910d1f0.jpg saved to cache
2026-03-27 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d453b8a3-059e-559b-b7ec-9fa99a243447
2026-03-27 10:43:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002c98d0>
2026-03-27 10:43:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593556e9-6717-55c2-b669-5dd70abc3ced/593556e9-6717-55c2-b669-5dd70abc3ced_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F86%252F2d866cd020021a3413704f004e3333c3%252Fpa%252FVM88505_8a6f5cc4da7e5dbbc978afc0a204862f.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_8a6f5cc4da7e5dbbc978afc0a204862f.jpg saved to cache
2026-03-27 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 593556e9-6717-55c2-b669-5dd70abc3ced
2026-03-27 10:43:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a6390>
2026-03-27 10:43:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593556e9-6717-55c2-b669-5dd70abc3ced/593556e9-6717-55c2-b669-5dd70abc3ced_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F86%252F2d866cd020021a3413704f004e3333c3%252Fpa%252FVM88505_4d2485d25343751142d5599848a019b8.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_4d2485d25343751142d5599848a019b8.jpg saved to cache
2026-03-27 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 593556e9-6717-55c2-b669-5dd70abc3ced
2026-03-27 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/a9/99a95f42f97b7ce5bfcb25dfa4efaafb/pa/BN83173_265c8a35995834300072f3b6fa216e30.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SM20101> (referer: https://www.auto1.com/v1/car-details-view/SM20101/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_9babface7c4d27f7923a01f2179b05f9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a12550>
2026-03-27 10:43:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bec28c5-1c2b-5132-b3c4-e1281ca87221/4bec28c5-1c2b-5132-b3c4-e1281ca87221_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F5c%252F775cd089272398646fea44d9acd12938%252Fpa%252FSV60739_9ae9b8db22220a8b00942dac15721d2b.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_9ae9b8db22220a8b00942dac15721d2b.jpg saved to cache
2026-03-27 10:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4bec28c5-1c2b-5132-b3c4-e1281ca87221
2026-03-27 10:43:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501955b10>
2026-03-27 10:43:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bec28c5-1c2b-5132-b3c4-e1281ca87221/4bec28c5-1c2b-5132-b3c4-e1281ca87221_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F5c%252F775cd089272398646fea44d9acd12938%252Fpa%252FSV60739_5f23f4ac70fed011fd887c3fafaaea84.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_5f23f4ac70fed011fd887c3fafaaea84.jpg saved to cache
2026-03-27 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4bec28c5-1c2b-5132-b3c4-e1281ca87221
2026-03-27 10:43:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501955350>
2026-03-27 10:43:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bec28c5-1c2b-5132-b3c4-e1281ca87221/4bec28c5-1c2b-5132-b3c4-e1281ca87221_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F5c%252F775cd089272398646fea44d9acd12938%252Fpa%252FSV60739_c8cc3ac158b1ba4d9c93cdd3b1da7df2.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_c8cc3ac158b1ba4d9c93cdd3b1da7df2.jpg saved to cache
2026-03-27 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4bec28c5-1c2b-5132-b3c4-e1281ca87221
2026-03-27 10:43:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500449110>
2026-03-27 10:43:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bec28c5-1c2b-5132-b3c4-e1281ca87221/4bec28c5-1c2b-5132-b3c4-e1281ca87221_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F5c%252F775cd089272398646fea44d9acd12938%252Fpa%252FSV60739_23b1e980c02978524e50f102fcba9707.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_23b1e980c02978524e50f102fcba9707.jpg saved to cache
2026-03-27 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4bec28c5-1c2b-5132-b3c4-e1281ca87221
2026-03-27 10:43:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4bec28c5-1c2b-5132-b3c4-e1281ca87221, skipping ID generation
2026-03-27 10:43:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bec28c5-1c2b-5132-b3c4-e1281ca87221 with scrape type 1
2026-03-27 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4bec28c5-1c2b-5132-b3c4-e1281ca87221 sending to next pipeline
2026-03-27 10:43:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bec28c5-1c2b-5132-b3c4-e1281ca87221, identifier: SV60739
2026-03-27 10:43:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb502611a50>
2026-03-27 10:43:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d453b8a3-059e-559b-b7ec-9fa99a243447/d453b8a3-059e-559b-b7ec-9fa99a243447_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F60%252F8160f483c73924e043577efa0bba0e1d%252Fpa%252FSV13508_9f5f963b2f409d1b00221d554bcee0bf.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_9f5f963b2f409d1b00221d554bcee0bf.jpg saved to cache
2026-03-27 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d453b8a3-059e-559b-b7ec-9fa99a243447
2026-03-27 10:43:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d453b8a3-059e-559b-b7ec-9fa99a243447, skipping ID generation
2026-03-27 10:43:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d453b8a3-059e-559b-b7ec-9fa99a243447 with scrape type 1
2026-03-27 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d453b8a3-059e-559b-b7ec-9fa99a243447 sending to next pipeline
2026-03-27 10:43:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d453b8a3-059e-559b-b7ec-9fa99a243447, identifier: SV13508
2026-03-27 10:43:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500499250>
2026-03-27 10:43:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593556e9-6717-55c2-b669-5dd70abc3ced/593556e9-6717-55c2-b669-5dd70abc3ced_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F86%252F2d866cd020021a3413704f004e3333c3%252Fpa%252FVM88505_a778cdd559a85a46b49692f085f57127.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_a778cdd559a85a46b49692f085f57127.jpg saved to cache
2026-03-27 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 593556e9-6717-55c2-b669-5dd70abc3ced
2026-03-27 10:43:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 593556e9-6717-55c2-b669-5dd70abc3ced, skipping ID generation
2026-03-27 10:43:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 593556e9-6717-55c2-b669-5dd70abc3ced with scrape type 1
2026-03-27 10:43:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 593556e9-6717-55c2-b669-5dd70abc3ced sending to next pipeline
2026-03-27 10:43:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 593556e9-6717-55c2-b669-5dd70abc3ced, identifier: VM88505
2026-03-27 10:43:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bec28c5-1c2b-5132-b3c4-e1281ca87221 with identifier: SV60739
2026-03-27 10:43:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bec28c5-1c2b-5132-b3c4-e1281ca87221 with identifier: SV60739
2026-03-27 10:43:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bec28c5-1c2b-5132-b3c4-e1281ca87221 with identifier: SV60739 to the API
2026-03-27 10:43:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_23b1e980c02978524e50f102fcba9707.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:01:23Z',
 'fuel_type': 'diesel',
 'id': '4bec28c5-1c2b-5132-b3c4-e1281ca87221',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV60739',
 'listing': 'auction',
 'location': 'DE, Bad Oeynhausen',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 224340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bec28c5-1c2b-5132-b3c4-e1281ca87221/4bec28c5-1c2b-5132-b3c4-e1281ca87221_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2442143,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_23b1e980c02978524e50f102fcba9707.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bec28c5-1c2b-5132-b3c4-e1281ca87221/4bec28c5-1c2b-5132-b3c4-e1281ca87221_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_115c6444a768219d74ddd25109d791e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bec28c5-1c2b-5132-b3c4-e1281ca87221/4bec28c5-1c2b-5132-b3c4-e1281ca87221_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_6b5dae8596f5011ff0c954011312a2c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bec28c5-1c2b-5132-b3c4-e1281ca87221/4bec28c5-1c2b-5132-b3c4-e1281ca87221_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_b9967d3bdb545406711e073fcc060113.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bec28c5-1c2b-5132-b3c4-e1281ca87221/4bec28c5-1c2b-5132-b3c4-e1281ca87221_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2557007,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_c8cc3ac158b1ba4d9c93cdd3b1da7df2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bec28c5-1c2b-5132-b3c4-e1281ca87221/4bec28c5-1c2b-5132-b3c4-e1281ca87221_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2536535,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_e399be83f23fd5abd2a387712f4d8e01.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bec28c5-1c2b-5132-b3c4-e1281ca87221/4bec28c5-1c2b-5132-b3c4-e1281ca87221_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2662065,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_5f23f4ac70fed011fd887c3fafaaea84.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bec28c5-1c2b-5132-b3c4-e1281ca87221/4bec28c5-1c2b-5132-b3c4-e1281ca87221_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_5054ba213cf48a440e7bacdf802760b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bec28c5-1c2b-5132-b3c4-e1281ca87221/4bec28c5-1c2b-5132-b3c4-e1281ca87221_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2561039,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_9ae9b8db22220a8b00942dac15721d2b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bec28c5-1c2b-5132-b3c4-e1281ca87221/4bec28c5-1c2b-5132-b3c4-e1281ca87221_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/5c/775cd089272398646fea44d9acd12938/pa/SV60739_3973b6b7e91d364ab639ba76dd90dcb4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V60 1.6 D Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2012}
2026-03-27 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV60739%27 HTTP/1.1" 200 None
2026-03-27 10:43:23 [auto1.de] INFO: Saving data for SV60739: {'created_time': 1774608203.342127, 'last_price_update_time': 1774608203.342138, 'auction_closing_time': 1774713683.0}
2026-03-27 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV60739') HTTP/1.1" 204 0
2026-03-27 10:43:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d453b8a3-059e-559b-b7ec-9fa99a243447 with identifier: SV13508
2026-03-27 10:43:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d453b8a3-059e-559b-b7ec-9fa99a243447 with identifier: SV13508
2026-03-27 10:43:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d453b8a3-059e-559b-b7ec-9fa99a243447 with identifier: SV13508 to the API
2026-03-27 10:43:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_9f5f963b2f409d1b00221d554bcee0bf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:19:27Z',
 'fuel_type': 'petrol',
 'id': 'd453b8a3-059e-559b-b7ec-9fa99a243447',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV13508',
 'listing': 'auction',
 'location': 'DE, Ulm-Senden',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 127824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d453b8a3-059e-559b-b7ec-9fa99a243447/d453b8a3-059e-559b-b7ec-9fa99a243447_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_cc6b361c941fc33e487ed0b01910d1f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d453b8a3-059e-559b-b7ec-9fa99a243447/d453b8a3-059e-559b-b7ec-9fa99a243447_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2874456,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_9f5f963b2f409d1b00221d554bcee0bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d453b8a3-059e-559b-b7ec-9fa99a243447/d453b8a3-059e-559b-b7ec-9fa99a243447_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2969428,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_c31fea7f61fb714c6d4752cb50d4a64c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d453b8a3-059e-559b-b7ec-9fa99a243447/d453b8a3-059e-559b-b7ec-9fa99a243447_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_c6af5bec29882f51b01901e12eab6066.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d453b8a3-059e-559b-b7ec-9fa99a243447/d453b8a3-059e-559b-b7ec-9fa99a243447_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3007625,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_058160646092bcc5e858c57196269952.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d453b8a3-059e-559b-b7ec-9fa99a243447/d453b8a3-059e-559b-b7ec-9fa99a243447_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2802371,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_5b959a975a7535aa1e113c3c97e0113f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d453b8a3-059e-559b-b7ec-9fa99a243447/d453b8a3-059e-559b-b7ec-9fa99a243447_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_d64318821e2b65a4a70fa6902eaf60a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d453b8a3-059e-559b-b7ec-9fa99a243447/d453b8a3-059e-559b-b7ec-9fa99a243447_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3067036,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_3b90cb49a321a2b2ad0a3b21765659cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d453b8a3-059e-559b-b7ec-9fa99a243447/d453b8a3-059e-559b-b7ec-9fa99a243447_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2922995,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_efeb499deab14c757e20b5454dc2045b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d453b8a3-059e-559b-b7ec-9fa99a243447/d453b8a3-059e-559b-b7ec-9fa99a243447_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/60/8160f483c73924e043577efa0bba0e1d/pa/SV13508_91bd8de72586aa886c3f6a2968eda644.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-08-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 BlueEfficiency',
 'transmission': 'manual',
 'trim': 'BlueEfficiency',
 'year': 2012}
2026-03-27 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV13508%27 HTTP/1.1" 200 None
2026-03-27 10:43:24 [auto1.de] INFO: Saving data for SV13508: {'created_time': 1774608204.720214, 'last_price_update_time': 1774608204.720225, 'auction_closing_time': 1774714767.0}
2026-03-27 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV13508') HTTP/1.1" 204 0
2026-03-27 10:43:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 593556e9-6717-55c2-b669-5dd70abc3ced with identifier: VM88505
2026-03-27 10:43:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 593556e9-6717-55c2-b669-5dd70abc3ced with identifier: VM88505
2026-03-27 10:43:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 593556e9-6717-55c2-b669-5dd70abc3ced with identifier: VM88505 to the API
2026-03-27 10:43:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_a778cdd559a85a46b49692f085f57127.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:07:14Z',
 'fuel_type': 'petrol',
 'id': '593556e9-6717-55c2-b669-5dd70abc3ced',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM88505',
 'listing': 'auction',
 'location': 'DE, Ulm-Senden',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 89636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593556e9-6717-55c2-b669-5dd70abc3ced/593556e9-6717-55c2-b669-5dd70abc3ced_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_a778cdd559a85a46b49692f085f57127.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593556e9-6717-55c2-b669-5dd70abc3ced/593556e9-6717-55c2-b669-5dd70abc3ced_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_4d2485d25343751142d5599848a019b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593556e9-6717-55c2-b669-5dd70abc3ced/593556e9-6717-55c2-b669-5dd70abc3ced_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_8a6f5cc4da7e5dbbc978afc0a204862f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593556e9-6717-55c2-b669-5dd70abc3ced/593556e9-6717-55c2-b669-5dd70abc3ced_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_60b2a54f73806a6ea3f6c6803c38d173.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593556e9-6717-55c2-b669-5dd70abc3ced/593556e9-6717-55c2-b669-5dd70abc3ced_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_e1e365f04b3e3080e1d6dc1f5af7dbd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593556e9-6717-55c2-b669-5dd70abc3ced/593556e9-6717-55c2-b669-5dd70abc3ced_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2624125,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_5a0b958b3a06fb5f06f0fb2a31ed0947.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593556e9-6717-55c2-b669-5dd70abc3ced/593556e9-6717-55c2-b669-5dd70abc3ced_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_f649f2cd3038f9507f12339ec6bcb3a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593556e9-6717-55c2-b669-5dd70abc3ced/593556e9-6717-55c2-b669-5dd70abc3ced_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2404242,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_01f47608db03b85c35cc20ce9e19f662.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593556e9-6717-55c2-b669-5dd70abc3ced/593556e9-6717-55c2-b669-5dd70abc3ced_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2534096,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_1461b331882119e46e31e6fb99ea335f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593556e9-6717-55c2-b669-5dd70abc3ced/593556e9-6717-55c2-b669-5dd70abc3ced_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/86/2d866cd020021a3413704f004e3333c3/pa/VM88505_2477389c79e445c1c79fe16aa60df89d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2015}
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM88505%27 HTTP/1.1" 200 None
2026-03-27 10:43:26 [auto1.de] INFO: Saving data for VM88505: {'created_time': 1774608206.372746, 'last_price_update_time': 1774608206.372758, 'auction_closing_time': 1774714034.0}
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VM88505') HTTP/1.1" 204 0
2026-03-27 10:43:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BZ40542/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CD24001/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d6fd0>
2026-03-27 10:43:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8/f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fa9%252F99a95f42f97b7ce5bfcb25dfa4efaafb%252Fpa%252FBN83173_265c8a35995834300072f3b6fa216e30.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/a9/99a95f42f97b7ce5bfcb25dfa4efaafb/pa/BN83173_265c8a35995834300072f3b6fa216e30.jpg saved to cache
2026-03-27 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8
2026-03-27 10:43:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27f0ebb0-c754-579c-811c-465a65648709 with identifier: SM20101
2026-03-27 10:43:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27f0ebb0-c754-579c-811c-465a65648709 with scrape type 1
2026-03-27 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27f0ebb0-c754-579c-811c-465a65648709
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff2%252Fdaf2d8649acba8dc395e37f45944cbf4%252Fpa%252FSM20101_a08aa01fa562551a934a0a8bb12a569d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_a08aa01fa562551a934a0a8bb12a569d.jpg not downloaded yet
2026-03-27 10:43:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50020df50>
2026-03-27 10:43:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3f8f6a2-a744-5295-96bd-003625d9e42d/d3f8f6a2-a744-5295-96bd-003625d9e42d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ff2%252F05f24be41fcea8f3c63150c2a7318649%252Fpa%252FRV26500_9babface7c4d27f7923a01f2179b05f9.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_9babface7c4d27f7923a01f2179b05f9.jpg saved to cache
2026-03-27 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3f8f6a2-a744-5295-96bd-003625d9e42d
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff2%252Fdaf2d8649acba8dc395e37f45944cbf4%252Fpa%252FSM20101_8e6faa83ebdad6edf303e4fb97a32c7c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_8e6faa83ebdad6edf303e4fb97a32c7c.jpg not downloaded yet
2026-03-27 10:43:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff2%252Fdaf2d8649acba8dc395e37f45944cbf4%252Fpa%252FSM20101_456e8f69cb25bb6a3b73aa6ca0a4985b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_456e8f69cb25bb6a3b73aa6ca0a4985b.jpg not downloaded yet
2026-03-27 10:43:26 [auto1.de] INFO: Channel: 24h | Page: 26 | totalHits: 10535 | hits on page: 40
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff2%252Fdaf2d8649acba8dc395e37f45944cbf4%252Fpa%252FSM20101_c1565d1199342fe40f5cd62bf00311df.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_c1565d1199342fe40f5cd62bf00311df.jpg not downloaded yet
2026-03-27 10:43:26 [auto1.de] INFO: Found listing with ID: DJ77655
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ77655%27 HTTP/1.1" 200 None
2026-03-27 10:43:26 [auto1.de] INFO: Scrape type for DJ77655: 0
2026-03-27 10:43:26 [auto1.de] INFO: Found listing with ID: DX68266
2026-03-27 10:43:26 [auto1.de] INFO: Found listing with ID: JL50388
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL50388%27 HTTP/1.1" 200 None
2026-03-27 10:43:26 [auto1.de] INFO: Scrape type for JL50388: 0
2026-03-27 10:43:26 [auto1.de] INFO: Found listing with ID: RM40239
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM40239%27 HTTP/1.1" 200 None
2026-03-27 10:43:26 [auto1.de] INFO: Scrape type for RM40239: 0
2026-03-27 10:43:26 [auto1.de] INFO: Found listing with ID: KL29911
2026-03-27 10:43:26 [auto1.de] INFO: Found listing with ID: FM97642
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM97642%27 HTTP/1.1" 200 None
2026-03-27 10:43:26 [auto1.de] INFO: Scrape type for FM97642: 2
2026-03-27 10:43:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6bd0256-0743-5ed8-8305-5f6b668c863b with identifier: FM97642
2026-03-27 10:43:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6bd0256-0743-5ed8-8305-5f6b668c863b with scrape type 2
2026-03-27 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6bd0256-0743-5ed8-8305-5f6b668c863b with scrape type 2
2026-03-27 10:43:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6bd0256-0743-5ed8-8305-5f6b668c863b, identifier: FM97642
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff2%252Fdaf2d8649acba8dc395e37f45944cbf4%252Fpa%252FSM20101_7a877784b0ffd5855af52c1f6344aca8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_7a877784b0ffd5855af52c1f6344aca8.jpg not downloaded yet
2026-03-27 10:43:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6bd0256-0743-5ed8-8305-5f6b668c863b with identifier: FM97642
2026-03-27 10:43:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6bd0256-0743-5ed8-8305-5f6b668c863b with identifier: FM97642
2026-03-27 10:43:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6bd0256-0743-5ed8-8305-5f6b668c863b with identifier: FM97642 to the API
2026-03-27 10:43:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:05:27Z',
 'fuel_type': 'petrol',
 'id': 'a6bd0256-0743-5ed8-8305-5f6b668c863b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM97642',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 129504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-12',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Join',
 'transmission': 'manual',
 'trim': 'Join',
 'year': 2018}
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM97642%27 HTTP/1.1" 200 None
2026-03-27 10:43:27 [auto1.de] INFO: Saving data for FM97642: {'auction_closing_time': 1774713927.0, 'created_time': 1773401544.413465, 'last_price_update_time': 1774608207.169361}
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM97642') HTTP/1.1" 204 0
2026-03-27 10:43:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/a9/99a95f42f97b7ce5bfcb25dfa4efaafb/pa/BN83173_c370f1a44d0ef6c7c1fdf0b7a8c4ab13.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/a9/99a95f42f97b7ce5bfcb25dfa4efaafb/pa/BN83173_0eb825d2e626eb09f590eec20bdf7368.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_2681236a6f6a62258067cee47170fe4b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_15f47a61748000ebd44f342ec2f6bc79.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_9f2ae5930e8e2cb839087a21539770d1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_a08aa01fa562551a934a0a8bb12a569d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:27 [auto1.de] INFO: Found listing with ID: UH05961
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH05961%27 HTTP/1.1" 200 None
2026-03-27 10:43:27 [auto1.de] INFO: Scrape type for UH05961: 2
2026-03-27 10:43:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fef7df37-4800-551f-9796-4fcf1b2fa79f with identifier: UH05961
2026-03-27 10:43:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fef7df37-4800-551f-9796-4fcf1b2fa79f with scrape type 2
2026-03-27 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fef7df37-4800-551f-9796-4fcf1b2fa79f with scrape type 2
2026-03-27 10:43:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fef7df37-4800-551f-9796-4fcf1b2fa79f, identifier: UH05961
2026-03-27 10:43:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/a9/99a95f42f97b7ce5bfcb25dfa4efaafb/pa/BN83173_b7bb44c48bcf63976c5357751c72dcc6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff2%252Fdaf2d8649acba8dc395e37f45944cbf4%252Fpa%252FSM20101_eb05da50acb274b491da25a8d35f5ab1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_eb05da50acb274b491da25a8d35f5ab1.jpg not downloaded yet
2026-03-27 10:43:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fef7df37-4800-551f-9796-4fcf1b2fa79f with identifier: UH05961
2026-03-27 10:43:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fef7df37-4800-551f-9796-4fcf1b2fa79f with identifier: UH05961
2026-03-27 10:43:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fef7df37-4800-551f-9796-4fcf1b2fa79f with identifier: UH05961 to the API
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:11:58Z',
 'fuel_type': 'diesel',
 'id': 'fef7df37-4800-551f-9796-4fcf1b2fa79f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH05961',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 178237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-15',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Clever',
 'transmission': 'automatic',
 'trim': 'Clever',
 'year': 2018}
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH05961%27 HTTP/1.1" 200 None
2026-03-27 10:43:28 [auto1.de] INFO: Saving data for UH05961: {'auction_closing_time': 1774714318.0, 'created_time': 1773772561.125417, 'last_price_update_time': 1774608208.073133}
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH05961') HTTP/1.1" 204 0
2026-03-27 10:43:28 [auto1.de] INFO: Found listing with ID: SU94182
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU94182%27 HTTP/1.1" 200 None
2026-03-27 10:43:28 [auto1.de] INFO: Scrape type for SU94182: 2
2026-03-27 10:43:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acb26360-181a-57ec-8194-f333b80c7990 with identifier: SU94182
2026-03-27 10:43:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acb26360-181a-57ec-8194-f333b80c7990 with scrape type 2
2026-03-27 10:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acb26360-181a-57ec-8194-f333b80c7990 with scrape type 2
2026-03-27 10:43:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acb26360-181a-57ec-8194-f333b80c7990, identifier: SU94182
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff2%252Fdaf2d8649acba8dc395e37f45944cbf4%252Fpa%252FSM20101_23a1d13f581a79d33e259ad7820358d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_23a1d13f581a79d33e259ad7820358d8.jpg not downloaded yet
2026-03-27 10:43:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acb26360-181a-57ec-8194-f333b80c7990 with identifier: SU94182
2026-03-27 10:43:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acb26360-181a-57ec-8194-f333b80c7990 with identifier: SU94182
2026-03-27 10:43:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acb26360-181a-57ec-8194-f333b80c7990 with identifier: SU94182 to the API
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:34:45Z',
 'fuel_type': 'petrol',
 'id': 'acb26360-181a-57ec-8194-f333b80c7990',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU94182',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 91803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-08',
 'seller_name': None,
 'title': 'Audi Q3 35 TFSI Mild-Hybrid ACT S line',
 'transmission': 'automatic',
 'trim': 'ACT S line',
 'year': 2020}
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU94182%27 HTTP/1.1" 200 None
2026-03-27 10:43:28 [auto1.de] INFO: Saving data for SU94182: {'auction_closing_time': 1774715685.0, 'created_time': 1774293511.379683, 'last_price_update_time': 1774608208.92263}
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU94182') HTTP/1.1" 204 0
2026-03-27 10:43:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_c1565d1199342fe40f5cd62bf00311df.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:29 [auto1.de] INFO: Found listing with ID: GA86041
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA86041%27 HTTP/1.1" 200 None
2026-03-27 10:43:29 [auto1.de] INFO: Scrape type for GA86041: 2
2026-03-27 10:43:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f530195-018f-5dca-b409-d7a978557dfb with identifier: GA86041
2026-03-27 10:43:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f530195-018f-5dca-b409-d7a978557dfb with scrape type 2
2026-03-27 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f530195-018f-5dca-b409-d7a978557dfb with scrape type 2
2026-03-27 10:43:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f530195-018f-5dca-b409-d7a978557dfb, identifier: GA86041
2026-03-27 10:43:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT42199> (referer: https://www.auto1.com/v1/car-details-view/XT42199/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP91741> (referer: https://www.auto1.com/v1/car-details-view/YP91741/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501763850>
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8/f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fa9%252F99a95f42f97b7ce5bfcb25dfa4efaafb%252Fpa%252FBN83173_c370f1a44d0ef6c7c1fdf0b7a8c4ab13.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/a9/99a95f42f97b7ce5bfcb25dfa4efaafb/pa/BN83173_c370f1a44d0ef6c7c1fdf0b7a8c4ab13.jpg saved to cache
2026-03-27 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c3f50>
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8/f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fa9%252F99a95f42f97b7ce5bfcb25dfa4efaafb%252Fpa%252FBN83173_0eb825d2e626eb09f590eec20bdf7368.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/a9/99a95f42f97b7ce5bfcb25dfa4efaafb/pa/BN83173_0eb825d2e626eb09f590eec20bdf7368.jpg saved to cache
2026-03-27 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016af650>
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3f8f6a2-a744-5295-96bd-003625d9e42d/d3f8f6a2-a744-5295-96bd-003625d9e42d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ff2%252F05f24be41fcea8f3c63150c2a7318649%252Fpa%252FRV26500_2681236a6f6a62258067cee47170fe4b.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_2681236a6f6a62258067cee47170fe4b.jpg saved to cache
2026-03-27 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3f8f6a2-a744-5295-96bd-003625d9e42d
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5005563d0>
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3f8f6a2-a744-5295-96bd-003625d9e42d/d3f8f6a2-a744-5295-96bd-003625d9e42d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ff2%252F05f24be41fcea8f3c63150c2a7318649%252Fpa%252FRV26500_15f47a61748000ebd44f342ec2f6bc79.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_15f47a61748000ebd44f342ec2f6bc79.jpg saved to cache
2026-03-27 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3f8f6a2-a744-5295-96bd-003625d9e42d
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016ad190>
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3f8f6a2-a744-5295-96bd-003625d9e42d/d3f8f6a2-a744-5295-96bd-003625d9e42d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ff2%252F05f24be41fcea8f3c63150c2a7318649%252Fpa%252FRV26500_9f2ae5930e8e2cb839087a21539770d1.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_9f2ae5930e8e2cb839087a21539770d1.jpg saved to cache
2026-03-27 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3f8f6a2-a744-5295-96bd-003625d9e42d
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016af790>
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27f0ebb0-c754-579c-811c-465a65648709/27f0ebb0-c754-579c-811c-465a65648709_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff2%252Fdaf2d8649acba8dc395e37f45944cbf4%252Fpa%252FSM20101_a08aa01fa562551a934a0a8bb12a569d.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_a08aa01fa562551a934a0a8bb12a569d.jpg saved to cache
2026-03-27 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27f0ebb0-c754-579c-811c-465a65648709
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a19110>
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8/f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fa9%252F99a95f42f97b7ce5bfcb25dfa4efaafb%252Fpa%252FBN83173_b7bb44c48bcf63976c5357751c72dcc6.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/a9/99a95f42f97b7ce5bfcb25dfa4efaafb/pa/BN83173_b7bb44c48bcf63976c5357751c72dcc6.jpg saved to cache
2026-03-27 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8
2026-03-27 10:43:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8, skipping ID generation
2026-03-27 10:43:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8 with scrape type 1
2026-03-27 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8 sending to next pipeline
2026-03-27 10:43:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8, identifier: BN83173
2026-03-27 10:43:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_7a877784b0ffd5855af52c1f6344aca8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff2%252Fdaf2d8649acba8dc395e37f45944cbf4%252Fpa%252FSM20101_e9350ade4d2a2a720794f1363dbe1136.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_e9350ade4d2a2a720794f1363dbe1136.jpg not downloaded yet
2026-03-27 10:43:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f530195-018f-5dca-b409-d7a978557dfb with identifier: GA86041
2026-03-27 10:43:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f530195-018f-5dca-b409-d7a978557dfb with identifier: GA86041
2026-03-27 10:43:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f530195-018f-5dca-b409-d7a978557dfb with identifier: GA86041 to the API
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:34:25Z',
 'fuel_type': 'petrol',
 'id': '7f530195-018f-5dca-b409-d7a978557dfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA86041',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 164805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-27',
 'seller_name': None,
 'title': 'Skoda Octavia 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA86041%27 HTTP/1.1" 200 None
2026-03-27 10:43:30 [auto1.de] INFO: Saving data for GA86041: {'auction_closing_time': 1774715665.0, 'created_time': 1773306910.76262, 'last_price_update_time': 1774608210.113897}
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA86041') HTTP/1.1" 204 0
2026-03-27 10:43:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8 with identifier: BN83173
2026-03-27 10:43:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8 with identifier: BN83173
2026-03-27 10:43:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8 with identifier: BN83173 to the API
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img99/a9/99a95f42f97b7ce5bfcb25dfa4efaafb/pa/BN83173_b7bb44c48bcf63976c5357751c72dcc6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:43:55Z',
 'fuel_type': 'petrol',
 'id': 'f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN83173',
 'listing': 'auction',
 'location': 'DE, Düsseldorf',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 215615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8/f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/a9/99a95f42f97b7ce5bfcb25dfa4efaafb/pa/BN83173_c370f1a44d0ef6c7c1fdf0b7a8c4ab13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8/f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/a9/99a95f42f97b7ce5bfcb25dfa4efaafb/pa/BN83173_b7bb44c48bcf63976c5357751c72dcc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8/f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/a9/99a95f42f97b7ce5bfcb25dfa4efaafb/pa/BN83173_0eb825d2e626eb09f590eec20bdf7368.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8/f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/a9/99a95f42f97b7ce5bfcb25dfa4efaafb/pa/BN83173_265c8a35995834300072f3b6fa216e30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8/f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/a9/99a95f42f97b7ce5bfcb25dfa4efaafb/pa/BN83173_f0003cc52c7eba1eeb22c3967403f7df.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Style Edition',
 'transmission': 'manual',
 'trim': 'Style Edition',
 'year': 2009}
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN83173%27 HTTP/1.1" 200 None
2026-03-27 10:43:30 [auto1.de] INFO: Saving data for BN83173: {'created_time': 1774608210.551016, 'last_price_update_time': 1774608210.551026, 'auction_closing_time': 1774716235.0}
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN83173') HTTP/1.1" 204 0
2026-03-27 10:43:30 [auto1.de] INFO: Found listing with ID: UD17279
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17279%27 HTTP/1.1" 200 None
2026-03-27 10:43:30 [auto1.de] INFO: Scrape type for UD17279: 2
2026-03-27 10:43:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f510f9e-3b00-5b5c-83d4-63ca840c9e2d with identifier: UD17279
2026-03-27 10:43:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f510f9e-3b00-5b5c-83d4-63ca840c9e2d with scrape type 2
2026-03-27 10:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f510f9e-3b00-5b5c-83d4-63ca840c9e2d with scrape type 2
2026-03-27 10:43:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f510f9e-3b00-5b5c-83d4-63ca840c9e2d, identifier: UD17279
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff2%252Fdaf2d8649acba8dc395e37f45944cbf4%252Fpa%252FSM20101_67d18768cf18d9d34d158d48d92dd1b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_67d18768cf18d9d34d158d48d92dd1b8.jpg not downloaded yet
2026-03-27 10:43:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f510f9e-3b00-5b5c-83d4-63ca840c9e2d with identifier: UD17279
2026-03-27 10:43:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f510f9e-3b00-5b5c-83d4-63ca840c9e2d with identifier: UD17279
2026-03-27 10:43:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f510f9e-3b00-5b5c-83d4-63ca840c9e2d with identifier: UD17279 to the API
2026-03-27 10:43:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:20:37Z',
 'fuel_type': 'diesel',
 'id': '1f510f9e-3b00-5b5c-83d4-63ca840c9e2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD17279',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 99043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-08',
 'seller_name': None,
 'title': 'Audi A6 40 TDI Mild-Hybrid quattro Design',
 'transmission': 'automatic',
 'trim': 'quattro Design',
 'year': 2020}
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17279%27 HTTP/1.1" 200 None
2026-03-27 10:43:31 [auto1.de] INFO: Saving data for UD17279: {'auction_closing_time': 1774714837.0, 'created_time': 1773688896.123319, 'last_price_update_time': 1774608211.572394}
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD17279') HTTP/1.1" 204 0
2026-03-27 10:43:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016427d0>
2026-03-27 10:43:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27f0ebb0-c754-579c-811c-465a65648709/27f0ebb0-c754-579c-811c-465a65648709_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff2%252Fdaf2d8649acba8dc395e37f45944cbf4%252Fpa%252FSM20101_c1565d1199342fe40f5cd62bf00311df.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_c1565d1199342fe40f5cd62bf00311df.jpg saved to cache
2026-03-27 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27f0ebb0-c754-579c-811c-465a65648709
2026-03-27 10:43:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bfccc22-160e-5798-9837-1f036baa35e0 with identifier: XT42199
2026-03-27 10:43:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bfccc22-160e-5798-9837-1f036baa35e0 with scrape type 1
2026-03-27 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7bfccc22-160e-5798-9837-1f036baa35e0
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F24%252Fec249ccc30be55562c132b1f86c82952%252Fpa%252FXT42199_879ce2a89003175e6ac8eb1daa00212e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_879ce2a89003175e6ac8eb1daa00212e.jpg already downloaded
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F24%252Fec249ccc30be55562c132b1f86c82952%252Fpa%252FXT42199_b9c4d9ab30c8f534ec4f15d2bbfd2627.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_b9c4d9ab30c8f534ec4f15d2bbfd2627.jpg already downloaded
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F24%252Fec249ccc30be55562c132b1f86c82952%252Fpa%252FXT42199_881cc027f652ab52c4bf626f96a596d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_881cc027f652ab52c4bf626f96a596d4.jpg already downloaded
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F24%252Fec249ccc30be55562c132b1f86c82952%252Fpa%252FXT42199_498192cbaebe8ece8da0e9f21c432841.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_498192cbaebe8ece8da0e9f21c432841.jpg already downloaded
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F24%252Fec249ccc30be55562c132b1f86c82952%252Fpa%252FXT42199_f2996c1a0af97f857685b5a00018b435.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_f2996c1a0af97f857685b5a00018b435.jpg already downloaded
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F24%252Fec249ccc30be55562c132b1f86c82952%252Fpa%252FXT42199_fbad84224b4fec63fa11e0aa143837e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_fbad84224b4fec63fa11e0aa143837e1.jpg already downloaded
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F24%252Fec249ccc30be55562c132b1f86c82952%252Fpa%252FXT42199_78f1ea68aa266264629b33140b034d07.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_78f1ea68aa266264629b33140b034d07.jpg already downloaded
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F24%252Fec249ccc30be55562c132b1f86c82952%252Fpa%252FXT42199_29cca6c13c9ee0072ed644492c779e80.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_29cca6c13c9ee0072ed644492c779e80.jpg already downloaded
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F24%252Fec249ccc30be55562c132b1f86c82952%252Fpa%252FXT42199_9675c8987e487d38da2ffaf41f5bf734.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_9675c8987e487d38da2ffaf41f5bf734.jpg already downloaded
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F24%252Fec249ccc30be55562c132b1f86c82952%252Fpa%252FXT42199_73be8002ade86cc0d973776f20a28b6b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_73be8002ade86cc0d973776f20a28b6b.jpg already downloaded
2026-03-27 10:43:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bfccc22-160e-5798-9837-1f036baa35e0, identifier: XT42199
2026-03-27 10:43:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef9df5d1-7f25-529c-a24c-f92f72dae2c3 with identifier: YP91741
2026-03-27 10:43:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef9df5d1-7f25-529c-a24c-f92f72dae2c3 with scrape type 1
2026-03-27 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef9df5d1-7f25-529c-a24c-f92f72dae2c3
2026-03-27 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff6%252F91f65d5df650f8939b2c3359ff2117e5%252Fpa%252FYP91741_2e59e3aff6d0a6a05f6aac9e36dd80a9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_2e59e3aff6d0a6a05f6aac9e36dd80a9.jpg not downloaded yet
2026-03-27 10:43:32 [auto1.de] INFO: Found listing with ID: GX08405
2026-03-27 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX08405%27 HTTP/1.1" 200 None
2026-03-27 10:43:32 [auto1.de] INFO: Scrape type for GX08405: 2
2026-03-27 10:43:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3456634d-de35-50d2-bc34-707358a3ac0e with identifier: GX08405
2026-03-27 10:43:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3456634d-de35-50d2-bc34-707358a3ac0e with scrape type 2
2026-03-27 10:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3456634d-de35-50d2-bc34-707358a3ac0e with scrape type 2
2026-03-27 10:43:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3456634d-de35-50d2-bc34-707358a3ac0e, identifier: GX08405
2026-03-27 10:43:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bfccc22-160e-5798-9837-1f036baa35e0 with identifier: XT42199
2026-03-27 10:43:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bfccc22-160e-5798-9837-1f036baa35e0 with identifier: XT42199
2026-03-27 10:43:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bfccc22-160e-5798-9837-1f036baa35e0 with identifier: XT42199 to the API
2026-03-27 10:43:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XT42199>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:29:55Z',
 'fuel_type': 'diesel',
 'id': '7bfccc22-160e-5798-9837-1f036baa35e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT42199',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 149885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_879ce2a89003175e6ac8eb1daa00212e.jpg',
                'https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_b9c4d9ab30c8f534ec4f15d2bbfd2627.jpg',
                'https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_881cc027f652ab52c4bf626f96a596d4.jpg',
                'https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_498192cbaebe8ece8da0e9f21c432841.jpg',
                'https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_f2996c1a0af97f857685b5a00018b435.jpg',
                'https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_fbad84224b4fec63fa11e0aa143837e1.jpg',
                'https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_78f1ea68aa266264629b33140b034d07.jpg',
                'https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_29cca6c13c9ee0072ed644492c779e80.jpg',
                'https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_9675c8987e487d38da2ffaf41f5bf734.jpg',
                'https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_73be8002ade86cc0d973776f20a28b6b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfccc22-160e-5798-9837-1f036baa35e0/7bfccc22-160e-5798-9837-1f036baa35e0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2810403,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_879ce2a89003175e6ac8eb1daa00212e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfccc22-160e-5798-9837-1f036baa35e0/7bfccc22-160e-5798-9837-1f036baa35e0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_b9c4d9ab30c8f534ec4f15d2bbfd2627.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfccc22-160e-5798-9837-1f036baa35e0/7bfccc22-160e-5798-9837-1f036baa35e0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_881cc027f652ab52c4bf626f96a596d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfccc22-160e-5798-9837-1f036baa35e0/7bfccc22-160e-5798-9837-1f036baa35e0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_498192cbaebe8ece8da0e9f21c432841.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfccc22-160e-5798-9837-1f036baa35e0/7bfccc22-160e-5798-9837-1f036baa35e0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2611746,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_f2996c1a0af97f857685b5a00018b435.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfccc22-160e-5798-9837-1f036baa35e0/7bfccc22-160e-5798-9837-1f036baa35e0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_fbad84224b4fec63fa11e0aa143837e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfccc22-160e-5798-9837-1f036baa35e0/7bfccc22-160e-5798-9837-1f036baa35e0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1918400,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_78f1ea68aa266264629b33140b034d07.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfccc22-160e-5798-9837-1f036baa35e0/7bfccc22-160e-5798-9837-1f036baa35e0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_29cca6c13c9ee0072ed644492c779e80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfccc22-160e-5798-9837-1f036baa35e0/7bfccc22-160e-5798-9837-1f036baa35e0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_9675c8987e487d38da2ffaf41f5bf734.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bfccc22-160e-5798-9837-1f036baa35e0/7bfccc22-160e-5798-9837-1f036baa35e0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/24/ec249ccc30be55562c132b1f86c82952/pa/XT42199_73be8002ade86cc0d973776f20a28b6b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Sports-Line AWD',
 'transmission': 'automatic',
 'trim': 'Sports-Line AWD',
 'year': 2015}
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT42199%27 HTTP/1.1" 200 None
2026-03-27 10:43:33 [auto1.de] INFO: Saving data for XT42199: {'created_time': 1774608213.149039, 'last_price_update_time': 1774608213.149054, 'auction_closing_time': 1774715395.0}
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT42199') HTTP/1.1" 204 0
2026-03-27 10:43:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_23a1d13f581a79d33e259ad7820358d8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_9d10e07a8e6f5122ef5e1e10c2cec3a5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff2%252Fdaf2d8649acba8dc395e37f45944cbf4%252Fpa%252FSM20101_072d64ba23251d6a8682d0cdb2e58123.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_072d64ba23251d6a8682d0cdb2e58123.jpg not downloaded yet
2026-03-27 10:43:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3456634d-de35-50d2-bc34-707358a3ac0e with identifier: GX08405
2026-03-27 10:43:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3456634d-de35-50d2-bc34-707358a3ac0e with identifier: GX08405
2026-03-27 10:43:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3456634d-de35-50d2-bc34-707358a3ac0e with identifier: GX08405 to the API
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-28T16:53:20Z',
 'fuel_type': 'diesel',
 'id': '3456634d-de35-50d2-bc34-707358a3ac0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX08405',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 167316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-13',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX08405%27 HTTP/1.1" 200 None
2026-03-27 10:43:33 [auto1.de] INFO: Saving data for GX08405: {'auction_closing_time': 1774716800.0, 'created_time': 1773383178.714776, 'last_price_update_time': 1774608213.560064}
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX08405') HTTP/1.1" 204 0
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff6%252F91f65d5df650f8939b2c3359ff2117e5%252Fpa%252FYP91741_1b2be556cb9b528d2c364eaa81e5c4c3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_1b2be556cb9b528d2c364eaa81e5c4c3.jpg not downloaded yet
2026-03-27 10:43:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BT35414/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500340c50>
2026-03-27 10:43:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27f0ebb0-c754-579c-811c-465a65648709/27f0ebb0-c754-579c-811c-465a65648709_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff2%252Fdaf2d8649acba8dc395e37f45944cbf4%252Fpa%252FSM20101_7a877784b0ffd5855af52c1f6344aca8.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_7a877784b0ffd5855af52c1f6344aca8.jpg saved to cache
2026-03-27 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27f0ebb0-c754-579c-811c-465a65648709
2026-03-27 10:43:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_eb05da50acb274b491da25a8d35f5ab1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:33 [auto1.de] INFO: Found listing with ID: CK84203
2026-03-27 10:43:33 [auto1.de] INFO: Found listing with ID: TH70911
2026-03-27 10:43:33 [auto1.de] INFO: Found listing with ID: MG70959
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG70959%27 HTTP/1.1" 200 None
2026-03-27 10:43:33 [auto1.de] INFO: Scrape type for MG70959: 2
2026-03-27 10:43:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1650e1ec-9f27-5960-8d16-69c8bdbe0c82 with identifier: MG70959
2026-03-27 10:43:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1650e1ec-9f27-5960-8d16-69c8bdbe0c82 with scrape type 2
2026-03-27 10:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1650e1ec-9f27-5960-8d16-69c8bdbe0c82 with scrape type 2
2026-03-27 10:43:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1650e1ec-9f27-5960-8d16-69c8bdbe0c82, identifier: MG70959
2026-03-27 10:43:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1650e1ec-9f27-5960-8d16-69c8bdbe0c82 with identifier: MG70959
2026-03-27 10:43:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1650e1ec-9f27-5960-8d16-69c8bdbe0c82 with identifier: MG70959
2026-03-27 10:43:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1650e1ec-9f27-5960-8d16-69c8bdbe0c82 with identifier: MG70959 to the API
2026-03-27 10:43:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:54:15Z',
 'fuel_type': 'petrol',
 'id': '1650e1ec-9f27-5960-8d16-69c8bdbe0c82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG70959',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 247311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG70959%27 HTTP/1.1" 200 None
2026-03-27 10:43:34 [auto1.de] INFO: Saving data for MG70959: {'auction_closing_time': 1774716855.0, 'created_time': 1773380530.636258, 'last_price_update_time': 1774608214.188385}
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG70959') HTTP/1.1" 204 0
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff6%252F91f65d5df650f8939b2c3359ff2117e5%252Fpa%252FYP91741_f3e1466020d1441abc093d0cb82d9547.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_f3e1466020d1441abc093d0cb82d9547.jpg not downloaded yet
2026-03-27 10:43:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FR69790> (referer: https://www.auto1.com/v1/car-details-view/FR69790/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:34 [auto1.de] INFO: Found listing with ID: PT78073
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT78073%27 HTTP/1.1" 200 None
2026-03-27 10:43:34 [auto1.de] INFO: Scrape type for PT78073: 2
2026-03-27 10:43:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 595e6759-546d-5b7d-b185-268441999091 with identifier: PT78073
2026-03-27 10:43:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 595e6759-546d-5b7d-b185-268441999091 with scrape type 2
2026-03-27 10:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 595e6759-546d-5b7d-b185-268441999091 with scrape type 2
2026-03-27 10:43:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 595e6759-546d-5b7d-b185-268441999091, identifier: PT78073
2026-03-27 10:43:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c2050>
2026-03-27 10:43:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27f0ebb0-c754-579c-811c-465a65648709/27f0ebb0-c754-579c-811c-465a65648709_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff2%252Fdaf2d8649acba8dc395e37f45944cbf4%252Fpa%252FSM20101_23a1d13f581a79d33e259ad7820358d8.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_23a1d13f581a79d33e259ad7820358d8.jpg saved to cache
2026-03-27 10:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27f0ebb0-c754-579c-811c-465a65648709
2026-03-27 10:43:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501846650>
2026-03-27 10:43:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3f8f6a2-a744-5295-96bd-003625d9e42d/d3f8f6a2-a744-5295-96bd-003625d9e42d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ff2%252F05f24be41fcea8f3c63150c2a7318649%252Fpa%252FRV26500_9d10e07a8e6f5122ef5e1e10c2cec3a5.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_9d10e07a8e6f5122ef5e1e10c2cec3a5.jpg saved to cache
2026-03-27 10:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3f8f6a2-a744-5295-96bd-003625d9e42d
2026-03-27 10:43:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 595e6759-546d-5b7d-b185-268441999091 with identifier: PT78073
2026-03-27 10:43:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 595e6759-546d-5b7d-b185-268441999091 with identifier: PT78073
2026-03-27 10:43:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 595e6759-546d-5b7d-b185-268441999091 with identifier: PT78073 to the API
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:21:31Z',
 'fuel_type': 'petrol',
 'id': '595e6759-546d-5b7d-b185-268441999091',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT78073',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 32849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-11',
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo Ultimate',
 'transmission': 'automatic',
 'trim': 'Ultimate',
 'year': 2024}
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT78073%27 HTTP/1.1" 200 None
2026-03-27 10:43:35 [auto1.de] INFO: Saving data for PT78073: {'auction_closing_time': 1774714891.0, 'created_time': 1773305116.950431, 'last_price_update_time': 1774608215.168974}
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT78073') HTTP/1.1" 204 0
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff6%252F91f65d5df650f8939b2c3359ff2117e5%252Fpa%252FYP91741_c849a5cb5301aec353f46aec2e610e12.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_c849a5cb5301aec353f46aec2e610e12.jpg not downloaded yet
2026-03-27 10:43:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501949390>
2026-03-27 10:43:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27f0ebb0-c754-579c-811c-465a65648709/27f0ebb0-c754-579c-811c-465a65648709_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff2%252Fdaf2d8649acba8dc395e37f45944cbf4%252Fpa%252FSM20101_eb05da50acb274b491da25a8d35f5ab1.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_eb05da50acb274b491da25a8d35f5ab1.jpg saved to cache
2026-03-27 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27f0ebb0-c754-579c-811c-465a65648709
2026-03-27 10:43:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_2e59e3aff6d0a6a05f6aac9e36dd80a9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_67d18768cf18d9d34d158d48d92dd1b8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:35 [auto1.de] INFO: Found listing with ID: WU34060
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU34060%27 HTTP/1.1" 200 None
2026-03-27 10:43:35 [auto1.de] INFO: Scrape type for WU34060: 2
2026-03-27 10:43:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fa9eeca-3502-5a6f-80ae-74520ebbbe38 with identifier: WU34060
2026-03-27 10:43:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fa9eeca-3502-5a6f-80ae-74520ebbbe38 with scrape type 2
2026-03-27 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fa9eeca-3502-5a6f-80ae-74520ebbbe38 with scrape type 2
2026-03-27 10:43:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fa9eeca-3502-5a6f-80ae-74520ebbbe38, identifier: WU34060
2026-03-27 10:43:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_e9350ade4d2a2a720794f1363dbe1136.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fa9eeca-3502-5a6f-80ae-74520ebbbe38 with identifier: WU34060
2026-03-27 10:43:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fa9eeca-3502-5a6f-80ae-74520ebbbe38 with identifier: WU34060
2026-03-27 10:43:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fa9eeca-3502-5a6f-80ae-74520ebbbe38 with identifier: WU34060 to the API
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:36:18Z',
 'fuel_type': 'petrol',
 'id': '5fa9eeca-3502-5a6f-80ae-74520ebbbe38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU34060',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 201041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-28',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI Style Copa',
 'transmission': 'manual',
 'trim': 'Style Copa',
 'year': 2011}
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU34060%27 HTTP/1.1" 200 None
2026-03-27 10:43:35 [auto1.de] INFO: Saving data for WU34060: {'auction_closing_time': 1774715778.0, 'created_time': 1773812129.92023, 'last_price_update_time': 1774608215.835574}
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WU34060') HTTP/1.1" 204 0
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff6%252F91f65d5df650f8939b2c3359ff2117e5%252Fpa%252FYP91741_5ab1a66157ebe881695c6d0f5d6138d3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_5ab1a66157ebe881695c6d0f5d6138d3.jpg not downloaded yet
2026-03-27 10:43:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb5db8d2-4364-5068-ad37-0111f938b3a7 with identifier: FR69790
2026-03-27 10:43:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb5db8d2-4364-5068-ad37-0111f938b3a7 with scrape type 1
2026-03-27 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb5db8d2-4364-5068-ad37-0111f938b3a7
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F27%252F4a275ba7d74583925521489e1c1f3ac2%252Fpa%252FFR69790_bdec3bffc49dc63cc98c509aeb243d92.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_bdec3bffc49dc63cc98c509aeb243d92.jpg not downloaded yet
2026-03-27 10:43:35 [auto1.de] INFO: Found listing with ID: ZE40568
2026-03-27 10:43:35 [auto1.de] INFO: Found listing with ID: PC86421
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC86421%27 HTTP/1.1" 200 None
2026-03-27 10:43:35 [auto1.de] INFO: Scrape type for PC86421: 2
2026-03-27 10:43:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 651a4870-40ff-5f5b-bfb9-2faf21646919 with identifier: PC86421
2026-03-27 10:43:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 651a4870-40ff-5f5b-bfb9-2faf21646919 with scrape type 2
2026-03-27 10:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 651a4870-40ff-5f5b-bfb9-2faf21646919 with scrape type 2
2026-03-27 10:43:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 651a4870-40ff-5f5b-bfb9-2faf21646919, identifier: PC86421
2026-03-27 10:43:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_1b2be556cb9b528d2c364eaa81e5c4c3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 651a4870-40ff-5f5b-bfb9-2faf21646919 with identifier: PC86421
2026-03-27 10:43:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 651a4870-40ff-5f5b-bfb9-2faf21646919 with identifier: PC86421
2026-03-27 10:43:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 651a4870-40ff-5f5b-bfb9-2faf21646919 with identifier: PC86421 to the API
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:58:27Z',
 'fuel_type': 'diesel',
 'id': '651a4870-40ff-5f5b-bfb9-2faf21646919',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC86421',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 96002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-21',
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi L1H1 Ka 2,8t',
 'transmission': 'manual',
 'trim': 'L1H1 Ka 2,8t',
 'year': 2014}
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC86421%27 HTTP/1.1" 200 None
2026-03-27 10:43:36 [auto1.de] INFO: Saving data for PC86421: {'auction_closing_time': 1774717107.0, 'created_time': 1773304798.900836, 'last_price_update_time': 1774608216.458499}
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC86421') HTTP/1.1" 204 0
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff6%252F91f65d5df650f8939b2c3359ff2117e5%252Fpa%252FYP91741_27a1c230381fa680032fe5b0bba31192.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_27a1c230381fa680032fe5b0bba31192.jpg not downloaded yet
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F27%252F4a275ba7d74583925521489e1c1f3ac2%252Fpa%252FFR69790_c74644e9f2b210cca70f50935a9ca397.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_c74644e9f2b210cca70f50935a9ca397.jpg not downloaded yet
2026-03-27 10:43:36 [auto1.de] INFO: Found listing with ID: FK97856
2026-03-27 10:43:36 [auto1.de] INFO: Found listing with ID: DT94754
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT94754%27 HTTP/1.1" 200 None
2026-03-27 10:43:36 [auto1.de] INFO: Scrape type for DT94754: 2
2026-03-27 10:43:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b47c6fe8-8101-57d4-9b05-3ca720aff3e2 with identifier: DT94754
2026-03-27 10:43:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b47c6fe8-8101-57d4-9b05-3ca720aff3e2 with scrape type 2
2026-03-27 10:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b47c6fe8-8101-57d4-9b05-3ca720aff3e2 with scrape type 2
2026-03-27 10:43:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b47c6fe8-8101-57d4-9b05-3ca720aff3e2, identifier: DT94754
2026-03-27 10:43:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500314a90>
2026-03-27 10:43:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef9df5d1-7f25-529c-a24c-f92f72dae2c3/ef9df5d1-7f25-529c-a24c-f92f72dae2c3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff6%252F91f65d5df650f8939b2c3359ff2117e5%252Fpa%252FYP91741_2e59e3aff6d0a6a05f6aac9e36dd80a9.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_2e59e3aff6d0a6a05f6aac9e36dd80a9.jpg saved to cache
2026-03-27 10:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef9df5d1-7f25-529c-a24c-f92f72dae2c3
2026-03-27 10:43:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501694d50>
2026-03-27 10:43:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27f0ebb0-c754-579c-811c-465a65648709/27f0ebb0-c754-579c-811c-465a65648709_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff2%252Fdaf2d8649acba8dc395e37f45944cbf4%252Fpa%252FSM20101_67d18768cf18d9d34d158d48d92dd1b8.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_67d18768cf18d9d34d158d48d92dd1b8.jpg saved to cache
2026-03-27 10:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27f0ebb0-c754-579c-811c-465a65648709
2026-03-27 10:43:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500570910>
2026-03-27 10:43:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27f0ebb0-c754-579c-811c-465a65648709/27f0ebb0-c754-579c-811c-465a65648709_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff2%252Fdaf2d8649acba8dc395e37f45944cbf4%252Fpa%252FSM20101_e9350ade4d2a2a720794f1363dbe1136.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_e9350ade4d2a2a720794f1363dbe1136.jpg saved to cache
2026-03-27 10:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27f0ebb0-c754-579c-811c-465a65648709
2026-03-27 10:43:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_c849a5cb5301aec353f46aec2e610e12.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b47c6fe8-8101-57d4-9b05-3ca720aff3e2 with identifier: DT94754
2026-03-27 10:43:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b47c6fe8-8101-57d4-9b05-3ca720aff3e2 with identifier: DT94754
2026-03-27 10:43:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b47c6fe8-8101-57d4-9b05-3ca720aff3e2 with identifier: DT94754 to the API
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:50:51Z',
 'fuel_type': 'diesel',
 'id': 'b47c6fe8-8101-57d4-9b05-3ca720aff3e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT94754',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 98855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-20',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 109 CDI Lang',
 'transmission': 'manual',
 'trim': 'Lang',
 'year': 2014}
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT94754%27 HTTP/1.1" 200 None
2026-03-27 10:43:37 [auto1.de] INFO: Saving data for DT94754: {'auction_closing_time': 1774716651.0, 'created_time': 1773380560.023934, 'last_price_update_time': 1774608217.263062}
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT94754') HTTP/1.1" 204 0
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff6%252F91f65d5df650f8939b2c3359ff2117e5%252Fpa%252FYP91741_e2493d8e2cd9c847e9c5799a905f7d43.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_e2493d8e2cd9c847e9c5799a905f7d43.jpg not downloaded yet
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F27%252F4a275ba7d74583925521489e1c1f3ac2%252Fpa%252FFR69790_40a8c217d194efee5c716ba09e915fe7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_40a8c217d194efee5c716ba09e915fe7.jpg not downloaded yet
2026-03-27 10:43:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_f3e1466020d1441abc093d0cb82d9547.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:37 [auto1.de] INFO: Found listing with ID: WE44185
2026-03-27 10:43:37 [auto1.de] INFO: Found listing with ID: AU40553
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU40553%27 HTTP/1.1" 200 None
2026-03-27 10:43:37 [auto1.de] INFO: Scrape type for AU40553: 2
2026-03-27 10:43:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9961705-a728-544e-be0f-bddba2cf9e3b with identifier: AU40553
2026-03-27 10:43:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9961705-a728-544e-be0f-bddba2cf9e3b with scrape type 2
2026-03-27 10:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9961705-a728-544e-be0f-bddba2cf9e3b with scrape type 2
2026-03-27 10:43:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9961705-a728-544e-be0f-bddba2cf9e3b, identifier: AU40553
2026-03-27 10:43:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c3ad0>
2026-03-27 10:43:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef9df5d1-7f25-529c-a24c-f92f72dae2c3/ef9df5d1-7f25-529c-a24c-f92f72dae2c3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff6%252F91f65d5df650f8939b2c3359ff2117e5%252Fpa%252FYP91741_1b2be556cb9b528d2c364eaa81e5c4c3.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_1b2be556cb9b528d2c364eaa81e5c4c3.jpg saved to cache
2026-03-27 10:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef9df5d1-7f25-529c-a24c-f92f72dae2c3
2026-03-27 10:43:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9961705-a728-544e-be0f-bddba2cf9e3b with identifier: AU40553
2026-03-27 10:43:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9961705-a728-544e-be0f-bddba2cf9e3b with identifier: AU40553
2026-03-27 10:43:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9961705-a728-544e-be0f-bddba2cf9e3b with identifier: AU40553 to the API
2026-03-27 10:43:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:19:16Z',
 'fuel_type': 'diesel',
 'id': 'e9961705-a728-544e-be0f-bddba2cf9e3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU40553',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Caravelle',
 'odometer': 198514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-31',
 'seller_name': None,
 'title': 'Volkswagen T5 Caravelle 2.0 TDI Trendline lang',
 'transmission': 'manual',
 'trim': 'Trendline lang',
 'year': 2011}
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU40553%27 HTTP/1.1" 200 None
2026-03-27 10:43:38 [auto1.de] INFO: Saving data for AU40553: {'auction_closing_time': 1774714756.0, 'created_time': 1773686168.732536, 'last_price_update_time': 1774608218.150734}
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU40553') HTTP/1.1" 204 0
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff6%252F91f65d5df650f8939b2c3359ff2117e5%252Fpa%252FYP91741_15bfa8915001b4d8d73077d819e0732a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_15bfa8915001b4d8d73077d819e0732a.jpg not downloaded yet
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F27%252F4a275ba7d74583925521489e1c1f3ac2%252Fpa%252FFR69790_803ec06fab54ed8edeafc46858ed33f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_803ec06fab54ed8edeafc46858ed33f5.jpg not downloaded yet
2026-03-27 10:43:38 [auto1.de] INFO: Found listing with ID: XB90216
2026-03-27 10:43:38 [auto1.de] INFO: Found listing with ID: NN66597
2026-03-27 10:43:38 [auto1.de] INFO: Found listing with ID: LB47051
2026-03-27 10:43:38 [auto1.de] INFO: Found listing with ID: NR01003
2026-03-27 10:43:38 [auto1.de] INFO: Found listing with ID: ES68108
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES68108%27 HTTP/1.1" 200 None
2026-03-27 10:43:38 [auto1.de] INFO: Scrape type for ES68108: 2
2026-03-27 10:43:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1803ee4c-aab7-54d1-8d04-2628fd9e4694 with identifier: ES68108
2026-03-27 10:43:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1803ee4c-aab7-54d1-8d04-2628fd9e4694 with scrape type 2
2026-03-27 10:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1803ee4c-aab7-54d1-8d04-2628fd9e4694 with scrape type 2
2026-03-27 10:43:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1803ee4c-aab7-54d1-8d04-2628fd9e4694, identifier: ES68108
2026-03-27 10:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_bdec3bffc49dc63cc98c509aeb243d92.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1803ee4c-aab7-54d1-8d04-2628fd9e4694 with identifier: ES68108
2026-03-27 10:43:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1803ee4c-aab7-54d1-8d04-2628fd9e4694 with identifier: ES68108
2026-03-27 10:43:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1803ee4c-aab7-54d1-8d04-2628fd9e4694 with identifier: ES68108 to the API
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:14:09Z',
 'fuel_type': 'diesel',
 'id': '1803ee4c-aab7-54d1-8d04-2628fd9e4694',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES68108',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 263130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-31',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Champions Edition',
 'transmission': 'automatic',
 'trim': 'Champions Edition',
 'year': 2012}
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES68108%27 HTTP/1.1" 200 None
2026-03-27 10:43:38 [auto1.de] INFO: Saving data for ES68108: {'auction_closing_time': 1774714449.0, 'created_time': 1773775436.293137, 'last_price_update_time': 1774608218.693389}
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES68108') HTTP/1.1" 204 0
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff6%252F91f65d5df650f8939b2c3359ff2117e5%252Fpa%252FYP91741_936959b6e547f1265718af4bd7020707.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_936959b6e547f1265718af4bd7020707.jpg not downloaded yet
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F27%252F4a275ba7d74583925521489e1c1f3ac2%252Fpa%252FFR69790_459d99acc6a54d40d7568bc54024bf80.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_459d99acc6a54d40d7568bc54024bf80.jpg not downloaded yet
2026-03-27 10:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CD24001> (referer: https://www.auto1.com/v1/car-details-view/CD24001/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001ce2d0>
2026-03-27 10:43:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef9df5d1-7f25-529c-a24c-f92f72dae2c3/ef9df5d1-7f25-529c-a24c-f92f72dae2c3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff6%252F91f65d5df650f8939b2c3359ff2117e5%252Fpa%252FYP91741_c849a5cb5301aec353f46aec2e610e12.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_c849a5cb5301aec353f46aec2e610e12.jpg saved to cache
2026-03-27 10:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef9df5d1-7f25-529c-a24c-f92f72dae2c3
2026-03-27 10:43:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004deed0>
2026-03-27 10:43:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef9df5d1-7f25-529c-a24c-f92f72dae2c3/ef9df5d1-7f25-529c-a24c-f92f72dae2c3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff6%252F91f65d5df650f8939b2c3359ff2117e5%252Fpa%252FYP91741_f3e1466020d1441abc093d0cb82d9547.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_f3e1466020d1441abc093d0cb82d9547.jpg saved to cache
2026-03-27 10:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef9df5d1-7f25-529c-a24c-f92f72dae2c3
2026-03-27 10:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_c74644e9f2b210cca70f50935a9ca397.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:38 [auto1.de] INFO: Found listing with ID: KZ08446
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ08446%27 HTTP/1.1" 200 None
2026-03-27 10:43:38 [auto1.de] INFO: Scrape type for KZ08446: 2
2026-03-27 10:43:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0062780f-5834-5996-80a8-4cd62721e991 with identifier: KZ08446
2026-03-27 10:43:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0062780f-5834-5996-80a8-4cd62721e991 with scrape type 2
2026-03-27 10:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0062780f-5834-5996-80a8-4cd62721e991 with scrape type 2
2026-03-27 10:43:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0062780f-5834-5996-80a8-4cd62721e991, identifier: KZ08446
2026-03-27 10:43:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZA85073> (referer: https://www.auto1.com/v1/car-details-view/ZA85073/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0062780f-5834-5996-80a8-4cd62721e991 with identifier: KZ08446
2026-03-27 10:43:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0062780f-5834-5996-80a8-4cd62721e991 with identifier: KZ08446
2026-03-27 10:43:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0062780f-5834-5996-80a8-4cd62721e991 with identifier: KZ08446 to the API
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:02:07Z',
 'fuel_type': 'petrol',
 'id': '0062780f-5834-5996-80a8-4cd62721e991',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ08446',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 85779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-11',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ08446%27 HTTP/1.1" 200 None
2026-03-27 10:43:39 [auto1.de] INFO: Saving data for KZ08446: {'auction_closing_time': 1774713727.0, 'created_time': 1774290938.902477, 'last_price_update_time': 1774608219.28522}
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ08446') HTTP/1.1" 204 0
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff6%252F91f65d5df650f8939b2c3359ff2117e5%252Fpa%252FYP91741_8e7fb029b0beaf37b9c8314bfae8af09.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_8e7fb029b0beaf37b9c8314bfae8af09.jpg not downloaded yet
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F27%252F4a275ba7d74583925521489e1c1f3ac2%252Fpa%252FFR69790_84e50a60b0a2d7c51cf7f811bc7991c7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_84e50a60b0a2d7c51cf7f811bc7991c7.jpg not downloaded yet
2026-03-27 10:43:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_27a1c230381fa680032fe5b0bba31192.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:39 [auto1.de] INFO: Found listing with ID: VE16712
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE16712%27 HTTP/1.1" 200 None
2026-03-27 10:43:39 [auto1.de] INFO: Scrape type for VE16712: 2
2026-03-27 10:43:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5746afbe-8f5f-5d3c-90e8-a86f2a105410 with identifier: VE16712
2026-03-27 10:43:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5746afbe-8f5f-5d3c-90e8-a86f2a105410 with scrape type 2
2026-03-27 10:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5746afbe-8f5f-5d3c-90e8-a86f2a105410 with scrape type 2
2026-03-27 10:43:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5746afbe-8f5f-5d3c-90e8-a86f2a105410, identifier: VE16712
2026-03-27 10:43:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015cc150>
2026-03-27 10:43:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb5db8d2-4364-5068-ad37-0111f938b3a7/cb5db8d2-4364-5068-ad37-0111f938b3a7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F27%252F4a275ba7d74583925521489e1c1f3ac2%252Fpa%252FFR69790_bdec3bffc49dc63cc98c509aeb243d92.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_bdec3bffc49dc63cc98c509aeb243d92.jpg saved to cache
2026-03-27 10:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb5db8d2-4364-5068-ad37-0111f938b3a7
2026-03-27 10:43:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5746afbe-8f5f-5d3c-90e8-a86f2a105410 with identifier: VE16712
2026-03-27 10:43:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5746afbe-8f5f-5d3c-90e8-a86f2a105410 with identifier: VE16712
2026-03-27 10:43:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5746afbe-8f5f-5d3c-90e8-a86f2a105410 with identifier: VE16712 to the API
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:49:58Z',
 'fuel_type': 'petrol',
 'id': '5746afbe-8f5f-5d3c-90e8-a86f2a105410',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE16712',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 84759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-25',
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT Xcellence',
 'transmission': 'manual',
 'trim': 'Xcellence',
 'year': 2020}
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE16712%27 HTTP/1.1" 200 None
2026-03-27 10:43:39 [auto1.de] INFO: Saving data for VE16712: {'auction_closing_time': 1774716598.0, 'created_time': 1774290946.965932, 'last_price_update_time': 1774608219.96584}
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE16712') HTTP/1.1" 204 0
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F27%252F4a275ba7d74583925521489e1c1f3ac2%252Fpa%252FFR69790_8ba8d26547bcc2f52d9cb9b1fa2674a9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_8ba8d26547bcc2f52d9cb9b1fa2674a9.jpg not downloaded yet
2026-03-27 10:43:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6f4b72b-c128-5bb6-a710-28f358bb1efa with identifier: CD24001
2026-03-27 10:43:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6f4b72b-c128-5bb6-a710-28f358bb1efa with scrape type 1
2026-03-27 10:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b6f4b72b-c128-5bb6-a710-28f358bb1efa
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75a8c5af560a4fe0ea90ad6322700d%252Fpa%252FCD24001_f5704d11209512ad1cea9e9b1e91e29f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75a8c5af560a4fe0ea90ad6322700d/pa/CD24001_f5704d11209512ad1cea9e9b1e91e29f.jpg not downloaded yet
2026-03-27 10:43:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50165e250>
2026-03-27 10:43:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb5db8d2-4364-5068-ad37-0111f938b3a7/cb5db8d2-4364-5068-ad37-0111f938b3a7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F27%252F4a275ba7d74583925521489e1c1f3ac2%252Fpa%252FFR69790_c74644e9f2b210cca70f50935a9ca397.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_c74644e9f2b210cca70f50935a9ca397.jpg saved to cache
2026-03-27 10:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb5db8d2-4364-5068-ad37-0111f938b3a7
2026-03-27 10:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_803ec06fab54ed8edeafc46858ed33f5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:40 [auto1.de] INFO: Found listing with ID: XV53612
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV53612%27 HTTP/1.1" 200 None
2026-03-27 10:43:40 [auto1.de] INFO: Scrape type for XV53612: 2
2026-03-27 10:43:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d08b116-37b6-5019-9c84-dc6091f31c13 with identifier: XV53612
2026-03-27 10:43:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d08b116-37b6-5019-9c84-dc6091f31c13 with scrape type 2
2026-03-27 10:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d08b116-37b6-5019-9c84-dc6091f31c13 with scrape type 2
2026-03-27 10:43:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d08b116-37b6-5019-9c84-dc6091f31c13, identifier: XV53612
2026-03-27 10:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_40a8c217d194efee5c716ba09e915fe7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d08b116-37b6-5019-9c84-dc6091f31c13 with identifier: XV53612
2026-03-27 10:43:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d08b116-37b6-5019-9c84-dc6091f31c13 with identifier: XV53612
2026-03-27 10:43:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d08b116-37b6-5019-9c84-dc6091f31c13 with identifier: XV53612 to the API
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:21:36Z',
 'fuel_type': 'hybrid',
 'id': '1d08b116-37b6-5019-9c84-dc6091f31c13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV53612',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 59935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-19',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 eHybrid Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2022}
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV53612%27 HTTP/1.1" 200 None
2026-03-27 10:43:40 [auto1.de] INFO: Saving data for XV53612: {'auction_closing_time': 1774714896.0, 'created_time': 1773400172.608221, 'last_price_update_time': 1774608220.809747}
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV53612') HTTP/1.1" 204 0
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F27%252F4a275ba7d74583925521489e1c1f3ac2%252Fpa%252FFR69790_fec865ffec3fcc36096d95383e8fc8ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_fec865ffec3fcc36096d95383e8fc8ac.jpg not downloaded yet
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75a8c5af560a4fe0ea90ad6322700d%252Fpa%252FCD24001_82a5ce3fd631741bc17e9ba9c96e985d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75a8c5af560a4fe0ea90ad6322700d/pa/CD24001_82a5ce3fd631741bc17e9ba9c96e985d.jpg not downloaded yet
2026-03-27 10:43:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 787cea62-ff85-54d8-809c-3b3575feef6e with identifier: ZA85073
2026-03-27 10:43:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 787cea62-ff85-54d8-809c-3b3575feef6e with scrape type 1
2026-03-27 10:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 787cea62-ff85-54d8-809c-3b3575feef6e
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff5%252Ffef56c8790e99a18cf286d21e17a71de%252Fpa%252FZA85073_e117a15a1e7cd0e976b4b0a8ec608583.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_e117a15a1e7cd0e976b4b0a8ec608583.jpg not downloaded yet
2026-03-27 10:43:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500589e90>
2026-03-27 10:43:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef9df5d1-7f25-529c-a24c-f92f72dae2c3/ef9df5d1-7f25-529c-a24c-f92f72dae2c3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff6%252F91f65d5df650f8939b2c3359ff2117e5%252Fpa%252FYP91741_27a1c230381fa680032fe5b0bba31192.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_27a1c230381fa680032fe5b0bba31192.jpg saved to cache
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef9df5d1-7f25-529c-a24c-f92f72dae2c3
2026-03-27 10:43:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_15bfa8915001b4d8d73077d819e0732a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_459d99acc6a54d40d7568bc54024bf80.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:41 [auto1.de] INFO: Found listing with ID: LL09257
2026-03-27 10:43:41 [auto1.de] INFO: Found listing with ID: AR53020
2026-03-27 10:43:41 [auto1.de] INFO: Found listing with ID: VG18386
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG18386%27 HTTP/1.1" 200 None
2026-03-27 10:43:41 [auto1.de] INFO: Scrape type for VG18386: 2
2026-03-27 10:43:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 643bca71-1a1d-51e2-a493-9be2e8e07c32 with identifier: VG18386
2026-03-27 10:43:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 643bca71-1a1d-51e2-a493-9be2e8e07c32 with scrape type 2
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 643bca71-1a1d-51e2-a493-9be2e8e07c32 with scrape type 2
2026-03-27 10:43:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 643bca71-1a1d-51e2-a493-9be2e8e07c32, identifier: VG18386
2026-03-27 10:43:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 643bca71-1a1d-51e2-a493-9be2e8e07c32 with identifier: VG18386
2026-03-27 10:43:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 643bca71-1a1d-51e2-a493-9be2e8e07c32 with identifier: VG18386
2026-03-27 10:43:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 643bca71-1a1d-51e2-a493-9be2e8e07c32 with identifier: VG18386 to the API
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 420,
 'expiration_date': '2026-03-28T16:10:44Z',
 'fuel_type': 'petrol',
 'id': '643bca71-1a1d-51e2-a493-9be2e8e07c32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG18386',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Panamera',
 'odometer': 135646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-19',
 'seller_name': None,
 'title': 'Porsche Panamera 4S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG18386%27 HTTP/1.1" 200 None
2026-03-27 10:43:41 [auto1.de] INFO: Saving data for VG18386: {'auction_closing_time': 1774714244.0, 'created_time': 1773773377.20829, 'last_price_update_time': 1774608221.628853}
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG18386') HTTP/1.1" 204 0
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F27%252F4a275ba7d74583925521489e1c1f3ac2%252Fpa%252FFR69790_2d13fa562d013370966759e3b62c7ce6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_2d13fa562d013370966759e3b62c7ce6.jpg not downloaded yet
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75a8c5af560a4fe0ea90ad6322700d%252Fpa%252FCD24001_3df9c9af0f55d99f2dbf751d31865cb9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75a8c5af560a4fe0ea90ad6322700d/pa/CD24001_3df9c9af0f55d99f2dbf751d31865cb9.jpg not downloaded yet
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff5%252Ffef56c8790e99a18cf286d21e17a71de%252Fpa%252FZA85073_4a192d4b5a543848f35bdde2d90a67ab.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_4a192d4b5a543848f35bdde2d90a67ab.jpg not downloaded yet
2026-03-27 10:43:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003f54d0>
2026-03-27 10:43:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb5db8d2-4364-5068-ad37-0111f938b3a7/cb5db8d2-4364-5068-ad37-0111f938b3a7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F27%252F4a275ba7d74583925521489e1c1f3ac2%252Fpa%252FFR69790_803ec06fab54ed8edeafc46858ed33f5.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_803ec06fab54ed8edeafc46858ed33f5.jpg saved to cache
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb5db8d2-4364-5068-ad37-0111f938b3a7
2026-03-27 10:43:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_936959b6e547f1265718af4bd7020707.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:41 [auto1.de] INFO: Found listing with ID: AE21884
2026-03-27 10:43:41 [auto1.de] INFO: Found listing with ID: VZ83010
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ83010%27 HTTP/1.1" 200 None
2026-03-27 10:43:41 [auto1.de] INFO: Scrape type for VZ83010: 2
2026-03-27 10:43:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bf64692-57e2-53f0-ad58-a325f2b580e1 with identifier: VZ83010
2026-03-27 10:43:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bf64692-57e2-53f0-ad58-a325f2b580e1 with scrape type 2
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bf64692-57e2-53f0-ad58-a325f2b580e1 with scrape type 2
2026-03-27 10:43:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0bf64692-57e2-53f0-ad58-a325f2b580e1, identifier: VZ83010
2026-03-27 10:43:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50ff175d0>
2026-03-27 10:43:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb5db8d2-4364-5068-ad37-0111f938b3a7/cb5db8d2-4364-5068-ad37-0111f938b3a7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F27%252F4a275ba7d74583925521489e1c1f3ac2%252Fpa%252FFR69790_40a8c217d194efee5c716ba09e915fe7.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_40a8c217d194efee5c716ba09e915fe7.jpg saved to cache
2026-03-27 10:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb5db8d2-4364-5068-ad37-0111f938b3a7
2026-03-27 10:43:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0bf64692-57e2-53f0-ad58-a325f2b580e1 with identifier: VZ83010
2026-03-27 10:43:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0bf64692-57e2-53f0-ad58-a325f2b580e1 with identifier: VZ83010
2026-03-27 10:43:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0bf64692-57e2-53f0-ad58-a325f2b580e1 with identifier: VZ83010 to the API
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:33Z',
 'fuel_type': 'petrol',
 'id': '0bf64692-57e2-53f0-ad58-a325f2b580e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ83010',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 38799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-05',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2024}
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ83010%27 HTTP/1.1" 200 None
2026-03-27 10:43:42 [auto1.de] INFO: Saving data for VZ83010: {'auction_closing_time': 1774715733.0, 'created_time': 1773402383.542394, 'last_price_update_time': 1774608222.27344}
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ83010') HTTP/1.1" 204 0
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F27%252F4a275ba7d74583925521489e1c1f3ac2%252Fpa%252FFR69790_b3177d525c0e4a92cc283f9b0f84e2e6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_b3177d525c0e4a92cc283f9b0f84e2e6.jpg not downloaded yet
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75a8c5af560a4fe0ea90ad6322700d%252Fpa%252FCD24001_05364874e82fca644250cdcbe37f068d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75a8c5af560a4fe0ea90ad6322700d/pa/CD24001_05364874e82fca644250cdcbe37f068d.jpg not downloaded yet
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff5%252Ffef56c8790e99a18cf286d21e17a71de%252Fpa%252FZA85073_c32f9b690760725758607686bff62942.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_c32f9b690760725758607686bff62942.jpg not downloaded yet
2026-03-27 10:43:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5025e4ed0>
2026-03-27 10:43:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef9df5d1-7f25-529c-a24c-f92f72dae2c3/ef9df5d1-7f25-529c-a24c-f92f72dae2c3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff6%252F91f65d5df650f8939b2c3359ff2117e5%252Fpa%252FYP91741_15bfa8915001b4d8d73077d819e0732a.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_15bfa8915001b4d8d73077d819e0732a.jpg saved to cache
2026-03-27 10:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef9df5d1-7f25-529c-a24c-f92f72dae2c3
2026-03-27 10:43:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501641090>
2026-03-27 10:43:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb5db8d2-4364-5068-ad37-0111f938b3a7/cb5db8d2-4364-5068-ad37-0111f938b3a7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F27%252F4a275ba7d74583925521489e1c1f3ac2%252Fpa%252FFR69790_459d99acc6a54d40d7568bc54024bf80.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_459d99acc6a54d40d7568bc54024bf80.jpg saved to cache
2026-03-27 10:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb5db8d2-4364-5068-ad37-0111f938b3a7
2026-03-27 10:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/75/bb75a8c5af560a4fe0ea90ad6322700d/pa/CD24001_f5704d11209512ad1cea9e9b1e91e29f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_8ba8d26547bcc2f52d9cb9b1fa2674a9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:42 [auto1.de] INFO: Found listing with ID: YH85992
2026-03-27 10:43:42 [auto1.de] INFO: Found listing with ID: SA06109
2026-03-27 10:43:42 [auto1.de] INFO: Found listing with ID: SZ48596
2026-03-27 10:43:42 [auto1.de] INFO: Found listing with ID: EC33073
2026-03-27 10:43:42 [auto1.de] INFO: Found listing with ID: LR06917
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75a8c5af560a4fe0ea90ad6322700d%252Fpa%252FCD24001_4e6eb676e75ae1a66ad9c6cec11aefa2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75a8c5af560a4fe0ea90ad6322700d/pa/CD24001_4e6eb676e75ae1a66ad9c6cec11aefa2.jpg not downloaded yet
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff5%252Ffef56c8790e99a18cf286d21e17a71de%252Fpa%252FZA85073_aea810c2fa585499aae9c7e79be38474.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_aea810c2fa585499aae9c7e79be38474.jpg not downloaded yet
2026-03-27 10:43:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017ed750>
2026-03-27 10:43:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef9df5d1-7f25-529c-a24c-f92f72dae2c3/ef9df5d1-7f25-529c-a24c-f92f72dae2c3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff6%252F91f65d5df650f8939b2c3359ff2117e5%252Fpa%252FYP91741_936959b6e547f1265718af4bd7020707.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_936959b6e547f1265718af4bd7020707.jpg saved to cache
2026-03-27 10:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef9df5d1-7f25-529c-a24c-f92f72dae2c3
2026-03-27 10:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_84e50a60b0a2d7c51cf7f811bc7991c7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_8e7fb029b0beaf37b9c8314bfae8af09.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:42 [auto1.de] INFO: Channel: 24h | Page: 27 | totalHits: 10535 | hits on page: 40
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff5%252Ffef56c8790e99a18cf286d21e17a71de%252Fpa%252FZA85073_1a006c17f67ad5db905dedf92114ee0c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_1a006c17f67ad5db905dedf92114ee0c.jpg not downloaded yet
2026-03-27 10:43:42 [auto1.de] INFO: Found listing with ID: CR11100
2026-03-27 10:43:42 [auto1.de] INFO: Found listing with ID: NY09817
2026-03-27 10:43:42 [auto1.de] INFO: Found listing with ID: MM42204
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM42204%27 HTTP/1.1" 200 None
2026-03-27 10:43:42 [auto1.de] INFO: Scrape type for MM42204: 2
2026-03-27 10:43:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80ac0a31-65f1-55fc-9702-6098d4b16fee with identifier: MM42204
2026-03-27 10:43:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80ac0a31-65f1-55fc-9702-6098d4b16fee with scrape type 2
2026-03-27 10:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80ac0a31-65f1-55fc-9702-6098d4b16fee with scrape type 2
2026-03-27 10:43:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80ac0a31-65f1-55fc-9702-6098d4b16fee, identifier: MM42204
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff5%252Ffef56c8790e99a18cf286d21e17a71de%252Fpa%252FZA85073_000ca6b01c241860c6b4b3f941d12e4b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_000ca6b01c241860c6b4b3f941d12e4b.jpg not downloaded yet
2026-03-27 10:43:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80ac0a31-65f1-55fc-9702-6098d4b16fee with identifier: MM42204
2026-03-27 10:43:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80ac0a31-65f1-55fc-9702-6098d4b16fee with identifier: MM42204
2026-03-27 10:43:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80ac0a31-65f1-55fc-9702-6098d4b16fee with identifier: MM42204 to the API
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:42:36Z',
 'fuel_type': 'diesel',
 'id': '80ac0a31-65f1-55fc-9702-6098d4b16fee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM42204',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 194390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-10',
 'seller_name': None,
 'title': 'BMW 3er 325d GT M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2016}
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM42204%27 HTTP/1.1" 200 None
2026-03-27 10:43:43 [auto1.de] INFO: Saving data for MM42204: {'auction_closing_time': 1774716156.0, 'created_time': 1773302884.786969, 'last_price_update_time': 1774608223.063519}
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM42204') HTTP/1.1" 204 0
2026-03-27 10:43:43 [auto1.de] INFO: Found listing with ID: EB01944
2026-03-27 10:43:43 [auto1.de] INFO: Found listing with ID: BC20634
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC20634%27 HTTP/1.1" 200 None
2026-03-27 10:43:43 [auto1.de] INFO: Scrape type for BC20634: 2
2026-03-27 10:43:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbf5abc8-4e5a-5d2f-9122-6cf33efca500 with identifier: BC20634
2026-03-27 10:43:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbf5abc8-4e5a-5d2f-9122-6cf33efca500 with scrape type 2
2026-03-27 10:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbf5abc8-4e5a-5d2f-9122-6cf33efca500 with scrape type 2
2026-03-27 10:43:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dbf5abc8-4e5a-5d2f-9122-6cf33efca500, identifier: BC20634
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015cccd0>
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f4b72b-c128-5bb6-a710-28f358bb1efa/b6f4b72b-c128-5bb6-a710-28f358bb1efa_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75a8c5af560a4fe0ea90ad6322700d%252Fpa%252FCD24001_f5704d11209512ad1cea9e9b1e91e29f.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75a8c5af560a4fe0ea90ad6322700d/pa/CD24001_f5704d11209512ad1cea9e9b1e91e29f.jpg saved to cache
2026-03-27 10:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6f4b72b-c128-5bb6-a710-28f358bb1efa
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500232550>
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb5db8d2-4364-5068-ad37-0111f938b3a7/cb5db8d2-4364-5068-ad37-0111f938b3a7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F27%252F4a275ba7d74583925521489e1c1f3ac2%252Fpa%252FFR69790_8ba8d26547bcc2f52d9cb9b1fa2674a9.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_8ba8d26547bcc2f52d9cb9b1fa2674a9.jpg saved to cache
2026-03-27 10:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb5db8d2-4364-5068-ad37-0111f938b3a7
2026-03-27 10:43:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_2d13fa562d013370966759e3b62c7ce6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_4a192d4b5a543848f35bdde2d90a67ab.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/75/bb75a8c5af560a4fe0ea90ad6322700d/pa/CD24001_05364874e82fca644250cdcbe37f068d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/75/bb75a8c5af560a4fe0ea90ad6322700d/pa/CD24001_3df9c9af0f55d99f2dbf751d31865cb9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff5%252Ffef56c8790e99a18cf286d21e17a71de%252Fpa%252FZA85073_7b2d15d9080797c7a8299bec5f68ed7f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_7b2d15d9080797c7a8299bec5f68ed7f.jpg not downloaded yet
2026-03-27 10:43:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dbf5abc8-4e5a-5d2f-9122-6cf33efca500 with identifier: BC20634
2026-03-27 10:43:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dbf5abc8-4e5a-5d2f-9122-6cf33efca500 with identifier: BC20634
2026-03-27 10:43:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dbf5abc8-4e5a-5d2f-9122-6cf33efca500 with identifier: BC20634 to the API
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:09:46Z',
 'fuel_type': 'petrol',
 'id': 'dbf5abc8-4e5a-5d2f-9122-6cf33efca500',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC20634',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 68368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-14',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2020}
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC20634%27 HTTP/1.1" 200 None
2026-03-27 10:43:43 [auto1.de] INFO: Saving data for BC20634: {'auction_closing_time': 1774714186.0, 'created_time': 1773302441.659356, 'last_price_update_time': 1774608223.72917}
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC20634') HTTP/1.1" 204 0
2026-03-27 10:43:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_c32f9b690760725758607686bff62942.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:43 [auto1.de] INFO: Found listing with ID: SL47086
2026-03-27 10:43:43 [auto1.de] INFO: Found listing with ID: HY33546
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY33546%27 HTTP/1.1" 200 None
2026-03-27 10:43:43 [auto1.de] INFO: Scrape type for HY33546: 2
2026-03-27 10:43:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d11637e-f70c-5c62-8b36-ea3a54712054 with identifier: HY33546
2026-03-27 10:43:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d11637e-f70c-5c62-8b36-ea3a54712054 with scrape type 2
2026-03-27 10:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d11637e-f70c-5c62-8b36-ea3a54712054 with scrape type 2
2026-03-27 10:43:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d11637e-f70c-5c62-8b36-ea3a54712054, identifier: HY33546
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500500c50>
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb5db8d2-4364-5068-ad37-0111f938b3a7/cb5db8d2-4364-5068-ad37-0111f938b3a7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F27%252F4a275ba7d74583925521489e1c1f3ac2%252Fpa%252FFR69790_84e50a60b0a2d7c51cf7f811bc7991c7.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_84e50a60b0a2d7c51cf7f811bc7991c7.jpg saved to cache
2026-03-27 10:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb5db8d2-4364-5068-ad37-0111f938b3a7
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001e42d0>
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef9df5d1-7f25-529c-a24c-f92f72dae2c3/ef9df5d1-7f25-529c-a24c-f92f72dae2c3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff6%252F91f65d5df650f8939b2c3359ff2117e5%252Fpa%252FYP91741_8e7fb029b0beaf37b9c8314bfae8af09.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_8e7fb029b0beaf37b9c8314bfae8af09.jpg saved to cache
2026-03-27 10:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ef9df5d1-7f25-529c-a24c-f92f72dae2c3
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff5%252Ffef56c8790e99a18cf286d21e17a71de%252Fpa%252FZA85073_e2e16333dffbcf405daf4ad715b1799c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_e2e16333dffbcf405daf4ad715b1799c.jpg not downloaded yet
2026-03-27 10:43:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d11637e-f70c-5c62-8b36-ea3a54712054 with identifier: HY33546
2026-03-27 10:43:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d11637e-f70c-5c62-8b36-ea3a54712054 with identifier: HY33546
2026-03-27 10:43:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d11637e-f70c-5c62-8b36-ea3a54712054 with identifier: HY33546 to the API
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:55:14Z',
 'fuel_type': 'diesel',
 'id': '1d11637e-f70c-5c62-8b36-ea3a54712054',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY33546',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 308129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-14',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.5 TDI Startline',
 'transmission': 'manual',
 'trim': 'Startline',
 'year': 2010}
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY33546%27 HTTP/1.1" 200 None
2026-03-27 10:43:44 [auto1.de] INFO: Saving data for HY33546: {'auction_closing_time': 1774716914.0, 'created_time': 1773858962.114718, 'last_price_update_time': 1774608224.339415}
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY33546') HTTP/1.1" 204 0
2026-03-27 10:43:44 [auto1.de] INFO: Found listing with ID: VN06043
2026-03-27 10:43:44 [auto1.de] INFO: Found listing with ID: MK56575
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK56575%27 HTTP/1.1" 200 None
2026-03-27 10:43:44 [auto1.de] INFO: Scrape type for MK56575: 2
2026-03-27 10:43:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77c88eb5-6b21-5377-9ddb-6ab76c7b326c with identifier: MK56575
2026-03-27 10:43:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77c88eb5-6b21-5377-9ddb-6ab76c7b326c with scrape type 2
2026-03-27 10:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77c88eb5-6b21-5377-9ddb-6ab76c7b326c with scrape type 2
2026-03-27 10:43:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77c88eb5-6b21-5377-9ddb-6ab76c7b326c, identifier: MK56575
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff5%252Ffef56c8790e99a18cf286d21e17a71de%252Fpa%252FZA85073_813f42a101d7192cd9cbb528fe25877b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_813f42a101d7192cd9cbb528fe25877b.jpg not downloaded yet
2026-03-27 10:43:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77c88eb5-6b21-5377-9ddb-6ab76c7b326c with identifier: MK56575
2026-03-27 10:43:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77c88eb5-6b21-5377-9ddb-6ab76c7b326c with identifier: MK56575
2026-03-27 10:43:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77c88eb5-6b21-5377-9ddb-6ab76c7b326c with identifier: MK56575 to the API
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:22:56Z',
 'fuel_type': 'petrol',
 'id': '77c88eb5-6b21-5377-9ddb-6ab76c7b326c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK56575',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 43203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'manual',
 'trim': '',
 'year': 2021}
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK56575%27 HTTP/1.1" 200 None
2026-03-27 10:43:44 [auto1.de] INFO: Saving data for MK56575: {'auction_closing_time': 1774714976.0, 'created_time': 1774293595.117582, 'last_price_update_time': 1774608224.847128}
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK56575') HTTP/1.1" 204 0
2026-03-27 10:43:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001dcfd0>
2026-03-27 10:43:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb5db8d2-4364-5068-ad37-0111f938b3a7/cb5db8d2-4364-5068-ad37-0111f938b3a7_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F27%252F4a275ba7d74583925521489e1c1f3ac2%252Fpa%252FFR69790_2d13fa562d013370966759e3b62c7ce6.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_2d13fa562d013370966759e3b62c7ce6.jpg saved to cache
2026-03-27 10:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb5db8d2-4364-5068-ad37-0111f938b3a7
2026-03-27 10:43:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501699790>
2026-03-27 10:43:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_787cea62-ff85-54d8-809c-3b3575feef6e/787cea62-ff85-54d8-809c-3b3575feef6e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff5%252Ffef56c8790e99a18cf286d21e17a71de%252Fpa%252FZA85073_4a192d4b5a543848f35bdde2d90a67ab.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_4a192d4b5a543848f35bdde2d90a67ab.jpg saved to cache
2026-03-27 10:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 787cea62-ff85-54d8-809c-3b3575feef6e
2026-03-27 10:43:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500384c90>
2026-03-27 10:43:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f4b72b-c128-5bb6-a710-28f358bb1efa/b6f4b72b-c128-5bb6-a710-28f358bb1efa_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75a8c5af560a4fe0ea90ad6322700d%252Fpa%252FCD24001_05364874e82fca644250cdcbe37f068d.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75a8c5af560a4fe0ea90ad6322700d/pa/CD24001_05364874e82fca644250cdcbe37f068d.jpg saved to cache
2026-03-27 10:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6f4b72b-c128-5bb6-a710-28f358bb1efa
2026-03-27 10:43:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004dddd0>
2026-03-27 10:43:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f4b72b-c128-5bb6-a710-28f358bb1efa/b6f4b72b-c128-5bb6-a710-28f358bb1efa_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75a8c5af560a4fe0ea90ad6322700d%252Fpa%252FCD24001_3df9c9af0f55d99f2dbf751d31865cb9.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75a8c5af560a4fe0ea90ad6322700d/pa/CD24001_3df9c9af0f55d99f2dbf751d31865cb9.jpg saved to cache
2026-03-27 10:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6f4b72b-c128-5bb6-a710-28f358bb1efa
2026-03-27 10:43:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015cf050>
2026-03-27 10:43:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_787cea62-ff85-54d8-809c-3b3575feef6e/787cea62-ff85-54d8-809c-3b3575feef6e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff5%252Ffef56c8790e99a18cf286d21e17a71de%252Fpa%252FZA85073_c32f9b690760725758607686bff62942.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_c32f9b690760725758607686bff62942.jpg saved to cache
2026-03-27 10:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 787cea62-ff85-54d8-809c-3b3575feef6e
2026-03-27 10:43:45 [auto1.de] INFO: Found listing with ID: TF52264
2026-03-27 10:43:45 [auto1.de] INFO: Found listing with ID: MG94250
2026-03-27 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG94250%27 HTTP/1.1" 200 None
2026-03-27 10:43:45 [auto1.de] INFO: Scrape type for MG94250: 2
2026-03-27 10:43:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bc1cd76-52db-5e6c-9536-fd3ed2009216 with identifier: MG94250
2026-03-27 10:43:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bc1cd76-52db-5e6c-9536-fd3ed2009216 with scrape type 2
2026-03-27 10:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bc1cd76-52db-5e6c-9536-fd3ed2009216 with scrape type 2
2026-03-27 10:43:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6bc1cd76-52db-5e6c-9536-fd3ed2009216, identifier: MG94250
2026-03-27 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff5%252Ffef56c8790e99a18cf286d21e17a71de%252Fpa%252FZA85073_3dcd8591534355fcd87fabf56a2687e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_3dcd8591534355fcd87fabf56a2687e3.jpg not downloaded yet
2026-03-27 10:43:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6bc1cd76-52db-5e6c-9536-fd3ed2009216 with identifier: MG94250
2026-03-27 10:43:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6bc1cd76-52db-5e6c-9536-fd3ed2009216 with identifier: MG94250
2026-03-27 10:43:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6bc1cd76-52db-5e6c-9536-fd3ed2009216 with identifier: MG94250 to the API
2026-03-27 10:43:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-28T16:29:38Z',
 'fuel_type': 'petrol',
 'id': '6bc1cd76-52db-5e6c-9536-fd3ed2009216',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG94250',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 183656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-26',
 'seller_name': None,
 'title': 'Citroen C3 1.4 VTR',
 'transmission': 'manual',
 'trim': 'VTR',
 'year': 2007}
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG94250%27 HTTP/1.1" 200 None
2026-03-27 10:43:46 [auto1.de] INFO: Saving data for MG94250: {'auction_closing_time': 1774715378.0, 'created_time': 1773812139.32712, 'last_price_update_time': 1774608226.685976}
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG94250') HTTP/1.1" 204 0
2026-03-27 10:43:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/75/bb75a8c5af560a4fe0ea90ad6322700d/pa/CD24001_4e6eb676e75ae1a66ad9c6cec11aefa2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_1a006c17f67ad5db905dedf92114ee0c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:46 [auto1.de] INFO: Found listing with ID: TY82930
2026-03-27 10:43:46 [auto1.de] INFO: Found listing with ID: XC92552
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC92552%27 HTTP/1.1" 200 None
2026-03-27 10:43:46 [auto1.de] INFO: Scrape type for XC92552: 2
2026-03-27 10:43:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 033e6181-c47b-5fc7-a64e-6e4a05601912 with identifier: XC92552
2026-03-27 10:43:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 033e6181-c47b-5fc7-a64e-6e4a05601912 with scrape type 2
2026-03-27 10:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 033e6181-c47b-5fc7-a64e-6e4a05601912 with scrape type 2
2026-03-27 10:43:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 033e6181-c47b-5fc7-a64e-6e4a05601912, identifier: XC92552
2026-03-27 10:43:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 033e6181-c47b-5fc7-a64e-6e4a05601912 with identifier: XC92552
2026-03-27 10:43:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 033e6181-c47b-5fc7-a64e-6e4a05601912 with identifier: XC92552
2026-03-27 10:43:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 033e6181-c47b-5fc7-a64e-6e4a05601912 with identifier: XC92552 to the API
2026-03-27 10:43:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:24:37Z',
 'fuel_type': 'petrol',
 'id': '033e6181-c47b-5fc7-a64e-6e4a05601912',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC92552',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'XV',
 'odometer': 246270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-02',
 'seller_name': None,
 'title': 'Subaru XV 2.0 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2018}
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC92552%27 HTTP/1.1" 200 None
2026-03-27 10:43:47 [auto1.de] INFO: Saving data for XC92552: {'auction_closing_time': 1774715077.0, 'created_time': 1773383044.674937, 'last_price_update_time': 1774608227.171035}
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC92552') HTTP/1.1" 204 0
2026-03-27 10:43:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_8e6faa83ebdad6edf303e4fb97a32c7c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:47 [auto1.de] INFO: Found listing with ID: BU63404
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU63404%27 HTTP/1.1" 200 None
2026-03-27 10:43:47 [auto1.de] INFO: Scrape type for BU63404: 2
2026-03-27 10:43:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7f9a921-65a4-5460-b3b7-5b841dd57e39 with identifier: BU63404
2026-03-27 10:43:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7f9a921-65a4-5460-b3b7-5b841dd57e39 with scrape type 2
2026-03-27 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7f9a921-65a4-5460-b3b7-5b841dd57e39 with scrape type 2
2026-03-27 10:43:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7f9a921-65a4-5460-b3b7-5b841dd57e39, identifier: BU63404
2026-03-27 10:43:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7f9a921-65a4-5460-b3b7-5b841dd57e39 with identifier: BU63404
2026-03-27 10:43:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7f9a921-65a4-5460-b3b7-5b841dd57e39 with identifier: BU63404
2026-03-27 10:43:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7f9a921-65a4-5460-b3b7-5b841dd57e39 with identifier: BU63404 to the API
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:17:54Z',
 'fuel_type': 'diesel',
 'id': 'c7f9a921-65a4-5460-b3b7-5b841dd57e39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU63404',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 59284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-29',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2023}
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU63404%27 HTTP/1.1" 200 None
2026-03-27 10:43:47 [auto1.de] INFO: Saving data for BU63404: {'auction_closing_time': 1774714674.0, 'created_time': 1773380713.034147, 'last_price_update_time': 1774608227.685924}
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU63404') HTTP/1.1" 204 0
2026-03-27 10:43:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50160d5d0>
2026-03-27 10:43:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f4b72b-c128-5bb6-a710-28f358bb1efa/b6f4b72b-c128-5bb6-a710-28f358bb1efa_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75a8c5af560a4fe0ea90ad6322700d%252Fpa%252FCD24001_4e6eb676e75ae1a66ad9c6cec11aefa2.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75a8c5af560a4fe0ea90ad6322700d/pa/CD24001_4e6eb676e75ae1a66ad9c6cec11aefa2.jpg saved to cache
2026-03-27 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6f4b72b-c128-5bb6-a710-28f358bb1efa
2026-03-27 10:43:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016409d0>
2026-03-27 10:43:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_787cea62-ff85-54d8-809c-3b3575feef6e/787cea62-ff85-54d8-809c-3b3575feef6e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff5%252Ffef56c8790e99a18cf286d21e17a71de%252Fpa%252FZA85073_1a006c17f67ad5db905dedf92114ee0c.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_1a006c17f67ad5db905dedf92114ee0c.jpg saved to cache
2026-03-27 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 787cea62-ff85-54d8-809c-3b3575feef6e
2026-03-27 10:43:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_456e8f69cb25bb6a3b73aa6ca0a4985b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:47 [auto1.de] INFO: Found listing with ID: ND33880
2026-03-27 10:43:47 [auto1.de] INFO: Found listing with ID: WT06361
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06361%27 HTTP/1.1" 200 None
2026-03-27 10:43:47 [auto1.de] INFO: Scrape type for WT06361: 2
2026-03-27 10:43:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edc68f7b-d13b-59da-806a-9ec51780cac0 with identifier: WT06361
2026-03-27 10:43:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edc68f7b-d13b-59da-806a-9ec51780cac0 with scrape type 2
2026-03-27 10:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edc68f7b-d13b-59da-806a-9ec51780cac0 with scrape type 2
2026-03-27 10:43:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edc68f7b-d13b-59da-806a-9ec51780cac0, identifier: WT06361
2026-03-27 10:43:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edc68f7b-d13b-59da-806a-9ec51780cac0 with identifier: WT06361
2026-03-27 10:43:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edc68f7b-d13b-59da-806a-9ec51780cac0 with identifier: WT06361
2026-03-27 10:43:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edc68f7b-d13b-59da-806a-9ec51780cac0 with identifier: WT06361 to the API
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:09:15Z',
 'fuel_type': 'petrol',
 'id': 'edc68f7b-d13b-59da-806a-9ec51780cac0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT06361',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 82581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-25',
 'seller_name': None,
 'title': 'Honda Jazz 1.4 Si',
 'transmission': 'manual',
 'trim': 'Si',
 'year': 2013}
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06361%27 HTTP/1.1" 200 None
2026-03-27 10:43:48 [auto1.de] INFO: Saving data for WT06361: {'auction_closing_time': 1774714155.0, 'created_time': 1774294840.7253, 'last_price_update_time': 1774608228.431112}
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT06361') HTTP/1.1" 204 0
2026-03-27 10:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_e2e16333dffbcf405daf4ad715b1799c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_813f42a101d7192cd9cbb528fe25877b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:48 [auto1.de] INFO: Found listing with ID: GE71981
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE71981%27 HTTP/1.1" 200 None
2026-03-27 10:43:48 [auto1.de] INFO: Scrape type for GE71981: 2
2026-03-27 10:43:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 343a34c2-cb4d-5c02-a9c5-767603466e49 with identifier: GE71981
2026-03-27 10:43:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 343a34c2-cb4d-5c02-a9c5-767603466e49 with scrape type 2
2026-03-27 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 343a34c2-cb4d-5c02-a9c5-767603466e49 with scrape type 2
2026-03-27 10:43:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 343a34c2-cb4d-5c02-a9c5-767603466e49, identifier: GE71981
2026-03-27 10:43:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501697390>
2026-03-27 10:43:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27f0ebb0-c754-579c-811c-465a65648709/27f0ebb0-c754-579c-811c-465a65648709_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff2%252Fdaf2d8649acba8dc395e37f45944cbf4%252Fpa%252FSM20101_8e6faa83ebdad6edf303e4fb97a32c7c.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_8e6faa83ebdad6edf303e4fb97a32c7c.jpg saved to cache
2026-03-27 10:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27f0ebb0-c754-579c-811c-465a65648709
2026-03-27 10:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_3dcd8591534355fcd87fabf56a2687e3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 343a34c2-cb4d-5c02-a9c5-767603466e49 with identifier: GE71981
2026-03-27 10:43:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 343a34c2-cb4d-5c02-a9c5-767603466e49 with identifier: GE71981
2026-03-27 10:43:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 343a34c2-cb4d-5c02-a9c5-767603466e49 with identifier: GE71981 to the API
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:29:32Z',
 'fuel_type': 'petrol',
 'id': '343a34c2-cb4d-5c02-a9c5-767603466e49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE71981',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Aveo',
 'odometer': 110771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-30',
 'seller_name': None,
 'title': 'Chevrolet Aveo 1.6 LTZ',
 'transmission': 'manual',
 'trim': 'LTZ',
 'year': 2012}
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE71981%27 HTTP/1.1" 200 None
2026-03-27 10:43:49 [auto1.de] INFO: Saving data for GE71981: {'auction_closing_time': 1774715372.0, 'created_time': 1773775126.334973, 'last_price_update_time': 1774608229.040116}
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE71981') HTTP/1.1" 204 0
2026-03-27 10:43:49 [auto1.de] INFO: Found listing with ID: TU29288
2026-03-27 10:43:49 [auto1.de] INFO: Found listing with ID: ZH23061
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH23061%27 HTTP/1.1" 200 None
2026-03-27 10:43:49 [auto1.de] INFO: Scrape type for ZH23061: 2
2026-03-27 10:43:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f3806d3-11d9-55f2-a90b-90c31941c829 with identifier: ZH23061
2026-03-27 10:43:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f3806d3-11d9-55f2-a90b-90c31941c829 with scrape type 2
2026-03-27 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f3806d3-11d9-55f2-a90b-90c31941c829 with scrape type 2
2026-03-27 10:43:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f3806d3-11d9-55f2-a90b-90c31941c829, identifier: ZH23061
2026-03-27 10:43:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:43:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003c03d0>
2026-03-27 10:43:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27f0ebb0-c754-579c-811c-465a65648709/27f0ebb0-c754-579c-811c-465a65648709_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff2%252Fdaf2d8649acba8dc395e37f45944cbf4%252Fpa%252FSM20101_456e8f69cb25bb6a3b73aa6ca0a4985b.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_456e8f69cb25bb6a3b73aa6ca0a4985b.jpg saved to cache
2026-03-27 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27f0ebb0-c754-579c-811c-465a65648709
2026-03-27 10:43:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f3806d3-11d9-55f2-a90b-90c31941c829 with identifier: ZH23061
2026-03-27 10:43:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f3806d3-11d9-55f2-a90b-90c31941c829 with identifier: ZH23061
2026-03-27 10:43:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f3806d3-11d9-55f2-a90b-90c31941c829 with identifier: ZH23061 to the API
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:26:22Z',
 'fuel_type': 'petrol',
 'id': '4f3806d3-11d9-55f2-a90b-90c31941c829',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH23061',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 96501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-27',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2018}
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH23061%27 HTTP/1.1" 200 None
2026-03-27 10:43:49 [auto1.de] INFO: Saving data for ZH23061: {'auction_closing_time': 1774715182.0, 'created_time': 1773861498.344512, 'last_price_update_time': 1774608229.633675}
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH23061') HTTP/1.1" 204 0
2026-03-27 10:43:49 [auto1.de] INFO: Found listing with ID: PR96123
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR96123%27 HTTP/1.1" 200 None
2026-03-27 10:43:49 [auto1.de] INFO: Scrape type for PR96123: 2
2026-03-27 10:43:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13a7e94c-3b2b-5aee-9380-d9926191415f with identifier: PR96123
2026-03-27 10:43:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13a7e94c-3b2b-5aee-9380-d9926191415f with scrape type 2
2026-03-27 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13a7e94c-3b2b-5aee-9380-d9926191415f with scrape type 2
2026-03-27 10:43:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13a7e94c-3b2b-5aee-9380-d9926191415f, identifier: PR96123
2026-03-27 10:43:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BZ40542> (referer: https://www.auto1.com/v1/car-details-view/BZ40542/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501871550>
2026-03-27 10:43:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_787cea62-ff85-54d8-809c-3b3575feef6e/787cea62-ff85-54d8-809c-3b3575feef6e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff5%252Ffef56c8790e99a18cf286d21e17a71de%252Fpa%252FZA85073_e2e16333dffbcf405daf4ad715b1799c.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_e2e16333dffbcf405daf4ad715b1799c.jpg saved to cache
2026-03-27 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 787cea62-ff85-54d8-809c-3b3575feef6e
2026-03-27 10:43:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001cd3d0>
2026-03-27 10:43:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_787cea62-ff85-54d8-809c-3b3575feef6e/787cea62-ff85-54d8-809c-3b3575feef6e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff5%252Ffef56c8790e99a18cf286d21e17a71de%252Fpa%252FZA85073_813f42a101d7192cd9cbb528fe25877b.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_813f42a101d7192cd9cbb528fe25877b.jpg saved to cache
2026-03-27 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 787cea62-ff85-54d8-809c-3b3575feef6e
2026-03-27 10:43:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50039bad0>
2026-03-27 10:43:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_787cea62-ff85-54d8-809c-3b3575feef6e/787cea62-ff85-54d8-809c-3b3575feef6e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff5%252Ffef56c8790e99a18cf286d21e17a71de%252Fpa%252FZA85073_3dcd8591534355fcd87fabf56a2687e3.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_3dcd8591534355fcd87fabf56a2687e3.jpg saved to cache
2026-03-27 10:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 787cea62-ff85-54d8-809c-3b3575feef6e
2026-03-27 10:43:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13a7e94c-3b2b-5aee-9380-d9926191415f with identifier: PR96123
2026-03-27 10:43:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13a7e94c-3b2b-5aee-9380-d9926191415f with identifier: PR96123
2026-03-27 10:43:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13a7e94c-3b2b-5aee-9380-d9926191415f with identifier: PR96123 to the API
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:03:15Z',
 'fuel_type': 'diesel',
 'id': '13a7e94c-3b2b-5aee-9380-d9926191415f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR96123',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 158464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-19',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 114 CDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2016}
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR96123%27 HTTP/1.1" 200 None
2026-03-27 10:43:50 [auto1.de] INFO: Saving data for PR96123: {'auction_closing_time': 1774713795.0, 'created_time': 1773305144.233712, 'last_price_update_time': 1774608230.31178}
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR96123') HTTP/1.1" 204 0
2026-03-27 10:43:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:50 [auto1.de] INFO: Found listing with ID: AR51863
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR51863%27 HTTP/1.1" 200 None
2026-03-27 10:43:50 [auto1.de] INFO: Scrape type for AR51863: 2
2026-03-27 10:43:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca696def-5809-59c0-9ae7-b3c41456be99 with identifier: AR51863
2026-03-27 10:43:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca696def-5809-59c0-9ae7-b3c41456be99 with scrape type 2
2026-03-27 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca696def-5809-59c0-9ae7-b3c41456be99 with scrape type 2
2026-03-27 10:43:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca696def-5809-59c0-9ae7-b3c41456be99, identifier: AR51863
2026-03-27 10:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_b3177d525c0e4a92cc283f9b0f84e2e6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca696def-5809-59c0-9ae7-b3c41456be99 with identifier: AR51863
2026-03-27 10:43:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca696def-5809-59c0-9ae7-b3c41456be99 with identifier: AR51863
2026-03-27 10:43:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca696def-5809-59c0-9ae7-b3c41456be99 with identifier: AR51863 to the API
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:14:54Z',
 'fuel_type': 'petrol',
 'id': 'ca696def-5809-59c0-9ae7-b3c41456be99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR51863',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 81673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-26',
 'seller_name': None,
 'title': 'Ford B-Max 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR51863%27 HTTP/1.1" 200 None
2026-03-27 10:43:50 [auto1.de] INFO: Saving data for AR51863: {'auction_closing_time': 1774714494.0, 'created_time': 1773303654.201246, 'last_price_update_time': 1774608230.837749}
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR51863') HTTP/1.1" 204 0
2026-03-27 10:43:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2240abd-8546-503e-92ea-70f826eee45c with identifier: BZ40542
2026-03-27 10:43:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2240abd-8546-503e-92ea-70f826eee45c with scrape type 1
2026-03-27 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b2240abd-8546-503e-92ea-70f826eee45c
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fe3%252F4fe3610bebf1d54f9979905a742119c0%252Fpa%252FBZ40542_a319b493944f5882dcdafd4e357b435a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/e3/4fe3610bebf1d54f9979905a742119c0/pa/BZ40542_a319b493944f5882dcdafd4e357b435a.jpg not downloaded yet
2026-03-27 10:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/75/bb75a8c5af560a4fe0ea90ad6322700d/pa/CD24001_82a5ce3fd631741bc17e9ba9c96e985d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_fec865ffec3fcc36096d95383e8fc8ac.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:50 [auto1.de] INFO: Found listing with ID: CZ89661
2026-03-27 10:43:50 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-27 10:43:50 [auto1.de] INFO: Found listing with ID: YT04304
2026-03-27 10:43:50 [auto1.de] INFO: Found listing with ID: EZ94089
2026-03-27 10:43:50 [auto1.de] INFO: Found listing with ID: TW39351
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW39351%27 HTTP/1.1" 200 None
2026-03-27 10:43:50 [auto1.de] INFO: Scrape type for TW39351: 2
2026-03-27 10:43:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2958a98a-3664-5621-b54a-e8414dc4dbc4 with identifier: TW39351
2026-03-27 10:43:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2958a98a-3664-5621-b54a-e8414dc4dbc4 with scrape type 2
2026-03-27 10:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2958a98a-3664-5621-b54a-e8414dc4dbc4 with scrape type 2
2026-03-27 10:43:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2958a98a-3664-5621-b54a-e8414dc4dbc4, identifier: TW39351
2026-03-27 10:43:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_e2493d8e2cd9c847e9c5799a905f7d43.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2958a98a-3664-5621-b54a-e8414dc4dbc4 with identifier: TW39351
2026-03-27 10:43:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2958a98a-3664-5621-b54a-e8414dc4dbc4 with identifier: TW39351
2026-03-27 10:43:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2958a98a-3664-5621-b54a-e8414dc4dbc4 with identifier: TW39351 to the API
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:38:31Z',
 'fuel_type': 'petrol',
 'id': '2958a98a-3664-5621-b54a-e8414dc4dbc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW39351',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 167602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-07',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2014}
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW39351%27 HTTP/1.1" 200 None
2026-03-27 10:43:51 [auto1.de] INFO: Saving data for TW39351: {'auction_closing_time': 1774715911.0, 'created_time': 1773383295.376422, 'last_price_update_time': 1774608231.351413}
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW39351') HTTP/1.1" 204 0
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fe3%252F4fe3610bebf1d54f9979905a742119c0%252Fpa%252FBZ40542_1daec72abd24284e0d713ed85eebd6a9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/e3/4fe3610bebf1d54f9979905a742119c0/pa/BZ40542_1daec72abd24284e0d713ed85eebd6a9.jpg not downloaded yet
2026-03-27 10:43:51 [auto1.de] INFO: Found listing with ID: ZS84546
2026-03-27 10:43:51 [auto1.de] INFO: Found listing with ID: SH26484
2026-03-27 10:43:51 [auto1.de] INFO: Found listing with ID: HX34455
2026-03-27 10:43:51 [auto1.de] INFO: Found listing with ID: DJ32425
2026-03-27 10:43:51 [auto1.de] INFO: Found listing with ID: VK44645
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK44645%27 HTTP/1.1" 200 None
2026-03-27 10:43:51 [auto1.de] INFO: Scrape type for VK44645: 2
2026-03-27 10:43:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa00de5f-a712-5d33-8d4e-b317246fa97a with identifier: VK44645
2026-03-27 10:43:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa00de5f-a712-5d33-8d4e-b317246fa97a with scrape type 2
2026-03-27 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa00de5f-a712-5d33-8d4e-b317246fa97a with scrape type 2
2026-03-27 10:43:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa00de5f-a712-5d33-8d4e-b317246fa97a, identifier: VK44645
2026-03-27 10:43:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501731250>
2026-03-27 10:43:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb5db8d2-4364-5068-ad37-0111f938b3a7/cb5db8d2-4364-5068-ad37-0111f938b3a7_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F27%252F4a275ba7d74583925521489e1c1f3ac2%252Fpa%252FFR69790_b3177d525c0e4a92cc283f9b0f84e2e6.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_b3177d525c0e4a92cc283f9b0f84e2e6.jpg saved to cache
2026-03-27 10:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb5db8d2-4364-5068-ad37-0111f938b3a7
2026-03-27 10:43:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa00de5f-a712-5d33-8d4e-b317246fa97a with identifier: VK44645
2026-03-27 10:43:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa00de5f-a712-5d33-8d4e-b317246fa97a with identifier: VK44645
2026-03-27 10:43:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa00de5f-a712-5d33-8d4e-b317246fa97a with identifier: VK44645 to the API
2026-03-27 10:43:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-28T16:56:01Z',
 'fuel_type': 'petrol',
 'id': 'fa00de5f-a712-5d33-8d4e-b317246fa97a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK44645',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 199651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-27',
 'seller_name': None,
 'title': 'BMW 4er 440i Gran Coupé xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2017}
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK44645%27 HTTP/1.1" 200 None
2026-03-27 10:43:52 [auto1.de] INFO: Saving data for VK44645: {'auction_closing_time': 1774716961.0, 'created_time': 1773686725.472849, 'last_price_update_time': 1774608232.228175}
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK44645') HTTP/1.1" 204 0
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fe3%252F4fe3610bebf1d54f9979905a742119c0%252Fpa%252FBZ40542_7e7cb80d965c28244a7a16ef09b66a2a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/e3/4fe3610bebf1d54f9979905a742119c0/pa/BZ40542_7e7cb80d965c28244a7a16ef09b66a2a.jpg not downloaded yet
2026-03-27 10:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_5ab1a66157ebe881695c6d0f5d6138d3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: DV91076
2026-03-27 10:43:52 [auto1.de] INFO: Found listing with ID: AE67956
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE67956%27 HTTP/1.1" 200 None
2026-03-27 10:43:52 [auto1.de] INFO: Scrape type for AE67956: 2
2026-03-27 10:43:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73b37455-c58b-5a18-9e16-099c2dd454f2 with identifier: AE67956
2026-03-27 10:43:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73b37455-c58b-5a18-9e16-099c2dd454f2 with scrape type 2
2026-03-27 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73b37455-c58b-5a18-9e16-099c2dd454f2 with scrape type 2
2026-03-27 10:43:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73b37455-c58b-5a18-9e16-099c2dd454f2, identifier: AE67956
2026-03-27 10:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AU97195/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501829310>
2026-03-27 10:43:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f4b72b-c128-5bb6-a710-28f358bb1efa/b6f4b72b-c128-5bb6-a710-28f358bb1efa_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75a8c5af560a4fe0ea90ad6322700d%252Fpa%252FCD24001_82a5ce3fd631741bc17e9ba9c96e985d.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75a8c5af560a4fe0ea90ad6322700d/pa/CD24001_82a5ce3fd631741bc17e9ba9c96e985d.jpg saved to cache
2026-03-27 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6f4b72b-c128-5bb6-a710-28f358bb1efa
2026-03-27 10:43:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6f4b72b-c128-5bb6-a710-28f358bb1efa, skipping ID generation
2026-03-27 10:43:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6f4b72b-c128-5bb6-a710-28f358bb1efa with scrape type 1
2026-03-27 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6f4b72b-c128-5bb6-a710-28f358bb1efa sending to next pipeline
2026-03-27 10:43:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6f4b72b-c128-5bb6-a710-28f358bb1efa, identifier: CD24001
2026-03-27 10:43:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016405d0>
2026-03-27 10:43:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb5db8d2-4364-5068-ad37-0111f938b3a7/cb5db8d2-4364-5068-ad37-0111f938b3a7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F27%252F4a275ba7d74583925521489e1c1f3ac2%252Fpa%252FFR69790_fec865ffec3fcc36096d95383e8fc8ac.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_fec865ffec3fcc36096d95383e8fc8ac.jpg saved to cache
2026-03-27 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb5db8d2-4364-5068-ad37-0111f938b3a7
2026-03-27 10:43:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb5db8d2-4364-5068-ad37-0111f938b3a7, skipping ID generation
2026-03-27 10:43:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb5db8d2-4364-5068-ad37-0111f938b3a7 with scrape type 1
2026-03-27 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb5db8d2-4364-5068-ad37-0111f938b3a7 sending to next pipeline
2026-03-27 10:43:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb5db8d2-4364-5068-ad37-0111f938b3a7, identifier: FR69790
2026-03-27 10:43:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5043f81d0>
2026-03-27 10:43:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef9df5d1-7f25-529c-a24c-f92f72dae2c3/ef9df5d1-7f25-529c-a24c-f92f72dae2c3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff6%252F91f65d5df650f8939b2c3359ff2117e5%252Fpa%252FYP91741_e2493d8e2cd9c847e9c5799a905f7d43.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_e2493d8e2cd9c847e9c5799a905f7d43.jpg saved to cache
2026-03-27 10:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef9df5d1-7f25-529c-a24c-f92f72dae2c3
2026-03-27 10:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/e3/4fe3610bebf1d54f9979905a742119c0/pa/BZ40542_a319b493944f5882dcdafd4e357b435a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73b37455-c58b-5a18-9e16-099c2dd454f2 with identifier: AE67956
2026-03-27 10:43:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73b37455-c58b-5a18-9e16-099c2dd454f2 with identifier: AE67956
2026-03-27 10:43:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73b37455-c58b-5a18-9e16-099c2dd454f2 with identifier: AE67956 to the API
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:04:21Z',
 'fuel_type': 'petrol',
 'id': '73b37455-c58b-5a18-9e16-099c2dd454f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE67956',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 140187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Cup BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion Tech',
 'year': 2014}
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE67956%27 HTTP/1.1" 200 None
2026-03-27 10:43:53 [auto1.de] INFO: Saving data for AE67956: {'auction_closing_time': 1774713861.0, 'created_time': 1774263628.220745, 'last_price_update_time': 1774608233.062427}
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE67956') HTTP/1.1" 204 0
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fe3%252F4fe3610bebf1d54f9979905a742119c0%252Fpa%252FBZ40542_6b4ced141750820a7c034d2fb8a2221e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/e3/4fe3610bebf1d54f9979905a742119c0/pa/BZ40542_6b4ced141750820a7c034d2fb8a2221e.jpg not downloaded yet
2026-03-27 10:43:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6f4b72b-c128-5bb6-a710-28f358bb1efa with identifier: CD24001
2026-03-27 10:43:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6f4b72b-c128-5bb6-a710-28f358bb1efa with identifier: CD24001
2026-03-27 10:43:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6f4b72b-c128-5bb6-a710-28f358bb1efa with identifier: CD24001 to the API
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/75/bb75a8c5af560a4fe0ea90ad6322700d/pa/CD24001_82a5ce3fd631741bc17e9ba9c96e985d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:53:32Z',
 'fuel_type': 'diesel',
 'id': 'b6f4b72b-c128-5bb6-a710-28f358bb1efa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD24001',
 'listing': 'auction',
 'location': 'DE, Deggendorf',
 'make': 'BMW',
 'model': '3er',
 'odometer': 406669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f4b72b-c128-5bb6-a710-28f358bb1efa/b6f4b72b-c128-5bb6-a710-28f358bb1efa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/75/bb75a8c5af560a4fe0ea90ad6322700d/pa/CD24001_f5704d11209512ad1cea9e9b1e91e29f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f4b72b-c128-5bb6-a710-28f358bb1efa/b6f4b72b-c128-5bb6-a710-28f358bb1efa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/75/bb75a8c5af560a4fe0ea90ad6322700d/pa/CD24001_82a5ce3fd631741bc17e9ba9c96e985d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f4b72b-c128-5bb6-a710-28f358bb1efa/b6f4b72b-c128-5bb6-a710-28f358bb1efa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/75/bb75a8c5af560a4fe0ea90ad6322700d/pa/CD24001_3df9c9af0f55d99f2dbf751d31865cb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f4b72b-c128-5bb6-a710-28f358bb1efa/b6f4b72b-c128-5bb6-a710-28f358bb1efa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/75/bb75a8c5af560a4fe0ea90ad6322700d/pa/CD24001_05364874e82fca644250cdcbe37f068d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f4b72b-c128-5bb6-a710-28f358bb1efa/b6f4b72b-c128-5bb6-a710-28f358bb1efa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/75/bb75a8c5af560a4fe0ea90ad6322700d/pa/CD24001_4e6eb676e75ae1a66ad9c6cec11aefa2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD24001%27 HTTP/1.1" 200 None
2026-03-27 10:43:53 [auto1.de] INFO: Saving data for CD24001: {'created_time': 1774608233.482674, 'last_price_update_time': 1774608233.482686, 'auction_closing_time': 1774716812.0}
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD24001') HTTP/1.1" 204 0
2026-03-27 10:43:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb5db8d2-4364-5068-ad37-0111f938b3a7 with identifier: FR69790
2026-03-27 10:43:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb5db8d2-4364-5068-ad37-0111f938b3a7 with identifier: FR69790
2026-03-27 10:43:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb5db8d2-4364-5068-ad37-0111f938b3a7 with identifier: FR69790 to the API
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_fec865ffec3fcc36096d95383e8fc8ac.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 211,
 'expiration_date': '2026-03-28T16:13:47Z',
 'fuel_type': 'petrol',
 'id': 'cb5db8d2-4364-5068-ad37-0111f938b3a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR69790',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 72008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb5db8d2-4364-5068-ad37-0111f938b3a7/cb5db8d2-4364-5068-ad37-0111f938b3a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_bdec3bffc49dc63cc98c509aeb243d92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb5db8d2-4364-5068-ad37-0111f938b3a7/cb5db8d2-4364-5068-ad37-0111f938b3a7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_c74644e9f2b210cca70f50935a9ca397.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb5db8d2-4364-5068-ad37-0111f938b3a7/cb5db8d2-4364-5068-ad37-0111f938b3a7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_40a8c217d194efee5c716ba09e915fe7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb5db8d2-4364-5068-ad37-0111f938b3a7/cb5db8d2-4364-5068-ad37-0111f938b3a7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_803ec06fab54ed8edeafc46858ed33f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb5db8d2-4364-5068-ad37-0111f938b3a7/cb5db8d2-4364-5068-ad37-0111f938b3a7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_459d99acc6a54d40d7568bc54024bf80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb5db8d2-4364-5068-ad37-0111f938b3a7/cb5db8d2-4364-5068-ad37-0111f938b3a7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_84e50a60b0a2d7c51cf7f811bc7991c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb5db8d2-4364-5068-ad37-0111f938b3a7/cb5db8d2-4364-5068-ad37-0111f938b3a7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_8ba8d26547bcc2f52d9cb9b1fa2674a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb5db8d2-4364-5068-ad37-0111f938b3a7/cb5db8d2-4364-5068-ad37-0111f938b3a7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_fec865ffec3fcc36096d95383e8fc8ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb5db8d2-4364-5068-ad37-0111f938b3a7/cb5db8d2-4364-5068-ad37-0111f938b3a7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_2d13fa562d013370966759e3b62c7ce6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb5db8d2-4364-5068-ad37-0111f938b3a7/cb5db8d2-4364-5068-ad37-0111f938b3a7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/27/4a275ba7d74583925521489e1c1f3ac2/pa/FR69790_b3177d525c0e4a92cc283f9b0f84e2e6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-04',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Mild-Hybrid Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2021}
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR69790%27 HTTP/1.1" 200 None
2026-03-27 10:43:53 [auto1.de] INFO: Saving data for FR69790: {'created_time': 1774608233.940728, 'last_price_update_time': 1774608233.940742, 'auction_closing_time': 1774714427.0}
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR69790') HTTP/1.1" 204 0
2026-03-27 10:43:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_072d64ba23251d6a8682d0cdb2e58123.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_eb7b83e7d8e53ec290336ea3418b8d06.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:53 [auto1.de] INFO: Found listing with ID: KD49468
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD49468%27 HTTP/1.1" 200 None
2026-03-27 10:43:53 [auto1.de] INFO: Scrape type for KD49468: 2
2026-03-27 10:43:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 491f0b8c-14be-5293-9969-448106eac0c7 with identifier: KD49468
2026-03-27 10:43:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 491f0b8c-14be-5293-9969-448106eac0c7 with scrape type 2
2026-03-27 10:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 491f0b8c-14be-5293-9969-448106eac0c7 with scrape type 2
2026-03-27 10:43:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 491f0b8c-14be-5293-9969-448106eac0c7, identifier: KD49468
2026-03-27 10:43:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 491f0b8c-14be-5293-9969-448106eac0c7 with identifier: KD49468
2026-03-27 10:43:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 491f0b8c-14be-5293-9969-448106eac0c7 with identifier: KD49468
2026-03-27 10:43:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 491f0b8c-14be-5293-9969-448106eac0c7 with identifier: KD49468 to the API
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:20:39Z',
 'fuel_type': 'petrol',
 'id': '491f0b8c-14be-5293-9969-448106eac0c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD49468',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 98321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-28',
 'seller_name': None,
 'title': 'Renault Espace 1.8 TCe Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2018}
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD49468%27 HTTP/1.1" 200 None
2026-03-27 10:43:54 [auto1.de] INFO: Saving data for KD49468: {'auction_closing_time': 1774714839.0, 'created_time': 1774292315.787011, 'last_price_update_time': 1774608234.456254}
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD49468') HTTP/1.1" 204 0
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fe3%252F4fe3610bebf1d54f9979905a742119c0%252Fpa%252FBZ40542_5f7af78260d3596ecb960f6e2a2b849d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/e3/4fe3610bebf1d54f9979905a742119c0/pa/BZ40542_5f7af78260d3596ecb960f6e2a2b849d.jpg not downloaded yet
2026-03-27 10:43:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BT35414> (referer: https://www.auto1.com/v1/car-details-view/BT35414/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:43:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/e3/4fe3610bebf1d54f9979905a742119c0/pa/BZ40542_1daec72abd24284e0d713ed85eebd6a9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:54 [auto1.de] INFO: Found listing with ID: ZU26768
2026-03-27 10:43:54 [auto1.de] INFO: Found listing with ID: PH00058
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00058%27 HTTP/1.1" 200 None
2026-03-27 10:43:54 [auto1.de] INFO: Scrape type for PH00058: 2
2026-03-27 10:43:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a46500ce-d342-50d1-bab5-1adf103992a9 with identifier: PH00058
2026-03-27 10:43:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a46500ce-d342-50d1-bab5-1adf103992a9 with scrape type 2
2026-03-27 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a46500ce-d342-50d1-bab5-1adf103992a9 with scrape type 2
2026-03-27 10:43:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a46500ce-d342-50d1-bab5-1adf103992a9, identifier: PH00058
2026-03-27 10:43:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:43:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001ca410>
2026-03-27 10:43:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef9df5d1-7f25-529c-a24c-f92f72dae2c3/ef9df5d1-7f25-529c-a24c-f92f72dae2c3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff6%252F91f65d5df650f8939b2c3359ff2117e5%252Fpa%252FYP91741_5ab1a66157ebe881695c6d0f5d6138d3.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_5ab1a66157ebe881695c6d0f5d6138d3.jpg saved to cache
2026-03-27 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef9df5d1-7f25-529c-a24c-f92f72dae2c3
2026-03-27 10:43:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef9df5d1-7f25-529c-a24c-f92f72dae2c3, skipping ID generation
2026-03-27 10:43:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef9df5d1-7f25-529c-a24c-f92f72dae2c3 with scrape type 1
2026-03-27 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef9df5d1-7f25-529c-a24c-f92f72dae2c3 sending to next pipeline
2026-03-27 10:43:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef9df5d1-7f25-529c-a24c-f92f72dae2c3, identifier: YP91741
2026-03-27 10:43:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50020d350>
2026-03-27 10:43:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2240abd-8546-503e-92ea-70f826eee45c/b2240abd-8546-503e-92ea-70f826eee45c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fe3%252F4fe3610bebf1d54f9979905a742119c0%252Fpa%252FBZ40542_a319b493944f5882dcdafd4e357b435a.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/e3/4fe3610bebf1d54f9979905a742119c0/pa/BZ40542_a319b493944f5882dcdafd4e357b435a.jpg saved to cache
2026-03-27 10:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2240abd-8546-503e-92ea-70f826eee45c
2026-03-27 10:43:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/e3/4fe3610bebf1d54f9979905a742119c0/pa/BZ40542_7e7cb80d965c28244a7a16ef09b66a2a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a46500ce-d342-50d1-bab5-1adf103992a9 with identifier: PH00058
2026-03-27 10:43:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a46500ce-d342-50d1-bab5-1adf103992a9 with identifier: PH00058
2026-03-27 10:43:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a46500ce-d342-50d1-bab5-1adf103992a9 with identifier: PH00058 to the API
2026-03-27 10:43:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:02:30Z',
 'fuel_type': 'petrol',
 'id': 'a46500ce-d342-50d1-bab5-1adf103992a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH00058',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 134647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-25',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Turbo Quadrifoglio Verde',
 'transmission': 'manual',
 'trim': 'Quadrifoglio Verde',
 'year': 2015}
2026-03-27 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00058%27 HTTP/1.1" 200 None
2026-03-27 10:43:55 [auto1.de] INFO: Saving data for PH00058: {'auction_closing_time': 1774713750.0, 'created_time': 1773305456.289794, 'last_price_update_time': 1774608235.691743}
2026-03-27 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH00058') HTTP/1.1" 204 0
2026-03-27 10:43:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef9df5d1-7f25-529c-a24c-f92f72dae2c3 with identifier: YP91741
2026-03-27 10:43:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef9df5d1-7f25-529c-a24c-f92f72dae2c3 with identifier: YP91741
2026-03-27 10:43:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef9df5d1-7f25-529c-a24c-f92f72dae2c3 with identifier: YP91741 to the API
2026-03-27 10:43:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_5ab1a66157ebe881695c6d0f5d6138d3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:48:47Z',
 'fuel_type': 'petrol',
 'id': 'ef9df5d1-7f25-529c-a24c-f92f72dae2c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP91741',
 'listing': 'auction',
 'location': 'Tradein',
 'make': 'BMW',
 'model': '3er',
 'odometer': 82020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef9df5d1-7f25-529c-a24c-f92f72dae2c3/ef9df5d1-7f25-529c-a24c-f92f72dae2c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_2e59e3aff6d0a6a05f6aac9e36dd80a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef9df5d1-7f25-529c-a24c-f92f72dae2c3/ef9df5d1-7f25-529c-a24c-f92f72dae2c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_1b2be556cb9b528d2c364eaa81e5c4c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef9df5d1-7f25-529c-a24c-f92f72dae2c3/ef9df5d1-7f25-529c-a24c-f92f72dae2c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_f3e1466020d1441abc093d0cb82d9547.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef9df5d1-7f25-529c-a24c-f92f72dae2c3/ef9df5d1-7f25-529c-a24c-f92f72dae2c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_c849a5cb5301aec353f46aec2e610e12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef9df5d1-7f25-529c-a24c-f92f72dae2c3/ef9df5d1-7f25-529c-a24c-f92f72dae2c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_5ab1a66157ebe881695c6d0f5d6138d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef9df5d1-7f25-529c-a24c-f92f72dae2c3/ef9df5d1-7f25-529c-a24c-f92f72dae2c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_27a1c230381fa680032fe5b0bba31192.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef9df5d1-7f25-529c-a24c-f92f72dae2c3/ef9df5d1-7f25-529c-a24c-f92f72dae2c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_e2493d8e2cd9c847e9c5799a905f7d43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef9df5d1-7f25-529c-a24c-f92f72dae2c3/ef9df5d1-7f25-529c-a24c-f92f72dae2c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_15bfa8915001b4d8d73077d819e0732a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef9df5d1-7f25-529c-a24c-f92f72dae2c3/ef9df5d1-7f25-529c-a24c-f92f72dae2c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_936959b6e547f1265718af4bd7020707.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef9df5d1-7f25-529c-a24c-f92f72dae2c3/ef9df5d1-7f25-529c-a24c-f92f72dae2c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/f6/91f65d5df650f8939b2c3359ff2117e5/pa/YP91741_8e7fb029b0beaf37b9c8314bfae8af09.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP91741%27 HTTP/1.1" 200 None
2026-03-27 10:43:56 [auto1.de] INFO: Saving data for YP91741: {'created_time': 1774608236.491665, 'last_price_update_time': 1774608236.491675, 'auction_closing_time': 1774716527.0}
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP91741') HTTP/1.1" 204 0
2026-03-27 10:43:56 [auto1.de] INFO: Found listing with ID: RX21062
2026-03-27 10:43:56 [auto1.de] INFO: Found listing with ID: GU43225
2026-03-27 10:43:56 [auto1.de] INFO: Found listing with ID: SA11985
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA11985%27 HTTP/1.1" 200 None
2026-03-27 10:43:56 [auto1.de] INFO: Scrape type for SA11985: 2
2026-03-27 10:43:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e5519d6-1eef-5901-b84b-152399c15e72 with identifier: SA11985
2026-03-27 10:43:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e5519d6-1eef-5901-b84b-152399c15e72 with scrape type 2
2026-03-27 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e5519d6-1eef-5901-b84b-152399c15e72 with scrape type 2
2026-03-27 10:43:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e5519d6-1eef-5901-b84b-152399c15e72, identifier: SA11985
2026-03-27 10:43:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a1a10>
2026-03-27 10:43:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27f0ebb0-c754-579c-811c-465a65648709/27f0ebb0-c754-579c-811c-465a65648709_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Ff2%252Fdaf2d8649acba8dc395e37f45944cbf4%252Fpa%252FSM20101_072d64ba23251d6a8682d0cdb2e58123.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_072d64ba23251d6a8682d0cdb2e58123.jpg saved to cache
2026-03-27 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 27f0ebb0-c754-579c-811c-465a65648709
2026-03-27 10:43:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27f0ebb0-c754-579c-811c-465a65648709, skipping ID generation
2026-03-27 10:43:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27f0ebb0-c754-579c-811c-465a65648709 with scrape type 1
2026-03-27 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27f0ebb0-c754-579c-811c-465a65648709 sending to next pipeline
2026-03-27 10:43:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27f0ebb0-c754-579c-811c-465a65648709, identifier: SM20101
2026-03-27 10:43:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50371e050>
2026-03-27 10:43:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3f8f6a2-a744-5295-96bd-003625d9e42d/d3f8f6a2-a744-5295-96bd-003625d9e42d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Ff2%252F05f24be41fcea8f3c63150c2a7318649%252Fpa%252FRV26500_eb7b83e7d8e53ec290336ea3418b8d06.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_eb7b83e7d8e53ec290336ea3418b8d06.jpg saved to cache
2026-03-27 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3f8f6a2-a744-5295-96bd-003625d9e42d
2026-03-27 10:43:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3f8f6a2-a744-5295-96bd-003625d9e42d, skipping ID generation
2026-03-27 10:43:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3f8f6a2-a744-5295-96bd-003625d9e42d with scrape type 1
2026-03-27 10:43:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3f8f6a2-a744-5295-96bd-003625d9e42d sending to next pipeline
2026-03-27 10:43:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3f8f6a2-a744-5295-96bd-003625d9e42d, identifier: RV26500
2026-03-27 10:43:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e5519d6-1eef-5901-b84b-152399c15e72 with identifier: SA11985
2026-03-27 10:43:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e5519d6-1eef-5901-b84b-152399c15e72 with identifier: SA11985
2026-03-27 10:43:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e5519d6-1eef-5901-b84b-152399c15e72 with identifier: SA11985 to the API
2026-03-27 10:43:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:45:55Z',
 'fuel_type': 'petrol',
 'id': '1e5519d6-1eef-5901-b84b-152399c15e72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA11985',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 159416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-14',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.0 TSI Cool Edition',
 'transmission': 'manual',
 'trim': 'Cool Edition',
 'year': 2017}
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA11985%27 HTTP/1.1" 200 None
2026-03-27 10:43:57 [auto1.de] INFO: Saving data for SA11985: {'auction_closing_time': 1774716355.0, 'created_time': 1773306558.875126, 'last_price_update_time': 1774608237.834588}
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA11985') HTTP/1.1" 204 0
2026-03-27 10:43:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27f0ebb0-c754-579c-811c-465a65648709 with identifier: SM20101
2026-03-27 10:43:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27f0ebb0-c754-579c-811c-465a65648709 with identifier: SM20101
2026-03-27 10:43:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27f0ebb0-c754-579c-811c-465a65648709 with identifier: SM20101 to the API
2026-03-27 10:43:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_072d64ba23251d6a8682d0cdb2e58123.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:18:49Z',
 'fuel_type': 'diesel',
 'id': '27f0ebb0-c754-579c-811c-465a65648709',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM20101',
 'listing': 'auction',
 'location': 'DE, Hamburg',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 170810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27f0ebb0-c754-579c-811c-465a65648709/27f0ebb0-c754-579c-811c-465a65648709_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_a08aa01fa562551a934a0a8bb12a569d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27f0ebb0-c754-579c-811c-465a65648709/27f0ebb0-c754-579c-811c-465a65648709_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3049345,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_8e6faa83ebdad6edf303e4fb97a32c7c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27f0ebb0-c754-579c-811c-465a65648709/27f0ebb0-c754-579c-811c-465a65648709_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3184757,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_456e8f69cb25bb6a3b73aa6ca0a4985b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27f0ebb0-c754-579c-811c-465a65648709/27f0ebb0-c754-579c-811c-465a65648709_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_c1565d1199342fe40f5cd62bf00311df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27f0ebb0-c754-579c-811c-465a65648709/27f0ebb0-c754-579c-811c-465a65648709_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_7a877784b0ffd5855af52c1f6344aca8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27f0ebb0-c754-579c-811c-465a65648709/27f0ebb0-c754-579c-811c-465a65648709_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_eb05da50acb274b491da25a8d35f5ab1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27f0ebb0-c754-579c-811c-465a65648709/27f0ebb0-c754-579c-811c-465a65648709_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_23a1d13f581a79d33e259ad7820358d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27f0ebb0-c754-579c-811c-465a65648709/27f0ebb0-c754-579c-811c-465a65648709_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_e9350ade4d2a2a720794f1363dbe1136.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27f0ebb0-c754-579c-811c-465a65648709/27f0ebb0-c754-579c-811c-465a65648709_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_67d18768cf18d9d34d158d48d92dd1b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27f0ebb0-c754-579c-811c-465a65648709/27f0ebb0-c754-579c-811c-465a65648709_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/f2/daf2d8649acba8dc395e37f45944cbf4/pa/SM20101_072d64ba23251d6a8682d0cdb2e58123.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-08-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-27 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM20101%27 HTTP/1.1" 200 None
2026-03-27 10:43:58 [auto1.de] INFO: Saving data for SM20101: {'created_time': 1774608238.367077, 'last_price_update_time': 1774608238.36709, 'auction_closing_time': 1774714729.0}
2026-03-27 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM20101') HTTP/1.1" 204 0
2026-03-27 10:43:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3f8f6a2-a744-5295-96bd-003625d9e42d with identifier: RV26500
2026-03-27 10:43:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3f8f6a2-a744-5295-96bd-003625d9e42d with identifier: RV26500
2026-03-27 10:43:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3f8f6a2-a744-5295-96bd-003625d9e42d with identifier: RV26500 to the API
2026-03-27 10:43:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_eb7b83e7d8e53ec290336ea3418b8d06.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:34:53Z',
 'fuel_type': 'diesel',
 'id': 'd3f8f6a2-a744-5295-96bd-003625d9e42d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV26500',
 'listing': 'auction',
 'location': 'DE, Saarlouis',
 'make': 'BMW',
 'model': '2er',
 'odometer': 66723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3f8f6a2-a744-5295-96bd-003625d9e42d/d3f8f6a2-a744-5295-96bd-003625d9e42d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_3e562740a5c0809ba366bbb45244880e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3f8f6a2-a744-5295-96bd-003625d9e42d/d3f8f6a2-a744-5295-96bd-003625d9e42d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_eb7b83e7d8e53ec290336ea3418b8d06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3f8f6a2-a744-5295-96bd-003625d9e42d/d3f8f6a2-a744-5295-96bd-003625d9e42d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_9d10e07a8e6f5122ef5e1e10c2cec3a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3f8f6a2-a744-5295-96bd-003625d9e42d/d3f8f6a2-a744-5295-96bd-003625d9e42d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_15f47a61748000ebd44f342ec2f6bc79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3f8f6a2-a744-5295-96bd-003625d9e42d/d3f8f6a2-a744-5295-96bd-003625d9e42d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_2681236a6f6a62258067cee47170fe4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3f8f6a2-a744-5295-96bd-003625d9e42d/d3f8f6a2-a744-5295-96bd-003625d9e42d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_9f2ae5930e8e2cb839087a21539770d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3f8f6a2-a744-5295-96bd-003625d9e42d/d3f8f6a2-a744-5295-96bd-003625d9e42d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_fe4d456df60717b0f50e6f2cf5d1cd78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3f8f6a2-a744-5295-96bd-003625d9e42d/d3f8f6a2-a744-5295-96bd-003625d9e42d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_9babface7c4d27f7923a01f2179b05f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3f8f6a2-a744-5295-96bd-003625d9e42d/d3f8f6a2-a744-5295-96bd-003625d9e42d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3139037,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_0bbc92ffeeedede21b42a8967fd52256.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3f8f6a2-a744-5295-96bd-003625d9e42d/d3f8f6a2-a744-5295-96bd-003625d9e42d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/f2/05f24be41fcea8f3c63150c2a7318649/pa/RV26500_d9451871306c935d2d610a66b8aa4087.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 218d Active Tourer Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2023}
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV26500%27 HTTP/1.1" 200 None
2026-03-27 10:43:59 [auto1.de] INFO: Saving data for RV26500: {'created_time': 1774608239.108031, 'last_price_update_time': 1774608239.108045, 'auction_closing_time': 1774715693.0}
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV26500') HTTP/1.1" 204 0
2026-03-27 10:43:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a639d3e-e7c2-5ee6-b485-571945b50668 with identifier: BT35414
2026-03-27 10:43:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a639d3e-e7c2-5ee6-b485-571945b50668 with scrape type 1
2026-03-27 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a639d3e-e7c2-5ee6-b485-571945b50668
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc4%252F2cc4e40675a7213fcec312d8ea13d60a%252Fpa%252FBT35414_7dcda8a82e1f802b26712d4764b29c6e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_7dcda8a82e1f802b26712d4764b29c6e.jpg already downloaded
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc4%252F2cc4e40675a7213fcec312d8ea13d60a%252Fpa%252FBT35414_6127b54cf10343e16c10e40ae980839c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_6127b54cf10343e16c10e40ae980839c.jpg already downloaded
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc4%252F2cc4e40675a7213fcec312d8ea13d60a%252Fpa%252FBT35414_51a9e55bfcde40581e31b6075eebda53.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_51a9e55bfcde40581e31b6075eebda53.jpg already downloaded
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc4%252F2cc4e40675a7213fcec312d8ea13d60a%252Fpa%252FBT35414_037d26a4acf7aaa589ebc8ab943e19ff.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_037d26a4acf7aaa589ebc8ab943e19ff.jpg already downloaded
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc4%252F2cc4e40675a7213fcec312d8ea13d60a%252Fpa%252FBT35414_544f3eb96294d5f7dfcd13576ffc0147.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_544f3eb96294d5f7dfcd13576ffc0147.jpg already downloaded
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc4%252F2cc4e40675a7213fcec312d8ea13d60a%252Fpa%252FBT35414_f67a99e969128f95658e419c197d434b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_f67a99e969128f95658e419c197d434b.jpg already downloaded
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc4%252F2cc4e40675a7213fcec312d8ea13d60a%252Fpa%252FBT35414_34689f146475665f2629235f547b5486.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_34689f146475665f2629235f547b5486.jpg already downloaded
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc4%252F2cc4e40675a7213fcec312d8ea13d60a%252Fpa%252FBT35414_c1c9b6af8a03f75c78548e522d776f3c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_c1c9b6af8a03f75c78548e522d776f3c.jpg already downloaded
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc4%252F2cc4e40675a7213fcec312d8ea13d60a%252Fpa%252FBT35414_8f3bddeb6f5d42087a3cdcfe140d4aa6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_8f3bddeb6f5d42087a3cdcfe140d4aa6.jpg already downloaded
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252Fc4%252F2cc4e40675a7213fcec312d8ea13d60a%252Fpa%252FBT35414_6eeaed758dd8cdacad25b5d456a3ad0c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_6eeaed758dd8cdacad25b5d456a3ad0c.jpg already downloaded
2026-03-27 10:43:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a639d3e-e7c2-5ee6-b485-571945b50668, identifier: BT35414
2026-03-27 10:43:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017d7990>
2026-03-27 10:43:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2240abd-8546-503e-92ea-70f826eee45c/b2240abd-8546-503e-92ea-70f826eee45c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fe3%252F4fe3610bebf1d54f9979905a742119c0%252Fpa%252FBZ40542_1daec72abd24284e0d713ed85eebd6a9.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/e3/4fe3610bebf1d54f9979905a742119c0/pa/BZ40542_1daec72abd24284e0d713ed85eebd6a9.jpg saved to cache
2026-03-27 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2240abd-8546-503e-92ea-70f826eee45c
2026-03-27 10:43:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/e3/4fe3610bebf1d54f9979905a742119c0/pa/BZ40542_6b4ced141750820a7c034d2fb8a2221e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:59 [auto1.de] INFO: Found listing with ID: MJ48017
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ48017%27 HTTP/1.1" 200 None
2026-03-27 10:43:59 [auto1.de] INFO: Scrape type for MJ48017: 2
2026-03-27 10:43:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3 with identifier: MJ48017
2026-03-27 10:43:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3 with scrape type 2
2026-03-27 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3 with scrape type 2
2026-03-27 10:43:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3, identifier: MJ48017
2026-03-27 10:43:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a639d3e-e7c2-5ee6-b485-571945b50668 with identifier: BT35414
2026-03-27 10:43:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a639d3e-e7c2-5ee6-b485-571945b50668 with identifier: BT35414
2026-03-27 10:43:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a639d3e-e7c2-5ee6-b485-571945b50668 with identifier: BT35414 to the API
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:43:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BT35414>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:42:09Z',
 'fuel_type': 'petrol',
 'id': '9a639d3e-e7c2-5ee6-b485-571945b50668',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT35414',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 75308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_7dcda8a82e1f802b26712d4764b29c6e.jpg',
                'https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_6127b54cf10343e16c10e40ae980839c.jpg',
                'https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_51a9e55bfcde40581e31b6075eebda53.jpg',
                'https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_037d26a4acf7aaa589ebc8ab943e19ff.jpg',
                'https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_544f3eb96294d5f7dfcd13576ffc0147.jpg',
                'https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_f67a99e969128f95658e419c197d434b.jpg',
                'https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_34689f146475665f2629235f547b5486.jpg',
                'https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_c1c9b6af8a03f75c78548e522d776f3c.jpg',
                'https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_8f3bddeb6f5d42087a3cdcfe140d4aa6.jpg',
                'https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_6eeaed758dd8cdacad25b5d456a3ad0c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a639d3e-e7c2-5ee6-b485-571945b50668/9a639d3e-e7c2-5ee6-b485-571945b50668_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3176842,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_7dcda8a82e1f802b26712d4764b29c6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a639d3e-e7c2-5ee6-b485-571945b50668/9a639d3e-e7c2-5ee6-b485-571945b50668_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_6127b54cf10343e16c10e40ae980839c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a639d3e-e7c2-5ee6-b485-571945b50668/9a639d3e-e7c2-5ee6-b485-571945b50668_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_51a9e55bfcde40581e31b6075eebda53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a639d3e-e7c2-5ee6-b485-571945b50668/9a639d3e-e7c2-5ee6-b485-571945b50668_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_037d26a4acf7aaa589ebc8ab943e19ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a639d3e-e7c2-5ee6-b485-571945b50668/9a639d3e-e7c2-5ee6-b485-571945b50668_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_544f3eb96294d5f7dfcd13576ffc0147.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a639d3e-e7c2-5ee6-b485-571945b50668/9a639d3e-e7c2-5ee6-b485-571945b50668_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_f67a99e969128f95658e419c197d434b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a639d3e-e7c2-5ee6-b485-571945b50668/9a639d3e-e7c2-5ee6-b485-571945b50668_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_34689f146475665f2629235f547b5486.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a639d3e-e7c2-5ee6-b485-571945b50668/9a639d3e-e7c2-5ee6-b485-571945b50668_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_c1c9b6af8a03f75c78548e522d776f3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a639d3e-e7c2-5ee6-b485-571945b50668/9a639d3e-e7c2-5ee6-b485-571945b50668_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_8f3bddeb6f5d42087a3cdcfe140d4aa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a639d3e-e7c2-5ee6-b485-571945b50668/9a639d3e-e7c2-5ee6-b485-571945b50668_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/c4/2cc4e40675a7213fcec312d8ea13d60a/pa/BT35414_6eeaed758dd8cdacad25b5d456a3ad0c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Porsche Macan 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT35414%27 HTTP/1.1" 200 None
2026-03-27 10:43:59 [auto1.de] INFO: Saving data for BT35414: {'created_time': 1774608239.871469, 'last_price_update_time': 1774608239.871482, 'auction_closing_time': 1774716129.0}
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT35414') HTTP/1.1" 204 0
2026-03-27 10:43:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:43:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001ffcd0>
2026-03-27 10:43:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:43:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2240abd-8546-503e-92ea-70f826eee45c/b2240abd-8546-503e-92ea-70f826eee45c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fe3%252F4fe3610bebf1d54f9979905a742119c0%252Fpa%252FBZ40542_7e7cb80d965c28244a7a16ef09b66a2a.jpg') HTTP/1.1" 204 0
2026-03-27 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/e3/4fe3610bebf1d54f9979905a742119c0/pa/BZ40542_7e7cb80d965c28244a7a16ef09b66a2a.jpg saved to cache
2026-03-27 10:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2240abd-8546-503e-92ea-70f826eee45c
2026-03-27 10:43:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/e3/4fe3610bebf1d54f9979905a742119c0/pa/BZ40542_5f7af78260d3596ecb960f6e2a2b849d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:43:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3 with identifier: MJ48017
2026-03-27 10:43:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3 with identifier: MJ48017
2026-03-27 10:44:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3 with identifier: MJ48017 to the API
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:29:42Z',
 'fuel_type': 'petrol',
 'id': 'c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ48017',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 58100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-07',
 'seller_name': None,
 'title': 'Kia XCeed 1.5 TGDI Xdition',
 'transmission': 'automatic',
 'trim': 'Xdition',
 'year': 2021}
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ48017%27 HTTP/1.1" 200 None
2026-03-27 10:44:00 [auto1.de] INFO: Saving data for MJ48017: {'auction_closing_time': 1774715382.0, 'created_time': 1773304914.987203, 'last_price_update_time': 1774608240.294533}
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ48017') HTTP/1.1" 204 0
2026-03-27 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500471e10>
2026-03-27 10:44:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2240abd-8546-503e-92ea-70f826eee45c/b2240abd-8546-503e-92ea-70f826eee45c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fe3%252F4fe3610bebf1d54f9979905a742119c0%252Fpa%252FBZ40542_6b4ced141750820a7c034d2fb8a2221e.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/e3/4fe3610bebf1d54f9979905a742119c0/pa/BZ40542_6b4ced141750820a7c034d2fb8a2221e.jpg saved to cache
2026-03-27 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2240abd-8546-503e-92ea-70f826eee45c
2026-03-27 10:44:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001e0d90>
2026-03-27 10:44:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2240abd-8546-503e-92ea-70f826eee45c/b2240abd-8546-503e-92ea-70f826eee45c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fe3%252F4fe3610bebf1d54f9979905a742119c0%252Fpa%252FBZ40542_5f7af78260d3596ecb960f6e2a2b849d.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/e3/4fe3610bebf1d54f9979905a742119c0/pa/BZ40542_5f7af78260d3596ecb960f6e2a2b849d.jpg saved to cache
2026-03-27 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2240abd-8546-503e-92ea-70f826eee45c
2026-03-27 10:44:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2240abd-8546-503e-92ea-70f826eee45c, skipping ID generation
2026-03-27 10:44:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2240abd-8546-503e-92ea-70f826eee45c with scrape type 1
2026-03-27 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2240abd-8546-503e-92ea-70f826eee45c sending to next pipeline
2026-03-27 10:44:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2240abd-8546-503e-92ea-70f826eee45c, identifier: BZ40542
2026-03-27 10:44:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2240abd-8546-503e-92ea-70f826eee45c with identifier: BZ40542
2026-03-27 10:44:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2240abd-8546-503e-92ea-70f826eee45c with identifier: BZ40542
2026-03-27 10:44:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2240abd-8546-503e-92ea-70f826eee45c with identifier: BZ40542 to the API
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4f/e3/4fe3610bebf1d54f9979905a742119c0/pa/BZ40542_5f7af78260d3596ecb960f6e2a2b849d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:12:41Z',
 'fuel_type': 'petrol',
 'id': 'b2240abd-8546-503e-92ea-70f826eee45c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ40542',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 43338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2240abd-8546-503e-92ea-70f826eee45c/b2240abd-8546-503e-92ea-70f826eee45c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36227,
             'Height': 351,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/e3/4fe3610bebf1d54f9979905a742119c0/pa/BZ40542_a319b493944f5882dcdafd4e357b435a.jpg',
             'Width': 468},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2240abd-8546-503e-92ea-70f826eee45c/b2240abd-8546-503e-92ea-70f826eee45c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33411,
             'Height': 351,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/e3/4fe3610bebf1d54f9979905a742119c0/pa/BZ40542_1daec72abd24284e0d713ed85eebd6a9.jpg',
             'Width': 468},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2240abd-8546-503e-92ea-70f826eee45c/b2240abd-8546-503e-92ea-70f826eee45c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27323,
             'Height': 351,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/e3/4fe3610bebf1d54f9979905a742119c0/pa/BZ40542_7e7cb80d965c28244a7a16ef09b66a2a.jpg',
             'Width': 468},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2240abd-8546-503e-92ea-70f826eee45c/b2240abd-8546-503e-92ea-70f826eee45c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33325,
             'Height': 351,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/e3/4fe3610bebf1d54f9979905a742119c0/pa/BZ40542_6b4ced141750820a7c034d2fb8a2221e.jpg',
             'Width': 468},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2240abd-8546-503e-92ea-70f826eee45c/b2240abd-8546-503e-92ea-70f826eee45c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 12788,
             'Height': 354,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/e3/4fe3610bebf1d54f9979905a742119c0/pa/BZ40542_5f7af78260d3596ecb960f6e2a2b849d.jpg',
             'Width': 472}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 1.5 GSE T4 e-Hybrid Altitude',
 'transmission': 'automatic',
 'trim': 'Altitude',
 'year': 2024}
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ40542%27 HTTP/1.1" 200 None
2026-03-27 10:44:00 [auto1.de] INFO: Saving data for BZ40542: {'created_time': 1774608240.880389, 'last_price_update_time': 1774608240.880401, 'auction_closing_time': 1774714361.0}
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ40542') HTTP/1.1" 204 0
2026-03-27 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/8e/988e53ac85628113ed3bbf4d01a32efc/pa/BX52233_18b720404f3771bd0e7fd18664abb7f1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:00 [auto1.de] INFO: Channel: 24h | Page: 28 | totalHits: 10536 | hits on page: 40
2026-03-27 10:44:00 [auto1.de] INFO: Found listing with ID: MJ48017
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ48017%27 HTTP/1.1" 200 None
2026-03-27 10:44:00 [auto1.de] INFO: Scrape type for MJ48017: 0
2026-03-27 10:44:00 [auto1.de] INFO: Found listing with ID: VU47138
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU47138%27 HTTP/1.1" 200 None
2026-03-27 10:44:00 [auto1.de] INFO: Scrape type for VU47138: 2
2026-03-27 10:44:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27b95a58-3d44-502c-b3c8-f522845bd629 with identifier: VU47138
2026-03-27 10:44:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27b95a58-3d44-502c-b3c8-f522845bd629 with scrape type 2
2026-03-27 10:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27b95a58-3d44-502c-b3c8-f522845bd629 with scrape type 2
2026-03-27 10:44:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27b95a58-3d44-502c-b3c8-f522845bd629, identifier: VU47138
2026-03-27 10:44:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_e117a15a1e7cd0e976b4b0a8ec608583.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27b95a58-3d44-502c-b3c8-f522845bd629 with identifier: VU47138
2026-03-27 10:44:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27b95a58-3d44-502c-b3c8-f522845bd629 with identifier: VU47138
2026-03-27 10:44:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27b95a58-3d44-502c-b3c8-f522845bd629 with identifier: VU47138 to the API
2026-03-27 10:44:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:53:15Z',
 'fuel_type': 'diesel',
 'id': '27b95a58-3d44-502c-b3c8-f522845bd629',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU47138',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 304026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-05-07',
 'seller_name': None,
 'title': 'BMW X5 3.0d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2003}
2026-03-27 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU47138%27 HTTP/1.1" 200 None
2026-03-27 10:44:01 [auto1.de] INFO: Saving data for VU47138: {'auction_closing_time': 1774716795.0, 'created_time': 1774262994.748112, 'last_price_update_time': 1774608241.414254}
2026-03-27 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU47138') HTTP/1.1" 204 0
2026-03-27 10:44:01 [auto1.de] INFO: Found listing with ID: FD07804
2026-03-27 10:44:01 [auto1.de] INFO: Found listing with ID: LG31115
2026-03-27 10:44:01 [auto1.de] INFO: Found listing with ID: DC16754
2026-03-27 10:44:01 [auto1.de] INFO: Found listing with ID: KZ05104
2026-03-27 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ05104%27 HTTP/1.1" 200 None
2026-03-27 10:44:01 [auto1.de] INFO: Scrape type for KZ05104: 2
2026-03-27 10:44:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 518a77ff-2195-5e0d-9084-09893dfa3bad with identifier: KZ05104
2026-03-27 10:44:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 518a77ff-2195-5e0d-9084-09893dfa3bad with scrape type 2
2026-03-27 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 518a77ff-2195-5e0d-9084-09893dfa3bad with scrape type 2
2026-03-27 10:44:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 518a77ff-2195-5e0d-9084-09893dfa3bad, identifier: KZ05104
2026-03-27 10:44:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/8e/988e53ac85628113ed3bbf4d01a32efc/pa/BX52233_f086d3ba9d13df3ebd18ca7e9b39c7e2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 518a77ff-2195-5e0d-9084-09893dfa3bad with identifier: KZ05104
2026-03-27 10:44:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 518a77ff-2195-5e0d-9084-09893dfa3bad with identifier: KZ05104
2026-03-27 10:44:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 518a77ff-2195-5e0d-9084-09893dfa3bad with identifier: KZ05104 to the API
2026-03-27 10:44:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:16:20Z',
 'fuel_type': 'petrol',
 'id': '518a77ff-2195-5e0d-9084-09893dfa3bad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ05104',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 91783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-29',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2012}
2026-03-27 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ05104%27 HTTP/1.1" 200 None
2026-03-27 10:44:01 [auto1.de] INFO: Saving data for KZ05104: {'auction_closing_time': 1774714580.0, 'created_time': 1773772606.582612, 'last_price_update_time': 1774608241.889734}
2026-03-27 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ05104') HTTP/1.1" 204 0
2026-03-27 10:44:01 [auto1.de] INFO: Found listing with ID: HH04622
2026-03-27 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH04622%27 HTTP/1.1" 200 None
2026-03-27 10:44:01 [auto1.de] INFO: Scrape type for HH04622: 2
2026-03-27 10:44:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1073c23e-5468-5ddc-aeec-3344b9e071b0 with identifier: HH04622
2026-03-27 10:44:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1073c23e-5468-5ddc-aeec-3344b9e071b0 with scrape type 2
2026-03-27 10:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1073c23e-5468-5ddc-aeec-3344b9e071b0 with scrape type 2
2026-03-27 10:44:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1073c23e-5468-5ddc-aeec-3344b9e071b0, identifier: HH04622
2026-03-27 10:44:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500363b50>
2026-03-27 10:44:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63a13579-1684-5820-a755-629853006931/63a13579-1684-5820-a755-629853006931_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F8e%252F988e53ac85628113ed3bbf4d01a32efc%252Fpa%252FBX52233_18b720404f3771bd0e7fd18664abb7f1.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/8e/988e53ac85628113ed3bbf4d01a32efc/pa/BX52233_18b720404f3771bd0e7fd18664abb7f1.jpg saved to cache
2026-03-27 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63a13579-1684-5820-a755-629853006931
2026-03-27 10:44:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001cd850>
2026-03-27 10:44:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_787cea62-ff85-54d8-809c-3b3575feef6e/787cea62-ff85-54d8-809c-3b3575feef6e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff5%252Ffef56c8790e99a18cf286d21e17a71de%252Fpa%252FZA85073_e117a15a1e7cd0e976b4b0a8ec608583.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_e117a15a1e7cd0e976b4b0a8ec608583.jpg saved to cache
2026-03-27 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 787cea62-ff85-54d8-809c-3b3575feef6e
2026-03-27 10:44:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1073c23e-5468-5ddc-aeec-3344b9e071b0 with identifier: HH04622
2026-03-27 10:44:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1073c23e-5468-5ddc-aeec-3344b9e071b0 with identifier: HH04622
2026-03-27 10:44:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1073c23e-5468-5ddc-aeec-3344b9e071b0 with identifier: HH04622 to the API
2026-03-27 10:44:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:42:52Z',
 'fuel_type': 'petrol',
 'id': '1073c23e-5468-5ddc-aeec-3344b9e071b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH04622',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 231255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-28',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2010}
2026-03-27 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH04622%27 HTTP/1.1" 200 None
2026-03-27 10:44:03 [auto1.de] INFO: Saving data for HH04622: {'auction_closing_time': 1774716172.0, 'created_time': 1773302806.650967, 'last_price_update_time': 1774608243.167845}
2026-03-27 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH04622') HTTP/1.1" 204 0
2026-03-27 10:44:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_aea810c2fa585499aae9c7e79be38474.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:03 [auto1.de] INFO: Found listing with ID: NY75190
2026-03-27 10:44:03 [auto1.de] INFO: Found listing with ID: XV26734
2026-03-27 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV26734%27 HTTP/1.1" 200 None
2026-03-27 10:44:03 [auto1.de] INFO: Scrape type for XV26734: 2
2026-03-27 10:44:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26b12246-b8ea-50fa-bd53-3d1639e4893d with identifier: XV26734
2026-03-27 10:44:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26b12246-b8ea-50fa-bd53-3d1639e4893d with scrape type 2
2026-03-27 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26b12246-b8ea-50fa-bd53-3d1639e4893d with scrape type 2
2026-03-27 10:44:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26b12246-b8ea-50fa-bd53-3d1639e4893d, identifier: XV26734
2026-03-27 10:44:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26b12246-b8ea-50fa-bd53-3d1639e4893d with identifier: XV26734
2026-03-27 10:44:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26b12246-b8ea-50fa-bd53-3d1639e4893d with identifier: XV26734
2026-03-27 10:44:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26b12246-b8ea-50fa-bd53-3d1639e4893d with identifier: XV26734 to the API
2026-03-27 10:44:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:22:49Z',
 'fuel_type': 'diesel',
 'id': '26b12246-b8ea-50fa-bd53-3d1639e4893d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV26734',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 167830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-13',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI X-Perience 4Drive',
 'transmission': 'automatic',
 'trim': 'X-Perience 4Drive',
 'year': 2016}
2026-03-27 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV26734%27 HTTP/1.1" 200 None
2026-03-27 10:44:03 [auto1.de] INFO: Saving data for XV26734: {'auction_closing_time': 1774714969.0, 'created_time': 1773304377.066621, 'last_price_update_time': 1774608243.701599}
2026-03-27 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV26734') HTTP/1.1" 204 0
2026-03-27 10:44:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50175c850>
2026-03-27 10:44:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63a13579-1684-5820-a755-629853006931/63a13579-1684-5820-a755-629853006931_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F8e%252F988e53ac85628113ed3bbf4d01a32efc%252Fpa%252FBX52233_f086d3ba9d13df3ebd18ca7e9b39c7e2.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/8e/988e53ac85628113ed3bbf4d01a32efc/pa/BX52233_f086d3ba9d13df3ebd18ca7e9b39c7e2.jpg saved to cache
2026-03-27 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63a13579-1684-5820-a755-629853006931
2026-03-27 10:44:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63a13579-1684-5820-a755-629853006931, skipping ID generation
2026-03-27 10:44:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63a13579-1684-5820-a755-629853006931 with scrape type 1
2026-03-27 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63a13579-1684-5820-a755-629853006931 sending to next pipeline
2026-03-27 10:44:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63a13579-1684-5820-a755-629853006931, identifier: BX52233
2026-03-27 10:44:03 [auto1.de] INFO: Found listing with ID: TB49418
2026-03-27 10:44:03 [auto1.de] INFO: Found listing with ID: FC29722
2026-03-27 10:44:03 [auto1.de] INFO: Found listing with ID: HX44464
2026-03-27 10:44:03 [auto1.de] INFO: Found listing with ID: MJ96775
2026-03-27 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ96775%27 HTTP/1.1" 200 None
2026-03-27 10:44:03 [auto1.de] INFO: Scrape type for MJ96775: 2
2026-03-27 10:44:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d185de4-05a5-57c4-b388-b5a20e358d07 with identifier: MJ96775
2026-03-27 10:44:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d185de4-05a5-57c4-b388-b5a20e358d07 with scrape type 2
2026-03-27 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d185de4-05a5-57c4-b388-b5a20e358d07 with scrape type 2
2026-03-27 10:44:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d185de4-05a5-57c4-b388-b5a20e358d07, identifier: MJ96775
2026-03-27 10:44:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG80154> (referer: https://www.auto1.com/v1/car-details-view/NG80154/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63a13579-1684-5820-a755-629853006931 with identifier: BX52233
2026-03-27 10:44:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63a13579-1684-5820-a755-629853006931 with identifier: BX52233
2026-03-27 10:44:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63a13579-1684-5820-a755-629853006931 with identifier: BX52233 to the API
2026-03-27 10:44:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/8e/988e53ac85628113ed3bbf4d01a32efc/pa/BX52233_f086d3ba9d13df3ebd18ca7e9b39c7e2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:51:56Z',
 'fuel_type': 'diesel',
 'id': '63a13579-1684-5820-a755-629853006931',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX52233',
 'listing': 'auction',
 'location': 'DE, Tradein',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 224634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63a13579-1684-5820-a755-629853006931/63a13579-1684-5820-a755-629853006931_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/8e/988e53ac85628113ed3bbf4d01a32efc/pa/BX52233_1ba1b12cfe3f46f1676e0df154d4cf45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63a13579-1684-5820-a755-629853006931/63a13579-1684-5820-a755-629853006931_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/8e/988e53ac85628113ed3bbf4d01a32efc/pa/BX52233_cc4cda057f327a4946fc14a8786eaedc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63a13579-1684-5820-a755-629853006931/63a13579-1684-5820-a755-629853006931_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/8e/988e53ac85628113ed3bbf4d01a32efc/pa/BX52233_f086d3ba9d13df3ebd18ca7e9b39c7e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63a13579-1684-5820-a755-629853006931/63a13579-1684-5820-a755-629853006931_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/8e/988e53ac85628113ed3bbf4d01a32efc/pa/BX52233_f426a048b6fac3132595b20f39f0d482.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63a13579-1684-5820-a755-629853006931/63a13579-1684-5820-a755-629853006931_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/8e/988e53ac85628113ed3bbf4d01a32efc/pa/BX52233_18b720404f3771bd0e7fd18664abb7f1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2014}
2026-03-27 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX52233%27 HTTP/1.1" 200 None
2026-03-27 10:44:04 [auto1.de] INFO: Saving data for BX52233: {'created_time': 1774608244.713576, 'last_price_update_time': 1774608244.713588, 'auction_closing_time': 1774716716.0}
2026-03-27 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX52233') HTTP/1.1" 204 0
2026-03-27 10:44:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_000ca6b01c241860c6b4b3f941d12e4b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d185de4-05a5-57c4-b388-b5a20e358d07 with identifier: MJ96775
2026-03-27 10:44:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d185de4-05a5-57c4-b388-b5a20e358d07 with identifier: MJ96775
2026-03-27 10:44:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d185de4-05a5-57c4-b388-b5a20e358d07 with identifier: MJ96775 to the API
2026-03-27 10:44:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:00:45Z',
 'fuel_type': 'petrol',
 'id': '0d185de4-05a5-57c4-b388-b5a20e358d07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ96775',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 143345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-17',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-27 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ96775%27 HTTP/1.1" 200 None
2026-03-27 10:44:05 [auto1.de] INFO: Saving data for MJ96775: {'auction_closing_time': 1774713645.0, 'created_time': 1773383441.76919, 'last_price_update_time': 1774608245.378934}
2026-03-27 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ96775') HTTP/1.1" 204 0
2026-03-27 10:44:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_2d9554323ae3156bd9fa5a30864fe8fa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:05 [auto1.de] INFO: Found listing with ID: JN95479
2026-03-27 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN95479%27 HTTP/1.1" 200 None
2026-03-27 10:44:05 [auto1.de] INFO: Scrape type for JN95479: 2
2026-03-27 10:44:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed611637-6328-5e3c-bfde-f589840b163a with identifier: JN95479
2026-03-27 10:44:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed611637-6328-5e3c-bfde-f589840b163a with scrape type 2
2026-03-27 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed611637-6328-5e3c-bfde-f589840b163a with scrape type 2
2026-03-27 10:44:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed611637-6328-5e3c-bfde-f589840b163a, identifier: JN95479
2026-03-27 10:44:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a1cd0>
2026-03-27 10:44:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_787cea62-ff85-54d8-809c-3b3575feef6e/787cea62-ff85-54d8-809c-3b3575feef6e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff5%252Ffef56c8790e99a18cf286d21e17a71de%252Fpa%252FZA85073_aea810c2fa585499aae9c7e79be38474.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_aea810c2fa585499aae9c7e79be38474.jpg saved to cache
2026-03-27 10:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 787cea62-ff85-54d8-809c-3b3575feef6e
2026-03-27 10:44:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_c5f1bbade8b6235e7752fa29dfa7551e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed611637-6328-5e3c-bfde-f589840b163a with identifier: JN95479
2026-03-27 10:44:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed611637-6328-5e3c-bfde-f589840b163a with identifier: JN95479
2026-03-27 10:44:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed611637-6328-5e3c-bfde-f589840b163a with identifier: JN95479 to the API
2026-03-27 10:44:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:50:59Z',
 'fuel_type': 'diesel',
 'id': 'ed611637-6328-5e3c-bfde-f589840b163a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN95479',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 188331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-26',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-27 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN95479%27 HTTP/1.1" 200 None
2026-03-27 10:44:05 [auto1.de] INFO: Saving data for JN95479: {'auction_closing_time': 1774716659.0, 'created_time': 1773136001.187482, 'last_price_update_time': 1774608245.992089}
2026-03-27 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN95479') HTTP/1.1" 204 0
2026-03-27 10:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS36559/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:06 [auto1.de] INFO: Found listing with ID: GR86063
2026-03-27 10:44:06 [auto1.de] INFO: Found listing with ID: FZ44442
2026-03-27 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ44442%27 HTTP/1.1" 200 None
2026-03-27 10:44:06 [auto1.de] INFO: Scrape type for FZ44442: 2
2026-03-27 10:44:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6f94a17-29e2-52f3-b9aa-487f9aeff4a3 with identifier: FZ44442
2026-03-27 10:44:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6f94a17-29e2-52f3-b9aa-487f9aeff4a3 with scrape type 2
2026-03-27 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6f94a17-29e2-52f3-b9aa-487f9aeff4a3 with scrape type 2
2026-03-27 10:44:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6f94a17-29e2-52f3-b9aa-487f9aeff4a3, identifier: FZ44442
2026-03-27 10:44:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1cef325-c250-5e42-b342-b0497a60b29d with identifier: NG80154
2026-03-27 10:44:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1cef325-c250-5e42-b342-b0497a60b29d with scrape type 1
2026-03-27 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1cef325-c250-5e42-b342-b0497a60b29d
2026-03-27 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe1%252F3ae18611c6a0b2ef8f4190f7630b2271%252Fpa%252FNG80154_ef79566f70171648e9e6d22ea97af869.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_ef79566f70171648e9e6d22ea97af869.jpg not downloaded yet
2026-03-27 10:44:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019693d0>
2026-03-27 10:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_787cea62-ff85-54d8-809c-3b3575feef6e/787cea62-ff85-54d8-809c-3b3575feef6e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff5%252Ffef56c8790e99a18cf286d21e17a71de%252Fpa%252FZA85073_000ca6b01c241860c6b4b3f941d12e4b.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_000ca6b01c241860c6b4b3f941d12e4b.jpg saved to cache
2026-03-27 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 787cea62-ff85-54d8-809c-3b3575feef6e
2026-03-27 10:44:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6f94a17-29e2-52f3-b9aa-487f9aeff4a3 with identifier: FZ44442
2026-03-27 10:44:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6f94a17-29e2-52f3-b9aa-487f9aeff4a3 with identifier: FZ44442
2026-03-27 10:44:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6f94a17-29e2-52f3-b9aa-487f9aeff4a3 with identifier: FZ44442 to the API
2026-03-27 10:44:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:28:09Z',
 'fuel_type': 'hybrid',
 'id': 'b6f94a17-29e2-52f3-b9aa-487f9aeff4a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ44442',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 147599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-01',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-27 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ44442%27 HTTP/1.1" 200 None
2026-03-27 10:44:06 [auto1.de] INFO: Saving data for FZ44442: {'auction_closing_time': 1774715289.0, 'created_time': 1773230339.703605, 'last_price_update_time': 1774608246.939728}
2026-03-27 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ44442') HTTP/1.1" 204 0
2026-03-27 10:44:06 [scrapy.extensions.logstats] INFO: Crawled 342 pages (at 23 pages/min), scraped 478 items (at 76 items/min)
2026-03-27 10:44:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 10:44:06 [auto1.de] INFO: Found listing with ID: YM75197
2026-03-27 10:44:06 [auto1.de] INFO: Found listing with ID: PE37736
2026-03-27 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE37736%27 HTTP/1.1" 200 None
2026-03-27 10:44:06 [auto1.de] INFO: Scrape type for PE37736: 1
2026-03-27 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe1%252F3ae18611c6a0b2ef8f4190f7630b2271%252Fpa%252FNG80154_4bec5c93b6e2f5f08773a72a1255d769.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_4bec5c93b6e2f5f08773a72a1255d769.jpg not downloaded yet
2026-03-27 10:44:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5026101d0>
2026-03-27 10:44:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c019b7c-8204-52b8-bc97-8858d94ee509/2c019b7c-8204-52b8-bc97-8858d94ee509_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb4%252F19b40c11ad2459d02f64f9b768dfe164%252Fpa%252FFV94610_2d9554323ae3156bd9fa5a30864fe8fa.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_2d9554323ae3156bd9fa5a30864fe8fa.jpg saved to cache
2026-03-27 10:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c019b7c-8204-52b8-bc97-8858d94ee509
2026-03-27 10:44:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a9e10>
2026-03-27 10:44:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f297e0e-9dbb-5272-a8f5-138589e5994b/2f297e0e-9dbb-5272-a8f5-138589e5994b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3a%252F2e3a289ec2450be73880f54f88868917%252Fpa%252FCK72953_c5f1bbade8b6235e7752fa29dfa7551e.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_c5f1bbade8b6235e7752fa29dfa7551e.jpg saved to cache
2026-03-27 10:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2f297e0e-9dbb-5272-a8f5-138589e5994b
2026-03-27 10:44:07 [auto1.de] INFO: Found listing with ID: YW50252
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW50252%27 HTTP/1.1" 200 None
2026-03-27 10:44:07 [auto1.de] INFO: Scrape type for YW50252: 1
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe1%252F3ae18611c6a0b2ef8f4190f7630b2271%252Fpa%252FNG80154_e2415507176c904c910ce1dc4b310abd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_e2415507176c904c910ce1dc4b310abd.jpg not downloaded yet
2026-03-27 10:44:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RM96597/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:07 [auto1.de] INFO: Found listing with ID: XS50717
2026-03-27 10:44:07 [auto1.de] INFO: Found listing with ID: UL70410
2026-03-27 10:44:07 [auto1.de] INFO: Found listing with ID: SP67485
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP67485%27 HTTP/1.1" 200 None
2026-03-27 10:44:07 [auto1.de] INFO: Scrape type for SP67485: 2
2026-03-27 10:44:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45631848-20ed-5365-8783-d18efe639f58 with identifier: SP67485
2026-03-27 10:44:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45631848-20ed-5365-8783-d18efe639f58 with scrape type 2
2026-03-27 10:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45631848-20ed-5365-8783-d18efe639f58 with scrape type 2
2026-03-27 10:44:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45631848-20ed-5365-8783-d18efe639f58, identifier: SP67485
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe1%252F3ae18611c6a0b2ef8f4190f7630b2271%252Fpa%252FNG80154_b4b82ce1ea2ab611d2259eb78a659a70.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_b4b82ce1ea2ab611d2259eb78a659a70.jpg not downloaded yet
2026-03-27 10:44:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45631848-20ed-5365-8783-d18efe639f58 with identifier: SP67485
2026-03-27 10:44:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45631848-20ed-5365-8783-d18efe639f58 with identifier: SP67485
2026-03-27 10:44:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45631848-20ed-5365-8783-d18efe639f58 with identifier: SP67485 to the API
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:11:42Z',
 'fuel_type': 'diesel',
 'id': '45631848-20ed-5365-8783-d18efe639f58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP67485',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 196606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-28',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2008}
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP67485%27 HTTP/1.1" 200 None
2026-03-27 10:44:07 [auto1.de] INFO: Saving data for SP67485: {'auction_closing_time': 1774714302.0, 'created_time': 1773301971.904257, 'last_price_update_time': 1774608247.647974}
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP67485') HTTP/1.1" 204 0
2026-03-27 10:44:07 [auto1.de] INFO: Found listing with ID: CT00605
2026-03-27 10:44:07 [auto1.de] INFO: Found listing with ID: BA65327
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA65327%27 HTTP/1.1" 200 None
2026-03-27 10:44:07 [auto1.de] INFO: Scrape type for BA65327: 2
2026-03-27 10:44:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08039476-1e58-55bc-a729-5d8e6e59965d with identifier: BA65327
2026-03-27 10:44:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08039476-1e58-55bc-a729-5d8e6e59965d with scrape type 2
2026-03-27 10:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08039476-1e58-55bc-a729-5d8e6e59965d with scrape type 2
2026-03-27 10:44:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08039476-1e58-55bc-a729-5d8e6e59965d, identifier: BA65327
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe1%252F3ae18611c6a0b2ef8f4190f7630b2271%252Fpa%252FNG80154_9491a8af67c1beb375a778645ec10498.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_9491a8af67c1beb375a778645ec10498.jpg not downloaded yet
2026-03-27 10:44:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_5c56ba55901d32d343a4cfd9a1f9afc4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08039476-1e58-55bc-a729-5d8e6e59965d with identifier: BA65327
2026-03-27 10:44:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08039476-1e58-55bc-a729-5d8e6e59965d with identifier: BA65327
2026-03-27 10:44:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08039476-1e58-55bc-a729-5d8e6e59965d with identifier: BA65327 to the API
2026-03-27 10:44:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:54:54Z',
 'fuel_type': 'petrol',
 'id': '08039476-1e58-55bc-a729-5d8e6e59965d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA65327',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 326138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-27 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA65327%27 HTTP/1.1" 200 None
2026-03-27 10:44:08 [auto1.de] INFO: Saving data for BA65327: {'auction_closing_time': 1774716894.0, 'created_time': 1773861427.078271, 'last_price_update_time': 1774608248.130053}
2026-03-27 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA65327') HTTP/1.1" 204 0
2026-03-27 10:44:08 [auto1.de] INFO: Found listing with ID: TK73674
2026-03-27 10:44:08 [auto1.de] INFO: Found listing with ID: GK51404
2026-03-27 10:44:08 [auto1.de] INFO: Found listing with ID: KM66171
2026-03-27 10:44:08 [auto1.de] INFO: Found listing with ID: XF83287
2026-03-27 10:44:08 [auto1.de] INFO: Found listing with ID: LJ65077
2026-03-27 10:44:08 [auto1.de] INFO: Found listing with ID: YL63918
2026-03-27 10:44:08 [auto1.de] INFO: Found listing with ID: XV50981
2026-03-27 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV50981%27 HTTP/1.1" 200 None
2026-03-27 10:44:08 [auto1.de] INFO: Scrape type for XV50981: 2
2026-03-27 10:44:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 875fc7cd-07f1-5628-bb84-dba208d6172d with identifier: XV50981
2026-03-27 10:44:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 875fc7cd-07f1-5628-bb84-dba208d6172d with scrape type 2
2026-03-27 10:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 875fc7cd-07f1-5628-bb84-dba208d6172d with scrape type 2
2026-03-27 10:44:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 875fc7cd-07f1-5628-bb84-dba208d6172d, identifier: XV50981
2026-03-27 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe1%252F3ae18611c6a0b2ef8f4190f7630b2271%252Fpa%252FNG80154_0bb81d94d50fd223dadfc9511da99c58.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_0bb81d94d50fd223dadfc9511da99c58.jpg not downloaded yet
2026-03-27 10:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_7b2d15d9080797c7a8299bec5f68ed7f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 875fc7cd-07f1-5628-bb84-dba208d6172d with identifier: XV50981
2026-03-27 10:44:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 875fc7cd-07f1-5628-bb84-dba208d6172d with identifier: XV50981
2026-03-27 10:44:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 875fc7cd-07f1-5628-bb84-dba208d6172d with identifier: XV50981 to the API
2026-03-27 10:44:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:19:48Z',
 'fuel_type': 'petrol',
 'id': '875fc7cd-07f1-5628-bb84-dba208d6172d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV50981',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 111249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-26',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-27 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV50981%27 HTTP/1.1" 200 None
2026-03-27 10:44:08 [auto1.de] INFO: Saving data for XV50981: {'auction_closing_time': 1774714788.0, 'created_time': 1773688241.402181, 'last_price_update_time': 1774608248.927853}
2026-03-27 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV50981') HTTP/1.1" 204 0
2026-03-27 10:44:08 [auto1.de] INFO: Found listing with ID: TN14580
2026-03-27 10:44:08 [auto1.de] INFO: Found listing with ID: ZL89473
2026-03-27 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89473%27 HTTP/1.1" 200 None
2026-03-27 10:44:08 [auto1.de] INFO: Scrape type for ZL89473: 2
2026-03-27 10:44:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 429368c5-16de-5572-8779-c6f458c850bd with identifier: ZL89473
2026-03-27 10:44:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 429368c5-16de-5572-8779-c6f458c850bd with scrape type 2
2026-03-27 10:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 429368c5-16de-5572-8779-c6f458c850bd with scrape type 2
2026-03-27 10:44:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 429368c5-16de-5572-8779-c6f458c850bd, identifier: ZL89473
2026-03-27 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe1%252F3ae18611c6a0b2ef8f4190f7630b2271%252Fpa%252FNG80154_3d8360c122d5d9fd5f6a0739c67a235f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_3d8360c122d5d9fd5f6a0739c67a235f.jpg not downloaded yet
2026-03-27 10:44:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50170d250>
2026-03-27 10:44:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c019b7c-8204-52b8-bc97-8858d94ee509/2c019b7c-8204-52b8-bc97-8858d94ee509_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb4%252F19b40c11ad2459d02f64f9b768dfe164%252Fpa%252FFV94610_5c56ba55901d32d343a4cfd9a1f9afc4.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_5c56ba55901d32d343a4cfd9a1f9afc4.jpg saved to cache
2026-03-27 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c019b7c-8204-52b8-bc97-8858d94ee509
2026-03-27 10:44:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 429368c5-16de-5572-8779-c6f458c850bd with identifier: ZL89473
2026-03-27 10:44:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 429368c5-16de-5572-8779-c6f458c850bd with identifier: ZL89473
2026-03-27 10:44:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 429368c5-16de-5572-8779-c6f458c850bd with identifier: ZL89473 to the API
2026-03-27 10:44:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:03:25Z',
 'fuel_type': 'petrol',
 'id': '429368c5-16de-5572-8779-c6f458c850bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL89473',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 130768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-03-27 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89473%27 HTTP/1.1" 200 None
2026-03-27 10:44:09 [auto1.de] INFO: Saving data for ZL89473: {'auction_closing_time': 1774713805.0, 'created_time': 1773861339.839585, 'last_price_update_time': 1774608249.433303}
2026-03-27 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL89473') HTTP/1.1" 204 0
2026-03-27 10:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_9491a8af67c1beb375a778645ec10498.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:09 [auto1.de] INFO: Found listing with ID: JK50656
2026-03-27 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK50656%27 HTTP/1.1" 200 None
2026-03-27 10:44:09 [auto1.de] INFO: Scrape type for JK50656: 2
2026-03-27 10:44:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 352a306b-7d24-5f93-8abf-09acf74faf31 with identifier: JK50656
2026-03-27 10:44:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 352a306b-7d24-5f93-8abf-09acf74faf31 with scrape type 2
2026-03-27 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 352a306b-7d24-5f93-8abf-09acf74faf31 with scrape type 2
2026-03-27 10:44:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 352a306b-7d24-5f93-8abf-09acf74faf31, identifier: JK50656
2026-03-27 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe1%252F3ae18611c6a0b2ef8f4190f7630b2271%252Fpa%252FNG80154_7cb6f5bee39b05d84088a1b556219055.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_7cb6f5bee39b05d84088a1b556219055.jpg not downloaded yet
2026-03-27 10:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_b4b82ce1ea2ab611d2259eb78a659a70.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 352a306b-7d24-5f93-8abf-09acf74faf31 with identifier: JK50656
2026-03-27 10:44:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 352a306b-7d24-5f93-8abf-09acf74faf31 with identifier: JK50656
2026-03-27 10:44:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 352a306b-7d24-5f93-8abf-09acf74faf31 with identifier: JK50656 to the API
2026-03-27 10:44:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:06:16Z',
 'fuel_type': 'diesel',
 'id': '352a306b-7d24-5f93-8abf-09acf74faf31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK50656',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 232981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-27',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2011}
2026-03-27 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK50656%27 HTTP/1.1" 200 None
2026-03-27 10:44:09 [auto1.de] INFO: Saving data for JK50656: {'auction_closing_time': 1774713976.0, 'created_time': 1774251382.582754, 'last_price_update_time': 1774608249.981129}
2026-03-27 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK50656') HTTP/1.1" 204 0
2026-03-27 10:44:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50032f490>
2026-03-27 10:44:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_787cea62-ff85-54d8-809c-3b3575feef6e/787cea62-ff85-54d8-809c-3b3575feef6e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Ff5%252Ffef56c8790e99a18cf286d21e17a71de%252Fpa%252FZA85073_7b2d15d9080797c7a8299bec5f68ed7f.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_7b2d15d9080797c7a8299bec5f68ed7f.jpg saved to cache
2026-03-27 10:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 787cea62-ff85-54d8-809c-3b3575feef6e
2026-03-27 10:44:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 787cea62-ff85-54d8-809c-3b3575feef6e, skipping ID generation
2026-03-27 10:44:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 787cea62-ff85-54d8-809c-3b3575feef6e with scrape type 1
2026-03-27 10:44:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 787cea62-ff85-54d8-809c-3b3575feef6e sending to next pipeline
2026-03-27 10:44:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 787cea62-ff85-54d8-809c-3b3575feef6e, identifier: ZA85073
2026-03-27 10:44:10 [auto1.de] INFO: Found listing with ID: AN13363
2026-03-27 10:44:10 [auto1.de] INFO: Found listing with ID: YD09657
2026-03-27 10:44:10 [auto1.de] INFO: Found listing with ID: NW35011
2026-03-27 10:44:10 [auto1.de] INFO: Found listing with ID: MK08111
2026-03-27 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK08111%27 HTTP/1.1" 200 None
2026-03-27 10:44:10 [auto1.de] INFO: Scrape type for MK08111: 2
2026-03-27 10:44:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca2f32e2-e041-5ec7-970a-8bacd89d8bd1 with identifier: MK08111
2026-03-27 10:44:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca2f32e2-e041-5ec7-970a-8bacd89d8bd1 with scrape type 2
2026-03-27 10:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca2f32e2-e041-5ec7-970a-8bacd89d8bd1 with scrape type 2
2026-03-27 10:44:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca2f32e2-e041-5ec7-970a-8bacd89d8bd1, identifier: MK08111
2026-03-27 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe1%252F3ae18611c6a0b2ef8f4190f7630b2271%252Fpa%252FNG80154_4f70dea301bc1dd4d163718d400305a8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_4f70dea301bc1dd4d163718d400305a8.jpg not downloaded yet
2026-03-27 10:44:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 787cea62-ff85-54d8-809c-3b3575feef6e with identifier: ZA85073
2026-03-27 10:44:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 787cea62-ff85-54d8-809c-3b3575feef6e with identifier: ZA85073
2026-03-27 10:44:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 787cea62-ff85-54d8-809c-3b3575feef6e with identifier: ZA85073 to the API
2026-03-27 10:44:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_7b2d15d9080797c7a8299bec5f68ed7f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 235,
 'expiration_date': '2026-03-28T16:06:39Z',
 'fuel_type': 'diesel',
 'id': '787cea62-ff85-54d8-809c-3b3575feef6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA85073',
 'listing': 'auction',
 'location': 'DE, Rosenheim',
 'make': 'Volvo',
 'model': 'S90',
 'odometer': 209586,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_787cea62-ff85-54d8-809c-3b3575feef6e/787cea62-ff85-54d8-809c-3b3575feef6e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3131329,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_e117a15a1e7cd0e976b4b0a8ec608583.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_787cea62-ff85-54d8-809c-3b3575feef6e/787cea62-ff85-54d8-809c-3b3575feef6e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_4a192d4b5a543848f35bdde2d90a67ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_787cea62-ff85-54d8-809c-3b3575feef6e/787cea62-ff85-54d8-809c-3b3575feef6e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_c32f9b690760725758607686bff62942.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_787cea62-ff85-54d8-809c-3b3575feef6e/787cea62-ff85-54d8-809c-3b3575feef6e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2854096,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_aea810c2fa585499aae9c7e79be38474.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_787cea62-ff85-54d8-809c-3b3575feef6e/787cea62-ff85-54d8-809c-3b3575feef6e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_1a006c17f67ad5db905dedf92114ee0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_787cea62-ff85-54d8-809c-3b3575feef6e/787cea62-ff85-54d8-809c-3b3575feef6e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3063340,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_000ca6b01c241860c6b4b3f941d12e4b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_787cea62-ff85-54d8-809c-3b3575feef6e/787cea62-ff85-54d8-809c-3b3575feef6e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2985732,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_7b2d15d9080797c7a8299bec5f68ed7f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_787cea62-ff85-54d8-809c-3b3575feef6e/787cea62-ff85-54d8-809c-3b3575feef6e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_e2e16333dffbcf405daf4ad715b1799c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_787cea62-ff85-54d8-809c-3b3575feef6e/787cea62-ff85-54d8-809c-3b3575feef6e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_813f42a101d7192cd9cbb528fe25877b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_787cea62-ff85-54d8-809c-3b3575feef6e/787cea62-ff85-54d8-809c-3b3575feef6e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/f5/fef56c8790e99a18cf286d21e17a71de/pa/ZA85073_3dcd8591534355fcd87fabf56a2687e3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo S90 2.0 D5 Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2016}
2026-03-27 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA85073%27 HTTP/1.1" 200 None
2026-03-27 10:44:11 [auto1.de] INFO: Saving data for ZA85073: {'created_time': 1774608251.192483, 'last_price_update_time': 1774608251.192496, 'auction_closing_time': 1774713999.0}
2026-03-27 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA85073') HTTP/1.1" 204 0
2026-03-27 10:44:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca2f32e2-e041-5ec7-970a-8bacd89d8bd1 with identifier: MK08111
2026-03-27 10:44:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca2f32e2-e041-5ec7-970a-8bacd89d8bd1 with identifier: MK08111
2026-03-27 10:44:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca2f32e2-e041-5ec7-970a-8bacd89d8bd1 with identifier: MK08111 to the API
2026-03-27 10:44:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:24:49Z',
 'fuel_type': 'petrol',
 'id': 'ca2f32e2-e041-5ec7-970a-8bacd89d8bd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK08111',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 108171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-22',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-27 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK08111%27 HTTP/1.1" 200 None
2026-03-27 10:44:11 [auto1.de] INFO: Saving data for MK08111: {'auction_closing_time': 1774715089.0, 'created_time': 1773831554.586064, 'last_price_update_time': 1774608251.884694}
2026-03-27 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK08111') HTTP/1.1" 204 0
2026-03-27 10:44:11 [auto1.de] INFO: Found listing with ID: ZU42459
2026-03-27 10:44:11 [auto1.de] INFO: Found listing with ID: CT18435
2026-03-27 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT18435%27 HTTP/1.1" 200 None
2026-03-27 10:44:11 [auto1.de] INFO: Scrape type for CT18435: 2
2026-03-27 10:44:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e23ef057-5cd6-5e2b-a70d-a3542464994f with identifier: CT18435
2026-03-27 10:44:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e23ef057-5cd6-5e2b-a70d-a3542464994f with scrape type 2
2026-03-27 10:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e23ef057-5cd6-5e2b-a70d-a3542464994f with scrape type 2
2026-03-27 10:44:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e23ef057-5cd6-5e2b-a70d-a3542464994f, identifier: CT18435
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe1%252F3ae18611c6a0b2ef8f4190f7630b2271%252Fpa%252FNG80154_077d2588e92ec4d40ed2d9d20b4061ff.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_077d2588e92ec4d40ed2d9d20b4061ff.jpg not downloaded yet
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50165dc90>
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1cef325-c250-5e42-b342-b0497a60b29d/a1cef325-c250-5e42-b342-b0497a60b29d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe1%252F3ae18611c6a0b2ef8f4190f7630b2271%252Fpa%252FNG80154_9491a8af67c1beb375a778645ec10498.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_9491a8af67c1beb375a778645ec10498.jpg saved to cache
2026-03-27 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1cef325-c250-5e42-b342-b0497a60b29d
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb502610550>
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1cef325-c250-5e42-b342-b0497a60b29d/a1cef325-c250-5e42-b342-b0497a60b29d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe1%252F3ae18611c6a0b2ef8f4190f7630b2271%252Fpa%252FNG80154_b4b82ce1ea2ab611d2259eb78a659a70.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_b4b82ce1ea2ab611d2259eb78a659a70.jpg saved to cache
2026-03-27 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1cef325-c250-5e42-b342-b0497a60b29d
2026-03-27 10:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_3d8360c122d5d9fd5f6a0739c67a235f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e23ef057-5cd6-5e2b-a70d-a3542464994f with identifier: CT18435
2026-03-27 10:44:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e23ef057-5cd6-5e2b-a70d-a3542464994f with identifier: CT18435
2026-03-27 10:44:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e23ef057-5cd6-5e2b-a70d-a3542464994f with identifier: CT18435 to the API
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:02:47Z',
 'fuel_type': 'diesel',
 'id': 'e23ef057-5cd6-5e2b-a70d-a3542464994f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT18435',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 200838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-27',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT18435%27 HTTP/1.1" 200 None
2026-03-27 10:44:12 [auto1.de] INFO: Saving data for CT18435: {'auction_closing_time': 1774713767.0, 'created_time': 1773387332.721525, 'last_price_update_time': 1774608252.434919}
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT18435') HTTP/1.1" 204 0
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb502612450>
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1cef325-c250-5e42-b342-b0497a60b29d/a1cef325-c250-5e42-b342-b0497a60b29d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe1%252F3ae18611c6a0b2ef8f4190f7630b2271%252Fpa%252FNG80154_3d8360c122d5d9fd5f6a0739c67a235f.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_3d8360c122d5d9fd5f6a0739c67a235f.jpg saved to cache
2026-03-27 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1cef325-c250-5e42-b342-b0497a60b29d
2026-03-27 10:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_b5acd947dcb2d860c09209a971fddf5b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_2e9d83bfcf5dfc76862f993898d9db07.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_2234f9c857376ddaa1191d2b9c632407.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_65619fbd325bd330821d3d09d532acfd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d6a50>
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f297e0e-9dbb-5272-a8f5-138589e5994b/2f297e0e-9dbb-5272-a8f5-138589e5994b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3a%252F2e3a289ec2450be73880f54f88868917%252Fpa%252FCK72953_b5acd947dcb2d860c09209a971fddf5b.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_b5acd947dcb2d860c09209a971fddf5b.jpg saved to cache
2026-03-27 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2f297e0e-9dbb-5272-a8f5-138589e5994b
2026-03-27 10:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_077d2588e92ec4d40ed2d9d20b4061ff.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_4f70dea301bc1dd4d163718d400305a8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_7cb6f5bee39b05d84088a1b556219055.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500362550>
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f297e0e-9dbb-5272-a8f5-138589e5994b/2f297e0e-9dbb-5272-a8f5-138589e5994b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3a%252F2e3a289ec2450be73880f54f88868917%252Fpa%252FCK72953_2e9d83bfcf5dfc76862f993898d9db07.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_2e9d83bfcf5dfc76862f993898d9db07.jpg saved to cache
2026-03-27 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2f297e0e-9dbb-5272-a8f5-138589e5994b
2026-03-27 10:44:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001ddb50>
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c019b7c-8204-52b8-bc97-8858d94ee509/2c019b7c-8204-52b8-bc97-8858d94ee509_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb4%252F19b40c11ad2459d02f64f9b768dfe164%252Fpa%252FFV94610_2234f9c857376ddaa1191d2b9c632407.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_2234f9c857376ddaa1191d2b9c632407.jpg saved to cache
2026-03-27 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c019b7c-8204-52b8-bc97-8858d94ee509
2026-03-27 10:44:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001e53d0>
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c019b7c-8204-52b8-bc97-8858d94ee509/2c019b7c-8204-52b8-bc97-8858d94ee509_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb4%252F19b40c11ad2459d02f64f9b768dfe164%252Fpa%252FFV94610_65619fbd325bd330821d3d09d532acfd.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_65619fbd325bd330821d3d09d532acfd.jpg saved to cache
2026-03-27 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c019b7c-8204-52b8-bc97-8858d94ee509
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a2050>
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1cef325-c250-5e42-b342-b0497a60b29d/a1cef325-c250-5e42-b342-b0497a60b29d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe1%252F3ae18611c6a0b2ef8f4190f7630b2271%252Fpa%252FNG80154_077d2588e92ec4d40ed2d9d20b4061ff.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_077d2588e92ec4d40ed2d9d20b4061ff.jpg saved to cache
2026-03-27 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1cef325-c250-5e42-b342-b0497a60b29d
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501948410>
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1cef325-c250-5e42-b342-b0497a60b29d/a1cef325-c250-5e42-b342-b0497a60b29d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe1%252F3ae18611c6a0b2ef8f4190f7630b2271%252Fpa%252FNG80154_4f70dea301bc1dd4d163718d400305a8.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_4f70dea301bc1dd4d163718d400305a8.jpg saved to cache
2026-03-27 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1cef325-c250-5e42-b342-b0497a60b29d
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001cfa90>
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1cef325-c250-5e42-b342-b0497a60b29d/a1cef325-c250-5e42-b342-b0497a60b29d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe1%252F3ae18611c6a0b2ef8f4190f7630b2271%252Fpa%252FNG80154_7cb6f5bee39b05d84088a1b556219055.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_7cb6f5bee39b05d84088a1b556219055.jpg saved to cache
2026-03-27 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1cef325-c250-5e42-b342-b0497a60b29d
2026-03-27 10:44:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_0bb81d94d50fd223dadfc9511da99c58.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004df4d0>
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1cef325-c250-5e42-b342-b0497a60b29d/a1cef325-c250-5e42-b342-b0497a60b29d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe1%252F3ae18611c6a0b2ef8f4190f7630b2271%252Fpa%252FNG80154_0bb81d94d50fd223dadfc9511da99c58.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_0bb81d94d50fd223dadfc9511da99c58.jpg saved to cache
2026-03-27 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1cef325-c250-5e42-b342-b0497a60b29d
2026-03-27 10:44:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_e2415507176c904c910ce1dc4b310abd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_4bec5c93b6e2f5f08773a72a1255d769.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001cd6d0>
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1cef325-c250-5e42-b342-b0497a60b29d/a1cef325-c250-5e42-b342-b0497a60b29d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe1%252F3ae18611c6a0b2ef8f4190f7630b2271%252Fpa%252FNG80154_e2415507176c904c910ce1dc4b310abd.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_e2415507176c904c910ce1dc4b310abd.jpg saved to cache
2026-03-27 10:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1cef325-c250-5e42-b342-b0497a60b29d
2026-03-27 10:44:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016e4110>
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1cef325-c250-5e42-b342-b0497a60b29d/a1cef325-c250-5e42-b342-b0497a60b29d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe1%252F3ae18611c6a0b2ef8f4190f7630b2271%252Fpa%252FNG80154_4bec5c93b6e2f5f08773a72a1255d769.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_4bec5c93b6e2f5f08773a72a1255d769.jpg saved to cache
2026-03-27 10:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1cef325-c250-5e42-b342-b0497a60b29d
2026-03-27 10:44:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_ef79566f70171648e9e6d22ea97af869.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_b4992e6248db243a60cd028ae9fe5c7a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_1849962cee8a435ec4c630aea28e4ed6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018ad390>
2026-03-27 10:44:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1cef325-c250-5e42-b342-b0497a60b29d/a1cef325-c250-5e42-b342-b0497a60b29d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe1%252F3ae18611c6a0b2ef8f4190f7630b2271%252Fpa%252FNG80154_ef79566f70171648e9e6d22ea97af869.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_ef79566f70171648e9e6d22ea97af869.jpg saved to cache
2026-03-27 10:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1cef325-c250-5e42-b342-b0497a60b29d
2026-03-27 10:44:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1cef325-c250-5e42-b342-b0497a60b29d, skipping ID generation
2026-03-27 10:44:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1cef325-c250-5e42-b342-b0497a60b29d with scrape type 1
2026-03-27 10:44:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1cef325-c250-5e42-b342-b0497a60b29d sending to next pipeline
2026-03-27 10:44:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1cef325-c250-5e42-b342-b0497a60b29d, identifier: NG80154
2026-03-27 10:44:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1cef325-c250-5e42-b342-b0497a60b29d with identifier: NG80154
2026-03-27 10:44:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1cef325-c250-5e42-b342-b0497a60b29d with identifier: NG80154
2026-03-27 10:44:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1cef325-c250-5e42-b342-b0497a60b29d with identifier: NG80154 to the API
2026-03-27 10:44:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_ef79566f70171648e9e6d22ea97af869.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:50:05Z',
 'fuel_type': 'diesel',
 'id': 'a1cef325-c250-5e42-b342-b0497a60b29d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG80154',
 'listing': 'auction',
 'location': 'DE, Braunschweig',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 104165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cef325-c250-5e42-b342-b0497a60b29d/a1cef325-c250-5e42-b342-b0497a60b29d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2524269,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_ef79566f70171648e9e6d22ea97af869.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cef325-c250-5e42-b342-b0497a60b29d/a1cef325-c250-5e42-b342-b0497a60b29d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2521047,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_4bec5c93b6e2f5f08773a72a1255d769.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cef325-c250-5e42-b342-b0497a60b29d/a1cef325-c250-5e42-b342-b0497a60b29d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2385469,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_e2415507176c904c910ce1dc4b310abd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cef325-c250-5e42-b342-b0497a60b29d/a1cef325-c250-5e42-b342-b0497a60b29d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_b4b82ce1ea2ab611d2259eb78a659a70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cef325-c250-5e42-b342-b0497a60b29d/a1cef325-c250-5e42-b342-b0497a60b29d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_9491a8af67c1beb375a778645ec10498.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cef325-c250-5e42-b342-b0497a60b29d/a1cef325-c250-5e42-b342-b0497a60b29d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_0bb81d94d50fd223dadfc9511da99c58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cef325-c250-5e42-b342-b0497a60b29d/a1cef325-c250-5e42-b342-b0497a60b29d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_3d8360c122d5d9fd5f6a0739c67a235f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cef325-c250-5e42-b342-b0497a60b29d/a1cef325-c250-5e42-b342-b0497a60b29d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_7cb6f5bee39b05d84088a1b556219055.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cef325-c250-5e42-b342-b0497a60b29d/a1cef325-c250-5e42-b342-b0497a60b29d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_4f70dea301bc1dd4d163718d400305a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cef325-c250-5e42-b342-b0497a60b29d/a1cef325-c250-5e42-b342-b0497a60b29d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e1/3ae18611c6a0b2ef8f4190f7630b2271/pa/NG80154_077d2588e92ec4d40ed2d9d20b4061ff.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline Blue',
 'transmission': 'manual',
 'trim': 'Comfortline Blue',
 'year': 2014}
2026-03-27 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG80154%27 HTTP/1.1" 200 None
2026-03-27 10:44:14 [auto1.de] INFO: Saving data for NG80154: {'created_time': 1774608254.86509, 'last_price_update_time': 1774608254.865105, 'auction_closing_time': 1774716605.0}
2026-03-27 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG80154') HTTP/1.1" 204 0
2026-03-27 10:44:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_ceac36d427c4cb339f1ab46185b71376.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/79/bf7975b6dfae6143b4d567e572327806/pa/SM54936_9b999e9635df65d41ad5a3028f6077cc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EU51889/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500363f50>
2026-03-27 10:44:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c019b7c-8204-52b8-bc97-8858d94ee509/2c019b7c-8204-52b8-bc97-8858d94ee509_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb4%252F19b40c11ad2459d02f64f9b768dfe164%252Fpa%252FFV94610_b4992e6248db243a60cd028ae9fe5c7a.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_b4992e6248db243a60cd028ae9fe5c7a.jpg saved to cache
2026-03-27 10:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c019b7c-8204-52b8-bc97-8858d94ee509
2026-03-27 10:44:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500205310>
2026-03-27 10:44:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4fb6605-c81f-5419-ba64-705d43223fb1/e4fb6605-c81f-5419-ba64-705d43223fb1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fec%252Ffbec04a34a856b304dfe666028957ed8%252Fpa%252FEA80690_1849962cee8a435ec4c630aea28e4ed6.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_1849962cee8a435ec4c630aea28e4ed6.jpg saved to cache
2026-03-27 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4fb6605-c81f-5419-ba64-705d43223fb1
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001becd0>
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f297e0e-9dbb-5272-a8f5-138589e5994b/2f297e0e-9dbb-5272-a8f5-138589e5994b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3a%252F2e3a289ec2450be73880f54f88868917%252Fpa%252FCK72953_ceac36d427c4cb339f1ab46185b71376.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_ceac36d427c4cb339f1ab46185b71376.jpg saved to cache
2026-03-27 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2f297e0e-9dbb-5272-a8f5-138589e5994b
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500397e90>
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_659f7e39-f36d-592e-8b4e-18ed268e3373/659f7e39-f36d-592e-8b4e-18ed268e3373_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F79%252Fbf7975b6dfae6143b4d567e572327806%252Fpa%252FSM54936_9b999e9635df65d41ad5a3028f6077cc.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/79/bf7975b6dfae6143b4d567e572327806/pa/SM54936_9b999e9635df65d41ad5a3028f6077cc.jpg saved to cache
2026-03-27 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 659f7e39-f36d-592e-8b4e-18ed268e3373
2026-03-27 10:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/01/1c0150e2a1951cd922cee15e1922baba/pa/TR81409_5641266397bf3d61fe8fbf0b81b80ea9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015e3d10>
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e57cc188-5e66-5ad7-b6ab-22277c30e36f/e57cc188-5e66-5ad7-b6ab-22277c30e36f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F01%252F1c0150e2a1951cd922cee15e1922baba%252Fpa%252FTR81409_5641266397bf3d61fe8fbf0b81b80ea9.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/01/1c0150e2a1951cd922cee15e1922baba/pa/TR81409_5641266397bf3d61fe8fbf0b81b80ea9.jpg saved to cache
2026-03-27 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e57cc188-5e66-5ad7-b6ab-22277c30e36f
2026-03-27 10:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/f2/80f29e4761941991526616a566c4efe0/pa/KL79607_e782abba63f8b113c67eadd3ebbd641a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001ff7d0>
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4cc6305-3dc3-5963-9880-cd5df1c48e9b/c4cc6305-3dc3-5963-9880-cd5df1c48e9b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Ff2%252F80f29e4761941991526616a566c4efe0%252Fpa%252FKL79607_e782abba63f8b113c67eadd3ebbd641a.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f2/80f29e4761941991526616a566c4efe0/pa/KL79607_e782abba63f8b113c67eadd3ebbd641a.jpg saved to cache
2026-03-27 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c4cc6305-3dc3-5963-9880-cd5df1c48e9b
2026-03-27 10:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/79/bf7975b6dfae6143b4d567e572327806/pa/SM54936_8680f85e904fe21978586965e1574225.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_9874580cace6170ecaaf4612af1abcc5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500571310>
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_659f7e39-f36d-592e-8b4e-18ed268e3373/659f7e39-f36d-592e-8b4e-18ed268e3373_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F79%252Fbf7975b6dfae6143b4d567e572327806%252Fpa%252FSM54936_8680f85e904fe21978586965e1574225.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/79/bf7975b6dfae6143b4d567e572327806/pa/SM54936_8680f85e904fe21978586965e1574225.jpg saved to cache
2026-03-27 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 659f7e39-f36d-592e-8b4e-18ed268e3373
2026-03-27 10:44:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb502639c50>
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c019b7c-8204-52b8-bc97-8858d94ee509/2c019b7c-8204-52b8-bc97-8858d94ee509_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb4%252F19b40c11ad2459d02f64f9b768dfe164%252Fpa%252FFV94610_9874580cace6170ecaaf4612af1abcc5.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_9874580cace6170ecaaf4612af1abcc5.jpg saved to cache
2026-03-27 10:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c019b7c-8204-52b8-bc97-8858d94ee509
2026-03-27 10:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/f2/80f29e4761941991526616a566c4efe0/pa/KL79607_74040746e8c86b17568e4b6acfe2ae98.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_4430a97ff2da6479b0feb6a2385668f8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_0018c5975011af585804446d20386352.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/01/1c0150e2a1951cd922cee15e1922baba/pa/TR81409_769aa99b02ff17a61e9215fc01f71ff4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500571650>
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4cc6305-3dc3-5963-9880-cd5df1c48e9b/c4cc6305-3dc3-5963-9880-cd5df1c48e9b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Ff2%252F80f29e4761941991526616a566c4efe0%252Fpa%252FKL79607_74040746e8c86b17568e4b6acfe2ae98.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f2/80f29e4761941991526616a566c4efe0/pa/KL79607_74040746e8c86b17568e4b6acfe2ae98.jpg saved to cache
2026-03-27 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c4cc6305-3dc3-5963-9880-cd5df1c48e9b
2026-03-27 10:44:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a11d0>
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f297e0e-9dbb-5272-a8f5-138589e5994b/2f297e0e-9dbb-5272-a8f5-138589e5994b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3a%252F2e3a289ec2450be73880f54f88868917%252Fpa%252FCK72953_4430a97ff2da6479b0feb6a2385668f8.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_4430a97ff2da6479b0feb6a2385668f8.jpg saved to cache
2026-03-27 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2f297e0e-9dbb-5272-a8f5-138589e5994b
2026-03-27 10:44:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501988d10>
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4fb6605-c81f-5419-ba64-705d43223fb1/e4fb6605-c81f-5419-ba64-705d43223fb1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fec%252Ffbec04a34a856b304dfe666028957ed8%252Fpa%252FEA80690_0018c5975011af585804446d20386352.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_0018c5975011af585804446d20386352.jpg saved to cache
2026-03-27 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4fb6605-c81f-5419-ba64-705d43223fb1
2026-03-27 10:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_5ffcc93086260dcf36eb2fc38386baf6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_5cb160a51ea272a26d57d86ddb9bd163.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/79/bf7975b6dfae6143b4d567e572327806/pa/SM54936_09b81ba6c7e5b707dbd19f56b96af6af.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c3950>
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e57cc188-5e66-5ad7-b6ab-22277c30e36f/e57cc188-5e66-5ad7-b6ab-22277c30e36f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F01%252F1c0150e2a1951cd922cee15e1922baba%252Fpa%252FTR81409_769aa99b02ff17a61e9215fc01f71ff4.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/01/1c0150e2a1951cd922cee15e1922baba/pa/TR81409_769aa99b02ff17a61e9215fc01f71ff4.jpg saved to cache
2026-03-27 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e57cc188-5e66-5ad7-b6ab-22277c30e36f
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500207010>
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4fb6605-c81f-5419-ba64-705d43223fb1/e4fb6605-c81f-5419-ba64-705d43223fb1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fec%252Ffbec04a34a856b304dfe666028957ed8%252Fpa%252FEA80690_5ffcc93086260dcf36eb2fc38386baf6.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_5ffcc93086260dcf36eb2fc38386baf6.jpg saved to cache
2026-03-27 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4fb6605-c81f-5419-ba64-705d43223fb1
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017c4890>
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c019b7c-8204-52b8-bc97-8858d94ee509/2c019b7c-8204-52b8-bc97-8858d94ee509_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb4%252F19b40c11ad2459d02f64f9b768dfe164%252Fpa%252FFV94610_5cb160a51ea272a26d57d86ddb9bd163.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_5cb160a51ea272a26d57d86ddb9bd163.jpg saved to cache
2026-03-27 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c019b7c-8204-52b8-bc97-8858d94ee509
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d5c50>
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_659f7e39-f36d-592e-8b4e-18ed268e3373/659f7e39-f36d-592e-8b4e-18ed268e3373_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F79%252Fbf7975b6dfae6143b4d567e572327806%252Fpa%252FSM54936_09b81ba6c7e5b707dbd19f56b96af6af.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/79/bf7975b6dfae6143b4d567e572327806/pa/SM54936_09b81ba6c7e5b707dbd19f56b96af6af.jpg saved to cache
2026-03-27 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 659f7e39-f36d-592e-8b4e-18ed268e3373
2026-03-27 10:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/f2/80f29e4761941991526616a566c4efe0/pa/KL79607_c743bdff9d0d2956ec8e6fae8375506e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_0039ac29e1430091dccc37572fda6924.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/01/1c0150e2a1951cd922cee15e1922baba/pa/TR81409_bb827fe9d9682067bfaeeb06a9c375dd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500396d10>
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4cc6305-3dc3-5963-9880-cd5df1c48e9b/c4cc6305-3dc3-5963-9880-cd5df1c48e9b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Ff2%252F80f29e4761941991526616a566c4efe0%252Fpa%252FKL79607_c743bdff9d0d2956ec8e6fae8375506e.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f2/80f29e4761941991526616a566c4efe0/pa/KL79607_c743bdff9d0d2956ec8e6fae8375506e.jpg saved to cache
2026-03-27 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c4cc6305-3dc3-5963-9880-cd5df1c48e9b
2026-03-27 10:44:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_109624e5fec41726f40380a72724bc98.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501750d90>
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c019b7c-8204-52b8-bc97-8858d94ee509/2c019b7c-8204-52b8-bc97-8858d94ee509_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb4%252F19b40c11ad2459d02f64f9b768dfe164%252Fpa%252FFV94610_0039ac29e1430091dccc37572fda6924.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_0039ac29e1430091dccc37572fda6924.jpg saved to cache
2026-03-27 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c019b7c-8204-52b8-bc97-8858d94ee509
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500573810>
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e57cc188-5e66-5ad7-b6ab-22277c30e36f/e57cc188-5e66-5ad7-b6ab-22277c30e36f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F01%252F1c0150e2a1951cd922cee15e1922baba%252Fpa%252FTR81409_bb827fe9d9682067bfaeeb06a9c375dd.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/01/1c0150e2a1951cd922cee15e1922baba/pa/TR81409_bb827fe9d9682067bfaeeb06a9c375dd.jpg saved to cache
2026-03-27 10:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e57cc188-5e66-5ad7-b6ab-22277c30e36f
2026-03-27 10:44:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001bda10>
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f297e0e-9dbb-5272-a8f5-138589e5994b/2f297e0e-9dbb-5272-a8f5-138589e5994b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3a%252F2e3a289ec2450be73880f54f88868917%252Fpa%252FCK72953_109624e5fec41726f40380a72724bc98.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_109624e5fec41726f40380a72724bc98.jpg saved to cache
2026-03-27 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2f297e0e-9dbb-5272-a8f5-138589e5994b
2026-03-27 10:44:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_4acf2ffa020cb77a4bed8d40501c448e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/79/bf7975b6dfae6143b4d567e572327806/pa/SM54936_fa56782ec1aab55faa4b261885ce062c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500351990>
2026-03-27 10:44:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f297e0e-9dbb-5272-a8f5-138589e5994b/2f297e0e-9dbb-5272-a8f5-138589e5994b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3a%252F2e3a289ec2450be73880f54f88868917%252Fpa%252FCK72953_4acf2ffa020cb77a4bed8d40501c448e.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_4acf2ffa020cb77a4bed8d40501c448e.jpg saved to cache
2026-03-27 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2f297e0e-9dbb-5272-a8f5-138589e5994b
2026-03-27 10:44:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018449d0>
2026-03-27 10:44:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_659f7e39-f36d-592e-8b4e-18ed268e3373/659f7e39-f36d-592e-8b4e-18ed268e3373_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F79%252Fbf7975b6dfae6143b4d567e572327806%252Fpa%252FSM54936_fa56782ec1aab55faa4b261885ce062c.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/79/bf7975b6dfae6143b4d567e572327806/pa/SM54936_fa56782ec1aab55faa4b261885ce062c.jpg saved to cache
2026-03-27 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 659f7e39-f36d-592e-8b4e-18ed268e3373
2026-03-27 10:44:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_f7bcd9961800aa527543398eeacf439f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/f2/80f29e4761941991526616a566c4efe0/pa/KL79607_3c20511a19b8a27271685adcf7e1396f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/01/1c0150e2a1951cd922cee15e1922baba/pa/TR81409_0e30f62bc4b4c02c06bbf1f41b4dae8b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50165d490>
2026-03-27 10:44:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c019b7c-8204-52b8-bc97-8858d94ee509/2c019b7c-8204-52b8-bc97-8858d94ee509_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb4%252F19b40c11ad2459d02f64f9b768dfe164%252Fpa%252FFV94610_f7bcd9961800aa527543398eeacf439f.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_f7bcd9961800aa527543398eeacf439f.jpg saved to cache
2026-03-27 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c019b7c-8204-52b8-bc97-8858d94ee509
2026-03-27 10:44:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_b02b6052b0f958729cd528077d20c8c5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/79/bf7975b6dfae6143b4d567e572327806/pa/SM54936_0977c16f9083cea91bf4facfc64d1a84.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001cf8d0>
2026-03-27 10:44:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4cc6305-3dc3-5963-9880-cd5df1c48e9b/c4cc6305-3dc3-5963-9880-cd5df1c48e9b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Ff2%252F80f29e4761941991526616a566c4efe0%252Fpa%252FKL79607_3c20511a19b8a27271685adcf7e1396f.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f2/80f29e4761941991526616a566c4efe0/pa/KL79607_3c20511a19b8a27271685adcf7e1396f.jpg saved to cache
2026-03-27 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c4cc6305-3dc3-5963-9880-cd5df1c48e9b
2026-03-27 10:44:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c14d0>
2026-03-27 10:44:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e57cc188-5e66-5ad7-b6ab-22277c30e36f/e57cc188-5e66-5ad7-b6ab-22277c30e36f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F01%252F1c0150e2a1951cd922cee15e1922baba%252Fpa%252FTR81409_0e30f62bc4b4c02c06bbf1f41b4dae8b.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/01/1c0150e2a1951cd922cee15e1922baba/pa/TR81409_0e30f62bc4b4c02c06bbf1f41b4dae8b.jpg saved to cache
2026-03-27 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e57cc188-5e66-5ad7-b6ab-22277c30e36f
2026-03-27 10:44:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e57cc188-5e66-5ad7-b6ab-22277c30e36f, skipping ID generation
2026-03-27 10:44:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e57cc188-5e66-5ad7-b6ab-22277c30e36f with scrape type 1
2026-03-27 10:44:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e57cc188-5e66-5ad7-b6ab-22277c30e36f sending to next pipeline
2026-03-27 10:44:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e57cc188-5e66-5ad7-b6ab-22277c30e36f, identifier: TR81409
2026-03-27 10:44:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e57cc188-5e66-5ad7-b6ab-22277c30e36f with identifier: TR81409
2026-03-27 10:44:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e57cc188-5e66-5ad7-b6ab-22277c30e36f with identifier: TR81409
2026-03-27 10:44:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e57cc188-5e66-5ad7-b6ab-22277c30e36f with identifier: TR81409 to the API
2026-03-27 10:44:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1c/01/1c0150e2a1951cd922cee15e1922baba/pa/TR81409_0e30f62bc4b4c02c06bbf1f41b4dae8b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:18:46Z',
 'fuel_type': 'petrol',
 'id': 'e57cc188-5e66-5ad7-b6ab-22277c30e36f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR81409',
 'listing': 'auction',
 'location': 'DE, Leer',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 179438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e57cc188-5e66-5ad7-b6ab-22277c30e36f/e57cc188-5e66-5ad7-b6ab-22277c30e36f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/01/1c0150e2a1951cd922cee15e1922baba/pa/TR81409_0e30f62bc4b4c02c06bbf1f41b4dae8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e57cc188-5e66-5ad7-b6ab-22277c30e36f/e57cc188-5e66-5ad7-b6ab-22277c30e36f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/01/1c0150e2a1951cd922cee15e1922baba/pa/TR81409_bb827fe9d9682067bfaeeb06a9c375dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e57cc188-5e66-5ad7-b6ab-22277c30e36f/e57cc188-5e66-5ad7-b6ab-22277c30e36f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/01/1c0150e2a1951cd922cee15e1922baba/pa/TR81409_769aa99b02ff17a61e9215fc01f71ff4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e57cc188-5e66-5ad7-b6ab-22277c30e36f/e57cc188-5e66-5ad7-b6ab-22277c30e36f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/01/1c0150e2a1951cd922cee15e1922baba/pa/TR81409_5641266397bf3d61fe8fbf0b81b80ea9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e57cc188-5e66-5ad7-b6ab-22277c30e36f/e57cc188-5e66-5ad7-b6ab-22277c30e36f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/01/1c0150e2a1951cd922cee15e1922baba/pa/TR81409_6e22d14f4487d08d488d1cfd747e505f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-12-01',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Opel Zafira 1.6 Design Edition',
 'transmission': 'manual',
 'trim': 'Design Edition',
 'year': 2011}
2026-03-27 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR81409%27 HTTP/1.1" 200 None
2026-03-27 10:44:18 [auto1.de] INFO: Saving data for TR81409: {'created_time': 1774608258.294418, 'last_price_update_time': 1774608258.294429, 'auction_closing_time': 1774714726.0}
2026-03-27 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR81409') HTTP/1.1" 204 0
2026-03-27 10:44:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_4701dd1a4ac49ff9304b8f99884fe018.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/f2/80f29e4761941991526616a566c4efe0/pa/KL79607_0cd4e29ace29614e5ce809d3da69fa3d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001fc810>
2026-03-27 10:44:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4fb6605-c81f-5419-ba64-705d43223fb1/e4fb6605-c81f-5419-ba64-705d43223fb1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fec%252Ffbec04a34a856b304dfe666028957ed8%252Fpa%252FEA80690_b02b6052b0f958729cd528077d20c8c5.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_b02b6052b0f958729cd528077d20c8c5.jpg saved to cache
2026-03-27 10:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4fb6605-c81f-5419-ba64-705d43223fb1
2026-03-27 10:44:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a1550>
2026-03-27 10:44:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_659f7e39-f36d-592e-8b4e-18ed268e3373/659f7e39-f36d-592e-8b4e-18ed268e3373_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F79%252Fbf7975b6dfae6143b4d567e572327806%252Fpa%252FSM54936_0977c16f9083cea91bf4facfc64d1a84.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/79/bf7975b6dfae6143b4d567e572327806/pa/SM54936_0977c16f9083cea91bf4facfc64d1a84.jpg saved to cache
2026-03-27 10:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 659f7e39-f36d-592e-8b4e-18ed268e3373
2026-03-27 10:44:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 659f7e39-f36d-592e-8b4e-18ed268e3373, skipping ID generation
2026-03-27 10:44:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 659f7e39-f36d-592e-8b4e-18ed268e3373 with scrape type 1
2026-03-27 10:44:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 659f7e39-f36d-592e-8b4e-18ed268e3373 sending to next pipeline
2026-03-27 10:44:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 659f7e39-f36d-592e-8b4e-18ed268e3373, identifier: SM54936
2026-03-27 10:44:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 659f7e39-f36d-592e-8b4e-18ed268e3373 with identifier: SM54936
2026-03-27 10:44:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 659f7e39-f36d-592e-8b4e-18ed268e3373 with identifier: SM54936
2026-03-27 10:44:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 659f7e39-f36d-592e-8b4e-18ed268e3373 with identifier: SM54936 to the API
2026-03-27 10:44:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbf/79/bf7975b6dfae6143b4d567e572327806/pa/SM54936_0977c16f9083cea91bf4facfc64d1a84.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.9L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:13:56Z',
 'fuel_type': 'diesel',
 'id': '659f7e39-f36d-592e-8b4e-18ed268e3373',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM54936',
 'listing': 'auction',
 'location': 'DE, Offenbach am Main',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 330037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_659f7e39-f36d-592e-8b4e-18ed268e3373/659f7e39-f36d-592e-8b4e-18ed268e3373_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/79/bf7975b6dfae6143b4d567e572327806/pa/SM54936_0977c16f9083cea91bf4facfc64d1a84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_659f7e39-f36d-592e-8b4e-18ed268e3373/659f7e39-f36d-592e-8b4e-18ed268e3373_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/79/bf7975b6dfae6143b4d567e572327806/pa/SM54936_fa56782ec1aab55faa4b261885ce062c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_659f7e39-f36d-592e-8b4e-18ed268e3373/659f7e39-f36d-592e-8b4e-18ed268e3373_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/79/bf7975b6dfae6143b4d567e572327806/pa/SM54936_09b81ba6c7e5b707dbd19f56b96af6af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_659f7e39-f36d-592e-8b4e-18ed268e3373/659f7e39-f36d-592e-8b4e-18ed268e3373_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/79/bf7975b6dfae6143b4d567e572327806/pa/SM54936_8680f85e904fe21978586965e1574225.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_659f7e39-f36d-592e-8b4e-18ed268e3373/659f7e39-f36d-592e-8b4e-18ed268e3373_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/79/bf7975b6dfae6143b4d567e572327806/pa/SM54936_9b999e9635df65d41ad5a3028f6077cc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-01-28',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Sharan 1.9 TDI Comfortline Family',
 'transmission': 'manual',
 'trim': 'Comfortline Family',
 'year': 2003}
2026-03-27 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM54936%27 HTTP/1.1" 200 None
2026-03-27 10:44:19 [auto1.de] INFO: Saving data for SM54936: {'created_time': 1774608259.002696, 'last_price_update_time': 1774608259.002706, 'auction_closing_time': 1774714436.0}
2026-03-27 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM54936') HTTP/1.1" 204 0
2026-03-27 10:44:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LS95970/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501640950>
2026-03-27 10:44:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f297e0e-9dbb-5272-a8f5-138589e5994b/2f297e0e-9dbb-5272-a8f5-138589e5994b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F3a%252F2e3a289ec2450be73880f54f88868917%252Fpa%252FCK72953_4701dd1a4ac49ff9304b8f99884fe018.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_4701dd1a4ac49ff9304b8f99884fe018.jpg saved to cache
2026-03-27 10:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f297e0e-9dbb-5272-a8f5-138589e5994b
2026-03-27 10:44:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f297e0e-9dbb-5272-a8f5-138589e5994b, skipping ID generation
2026-03-27 10:44:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f297e0e-9dbb-5272-a8f5-138589e5994b with scrape type 1
2026-03-27 10:44:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f297e0e-9dbb-5272-a8f5-138589e5994b sending to next pipeline
2026-03-27 10:44:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f297e0e-9dbb-5272-a8f5-138589e5994b, identifier: CK72953
2026-03-27 10:44:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500362d90>
2026-03-27 10:44:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4cc6305-3dc3-5963-9880-cd5df1c48e9b/c4cc6305-3dc3-5963-9880-cd5df1c48e9b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Ff2%252F80f29e4761941991526616a566c4efe0%252Fpa%252FKL79607_0cd4e29ace29614e5ce809d3da69fa3d.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/f2/80f29e4761941991526616a566c4efe0/pa/KL79607_0cd4e29ace29614e5ce809d3da69fa3d.jpg saved to cache
2026-03-27 10:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c4cc6305-3dc3-5963-9880-cd5df1c48e9b
2026-03-27 10:44:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c4cc6305-3dc3-5963-9880-cd5df1c48e9b, skipping ID generation
2026-03-27 10:44:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4cc6305-3dc3-5963-9880-cd5df1c48e9b with scrape type 1
2026-03-27 10:44:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c4cc6305-3dc3-5963-9880-cd5df1c48e9b sending to next pipeline
2026-03-27 10:44:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4cc6305-3dc3-5963-9880-cd5df1c48e9b, identifier: KL79607
2026-03-27 10:44:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_7d65e72a7c3796dec073d209d25e2630.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f297e0e-9dbb-5272-a8f5-138589e5994b with identifier: CK72953
2026-03-27 10:44:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f297e0e-9dbb-5272-a8f5-138589e5994b with identifier: CK72953
2026-03-27 10:44:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f297e0e-9dbb-5272-a8f5-138589e5994b with identifier: CK72953 to the API
2026-03-27 10:44:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_4701dd1a4ac49ff9304b8f99884fe018.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:46:12Z',
 'fuel_type': 'petrol',
 'id': '2f297e0e-9dbb-5272-a8f5-138589e5994b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK72953',
 'listing': 'auction',
 'location': 'DE, Neubrandenburg',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 132539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f297e0e-9dbb-5272-a8f5-138589e5994b/2f297e0e-9dbb-5272-a8f5-138589e5994b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_4701dd1a4ac49ff9304b8f99884fe018.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f297e0e-9dbb-5272-a8f5-138589e5994b/2f297e0e-9dbb-5272-a8f5-138589e5994b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_4acf2ffa020cb77a4bed8d40501c448e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f297e0e-9dbb-5272-a8f5-138589e5994b/2f297e0e-9dbb-5272-a8f5-138589e5994b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2029287,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_109624e5fec41726f40380a72724bc98.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f297e0e-9dbb-5272-a8f5-138589e5994b/2f297e0e-9dbb-5272-a8f5-138589e5994b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1907105,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_4430a97ff2da6479b0feb6a2385668f8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f297e0e-9dbb-5272-a8f5-138589e5994b/2f297e0e-9dbb-5272-a8f5-138589e5994b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_ceac36d427c4cb339f1ab46185b71376.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f297e0e-9dbb-5272-a8f5-138589e5994b/2f297e0e-9dbb-5272-a8f5-138589e5994b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_20bf217e56ee54158e9961e7f6fb4632.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f297e0e-9dbb-5272-a8f5-138589e5994b/2f297e0e-9dbb-5272-a8f5-138589e5994b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1789577,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_b5acd947dcb2d860c09209a971fddf5b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f297e0e-9dbb-5272-a8f5-138589e5994b/2f297e0e-9dbb-5272-a8f5-138589e5994b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1980808,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_2e9d83bfcf5dfc76862f993898d9db07.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f297e0e-9dbb-5272-a8f5-138589e5994b/2f297e0e-9dbb-5272-a8f5-138589e5994b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_c5f1bbade8b6235e7752fa29dfa7551e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f297e0e-9dbb-5272-a8f5-138589e5994b/2f297e0e-9dbb-5272-a8f5-138589e5994b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2115452,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/3a/2e3a289ec2450be73880f54f88868917/pa/CK72953_c6cd7428d1c36f83b317fe79951fb07c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-07-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI Roadster',
 'transmission': 'automatic',
 'trim': 'Roadster',
 'year': 2008}
2026-03-27 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72953%27 HTTP/1.1" 200 None
2026-03-27 10:44:19 [auto1.de] INFO: Saving data for CK72953: {'created_time': 1774608259.768948, 'last_price_update_time': 1774608259.76896, 'auction_closing_time': 1774716372.0}
2026-03-27 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK72953') HTTP/1.1" 204 0
2026-03-27 10:44:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4cc6305-3dc3-5963-9880-cd5df1c48e9b with identifier: KL79607
2026-03-27 10:44:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4cc6305-3dc3-5963-9880-cd5df1c48e9b with identifier: KL79607
2026-03-27 10:44:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4cc6305-3dc3-5963-9880-cd5df1c48e9b with identifier: KL79607 to the API
2026-03-27 10:44:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img80/f2/80f29e4761941991526616a566c4efe0/pa/KL79607_0cd4e29ace29614e5ce809d3da69fa3d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:40:57Z',
 'fuel_type': 'petrol',
 'id': 'c4cc6305-3dc3-5963-9880-cd5df1c48e9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL79607',
 'listing': 'auction',
 'location': 'DE, Dornach',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 187897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4cc6305-3dc3-5963-9880-cd5df1c48e9b/c4cc6305-3dc3-5963-9880-cd5df1c48e9b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/f2/80f29e4761941991526616a566c4efe0/pa/KL79607_0cd4e29ace29614e5ce809d3da69fa3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4cc6305-3dc3-5963-9880-cd5df1c48e9b/c4cc6305-3dc3-5963-9880-cd5df1c48e9b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/f2/80f29e4761941991526616a566c4efe0/pa/KL79607_3c20511a19b8a27271685adcf7e1396f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4cc6305-3dc3-5963-9880-cd5df1c48e9b/c4cc6305-3dc3-5963-9880-cd5df1c48e9b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/f2/80f29e4761941991526616a566c4efe0/pa/KL79607_c743bdff9d0d2956ec8e6fae8375506e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4cc6305-3dc3-5963-9880-cd5df1c48e9b/c4cc6305-3dc3-5963-9880-cd5df1c48e9b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/f2/80f29e4761941991526616a566c4efe0/pa/KL79607_74040746e8c86b17568e4b6acfe2ae98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4cc6305-3dc3-5963-9880-cd5df1c48e9b/c4cc6305-3dc3-5963-9880-cd5df1c48e9b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/f2/80f29e4761941991526616a566c4efe0/pa/KL79607_e782abba63f8b113c67eadd3ebbd641a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2000-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.8 Bild Alternativ',
 'transmission': 'automatic',
 'trim': 'Bild Alternativ',
 'year': 2000}
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL79607%27 HTTP/1.1" 200 None
2026-03-27 10:44:20 [auto1.de] INFO: Saving data for KL79607: {'created_time': 1774608260.129506, 'last_price_update_time': 1774608260.129517, 'auction_closing_time': 1774716057.0}
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL79607') HTTP/1.1" 204 0
2026-03-27 10:44:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50378d750>
2026-03-27 10:44:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c019b7c-8204-52b8-bc97-8858d94ee509/2c019b7c-8204-52b8-bc97-8858d94ee509_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fb4%252F19b40c11ad2459d02f64f9b768dfe164%252Fpa%252FFV94610_7d65e72a7c3796dec073d209d25e2630.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_7d65e72a7c3796dec073d209d25e2630.jpg saved to cache
2026-03-27 10:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c019b7c-8204-52b8-bc97-8858d94ee509
2026-03-27 10:44:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c019b7c-8204-52b8-bc97-8858d94ee509, skipping ID generation
2026-03-27 10:44:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c019b7c-8204-52b8-bc97-8858d94ee509 with scrape type 1
2026-03-27 10:44:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c019b7c-8204-52b8-bc97-8858d94ee509 sending to next pipeline
2026-03-27 10:44:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c019b7c-8204-52b8-bc97-8858d94ee509, identifier: FV94610
2026-03-27 10:44:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c019b7c-8204-52b8-bc97-8858d94ee509 with identifier: FV94610
2026-03-27 10:44:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c019b7c-8204-52b8-bc97-8858d94ee509 with identifier: FV94610
2026-03-27 10:44:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c019b7c-8204-52b8-bc97-8858d94ee509 with identifier: FV94610 to the API
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_7d65e72a7c3796dec073d209d25e2630.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:06:36Z',
 'fuel_type': 'petrol',
 'id': '2c019b7c-8204-52b8-bc97-8858d94ee509',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV94610',
 'listing': 'auction',
 'location': 'DE, Bünde',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 70628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c019b7c-8204-52b8-bc97-8858d94ee509/2c019b7c-8204-52b8-bc97-8858d94ee509_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_7d65e72a7c3796dec073d209d25e2630.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c019b7c-8204-52b8-bc97-8858d94ee509/2c019b7c-8204-52b8-bc97-8858d94ee509_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_f7bcd9961800aa527543398eeacf439f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c019b7c-8204-52b8-bc97-8858d94ee509/2c019b7c-8204-52b8-bc97-8858d94ee509_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2495013,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_0039ac29e1430091dccc37572fda6924.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c019b7c-8204-52b8-bc97-8858d94ee509/2c019b7c-8204-52b8-bc97-8858d94ee509_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_5cb160a51ea272a26d57d86ddb9bd163.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c019b7c-8204-52b8-bc97-8858d94ee509/2c019b7c-8204-52b8-bc97-8858d94ee509_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2562404,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_9874580cace6170ecaaf4612af1abcc5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c019b7c-8204-52b8-bc97-8858d94ee509/2c019b7c-8204-52b8-bc97-8858d94ee509_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2428728,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_b4992e6248db243a60cd028ae9fe5c7a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c019b7c-8204-52b8-bc97-8858d94ee509/2c019b7c-8204-52b8-bc97-8858d94ee509_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2489714,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_2234f9c857376ddaa1191d2b9c632407.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c019b7c-8204-52b8-bc97-8858d94ee509/2c019b7c-8204-52b8-bc97-8858d94ee509_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_5c56ba55901d32d343a4cfd9a1f9afc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c019b7c-8204-52b8-bc97-8858d94ee509/2c019b7c-8204-52b8-bc97-8858d94ee509_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2577761,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_65619fbd325bd330821d3d09d532acfd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c019b7c-8204-52b8-bc97-8858d94ee509/2c019b7c-8204-52b8-bc97-8858d94ee509_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/b4/19b40c11ad2459d02f64f9b768dfe164/pa/FV94610_2d9554323ae3156bd9fa5a30864fe8fa.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mondeo 1.5 EcoBoost Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2018}
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV94610%27 HTTP/1.1" 200 None
2026-03-27 10:44:20 [auto1.de] INFO: Saving data for FV94610: {'created_time': 1774608260.694232, 'last_price_update_time': 1774608260.694242, 'auction_closing_time': 1774713996.0}
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV94610') HTTP/1.1" 204 0
2026-03-27 10:44:20 [auto1.de] INFO: Channel: 24h | Page: 29 | totalHits: 10538 | hits on page: 40
2026-03-27 10:44:20 [auto1.de] INFO: Found listing with ID: ZU42459
2026-03-27 10:44:20 [auto1.de] INFO: Found listing with ID: CT18435
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT18435%27 HTTP/1.1" 200 None
2026-03-27 10:44:20 [auto1.de] INFO: Scrape type for CT18435: 0
2026-03-27 10:44:20 [auto1.de] INFO: Found listing with ID: GJ36407
2026-03-27 10:44:20 [auto1.de] INFO: Found listing with ID: XN51512
2026-03-27 10:44:20 [auto1.de] INFO: Found listing with ID: RR13548
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR13548%27 HTTP/1.1" 200 None
2026-03-27 10:44:20 [auto1.de] INFO: Scrape type for RR13548: 2
2026-03-27 10:44:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07ac2543-6e87-54bf-9948-4bc2c2a5d49e with identifier: RR13548
2026-03-27 10:44:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07ac2543-6e87-54bf-9948-4bc2c2a5d49e with scrape type 2
2026-03-27 10:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07ac2543-6e87-54bf-9948-4bc2c2a5d49e with scrape type 2
2026-03-27 10:44:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07ac2543-6e87-54bf-9948-4bc2c2a5d49e, identifier: RR13548
2026-03-27 10:44:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07ac2543-6e87-54bf-9948-4bc2c2a5d49e with identifier: RR13548
2026-03-27 10:44:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07ac2543-6e87-54bf-9948-4bc2c2a5d49e with identifier: RR13548
2026-03-27 10:44:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07ac2543-6e87-54bf-9948-4bc2c2a5d49e with identifier: RR13548 to the API
2026-03-27 10:44:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:31:11Z',
 'fuel_type': 'diesel',
 'id': '07ac2543-6e87-54bf-9948-4bc2c2a5d49e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR13548',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 159552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-15',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2015}
2026-03-27 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR13548%27 HTTP/1.1" 200 None
2026-03-27 10:44:21 [auto1.de] INFO: Saving data for RR13548: {'auction_closing_time': 1774715471.0, 'created_time': 1773302871.025354, 'last_price_update_time': 1774608261.443551}
2026-03-27 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR13548') HTTP/1.1" 204 0
2026-03-27 10:44:21 [auto1.de] INFO: Found listing with ID: NM84530
2026-03-27 10:44:21 [auto1.de] INFO: Found listing with ID: GK55952
2026-03-27 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK55952%27 HTTP/1.1" 200 None
2026-03-27 10:44:21 [auto1.de] INFO: Scrape type for GK55952: 2
2026-03-27 10:44:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 084bb1bc-1db1-5c53-913d-6300f03782cd with identifier: GK55952
2026-03-27 10:44:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 084bb1bc-1db1-5c53-913d-6300f03782cd with scrape type 2
2026-03-27 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 084bb1bc-1db1-5c53-913d-6300f03782cd with scrape type 2
2026-03-27 10:44:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 084bb1bc-1db1-5c53-913d-6300f03782cd, identifier: GK55952
2026-03-27 10:44:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 084bb1bc-1db1-5c53-913d-6300f03782cd with identifier: GK55952
2026-03-27 10:44:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 084bb1bc-1db1-5c53-913d-6300f03782cd with identifier: GK55952
2026-03-27 10:44:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 084bb1bc-1db1-5c53-913d-6300f03782cd with identifier: GK55952 to the API
2026-03-27 10:44:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:34:13Z',
 'fuel_type': 'petrol',
 'id': '084bb1bc-1db1-5c53-913d-6300f03782cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK55952',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 142994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-26',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Turbo BRABUS BRABUS Xclusive',
 'transmission': 'automatic',
 'trim': 'BRABUS BRABUS Xclusive',
 'year': 2014}
2026-03-27 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK55952%27 HTTP/1.1" 200 None
2026-03-27 10:44:22 [auto1.de] INFO: Saving data for GK55952: {'auction_closing_time': 1774715653.0, 'created_time': 1773859000.563124, 'last_price_update_time': 1774608262.34695}
2026-03-27 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK55952') HTTP/1.1" 204 0
2026-03-27 10:44:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK63697/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:22 [auto1.de] INFO: Found listing with ID: MS73974
2026-03-27 10:44:22 [auto1.de] INFO: Found listing with ID: AS21942
2026-03-27 10:44:22 [auto1.de] INFO: Found listing with ID: VN46305
2026-03-27 10:44:22 [auto1.de] INFO: Found listing with ID: LS92843
2026-03-27 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS92843%27 HTTP/1.1" 200 None
2026-03-27 10:44:22 [auto1.de] INFO: Scrape type for LS92843: 2
2026-03-27 10:44:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23f772a1-8beb-5539-9ca4-503036589778 with identifier: LS92843
2026-03-27 10:44:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23f772a1-8beb-5539-9ca4-503036589778 with scrape type 2
2026-03-27 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23f772a1-8beb-5539-9ca4-503036589778 with scrape type 2
2026-03-27 10:44:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23f772a1-8beb-5539-9ca4-503036589778, identifier: LS92843
2026-03-27 10:44:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23f772a1-8beb-5539-9ca4-503036589778 with identifier: LS92843
2026-03-27 10:44:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23f772a1-8beb-5539-9ca4-503036589778 with identifier: LS92843
2026-03-27 10:44:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23f772a1-8beb-5539-9ca4-503036589778 with identifier: LS92843 to the API
2026-03-27 10:44:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:01:26Z',
 'fuel_type': 'petrol',
 'id': '23f772a1-8beb-5539-9ca4-503036589778',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS92843',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 154983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-18',
 'seller_name': None,
 'title': 'Ford Mondeo 2.5 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2007}
2026-03-27 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS92843%27 HTTP/1.1" 200 None
2026-03-27 10:44:22 [auto1.de] INFO: Saving data for LS92843: {'auction_closing_time': 1774713686.0, 'created_time': 1774292162.249993, 'last_price_update_time': 1774608262.83285}
2026-03-27 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS92843') HTTP/1.1" 204 0
2026-03-27 10:44:22 [auto1.de] INFO: Found listing with ID: TV11727
2026-03-27 10:44:22 [auto1.de] INFO: Found listing with ID: YZ54178
2026-03-27 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ54178%27 HTTP/1.1" 200 None
2026-03-27 10:44:22 [auto1.de] INFO: Scrape type for YZ54178: 2
2026-03-27 10:44:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d904c0d-27fa-5839-a373-84088e8e493a with identifier: YZ54178
2026-03-27 10:44:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d904c0d-27fa-5839-a373-84088e8e493a with scrape type 2
2026-03-27 10:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d904c0d-27fa-5839-a373-84088e8e493a with scrape type 2
2026-03-27 10:44:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d904c0d-27fa-5839-a373-84088e8e493a, identifier: YZ54178
2026-03-27 10:44:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d904c0d-27fa-5839-a373-84088e8e493a with identifier: YZ54178
2026-03-27 10:44:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d904c0d-27fa-5839-a373-84088e8e493a with identifier: YZ54178
2026-03-27 10:44:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d904c0d-27fa-5839-a373-84088e8e493a with identifier: YZ54178 to the API
2026-03-27 10:44:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:32:37Z',
 'fuel_type': 'petrol',
 'id': '4d904c0d-27fa-5839-a373-84088e8e493a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ54178',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S3',
 'odometer': 179068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-25',
 'seller_name': None,
 'title': 'Audi S3 2.0 TFSI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2007}
2026-03-27 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ54178%27 HTTP/1.1" 200 None
2026-03-27 10:44:23 [auto1.de] INFO: Saving data for YZ54178: {'auction_closing_time': 1774715557.0, 'created_time': 1774291073.364745, 'last_price_update_time': 1774608263.398886}
2026-03-27 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ54178') HTTP/1.1" 204 0
2026-03-27 10:44:23 [auto1.de] INFO: Found listing with ID: JK39186
2026-03-27 10:44:23 [auto1.de] INFO: Found listing with ID: RD63050
2026-03-27 10:44:23 [auto1.de] INFO: Found listing with ID: HC91159
2026-03-27 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC91159%27 HTTP/1.1" 200 None
2026-03-27 10:44:23 [auto1.de] INFO: Scrape type for HC91159: 2
2026-03-27 10:44:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81f0cc5f-b557-5022-af94-650154451bd6 with identifier: HC91159
2026-03-27 10:44:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81f0cc5f-b557-5022-af94-650154451bd6 with scrape type 2
2026-03-27 10:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81f0cc5f-b557-5022-af94-650154451bd6 with scrape type 2
2026-03-27 10:44:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81f0cc5f-b557-5022-af94-650154451bd6, identifier: HC91159
2026-03-27 10:44:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81f0cc5f-b557-5022-af94-650154451bd6 with identifier: HC91159
2026-03-27 10:44:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81f0cc5f-b557-5022-af94-650154451bd6 with identifier: HC91159
2026-03-27 10:44:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81f0cc5f-b557-5022-af94-650154451bd6 with identifier: HC91159 to the API
2026-03-27 10:44:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:44:12Z',
 'fuel_type': 'diesel',
 'id': '81f0cc5f-b557-5022-af94-650154451bd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC91159',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand Tourneo Connect',
 'odometer': 136248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-16',
 'seller_name': None,
 'title': 'Ford Grand Tourneo Connect 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-27 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC91159%27 HTTP/1.1" 200 None
2026-03-27 10:44:23 [auto1.de] INFO: Saving data for HC91159: {'auction_closing_time': 1774716252.0, 'created_time': 1774294632.616438, 'last_price_update_time': 1774608263.846677}
2026-03-27 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC91159') HTTP/1.1" 204 0
2026-03-27 10:44:23 [auto1.de] INFO: Found listing with ID: FK87284
2026-03-27 10:44:23 [auto1.de] INFO: Found listing with ID: HX75388
2026-03-27 10:44:23 [auto1.de] INFO: Found listing with ID: NZ01572
2026-03-27 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ01572%27 HTTP/1.1" 200 None
2026-03-27 10:44:23 [auto1.de] INFO: Scrape type for NZ01572: 2
2026-03-27 10:44:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc7173c4-6055-5527-abce-5252f34ae246 with identifier: NZ01572
2026-03-27 10:44:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc7173c4-6055-5527-abce-5252f34ae246 with scrape type 2
2026-03-27 10:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc7173c4-6055-5527-abce-5252f34ae246 with scrape type 2
2026-03-27 10:44:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc7173c4-6055-5527-abce-5252f34ae246, identifier: NZ01572
2026-03-27 10:44:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc7173c4-6055-5527-abce-5252f34ae246 with identifier: NZ01572
2026-03-27 10:44:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc7173c4-6055-5527-abce-5252f34ae246 with identifier: NZ01572
2026-03-27 10:44:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc7173c4-6055-5527-abce-5252f34ae246 with identifier: NZ01572 to the API
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:09:11Z',
 'fuel_type': 'petrol',
 'id': 'cc7173c4-6055-5527-abce-5252f34ae246',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ01572',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 57689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-16',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ01572%27 HTTP/1.1" 200 None
2026-03-27 10:44:24 [auto1.de] INFO: Saving data for NZ01572: {'auction_closing_time': 1774714151.0, 'created_time': 1773775084.116803, 'last_price_update_time': 1774608264.392575}
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ01572') HTTP/1.1" 204 0
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: CE68759
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: UX30716
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: BZ96817
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: EX44757
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: DE42572
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: BP97465
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97465%27 HTTP/1.1" 200 None
2026-03-27 10:44:24 [auto1.de] INFO: Scrape type for BP97465: 2
2026-03-27 10:44:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ba11a15-316d-56a8-a54d-51082370b945 with identifier: BP97465
2026-03-27 10:44:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ba11a15-316d-56a8-a54d-51082370b945 with scrape type 2
2026-03-27 10:44:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ba11a15-316d-56a8-a54d-51082370b945 with scrape type 2
2026-03-27 10:44:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ba11a15-316d-56a8-a54d-51082370b945, identifier: BP97465
2026-03-27 10:44:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ba11a15-316d-56a8-a54d-51082370b945 with identifier: BP97465
2026-03-27 10:44:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ba11a15-316d-56a8-a54d-51082370b945 with identifier: BP97465
2026-03-27 10:44:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ba11a15-316d-56a8-a54d-51082370b945 with identifier: BP97465 to the API
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:55:34Z',
 'fuel_type': 'petrol',
 'id': '0ba11a15-316d-56a8-a54d-51082370b945',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP97465',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 194329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-01',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97465%27 HTTP/1.1" 200 None
2026-03-27 10:44:24 [auto1.de] INFO: Saving data for BP97465: {'auction_closing_time': 1774716934.0, 'created_time': 1773303861.074413, 'last_price_update_time': 1774608264.847785}
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP97465') HTTP/1.1" 204 0
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: TV18739
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: ZG62657
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: LZ15789
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: PN31203
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: FC76019
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: FG09102
2026-03-27 10:44:24 [auto1.de] INFO: Found listing with ID: DZ26190
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ26190%27 HTTP/1.1" 200 None
2026-03-27 10:44:24 [auto1.de] INFO: Scrape type for DZ26190: 2
2026-03-27 10:44:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83321f98-14a4-5c31-b76f-553e6c401692 with identifier: DZ26190
2026-03-27 10:44:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83321f98-14a4-5c31-b76f-553e6c401692 with scrape type 2
2026-03-27 10:44:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83321f98-14a4-5c31-b76f-553e6c401692 with scrape type 2
2026-03-27 10:44:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83321f98-14a4-5c31-b76f-553e6c401692, identifier: DZ26190
2026-03-27 10:44:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83321f98-14a4-5c31-b76f-553e6c401692 with identifier: DZ26190
2026-03-27 10:44:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83321f98-14a4-5c31-b76f-553e6c401692 with identifier: DZ26190
2026-03-27 10:44:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83321f98-14a4-5c31-b76f-553e6c401692 with identifier: DZ26190 to the API
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:44:09Z',
 'fuel_type': 'petrol',
 'id': '83321f98-14a4-5c31-b76f-553e6c401692',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ26190',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 191765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-12',
 'seller_name': None,
 'title': 'Skoda Octavia 1.8 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2012}
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ26190%27 HTTP/1.1" 200 None
2026-03-27 10:44:25 [auto1.de] INFO: Saving data for DZ26190: {'auction_closing_time': 1774716249.0, 'created_time': 1773859002.527609, 'last_price_update_time': 1774608265.520007}
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ26190') HTTP/1.1" 204 0
2026-03-27 10:44:25 [auto1.de] INFO: Found listing with ID: HB27474
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB27474%27 HTTP/1.1" 200 None
2026-03-27 10:44:25 [auto1.de] INFO: Scrape type for HB27474: 2
2026-03-27 10:44:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0ee91dc-75c7-5a56-b5df-750e5fd39584 with identifier: HB27474
2026-03-27 10:44:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0ee91dc-75c7-5a56-b5df-750e5fd39584 with scrape type 2
2026-03-27 10:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0ee91dc-75c7-5a56-b5df-750e5fd39584 with scrape type 2
2026-03-27 10:44:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0ee91dc-75c7-5a56-b5df-750e5fd39584, identifier: HB27474
2026-03-27 10:44:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0ee91dc-75c7-5a56-b5df-750e5fd39584 with identifier: HB27474
2026-03-27 10:44:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0ee91dc-75c7-5a56-b5df-750e5fd39584 with identifier: HB27474
2026-03-27 10:44:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0ee91dc-75c7-5a56-b5df-750e5fd39584 with identifier: HB27474 to the API
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:57:52Z',
 'fuel_type': 'petrol',
 'id': 'c0ee91dc-75c7-5a56-b5df-750e5fd39584',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB27474',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 95609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-17',
 'seller_name': None,
 'title': 'Toyota Yaris 1.33 Dual VVT-i Edition-S',
 'transmission': 'manual',
 'trim': 'Edition-S',
 'year': 2016}
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB27474%27 HTTP/1.1" 200 None
2026-03-27 10:44:25 [auto1.de] INFO: Saving data for HB27474: {'auction_closing_time': 1774717072.0, 'created_time': 1774263226.954427, 'last_price_update_time': 1774608265.985517}
2026-03-27 10:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB27474') HTTP/1.1" 204 0
2026-03-27 10:44:26 [auto1.de] INFO: Found listing with ID: JG35044
2026-03-27 10:44:26 [auto1.de] INFO: Found listing with ID: ZV61779
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV61779%27 HTTP/1.1" 200 None
2026-03-27 10:44:26 [auto1.de] INFO: Scrape type for ZV61779: 2
2026-03-27 10:44:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c1a7600-ef21-5d70-8567-de4d1cedd691 with identifier: ZV61779
2026-03-27 10:44:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c1a7600-ef21-5d70-8567-de4d1cedd691 with scrape type 2
2026-03-27 10:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c1a7600-ef21-5d70-8567-de4d1cedd691 with scrape type 2
2026-03-27 10:44:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c1a7600-ef21-5d70-8567-de4d1cedd691, identifier: ZV61779
2026-03-27 10:44:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c1a7600-ef21-5d70-8567-de4d1cedd691 with identifier: ZV61779
2026-03-27 10:44:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c1a7600-ef21-5d70-8567-de4d1cedd691 with identifier: ZV61779
2026-03-27 10:44:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c1a7600-ef21-5d70-8567-de4d1cedd691 with identifier: ZV61779 to the API
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-28T16:53:56Z',
 'fuel_type': 'petrol',
 'id': '4c1a7600-ef21-5d70-8567-de4d1cedd691',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV61779',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 133452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-11',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 400 CGI Shooting Brake 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2017}
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV61779%27 HTTP/1.1" 200 None
2026-03-27 10:44:26 [auto1.de] INFO: Saving data for ZV61779: {'auction_closing_time': 1774716836.0, 'created_time': 1774291071.471659, 'last_price_update_time': 1774608266.421435}
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV61779') HTTP/1.1" 204 0
2026-03-27 10:44:26 [auto1.de] INFO: Found listing with ID: BY18365
2026-03-27 10:44:26 [auto1.de] INFO: Found listing with ID: BE52525
2026-03-27 10:44:26 [auto1.de] INFO: Found listing with ID: MB36683
2026-03-27 10:44:26 [auto1.de] INFO: Found listing with ID: PT08625
2026-03-27 10:44:26 [auto1.de] INFO: Found listing with ID: JK09354
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK09354%27 HTTP/1.1" 200 None
2026-03-27 10:44:26 [auto1.de] INFO: Scrape type for JK09354: 2
2026-03-27 10:44:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c2a8801-2849-5b91-9ca2-812afe0accf1 with identifier: JK09354
2026-03-27 10:44:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c2a8801-2849-5b91-9ca2-812afe0accf1 with scrape type 2
2026-03-27 10:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c2a8801-2849-5b91-9ca2-812afe0accf1 with scrape type 2
2026-03-27 10:44:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c2a8801-2849-5b91-9ca2-812afe0accf1, identifier: JK09354
2026-03-27 10:44:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c2a8801-2849-5b91-9ca2-812afe0accf1 with identifier: JK09354
2026-03-27 10:44:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c2a8801-2849-5b91-9ca2-812afe0accf1 with identifier: JK09354
2026-03-27 10:44:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c2a8801-2849-5b91-9ca2-812afe0accf1 with identifier: JK09354 to the API
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:11:57Z',
 'fuel_type': 'diesel',
 'id': '5c2a8801-2849-5b91-9ca2-812afe0accf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK09354',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 119096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-14',
 'seller_name': None,
 'title': 'Audi A4 35 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK09354%27 HTTP/1.1" 200 None
2026-03-27 10:44:26 [auto1.de] INFO: Saving data for JK09354: {'auction_closing_time': 1774714317.0, 'created_time': 1773308000.018424, 'last_price_update_time': 1774608266.888224}
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK09354') HTTP/1.1" 204 0
2026-03-27 10:44:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_b1d82f96d373da37dc6157c397f7a6f4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_6b8727a3450b866cc248a1292810bc2f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_8c72c390b82486fcae13c799e1f16a35.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_0cf204f4de60fc3de9b9539d9d7cce7a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002063d0>
2026-03-27 10:44:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4fb6605-c81f-5419-ba64-705d43223fb1/e4fb6605-c81f-5419-ba64-705d43223fb1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fec%252Ffbec04a34a856b304dfe666028957ed8%252Fpa%252FEA80690_b1d82f96d373da37dc6157c397f7a6f4.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_b1d82f96d373da37dc6157c397f7a6f4.jpg saved to cache
2026-03-27 10:44:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4fb6605-c81f-5419-ba64-705d43223fb1
2026-03-27 10:44:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4fb6605-c81f-5419-ba64-705d43223fb1, skipping ID generation
2026-03-27 10:44:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4fb6605-c81f-5419-ba64-705d43223fb1 with scrape type 1
2026-03-27 10:44:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4fb6605-c81f-5419-ba64-705d43223fb1 sending to next pipeline
2026-03-27 10:44:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4fb6605-c81f-5419-ba64-705d43223fb1, identifier: EA80690
2026-03-27 10:44:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4fb6605-c81f-5419-ba64-705d43223fb1 with identifier: EA80690
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-27 10:44:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:44:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4fb6605-c81f-5419-ba64-705d43223fb1 with identifier: EA80690
2026-03-27 10:44:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4fb6605-c81f-5419-ba64-705d43223fb1 with identifier: EA80690 to the API
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_b1d82f96d373da37dc6157c397f7a6f4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:11:24Z',
 'fuel_type': 'gas',
 'id': 'e4fb6605-c81f-5419-ba64-705d43223fb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA80690',
 'listing': 'auction',
 'location': 'DE, Erfurt',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 42366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fb6605-c81f-5419-ba64-705d43223fb1/e4fb6605-c81f-5419-ba64-705d43223fb1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2687579,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_b1d82f96d373da37dc6157c397f7a6f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fb6605-c81f-5419-ba64-705d43223fb1/e4fb6605-c81f-5419-ba64-705d43223fb1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2752258,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_b02b6052b0f958729cd528077d20c8c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fb6605-c81f-5419-ba64-705d43223fb1/e4fb6605-c81f-5419-ba64-705d43223fb1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_5ffcc93086260dcf36eb2fc38386baf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fb6605-c81f-5419-ba64-705d43223fb1/e4fb6605-c81f-5419-ba64-705d43223fb1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2557612,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_0018c5975011af585804446d20386352.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fb6605-c81f-5419-ba64-705d43223fb1/e4fb6605-c81f-5419-ba64-705d43223fb1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2695250,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_1849962cee8a435ec4c630aea28e4ed6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fb6605-c81f-5419-ba64-705d43223fb1/e4fb6605-c81f-5419-ba64-705d43223fb1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2483193,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_985502ff0c6ae8518f9619b5249c02a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fb6605-c81f-5419-ba64-705d43223fb1/e4fb6605-c81f-5419-ba64-705d43223fb1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2514731,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_0da8a250973466bcb30b74b3b8d948da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fb6605-c81f-5419-ba64-705d43223fb1/e4fb6605-c81f-5419-ba64-705d43223fb1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2569360,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_92c0b5662ba96bcfce5bc092ed8bf955.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fb6605-c81f-5419-ba64-705d43223fb1/e4fb6605-c81f-5419-ba64-705d43223fb1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_1b6161d29b486810db4f004a5574fcad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fb6605-c81f-5419-ba64-705d43223fb1/e4fb6605-c81f-5419-ba64-705d43223fb1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/ec/fbec04a34a856b304dfe666028957ed8/pa/EA80690_aecb7d081391805d89abba955e64abf3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe LPG Extreme+',
 'transmission': 'manual',
 'trim': 'Extreme+',
 'year': 2023}
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA80690%27 HTTP/1.1" 200 None
2026-03-27 10:44:27 [auto1.de] INFO: Saving data for EA80690: {'created_time': 1774608267.898325, 'last_price_update_time': 1774608267.898337, 'auction_closing_time': 1774714284.0}
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA80690') HTTP/1.1" 204 0
2026-03-27 10:44:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500204850>
2026-03-27 10:44:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30986627-4795-5964-a386-2181452c2a6e/30986627-4795-5964-a386-2181452c2a6e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F5331d13314a0b54db64ac2f75f2df8ce%252Fpa%252FBY90710_6b8727a3450b866cc248a1292810bc2f.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_6b8727a3450b866cc248a1292810bc2f.jpg saved to cache
2026-03-27 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30986627-4795-5964-a386-2181452c2a6e
2026-03-27 10:44:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YW50252/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c36d0>
2026-03-27 10:44:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c325213c-98d7-5b02-b0dd-1fcc571aa207/c325213c-98d7-5b02-b0dd-1fcc571aa207_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F3b%252F383b91974caca5b2a78d21f118a302dc%252Fpa%252FVZ21746_8c72c390b82486fcae13c799e1f16a35.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_8c72c390b82486fcae13c799e1f16a35.jpg saved to cache
2026-03-27 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c325213c-98d7-5b02-b0dd-1fcc571aa207
2026-03-27 10:44:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50169b3d0>
2026-03-27 10:44:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c218447f-2f05-5fb8-b352-abe4d5938aad/c218447f-2f05-5fb8-b352-abe4d5938aad_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7a%252F4d7a76cf71d17ec266e8856f3c6a5e25%252Fpa%252FKV84804_0cf204f4de60fc3de9b9539d9d7cce7a.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_0cf204f4de60fc3de9b9539d9d7cce7a.jpg saved to cache
2026-03-27 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c218447f-2f05-5fb8-b352-abe4d5938aad
2026-03-27 10:44:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_a1394d6e027ade4b93b322f3e66b3681.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50169a450>
2026-03-27 10:44:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c325213c-98d7-5b02-b0dd-1fcc571aa207/c325213c-98d7-5b02-b0dd-1fcc571aa207_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F3b%252F383b91974caca5b2a78d21f118a302dc%252Fpa%252FVZ21746_a1394d6e027ade4b93b322f3e66b3681.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_a1394d6e027ade4b93b322f3e66b3681.jpg saved to cache
2026-03-27 10:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c325213c-98d7-5b02-b0dd-1fcc571aa207
2026-03-27 10:44:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JG50197/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_45c9a01b8b3fc445b83d53c420a9c9e6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501846d90>
2026-03-27 10:44:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30986627-4795-5964-a386-2181452c2a6e/30986627-4795-5964-a386-2181452c2a6e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F5331d13314a0b54db64ac2f75f2df8ce%252Fpa%252FBY90710_45c9a01b8b3fc445b83d53c420a9c9e6.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_45c9a01b8b3fc445b83d53c420a9c9e6.jpg saved to cache
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30986627-4795-5964-a386-2181452c2a6e
2026-03-27 10:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_b34df8658de0c45378cfdba0ada53d80.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_9d7b235c29c3010bf64b641c2ebf43e6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AU97195> (referer: https://www.auto1.com/v1/car-details-view/AU97195/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019582d0>
2026-03-27 10:44:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c218447f-2f05-5fb8-b352-abe4d5938aad/c218447f-2f05-5fb8-b352-abe4d5938aad_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7a%252F4d7a76cf71d17ec266e8856f3c6a5e25%252Fpa%252FKV84804_b34df8658de0c45378cfdba0ada53d80.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_b34df8658de0c45378cfdba0ada53d80.jpg saved to cache
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c218447f-2f05-5fb8-b352-abe4d5938aad
2026-03-27 10:44:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a0e90>
2026-03-27 10:44:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30986627-4795-5964-a386-2181452c2a6e/30986627-4795-5964-a386-2181452c2a6e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F5331d13314a0b54db64ac2f75f2df8ce%252Fpa%252FBY90710_9d7b235c29c3010bf64b641c2ebf43e6.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_9d7b235c29c3010bf64b641c2ebf43e6.jpg saved to cache
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30986627-4795-5964-a386-2181452c2a6e
2026-03-27 10:44:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 817227d7-5e70-55be-9ac2-af7343b89aa2 with identifier: AU97195
2026-03-27 10:44:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 817227d7-5e70-55be-9ac2-af7343b89aa2 with scrape type 1
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 817227d7-5e70-55be-9ac2-af7343b89aa2
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fc8%252F18c8b40a9f6cdd1df55630acb0ab114e%252Fpa%252FAU97195_130c5790d5c051b860bcc885117a3d03.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_130c5790d5c051b860bcc885117a3d03.jpg not downloaded yet
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fc8%252F18c8b40a9f6cdd1df55630acb0ab114e%252Fpa%252FAU97195_1b427d9f10e499aa65f42350f44be041.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_1b427d9f10e499aa65f42350f44be041.jpg not downloaded yet
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fc8%252F18c8b40a9f6cdd1df55630acb0ab114e%252Fpa%252FAU97195_8932a32d9cbf99f9b9a93fb1c46b14a9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_8932a32d9cbf99f9b9a93fb1c46b14a9.jpg not downloaded yet
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fc8%252F18c8b40a9f6cdd1df55630acb0ab114e%252Fpa%252FAU97195_ed5272ee9d0f8327c377e9576c3abac6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_ed5272ee9d0f8327c377e9576c3abac6.jpg not downloaded yet
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fc8%252F18c8b40a9f6cdd1df55630acb0ab114e%252Fpa%252FAU97195_c99ef509397a06aac622a30f1cc137d7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_c99ef509397a06aac622a30f1cc137d7.jpg not downloaded yet
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fc8%252F18c8b40a9f6cdd1df55630acb0ab114e%252Fpa%252FAU97195_4cb148b87845989ef912fd6081eec780.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_4cb148b87845989ef912fd6081eec780.jpg not downloaded yet
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fc8%252F18c8b40a9f6cdd1df55630acb0ab114e%252Fpa%252FAU97195_a18066dbb99b06a82ed181bdd2935bed.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_a18066dbb99b06a82ed181bdd2935bed.jpg not downloaded yet
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fc8%252F18c8b40a9f6cdd1df55630acb0ab114e%252Fpa%252FAU97195_738bf0b74e542c27cc5b178e445e4114.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_738bf0b74e542c27cc5b178e445e4114.jpg not downloaded yet
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fc8%252F18c8b40a9f6cdd1df55630acb0ab114e%252Fpa%252FAU97195_bf2d6df25f65ae7239c53aecc527258b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_bf2d6df25f65ae7239c53aecc527258b.jpg not downloaded yet
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fc8%252F18c8b40a9f6cdd1df55630acb0ab114e%252Fpa%252FAU97195_6c8cc3f4e784e17196e1c89e93a9c3ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_6c8cc3f4e784e17196e1c89e93a9c3ac.jpg not downloaded yet
2026-03-27 10:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_e2ea2699e7b36f88e2cb33d72140b5a3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001dc690>
2026-03-27 10:44:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c325213c-98d7-5b02-b0dd-1fcc571aa207/c325213c-98d7-5b02-b0dd-1fcc571aa207_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F3b%252F383b91974caca5b2a78d21f118a302dc%252Fpa%252FVZ21746_e2ea2699e7b36f88e2cb33d72140b5a3.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_e2ea2699e7b36f88e2cb33d72140b5a3.jpg saved to cache
2026-03-27 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c325213c-98d7-5b02-b0dd-1fcc571aa207
2026-03-27 10:44:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_6c8cc3f4e784e17196e1c89e93a9c3ac.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501641ad0>
2026-03-27 10:44:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_817227d7-5e70-55be-9ac2-af7343b89aa2/817227d7-5e70-55be-9ac2-af7343b89aa2_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fc8%252F18c8b40a9f6cdd1df55630acb0ab114e%252Fpa%252FAU97195_6c8cc3f4e784e17196e1c89e93a9c3ac.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_6c8cc3f4e784e17196e1c89e93a9c3ac.jpg saved to cache
2026-03-27 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 817227d7-5e70-55be-9ac2-af7343b89aa2
2026-03-27 10:44:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_bf2d6df25f65ae7239c53aecc527258b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001e4310>
2026-03-27 10:44:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_817227d7-5e70-55be-9ac2-af7343b89aa2/817227d7-5e70-55be-9ac2-af7343b89aa2_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fc8%252F18c8b40a9f6cdd1df55630acb0ab114e%252Fpa%252FAU97195_bf2d6df25f65ae7239c53aecc527258b.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_bf2d6df25f65ae7239c53aecc527258b.jpg saved to cache
2026-03-27 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 817227d7-5e70-55be-9ac2-af7343b89aa2
2026-03-27 10:44:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HV45616/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_a18066dbb99b06a82ed181bdd2935bed.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_738bf0b74e542c27cc5b178e445e4114.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5026130d0>
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_817227d7-5e70-55be-9ac2-af7343b89aa2/817227d7-5e70-55be-9ac2-af7343b89aa2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fc8%252F18c8b40a9f6cdd1df55630acb0ab114e%252Fpa%252FAU97195_a18066dbb99b06a82ed181bdd2935bed.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_a18066dbb99b06a82ed181bdd2935bed.jpg saved to cache
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 817227d7-5e70-55be-9ac2-af7343b89aa2
2026-03-27 10:44:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003502d0>
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_817227d7-5e70-55be-9ac2-af7343b89aa2/817227d7-5e70-55be-9ac2-af7343b89aa2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fc8%252F18c8b40a9f6cdd1df55630acb0ab114e%252Fpa%252FAU97195_738bf0b74e542c27cc5b178e445e4114.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_738bf0b74e542c27cc5b178e445e4114.jpg saved to cache
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 817227d7-5e70-55be-9ac2-af7343b89aa2
2026-03-27 10:44:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RM96597> (referer: https://www.auto1.com/v1/car-details-view/RM96597/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_4cb148b87845989ef912fd6081eec780.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 432be146-7242-5d8d-8812-054af96c35dc with identifier: RM96597
2026-03-27 10:44:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 432be146-7242-5d8d-8812-054af96c35dc with scrape type 1
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 432be146-7242-5d8d-8812-054af96c35dc
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F2a%252F142a823b4534607bcb349eb396555257%252Fpa%252FRM96597_e35ba7296ea4588317d67e2432bc95f7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_e35ba7296ea4588317d67e2432bc95f7.jpg not downloaded yet
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F2a%252F142a823b4534607bcb349eb396555257%252Fpa%252FRM96597_1fee7280bd1aa5750b169c0aab65c272.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_1fee7280bd1aa5750b169c0aab65c272.jpg not downloaded yet
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F2a%252F142a823b4534607bcb349eb396555257%252Fpa%252FRM96597_2be6ece221fe3460a149bcf3264f22dc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_2be6ece221fe3460a149bcf3264f22dc.jpg not downloaded yet
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F2a%252F142a823b4534607bcb349eb396555257%252Fpa%252FRM96597_9163c0ec03cd6bdeda789d12d70ecd98.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_9163c0ec03cd6bdeda789d12d70ecd98.jpg not downloaded yet
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F2a%252F142a823b4534607bcb349eb396555257%252Fpa%252FRM96597_3aa962e26711afd36d145245276da744.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_3aa962e26711afd36d145245276da744.jpg not downloaded yet
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F2a%252F142a823b4534607bcb349eb396555257%252Fpa%252FRM96597_ac68100adfede9b8de557f773bc57f93.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_ac68100adfede9b8de557f773bc57f93.jpg not downloaded yet
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F2a%252F142a823b4534607bcb349eb396555257%252Fpa%252FRM96597_edb57c99023c7fc3b81a5620e14b1ac3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_edb57c99023c7fc3b81a5620e14b1ac3.jpg not downloaded yet
2026-03-27 10:44:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501822310>
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_817227d7-5e70-55be-9ac2-af7343b89aa2/817227d7-5e70-55be-9ac2-af7343b89aa2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fc8%252F18c8b40a9f6cdd1df55630acb0ab114e%252Fpa%252FAU97195_4cb148b87845989ef912fd6081eec780.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_4cb148b87845989ef912fd6081eec780.jpg saved to cache
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 817227d7-5e70-55be-9ac2-af7343b89aa2
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F2a%252F142a823b4534607bcb349eb396555257%252Fpa%252FRM96597_8837d0ae70555e60074848244098c896.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_8837d0ae70555e60074848244098c896.jpg not downloaded yet
2026-03-27 10:44:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_c99ef509397a06aac622a30f1cc137d7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_ed5272ee9d0f8327c377e9576c3abac6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F2a%252F142a823b4534607bcb349eb396555257%252Fpa%252FRM96597_9ba0ce86fab8e03ff197e4b817bcd1d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_9ba0ce86fab8e03ff197e4b817bcd1d5.jpg not downloaded yet
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F2a%252F142a823b4534607bcb349eb396555257%252Fpa%252FRM96597_ac832b7c6310501d85692f61dea4a998.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_ac832b7c6310501d85692f61dea4a998.jpg not downloaded yet
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb502612350>
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_817227d7-5e70-55be-9ac2-af7343b89aa2/817227d7-5e70-55be-9ac2-af7343b89aa2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fc8%252F18c8b40a9f6cdd1df55630acb0ab114e%252Fpa%252FAU97195_c99ef509397a06aac622a30f1cc137d7.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_c99ef509397a06aac622a30f1cc137d7.jpg saved to cache
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 817227d7-5e70-55be-9ac2-af7343b89aa2
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c2b10>
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_817227d7-5e70-55be-9ac2-af7343b89aa2/817227d7-5e70-55be-9ac2-af7343b89aa2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fc8%252F18c8b40a9f6cdd1df55630acb0ab114e%252Fpa%252FAU97195_ed5272ee9d0f8327c377e9576c3abac6.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_ed5272ee9d0f8327c377e9576c3abac6.jpg saved to cache
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 817227d7-5e70-55be-9ac2-af7343b89aa2
2026-03-27 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_8837d0ae70555e60074848244098c896.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500360ed0>
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_432be146-7242-5d8d-8812-054af96c35dc/432be146-7242-5d8d-8812-054af96c35dc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F2a%252F142a823b4534607bcb349eb396555257%252Fpa%252FRM96597_8837d0ae70555e60074848244098c896.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_8837d0ae70555e60074848244098c896.jpg saved to cache
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 432be146-7242-5d8d-8812-054af96c35dc
2026-03-27 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_edb57c99023c7fc3b81a5620e14b1ac3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_ac832b7c6310501d85692f61dea4a998.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001ddd10>
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_432be146-7242-5d8d-8812-054af96c35dc/432be146-7242-5d8d-8812-054af96c35dc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F2a%252F142a823b4534607bcb349eb396555257%252Fpa%252FRM96597_edb57c99023c7fc3b81a5620e14b1ac3.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_edb57c99023c7fc3b81a5620e14b1ac3.jpg saved to cache
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 432be146-7242-5d8d-8812-054af96c35dc
2026-03-27 10:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_9ba0ce86fab8e03ff197e4b817bcd1d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a7e10>
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_432be146-7242-5d8d-8812-054af96c35dc/432be146-7242-5d8d-8812-054af96c35dc_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F2a%252F142a823b4534607bcb349eb396555257%252Fpa%252FRM96597_ac832b7c6310501d85692f61dea4a998.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_ac832b7c6310501d85692f61dea4a998.jpg saved to cache
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 432be146-7242-5d8d-8812-054af96c35dc
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a4f50>
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_432be146-7242-5d8d-8812-054af96c35dc/432be146-7242-5d8d-8812-054af96c35dc_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F2a%252F142a823b4534607bcb349eb396555257%252Fpa%252FRM96597_9ba0ce86fab8e03ff197e4b817bcd1d5.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_9ba0ce86fab8e03ff197e4b817bcd1d5.jpg saved to cache
2026-03-27 10:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 432be146-7242-5d8d-8812-054af96c35dc
2026-03-27 10:44:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_ac68100adfede9b8de557f773bc57f93.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_3aa962e26711afd36d145245276da744.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d6490>
2026-03-27 10:44:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_432be146-7242-5d8d-8812-054af96c35dc/432be146-7242-5d8d-8812-054af96c35dc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F2a%252F142a823b4534607bcb349eb396555257%252Fpa%252FRM96597_ac68100adfede9b8de557f773bc57f93.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_ac68100adfede9b8de557f773bc57f93.jpg saved to cache
2026-03-27 10:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 432be146-7242-5d8d-8812-054af96c35dc
2026-03-27 10:44:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_9163c0ec03cd6bdeda789d12d70ecd98.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_2be6ece221fe3460a149bcf3264f22dc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500363a10>
2026-03-27 10:44:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_432be146-7242-5d8d-8812-054af96c35dc/432be146-7242-5d8d-8812-054af96c35dc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F2a%252F142a823b4534607bcb349eb396555257%252Fpa%252FRM96597_3aa962e26711afd36d145245276da744.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_3aa962e26711afd36d145245276da744.jpg saved to cache
2026-03-27 10:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 432be146-7242-5d8d-8812-054af96c35dc
2026-03-27 10:44:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015e1e90>
2026-03-27 10:44:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_432be146-7242-5d8d-8812-054af96c35dc/432be146-7242-5d8d-8812-054af96c35dc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F2a%252F142a823b4534607bcb349eb396555257%252Fpa%252FRM96597_9163c0ec03cd6bdeda789d12d70ecd98.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_9163c0ec03cd6bdeda789d12d70ecd98.jpg saved to cache
2026-03-27 10:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 432be146-7242-5d8d-8812-054af96c35dc
2026-03-27 10:44:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50032d1d0>
2026-03-27 10:44:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_432be146-7242-5d8d-8812-054af96c35dc/432be146-7242-5d8d-8812-054af96c35dc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F2a%252F142a823b4534607bcb349eb396555257%252Fpa%252FRM96597_2be6ece221fe3460a149bcf3264f22dc.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_2be6ece221fe3460a149bcf3264f22dc.jpg saved to cache
2026-03-27 10:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 432be146-7242-5d8d-8812-054af96c35dc
2026-03-27 10:44:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_1fee7280bd1aa5750b169c0aab65c272.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501768f90>
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_432be146-7242-5d8d-8812-054af96c35dc/432be146-7242-5d8d-8812-054af96c35dc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F2a%252F142a823b4534607bcb349eb396555257%252Fpa%252FRM96597_1fee7280bd1aa5750b169c0aab65c272.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_1fee7280bd1aa5750b169c0aab65c272.jpg saved to cache
2026-03-27 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 432be146-7242-5d8d-8812-054af96c35dc
2026-03-27 10:44:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_8932a32d9cbf99f9b9a93fb1c46b14a9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_e35ba7296ea4588317d67e2432bc95f7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a1950>
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_817227d7-5e70-55be-9ac2-af7343b89aa2/817227d7-5e70-55be-9ac2-af7343b89aa2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fc8%252F18c8b40a9f6cdd1df55630acb0ab114e%252Fpa%252FAU97195_8932a32d9cbf99f9b9a93fb1c46b14a9.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_8932a32d9cbf99f9b9a93fb1c46b14a9.jpg saved to cache
2026-03-27 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 817227d7-5e70-55be-9ac2-af7343b89aa2
2026-03-27 10:44:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c53d0>
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_432be146-7242-5d8d-8812-054af96c35dc/432be146-7242-5d8d-8812-054af96c35dc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F2a%252F142a823b4534607bcb349eb396555257%252Fpa%252FRM96597_e35ba7296ea4588317d67e2432bc95f7.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_e35ba7296ea4588317d67e2432bc95f7.jpg saved to cache
2026-03-27 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 432be146-7242-5d8d-8812-054af96c35dc
2026-03-27 10:44:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 432be146-7242-5d8d-8812-054af96c35dc, skipping ID generation
2026-03-27 10:44:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 432be146-7242-5d8d-8812-054af96c35dc with scrape type 1
2026-03-27 10:44:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 432be146-7242-5d8d-8812-054af96c35dc sending to next pipeline
2026-03-27 10:44:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 432be146-7242-5d8d-8812-054af96c35dc, identifier: RM96597
2026-03-27 10:44:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 432be146-7242-5d8d-8812-054af96c35dc with identifier: RM96597
2026-03-27 10:44:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 432be146-7242-5d8d-8812-054af96c35dc with identifier: RM96597
2026-03-27 10:44:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 432be146-7242-5d8d-8812-054af96c35dc with identifier: RM96597 to the API
2026-03-27 10:44:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_e35ba7296ea4588317d67e2432bc95f7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:13:07Z',
 'fuel_type': 'petrol',
 'id': '432be146-7242-5d8d-8812-054af96c35dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM96597',
 'listing': 'auction',
 'location': 'DE, Potsdam',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 211509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_432be146-7242-5d8d-8812-054af96c35dc/432be146-7242-5d8d-8812-054af96c35dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2427081,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_e35ba7296ea4588317d67e2432bc95f7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_432be146-7242-5d8d-8812-054af96c35dc/432be146-7242-5d8d-8812-054af96c35dc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2284366,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_1fee7280bd1aa5750b169c0aab65c272.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_432be146-7242-5d8d-8812-054af96c35dc/432be146-7242-5d8d-8812-054af96c35dc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_2be6ece221fe3460a149bcf3264f22dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_432be146-7242-5d8d-8812-054af96c35dc/432be146-7242-5d8d-8812-054af96c35dc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_9163c0ec03cd6bdeda789d12d70ecd98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_432be146-7242-5d8d-8812-054af96c35dc/432be146-7242-5d8d-8812-054af96c35dc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2461814,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_3aa962e26711afd36d145245276da744.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_432be146-7242-5d8d-8812-054af96c35dc/432be146-7242-5d8d-8812-054af96c35dc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2429357,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_ac68100adfede9b8de557f773bc57f93.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_432be146-7242-5d8d-8812-054af96c35dc/432be146-7242-5d8d-8812-054af96c35dc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2332646,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_edb57c99023c7fc3b81a5620e14b1ac3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_432be146-7242-5d8d-8812-054af96c35dc/432be146-7242-5d8d-8812-054af96c35dc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2561545,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_8837d0ae70555e60074848244098c896.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_432be146-7242-5d8d-8812-054af96c35dc/432be146-7242-5d8d-8812-054af96c35dc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_9ba0ce86fab8e03ff197e4b817bcd1d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_432be146-7242-5d8d-8812-054af96c35dc/432be146-7242-5d8d-8812-054af96c35dc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2700090,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/2a/142a823b4534607bcb349eb396555257/pa/RM96597_ac832b7c6310501d85692f61dea4a998.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Innovation Start/Stop',
 'transmission': 'automatic',
 'trim': 'Innovation Start/Stop',
 'year': 2017}
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM96597%27 HTTP/1.1" 200 None
2026-03-27 10:44:35 [auto1.de] INFO: Saving data for RM96597: {'created_time': 1774608275.527707, 'last_price_update_time': 1774608275.527723, 'auction_closing_time': 1774714387.0}
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM96597') HTTP/1.1" 204 0
2026-03-27 10:44:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_1b427d9f10e499aa65f42350f44be041.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_130c5790d5c051b860bcc885117a3d03.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501642150>
2026-03-27 10:44:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_817227d7-5e70-55be-9ac2-af7343b89aa2/817227d7-5e70-55be-9ac2-af7343b89aa2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fc8%252F18c8b40a9f6cdd1df55630acb0ab114e%252Fpa%252FAU97195_1b427d9f10e499aa65f42350f44be041.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_1b427d9f10e499aa65f42350f44be041.jpg saved to cache
2026-03-27 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 817227d7-5e70-55be-9ac2-af7343b89aa2
2026-03-27 10:44:35 [auto1.de] INFO: Channel: 24h | Page: 30 | totalHits: 10539 | hits on page: 40
2026-03-27 10:44:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500397050>
2026-03-27 10:44:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_817227d7-5e70-55be-9ac2-af7343b89aa2/817227d7-5e70-55be-9ac2-af7343b89aa2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fc8%252F18c8b40a9f6cdd1df55630acb0ab114e%252Fpa%252FAU97195_130c5790d5c051b860bcc885117a3d03.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_130c5790d5c051b860bcc885117a3d03.jpg saved to cache
2026-03-27 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 817227d7-5e70-55be-9ac2-af7343b89aa2
2026-03-27 10:44:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 817227d7-5e70-55be-9ac2-af7343b89aa2, skipping ID generation
2026-03-27 10:44:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 817227d7-5e70-55be-9ac2-af7343b89aa2 with scrape type 1
2026-03-27 10:44:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 817227d7-5e70-55be-9ac2-af7343b89aa2 sending to next pipeline
2026-03-27 10:44:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 817227d7-5e70-55be-9ac2-af7343b89aa2, identifier: AU97195
2026-03-27 10:44:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 817227d7-5e70-55be-9ac2-af7343b89aa2 with identifier: AU97195
2026-03-27 10:44:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 817227d7-5e70-55be-9ac2-af7343b89aa2 with identifier: AU97195
2026-03-27 10:44:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 817227d7-5e70-55be-9ac2-af7343b89aa2 with identifier: AU97195 to the API
2026-03-27 10:44:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_130c5790d5c051b860bcc885117a3d03.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:04:50Z',
 'fuel_type': 'petrol',
 'id': '817227d7-5e70-55be-9ac2-af7343b89aa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU97195',
 'listing': 'auction',
 'location': 'DE, Mannheim',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 26608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_817227d7-5e70-55be-9ac2-af7343b89aa2/817227d7-5e70-55be-9ac2-af7343b89aa2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2627751,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_130c5790d5c051b860bcc885117a3d03.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_817227d7-5e70-55be-9ac2-af7343b89aa2/817227d7-5e70-55be-9ac2-af7343b89aa2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_1b427d9f10e499aa65f42350f44be041.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_817227d7-5e70-55be-9ac2-af7343b89aa2/817227d7-5e70-55be-9ac2-af7343b89aa2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2405045,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_8932a32d9cbf99f9b9a93fb1c46b14a9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_817227d7-5e70-55be-9ac2-af7343b89aa2/817227d7-5e70-55be-9ac2-af7343b89aa2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_ed5272ee9d0f8327c377e9576c3abac6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_817227d7-5e70-55be-9ac2-af7343b89aa2/817227d7-5e70-55be-9ac2-af7343b89aa2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_c99ef509397a06aac622a30f1cc137d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_817227d7-5e70-55be-9ac2-af7343b89aa2/817227d7-5e70-55be-9ac2-af7343b89aa2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2449110,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_4cb148b87845989ef912fd6081eec780.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_817227d7-5e70-55be-9ac2-af7343b89aa2/817227d7-5e70-55be-9ac2-af7343b89aa2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_a18066dbb99b06a82ed181bdd2935bed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_817227d7-5e70-55be-9ac2-af7343b89aa2/817227d7-5e70-55be-9ac2-af7343b89aa2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2428516,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_738bf0b74e542c27cc5b178e445e4114.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_817227d7-5e70-55be-9ac2-af7343b89aa2/817227d7-5e70-55be-9ac2-af7343b89aa2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2358311,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_bf2d6df25f65ae7239c53aecc527258b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_817227d7-5e70-55be-9ac2-af7343b89aa2/817227d7-5e70-55be-9ac2-af7343b89aa2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2275379,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/c8/18c8b40a9f6cdd1df55630acb0ab114e/pa/AU97195_6c8cc3f4e784e17196e1c89e93a9c3ac.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport 4Motion',
 'year': 2020}
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97195%27 HTTP/1.1" 200 None
2026-03-27 10:44:38 [auto1.de] INFO: Saving data for AU97195: {'created_time': 1774608278.938039, 'last_price_update_time': 1774608278.938049, 'auction_closing_time': 1774713890.0}
2026-03-27 10:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU97195') HTTP/1.1" 204 0
2026-03-27 10:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_e0ba3eae689401bce52327155d330afb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_c0f15395a837ae551696ccbc2a80c9a7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:39 [auto1.de] INFO: Found listing with ID: JK09354
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK09354%27 HTTP/1.1" 200 None
2026-03-27 10:44:39 [auto1.de] INFO: Scrape type for JK09354: 0
2026-03-27 10:44:39 [auto1.de] INFO: Found listing with ID: FY57679
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY57679%27 HTTP/1.1" 200 None
2026-03-27 10:44:39 [auto1.de] INFO: Scrape type for FY57679: 2
2026-03-27 10:44:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6ca2c54-5030-5f3a-8640-b78c7fd2f325 with identifier: FY57679
2026-03-27 10:44:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6ca2c54-5030-5f3a-8640-b78c7fd2f325 with scrape type 2
2026-03-27 10:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6ca2c54-5030-5f3a-8640-b78c7fd2f325 with scrape type 2
2026-03-27 10:44:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6ca2c54-5030-5f3a-8640-b78c7fd2f325, identifier: FY57679
2026-03-27 10:44:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6ca2c54-5030-5f3a-8640-b78c7fd2f325 with identifier: FY57679
2026-03-27 10:44:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6ca2c54-5030-5f3a-8640-b78c7fd2f325 with identifier: FY57679
2026-03-27 10:44:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6ca2c54-5030-5f3a-8640-b78c7fd2f325 with identifier: FY57679 to the API
2026-03-27 10:44:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-28T16:16:04Z',
 'fuel_type': 'hybrid',
 'id': 'e6ca2c54-5030-5f3a-8640-b78c7fd2f325',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY57679',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 68902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-17',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30e',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-27 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY57679%27 HTTP/1.1" 200 None
2026-03-27 10:44:40 [auto1.de] INFO: Saving data for FY57679: {'auction_closing_time': 1774714564.0, 'created_time': 1773775424.423979, 'last_price_update_time': 1774608280.455381}
2026-03-27 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY57679') HTTP/1.1" 204 0
2026-03-27 10:44:40 [auto1.de] INFO: Found listing with ID: PG24864
2026-03-27 10:44:40 [auto1.de] INFO: Found listing with ID: YD14218
2026-03-27 10:44:40 [auto1.de] INFO: Found listing with ID: JY20975
2026-03-27 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20975%27 HTTP/1.1" 200 None
2026-03-27 10:44:40 [auto1.de] INFO: Scrape type for JY20975: 2
2026-03-27 10:44:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b99ce715-5408-51fb-a5dc-b1e12bba4dd9 with identifier: JY20975
2026-03-27 10:44:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b99ce715-5408-51fb-a5dc-b1e12bba4dd9 with scrape type 2
2026-03-27 10:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b99ce715-5408-51fb-a5dc-b1e12bba4dd9 with scrape type 2
2026-03-27 10:44:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b99ce715-5408-51fb-a5dc-b1e12bba4dd9, identifier: JY20975
2026-03-27 10:44:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b99ce715-5408-51fb-a5dc-b1e12bba4dd9 with identifier: JY20975
2026-03-27 10:44:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b99ce715-5408-51fb-a5dc-b1e12bba4dd9 with identifier: JY20975
2026-03-27 10:44:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b99ce715-5408-51fb-a5dc-b1e12bba4dd9 with identifier: JY20975 to the API
2026-03-27 10:44:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:11:46Z',
 'fuel_type': 'petrol',
 'id': 'b99ce715-5408-51fb-a5dc-b1e12bba4dd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY20975',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 31538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-21',
 'seller_name': None,
 'title': 'Seat Tarraco 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2023}
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20975%27 HTTP/1.1" 200 None
2026-03-27 10:44:41 [auto1.de] INFO: Saving data for JY20975: {'auction_closing_time': 1774714306.0, 'created_time': 1774264193.656289, 'last_price_update_time': 1774608281.70417}
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY20975') HTTP/1.1" 204 0
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002c8c90>
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c325213c-98d7-5b02-b0dd-1fcc571aa207/c325213c-98d7-5b02-b0dd-1fcc571aa207_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F3b%252F383b91974caca5b2a78d21f118a302dc%252Fpa%252FVZ21746_e0ba3eae689401bce52327155d330afb.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_e0ba3eae689401bce52327155d330afb.jpg saved to cache
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c325213c-98d7-5b02-b0dd-1fcc571aa207
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003438d0>
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30986627-4795-5964-a386-2181452c2a6e/30986627-4795-5964-a386-2181452c2a6e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F5331d13314a0b54db64ac2f75f2df8ce%252Fpa%252FBY90710_c0f15395a837ae551696ccbc2a80c9a7.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_c0f15395a837ae551696ccbc2a80c9a7.jpg saved to cache
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30986627-4795-5964-a386-2181452c2a6e
2026-03-27 10:44:41 [auto1.de] INFO: Found listing with ID: YZ38333
2026-03-27 10:44:41 [auto1.de] INFO: Found listing with ID: SG17640
2026-03-27 10:44:41 [auto1.de] INFO: Found listing with ID: AZ42176
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ42176%27 HTTP/1.1" 200 None
2026-03-27 10:44:41 [auto1.de] INFO: Scrape type for AZ42176: 2
2026-03-27 10:44:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79eedd0f-420d-5877-a1ac-1dec1bd32d4c with identifier: AZ42176
2026-03-27 10:44:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79eedd0f-420d-5877-a1ac-1dec1bd32d4c with scrape type 2
2026-03-27 10:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79eedd0f-420d-5877-a1ac-1dec1bd32d4c with scrape type 2
2026-03-27 10:44:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79eedd0f-420d-5877-a1ac-1dec1bd32d4c, identifier: AZ42176
2026-03-27 10:44:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79eedd0f-420d-5877-a1ac-1dec1bd32d4c with identifier: AZ42176
2026-03-27 10:44:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79eedd0f-420d-5877-a1ac-1dec1bd32d4c with identifier: AZ42176
2026-03-27 10:44:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79eedd0f-420d-5877-a1ac-1dec1bd32d4c with identifier: AZ42176 to the API
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:51:22Z',
 'fuel_type': 'petrol',
 'id': '79eedd0f-420d-5877-a1ac-1dec1bd32d4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ42176',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 210584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-27',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ42176%27 HTTP/1.1" 200 None
2026-03-27 10:44:42 [auto1.de] INFO: Saving data for AZ42176: {'auction_closing_time': 1774716682.0, 'created_time': 1773135092.266863, 'last_price_update_time': 1774608282.305318}
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ42176') HTTP/1.1" 204 0
2026-03-27 10:44:42 [auto1.de] INFO: Found listing with ID: SL77379
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL77379%27 HTTP/1.1" 200 None
2026-03-27 10:44:42 [auto1.de] INFO: Scrape type for SL77379: 0
2026-03-27 10:44:42 [auto1.de] INFO: Found listing with ID: AB26225
2026-03-27 10:44:42 [auto1.de] INFO: Found listing with ID: GS33010
2026-03-27 10:44:42 [auto1.de] INFO: Found listing with ID: UH96912
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH96912%27 HTTP/1.1" 200 None
2026-03-27 10:44:42 [auto1.de] INFO: Scrape type for UH96912: 2
2026-03-27 10:44:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58218d58-2d0b-52a0-a29d-2a6dffef178a with identifier: UH96912
2026-03-27 10:44:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58218d58-2d0b-52a0-a29d-2a6dffef178a with scrape type 2
2026-03-27 10:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58218d58-2d0b-52a0-a29d-2a6dffef178a with scrape type 2
2026-03-27 10:44:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58218d58-2d0b-52a0-a29d-2a6dffef178a, identifier: UH96912
2026-03-27 10:44:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58218d58-2d0b-52a0-a29d-2a6dffef178a with identifier: UH96912
2026-03-27 10:44:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58218d58-2d0b-52a0-a29d-2a6dffef178a with identifier: UH96912
2026-03-27 10:44:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58218d58-2d0b-52a0-a29d-2a6dffef178a with identifier: UH96912 to the API
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 387,
 'expiration_date': '2026-03-28T16:54:33Z',
 'fuel_type': 'petrol',
 'id': '58218d58-2d0b-52a0-a29d-2a6dffef178a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH96912',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 164074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-07',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 500 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2009}
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH96912%27 HTTP/1.1" 200 None
2026-03-27 10:44:42 [auto1.de] INFO: Saving data for UH96912: {'auction_closing_time': 1774716873.0, 'created_time': 1773134152.576679, 'last_price_update_time': 1774608282.949574}
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH96912') HTTP/1.1" 204 0
2026-03-27 10:44:43 [auto1.de] INFO: Found listing with ID: TY20606
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY20606%27 HTTP/1.1" 200 None
2026-03-27 10:44:43 [auto1.de] INFO: Scrape type for TY20606: 2
2026-03-27 10:44:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c063c708-91ba-5810-9f8f-8005f1f4822d with identifier: TY20606
2026-03-27 10:44:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c063c708-91ba-5810-9f8f-8005f1f4822d with scrape type 2
2026-03-27 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c063c708-91ba-5810-9f8f-8005f1f4822d with scrape type 2
2026-03-27 10:44:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c063c708-91ba-5810-9f8f-8005f1f4822d, identifier: TY20606
2026-03-27 10:44:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c063c708-91ba-5810-9f8f-8005f1f4822d with identifier: TY20606
2026-03-27 10:44:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c063c708-91ba-5810-9f8f-8005f1f4822d with identifier: TY20606
2026-03-27 10:44:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c063c708-91ba-5810-9f8f-8005f1f4822d with identifier: TY20606 to the API
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:09:14Z',
 'fuel_type': 'petrol',
 'id': 'c063c708-91ba-5810-9f8f-8005f1f4822d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY20606',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 64971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-14',
 'seller_name': None,
 'title': 'Dacia Duster 1.3 TCe Journey',
 'transmission': 'automatic',
 'trim': 'Journey',
 'year': 2023}
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY20606%27 HTTP/1.1" 200 None
2026-03-27 10:44:43 [auto1.de] INFO: Saving data for TY20606: {'auction_closing_time': 1774714154.0, 'created_time': 1773383238.051134, 'last_price_update_time': 1774608283.515811}
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY20606') HTTP/1.1" 204 0
2026-03-27 10:44:43 [auto1.de] INFO: Found listing with ID: SE32009
2026-03-27 10:44:43 [auto1.de] INFO: Found listing with ID: LK17231
2026-03-27 10:44:43 [auto1.de] INFO: Found listing with ID: XJ52823
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ52823%27 HTTP/1.1" 200 None
2026-03-27 10:44:43 [auto1.de] INFO: Scrape type for XJ52823: 2
2026-03-27 10:44:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6bddd6e-1259-5bc5-ae10-973b2dccc634 with identifier: XJ52823
2026-03-27 10:44:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6bddd6e-1259-5bc5-ae10-973b2dccc634 with scrape type 2
2026-03-27 10:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6bddd6e-1259-5bc5-ae10-973b2dccc634 with scrape type 2
2026-03-27 10:44:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6bddd6e-1259-5bc5-ae10-973b2dccc634, identifier: XJ52823
2026-03-27 10:44:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6bddd6e-1259-5bc5-ae10-973b2dccc634 with identifier: XJ52823
2026-03-27 10:44:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6bddd6e-1259-5bc5-ae10-973b2dccc634 with identifier: XJ52823
2026-03-27 10:44:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6bddd6e-1259-5bc5-ae10-973b2dccc634 with identifier: XJ52823 to the API
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:49:51Z',
 'fuel_type': 'gas',
 'id': 'f6bddd6e-1259-5bc5-ae10-973b2dccc634',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ52823',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 128182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-14',
 'seller_name': None,
 'title': 'Opel Combo 1.6 Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2007}
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ52823%27 HTTP/1.1" 200 None
2026-03-27 10:44:44 [auto1.de] INFO: Saving data for XJ52823: {'auction_closing_time': 1774716591.0, 'created_time': 1773134420.851467, 'last_price_update_time': 1774608284.03097}
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ52823') HTTP/1.1" 204 0
2026-03-27 10:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK63697> (referer: https://www.auto1.com/v1/car-details-view/HK63697/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EU51889> (referer: https://www.auto1.com/v1/car-details-view/EU51889/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:44 [auto1.de] INFO: Found listing with ID: LN23623
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN23623%27 HTTP/1.1" 200 None
2026-03-27 10:44:44 [auto1.de] INFO: Scrape type for LN23623: 2
2026-03-27 10:44:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d4ae872-bb7e-5fde-9e5f-a8712e029fb7 with identifier: LN23623
2026-03-27 10:44:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d4ae872-bb7e-5fde-9e5f-a8712e029fb7 with scrape type 2
2026-03-27 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d4ae872-bb7e-5fde-9e5f-a8712e029fb7 with scrape type 2
2026-03-27 10:44:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d4ae872-bb7e-5fde-9e5f-a8712e029fb7, identifier: LN23623
2026-03-27 10:44:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HV64790/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d4ae872-bb7e-5fde-9e5f-a8712e029fb7 with identifier: LN23623
2026-03-27 10:44:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d4ae872-bb7e-5fde-9e5f-a8712e029fb7 with identifier: LN23623
2026-03-27 10:44:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d4ae872-bb7e-5fde-9e5f-a8712e029fb7 with identifier: LN23623 to the API
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:06:04Z',
 'fuel_type': 'hybrid',
 'id': '2d4ae872-bb7e-5fde-9e5f-a8712e029fb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN23623',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 76884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-03',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2022}
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN23623%27 HTTP/1.1" 200 None
2026-03-27 10:44:44 [auto1.de] INFO: Saving data for LN23623: {'auction_closing_time': 1774713964.0, 'created_time': 1773830406.814358, 'last_price_update_time': 1774608284.572251}
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN23623') HTTP/1.1" 204 0
2026-03-27 10:44:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:44 [auto1.de] INFO: Found listing with ID: RR41525
2026-03-27 10:44:44 [auto1.de] INFO: Found listing with ID: ZV40367
2026-03-27 10:44:44 [auto1.de] INFO: Found listing with ID: YJ71992
2026-03-27 10:44:44 [auto1.de] INFO: Found listing with ID: PZ40966
2026-03-27 10:44:44 [auto1.de] INFO: Found listing with ID: BT34315
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT34315%27 HTTP/1.1" 200 None
2026-03-27 10:44:44 [auto1.de] INFO: Scrape type for BT34315: 2
2026-03-27 10:44:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 462fad6c-41c2-5a87-85d1-9ed0f67efd97 with identifier: BT34315
2026-03-27 10:44:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 462fad6c-41c2-5a87-85d1-9ed0f67efd97 with scrape type 2
2026-03-27 10:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 462fad6c-41c2-5a87-85d1-9ed0f67efd97 with scrape type 2
2026-03-27 10:44:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 462fad6c-41c2-5a87-85d1-9ed0f67efd97, identifier: BT34315
2026-03-27 10:44:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 462fad6c-41c2-5a87-85d1-9ed0f67efd97 with identifier: BT34315
2026-03-27 10:44:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 462fad6c-41c2-5a87-85d1-9ed0f67efd97 with identifier: BT34315
2026-03-27 10:44:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 462fad6c-41c2-5a87-85d1-9ed0f67efd97 with identifier: BT34315 to the API
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:52:46Z',
 'fuel_type': 'petrol',
 'id': '462fad6c-41c2-5a87-85d1-9ed0f67efd97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT34315',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 108042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-19',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.2 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2011}
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT34315%27 HTTP/1.1" 200 None
2026-03-27 10:44:45 [auto1.de] INFO: Saving data for BT34315: {'auction_closing_time': 1774716766.0, 'created_time': 1773381990.593559, 'last_price_update_time': 1774608285.058907}
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT34315') HTTP/1.1" 204 0
2026-03-27 10:44:45 [auto1.de] INFO: Found listing with ID: GD49252
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD49252%27 HTTP/1.1" 200 None
2026-03-27 10:44:45 [auto1.de] INFO: Scrape type for GD49252: 2
2026-03-27 10:44:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f02bd64a-f1be-5e24-b147-9347c9d11809 with identifier: GD49252
2026-03-27 10:44:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f02bd64a-f1be-5e24-b147-9347c9d11809 with scrape type 2
2026-03-27 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f02bd64a-f1be-5e24-b147-9347c9d11809 with scrape type 2
2026-03-27 10:44:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f02bd64a-f1be-5e24-b147-9347c9d11809, identifier: GD49252
2026-03-27 10:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LS95970> (referer: https://www.auto1.com/v1/car-details-view/LS95970/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6f0a743-ec6e-5e13-8d60-b5021a1389c3 with identifier: HK63697
2026-03-27 10:44:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6f0a743-ec6e-5e13-8d60-b5021a1389c3 with scrape type 1
2026-03-27 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6f0a743-ec6e-5e13-8d60-b5021a1389c3
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F18%252F2d182716f91916da0f78a07e1b11ae0b%252Fpa%252FHK63697_2f210675a40c7fbb6ed599a6797ffc8a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_2f210675a40c7fbb6ed599a6797ffc8a.jpg not downloaded yet
2026-03-27 10:44:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60053297-7423-53c8-8613-9e1c2f5def8c with identifier: EU51889
2026-03-27 10:44:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60053297-7423-53c8-8613-9e1c2f5def8c with scrape type 1
2026-03-27 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 60053297-7423-53c8-8613-9e1c2f5def8c
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a76d3c7571ef4cd76d323d8366edf%252Fpa%252FEU51889_7005ad4b1088e34c5d79ada49d448dd8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_7005ad4b1088e34c5d79ada49d448dd8.jpg not downloaded yet
2026-03-27 10:44:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f02bd64a-f1be-5e24-b147-9347c9d11809 with identifier: GD49252
2026-03-27 10:44:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f02bd64a-f1be-5e24-b147-9347c9d11809 with identifier: GD49252
2026-03-27 10:44:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f02bd64a-f1be-5e24-b147-9347c9d11809 with identifier: GD49252 to the API
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:25:23Z',
 'fuel_type': 'petrol',
 'id': 'f02bd64a-f1be-5e24-b147-9347c9d11809',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD49252',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 48483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Skyactiv-G Mild-Hybrid Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2020}
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD49252%27 HTTP/1.1" 200 None
2026-03-27 10:44:45 [auto1.de] INFO: Saving data for GD49252: {'auction_closing_time': 1774715123.0, 'created_time': 1773861488.63502, 'last_price_update_time': 1774608285.597098}
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD49252') HTTP/1.1" 204 0
2026-03-27 10:44:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/33/d133584e32ab31311010e09990a94ca0/pa/DC30039_bd2e272f1ed12217ae9ef70873d9bb61.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:45 [auto1.de] INFO: Found listing with ID: CJ15757
2026-03-27 10:44:45 [auto1.de] INFO: Found listing with ID: ED19748
2026-03-27 10:44:45 [auto1.de] INFO: Found listing with ID: NE16717
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE16717%27 HTTP/1.1" 200 None
2026-03-27 10:44:45 [auto1.de] INFO: Scrape type for NE16717: 2
2026-03-27 10:44:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d41d975f-1838-590a-814e-db4f5df86271 with identifier: NE16717
2026-03-27 10:44:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d41d975f-1838-590a-814e-db4f5df86271 with scrape type 2
2026-03-27 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d41d975f-1838-590a-814e-db4f5df86271 with scrape type 2
2026-03-27 10:44:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d41d975f-1838-590a-814e-db4f5df86271, identifier: NE16717
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F18%252F2d182716f91916da0f78a07e1b11ae0b%252Fpa%252FHK63697_af93cd781f69b29242f1ad79dd504444.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_af93cd781f69b29242f1ad79dd504444.jpg not downloaded yet
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a76d3c7571ef4cd76d323d8366edf%252Fpa%252FEU51889_62531eca9d47271c775afdc877f661ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_62531eca9d47271c775afdc877f661ca.jpg not downloaded yet
2026-03-27 10:44:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d41d975f-1838-590a-814e-db4f5df86271 with identifier: NE16717
2026-03-27 10:44:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d41d975f-1838-590a-814e-db4f5df86271 with identifier: NE16717
2026-03-27 10:44:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d41d975f-1838-590a-814e-db4f5df86271 with identifier: NE16717 to the API
2026-03-27 10:44:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-28T16:38:40Z',
 'fuel_type': 'petrol',
 'id': 'd41d975f-1838-590a-814e-db4f5df86271',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE16717',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 149299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-09',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 350 CGI BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2013}
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE16717%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [auto1.de] INFO: Saving data for NE16717: {'auction_closing_time': 1774715920.0, 'created_time': 1773383449.392621, 'last_price_update_time': 1774608286.270332}
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE16717') HTTP/1.1" 204 0
2026-03-27 10:44:46 [auto1.de] INFO: Found listing with ID: MZ72792
2026-03-27 10:44:46 [auto1.de] INFO: Found listing with ID: WP48150
2026-03-27 10:44:46 [auto1.de] INFO: Found listing with ID: DH13363
2026-03-27 10:44:46 [auto1.de] INFO: Found listing with ID: JE71066
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE71066%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [auto1.de] INFO: Scrape type for JE71066: 2
2026-03-27 10:44:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94e624af-c21c-53bb-9b98-00e2082c8152 with identifier: JE71066
2026-03-27 10:44:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94e624af-c21c-53bb-9b98-00e2082c8152 with scrape type 2
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94e624af-c21c-53bb-9b98-00e2082c8152 with scrape type 2
2026-03-27 10:44:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94e624af-c21c-53bb-9b98-00e2082c8152, identifier: JE71066
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F18%252F2d182716f91916da0f78a07e1b11ae0b%252Fpa%252FHK63697_10154ad249a6bc466728c909643cb0a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_10154ad249a6bc466728c909643cb0a2.jpg not downloaded yet
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a76d3c7571ef4cd76d323d8366edf%252Fpa%252FEU51889_bf9f4e67ff27c067dbbfe4d97aedcab8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_bf9f4e67ff27c067dbbfe4d97aedcab8.jpg not downloaded yet
2026-03-27 10:44:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94e624af-c21c-53bb-9b98-00e2082c8152 with identifier: JE71066
2026-03-27 10:44:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94e624af-c21c-53bb-9b98-00e2082c8152 with identifier: JE71066
2026-03-27 10:44:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94e624af-c21c-53bb-9b98-00e2082c8152 with identifier: JE71066 to the API
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 215,
 'expiration_date': '2026-03-28T16:13:04Z',
 'fuel_type': 'diesel',
 'id': '94e624af-c21c-53bb-9b98-00e2082c8152',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE71066',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 199158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-17',
 'seller_name': None,
 'title': 'Volvo S60 2.4 D5 AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2011}
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE71066%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [auto1.de] INFO: Saving data for JE71066: {'auction_closing_time': 1774714384.0, 'created_time': 1774330542.272959, 'last_price_update_time': 1774608286.813353}
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE71066') HTTP/1.1" 204 0
2026-03-27 10:44:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a95b3bf0-d1d9-5693-a56a-2595fc3236ba with identifier: LS95970
2026-03-27 10:44:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a95b3bf0-d1d9-5693-a56a-2595fc3236ba with scrape type 1
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a95b3bf0-d1d9-5693-a56a-2595fc3236ba
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc2%252Fcfc26518daa80965ae167b2a80d5826d%252Fpa%252FLS95970_5fa21c041400434d415165b6a1e8da9d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c2/cfc26518daa80965ae167b2a80d5826d/pa/LS95970_5fa21c041400434d415165b6a1e8da9d.jpg not downloaded yet
2026-03-27 10:44:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50033a310>
2026-03-27 10:44:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb25c12a-97b7-5649-ac29-b32a9302172d/bb25c12a-97b7-5649-ac29-b32a9302172d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F33%252Fd133584e32ab31311010e09990a94ca0%252Fpa%252FDC30039_bd2e272f1ed12217ae9ef70873d9bb61.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/33/d133584e32ab31311010e09990a94ca0/pa/DC30039_bd2e272f1ed12217ae9ef70873d9bb61.jpg saved to cache
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb25c12a-97b7-5649-ac29-b32a9302172d
2026-03-27 10:44:46 [auto1.de] INFO: Found listing with ID: XP82440
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP82440%27 HTTP/1.1" 200 None
2026-03-27 10:44:46 [auto1.de] INFO: Scrape type for XP82440: 2
2026-03-27 10:44:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e7b782c-915a-5365-a586-e64e133b1eac with identifier: XP82440
2026-03-27 10:44:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e7b782c-915a-5365-a586-e64e133b1eac with scrape type 2
2026-03-27 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e7b782c-915a-5365-a586-e64e133b1eac with scrape type 2
2026-03-27 10:44:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e7b782c-915a-5365-a586-e64e133b1eac, identifier: XP82440
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F18%252F2d182716f91916da0f78a07e1b11ae0b%252Fpa%252FHK63697_29a827d98662628cada7d3067b0c2605.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_29a827d98662628cada7d3067b0c2605.jpg not downloaded yet
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a76d3c7571ef4cd76d323d8366edf%252Fpa%252FEU51889_42c2b97062909972731f95b722b8e567.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_42c2b97062909972731f95b722b8e567.jpg not downloaded yet
2026-03-27 10:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_7005ad4b1088e34c5d79ada49d448dd8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e7b782c-915a-5365-a586-e64e133b1eac with identifier: XP82440
2026-03-27 10:44:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e7b782c-915a-5365-a586-e64e133b1eac with identifier: XP82440
2026-03-27 10:44:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e7b782c-915a-5365-a586-e64e133b1eac with identifier: XP82440 to the API
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:55:13Z',
 'fuel_type': 'petrol',
 'id': '4e7b782c-915a-5365-a586-e64e133b1eac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP82440',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 73340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-19',
 'seller_name': None,
 'title': 'Cupra Formentor 1.5 TSI ACT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP82440%27 HTTP/1.1" 200 None
2026-03-27 10:44:52 [auto1.de] INFO: Saving data for XP82440: {'auction_closing_time': 1774716913.0, 'created_time': 1773138533.799474, 'last_price_update_time': 1774608292.364902}
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP82440') HTTP/1.1" 204 0
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc2%252Fcfc26518daa80965ae167b2a80d5826d%252Fpa%252FLS95970_18355f0e28a24df6573c086d91b3fd18.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c2/cfc26518daa80965ae167b2a80d5826d/pa/LS95970_18355f0e28a24df6573c086d91b3fd18.jpg not downloaded yet
2026-03-27 10:44:52 [auto1.de] INFO: Found listing with ID: RC50586
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC50586%27 HTTP/1.1" 200 None
2026-03-27 10:44:52 [auto1.de] INFO: Scrape type for RC50586: 2
2026-03-27 10:44:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 685be0a8-2cb0-510c-8e02-d2a2d364834b with identifier: RC50586
2026-03-27 10:44:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 685be0a8-2cb0-510c-8e02-d2a2d364834b with scrape type 2
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 685be0a8-2cb0-510c-8e02-d2a2d364834b with scrape type 2
2026-03-27 10:44:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 685be0a8-2cb0-510c-8e02-d2a2d364834b, identifier: RC50586
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F18%252F2d182716f91916da0f78a07e1b11ae0b%252Fpa%252FHK63697_45dd1ae95f0523c1c23d21be0e946496.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_45dd1ae95f0523c1c23d21be0e946496.jpg not downloaded yet
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a76d3c7571ef4cd76d323d8366edf%252Fpa%252FEU51889_086ce27e809a6f297b3fd30bcecd902e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_086ce27e809a6f297b3fd30bcecd902e.jpg not downloaded yet
2026-03-27 10:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PE37736/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 685be0a8-2cb0-510c-8e02-d2a2d364834b with identifier: RC50586
2026-03-27 10:44:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 685be0a8-2cb0-510c-8e02-d2a2d364834b with identifier: RC50586
2026-03-27 10:44:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 685be0a8-2cb0-510c-8e02-d2a2d364834b with identifier: RC50586 to the API
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:56:45Z',
 'fuel_type': 'petrol',
 'id': '685be0a8-2cb0-510c-8e02-d2a2d364834b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC50586',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 182998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-29',
 'seller_name': None,
 'title': 'Honda CR-V 2.0 VTEC Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2012}
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC50586%27 HTTP/1.1" 200 None
2026-03-27 10:44:52 [auto1.de] INFO: Saving data for RC50586: {'auction_closing_time': 1774717005.0, 'created_time': 1773772767.037647, 'last_price_update_time': 1774608292.904914}
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC50586') HTTP/1.1" 204 0
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc2%252Fcfc26518daa80965ae167b2a80d5826d%252Fpa%252FLS95970_2a91e90ea7b282ec43fb8a4ae1f8739a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c2/cfc26518daa80965ae167b2a80d5826d/pa/LS95970_2a91e90ea7b282ec43fb8a4ae1f8739a.jpg not downloaded yet
2026-03-27 10:44:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:52 [auto1.de] INFO: Found listing with ID: LN88860
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN88860%27 HTTP/1.1" 200 None
2026-03-27 10:44:52 [auto1.de] INFO: Scrape type for LN88860: 2
2026-03-27 10:44:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e0969dd-d8b2-56e7-ac64-2adf09551dd9 with identifier: LN88860
2026-03-27 10:44:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e0969dd-d8b2-56e7-ac64-2adf09551dd9 with scrape type 2
2026-03-27 10:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e0969dd-d8b2-56e7-ac64-2adf09551dd9 with scrape type 2
2026-03-27 10:44:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e0969dd-d8b2-56e7-ac64-2adf09551dd9, identifier: LN88860
2026-03-27 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F18%252F2d182716f91916da0f78a07e1b11ae0b%252Fpa%252FHK63697_4c0e55e7d4bd88772dc8c92809bcddab.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_4c0e55e7d4bd88772dc8c92809bcddab.jpg not downloaded yet
2026-03-27 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a76d3c7571ef4cd76d323d8366edf%252Fpa%252FEU51889_a0f7697133e012afcb9d88b800c0be9b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_a0f7697133e012afcb9d88b800c0be9b.jpg not downloaded yet
2026-03-27 10:44:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003389d0>
2026-03-27 10:44:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60053297-7423-53c8-8613-9e1c2f5def8c/60053297-7423-53c8-8613-9e1c2f5def8c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a76d3c7571ef4cd76d323d8366edf%252Fpa%252FEU51889_7005ad4b1088e34c5d79ada49d448dd8.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_7005ad4b1088e34c5d79ada49d448dd8.jpg saved to cache
2026-03-27 10:44:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60053297-7423-53c8-8613-9e1c2f5def8c
2026-03-27 10:44:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e0969dd-d8b2-56e7-ac64-2adf09551dd9 with identifier: LN88860
2026-03-27 10:44:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e0969dd-d8b2-56e7-ac64-2adf09551dd9 with identifier: LN88860
2026-03-27 10:44:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e0969dd-d8b2-56e7-ac64-2adf09551dd9 with identifier: LN88860 to the API
2026-03-27 10:44:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 354,
 'expiration_date': '2026-03-28T16:54:07Z',
 'fuel_type': 'petrol',
 'id': '9e0969dd-d8b2-56e7-ac64-2adf09551dd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN88860',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 129255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-15',
 'seller_name': None,
 'title': 'BMW X3 M40i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN88860%27 HTTP/1.1" 200 None
2026-03-27 10:44:54 [auto1.de] INFO: Saving data for LN88860: {'auction_closing_time': 1774716847.0, 'created_time': 1773303519.535343, 'last_price_update_time': 1774608294.204314}
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN88860') HTTP/1.1" 204 0
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc2%252Fcfc26518daa80965ae167b2a80d5826d%252Fpa%252FLS95970_a06f47a7d7580df03216f2d25361eca8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c2/cfc26518daa80965ae167b2a80d5826d/pa/LS95970_a06f47a7d7580df03216f2d25361eca8.jpg not downloaded yet
2026-03-27 10:44:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/c2/cfc26518daa80965ae167b2a80d5826d/pa/LS95970_5fa21c041400434d415165b6a1e8da9d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:54 [auto1.de] INFO: Found listing with ID: YE69852
2026-03-27 10:44:54 [auto1.de] INFO: Found listing with ID: UV35373
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV35373%27 HTTP/1.1" 200 None
2026-03-27 10:44:54 [auto1.de] INFO: Scrape type for UV35373: 2
2026-03-27 10:44:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9333e0f4-d27c-508e-a85f-d3fab7aadb9f with identifier: UV35373
2026-03-27 10:44:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9333e0f4-d27c-508e-a85f-d3fab7aadb9f with scrape type 2
2026-03-27 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9333e0f4-d27c-508e-a85f-d3fab7aadb9f with scrape type 2
2026-03-27 10:44:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9333e0f4-d27c-508e-a85f-d3fab7aadb9f, identifier: UV35373
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F18%252F2d182716f91916da0f78a07e1b11ae0b%252Fpa%252FHK63697_d5de922672811af0e3aabf05865951f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_d5de922672811af0e3aabf05865951f8.jpg not downloaded yet
2026-03-27 10:44:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9333e0f4-d27c-508e-a85f-d3fab7aadb9f with identifier: UV35373
2026-03-27 10:44:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9333e0f4-d27c-508e-a85f-d3fab7aadb9f with identifier: UV35373
2026-03-27 10:44:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9333e0f4-d27c-508e-a85f-d3fab7aadb9f with identifier: UV35373 to the API
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:01:07Z',
 'fuel_type': 'diesel',
 'id': '9333e0f4-d27c-508e-a85f-d3fab7aadb9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV35373',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 291851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-12',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2013}
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV35373%27 HTTP/1.1" 200 None
2026-03-27 10:44:54 [auto1.de] INFO: Saving data for UV35373: {'auction_closing_time': 1774713667.0, 'created_time': 1773689112.967782, 'last_price_update_time': 1774608294.845436}
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV35373') HTTP/1.1" 204 0
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc2%252Fcfc26518daa80965ae167b2a80d5826d%252Fpa%252FLS95970_9c6266d082dfb6383e5e701b74122be6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c2/cfc26518daa80965ae167b2a80d5826d/pa/LS95970_9c6266d082dfb6383e5e701b74122be6.jpg not downloaded yet
2026-03-27 10:44:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/c2/cfc26518daa80965ae167b2a80d5826d/pa/LS95970_18355f0e28a24df6573c086d91b3fd18.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:54 [auto1.de] INFO: Found listing with ID: KT10840
2026-03-27 10:44:54 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG66874%27 HTTP/1.1" 200 None
2026-03-27 10:44:54 [auto1.de] INFO: Scrape type for SG66874: 2
2026-03-27 10:44:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1de4729-38d0-5f1e-a0ac-82437315f359 with identifier: SG66874
2026-03-27 10:44:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1de4729-38d0-5f1e-a0ac-82437315f359 with scrape type 2
2026-03-27 10:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1de4729-38d0-5f1e-a0ac-82437315f359 with scrape type 2
2026-03-27 10:44:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1de4729-38d0-5f1e-a0ac-82437315f359, identifier: SG66874
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F18%252F2d182716f91916da0f78a07e1b11ae0b%252Fpa%252FHK63697_4261d27e760baaafbf36a03e4b823794.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_4261d27e760baaafbf36a03e4b823794.jpg not downloaded yet
2026-03-27 10:44:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1de4729-38d0-5f1e-a0ac-82437315f359 with identifier: SG66874
2026-03-27 10:44:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1de4729-38d0-5f1e-a0ac-82437315f359 with identifier: SG66874
2026-03-27 10:44:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1de4729-38d0-5f1e-a0ac-82437315f359 with identifier: SG66874 to the API
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:52:55Z',
 'fuel_type': 'petrol',
 'id': 'd1de4729-38d0-5f1e-a0ac-82437315f359',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG66874',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 109019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-09',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Champions Edition',
 'transmission': 'manual',
 'trim': 'Champions Edition',
 'year': 2012}
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG66874%27 HTTP/1.1" 200 None
2026-03-27 10:44:55 [auto1.de] INFO: Saving data for SG66874: {'auction_closing_time': 1774716775.0, 'created_time': 1773305322.502021, 'last_price_update_time': 1774608295.450993}
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG66874') HTTP/1.1" 204 0
2026-03-27 10:44:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50020c250>
2026-03-27 10:44:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a95b3bf0-d1d9-5693-a56a-2595fc3236ba/a95b3bf0-d1d9-5693-a56a-2595fc3236ba_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc2%252Fcfc26518daa80965ae167b2a80d5826d%252Fpa%252FLS95970_5fa21c041400434d415165b6a1e8da9d.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c2/cfc26518daa80965ae167b2a80d5826d/pa/LS95970_5fa21c041400434d415165b6a1e8da9d.jpg saved to cache
2026-03-27 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a95b3bf0-d1d9-5693-a56a-2595fc3236ba
2026-03-27 10:44:55 [auto1.de] INFO: Found listing with ID: SG62181
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG62181%27 HTTP/1.1" 200 None
2026-03-27 10:44:55 [auto1.de] INFO: Scrape type for SG62181: 2
2026-03-27 10:44:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef1db094-54cf-55ed-8018-cdbe6b68dc7f with identifier: SG62181
2026-03-27 10:44:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef1db094-54cf-55ed-8018-cdbe6b68dc7f with scrape type 2
2026-03-27 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef1db094-54cf-55ed-8018-cdbe6b68dc7f with scrape type 2
2026-03-27 10:44:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef1db094-54cf-55ed-8018-cdbe6b68dc7f, identifier: SG62181
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F18%252F2d182716f91916da0f78a07e1b11ae0b%252Fpa%252FHK63697_5f3e3d50eb27f221640d4f3f66983833.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_5f3e3d50eb27f221640d4f3f66983833.jpg not downloaded yet
2026-03-27 10:44:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG10221/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef1db094-54cf-55ed-8018-cdbe6b68dc7f with identifier: SG62181
2026-03-27 10:44:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef1db094-54cf-55ed-8018-cdbe6b68dc7f with identifier: SG62181
2026-03-27 10:44:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef1db094-54cf-55ed-8018-cdbe6b68dc7f with identifier: SG62181 to the API
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:53:11Z',
 'fuel_type': 'petrol',
 'id': 'ef1db094-54cf-55ed-8018-cdbe6b68dc7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG62181',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 157725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-16',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Business Edition BlueMotion',
 'transmission': 'automatic',
 'trim': 'Business Edition BlueMotion',
 'year': 2014}
2026-03-27 10:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG62181%27 HTTP/1.1" 200 None
2026-03-27 10:44:56 [auto1.de] INFO: Saving data for SG62181: {'auction_closing_time': 1774716791.0, 'created_time': 1774293913.418717, 'last_price_update_time': 1774608296.001779}
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG62181') HTTP/1.1" 204 0
2026-03-27 10:44:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JG50197> (referer: https://www.auto1.com/v1/car-details-view/JG50197/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001fe9d0>
2026-03-27 10:44:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a95b3bf0-d1d9-5693-a56a-2595fc3236ba/a95b3bf0-d1d9-5693-a56a-2595fc3236ba_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc2%252Fcfc26518daa80965ae167b2a80d5826d%252Fpa%252FLS95970_18355f0e28a24df6573c086d91b3fd18.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c2/cfc26518daa80965ae167b2a80d5826d/pa/LS95970_18355f0e28a24df6573c086d91b3fd18.jpg saved to cache
2026-03-27 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a95b3bf0-d1d9-5693-a56a-2595fc3236ba
2026-03-27 10:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_ac0d1f5b9cd314cfacea960f6aeba169.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_a0f7697133e012afcb9d88b800c0be9b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:56 [auto1.de] INFO: Found listing with ID: RE51747
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE51747%27 HTTP/1.1" 200 None
2026-03-27 10:44:56 [auto1.de] INFO: Scrape type for RE51747: 2
2026-03-27 10:44:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353 with identifier: RE51747
2026-03-27 10:44:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353 with scrape type 2
2026-03-27 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353 with scrape type 2
2026-03-27 10:44:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353, identifier: RE51747
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F18%252F2d182716f91916da0f78a07e1b11ae0b%252Fpa%252FHK63697_b4d82afe122fed50d7d7741eb26a3bea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_b4d82afe122fed50d7d7741eb26a3bea.jpg not downloaded yet
2026-03-27 10:44:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YW50252> (referer: https://www.auto1.com/v1/car-details-view/YW50252/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353 with identifier: RE51747
2026-03-27 10:44:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353 with identifier: RE51747
2026-03-27 10:44:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353 with identifier: RE51747 to the API
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:29:20Z',
 'fuel_type': 'petrol',
 'id': '81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE51747',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 183217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-28',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE51747%27 HTTP/1.1" 200 None
2026-03-27 10:44:56 [auto1.de] INFO: Saving data for RE51747: {'auction_closing_time': 1774715360.0, 'created_time': 1773812130.262438, 'last_price_update_time': 1774608296.59548}
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE51747') HTTP/1.1" 204 0
2026-03-27 10:44:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK36179/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:56 [auto1.de] INFO: Found listing with ID: LV47567
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV47567%27 HTTP/1.1" 200 None
2026-03-27 10:44:56 [auto1.de] INFO: Scrape type for LV47567: 2
2026-03-27 10:44:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9 with identifier: LV47567
2026-03-27 10:44:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9 with scrape type 2
2026-03-27 10:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9 with scrape type 2
2026-03-27 10:44:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9, identifier: LV47567
2026-03-27 10:44:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/c2/cfc26518daa80965ae167b2a80d5826d/pa/LS95970_9c6266d082dfb6383e5e701b74122be6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9 with identifier: LV47567
2026-03-27 10:44:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9 with identifier: LV47567
2026-03-27 10:44:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9 with identifier: LV47567 to the API
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:07:44Z',
 'fuel_type': 'petrol',
 'id': 'c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV47567',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SL-Klasse',
 'odometer': 111522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-01-03',
 'seller_name': None,
 'title': 'Mercedes-Benz SL-Klasse SL 350',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV47567%27 HTTP/1.1" 200 None
2026-03-27 10:44:57 [auto1.de] INFO: Saving data for LV47567: {'auction_closing_time': 1774714064.0, 'created_time': 1773136055.532977, 'last_price_update_time': 1774608297.086046}
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV47567') HTTP/1.1" 204 0
2026-03-27 10:44:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d1a52c8-32fb-52bb-baa1-45002def6da1 with identifier: JG50197
2026-03-27 10:44:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d1a52c8-32fb-52bb-baa1-45002def6da1 with scrape type 1
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d1a52c8-32fb-52bb-baa1-45002def6da1
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F83%252F9f831459c68d749bfa744f2d86f97f1e%252Fpa%252FJG50197_5c5927eb640354f3f5d8ba36eff1ea0c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_5c5927eb640354f3f5d8ba36eff1ea0c.jpg not downloaded yet
2026-03-27 10:44:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50160e150>
2026-03-27 10:44:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c218447f-2f05-5fb8-b352-abe4d5938aad/c218447f-2f05-5fb8-b352-abe4d5938aad_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7a%252F4d7a76cf71d17ec266e8856f3c6a5e25%252Fpa%252FKV84804_ac0d1f5b9cd314cfacea960f6aeba169.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_ac0d1f5b9cd314cfacea960f6aeba169.jpg saved to cache
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c218447f-2f05-5fb8-b352-abe4d5938aad
2026-03-27 10:44:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001bb390>
2026-03-27 10:44:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60053297-7423-53c8-8613-9e1c2f5def8c/60053297-7423-53c8-8613-9e1c2f5def8c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a76d3c7571ef4cd76d323d8366edf%252Fpa%252FEU51889_a0f7697133e012afcb9d88b800c0be9b.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_a0f7697133e012afcb9d88b800c0be9b.jpg saved to cache
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60053297-7423-53c8-8613-9e1c2f5def8c
2026-03-27 10:44:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_5f3e3d50eb27f221640d4f3f66983833.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_4261d27e760baaafbf36a03e4b823794.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15a7d61b-1ab2-568f-9f23-93f6df5e5c00 with identifier: YW50252
2026-03-27 10:44:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15a7d61b-1ab2-568f-9f23-93f6df5e5c00 with scrape type 1
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15a7d61b-1ab2-568f-9f23-93f6df5e5c00
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fbb%252Fe1bb03523ca517ec0db73ff6390b4b78%252Fpa%252FYW50252_811c16c0a395cee9c3647089374aa9ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_811c16c0a395cee9c3647089374aa9ed.jpg already downloaded
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fbb%252Fe1bb03523ca517ec0db73ff6390b4b78%252Fpa%252FYW50252_477c510f46a6511bc1547fa74eaa75db.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_477c510f46a6511bc1547fa74eaa75db.jpg already downloaded
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fbb%252Fe1bb03523ca517ec0db73ff6390b4b78%252Fpa%252FYW50252_9bdc603fc352ffaa9f20ba4bf419ff77.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_9bdc603fc352ffaa9f20ba4bf419ff77.jpg already downloaded
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fbb%252Fe1bb03523ca517ec0db73ff6390b4b78%252Fpa%252FYW50252_1c129527eae666fc4d7f86cebcaa3580.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_1c129527eae666fc4d7f86cebcaa3580.jpg already downloaded
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fbb%252Fe1bb03523ca517ec0db73ff6390b4b78%252Fpa%252FYW50252_f25c0e0dfda9b678038c49439e0ef850.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_f25c0e0dfda9b678038c49439e0ef850.jpg already downloaded
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fbb%252Fe1bb03523ca517ec0db73ff6390b4b78%252Fpa%252FYW50252_eb63bffabc7af40cb035471d8db3c7c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_eb63bffabc7af40cb035471d8db3c7c0.jpg already downloaded
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fbb%252Fe1bb03523ca517ec0db73ff6390b4b78%252Fpa%252FYW50252_bfcc445cee88b120c3b5d3311e33609b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_bfcc445cee88b120c3b5d3311e33609b.jpg already downloaded
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fbb%252Fe1bb03523ca517ec0db73ff6390b4b78%252Fpa%252FYW50252_03d1cd9581e8b8fcb1222b9535d39094.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_03d1cd9581e8b8fcb1222b9535d39094.jpg already downloaded
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fbb%252Fe1bb03523ca517ec0db73ff6390b4b78%252Fpa%252FYW50252_ac851c1843007c482f45f57736cc272b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_ac851c1843007c482f45f57736cc272b.jpg already downloaded
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fbb%252Fe1bb03523ca517ec0db73ff6390b4b78%252Fpa%252FYW50252_ff4c33d57bc343ca480da916f4921fef.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_ff4c33d57bc343ca480da916f4921fef.jpg already downloaded
2026-03-27 10:44:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15a7d61b-1ab2-568f-9f23-93f6df5e5c00, identifier: YW50252
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F83%252F9f831459c68d749bfa744f2d86f97f1e%252Fpa%252FJG50197_670e354ca5da8065a05f5d2079777b79.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_670e354ca5da8065a05f5d2079777b79.jpg not downloaded yet
2026-03-27 10:44:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15a7d61b-1ab2-568f-9f23-93f6df5e5c00 with identifier: YW50252
2026-03-27 10:44:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15a7d61b-1ab2-568f-9f23-93f6df5e5c00 with identifier: YW50252
2026-03-27 10:44:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15a7d61b-1ab2-568f-9f23-93f6df5e5c00 with identifier: YW50252 to the API
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YW50252>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:24:59Z',
 'fuel_type': 'petrol',
 'id': '15a7d61b-1ab2-568f-9f23-93f6df5e5c00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW50252',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 48367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_811c16c0a395cee9c3647089374aa9ed.jpg',
                'https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_477c510f46a6511bc1547fa74eaa75db.jpg',
                'https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_9bdc603fc352ffaa9f20ba4bf419ff77.jpg',
                'https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_1c129527eae666fc4d7f86cebcaa3580.jpg',
                'https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_f25c0e0dfda9b678038c49439e0ef850.jpg',
                'https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_eb63bffabc7af40cb035471d8db3c7c0.jpg',
                'https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_bfcc445cee88b120c3b5d3311e33609b.jpg',
                'https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_03d1cd9581e8b8fcb1222b9535d39094.jpg',
                'https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_ac851c1843007c482f45f57736cc272b.jpg',
                'https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_ff4c33d57bc343ca480da916f4921fef.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a7d61b-1ab2-568f-9f23-93f6df5e5c00/15a7d61b-1ab2-568f-9f23-93f6df5e5c00_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_811c16c0a395cee9c3647089374aa9ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a7d61b-1ab2-568f-9f23-93f6df5e5c00/15a7d61b-1ab2-568f-9f23-93f6df5e5c00_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_477c510f46a6511bc1547fa74eaa75db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a7d61b-1ab2-568f-9f23-93f6df5e5c00/15a7d61b-1ab2-568f-9f23-93f6df5e5c00_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_9bdc603fc352ffaa9f20ba4bf419ff77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a7d61b-1ab2-568f-9f23-93f6df5e5c00/15a7d61b-1ab2-568f-9f23-93f6df5e5c00_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_1c129527eae666fc4d7f86cebcaa3580.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a7d61b-1ab2-568f-9f23-93f6df5e5c00/15a7d61b-1ab2-568f-9f23-93f6df5e5c00_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_f25c0e0dfda9b678038c49439e0ef850.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a7d61b-1ab2-568f-9f23-93f6df5e5c00/15a7d61b-1ab2-568f-9f23-93f6df5e5c00_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_eb63bffabc7af40cb035471d8db3c7c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a7d61b-1ab2-568f-9f23-93f6df5e5c00/15a7d61b-1ab2-568f-9f23-93f6df5e5c00_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_bfcc445cee88b120c3b5d3311e33609b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a7d61b-1ab2-568f-9f23-93f6df5e5c00/15a7d61b-1ab2-568f-9f23-93f6df5e5c00_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_03d1cd9581e8b8fcb1222b9535d39094.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a7d61b-1ab2-568f-9f23-93f6df5e5c00/15a7d61b-1ab2-568f-9f23-93f6df5e5c00_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_ac851c1843007c482f45f57736cc272b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a7d61b-1ab2-568f-9f23-93f6df5e5c00/15a7d61b-1ab2-568f-9f23-93f6df5e5c00_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/bb/e1bb03523ca517ec0db73ff6390b4b78/pa/YW50252_ff4c33d57bc343ca480da916f4921fef.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2016}
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW50252%27 HTTP/1.1" 200 None
2026-03-27 10:44:58 [auto1.de] INFO: Saving data for YW50252: {'created_time': 1774608298.096831, 'last_price_update_time': 1774608298.096842, 'auction_closing_time': 1774715099.0}
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW50252') HTTP/1.1" 204 0
2026-03-27 10:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/c2/cfc26518daa80965ae167b2a80d5826d/pa/LS95970_a06f47a7d7580df03216f2d25361eca8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_d5de922672811af0e3aabf05865951f8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HV45616> (referer: https://www.auto1.com/v1/car-details-view/HV45616/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500494e50>
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a95b3bf0-d1d9-5693-a56a-2595fc3236ba/a95b3bf0-d1d9-5693-a56a-2595fc3236ba_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc2%252Fcfc26518daa80965ae167b2a80d5826d%252Fpa%252FLS95970_9c6266d082dfb6383e5e701b74122be6.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c2/cfc26518daa80965ae167b2a80d5826d/pa/LS95970_9c6266d082dfb6383e5e701b74122be6.jpg saved to cache
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a95b3bf0-d1d9-5693-a56a-2595fc3236ba
2026-03-27 10:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_b4d82afe122fed50d7d7741eb26a3bea.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F83%252F9f831459c68d749bfa744f2d86f97f1e%252Fpa%252FJG50197_59056d88fe89ad876bf36dfe027dae7d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_59056d88fe89ad876bf36dfe027dae7d.jpg not downloaded yet
2026-03-27 10:44:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb502613690>
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f0a743-ec6e-5e13-8d60-b5021a1389c3/d6f0a743-ec6e-5e13-8d60-b5021a1389c3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F18%252F2d182716f91916da0f78a07e1b11ae0b%252Fpa%252FHK63697_5f3e3d50eb27f221640d4f3f66983833.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_5f3e3d50eb27f221640d4f3f66983833.jpg saved to cache
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6f0a743-ec6e-5e13-8d60-b5021a1389c3
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500430490>
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f0a743-ec6e-5e13-8d60-b5021a1389c3/d6f0a743-ec6e-5e13-8d60-b5021a1389c3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F18%252F2d182716f91916da0f78a07e1b11ae0b%252Fpa%252FHK63697_4261d27e760baaafbf36a03e4b823794.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_4261d27e760baaafbf36a03e4b823794.jpg saved to cache
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6f0a743-ec6e-5e13-8d60-b5021a1389c3
2026-03-27 10:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_4c0e55e7d4bd88772dc8c92809bcddab.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/c2/cfc26518daa80965ae167b2a80d5826d/pa/LS95970_2a91e90ea7b282ec43fb8a4ae1f8739a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F83%252F9f831459c68d749bfa744f2d86f97f1e%252Fpa%252FJG50197_655cd315e80f11d76bc422c74c99f432.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_655cd315e80f11d76bc422c74c99f432.jpg not downloaded yet
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a8810>
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a95b3bf0-d1d9-5693-a56a-2595fc3236ba/a95b3bf0-d1d9-5693-a56a-2595fc3236ba_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc2%252Fcfc26518daa80965ae167b2a80d5826d%252Fpa%252FLS95970_a06f47a7d7580df03216f2d25361eca8.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c2/cfc26518daa80965ae167b2a80d5826d/pa/LS95970_a06f47a7d7580df03216f2d25361eca8.jpg saved to cache
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a95b3bf0-d1d9-5693-a56a-2595fc3236ba
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500494450>
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f0a743-ec6e-5e13-8d60-b5021a1389c3/d6f0a743-ec6e-5e13-8d60-b5021a1389c3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F18%252F2d182716f91916da0f78a07e1b11ae0b%252Fpa%252FHK63697_d5de922672811af0e3aabf05865951f8.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_d5de922672811af0e3aabf05865951f8.jpg saved to cache
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6f0a743-ec6e-5e13-8d60-b5021a1389c3
2026-03-27 10:44:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db2540f8-6be7-52b5-8977-7c8213769550 with identifier: HV45616
2026-03-27 10:44:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db2540f8-6be7-52b5-8977-7c8213769550 with scrape type 1
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item db2540f8-6be7-52b5-8977-7c8213769550
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fdb%252Fa0dbb77858d2c788cae5b2edaf6f2a10%252Fpa%252FHV45616_853463b70f128ed120f07aba441af416.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_853463b70f128ed120f07aba441af416.jpg not downloaded yet
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002211d0>
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f0a743-ec6e-5e13-8d60-b5021a1389c3/d6f0a743-ec6e-5e13-8d60-b5021a1389c3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F18%252F2d182716f91916da0f78a07e1b11ae0b%252Fpa%252FHK63697_b4d82afe122fed50d7d7741eb26a3bea.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_b4d82afe122fed50d7d7741eb26a3bea.jpg saved to cache
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6f0a743-ec6e-5e13-8d60-b5021a1389c3
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F83%252F9f831459c68d749bfa744f2d86f97f1e%252Fpa%252FJG50197_ad886a5b5228fa5f3322432144179f47.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_ad886a5b5228fa5f3322432144179f47.jpg not downloaded yet
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fdb%252Fa0dbb77858d2c788cae5b2edaf6f2a10%252Fpa%252FHV45616_ec243d9af8f24f283afd71d38e8b5ae6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_ec243d9af8f24f283afd71d38e8b5ae6.jpg not downloaded yet
2026-03-27 10:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_670e354ca5da8065a05f5d2079777b79.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F83%252F9f831459c68d749bfa744f2d86f97f1e%252Fpa%252FJG50197_1a0a5190ed8e2854e1b56a84d0e24a32.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_1a0a5190ed8e2854e1b56a84d0e24a32.jpg not downloaded yet
2026-03-27 10:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_5c5927eb640354f3f5d8ba36eff1ea0c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fdb%252Fa0dbb77858d2c788cae5b2edaf6f2a10%252Fpa%252FHV45616_a9e10a938961f10edb6409fb6c148d4a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_a9e10a938961f10edb6409fb6c148d4a.jpg not downloaded yet
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500322550>
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f0a743-ec6e-5e13-8d60-b5021a1389c3/d6f0a743-ec6e-5e13-8d60-b5021a1389c3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F18%252F2d182716f91916da0f78a07e1b11ae0b%252Fpa%252FHK63697_4c0e55e7d4bd88772dc8c92809bcddab.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_4c0e55e7d4bd88772dc8c92809bcddab.jpg saved to cache
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6f0a743-ec6e-5e13-8d60-b5021a1389c3
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002062d0>
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a95b3bf0-d1d9-5693-a56a-2595fc3236ba/a95b3bf0-d1d9-5693-a56a-2595fc3236ba_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc2%252Fcfc26518daa80965ae167b2a80d5826d%252Fpa%252FLS95970_2a91e90ea7b282ec43fb8a4ae1f8739a.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c2/cfc26518daa80965ae167b2a80d5826d/pa/LS95970_2a91e90ea7b282ec43fb8a4ae1f8739a.jpg saved to cache
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a95b3bf0-d1d9-5693-a56a-2595fc3236ba
2026-03-27 10:44:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a95b3bf0-d1d9-5693-a56a-2595fc3236ba, skipping ID generation
2026-03-27 10:44:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a95b3bf0-d1d9-5693-a56a-2595fc3236ba with scrape type 1
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a95b3bf0-d1d9-5693-a56a-2595fc3236ba sending to next pipeline
2026-03-27 10:44:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a95b3bf0-d1d9-5693-a56a-2595fc3236ba, identifier: LS95970
2026-03-27 10:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_59056d88fe89ad876bf36dfe027dae7d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F83%252F9f831459c68d749bfa744f2d86f97f1e%252Fpa%252FJG50197_029951c3c71f8435ff263b0ffb6b75ec.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_029951c3c71f8435ff263b0ffb6b75ec.jpg not downloaded yet
2026-03-27 10:44:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a95b3bf0-d1d9-5693-a56a-2595fc3236ba with identifier: LS95970
2026-03-27 10:44:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a95b3bf0-d1d9-5693-a56a-2595fc3236ba with identifier: LS95970
2026-03-27 10:44:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a95b3bf0-d1d9-5693-a56a-2595fc3236ba with identifier: LS95970 to the API
2026-03-27 10:44:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:44:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/c2/cfc26518daa80965ae167b2a80d5826d/pa/LS95970_2a91e90ea7b282ec43fb8a4ae1f8739a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 237,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 3',
 'engine': '2.1L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:58:36Z',
 'fuel_type': 'diesel',
 'id': 'a95b3bf0-d1d9-5693-a56a-2595fc3236ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS95970',
 'listing': 'auction',
 'location': 'DE, Mainz',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 251863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a95b3bf0-d1d9-5693-a56a-2595fc3236ba/a95b3bf0-d1d9-5693-a56a-2595fc3236ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c2/cfc26518daa80965ae167b2a80d5826d/pa/LS95970_5fa21c041400434d415165b6a1e8da9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a95b3bf0-d1d9-5693-a56a-2595fc3236ba/a95b3bf0-d1d9-5693-a56a-2595fc3236ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c2/cfc26518daa80965ae167b2a80d5826d/pa/LS95970_18355f0e28a24df6573c086d91b3fd18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a95b3bf0-d1d9-5693-a56a-2595fc3236ba/a95b3bf0-d1d9-5693-a56a-2595fc3236ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c2/cfc26518daa80965ae167b2a80d5826d/pa/LS95970_2a91e90ea7b282ec43fb8a4ae1f8739a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a95b3bf0-d1d9-5693-a56a-2595fc3236ba/a95b3bf0-d1d9-5693-a56a-2595fc3236ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c2/cfc26518daa80965ae167b2a80d5826d/pa/LS95970_a06f47a7d7580df03216f2d25361eca8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a95b3bf0-d1d9-5693-a56a-2595fc3236ba/a95b3bf0-d1d9-5693-a56a-2595fc3236ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c2/cfc26518daa80965ae167b2a80d5826d/pa/LS95970_9c6266d082dfb6383e5e701b74122be6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-05-29',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 115 CDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2005}
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS95970%27 HTTP/1.1" 200 None
2026-03-27 10:44:59 [auto1.de] INFO: Saving data for LS95970: {'created_time': 1774608299.152545, 'last_price_update_time': 1774608299.152558, 'auction_closing_time': 1774717116.0}
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS95970') HTTP/1.1" 204 0
2026-03-27 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_2e37570cd8331dc8459d977687a9f1ba.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fdb%252Fa0dbb77858d2c788cae5b2edaf6f2a10%252Fpa%252FHV45616_7d73454084523692c42183c3d2f12c5b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_7d73454084523692c42183c3d2f12c5b.jpg not downloaded yet
2026-03-27 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_086ce27e809a6f297b3fd30bcecd902e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_ad886a5b5228fa5f3322432144179f47.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_45dd1ae95f0523c1c23d21be0e946496.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F83%252F9f831459c68d749bfa744f2d86f97f1e%252Fpa%252FJG50197_29f0b407d28ef03924ae86a98a0726b9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_29f0b407d28ef03924ae86a98a0726b9.jpg not downloaded yet
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50373f090>
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1a52c8-32fb-52bb-baa1-45002def6da1/8d1a52c8-32fb-52bb-baa1-45002def6da1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F83%252F9f831459c68d749bfa744f2d86f97f1e%252Fpa%252FJG50197_670e354ca5da8065a05f5d2079777b79.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_670e354ca5da8065a05f5d2079777b79.jpg saved to cache
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d1a52c8-32fb-52bb-baa1-45002def6da1
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001ca910>
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1a52c8-32fb-52bb-baa1-45002def6da1/8d1a52c8-32fb-52bb-baa1-45002def6da1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F83%252F9f831459c68d749bfa744f2d86f97f1e%252Fpa%252FJG50197_5c5927eb640354f3f5d8ba36eff1ea0c.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_5c5927eb640354f3f5d8ba36eff1ea0c.jpg saved to cache
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d1a52c8-32fb-52bb-baa1-45002def6da1
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fdb%252Fa0dbb77858d2c788cae5b2edaf6f2a10%252Fpa%252FHV45616_84eaf60e4852a51a1086c9af09c6e416.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_84eaf60e4852a51a1086c9af09c6e416.jpg not downloaded yet
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503f38910>
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1a52c8-32fb-52bb-baa1-45002def6da1/8d1a52c8-32fb-52bb-baa1-45002def6da1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F83%252F9f831459c68d749bfa744f2d86f97f1e%252Fpa%252FJG50197_59056d88fe89ad876bf36dfe027dae7d.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_59056d88fe89ad876bf36dfe027dae7d.jpg saved to cache
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d1a52c8-32fb-52bb-baa1-45002def6da1
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F83%252F9f831459c68d749bfa744f2d86f97f1e%252Fpa%252FJG50197_e4827ae7d80fae9b878219e1a75fc405.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_e4827ae7d80fae9b878219e1a75fc405.jpg not downloaded yet
2026-03-27 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_45176928420d21403a2dea48e2aadebb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fdb%252Fa0dbb77858d2c788cae5b2edaf6f2a10%252Fpa%252FHV45616_f9e0c476e10dbb4f85c82e6320f9de8b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_f9e0c476e10dbb4f85c82e6320f9de8b.jpg not downloaded yet
2026-03-27 10:44:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500589250>
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30986627-4795-5964-a386-2181452c2a6e/30986627-4795-5964-a386-2181452c2a6e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F5331d13314a0b54db64ac2f75f2df8ce%252Fpa%252FBY90710_2e37570cd8331dc8459d977687a9f1ba.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_2e37570cd8331dc8459d977687a9f1ba.jpg saved to cache
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30986627-4795-5964-a386-2181452c2a6e
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501699290>
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60053297-7423-53c8-8613-9e1c2f5def8c/60053297-7423-53c8-8613-9e1c2f5def8c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a76d3c7571ef4cd76d323d8366edf%252Fpa%252FEU51889_086ce27e809a6f297b3fd30bcecd902e.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_086ce27e809a6f297b3fd30bcecd902e.jpg saved to cache
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60053297-7423-53c8-8613-9e1c2f5def8c
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015e1b50>
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1a52c8-32fb-52bb-baa1-45002def6da1/8d1a52c8-32fb-52bb-baa1-45002def6da1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F83%252F9f831459c68d749bfa744f2d86f97f1e%252Fpa%252FJG50197_ad886a5b5228fa5f3322432144179f47.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_ad886a5b5228fa5f3322432144179f47.jpg saved to cache
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d1a52c8-32fb-52bb-baa1-45002def6da1
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50196b7d0>
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f0a743-ec6e-5e13-8d60-b5021a1389c3/d6f0a743-ec6e-5e13-8d60-b5021a1389c3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F18%252F2d182716f91916da0f78a07e1b11ae0b%252Fpa%252FHK63697_45dd1ae95f0523c1c23d21be0e946496.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_45dd1ae95f0523c1c23d21be0e946496.jpg saved to cache
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6f0a743-ec6e-5e13-8d60-b5021a1389c3
2026-03-27 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_ec243d9af8f24f283afd71d38e8b5ae6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F83%252F9f831459c68d749bfa744f2d86f97f1e%252Fpa%252FJG50197_3fe8b1f8dcd31618e5c8c938cb730409.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_3fe8b1f8dcd31618e5c8c938cb730409.jpg not downloaded yet
2026-03-27 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_655cd315e80f11d76bc422c74c99f432.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_1a0a5190ed8e2854e1b56a84d0e24a32.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_853463b70f128ed120f07aba441af416.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_029951c3c71f8435ff263b0ffb6b75ec.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_a9e10a938961f10edb6409fb6c148d4a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS36559> (referer: https://www.auto1.com/v1/car-details-view/TS36559/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:44:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50196a890>
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c218447f-2f05-5fb8-b352-abe4d5938aad/c218447f-2f05-5fb8-b352-abe4d5938aad_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7a%252F4d7a76cf71d17ec266e8856f3c6a5e25%252Fpa%252FKV84804_45176928420d21403a2dea48e2aadebb.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_45176928420d21403a2dea48e2aadebb.jpg saved to cache
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c218447f-2f05-5fb8-b352-abe4d5938aad
2026-03-27 10:44:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002fe590>
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2540f8-6be7-52b5-8977-7c8213769550/db2540f8-6be7-52b5-8977-7c8213769550_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fdb%252Fa0dbb77858d2c788cae5b2edaf6f2a10%252Fpa%252FHV45616_ec243d9af8f24f283afd71d38e8b5ae6.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_ec243d9af8f24f283afd71d38e8b5ae6.jpg saved to cache
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db2540f8-6be7-52b5-8977-7c8213769550
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500451750>
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1a52c8-32fb-52bb-baa1-45002def6da1/8d1a52c8-32fb-52bb-baa1-45002def6da1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F83%252F9f831459c68d749bfa744f2d86f97f1e%252Fpa%252FJG50197_655cd315e80f11d76bc422c74c99f432.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_655cd315e80f11d76bc422c74c99f432.jpg saved to cache
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d1a52c8-32fb-52bb-baa1-45002def6da1
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001ec490>
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1a52c8-32fb-52bb-baa1-45002def6da1/8d1a52c8-32fb-52bb-baa1-45002def6da1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F83%252F9f831459c68d749bfa744f2d86f97f1e%252Fpa%252FJG50197_1a0a5190ed8e2854e1b56a84d0e24a32.jpg') HTTP/1.1" 204 0
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_1a0a5190ed8e2854e1b56a84d0e24a32.jpg saved to cache
2026-03-27 10:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d1a52c8-32fb-52bb-baa1-45002def6da1
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001ef910>
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:44:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:44:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2540f8-6be7-52b5-8977-7c8213769550/db2540f8-6be7-52b5-8977-7c8213769550_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fdb%252Fa0dbb77858d2c788cae5b2edaf6f2a10%252Fpa%252FHV45616_853463b70f128ed120f07aba441af416.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_853463b70f128ed120f07aba441af416.jpg saved to cache
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db2540f8-6be7-52b5-8977-7c8213769550
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501695250>
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1a52c8-32fb-52bb-baa1-45002def6da1/8d1a52c8-32fb-52bb-baa1-45002def6da1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F83%252F9f831459c68d749bfa744f2d86f97f1e%252Fpa%252FJG50197_029951c3c71f8435ff263b0ffb6b75ec.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_029951c3c71f8435ff263b0ffb6b75ec.jpg saved to cache
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d1a52c8-32fb-52bb-baa1-45002def6da1
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001fc590>
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2540f8-6be7-52b5-8977-7c8213769550/db2540f8-6be7-52b5-8977-7c8213769550_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fdb%252Fa0dbb77858d2c788cae5b2edaf6f2a10%252Fpa%252FHV45616_a9e10a938961f10edb6409fb6c148d4a.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_a9e10a938961f10edb6409fb6c148d4a.jpg saved to cache
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db2540f8-6be7-52b5-8977-7c8213769550
2026-03-27 10:45:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30687c1f-da00-51ca-a284-0ac97a3dd676 with identifier: TS36559
2026-03-27 10:45:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30687c1f-da00-51ca-a284-0ac97a3dd676 with scrape type 1
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30687c1f-da00-51ca-a284-0ac97a3dd676
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F0e%252F3b0e246767da4493a6dc2828be266e29%252Fpa%252FTS36559_cb8f0ebd3a46b2db1712ee7e6c25b52f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_cb8f0ebd3a46b2db1712ee7e6c25b52f.jpg not downloaded yet
2026-03-27 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_f9e0c476e10dbb4f85c82e6320f9de8b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_e4827ae7d80fae9b878219e1a75fc405.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_3fe8b1f8dcd31618e5c8c938cb730409.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F0e%252F3b0e246767da4493a6dc2828be266e29%252Fpa%252FTS36559_da457de13a47d5f4c498c9ba55e353d3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_da457de13a47d5f4c498c9ba55e353d3.jpg not downloaded yet
2026-03-27 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_29a827d98662628cada7d3067b0c2605.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_29f0b407d28ef03924ae86a98a0726b9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_42c2b97062909972731f95b722b8e567.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_7d73454084523692c42183c3d2f12c5b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_84eaf60e4852a51a1086c9af09c6e416.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F0e%252F3b0e246767da4493a6dc2828be266e29%252Fpa%252FTS36559_d0610d74dfea50bcfc64b56dd9d06a35.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_d0610d74dfea50bcfc64b56dd9d06a35.jpg not downloaded yet
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F0e%252F3b0e246767da4493a6dc2828be266e29%252Fpa%252FTS36559_b5a4cefb4e0f0965bf716b092cb9e0ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_b5a4cefb4e0f0965bf716b092cb9e0ed.jpg not downloaded yet
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F0e%252F3b0e246767da4493a6dc2828be266e29%252Fpa%252FTS36559_736b828ac41914f21f2c319bc9aca26e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_736b828ac41914f21f2c319bc9aca26e.jpg not downloaded yet
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F0e%252F3b0e246767da4493a6dc2828be266e29%252Fpa%252FTS36559_68321f11da02876286e4c107e3cbde97.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_68321f11da02876286e4c107e3cbde97.jpg not downloaded yet
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F0e%252F3b0e246767da4493a6dc2828be266e29%252Fpa%252FTS36559_3b17f5fac6390a1777e987403bc28ead.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_3b17f5fac6390a1777e987403bc28ead.jpg not downloaded yet
2026-03-27 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_2f210675a40c7fbb6ed599a6797ffc8a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_87dac738be14526db7562e9680f4b4b5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F0e%252F3b0e246767da4493a6dc2828be266e29%252Fpa%252FTS36559_689fd8a9bb161ed01526c9c9bf929aad.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_689fd8a9bb161ed01526c9c9bf929aad.jpg not downloaded yet
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a0d10>
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2540f8-6be7-52b5-8977-7c8213769550/db2540f8-6be7-52b5-8977-7c8213769550_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fdb%252Fa0dbb77858d2c788cae5b2edaf6f2a10%252Fpa%252FHV45616_f9e0c476e10dbb4f85c82e6320f9de8b.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_f9e0c476e10dbb4f85c82e6320f9de8b.jpg saved to cache
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db2540f8-6be7-52b5-8977-7c8213769550
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50058bad0>
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1a52c8-32fb-52bb-baa1-45002def6da1/8d1a52c8-32fb-52bb-baa1-45002def6da1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F83%252F9f831459c68d749bfa744f2d86f97f1e%252Fpa%252FJG50197_e4827ae7d80fae9b878219e1a75fc405.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_e4827ae7d80fae9b878219e1a75fc405.jpg saved to cache
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d1a52c8-32fb-52bb-baa1-45002def6da1
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016a8450>
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1a52c8-32fb-52bb-baa1-45002def6da1/8d1a52c8-32fb-52bb-baa1-45002def6da1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F83%252F9f831459c68d749bfa744f2d86f97f1e%252Fpa%252FJG50197_3fe8b1f8dcd31618e5c8c938cb730409.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_3fe8b1f8dcd31618e5c8c938cb730409.jpg saved to cache
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d1a52c8-32fb-52bb-baa1-45002def6da1
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F0e%252F3b0e246767da4493a6dc2828be266e29%252Fpa%252FTS36559_1fe66fe7ea8e2573bace28efb866aeca.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_1fe66fe7ea8e2573bace28efb866aeca.jpg not downloaded yet
2026-03-27 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_10154ad249a6bc466728c909643cb0a2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_62531eca9d47271c775afdc877f661ca.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_bf9f4e67ff27c067dbbfe4d97aedcab8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_af93cd781f69b29242f1ad79dd504444.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F0e%252F3b0e246767da4493a6dc2828be266e29%252Fpa%252FTS36559_6019b936ccbd59f76bf8f9c97a799f60.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_6019b936ccbd59f76bf8f9c97a799f60.jpg not downloaded yet
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001e6ed0>
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f0a743-ec6e-5e13-8d60-b5021a1389c3/d6f0a743-ec6e-5e13-8d60-b5021a1389c3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F18%252F2d182716f91916da0f78a07e1b11ae0b%252Fpa%252FHK63697_29a827d98662628cada7d3067b0c2605.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_29a827d98662628cada7d3067b0c2605.jpg saved to cache
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6f0a743-ec6e-5e13-8d60-b5021a1389c3
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a3a10>
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d1a52c8-32fb-52bb-baa1-45002def6da1/8d1a52c8-32fb-52bb-baa1-45002def6da1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F83%252F9f831459c68d749bfa744f2d86f97f1e%252Fpa%252FJG50197_29f0b407d28ef03924ae86a98a0726b9.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_29f0b407d28ef03924ae86a98a0726b9.jpg saved to cache
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d1a52c8-32fb-52bb-baa1-45002def6da1
2026-03-27 10:45:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d1a52c8-32fb-52bb-baa1-45002def6da1, skipping ID generation
2026-03-27 10:45:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d1a52c8-32fb-52bb-baa1-45002def6da1 with scrape type 1
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d1a52c8-32fb-52bb-baa1-45002def6da1 sending to next pipeline
2026-03-27 10:45:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d1a52c8-32fb-52bb-baa1-45002def6da1, identifier: JG50197
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500384390>
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60053297-7423-53c8-8613-9e1c2f5def8c/60053297-7423-53c8-8613-9e1c2f5def8c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a76d3c7571ef4cd76d323d8366edf%252Fpa%252FEU51889_42c2b97062909972731f95b722b8e567.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_42c2b97062909972731f95b722b8e567.jpg saved to cache
2026-03-27 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60053297-7423-53c8-8613-9e1c2f5def8c
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501844250>
2026-03-27 10:45:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2540f8-6be7-52b5-8977-7c8213769550/db2540f8-6be7-52b5-8977-7c8213769550_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fdb%252Fa0dbb77858d2c788cae5b2edaf6f2a10%252Fpa%252FHV45616_7d73454084523692c42183c3d2f12c5b.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_7d73454084523692c42183c3d2f12c5b.jpg saved to cache
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db2540f8-6be7-52b5-8977-7c8213769550
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a10d0>
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2540f8-6be7-52b5-8977-7c8213769550/db2540f8-6be7-52b5-8977-7c8213769550_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fdb%252Fa0dbb77858d2c788cae5b2edaf6f2a10%252Fpa%252FHV45616_84eaf60e4852a51a1086c9af09c6e416.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_84eaf60e4852a51a1086c9af09c6e416.jpg saved to cache
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db2540f8-6be7-52b5-8977-7c8213769550
2026-03-27 10:45:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db2540f8-6be7-52b5-8977-7c8213769550, skipping ID generation
2026-03-27 10:45:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db2540f8-6be7-52b5-8977-7c8213769550 with scrape type 1
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db2540f8-6be7-52b5-8977-7c8213769550 sending to next pipeline
2026-03-27 10:45:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db2540f8-6be7-52b5-8977-7c8213769550, identifier: HV45616
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004dc6d0>
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f0a743-ec6e-5e13-8d60-b5021a1389c3/d6f0a743-ec6e-5e13-8d60-b5021a1389c3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F18%252F2d182716f91916da0f78a07e1b11ae0b%252Fpa%252FHK63697_2f210675a40c7fbb6ed599a6797ffc8a.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_2f210675a40c7fbb6ed599a6797ffc8a.jpg saved to cache
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6f0a743-ec6e-5e13-8d60-b5021a1389c3
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018468d0>
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8049887e-e6ec-5ec0-b934-32ee67f4586a/8049887e-e6ec-5ec0-b934-32ee67f4586a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F95%252F3e95111e6d12aed932064814fedf789b%252Fpa%252FJM16548_87dac738be14526db7562e9680f4b4b5.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_87dac738be14526db7562e9680f4b4b5.jpg saved to cache
2026-03-27 10:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8049887e-e6ec-5ec0-b934-32ee67f4586a
2026-03-27 10:45:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d1a52c8-32fb-52bb-baa1-45002def6da1 with identifier: JG50197
2026-03-27 10:45:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d1a52c8-32fb-52bb-baa1-45002def6da1 with identifier: JG50197
2026-03-27 10:45:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d1a52c8-32fb-52bb-baa1-45002def6da1 with identifier: JG50197 to the API
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_29f0b407d28ef03924ae86a98a0726b9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:29:18Z',
 'fuel_type': 'petrol',
 'id': '8d1a52c8-32fb-52bb-baa1-45002def6da1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG50197',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 205500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1a52c8-32fb-52bb-baa1-45002def6da1/8d1a52c8-32fb-52bb-baa1-45002def6da1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_5c5927eb640354f3f5d8ba36eff1ea0c.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1a52c8-32fb-52bb-baa1-45002def6da1/8d1a52c8-32fb-52bb-baa1-45002def6da1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_670e354ca5da8065a05f5d2079777b79.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1a52c8-32fb-52bb-baa1-45002def6da1/8d1a52c8-32fb-52bb-baa1-45002def6da1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_59056d88fe89ad876bf36dfe027dae7d.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1a52c8-32fb-52bb-baa1-45002def6da1/8d1a52c8-32fb-52bb-baa1-45002def6da1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_655cd315e80f11d76bc422c74c99f432.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1a52c8-32fb-52bb-baa1-45002def6da1/8d1a52c8-32fb-52bb-baa1-45002def6da1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_ad886a5b5228fa5f3322432144179f47.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1a52c8-32fb-52bb-baa1-45002def6da1/8d1a52c8-32fb-52bb-baa1-45002def6da1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_1a0a5190ed8e2854e1b56a84d0e24a32.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1a52c8-32fb-52bb-baa1-45002def6da1/8d1a52c8-32fb-52bb-baa1-45002def6da1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_029951c3c71f8435ff263b0ffb6b75ec.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1a52c8-32fb-52bb-baa1-45002def6da1/8d1a52c8-32fb-52bb-baa1-45002def6da1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_29f0b407d28ef03924ae86a98a0726b9.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1a52c8-32fb-52bb-baa1-45002def6da1/8d1a52c8-32fb-52bb-baa1-45002def6da1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_e4827ae7d80fae9b878219e1a75fc405.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d1a52c8-32fb-52bb-baa1-45002def6da1/8d1a52c8-32fb-52bb-baa1-45002def6da1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/83/9f831459c68d749bfa744f2d86f97f1e/pa/JG50197_3fe8b1f8dcd31618e5c8c938cb730409.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG50197%27 HTTP/1.1" 200 None
2026-03-27 10:45:02 [auto1.de] INFO: Saving data for JG50197: {'created_time': 1774608302.013792, 'last_price_update_time': 1774608302.013804, 'auction_closing_time': 1774715358.0}
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG50197') HTTP/1.1" 204 0
2026-03-27 10:45:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db2540f8-6be7-52b5-8977-7c8213769550 with identifier: HV45616
2026-03-27 10:45:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db2540f8-6be7-52b5-8977-7c8213769550 with identifier: HV45616
2026-03-27 10:45:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db2540f8-6be7-52b5-8977-7c8213769550 with identifier: HV45616 to the API
2026-03-27 10:45:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_84eaf60e4852a51a1086c9af09c6e416.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:26:44Z',
 'fuel_type': 'petrol',
 'id': 'db2540f8-6be7-52b5-8977-7c8213769550',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV45616',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 220217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db2540f8-6be7-52b5-8977-7c8213769550/db2540f8-6be7-52b5-8977-7c8213769550_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_853463b70f128ed120f07aba441af416.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db2540f8-6be7-52b5-8977-7c8213769550/db2540f8-6be7-52b5-8977-7c8213769550_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_ec243d9af8f24f283afd71d38e8b5ae6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db2540f8-6be7-52b5-8977-7c8213769550/db2540f8-6be7-52b5-8977-7c8213769550_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_a9e10a938961f10edb6409fb6c148d4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db2540f8-6be7-52b5-8977-7c8213769550/db2540f8-6be7-52b5-8977-7c8213769550_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_7d73454084523692c42183c3d2f12c5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db2540f8-6be7-52b5-8977-7c8213769550/db2540f8-6be7-52b5-8977-7c8213769550_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_84eaf60e4852a51a1086c9af09c6e416.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db2540f8-6be7-52b5-8977-7c8213769550/db2540f8-6be7-52b5-8977-7c8213769550_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/db/a0dbb77858d2c788cae5b2edaf6f2a10/pa/HV45616_f9e0c476e10dbb4f85c82e6320f9de8b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2005}
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV45616%27 HTTP/1.1" 200 None
2026-03-27 10:45:03 [auto1.de] INFO: Saving data for HV45616: {'created_time': 1774608303.153247, 'last_price_update_time': 1774608303.153261, 'auction_closing_time': 1774715204.0}
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV45616') HTTP/1.1" 204 0
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50037d210>
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f0a743-ec6e-5e13-8d60-b5021a1389c3/d6f0a743-ec6e-5e13-8d60-b5021a1389c3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F18%252F2d182716f91916da0f78a07e1b11ae0b%252Fpa%252FHK63697_10154ad249a6bc466728c909643cb0a2.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_10154ad249a6bc466728c909643cb0a2.jpg saved to cache
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6f0a743-ec6e-5e13-8d60-b5021a1389c3
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501957e50>
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60053297-7423-53c8-8613-9e1c2f5def8c/60053297-7423-53c8-8613-9e1c2f5def8c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a76d3c7571ef4cd76d323d8366edf%252Fpa%252FEU51889_62531eca9d47271c775afdc877f661ca.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_62531eca9d47271c775afdc877f661ca.jpg saved to cache
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60053297-7423-53c8-8613-9e1c2f5def8c
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501729a50>
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60053297-7423-53c8-8613-9e1c2f5def8c/60053297-7423-53c8-8613-9e1c2f5def8c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F1a%252Faf1a76d3c7571ef4cd76d323d8366edf%252Fpa%252FEU51889_bf9f4e67ff27c067dbbfe4d97aedcab8.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_bf9f4e67ff27c067dbbfe4d97aedcab8.jpg saved to cache
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60053297-7423-53c8-8613-9e1c2f5def8c
2026-03-27 10:45:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60053297-7423-53c8-8613-9e1c2f5def8c, skipping ID generation
2026-03-27 10:45:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60053297-7423-53c8-8613-9e1c2f5def8c with scrape type 1
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60053297-7423-53c8-8613-9e1c2f5def8c sending to next pipeline
2026-03-27 10:45:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60053297-7423-53c8-8613-9e1c2f5def8c, identifier: EU51889
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50172be10>
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6f0a743-ec6e-5e13-8d60-b5021a1389c3/d6f0a743-ec6e-5e13-8d60-b5021a1389c3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F18%252F2d182716f91916da0f78a07e1b11ae0b%252Fpa%252FHK63697_af93cd781f69b29242f1ad79dd504444.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_af93cd781f69b29242f1ad79dd504444.jpg saved to cache
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6f0a743-ec6e-5e13-8d60-b5021a1389c3
2026-03-27 10:45:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6f0a743-ec6e-5e13-8d60-b5021a1389c3, skipping ID generation
2026-03-27 10:45:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6f0a743-ec6e-5e13-8d60-b5021a1389c3 with scrape type 1
2026-03-27 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6f0a743-ec6e-5e13-8d60-b5021a1389c3 sending to next pipeline
2026-03-27 10:45:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6f0a743-ec6e-5e13-8d60-b5021a1389c3, identifier: HK63697
2026-03-27 10:45:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60053297-7423-53c8-8613-9e1c2f5def8c with identifier: EU51889
2026-03-27 10:45:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60053297-7423-53c8-8613-9e1c2f5def8c with identifier: EU51889
2026-03-27 10:45:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60053297-7423-53c8-8613-9e1c2f5def8c with identifier: EU51889 to the API
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_bf9f4e67ff27c067dbbfe4d97aedcab8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:39:06Z',
 'fuel_type': 'petrol',
 'id': '60053297-7423-53c8-8613-9e1c2f5def8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU51889',
 'listing': 'auction',
 'location': 'DE, Kaiserslautern',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 205415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60053297-7423-53c8-8613-9e1c2f5def8c/60053297-7423-53c8-8613-9e1c2f5def8c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_7005ad4b1088e34c5d79ada49d448dd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60053297-7423-53c8-8613-9e1c2f5def8c/60053297-7423-53c8-8613-9e1c2f5def8c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_62531eca9d47271c775afdc877f661ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60053297-7423-53c8-8613-9e1c2f5def8c/60053297-7423-53c8-8613-9e1c2f5def8c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_bf9f4e67ff27c067dbbfe4d97aedcab8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60053297-7423-53c8-8613-9e1c2f5def8c/60053297-7423-53c8-8613-9e1c2f5def8c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_42c2b97062909972731f95b722b8e567.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60053297-7423-53c8-8613-9e1c2f5def8c/60053297-7423-53c8-8613-9e1c2f5def8c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_086ce27e809a6f297b3fd30bcecd902e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60053297-7423-53c8-8613-9e1c2f5def8c/60053297-7423-53c8-8613-9e1c2f5def8c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/1a/af1a76d3c7571ef4cd76d323d8366edf/pa/EU51889_a0f7697133e012afcb9d88b800c0be9b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-11-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2008}
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU51889%27 HTTP/1.1" 200 None
2026-03-27 10:45:04 [auto1.de] INFO: Saving data for EU51889: {'created_time': 1774608304.061345, 'last_price_update_time': 1774608304.061359, 'auction_closing_time': 1774715946.0}
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU51889') HTTP/1.1" 204 0
2026-03-27 10:45:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6f0a743-ec6e-5e13-8d60-b5021a1389c3 with identifier: HK63697
2026-03-27 10:45:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6f0a743-ec6e-5e13-8d60-b5021a1389c3 with identifier: HK63697
2026-03-27 10:45:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6f0a743-ec6e-5e13-8d60-b5021a1389c3 with identifier: HK63697 to the API
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_af93cd781f69b29242f1ad79dd504444.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 49,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 462,
 'expiration_date': '2026-03-28T16:31:17Z',
 'fuel_type': 'hybrid',
 'id': 'd6f0a743-ec6e-5e13-8d60-b5021a1389c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK63697',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 23182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f0a743-ec6e-5e13-8d60-b5021a1389c3/d6f0a743-ec6e-5e13-8d60-b5021a1389c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_2f210675a40c7fbb6ed599a6797ffc8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f0a743-ec6e-5e13-8d60-b5021a1389c3/d6f0a743-ec6e-5e13-8d60-b5021a1389c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_af93cd781f69b29242f1ad79dd504444.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f0a743-ec6e-5e13-8d60-b5021a1389c3/d6f0a743-ec6e-5e13-8d60-b5021a1389c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_10154ad249a6bc466728c909643cb0a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f0a743-ec6e-5e13-8d60-b5021a1389c3/d6f0a743-ec6e-5e13-8d60-b5021a1389c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_29a827d98662628cada7d3067b0c2605.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f0a743-ec6e-5e13-8d60-b5021a1389c3/d6f0a743-ec6e-5e13-8d60-b5021a1389c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_45dd1ae95f0523c1c23d21be0e946496.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f0a743-ec6e-5e13-8d60-b5021a1389c3/d6f0a743-ec6e-5e13-8d60-b5021a1389c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_4c0e55e7d4bd88772dc8c92809bcddab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f0a743-ec6e-5e13-8d60-b5021a1389c3/d6f0a743-ec6e-5e13-8d60-b5021a1389c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_d5de922672811af0e3aabf05865951f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f0a743-ec6e-5e13-8d60-b5021a1389c3/d6f0a743-ec6e-5e13-8d60-b5021a1389c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_4261d27e760baaafbf36a03e4b823794.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f0a743-ec6e-5e13-8d60-b5021a1389c3/d6f0a743-ec6e-5e13-8d60-b5021a1389c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_5f3e3d50eb27f221640d4f3f66983833.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6f0a743-ec6e-5e13-8d60-b5021a1389c3/d6f0a743-ec6e-5e13-8d60-b5021a1389c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/18/2d182716f91916da0f78a07e1b11ae0b/pa/HK63697_b4d82afe122fed50d7d7741eb26a3bea.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 TSI eHybrid R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2024}
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK63697%27 HTTP/1.1" 200 None
2026-03-27 10:45:04 [auto1.de] INFO: Saving data for HK63697: {'created_time': 1774608304.869078, 'last_price_update_time': 1774608304.869089, 'auction_closing_time': 1774715477.0}
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK63697') HTTP/1.1" 204 0
2026-03-27 10:45:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_b5a4cefb4e0f0965bf716b092cb9e0ed.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_689fd8a9bb161ed01526c9c9bf929aad.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_cb8f0ebd3a46b2db1712ee7e6c25b52f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_68321f11da02876286e4c107e3cbde97.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_3b17f5fac6390a1777e987403bc28ead.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_1fe66fe7ea8e2573bace28efb866aeca.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_736b828ac41914f21f2c319bc9aca26e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501808710>
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30687c1f-da00-51ca-a284-0ac97a3dd676/30687c1f-da00-51ca-a284-0ac97a3dd676_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F0e%252F3b0e246767da4493a6dc2828be266e29%252Fpa%252FTS36559_b5a4cefb4e0f0965bf716b092cb9e0ed.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_b5a4cefb4e0f0965bf716b092cb9e0ed.jpg saved to cache
2026-03-27 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30687c1f-da00-51ca-a284-0ac97a3dd676
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50033bb10>
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30687c1f-da00-51ca-a284-0ac97a3dd676/30687c1f-da00-51ca-a284-0ac97a3dd676_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F0e%252F3b0e246767da4493a6dc2828be266e29%252Fpa%252FTS36559_689fd8a9bb161ed01526c9c9bf929aad.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_689fd8a9bb161ed01526c9c9bf929aad.jpg saved to cache
2026-03-27 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30687c1f-da00-51ca-a284-0ac97a3dd676
2026-03-27 10:45:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001dc9d0>
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30687c1f-da00-51ca-a284-0ac97a3dd676/30687c1f-da00-51ca-a284-0ac97a3dd676_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F0e%252F3b0e246767da4493a6dc2828be266e29%252Fpa%252FTS36559_cb8f0ebd3a46b2db1712ee7e6c25b52f.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_cb8f0ebd3a46b2db1712ee7e6c25b52f.jpg saved to cache
2026-03-27 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30687c1f-da00-51ca-a284-0ac97a3dd676
2026-03-27 10:45:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c11d0>
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30687c1f-da00-51ca-a284-0ac97a3dd676/30687c1f-da00-51ca-a284-0ac97a3dd676_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F0e%252F3b0e246767da4493a6dc2828be266e29%252Fpa%252FTS36559_68321f11da02876286e4c107e3cbde97.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_68321f11da02876286e4c107e3cbde97.jpg saved to cache
2026-03-27 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30687c1f-da00-51ca-a284-0ac97a3dd676
2026-03-27 10:45:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c3310>
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30687c1f-da00-51ca-a284-0ac97a3dd676/30687c1f-da00-51ca-a284-0ac97a3dd676_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F0e%252F3b0e246767da4493a6dc2828be266e29%252Fpa%252FTS36559_3b17f5fac6390a1777e987403bc28ead.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_3b17f5fac6390a1777e987403bc28ead.jpg saved to cache
2026-03-27 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30687c1f-da00-51ca-a284-0ac97a3dd676
2026-03-27 10:45:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001dc150>
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30687c1f-da00-51ca-a284-0ac97a3dd676/30687c1f-da00-51ca-a284-0ac97a3dd676_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F0e%252F3b0e246767da4493a6dc2828be266e29%252Fpa%252FTS36559_1fe66fe7ea8e2573bace28efb866aeca.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_1fe66fe7ea8e2573bace28efb866aeca.jpg saved to cache
2026-03-27 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30687c1f-da00-51ca-a284-0ac97a3dd676
2026-03-27 10:45:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50038f450>
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30687c1f-da00-51ca-a284-0ac97a3dd676/30687c1f-da00-51ca-a284-0ac97a3dd676_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F0e%252F3b0e246767da4493a6dc2828be266e29%252Fpa%252FTS36559_736b828ac41914f21f2c319bc9aca26e.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_736b828ac41914f21f2c319bc9aca26e.jpg saved to cache
2026-03-27 10:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30687c1f-da00-51ca-a284-0ac97a3dd676
2026-03-27 10:45:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_6019b936ccbd59f76bf8f9c97a799f60.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_d0610d74dfea50bcfc64b56dd9d06a35.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_da457de13a47d5f4c498c9ba55e353d3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KY59799/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_49b1a22626bee50e48560dcf42be5c2b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004dd050>
2026-03-27 10:45:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30687c1f-da00-51ca-a284-0ac97a3dd676/30687c1f-da00-51ca-a284-0ac97a3dd676_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F0e%252F3b0e246767da4493a6dc2828be266e29%252Fpa%252FTS36559_6019b936ccbd59f76bf8f9c97a799f60.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_6019b936ccbd59f76bf8f9c97a799f60.jpg saved to cache
2026-03-27 10:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30687c1f-da00-51ca-a284-0ac97a3dd676
2026-03-27 10:45:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004dec50>
2026-03-27 10:45:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30687c1f-da00-51ca-a284-0ac97a3dd676/30687c1f-da00-51ca-a284-0ac97a3dd676_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F0e%252F3b0e246767da4493a6dc2828be266e29%252Fpa%252FTS36559_d0610d74dfea50bcfc64b56dd9d06a35.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_d0610d74dfea50bcfc64b56dd9d06a35.jpg saved to cache
2026-03-27 10:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30687c1f-da00-51ca-a284-0ac97a3dd676
2026-03-27 10:45:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501748210>
2026-03-27 10:45:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30687c1f-da00-51ca-a284-0ac97a3dd676/30687c1f-da00-51ca-a284-0ac97a3dd676_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F0e%252F3b0e246767da4493a6dc2828be266e29%252Fpa%252FTS36559_da457de13a47d5f4c498c9ba55e353d3.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_da457de13a47d5f4c498c9ba55e353d3.jpg saved to cache
2026-03-27 10:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30687c1f-da00-51ca-a284-0ac97a3dd676
2026-03-27 10:45:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30687c1f-da00-51ca-a284-0ac97a3dd676, skipping ID generation
2026-03-27 10:45:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30687c1f-da00-51ca-a284-0ac97a3dd676 with scrape type 1
2026-03-27 10:45:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30687c1f-da00-51ca-a284-0ac97a3dd676 sending to next pipeline
2026-03-27 10:45:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30687c1f-da00-51ca-a284-0ac97a3dd676, identifier: TS36559
2026-03-27 10:45:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30687c1f-da00-51ca-a284-0ac97a3dd676 with identifier: TS36559
2026-03-27 10:45:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30687c1f-da00-51ca-a284-0ac97a3dd676 with identifier: TS36559
2026-03-27 10:45:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30687c1f-da00-51ca-a284-0ac97a3dd676 with identifier: TS36559 to the API
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_da457de13a47d5f4c498c9ba55e353d3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:16:32Z',
 'fuel_type': 'petrol',
 'id': '30687c1f-da00-51ca-a284-0ac97a3dd676',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS36559',
 'listing': 'auction',
 'location': 'DE, Göppingen',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 149965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30687c1f-da00-51ca-a284-0ac97a3dd676/30687c1f-da00-51ca-a284-0ac97a3dd676_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3101342,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_cb8f0ebd3a46b2db1712ee7e6c25b52f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30687c1f-da00-51ca-a284-0ac97a3dd676/30687c1f-da00-51ca-a284-0ac97a3dd676_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_da457de13a47d5f4c498c9ba55e353d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30687c1f-da00-51ca-a284-0ac97a3dd676/30687c1f-da00-51ca-a284-0ac97a3dd676_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_d0610d74dfea50bcfc64b56dd9d06a35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30687c1f-da00-51ca-a284-0ac97a3dd676/30687c1f-da00-51ca-a284-0ac97a3dd676_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_b5a4cefb4e0f0965bf716b092cb9e0ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30687c1f-da00-51ca-a284-0ac97a3dd676/30687c1f-da00-51ca-a284-0ac97a3dd676_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3079009,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_736b828ac41914f21f2c319bc9aca26e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30687c1f-da00-51ca-a284-0ac97a3dd676/30687c1f-da00-51ca-a284-0ac97a3dd676_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2999794,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_68321f11da02876286e4c107e3cbde97.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30687c1f-da00-51ca-a284-0ac97a3dd676/30687c1f-da00-51ca-a284-0ac97a3dd676_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3093497,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_3b17f5fac6390a1777e987403bc28ead.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30687c1f-da00-51ca-a284-0ac97a3dd676/30687c1f-da00-51ca-a284-0ac97a3dd676_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_689fd8a9bb161ed01526c9c9bf929aad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30687c1f-da00-51ca-a284-0ac97a3dd676/30687c1f-da00-51ca-a284-0ac97a3dd676_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3041281,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_1fe66fe7ea8e2573bace28efb866aeca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30687c1f-da00-51ca-a284-0ac97a3dd676/30687c1f-da00-51ca-a284-0ac97a3dd676_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/0e/3b0e246767da4493a6dc2828be266e29/pa/TS36559_6019b936ccbd59f76bf8f9c97a799f60.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS36559%27 HTTP/1.1" 200 None
2026-03-27 10:45:06 [auto1.de] INFO: Saving data for TS36559: {'created_time': 1774608306.725129, 'last_price_update_time': 1774608306.725146, 'auction_closing_time': 1774714592.0}
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS36559') HTTP/1.1" 204 0
2026-03-27 10:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_c8fcb25c09e30c4adbedf36691262dca.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/33/d133584e32ab31311010e09990a94ca0/pa/DC30039_eb060fa7831d7fe5731bb19bf21f0d97.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_5a063aafbe9f95071d8f9da8bfb4ecba.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_36ae7af45ce6fd93701f9d397913dc12.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/33/d133584e32ab31311010e09990a94ca0/pa/DC30039_9162482463956c6e96b934bbbf0b88d8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:06 [scrapy.extensions.logstats] INFO: Crawled 370 pages (at 28 pages/min), scraped 532 items (at 54 items/min)
2026-03-27 10:45:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 10:45:06 [auto1.de] INFO: Channel: 24h | Page: 31 | totalHits: 10544 | hits on page: 40
2026-03-27 10:45:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500473e50>
2026-03-27 10:45:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c325213c-98d7-5b02-b0dd-1fcc571aa207/c325213c-98d7-5b02-b0dd-1fcc571aa207_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F3b%252F383b91974caca5b2a78d21f118a302dc%252Fpa%252FVZ21746_49b1a22626bee50e48560dcf42be5c2b.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_49b1a22626bee50e48560dcf42be5c2b.jpg saved to cache
2026-03-27 10:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c325213c-98d7-5b02-b0dd-1fcc571aa207
2026-03-27 10:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HV64790> (referer: https://www.auto1.com/v1/car-details-view/HV64790/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:06 [auto1.de] INFO: Found listing with ID: KT10840
2026-03-27 10:45:06 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG66874%27 HTTP/1.1" 200 None
2026-03-27 10:45:06 [auto1.de] INFO: Scrape type for SG66874: 0
2026-03-27 10:45:06 [auto1.de] INFO: Found listing with ID: SG62181
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG62181%27 HTTP/1.1" 200 None
2026-03-27 10:45:06 [auto1.de] INFO: Scrape type for SG62181: 0
2026-03-27 10:45:06 [auto1.de] INFO: Found listing with ID: RE51747
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE51747%27 HTTP/1.1" 200 None
2026-03-27 10:45:06 [auto1.de] INFO: Scrape type for RE51747: 0
2026-03-27 10:45:06 [auto1.de] INFO: Found listing with ID: LV47567
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV47567%27 HTTP/1.1" 200 None
2026-03-27 10:45:06 [auto1.de] INFO: Scrape type for LV47567: 0
2026-03-27 10:45:06 [auto1.de] INFO: Found listing with ID: ZS46633
2026-03-27 10:45:06 [auto1.de] INFO: Found listing with ID: ZV21910
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV21910%27 HTTP/1.1" 200 None
2026-03-27 10:45:06 [auto1.de] INFO: Scrape type for ZV21910: 2
2026-03-27 10:45:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4e2149d-fd64-58e9-9a74-281aee60537d with identifier: ZV21910
2026-03-27 10:45:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e2149d-fd64-58e9-9a74-281aee60537d with scrape type 2
2026-03-27 10:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4e2149d-fd64-58e9-9a74-281aee60537d with scrape type 2
2026-03-27 10:45:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4e2149d-fd64-58e9-9a74-281aee60537d, identifier: ZV21910
2026-03-27 10:45:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4e2149d-fd64-58e9-9a74-281aee60537d with identifier: ZV21910
2026-03-27 10:45:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4e2149d-fd64-58e9-9a74-281aee60537d with identifier: ZV21910
2026-03-27 10:45:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4e2149d-fd64-58e9-9a74-281aee60537d with identifier: ZV21910 to the API
2026-03-27 10:45:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:54:54Z',
 'fuel_type': 'diesel',
 'id': 'b4e2149d-fd64-58e9-9a74-281aee60537d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV21910',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 187457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-01',
 'seller_name': None,
 'title': 'Hyundai Santa Fe 2.2 CRDi Premium 4WD',
 'transmission': 'automatic',
 'trim': 'Premium 4WD',
 'year': 2016}
2026-03-27 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV21910%27 HTTP/1.1" 200 None
2026-03-27 10:45:07 [auto1.de] INFO: Saving data for ZV21910: {'auction_closing_time': 1774716894.0, 'created_time': 1773387352.387303, 'last_price_update_time': 1774608307.367129}
2026-03-27 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV21910') HTTP/1.1" 204 0
2026-03-27 10:45:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_953658ca41ae7779d4abb905731ff225.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:07 [auto1.de] INFO: Found listing with ID: JC98855
2026-03-27 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC98855%27 HTTP/1.1" 200 None
2026-03-27 10:45:07 [auto1.de] INFO: Scrape type for JC98855: 2
2026-03-27 10:45:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a with identifier: JC98855
2026-03-27 10:45:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a with scrape type 2
2026-03-27 10:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a with scrape type 2
2026-03-27 10:45:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a, identifier: JC98855
2026-03-27 10:45:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_0b8501db71e53964f72e6fb399961d4c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a with identifier: JC98855
2026-03-27 10:45:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a with identifier: JC98855
2026-03-27 10:45:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a with identifier: JC98855 to the API
2026-03-27 10:45:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:55:37Z',
 'fuel_type': 'petrol',
 'id': '5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC98855',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 76280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-10',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Urban',
 'year': 2017}
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC98855%27 HTTP/1.1" 200 None
2026-03-27 10:45:08 [auto1.de] INFO: Saving data for JC98855: {'auction_closing_time': 1774716937.0, 'created_time': 1773383239.787443, 'last_price_update_time': 1774608308.268721}
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC98855') HTTP/1.1" 204 0
2026-03-27 10:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PE37736> (referer: https://www.auto1.com/v1/car-details-view/PE37736/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501871a90>
2026-03-27 10:45:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30986627-4795-5964-a386-2181452c2a6e/30986627-4795-5964-a386-2181452c2a6e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F5331d13314a0b54db64ac2f75f2df8ce%252Fpa%252FBY90710_c8fcb25c09e30c4adbedf36691262dca.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_c8fcb25c09e30c4adbedf36691262dca.jpg saved to cache
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30986627-4795-5964-a386-2181452c2a6e
2026-03-27 10:45:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50040ab90>
2026-03-27 10:45:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb25c12a-97b7-5649-ac29-b32a9302172d/bb25c12a-97b7-5649-ac29-b32a9302172d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F33%252Fd133584e32ab31311010e09990a94ca0%252Fpa%252FDC30039_eb060fa7831d7fe5731bb19bf21f0d97.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/33/d133584e32ab31311010e09990a94ca0/pa/DC30039_eb060fa7831d7fe5731bb19bf21f0d97.jpg saved to cache
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb25c12a-97b7-5649-ac29-b32a9302172d
2026-03-27 10:45:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a51d0>
2026-03-27 10:45:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c218447f-2f05-5fb8-b352-abe4d5938aad/c218447f-2f05-5fb8-b352-abe4d5938aad_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7a%252F4d7a76cf71d17ec266e8856f3c6a5e25%252Fpa%252FKV84804_5a063aafbe9f95071d8f9da8bfb4ecba.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_5a063aafbe9f95071d8f9da8bfb4ecba.jpg saved to cache
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c218447f-2f05-5fb8-b352-abe4d5938aad
2026-03-27 10:45:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50371e090>
2026-03-27 10:45:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8049887e-e6ec-5ec0-b934-32ee67f4586a/8049887e-e6ec-5ec0-b934-32ee67f4586a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F95%252F3e95111e6d12aed932064814fedf789b%252Fpa%252FJM16548_36ae7af45ce6fd93701f9d397913dc12.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_36ae7af45ce6fd93701f9d397913dc12.jpg saved to cache
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8049887e-e6ec-5ec0-b934-32ee67f4586a
2026-03-27 10:45:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016e7990>
2026-03-27 10:45:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb25c12a-97b7-5649-ac29-b32a9302172d/bb25c12a-97b7-5649-ac29-b32a9302172d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F33%252Fd133584e32ab31311010e09990a94ca0%252Fpa%252FDC30039_9162482463956c6e96b934bbbf0b88d8.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/33/d133584e32ab31311010e09990a94ca0/pa/DC30039_9162482463956c6e96b934bbbf0b88d8.jpg saved to cache
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb25c12a-97b7-5649-ac29-b32a9302172d
2026-03-27 10:45:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8 with identifier: HV64790
2026-03-27 10:45:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8 with scrape type 1
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fc5%252F84c5fc3cda12e06e51ecd50da8c71478%252Fpa%252FHV64790_25c7aded110f626c5ce190a90f3e47cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_25c7aded110f626c5ce190a90f3e47cf.jpg not downloaded yet
2026-03-27 10:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/33/d133584e32ab31311010e09990a94ca0/pa/DC30039_8324e5a2a9374e4a34a724b65e0b1681.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:08 [auto1.de] INFO: Found listing with ID: GG36618
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG36618%27 HTTP/1.1" 200 None
2026-03-27 10:45:08 [auto1.de] INFO: Scrape type for GG36618: 2
2026-03-27 10:45:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2096cefb-abf5-587f-992e-f93d41aa8e65 with identifier: GG36618
2026-03-27 10:45:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2096cefb-abf5-587f-992e-f93d41aa8e65 with scrape type 2
2026-03-27 10:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2096cefb-abf5-587f-992e-f93d41aa8e65 with scrape type 2
2026-03-27 10:45:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2096cefb-abf5-587f-992e-f93d41aa8e65, identifier: GG36618
2026-03-27 10:45:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CR70146> (referer: https://www.auto1.com/v1/car-details-view/CR70146/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2096cefb-abf5-587f-992e-f93d41aa8e65 with identifier: GG36618
2026-03-27 10:45:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2096cefb-abf5-587f-992e-f93d41aa8e65 with identifier: GG36618
2026-03-27 10:45:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2096cefb-abf5-587f-992e-f93d41aa8e65 with identifier: GG36618 to the API
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:56:22Z',
 'fuel_type': 'diesel',
 'id': '2096cefb-abf5-587f-992e-f93d41aa8e65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG36618',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 198518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-10',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 TDI Connect',
 'transmission': 'manual',
 'trim': 'Connect',
 'year': 2016}
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG36618%27 HTTP/1.1" 200 None
2026-03-27 10:45:09 [auto1.de] INFO: Saving data for GG36618: {'auction_closing_time': 1774716982.0, 'created_time': 1774262652.68583, 'last_price_update_time': 1774608309.028767}
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG36618') HTTP/1.1" 204 0
2026-03-27 10:45:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fc5%252F84c5fc3cda12e06e51ecd50da8c71478%252Fpa%252FHV64790_ce125a5ebfb0274e4c1aaae6e8e6ca20.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_ce125a5ebfb0274e4c1aaae6e8e6ca20.jpg not downloaded yet
2026-03-27 10:45:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50040add0>
2026-03-27 10:45:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8049887e-e6ec-5ec0-b934-32ee67f4586a/8049887e-e6ec-5ec0-b934-32ee67f4586a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F95%252F3e95111e6d12aed932064814fedf789b%252Fpa%252FJM16548_953658ca41ae7779d4abb905731ff225.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_953658ca41ae7779d4abb905731ff225.jpg saved to cache
2026-03-27 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8049887e-e6ec-5ec0-b934-32ee67f4586a
2026-03-27 10:45:09 [auto1.de] INFO: Found listing with ID: EZ36931
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ36931%27 HTTP/1.1" 200 None
2026-03-27 10:45:09 [auto1.de] INFO: Scrape type for EZ36931: 2
2026-03-27 10:45:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4c87d2b-ec2b-582f-8d87-0ed90b4e0063 with identifier: EZ36931
2026-03-27 10:45:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4c87d2b-ec2b-582f-8d87-0ed90b4e0063 with scrape type 2
2026-03-27 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4c87d2b-ec2b-582f-8d87-0ed90b4e0063 with scrape type 2
2026-03-27 10:45:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4c87d2b-ec2b-582f-8d87-0ed90b4e0063, identifier: EZ36931
2026-03-27 10:45:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50045e150>
2026-03-27 10:45:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c218447f-2f05-5fb8-b352-abe4d5938aad/c218447f-2f05-5fb8-b352-abe4d5938aad_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7a%252F4d7a76cf71d17ec266e8856f3c6a5e25%252Fpa%252FKV84804_0b8501db71e53964f72e6fb399961d4c.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_0b8501db71e53964f72e6fb399961d4c.jpg saved to cache
2026-03-27 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c218447f-2f05-5fb8-b352-abe4d5938aad
2026-03-27 10:45:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6953ed59-abdd-5f0d-896d-f4c10adc917a with identifier: PE37736
2026-03-27 10:45:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6953ed59-abdd-5f0d-896d-f4c10adc917a with scrape type 1
2026-03-27 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6953ed59-abdd-5f0d-896d-f4c10adc917a
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Ff9%252Fdbf91d296f46f5b583c6ab8a6144c019%252Fpa%252FPE37736_0e7e42f90fa47b44471aeca04babc2e7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/f9/dbf91d296f46f5b583c6ab8a6144c019/pa/PE37736_0e7e42f90fa47b44471aeca04babc2e7.jpg not downloaded yet
2026-03-27 10:45:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4c87d2b-ec2b-582f-8d87-0ed90b4e0063 with identifier: EZ36931
2026-03-27 10:45:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4c87d2b-ec2b-582f-8d87-0ed90b4e0063 with identifier: EZ36931
2026-03-27 10:45:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4c87d2b-ec2b-582f-8d87-0ed90b4e0063 with identifier: EZ36931 to the API
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:23:44Z',
 'fuel_type': 'petrol',
 'id': 'b4c87d2b-ec2b-582f-8d87-0ed90b4e0063',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ36931',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 97885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-11',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2007}
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ36931%27 HTTP/1.1" 200 None
2026-03-27 10:45:09 [auto1.de] INFO: Saving data for EZ36931: {'auction_closing_time': 1774715024.0, 'created_time': 1772728533.609466, 'last_price_update_time': 1774608309.668678}
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ36931') HTTP/1.1" 204 0
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fc5%252F84c5fc3cda12e06e51ecd50da8c71478%252Fpa%252FHV64790_329589e9aca577f1fdfdccdf76df37a8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_329589e9aca577f1fdfdccdf76df37a8.jpg not downloaded yet
2026-03-27 10:45:09 [auto1.de] INFO: Found listing with ID: PA97502
2026-03-27 10:45:09 [auto1.de] INFO: Found listing with ID: DW94281
2026-03-27 10:45:09 [auto1.de] INFO: Found listing with ID: ZL76152
2026-03-27 10:45:09 [auto1.de] INFO: Found listing with ID: BL07705
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL07705%27 HTTP/1.1" 200 None
2026-03-27 10:45:09 [auto1.de] INFO: Scrape type for BL07705: 2
2026-03-27 10:45:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65b8bc14-64fc-5809-ba5d-b99f1c3124b9 with identifier: BL07705
2026-03-27 10:45:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65b8bc14-64fc-5809-ba5d-b99f1c3124b9 with scrape type 2
2026-03-27 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65b8bc14-64fc-5809-ba5d-b99f1c3124b9 with scrape type 2
2026-03-27 10:45:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65b8bc14-64fc-5809-ba5d-b99f1c3124b9, identifier: BL07705
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Ff9%252Fdbf91d296f46f5b583c6ab8a6144c019%252Fpa%252FPE37736_8db7ecd1daaf0ecae5fd1a42968d48d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/f9/dbf91d296f46f5b583c6ab8a6144c019/pa/PE37736_8db7ecd1daaf0ecae5fd1a42968d48d8.jpg not downloaded yet
2026-03-27 10:45:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018979d0>
2026-03-27 10:45:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb25c12a-97b7-5649-ac29-b32a9302172d/bb25c12a-97b7-5649-ac29-b32a9302172d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F33%252Fd133584e32ab31311010e09990a94ca0%252Fpa%252FDC30039_8324e5a2a9374e4a34a724b65e0b1681.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/33/d133584e32ab31311010e09990a94ca0/pa/DC30039_8324e5a2a9374e4a34a724b65e0b1681.jpg saved to cache
2026-03-27 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb25c12a-97b7-5649-ac29-b32a9302172d
2026-03-27 10:45:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb25c12a-97b7-5649-ac29-b32a9302172d, skipping ID generation
2026-03-27 10:45:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb25c12a-97b7-5649-ac29-b32a9302172d with scrape type 1
2026-03-27 10:45:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb25c12a-97b7-5649-ac29-b32a9302172d sending to next pipeline
2026-03-27 10:45:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb25c12a-97b7-5649-ac29-b32a9302172d, identifier: DC30039
2026-03-27 10:45:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53f36514-15a5-5ecd-b3ef-379629d48d5a with identifier: CR70146
2026-03-27 10:45:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53f36514-15a5-5ecd-b3ef-379629d48d5a with scrape type 1
2026-03-27 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 53f36514-15a5-5ecd-b3ef-379629d48d5a
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F42%252Fdd42162d4c5752d4f302d560996b1aed%252Fpa%252FCR70146_35fb2504ca2cb054f24cb62302d02573.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/42/dd42162d4c5752d4f302d560996b1aed/pa/CR70146_35fb2504ca2cb054f24cb62302d02573.jpg not downloaded yet
2026-03-27 10:45:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_9c792e468a8d80a3795f299e2b827be0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65b8bc14-64fc-5809-ba5d-b99f1c3124b9 with identifier: BL07705
2026-03-27 10:45:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65b8bc14-64fc-5809-ba5d-b99f1c3124b9 with identifier: BL07705
2026-03-27 10:45:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65b8bc14-64fc-5809-ba5d-b99f1c3124b9 with identifier: BL07705 to the API
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:41:08Z',
 'fuel_type': 'petrol',
 'id': '65b8bc14-64fc-5809-ba5d-b99f1c3124b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL07705',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 211141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-22',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TFSI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL07705%27 HTTP/1.1" 200 None
2026-03-27 10:45:10 [auto1.de] INFO: Saving data for BL07705: {'auction_closing_time': 1774716068.0, 'created_time': 1773383434.873398, 'last_price_update_time': 1774608310.403071}
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BL07705') HTTP/1.1" 204 0
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fc5%252F84c5fc3cda12e06e51ecd50da8c71478%252Fpa%252FHV64790_0b3af86c9c47928190c9d7179927aeee.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_0b3af86c9c47928190c9d7179927aeee.jpg not downloaded yet
2026-03-27 10:45:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb25c12a-97b7-5649-ac29-b32a9302172d with identifier: DC30039
2026-03-27 10:45:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb25c12a-97b7-5649-ac29-b32a9302172d with identifier: DC30039
2026-03-27 10:45:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb25c12a-97b7-5649-ac29-b32a9302172d with identifier: DC30039 to the API
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd1/33/d133584e32ab31311010e09990a94ca0/pa/DC30039_8324e5a2a9374e4a34a724b65e0b1681.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:48:12Z',
 'fuel_type': 'petrol',
 'id': 'bb25c12a-97b7-5649-ac29-b32a9302172d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC30039',
 'listing': 'auction',
 'location': 'DE, Flensburg',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 95401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb25c12a-97b7-5649-ac29-b32a9302172d/bb25c12a-97b7-5649-ac29-b32a9302172d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/33/d133584e32ab31311010e09990a94ca0/pa/DC30039_d0be6c6a33d24b516869598775b09da6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb25c12a-97b7-5649-ac29-b32a9302172d/bb25c12a-97b7-5649-ac29-b32a9302172d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/33/d133584e32ab31311010e09990a94ca0/pa/DC30039_8324e5a2a9374e4a34a724b65e0b1681.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb25c12a-97b7-5649-ac29-b32a9302172d/bb25c12a-97b7-5649-ac29-b32a9302172d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/33/d133584e32ab31311010e09990a94ca0/pa/DC30039_9162482463956c6e96b934bbbf0b88d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb25c12a-97b7-5649-ac29-b32a9302172d/bb25c12a-97b7-5649-ac29-b32a9302172d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/33/d133584e32ab31311010e09990a94ca0/pa/DC30039_eb060fa7831d7fe5731bb19bf21f0d97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb25c12a-97b7-5649-ac29-b32a9302172d/bb25c12a-97b7-5649-ac29-b32a9302172d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/33/d133584e32ab31311010e09990a94ca0/pa/DC30039_bd2e272f1ed12217ae9ef70873d9bb61.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2011}
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC30039%27 HTTP/1.1" 200 None
2026-03-27 10:45:10 [auto1.de] INFO: Saving data for DC30039: {'created_time': 1774608310.870023, 'last_price_update_time': 1774608310.870034, 'auction_closing_time': 1774716492.0}
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC30039') HTTP/1.1" 204 0
2026-03-27 10:45:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_25c7aded110f626c5ce190a90f3e47cf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:10 [auto1.de] INFO: Found listing with ID: XM62598
2026-03-27 10:45:10 [auto1.de] INFO: Found listing with ID: CV89057
2026-03-27 10:45:10 [auto1.de] INFO: Found listing with ID: LV98525
2026-03-27 10:45:10 [auto1.de] INFO: Found listing with ID: NN41224
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN41224%27 HTTP/1.1" 200 None
2026-03-27 10:45:10 [auto1.de] INFO: Scrape type for NN41224: 2
2026-03-27 10:45:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d24577de-6e34-5ea3-ace2-47233e613236 with identifier: NN41224
2026-03-27 10:45:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d24577de-6e34-5ea3-ace2-47233e613236 with scrape type 2
2026-03-27 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d24577de-6e34-5ea3-ace2-47233e613236 with scrape type 2
2026-03-27 10:45:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d24577de-6e34-5ea3-ace2-47233e613236, identifier: NN41224
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Ff9%252Fdbf91d296f46f5b583c6ab8a6144c019%252Fpa%252FPE37736_e57dc0712c95592c0338cdabf8e1659f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/f9/dbf91d296f46f5b583c6ab8a6144c019/pa/PE37736_e57dc0712c95592c0338cdabf8e1659f.jpg not downloaded yet
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F42%252Fdd42162d4c5752d4f302d560996b1aed%252Fpa%252FCR70146_afb48dc549a53e4d66b0e5807aff13cb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/42/dd42162d4c5752d4f302d560996b1aed/pa/CR70146_afb48dc549a53e4d66b0e5807aff13cb.jpg not downloaded yet
2026-03-27 10:45:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d24577de-6e34-5ea3-ace2-47233e613236 with identifier: NN41224
2026-03-27 10:45:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d24577de-6e34-5ea3-ace2-47233e613236 with identifier: NN41224
2026-03-27 10:45:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d24577de-6e34-5ea3-ace2-47233e613236 with identifier: NN41224 to the API
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:38:22Z',
 'fuel_type': 'diesel',
 'id': 'd24577de-6e34-5ea3-ace2-47233e613236',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN41224',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 204751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-31',
 'seller_name': None,
 'title': 'Skoda Roomster 1.6 TDI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2011}
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN41224%27 HTTP/1.1" 200 None
2026-03-27 10:45:11 [auto1.de] INFO: Saving data for NN41224: {'auction_closing_time': 1774715902.0, 'created_time': 1773305170.778331, 'last_price_update_time': 1774608311.42399}
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN41224') HTTP/1.1" 204 0
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fc5%252F84c5fc3cda12e06e51ecd50da8c71478%252Fpa%252FHV64790_e0019dbe0bddc27373b55138a009083c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_e0019dbe0bddc27373b55138a009083c.jpg not downloaded yet
2026-03-27 10:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB95489/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:11 [auto1.de] INFO: Found listing with ID: RZ99970
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ99970%27 HTTP/1.1" 200 None
2026-03-27 10:45:11 [auto1.de] INFO: Scrape type for RZ99970: 1
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Ff9%252Fdbf91d296f46f5b583c6ab8a6144c019%252Fpa%252FPE37736_8945a40faf5becbcf3ab4941a31d87d0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/f9/dbf91d296f46f5b583c6ab8a6144c019/pa/PE37736_8945a40faf5becbcf3ab4941a31d87d0.jpg not downloaded yet
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F42%252Fdd42162d4c5752d4f302d560996b1aed%252Fpa%252FCR70146_70e324a6bc2522a8992106de810e7d2d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/42/dd42162d4c5752d4f302d560996b1aed/pa/CR70146_70e324a6bc2522a8992106de810e7d2d.jpg not downloaded yet
2026-03-27 10:45:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TG96584/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK36179> (referer: https://www.auto1.com/v1/car-details-view/HK36179/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fc5%252F84c5fc3cda12e06e51ecd50da8c71478%252Fpa%252FHV64790_e2c22641a5c5e7d3870e559a09ddd298.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_e2c22641a5c5e7d3870e559a09ddd298.jpg not downloaded yet
2026-03-27 10:45:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001fdd50>
2026-03-27 10:45:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8049887e-e6ec-5ec0-b934-32ee67f4586a/8049887e-e6ec-5ec0-b934-32ee67f4586a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F95%252F3e95111e6d12aed932064814fedf789b%252Fpa%252FJM16548_9c792e468a8d80a3795f299e2b827be0.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_9c792e468a8d80a3795f299e2b827be0.jpg saved to cache
2026-03-27 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8049887e-e6ec-5ec0-b934-32ee67f4586a
2026-03-27 10:45:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501688f50>
2026-03-27 10:45:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8/a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fc5%252F84c5fc3cda12e06e51ecd50da8c71478%252Fpa%252FHV64790_25c7aded110f626c5ce190a90f3e47cf.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_25c7aded110f626c5ce190a90f3e47cf.jpg saved to cache
2026-03-27 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8
2026-03-27 10:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_329589e9aca577f1fdfdccdf76df37a8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:11 [auto1.de] INFO: Found listing with ID: VL85665
2026-03-27 10:45:11 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-27 10:45:11 [auto1.de] INFO: Found listing with ID: KK20650
2026-03-27 10:45:11 [auto1.de] INFO: Found listing with ID: UB45914
2026-03-27 10:45:11 [auto1.de] INFO: Found listing with ID: ZY62714
2026-03-27 10:45:11 [auto1.de] INFO: Found listing with ID: FT64995
2026-03-27 10:45:11 [auto1.de] INFO: Found listing with ID: WL25699
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL25699%27 HTTP/1.1" 200 None
2026-03-27 10:45:11 [auto1.de] INFO: Scrape type for WL25699: 2
2026-03-27 10:45:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66bf0c68-3b5b-5c10-89e3-96b5d8a6ba6a with identifier: WL25699
2026-03-27 10:45:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66bf0c68-3b5b-5c10-89e3-96b5d8a6ba6a with scrape type 2
2026-03-27 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66bf0c68-3b5b-5c10-89e3-96b5d8a6ba6a with scrape type 2
2026-03-27 10:45:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66bf0c68-3b5b-5c10-89e3-96b5d8a6ba6a, identifier: WL25699
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Ff9%252Fdbf91d296f46f5b583c6ab8a6144c019%252Fpa%252FPE37736_03f09121a3b4f6f4c6b56c9fe30e53c1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/f9/dbf91d296f46f5b583c6ab8a6144c019/pa/PE37736_03f09121a3b4f6f4c6b56c9fe30e53c1.jpg not downloaded yet
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F42%252Fdd42162d4c5752d4f302d560996b1aed%252Fpa%252FCR70146_15a85a51b962606ac9dd3819514c2ce6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/42/dd42162d4c5752d4f302d560996b1aed/pa/CR70146_15a85a51b962606ac9dd3819514c2ce6.jpg not downloaded yet
2026-03-27 10:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/42/dd42162d4c5752d4f302d560996b1aed/pa/CR70146_35fb2504ca2cb054f24cb62302d02573.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66bf0c68-3b5b-5c10-89e3-96b5d8a6ba6a with identifier: WL25699
2026-03-27 10:45:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66bf0c68-3b5b-5c10-89e3-96b5d8a6ba6a with identifier: WL25699
2026-03-27 10:45:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66bf0c68-3b5b-5c10-89e3-96b5d8a6ba6a with identifier: WL25699 to the API
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:56:08Z',
 'fuel_type': 'diesel',
 'id': '66bf0c68-3b5b-5c10-89e3-96b5d8a6ba6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL25699',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 225313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2013}
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL25699%27 HTTP/1.1" 200 None
2026-03-27 10:45:12 [auto1.de] INFO: Saving data for WL25699: {'auction_closing_time': 1774716968.0, 'created_time': 1773382477.562391, 'last_price_update_time': 1774608312.289044}
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL25699') HTTP/1.1" 204 0
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fc5%252F84c5fc3cda12e06e51ecd50da8c71478%252Fpa%252FHV64790_a48a1c208e537d5a6a0eeef51cebb8a0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_a48a1c208e537d5a6a0eeef51cebb8a0.jpg not downloaded yet
2026-03-27 10:45:12 [auto1.de] INFO: Found listing with ID: CM72901
2026-03-27 10:45:12 [auto1.de] INFO: Found listing with ID: SY47772
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY47772%27 HTTP/1.1" 200 None
2026-03-27 10:45:12 [auto1.de] INFO: Scrape type for SY47772: 2
2026-03-27 10:45:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53242f5d-d059-53ce-9533-c8e9f9ba632c with identifier: SY47772
2026-03-27 10:45:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53242f5d-d059-53ce-9533-c8e9f9ba632c with scrape type 2
2026-03-27 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53242f5d-d059-53ce-9533-c8e9f9ba632c with scrape type 2
2026-03-27 10:45:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53242f5d-d059-53ce-9533-c8e9f9ba632c, identifier: SY47772
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F42%252Fdd42162d4c5752d4f302d560996b1aed%252Fpa%252FCR70146_b82dd6fd40287b2ca90aa089c4a25545.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/42/dd42162d4c5752d4f302d560996b1aed/pa/CR70146_b82dd6fd40287b2ca90aa089c4a25545.jpg not downloaded yet
2026-03-27 10:45:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8705a19a-76d9-5f20-b84b-fd75a0cecf27 with identifier: HK36179
2026-03-27 10:45:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8705a19a-76d9-5f20-b84b-fd75a0cecf27 with scrape type 1
2026-03-27 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8705a19a-76d9-5f20-b84b-fd75a0cecf27
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F69%252F2a6979e75847faf2423d079579b84ac2%252Fpa%252FHK36179_0bf5c28e13f4540795cb2d7fb8e6cd70.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_0bf5c28e13f4540795cb2d7fb8e6cd70.jpg not downloaded yet
2026-03-27 10:45:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53242f5d-d059-53ce-9533-c8e9f9ba632c with identifier: SY47772
2026-03-27 10:45:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53242f5d-d059-53ce-9533-c8e9f9ba632c with identifier: SY47772
2026-03-27 10:45:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53242f5d-d059-53ce-9533-c8e9f9ba632c with identifier: SY47772 to the API
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:08:34Z',
 'fuel_type': 'petrol',
 'id': '53242f5d-d059-53ce-9533-c8e9f9ba632c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY47772',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 88581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-04',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
 'transmission': 'automatic',
 'trim': 'GTI Clubsport',
 'year': 2021}
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY47772%27 HTTP/1.1" 200 None
2026-03-27 10:45:12 [auto1.de] INFO: Saving data for SY47772: {'auction_closing_time': 1774714114.0, 'created_time': 1773861577.476407, 'last_price_update_time': 1774608312.963872}
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY47772') HTTP/1.1" 204 0
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fc5%252F84c5fc3cda12e06e51ecd50da8c71478%252Fpa%252FHV64790_e3f8d7a1759e2738956883ac60657069.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_e3f8d7a1759e2738956883ac60657069.jpg not downloaded yet
2026-03-27 10:45:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/42/dd42162d4c5752d4f302d560996b1aed/pa/CR70146_afb48dc549a53e4d66b0e5807aff13cb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/f9/dbf91d296f46f5b583c6ab8a6144c019/pa/PE37736_e57dc0712c95592c0338cdabf8e1659f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_e0019dbe0bddc27373b55138a009083c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:13 [auto1.de] INFO: Found listing with ID: HY54532
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY54532%27 HTTP/1.1" 200 None
2026-03-27 10:45:13 [auto1.de] INFO: Scrape type for HY54532: 2
2026-03-27 10:45:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 174b828c-aa89-5c29-a97f-720383dbdb48 with identifier: HY54532
2026-03-27 10:45:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 174b828c-aa89-5c29-a97f-720383dbdb48 with scrape type 2
2026-03-27 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 174b828c-aa89-5c29-a97f-720383dbdb48 with scrape type 2
2026-03-27 10:45:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 174b828c-aa89-5c29-a97f-720383dbdb48, identifier: HY54532
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F69%252F2a6979e75847faf2423d079579b84ac2%252Fpa%252FHK36179_45c15b4f3eaed5a774e8a6d108369b00.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_45c15b4f3eaed5a774e8a6d108369b00.jpg not downloaded yet
2026-03-27 10:45:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG10221> (referer: https://www.auto1.com/v1/car-details-view/NG10221/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50057ed90>
2026-03-27 10:45:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8/a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fc5%252F84c5fc3cda12e06e51ecd50da8c71478%252Fpa%252FHV64790_329589e9aca577f1fdfdccdf76df37a8.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_329589e9aca577f1fdfdccdf76df37a8.jpg saved to cache
2026-03-27 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8
2026-03-27 10:45:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501973b10>
2026-03-27 10:45:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53f36514-15a5-5ecd-b3ef-379629d48d5a/53f36514-15a5-5ecd-b3ef-379629d48d5a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F42%252Fdd42162d4c5752d4f302d560996b1aed%252Fpa%252FCR70146_35fb2504ca2cb054f24cb62302d02573.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/42/dd42162d4c5752d4f302d560996b1aed/pa/CR70146_35fb2504ca2cb054f24cb62302d02573.jpg saved to cache
2026-03-27 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53f36514-15a5-5ecd-b3ef-379629d48d5a
2026-03-27 10:45:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/42/dd42162d4c5752d4f302d560996b1aed/pa/CR70146_70e324a6bc2522a8992106de810e7d2d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 174b828c-aa89-5c29-a97f-720383dbdb48 with identifier: HY54532
2026-03-27 10:45:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 174b828c-aa89-5c29-a97f-720383dbdb48 with identifier: HY54532
2026-03-27 10:45:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 174b828c-aa89-5c29-a97f-720383dbdb48 with identifier: HY54532 to the API
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:37:15Z',
 'fuel_type': 'petrol',
 'id': '174b828c-aa89-5c29-a97f-720383dbdb48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY54532',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 56341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-14',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2020}
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY54532%27 HTTP/1.1" 200 None
2026-03-27 10:45:13 [auto1.de] INFO: Saving data for HY54532: {'auction_closing_time': 1774715835.0, 'created_time': 1773427044.165479, 'last_price_update_time': 1774608313.627437}
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY54532') HTTP/1.1" 204 0
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fc5%252F84c5fc3cda12e06e51ecd50da8c71478%252Fpa%252FHV64790_6925c979f2ac0a3f0c3644ee1c50abda.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_6925c979f2ac0a3f0c3644ee1c50abda.jpg not downloaded yet
2026-03-27 10:45:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:13 [auto1.de] INFO: Found listing with ID: HA10430
2026-03-27 10:45:13 [auto1.de] INFO: Found listing with ID: TD54604
2026-03-27 10:45:13 [auto1.de] INFO: Found listing with ID: YJ30839
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ30839%27 HTTP/1.1" 200 None
2026-03-27 10:45:13 [auto1.de] INFO: Scrape type for YJ30839: 2
2026-03-27 10:45:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61e3541e-02fa-5f2f-8b3a-019b4c59ff9c with identifier: YJ30839
2026-03-27 10:45:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61e3541e-02fa-5f2f-8b3a-019b4c59ff9c with scrape type 2
2026-03-27 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61e3541e-02fa-5f2f-8b3a-019b4c59ff9c with scrape type 2
2026-03-27 10:45:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61e3541e-02fa-5f2f-8b3a-019b4c59ff9c, identifier: YJ30839
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F69%252F2a6979e75847faf2423d079579b84ac2%252Fpa%252FHK36179_776430c9b65c2e44703f4f95a6fa80bd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_776430c9b65c2e44703f4f95a6fa80bd.jpg not downloaded yet
2026-03-27 10:45:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61e3541e-02fa-5f2f-8b3a-019b4c59ff9c with identifier: YJ30839
2026-03-27 10:45:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61e3541e-02fa-5f2f-8b3a-019b4c59ff9c with identifier: YJ30839
2026-03-27 10:45:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61e3541e-02fa-5f2f-8b3a-019b4c59ff9c with identifier: YJ30839 to the API
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:58:54Z',
 'fuel_type': 'diesel',
 'id': '61e3541e-02fa-5f2f-8b3a-019b4c59ff9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ30839',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 115221,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-01',
 'seller_name': None,
 'title': 'MINI Countryman Cooper SD ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2016}
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ30839%27 HTTP/1.1" 200 None
2026-03-27 10:45:14 [auto1.de] INFO: Saving data for YJ30839: {'auction_closing_time': 1774717134.0, 'created_time': 1773305735.047043, 'last_price_update_time': 1774608314.269793}
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ30839') HTTP/1.1" 204 0
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fc5%252F84c5fc3cda12e06e51ecd50da8c71478%252Fpa%252FHV64790_7469aa743b98e9cb89761c788f9a902c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_7469aa743b98e9cb89761c788f9a902c.jpg not downloaded yet
2026-03-27 10:45:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50049b510>
2026-03-27 10:45:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53f36514-15a5-5ecd-b3ef-379629d48d5a/53f36514-15a5-5ecd-b3ef-379629d48d5a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F42%252Fdd42162d4c5752d4f302d560996b1aed%252Fpa%252FCR70146_afb48dc549a53e4d66b0e5807aff13cb.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/42/dd42162d4c5752d4f302d560996b1aed/pa/CR70146_afb48dc549a53e4d66b0e5807aff13cb.jpg saved to cache
2026-03-27 10:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53f36514-15a5-5ecd-b3ef-379629d48d5a
2026-03-27 10:45:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500320a90>
2026-03-27 10:45:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6953ed59-abdd-5f0d-896d-f4c10adc917a/6953ed59-abdd-5f0d-896d-f4c10adc917a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Ff9%252Fdbf91d296f46f5b583c6ab8a6144c019%252Fpa%252FPE37736_e57dc0712c95592c0338cdabf8e1659f.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/f9/dbf91d296f46f5b583c6ab8a6144c019/pa/PE37736_e57dc0712c95592c0338cdabf8e1659f.jpg saved to cache
2026-03-27 10:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6953ed59-abdd-5f0d-896d-f4c10adc917a
2026-03-27 10:45:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500500e50>
2026-03-27 10:45:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8/a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fc5%252F84c5fc3cda12e06e51ecd50da8c71478%252Fpa%252FHV64790_e0019dbe0bddc27373b55138a009083c.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_e0019dbe0bddc27373b55138a009083c.jpg saved to cache
2026-03-27 10:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8
2026-03-27 10:45:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_e2c22641a5c5e7d3870e559a09ddd298.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:14 [auto1.de] INFO: Found listing with ID: DJ74169
2026-03-27 10:45:14 [auto1.de] INFO: Found listing with ID: JZ53783
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ53783%27 HTTP/1.1" 200 None
2026-03-27 10:45:14 [auto1.de] INFO: Scrape type for JZ53783: 2
2026-03-27 10:45:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d253bb53-62aa-5b91-bb8e-b588abe03ee6 with identifier: JZ53783
2026-03-27 10:45:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d253bb53-62aa-5b91-bb8e-b588abe03ee6 with scrape type 2
2026-03-27 10:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d253bb53-62aa-5b91-bb8e-b588abe03ee6 with scrape type 2
2026-03-27 10:45:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d253bb53-62aa-5b91-bb8e-b588abe03ee6, identifier: JZ53783
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F69%252F2a6979e75847faf2423d079579b84ac2%252Fpa%252FHK36179_baba07c1cbe4ca8ee3d6bd5af41bfa02.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_baba07c1cbe4ca8ee3d6bd5af41bfa02.jpg not downloaded yet
2026-03-27 10:45:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_0bf5c28e13f4540795cb2d7fb8e6cd70.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d253bb53-62aa-5b91-bb8e-b588abe03ee6 with identifier: JZ53783
2026-03-27 10:45:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d253bb53-62aa-5b91-bb8e-b588abe03ee6 with identifier: JZ53783
2026-03-27 10:45:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d253bb53-62aa-5b91-bb8e-b588abe03ee6 with identifier: JZ53783 to the API
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:10:26Z',
 'fuel_type': 'diesel',
 'id': 'd253bb53-62aa-5b91-bb8e-b588abe03ee6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ53783',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 67594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-05',
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ53783%27 HTTP/1.1" 200 None
2026-03-27 10:45:14 [auto1.de] INFO: Saving data for JZ53783: {'auction_closing_time': 1774714226.0, 'created_time': 1773304497.641106, 'last_price_update_time': 1774608314.981301}
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ53783') HTTP/1.1" 204 0
2026-03-27 10:45:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2717c145-1d62-520f-9847-00fdf35aaef0 with identifier: NG10221
2026-03-27 10:45:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2717c145-1d62-520f-9847-00fdf35aaef0 with scrape type 1
2026-03-27 10:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2717c145-1d62-520f-9847-00fdf35aaef0
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff6%252F26f6acf917e0b4d3a6ac809f0aa8e2b6%252Fpa%252FNG10221_bcb4984dd1f8de31de4b3d9810babbf3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_bcb4984dd1f8de31de4b3d9810babbf3.jpg not downloaded yet
2026-03-27 10:45:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003960d0>
2026-03-27 10:45:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53f36514-15a5-5ecd-b3ef-379629d48d5a/53f36514-15a5-5ecd-b3ef-379629d48d5a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F42%252Fdd42162d4c5752d4f302d560996b1aed%252Fpa%252FCR70146_70e324a6bc2522a8992106de810e7d2d.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/42/dd42162d4c5752d4f302d560996b1aed/pa/CR70146_70e324a6bc2522a8992106de810e7d2d.jpg saved to cache
2026-03-27 10:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53f36514-15a5-5ecd-b3ef-379629d48d5a
2026-03-27 10:45:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_e3f8d7a1759e2738956883ac60657069.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/42/dd42162d4c5752d4f302d560996b1aed/pa/CR70146_b82dd6fd40287b2ca90aa089c4a25545.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:15 [auto1.de] INFO: Found listing with ID: GA26329
2026-03-27 10:45:15 [auto1.de] INFO: Found listing with ID: PS83332
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS83332%27 HTTP/1.1" 200 None
2026-03-27 10:45:15 [auto1.de] INFO: Scrape type for PS83332: 2
2026-03-27 10:45:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ff99d9d-1f8c-5726-90c5-92466b5dfef5 with identifier: PS83332
2026-03-27 10:45:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ff99d9d-1f8c-5726-90c5-92466b5dfef5 with scrape type 2
2026-03-27 10:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ff99d9d-1f8c-5726-90c5-92466b5dfef5 with scrape type 2
2026-03-27 10:45:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ff99d9d-1f8c-5726-90c5-92466b5dfef5, identifier: PS83332
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F69%252F2a6979e75847faf2423d079579b84ac2%252Fpa%252FHK36179_8548f3b57458cd38f3707dabc0c70e0f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_8548f3b57458cd38f3707dabc0c70e0f.jpg not downloaded yet
2026-03-27 10:45:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ff99d9d-1f8c-5726-90c5-92466b5dfef5 with identifier: PS83332
2026-03-27 10:45:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ff99d9d-1f8c-5726-90c5-92466b5dfef5 with identifier: PS83332
2026-03-27 10:45:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ff99d9d-1f8c-5726-90c5-92466b5dfef5 with identifier: PS83332 to the API
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:53:38Z',
 'fuel_type': 'diesel',
 'id': '2ff99d9d-1f8c-5726-90c5-92466b5dfef5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS83332',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 4',
 'odometer': 173269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-22',
 'seller_name': None,
 'title': 'Land Rover Discovery 4 3.0 TD V6 TDV6 S',
 'transmission': 'automatic',
 'trim': 'TDV6 S',
 'year': 2015}
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS83332%27 HTTP/1.1" 200 None
2026-03-27 10:45:15 [auto1.de] INFO: Saving data for PS83332: {'auction_closing_time': 1774716818.0, 'created_time': 1773134716.789018, 'last_price_update_time': 1774608315.764735}
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS83332') HTTP/1.1" 204 0
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff6%252F26f6acf917e0b4d3a6ac809f0aa8e2b6%252Fpa%252FNG10221_01e43677ade9e06b71edbe5ec77a429f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_01e43677ade9e06b71edbe5ec77a429f.jpg not downloaded yet
2026-03-27 10:45:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500375710>
2026-03-27 10:45:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8/a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fc5%252F84c5fc3cda12e06e51ecd50da8c71478%252Fpa%252FHV64790_e2c22641a5c5e7d3870e559a09ddd298.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_e2c22641a5c5e7d3870e559a09ddd298.jpg saved to cache
2026-03-27 10:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8
2026-03-27 10:45:15 [auto1.de] INFO: Found listing with ID: WA46177
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA46177%27 HTTP/1.1" 200 None
2026-03-27 10:45:15 [auto1.de] INFO: Scrape type for WA46177: 2
2026-03-27 10:45:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89e3f994-8aea-5935-bc91-2b277b978b16 with identifier: WA46177
2026-03-27 10:45:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89e3f994-8aea-5935-bc91-2b277b978b16 with scrape type 2
2026-03-27 10:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89e3f994-8aea-5935-bc91-2b277b978b16 with scrape type 2
2026-03-27 10:45:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89e3f994-8aea-5935-bc91-2b277b978b16, identifier: WA46177
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F69%252F2a6979e75847faf2423d079579b84ac2%252Fpa%252FHK36179_4968c6f6959398365edc43d0d0cc773e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_4968c6f6959398365edc43d0d0cc773e.jpg not downloaded yet
2026-03-27 10:45:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004c59d0>
2026-03-27 10:45:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8705a19a-76d9-5f20-b84b-fd75a0cecf27/8705a19a-76d9-5f20-b84b-fd75a0cecf27_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F69%252F2a6979e75847faf2423d079579b84ac2%252Fpa%252FHK36179_0bf5c28e13f4540795cb2d7fb8e6cd70.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_0bf5c28e13f4540795cb2d7fb8e6cd70.jpg saved to cache
2026-03-27 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8705a19a-76d9-5f20-b84b-fd75a0cecf27
2026-03-27 10:45:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89e3f994-8aea-5935-bc91-2b277b978b16 with identifier: WA46177
2026-03-27 10:45:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89e3f994-8aea-5935-bc91-2b277b978b16 with identifier: WA46177
2026-03-27 10:45:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89e3f994-8aea-5935-bc91-2b277b978b16 with identifier: WA46177 to the API
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:05:35Z',
 'fuel_type': 'diesel',
 'id': '89e3f994-8aea-5935-bc91-2b277b978b16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA46177',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 317737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-19',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2010}
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA46177%27 HTTP/1.1" 200 None
2026-03-27 10:45:16 [auto1.de] INFO: Saving data for WA46177: {'auction_closing_time': 1774713935.0, 'created_time': 1774291010.261216, 'last_price_update_time': 1774608316.440651}
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA46177') HTTP/1.1" 204 0
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff6%252F26f6acf917e0b4d3a6ac809f0aa8e2b6%252Fpa%252FNG10221_a63857bcf9228a8f4e05cc97bd202e71.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_a63857bcf9228a8f4e05cc97bd202e71.jpg not downloaded yet
2026-03-27 10:45:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_b898119c4ba8933ed85cd93c84f7b83d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_7469aa743b98e9cb89761c788f9a902c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_776430c9b65c2e44703f4f95a6fa80bd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:16 [auto1.de] INFO: Found listing with ID: HN35762
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN35762%27 HTTP/1.1" 200 None
2026-03-27 10:45:16 [auto1.de] INFO: Scrape type for HN35762: 2
2026-03-27 10:45:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb8930d2-a6d8-5270-81b2-7e99df3990b9 with identifier: HN35762
2026-03-27 10:45:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb8930d2-a6d8-5270-81b2-7e99df3990b9 with scrape type 2
2026-03-27 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb8930d2-a6d8-5270-81b2-7e99df3990b9 with scrape type 2
2026-03-27 10:45:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb8930d2-a6d8-5270-81b2-7e99df3990b9, identifier: HN35762
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F69%252F2a6979e75847faf2423d079579b84ac2%252Fpa%252FHK36179_2479bb2a14695ec42f04373a4b221399.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_2479bb2a14695ec42f04373a4b221399.jpg not downloaded yet
2026-03-27 10:45:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501731cd0>
2026-03-27 10:45:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8/a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fc5%252F84c5fc3cda12e06e51ecd50da8c71478%252Fpa%252FHV64790_e3f8d7a1759e2738956883ac60657069.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_e3f8d7a1759e2738956883ac60657069.jpg saved to cache
2026-03-27 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8
2026-03-27 10:45:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501953410>
2026-03-27 10:45:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53f36514-15a5-5ecd-b3ef-379629d48d5a/53f36514-15a5-5ecd-b3ef-379629d48d5a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F42%252Fdd42162d4c5752d4f302d560996b1aed%252Fpa%252FCR70146_b82dd6fd40287b2ca90aa089c4a25545.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/42/dd42162d4c5752d4f302d560996b1aed/pa/CR70146_b82dd6fd40287b2ca90aa089c4a25545.jpg saved to cache
2026-03-27 10:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53f36514-15a5-5ecd-b3ef-379629d48d5a
2026-03-27 10:45:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_0bbd8aea8d14ac9782e01276394cfa33.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_6925c979f2ac0a3f0c3644ee1c50abda.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_baba07c1cbe4ca8ee3d6bd5af41bfa02.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb8930d2-a6d8-5270-81b2-7e99df3990b9 with identifier: HN35762
2026-03-27 10:45:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb8930d2-a6d8-5270-81b2-7e99df3990b9 with identifier: HN35762
2026-03-27 10:45:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb8930d2-a6d8-5270-81b2-7e99df3990b9 with identifier: HN35762 to the API
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:58:41Z',
 'fuel_type': 'diesel',
 'id': 'bb8930d2-a6d8-5270-81b2-7e99df3990b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN35762',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 287654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-04',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2017}
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN35762%27 HTTP/1.1" 200 None
2026-03-27 10:45:17 [auto1.de] INFO: Saving data for HN35762: {'auction_closing_time': 1774717121.0, 'created_time': 1774293896.249834, 'last_price_update_time': 1774608317.12458}
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN35762') HTTP/1.1" 204 0
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff6%252F26f6acf917e0b4d3a6ac809f0aa8e2b6%252Fpa%252FNG10221_b16fb352d8311d8e5f3f04301ac708c8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_b16fb352d8311d8e5f3f04301ac708c8.jpg not downloaded yet
2026-03-27 10:45:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KY59799> (referer: https://www.auto1.com/v1/car-details-view/KY59799/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:17 [auto1.de] INFO: Found listing with ID: JH35819
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH35819%27 HTTP/1.1" 200 None
2026-03-27 10:45:17 [auto1.de] INFO: Scrape type for JH35819: 2
2026-03-27 10:45:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66c0106e-330b-52a8-849a-e224554552db with identifier: JH35819
2026-03-27 10:45:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66c0106e-330b-52a8-849a-e224554552db with scrape type 2
2026-03-27 10:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66c0106e-330b-52a8-849a-e224554552db with scrape type 2
2026-03-27 10:45:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66c0106e-330b-52a8-849a-e224554552db, identifier: JH35819
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F69%252F2a6979e75847faf2423d079579b84ac2%252Fpa%252FHK36179_b60a8d293f59898678c12c808f946225.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_b60a8d293f59898678c12c808f946225.jpg not downloaded yet
2026-03-27 10:45:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66c0106e-330b-52a8-849a-e224554552db with identifier: JH35819
2026-03-27 10:45:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66c0106e-330b-52a8-849a-e224554552db with identifier: JH35819
2026-03-27 10:45:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66c0106e-330b-52a8-849a-e224554552db with identifier: JH35819 to the API
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:54:24Z',
 'fuel_type': 'petrol',
 'id': '66c0106e-330b-52a8-849a-e224554552db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH35819',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 115436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-27',
 'seller_name': None,
 'title': 'BMW 1er 116i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2017}
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH35819%27 HTTP/1.1" 200 None
2026-03-27 10:45:17 [auto1.de] INFO: Saving data for JH35819: {'auction_closing_time': 1774716864.0, 'created_time': 1773773156.4411, 'last_price_update_time': 1774608317.671771}
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH35819') HTTP/1.1" 204 0
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff6%252F26f6acf917e0b4d3a6ac809f0aa8e2b6%252Fpa%252FNG10221_8f406ae1c268334a763a4e3362fe6ecb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_8f406ae1c268334a763a4e3362fe6ecb.jpg not downloaded yet
2026-03-27 10:45:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50175fe10>
2026-03-27 10:45:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30986627-4795-5964-a386-2181452c2a6e/30986627-4795-5964-a386-2181452c2a6e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F5331d13314a0b54db64ac2f75f2df8ce%252Fpa%252FBY90710_b898119c4ba8933ed85cd93c84f7b83d.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_b898119c4ba8933ed85cd93c84f7b83d.jpg saved to cache
2026-03-27 10:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30986627-4795-5964-a386-2181452c2a6e
2026-03-27 10:45:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001ec050>
2026-03-27 10:45:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8/a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fc5%252F84c5fc3cda12e06e51ecd50da8c71478%252Fpa%252FHV64790_7469aa743b98e9cb89761c788f9a902c.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_7469aa743b98e9cb89761c788f9a902c.jpg saved to cache
2026-03-27 10:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8
2026-03-27 10:45:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50057f1d0>
2026-03-27 10:45:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8705a19a-76d9-5f20-b84b-fd75a0cecf27/8705a19a-76d9-5f20-b84b-fd75a0cecf27_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F69%252F2a6979e75847faf2423d079579b84ac2%252Fpa%252FHK36179_776430c9b65c2e44703f4f95a6fa80bd.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_776430c9b65c2e44703f4f95a6fa80bd.jpg saved to cache
2026-03-27 10:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8705a19a-76d9-5f20-b84b-fd75a0cecf27
2026-03-27 10:45:17 [auto1.de] INFO: Found listing with ID: LD79531
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F69%252F2a6979e75847faf2423d079579b84ac2%252Fpa%252FHK36179_60cc99c37424344d30bad5845f57bd92.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_60cc99c37424344d30bad5845f57bd92.jpg not downloaded yet
2026-03-27 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff6%252F26f6acf917e0b4d3a6ac809f0aa8e2b6%252Fpa%252FNG10221_e19383a8ee113b1d778e97a121148c4f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_e19383a8ee113b1d778e97a121148c4f.jpg not downloaded yet
2026-03-27 10:45:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50189bf10>
2026-03-27 10:45:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c325213c-98d7-5b02-b0dd-1fcc571aa207/c325213c-98d7-5b02-b0dd-1fcc571aa207_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F3b%252F383b91974caca5b2a78d21f118a302dc%252Fpa%252FVZ21746_0bbd8aea8d14ac9782e01276394cfa33.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_0bbd8aea8d14ac9782e01276394cfa33.jpg saved to cache
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c325213c-98d7-5b02-b0dd-1fcc571aa207
2026-03-27 10:45:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c325213c-98d7-5b02-b0dd-1fcc571aa207, skipping ID generation
2026-03-27 10:45:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c325213c-98d7-5b02-b0dd-1fcc571aa207 with scrape type 1
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c325213c-98d7-5b02-b0dd-1fcc571aa207 sending to next pipeline
2026-03-27 10:45:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c325213c-98d7-5b02-b0dd-1fcc571aa207, identifier: VZ21746
2026-03-27 10:45:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019a6ed0>
2026-03-27 10:45:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8/a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fc5%252F84c5fc3cda12e06e51ecd50da8c71478%252Fpa%252FHV64790_6925c979f2ac0a3f0c3644ee1c50abda.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_6925c979f2ac0a3f0c3644ee1c50abda.jpg saved to cache
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8
2026-03-27 10:45:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016b16d0>
2026-03-27 10:45:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8705a19a-76d9-5f20-b84b-fd75a0cecf27/8705a19a-76d9-5f20-b84b-fd75a0cecf27_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F69%252F2a6979e75847faf2423d079579b84ac2%252Fpa%252FHK36179_baba07c1cbe4ca8ee3d6bd5af41bfa02.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_baba07c1cbe4ca8ee3d6bd5af41bfa02.jpg saved to cache
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8705a19a-76d9-5f20-b84b-fd75a0cecf27
2026-03-27 10:45:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a27e591-12a2-519c-afee-8da7428cc02c with identifier: KY59799
2026-03-27 10:45:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a27e591-12a2-519c-afee-8da7428cc02c with scrape type 1
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a27e591-12a2-519c-afee-8da7428cc02c
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fc8%252Fcdc8d0a6994ceda45d66be08f534afbf%252Fpa%252FKY59799_9c69c96e1dbb1805daa68c548089c8df.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_9c69c96e1dbb1805daa68c548089c8df.jpg not downloaded yet
2026-03-27 10:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_4704305d9c650b867393407b39cddcaa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_8548f3b57458cd38f3707dabc0c70e0f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_01e43677ade9e06b71edbe5ec77a429f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F69%252F2a6979e75847faf2423d079579b84ac2%252Fpa%252FHK36179_570e200b60b6502af9fba7241bd13396.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_570e200b60b6502af9fba7241bd13396.jpg not downloaded yet
2026-03-27 10:45:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c325213c-98d7-5b02-b0dd-1fcc571aa207 with identifier: VZ21746
2026-03-27 10:45:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c325213c-98d7-5b02-b0dd-1fcc571aa207 with identifier: VZ21746
2026-03-27 10:45:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c325213c-98d7-5b02-b0dd-1fcc571aa207 with identifier: VZ21746 to the API
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_0bbd8aea8d14ac9782e01276394cfa33.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:12:51Z',
 'fuel_type': 'petrol',
 'id': 'c325213c-98d7-5b02-b0dd-1fcc571aa207',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ21746',
 'listing': 'auction',
 'location': 'DE, Wolfsburg',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 135087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c325213c-98d7-5b02-b0dd-1fcc571aa207/c325213c-98d7-5b02-b0dd-1fcc571aa207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_49b1a22626bee50e48560dcf42be5c2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c325213c-98d7-5b02-b0dd-1fcc571aa207/c325213c-98d7-5b02-b0dd-1fcc571aa207_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2455750,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_0bbd8aea8d14ac9782e01276394cfa33.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c325213c-98d7-5b02-b0dd-1fcc571aa207/c325213c-98d7-5b02-b0dd-1fcc571aa207_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_e0ba3eae689401bce52327155d330afb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c325213c-98d7-5b02-b0dd-1fcc571aa207/c325213c-98d7-5b02-b0dd-1fcc571aa207_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2224876,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_e2ea2699e7b36f88e2cb33d72140b5a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c325213c-98d7-5b02-b0dd-1fcc571aa207/c325213c-98d7-5b02-b0dd-1fcc571aa207_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_a1394d6e027ade4b93b322f3e66b3681.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c325213c-98d7-5b02-b0dd-1fcc571aa207/c325213c-98d7-5b02-b0dd-1fcc571aa207_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2388710,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_8c72c390b82486fcae13c799e1f16a35.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c325213c-98d7-5b02-b0dd-1fcc571aa207/c325213c-98d7-5b02-b0dd-1fcc571aa207_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_d4896dc6cd7de5f1ba6137220c285d6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c325213c-98d7-5b02-b0dd-1fcc571aa207/c325213c-98d7-5b02-b0dd-1fcc571aa207_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2319710,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_9a6affea61516b6dd6cf3d8d4fafbfd9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c325213c-98d7-5b02-b0dd-1fcc571aa207/c325213c-98d7-5b02-b0dd-1fcc571aa207_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_9bc3e0fbeae63b10e4a0c97950482c5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c325213c-98d7-5b02-b0dd-1fcc571aa207/c325213c-98d7-5b02-b0dd-1fcc571aa207_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/3b/383b91974caca5b2a78d21f118a302dc/pa/VZ21746_65097d6a10aaff17e8bbd2a3a5ca69d4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ21746%27 HTTP/1.1" 200 None
2026-03-27 10:45:18 [auto1.de] INFO: Saving data for VZ21746: {'created_time': 1774608318.811591, 'last_price_update_time': 1774608318.811603, 'auction_closing_time': 1774714371.0}
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ21746') HTTP/1.1" 204 0
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff6%252F26f6acf917e0b4d3a6ac809f0aa8e2b6%252Fpa%252FNG10221_6c33ae6bdc69278ccf2793d64e50f4e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_6c33ae6bdc69278ccf2793d64e50f4e5.jpg not downloaded yet
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fc8%252Fcdc8d0a6994ceda45d66be08f534afbf%252Fpa%252FKY59799_81ba66b2833620dc99701a35617688fe.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_81ba66b2833620dc99701a35617688fe.jpg not downloaded yet
2026-03-27 10:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA39027/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff6%252F26f6acf917e0b4d3a6ac809f0aa8e2b6%252Fpa%252FNG10221_fbef568b4fd3ce90c72b4dc2360fe84f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_fbef568b4fd3ce90c72b4dc2360fe84f.jpg not downloaded yet
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fc8%252Fcdc8d0a6994ceda45d66be08f534afbf%252Fpa%252FKY59799_373da172ef5864ba84c73e1f6a620c3e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_373da172ef5864ba84c73e1f6a620c3e.jpg not downloaded yet
2026-03-27 10:45:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500409710>
2026-03-27 10:45:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c218447f-2f05-5fb8-b352-abe4d5938aad/c218447f-2f05-5fb8-b352-abe4d5938aad_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7a%252F4d7a76cf71d17ec266e8856f3c6a5e25%252Fpa%252FKV84804_4704305d9c650b867393407b39cddcaa.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_4704305d9c650b867393407b39cddcaa.jpg saved to cache
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c218447f-2f05-5fb8-b352-abe4d5938aad
2026-03-27 10:45:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501819390>
2026-03-27 10:45:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8705a19a-76d9-5f20-b84b-fd75a0cecf27/8705a19a-76d9-5f20-b84b-fd75a0cecf27_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F69%252F2a6979e75847faf2423d079579b84ac2%252Fpa%252FHK36179_8548f3b57458cd38f3707dabc0c70e0f.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_8548f3b57458cd38f3707dabc0c70e0f.jpg saved to cache
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8705a19a-76d9-5f20-b84b-fd75a0cecf27
2026-03-27 10:45:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016aa050>
2026-03-27 10:45:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2717c145-1d62-520f-9847-00fdf35aaef0/2717c145-1d62-520f-9847-00fdf35aaef0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff6%252F26f6acf917e0b4d3a6ac809f0aa8e2b6%252Fpa%252FNG10221_01e43677ade9e06b71edbe5ec77a429f.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_01e43677ade9e06b71edbe5ec77a429f.jpg saved to cache
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2717c145-1d62-520f-9847-00fdf35aaef0
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff6%252F26f6acf917e0b4d3a6ac809f0aa8e2b6%252Fpa%252FNG10221_f74ae6d924287683f298cefb1535d8ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_f74ae6d924287683f298cefb1535d8ef.jpg not downloaded yet
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fc8%252Fcdc8d0a6994ceda45d66be08f534afbf%252Fpa%252FKY59799_8e895ae99b1eb414db869b06b435694c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_8e895ae99b1eb414db869b06b435694c.jpg not downloaded yet
2026-03-27 10:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_ce2484226ea62b63c593c7446957fb33.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff6%252F26f6acf917e0b4d3a6ac809f0aa8e2b6%252Fpa%252FNG10221_d08d1d5f5f6f050dc07eae08d4ad122e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_d08d1d5f5f6f050dc07eae08d4ad122e.jpg not downloaded yet
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fc8%252Fcdc8d0a6994ceda45d66be08f534afbf%252Fpa%252FKY59799_8760e05a1582076e09322143b7f06dc1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_8760e05a1582076e09322143b7f06dc1.jpg not downloaded yet
2026-03-27 10:45:19 [auto1.de] INFO: Channel: 24h | Page: 32 | totalHits: 10544 | hits on page: 40
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fc8%252Fcdc8d0a6994ceda45d66be08f534afbf%252Fpa%252FKY59799_4adf87bfcc700bc262910f7b8c24cc02.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_4adf87bfcc700bc262910f7b8c24cc02.jpg not downloaded yet
2026-03-27 10:45:19 [auto1.de] INFO: Found listing with ID: WX41369
2026-03-27 10:45:19 [auto1.de] INFO: Found listing with ID: BC03765
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC03765%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [auto1.de] INFO: Scrape type for BC03765: 2
2026-03-27 10:45:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c96e779b-2971-5caf-bea1-537a3b19961b with identifier: BC03765
2026-03-27 10:45:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c96e779b-2971-5caf-bea1-537a3b19961b with scrape type 2
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c96e779b-2971-5caf-bea1-537a3b19961b with scrape type 2
2026-03-27 10:45:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c96e779b-2971-5caf-bea1-537a3b19961b, identifier: BC03765
2026-03-27 10:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_9c69c96e1dbb1805daa68c548089c8df.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c96e779b-2971-5caf-bea1-537a3b19961b with identifier: BC03765
2026-03-27 10:45:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c96e779b-2971-5caf-bea1-537a3b19961b with identifier: BC03765
2026-03-27 10:45:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c96e779b-2971-5caf-bea1-537a3b19961b with identifier: BC03765 to the API
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:53:09Z',
 'fuel_type': 'diesel',
 'id': 'c96e779b-2971-5caf-bea1-537a3b19961b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC03765',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 229716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-02',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC03765%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [auto1.de] INFO: Saving data for BC03765: {'auction_closing_time': 1774716789.0, 'created_time': 1773426929.674773, 'last_price_update_time': 1774608319.837813}
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC03765') HTTP/1.1" 204 0
2026-03-27 10:45:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fc8%252Fcdc8d0a6994ceda45d66be08f534afbf%252Fpa%252FKY59799_021e0d73e8a8102bd8afda18a0ec641c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_021e0d73e8a8102bd8afda18a0ec641c.jpg not downloaded yet
2026-03-27 10:45:19 [auto1.de] INFO: Found listing with ID: GN68043
2026-03-27 10:45:19 [auto1.de] INFO: Found listing with ID: HE96933
2026-03-27 10:45:19 [auto1.de] INFO: Found listing with ID: WJ12441
2026-03-27 10:45:19 [auto1.de] INFO: Found listing with ID: PU35807
2026-03-27 10:45:19 [auto1.de] INFO: Found listing with ID: ZC62608
2026-03-27 10:45:19 [auto1.de] INFO: Found listing with ID: XW28946
2026-03-27 10:45:19 [auto1.de] INFO: Found listing with ID: AH71943
2026-03-27 10:45:19 [auto1.de] INFO: Found listing with ID: HX82785
2026-03-27 10:45:19 [auto1.de] INFO: Found listing with ID: HY74574
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY74574%27 HTTP/1.1" 200 None
2026-03-27 10:45:19 [auto1.de] INFO: Scrape type for HY74574: 2
2026-03-27 10:45:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85474071-9d19-5f7a-a02f-3cf7a61694a9 with identifier: HY74574
2026-03-27 10:45:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85474071-9d19-5f7a-a02f-3cf7a61694a9 with scrape type 2
2026-03-27 10:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85474071-9d19-5f7a-a02f-3cf7a61694a9 with scrape type 2
2026-03-27 10:45:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85474071-9d19-5f7a-a02f-3cf7a61694a9, identifier: HY74574
2026-03-27 10:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_fbef568b4fd3ce90c72b4dc2360fe84f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_6c33ae6bdc69278ccf2793d64e50f4e5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_e19383a8ee113b1d778e97a121148c4f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_570e200b60b6502af9fba7241bd13396.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85474071-9d19-5f7a-a02f-3cf7a61694a9 with identifier: HY74574
2026-03-27 10:45:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85474071-9d19-5f7a-a02f-3cf7a61694a9 with identifier: HY74574
2026-03-27 10:45:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85474071-9d19-5f7a-a02f-3cf7a61694a9 with identifier: HY74574 to the API
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:33:26Z',
 'fuel_type': 'petrol',
 'id': '85474071-9d19-5f7a-a02f-3cf7a61694a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY74574',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 47136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-12',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY74574%27 HTTP/1.1" 200 None
2026-03-27 10:45:20 [auto1.de] INFO: Saving data for HY74574: {'auction_closing_time': 1774715606.0, 'created_time': 1773860952.842866, 'last_price_update_time': 1774608320.386245}
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY74574') HTTP/1.1" 204 0
2026-03-27 10:45:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a159d0>
2026-03-27 10:45:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30986627-4795-5964-a386-2181452c2a6e/30986627-4795-5964-a386-2181452c2a6e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F5331d13314a0b54db64ac2f75f2df8ce%252Fpa%252FBY90710_ce2484226ea62b63c593c7446957fb33.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_ce2484226ea62b63c593c7446957fb33.jpg saved to cache
2026-03-27 10:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30986627-4795-5964-a386-2181452c2a6e
2026-03-27 10:45:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_81ba66b2833620dc99701a35617688fe.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fc8%252Fcdc8d0a6994ceda45d66be08f534afbf%252Fpa%252FKY59799_27f7a93162b55b14cf9677c7b11a6dbd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_27f7a93162b55b14cf9677c7b11a6dbd.jpg not downloaded yet
2026-03-27 10:45:20 [auto1.de] INFO: Found listing with ID: DJ60943
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ60943%27 HTTP/1.1" 200 None
2026-03-27 10:45:20 [auto1.de] INFO: Scrape type for DJ60943: 2
2026-03-27 10:45:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 617e169a-c15a-5ed1-8130-d3cf2f5edaa1 with identifier: DJ60943
2026-03-27 10:45:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 617e169a-c15a-5ed1-8130-d3cf2f5edaa1 with scrape type 2
2026-03-27 10:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 617e169a-c15a-5ed1-8130-d3cf2f5edaa1 with scrape type 2
2026-03-27 10:45:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 617e169a-c15a-5ed1-8130-d3cf2f5edaa1, identifier: DJ60943
2026-03-27 10:45:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_60cc99c37424344d30bad5845f57bd92.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 617e169a-c15a-5ed1-8130-d3cf2f5edaa1 with identifier: DJ60943
2026-03-27 10:45:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 617e169a-c15a-5ed1-8130-d3cf2f5edaa1 with identifier: DJ60943
2026-03-27 10:45:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 617e169a-c15a-5ed1-8130-d3cf2f5edaa1 with identifier: DJ60943 to the API
2026-03-27 10:45:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:14:41Z',
 'fuel_type': 'petrol',
 'id': '617e169a-c15a-5ed1-8130-d3cf2f5edaa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ60943',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 23560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-26',
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2021}
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ60943%27 HTTP/1.1" 200 None
2026-03-27 10:45:21 [auto1.de] INFO: Saving data for DJ60943: {'auction_closing_time': 1774714481.0, 'created_time': 1773304442.87449, 'last_price_update_time': 1774608321.162758}
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ60943') HTTP/1.1" 204 0
2026-03-27 10:45:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC04938> (referer: https://www.auto1.com/v1/car-details-view/GC04938/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fc8%252Fcdc8d0a6994ceda45d66be08f534afbf%252Fpa%252FKY59799_0f909ad531adceb52c889b562948b263.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_0f909ad531adceb52c889b562948b263.jpg not downloaded yet
2026-03-27 10:45:21 [auto1.de] INFO: Found listing with ID: BB20328
2026-03-27 10:45:21 [auto1.de] INFO: Found listing with ID: ZA19141
2026-03-27 10:45:21 [auto1.de] INFO: Found listing with ID: YY92615
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY92615%27 HTTP/1.1" 200 None
2026-03-27 10:45:21 [auto1.de] INFO: Scrape type for YY92615: 2
2026-03-27 10:45:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7928b9de-98fa-5b16-83e0-e30944e8187b with identifier: YY92615
2026-03-27 10:45:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7928b9de-98fa-5b16-83e0-e30944e8187b with scrape type 2
2026-03-27 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7928b9de-98fa-5b16-83e0-e30944e8187b with scrape type 2
2026-03-27 10:45:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7928b9de-98fa-5b16-83e0-e30944e8187b, identifier: YY92615
2026-03-27 10:45:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB95489> (referer: https://www.auto1.com/v1/car-details-view/HB95489/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d9150>
2026-03-27 10:45:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a27e591-12a2-519c-afee-8da7428cc02c/9a27e591-12a2-519c-afee-8da7428cc02c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fc8%252Fcdc8d0a6994ceda45d66be08f534afbf%252Fpa%252FKY59799_9c69c96e1dbb1805daa68c548089c8df.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_9c69c96e1dbb1805daa68c548089c8df.jpg saved to cache
2026-03-27 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a27e591-12a2-519c-afee-8da7428cc02c
2026-03-27 10:45:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500437690>
2026-03-27 10:45:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2717c145-1d62-520f-9847-00fdf35aaef0/2717c145-1d62-520f-9847-00fdf35aaef0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff6%252F26f6acf917e0b4d3a6ac809f0aa8e2b6%252Fpa%252FNG10221_fbef568b4fd3ce90c72b4dc2360fe84f.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_fbef568b4fd3ce90c72b4dc2360fe84f.jpg saved to cache
2026-03-27 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2717c145-1d62-520f-9847-00fdf35aaef0
2026-03-27 10:45:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a25d0>
2026-03-27 10:45:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2717c145-1d62-520f-9847-00fdf35aaef0/2717c145-1d62-520f-9847-00fdf35aaef0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff6%252F26f6acf917e0b4d3a6ac809f0aa8e2b6%252Fpa%252FNG10221_6c33ae6bdc69278ccf2793d64e50f4e5.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_6c33ae6bdc69278ccf2793d64e50f4e5.jpg saved to cache
2026-03-27 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2717c145-1d62-520f-9847-00fdf35aaef0
2026-03-27 10:45:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500437490>
2026-03-27 10:45:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2717c145-1d62-520f-9847-00fdf35aaef0/2717c145-1d62-520f-9847-00fdf35aaef0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff6%252F26f6acf917e0b4d3a6ac809f0aa8e2b6%252Fpa%252FNG10221_e19383a8ee113b1d778e97a121148c4f.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_e19383a8ee113b1d778e97a121148c4f.jpg saved to cache
2026-03-27 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2717c145-1d62-520f-9847-00fdf35aaef0
2026-03-27 10:45:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017a8dd0>
2026-03-27 10:45:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8705a19a-76d9-5f20-b84b-fd75a0cecf27/8705a19a-76d9-5f20-b84b-fd75a0cecf27_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F69%252F2a6979e75847faf2423d079579b84ac2%252Fpa%252FHK36179_570e200b60b6502af9fba7241bd13396.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_570e200b60b6502af9fba7241bd13396.jpg saved to cache
2026-03-27 10:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8705a19a-76d9-5f20-b84b-fd75a0cecf27
2026-03-27 10:45:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_8f406ae1c268334a763a4e3362fe6ecb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7928b9de-98fa-5b16-83e0-e30944e8187b with identifier: YY92615
2026-03-27 10:45:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7928b9de-98fa-5b16-83e0-e30944e8187b with identifier: YY92615
2026-03-27 10:45:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7928b9de-98fa-5b16-83e0-e30944e8187b with identifier: YY92615 to the API
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:01:32Z',
 'fuel_type': 'diesel',
 'id': '7928b9de-98fa-5b16-83e0-e30944e8187b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY92615',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 144906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-31',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Sport 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport 4Motion',
 'year': 2020}
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY92615%27 HTTP/1.1" 200 None
2026-03-27 10:45:22 [auto1.de] INFO: Saving data for YY92615: {'auction_closing_time': 1774713692.0, 'created_time': 1774294217.995412, 'last_price_update_time': 1774608322.07788}
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY92615') HTTP/1.1" 204 0
2026-03-27 10:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_8760e05a1582076e09322143b7f06dc1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_d08d1d5f5f6f050dc07eae08d4ad122e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fc8%252Fcdc8d0a6994ceda45d66be08f534afbf%252Fpa%252FKY59799_bea429431e991108863ec8ff52bf58ad.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_bea429431e991108863ec8ff52bf58ad.jpg not downloaded yet
2026-03-27 10:45:22 [auto1.de] INFO: Found listing with ID: GE94001
2026-03-27 10:45:22 [auto1.de] INFO: Found listing with ID: BA36034
2026-03-27 10:45:22 [auto1.de] INFO: Found listing with ID: LT34656
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT34656%27 HTTP/1.1" 200 None
2026-03-27 10:45:22 [auto1.de] INFO: Scrape type for LT34656: 2
2026-03-27 10:45:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce2dca40-f721-58f7-bcb6-a8858dc1fa78 with identifier: LT34656
2026-03-27 10:45:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce2dca40-f721-58f7-bcb6-a8858dc1fa78 with scrape type 2
2026-03-27 10:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce2dca40-f721-58f7-bcb6-a8858dc1fa78 with scrape type 2
2026-03-27 10:45:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce2dca40-f721-58f7-bcb6-a8858dc1fa78, identifier: LT34656
2026-03-27 10:45:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50022a6d0>
2026-03-27 10:45:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a27e591-12a2-519c-afee-8da7428cc02c/9a27e591-12a2-519c-afee-8da7428cc02c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fc8%252Fcdc8d0a6994ceda45d66be08f534afbf%252Fpa%252FKY59799_81ba66b2833620dc99701a35617688fe.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_81ba66b2833620dc99701a35617688fe.jpg saved to cache
2026-03-27 10:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a27e591-12a2-519c-afee-8da7428cc02c
2026-03-27 10:45:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500430250>
2026-03-27 10:45:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8705a19a-76d9-5f20-b84b-fd75a0cecf27/8705a19a-76d9-5f20-b84b-fd75a0cecf27_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F69%252F2a6979e75847faf2423d079579b84ac2%252Fpa%252FHK36179_60cc99c37424344d30bad5845f57bd92.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_60cc99c37424344d30bad5845f57bd92.jpg saved to cache
2026-03-27 10:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8705a19a-76d9-5f20-b84b-fd75a0cecf27
2026-03-27 10:45:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce2dca40-f721-58f7-bcb6-a8858dc1fa78 with identifier: LT34656
2026-03-27 10:45:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce2dca40-f721-58f7-bcb6-a8858dc1fa78 with identifier: LT34656
2026-03-27 10:45:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce2dca40-f721-58f7-bcb6-a8858dc1fa78 with identifier: LT34656 to the API
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:42:39Z',
 'fuel_type': 'diesel',
 'id': 'ce2dca40-f721-58f7-bcb6-a8858dc1fa78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT34656',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 147957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-13',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Black Shadow 4x4',
 'transmission': 'manual',
 'trim': 'Black Shadow 4x4',
 'year': 2017}
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT34656%27 HTTP/1.1" 200 None
2026-03-27 10:45:22 [auto1.de] INFO: Saving data for LT34656: {'auction_closing_time': 1774716159.0, 'created_time': 1773831013.481671, 'last_price_update_time': 1774608322.808878}
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT34656') HTTP/1.1" 204 0
2026-03-27 10:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_021e0d73e8a8102bd8afda18a0ec641c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:22 [auto1.de] INFO: Found listing with ID: DN11419
2026-03-27 10:45:22 [auto1.de] INFO: Found listing with ID: RX21744
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21744%27 HTTP/1.1" 200 None
2026-03-27 10:45:22 [auto1.de] INFO: Scrape type for RX21744: 2
2026-03-27 10:45:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1e65f0b-0d8f-5dcb-972b-bd305a595ddb with identifier: RX21744
2026-03-27 10:45:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1e65f0b-0d8f-5dcb-972b-bd305a595ddb with scrape type 2
2026-03-27 10:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1e65f0b-0d8f-5dcb-972b-bd305a595ddb with scrape type 2
2026-03-27 10:45:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1e65f0b-0d8f-5dcb-972b-bd305a595ddb, identifier: RX21744
2026-03-27 10:45:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1e65f0b-0d8f-5dcb-972b-bd305a595ddb with identifier: RX21744
2026-03-27 10:45:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1e65f0b-0d8f-5dcb-972b-bd305a595ddb with identifier: RX21744
2026-03-27 10:45:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1e65f0b-0d8f-5dcb-972b-bd305a595ddb with identifier: RX21744 to the API
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:20:44Z',
 'fuel_type': 'diesel',
 'id': 'b1e65f0b-0d8f-5dcb-972b-bd305a595ddb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX21744',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 277115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-17',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 e-HDi Business-Line',
 'transmission': 'automatic',
 'trim': 'Business-Line',
 'year': 2013}
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21744%27 HTTP/1.1" 200 None
2026-03-27 10:45:23 [auto1.de] INFO: Saving data for RX21744: {'auction_closing_time': 1774714844.0, 'created_time': 1773429007.339156, 'last_price_update_time': 1774608323.31843}
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX21744') HTTP/1.1" 204 0
2026-03-27 10:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d782adae-621d-5fef-a03f-a677a8b4cb84 with identifier: GC04938
2026-03-27 10:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d782adae-621d-5fef-a03f-a677a8b4cb84 with scrape type 1
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d782adae-621d-5fef-a03f-a677a8b4cb84
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Ff1%252Fb5f14071738b4357517ae91c97b79444%252Fpa%252FGC04938_3c4f8d205ffdfdc67d4dabaf3551f140.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_3c4f8d205ffdfdc67d4dabaf3551f140.jpg already downloaded
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Ff1%252Fb5f14071738b4357517ae91c97b79444%252Fpa%252FGC04938_05fff8769fa037efbd08fee8f7fe7c88.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_05fff8769fa037efbd08fee8f7fe7c88.jpg already downloaded
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Ff1%252Fb5f14071738b4357517ae91c97b79444%252Fpa%252FGC04938_0776414f2354f68681483ecb8b40e338.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_0776414f2354f68681483ecb8b40e338.jpg already downloaded
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Ff1%252Fb5f14071738b4357517ae91c97b79444%252Fpa%252FGC04938_208c7cc3e97bcbe35945c197e5b37016.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_208c7cc3e97bcbe35945c197e5b37016.jpg already downloaded
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Ff1%252Fb5f14071738b4357517ae91c97b79444%252Fpa%252FGC04938_ba6b15e8641aab85d1ade578baf943f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_ba6b15e8641aab85d1ade578baf943f1.jpg already downloaded
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Ff1%252Fb5f14071738b4357517ae91c97b79444%252Fpa%252FGC04938_16602136e8c9d41edfa5ef3d064062cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_16602136e8c9d41edfa5ef3d064062cc.jpg already downloaded
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Ff1%252Fb5f14071738b4357517ae91c97b79444%252Fpa%252FGC04938_88968f8b3ed7736663f09cf03592cd22.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_88968f8b3ed7736663f09cf03592cd22.jpg already downloaded
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Ff1%252Fb5f14071738b4357517ae91c97b79444%252Fpa%252FGC04938_ee34d41633b15efe471d0ef4c84c3374.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_ee34d41633b15efe471d0ef4c84c3374.jpg already downloaded
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Ff1%252Fb5f14071738b4357517ae91c97b79444%252Fpa%252FGC04938_377f78a98bd5aa376180fef3cd7d2920.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_377f78a98bd5aa376180fef3cd7d2920.jpg already downloaded
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Ff1%252Fb5f14071738b4357517ae91c97b79444%252Fpa%252FGC04938_476f034254574025c722cc51ef46d994.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_476f034254574025c722cc51ef46d994.jpg already downloaded
2026-03-27 10:45:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d782adae-621d-5fef-a03f-a677a8b4cb84, identifier: GC04938
2026-03-27 10:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e620f3e6-49a7-5678-840b-c8020f1d696c with identifier: HB95489
2026-03-27 10:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e620f3e6-49a7-5678-840b-c8020f1d696c with scrape type 1
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e620f3e6-49a7-5678-840b-c8020f1d696c
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe7%252F79e7e68d2433c9e4d765a406e6f5c046%252Fpa%252FHB95489_d2eb828a4ed257ebe854ad293eed483d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_d2eb828a4ed257ebe854ad293eed483d.jpg not downloaded yet
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001d6b90>
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2717c145-1d62-520f-9847-00fdf35aaef0/2717c145-1d62-520f-9847-00fdf35aaef0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff6%252F26f6acf917e0b4d3a6ac809f0aa8e2b6%252Fpa%252FNG10221_8f406ae1c268334a763a4e3362fe6ecb.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_8f406ae1c268334a763a4e3362fe6ecb.jpg saved to cache
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2717c145-1d62-520f-9847-00fdf35aaef0
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004c5650>
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a27e591-12a2-519c-afee-8da7428cc02c/9a27e591-12a2-519c-afee-8da7428cc02c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fc8%252Fcdc8d0a6994ceda45d66be08f534afbf%252Fpa%252FKY59799_8760e05a1582076e09322143b7f06dc1.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_8760e05a1582076e09322143b7f06dc1.jpg saved to cache
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a27e591-12a2-519c-afee-8da7428cc02c
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50378d9d0>
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2717c145-1d62-520f-9847-00fdf35aaef0/2717c145-1d62-520f-9847-00fdf35aaef0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff6%252F26f6acf917e0b4d3a6ac809f0aa8e2b6%252Fpa%252FNG10221_d08d1d5f5f6f050dc07eae08d4ad122e.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_d08d1d5f5f6f050dc07eae08d4ad122e.jpg saved to cache
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2717c145-1d62-520f-9847-00fdf35aaef0
2026-03-27 10:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_f74ae6d924287683f298cefb1535d8ef.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:23 [auto1.de] INFO: Found listing with ID: HL77146
2026-03-27 10:45:23 [auto1.de] INFO: Found listing with ID: RM91715
2026-03-27 10:45:23 [auto1.de] INFO: Found listing with ID: WC14239
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC14239%27 HTTP/1.1" 200 None
2026-03-27 10:45:23 [auto1.de] INFO: Scrape type for WC14239: 2
2026-03-27 10:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f728d3a-6c70-568d-9d02-6ed7b5d83f21 with identifier: WC14239
2026-03-27 10:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f728d3a-6c70-568d-9d02-6ed7b5d83f21 with scrape type 2
2026-03-27 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f728d3a-6c70-568d-9d02-6ed7b5d83f21 with scrape type 2
2026-03-27 10:45:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f728d3a-6c70-568d-9d02-6ed7b5d83f21, identifier: WC14239
2026-03-27 10:45:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d782adae-621d-5fef-a03f-a677a8b4cb84 with identifier: GC04938
2026-03-27 10:45:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d782adae-621d-5fef-a03f-a677a8b4cb84 with identifier: GC04938
2026-03-27 10:45:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d782adae-621d-5fef-a03f-a677a8b4cb84 with identifier: GC04938 to the API
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GC04938>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:47:07Z',
 'fuel_type': 'hybrid',
 'id': 'd782adae-621d-5fef-a03f-a677a8b4cb84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC04938',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 45127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_3c4f8d205ffdfdc67d4dabaf3551f140.jpg',
                'https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_05fff8769fa037efbd08fee8f7fe7c88.jpg',
                'https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_0776414f2354f68681483ecb8b40e338.jpg',
                'https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_208c7cc3e97bcbe35945c197e5b37016.jpg',
                'https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_ba6b15e8641aab85d1ade578baf943f1.jpg',
                'https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_16602136e8c9d41edfa5ef3d064062cc.jpg',
                'https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_88968f8b3ed7736663f09cf03592cd22.jpg',
                'https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_ee34d41633b15efe471d0ef4c84c3374.jpg',
                'https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_377f78a98bd5aa376180fef3cd7d2920.jpg',
                'https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_476f034254574025c722cc51ef46d994.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d782adae-621d-5fef-a03f-a677a8b4cb84/d782adae-621d-5fef-a03f-a677a8b4cb84_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_3c4f8d205ffdfdc67d4dabaf3551f140.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d782adae-621d-5fef-a03f-a677a8b4cb84/d782adae-621d-5fef-a03f-a677a8b4cb84_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_05fff8769fa037efbd08fee8f7fe7c88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d782adae-621d-5fef-a03f-a677a8b4cb84/d782adae-621d-5fef-a03f-a677a8b4cb84_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_0776414f2354f68681483ecb8b40e338.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d782adae-621d-5fef-a03f-a677a8b4cb84/d782adae-621d-5fef-a03f-a677a8b4cb84_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_208c7cc3e97bcbe35945c197e5b37016.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d782adae-621d-5fef-a03f-a677a8b4cb84/d782adae-621d-5fef-a03f-a677a8b4cb84_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_ba6b15e8641aab85d1ade578baf943f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d782adae-621d-5fef-a03f-a677a8b4cb84/d782adae-621d-5fef-a03f-a677a8b4cb84_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_16602136e8c9d41edfa5ef3d064062cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d782adae-621d-5fef-a03f-a677a8b4cb84/d782adae-621d-5fef-a03f-a677a8b4cb84_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_88968f8b3ed7736663f09cf03592cd22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d782adae-621d-5fef-a03f-a677a8b4cb84/d782adae-621d-5fef-a03f-a677a8b4cb84_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_ee34d41633b15efe471d0ef4c84c3374.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d782adae-621d-5fef-a03f-a677a8b4cb84/d782adae-621d-5fef-a03f-a677a8b4cb84_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_377f78a98bd5aa376180fef3cd7d2920.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d782adae-621d-5fef-a03f-a677a8b4cb84/d782adae-621d-5fef-a03f-a677a8b4cb84_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/f1/b5f14071738b4357517ae91c97b79444/pa/GC04938_476f034254574025c722cc51ef46d994.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Grandland X 1.6 Plug-in Hybrid Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2021}
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC04938%27 HTTP/1.1" 200 None
2026-03-27 10:45:24 [auto1.de] INFO: Saving data for GC04938: {'created_time': 1774608324.393389, 'last_price_update_time': 1774608324.393401, 'auction_closing_time': 1774716427.0}
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC04938') HTTP/1.1" 204 0
2026-03-27 10:45:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f728d3a-6c70-568d-9d02-6ed7b5d83f21 with identifier: WC14239
2026-03-27 10:45:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f728d3a-6c70-568d-9d02-6ed7b5d83f21 with identifier: WC14239
2026-03-27 10:45:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f728d3a-6c70-568d-9d02-6ed7b5d83f21 with identifier: WC14239 to the API
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:02:24Z',
 'fuel_type': 'petrol',
 'id': '1f728d3a-6c70-568d-9d02-6ed7b5d83f21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC14239',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 80783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-04',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI Performance BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI Performance BlueMotion',
 'year': 2019}
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC14239%27 HTTP/1.1" 200 None
2026-03-27 10:45:25 [auto1.de] INFO: Saving data for WC14239: {'auction_closing_time': 1774713744.0, 'created_time': 1773402596.624837, 'last_price_update_time': 1774608325.009087}
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC14239') HTTP/1.1" 204 0
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe7%252F79e7e68d2433c9e4d765a406e6f5c046%252Fpa%252FHB95489_90123f7b7968a018bbba89b4d31cc41c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_90123f7b7968a018bbba89b4d31cc41c.jpg not downloaded yet
2026-03-27 10:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500321a50>
2026-03-27 10:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a27e591-12a2-519c-afee-8da7428cc02c/9a27e591-12a2-519c-afee-8da7428cc02c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fc8%252Fcdc8d0a6994ceda45d66be08f534afbf%252Fpa%252FKY59799_021e0d73e8a8102bd8afda18a0ec641c.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_021e0d73e8a8102bd8afda18a0ec641c.jpg saved to cache
2026-03-27 10:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a27e591-12a2-519c-afee-8da7428cc02c
2026-03-27 10:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_0f909ad531adceb52c889b562948b263.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:25 [auto1.de] INFO: Found listing with ID: MP24640
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP24640%27 HTTP/1.1" 200 None
2026-03-27 10:45:25 [auto1.de] INFO: Scrape type for MP24640: 2
2026-03-27 10:45:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ace37f9f-d718-5388-a123-c681744a6d41 with identifier: MP24640
2026-03-27 10:45:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ace37f9f-d718-5388-a123-c681744a6d41 with scrape type 2
2026-03-27 10:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ace37f9f-d718-5388-a123-c681744a6d41 with scrape type 2
2026-03-27 10:45:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ace37f9f-d718-5388-a123-c681744a6d41, identifier: MP24640
2026-03-27 10:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_4968c6f6959398365edc43d0d0cc773e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_b60a8d293f59898678c12c808f946225.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ace37f9f-d718-5388-a123-c681744a6d41 with identifier: MP24640
2026-03-27 10:45:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ace37f9f-d718-5388-a123-c681744a6d41 with identifier: MP24640
2026-03-27 10:45:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ace37f9f-d718-5388-a123-c681744a6d41 with identifier: MP24640 to the API
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:13:57Z',
 'fuel_type': 'petrol',
 'id': 'ace37f9f-d718-5388-a123-c681744a6d41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP24640',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 71741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Allstar BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2017}
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP24640%27 HTTP/1.1" 200 None
2026-03-27 10:45:25 [auto1.de] INFO: Saving data for MP24640: {'auction_closing_time': 1774714437.0, 'created_time': 1773858927.865826, 'last_price_update_time': 1774608325.641405}
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP24640') HTTP/1.1" 204 0
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe7%252F79e7e68d2433c9e4d765a406e6f5c046%252Fpa%252FHB95489_c3bcea0f0e18ab0c26d323662bb40cbc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_c3bcea0f0e18ab0c26d323662bb40cbc.jpg not downloaded yet
2026-03-27 10:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_b16fb352d8311d8e5f3f04301ac708c8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:25 [auto1.de] INFO: Found listing with ID: BX52940
2026-03-27 10:45:25 [auto1.de] INFO: Found listing with ID: HA89104
2026-03-27 10:45:25 [auto1.de] INFO: Found listing with ID: XB63753
2026-03-27 10:45:25 [auto1.de] INFO: Found listing with ID: TT59921
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT59921%27 HTTP/1.1" 200 None
2026-03-27 10:45:25 [auto1.de] INFO: Scrape type for TT59921: 2
2026-03-27 10:45:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acd8a982-625c-5cc1-9e30-0472ae648a22 with identifier: TT59921
2026-03-27 10:45:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acd8a982-625c-5cc1-9e30-0472ae648a22 with scrape type 2
2026-03-27 10:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acd8a982-625c-5cc1-9e30-0472ae648a22 with scrape type 2
2026-03-27 10:45:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acd8a982-625c-5cc1-9e30-0472ae648a22, identifier: TT59921
2026-03-27 10:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001cd910>
2026-03-27 10:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2717c145-1d62-520f-9847-00fdf35aaef0/2717c145-1d62-520f-9847-00fdf35aaef0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff6%252F26f6acf917e0b4d3a6ac809f0aa8e2b6%252Fpa%252FNG10221_f74ae6d924287683f298cefb1535d8ef.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_f74ae6d924287683f298cefb1535d8ef.jpg saved to cache
2026-03-27 10:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2717c145-1d62-520f-9847-00fdf35aaef0
2026-03-27 10:45:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acd8a982-625c-5cc1-9e30-0472ae648a22 with identifier: TT59921
2026-03-27 10:45:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acd8a982-625c-5cc1-9e30-0472ae648a22 with identifier: TT59921
2026-03-27 10:45:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acd8a982-625c-5cc1-9e30-0472ae648a22 with identifier: TT59921 to the API
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:28:52Z',
 'fuel_type': 'diesel',
 'id': 'acd8a982-625c-5cc1-9e30-0472ae648a22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT59921',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 226844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2011}
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT59921%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [auto1.de] INFO: Saving data for TT59921: {'auction_closing_time': 1774715332.0, 'created_time': 1773687239.829686, 'last_price_update_time': 1774608326.380929}
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT59921') HTTP/1.1" 204 0
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe7%252F79e7e68d2433c9e4d765a406e6f5c046%252Fpa%252FHB95489_64e10acedd02549cc2144064f17560cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_64e10acedd02549cc2144064f17560cf.jpg not downloaded yet
2026-03-27 10:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_2479bb2a14695ec42f04373a4b221399.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:26 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV52621%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [auto1.de] INFO: Scrape type for KV52621: 2
2026-03-27 10:45:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd5ebeff-de36-58b5-919c-e1f530f0f5c2 with identifier: KV52621
2026-03-27 10:45:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd5ebeff-de36-58b5-919c-e1f530f0f5c2 with scrape type 2
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd5ebeff-de36-58b5-919c-e1f530f0f5c2 with scrape type 2
2026-03-27 10:45:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd5ebeff-de36-58b5-919c-e1f530f0f5c2, identifier: KV52621
2026-03-27 10:45:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd5ebeff-de36-58b5-919c-e1f530f0f5c2 with identifier: KV52621
2026-03-27 10:45:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd5ebeff-de36-58b5-919c-e1f530f0f5c2 with identifier: KV52621
2026-03-27 10:45:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd5ebeff-de36-58b5-919c-e1f530f0f5c2 with identifier: KV52621 to the API
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:04:03Z',
 'fuel_type': 'petrol',
 'id': 'dd5ebeff-de36-58b5-919c-e1f530f0f5c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV52621',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 171478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-28',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.4 Dynamic',
 'transmission': 'automatic',
 'trim': 'Dynamic',
 'year': 2011}
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV52621%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [auto1.de] INFO: Saving data for KV52621: {'auction_closing_time': 1774713843.0, 'created_time': 1774291108.598519, 'last_price_update_time': 1774608326.882528}
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV52621') HTTP/1.1" 204 0
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe7%252F79e7e68d2433c9e4d765a406e6f5c046%252Fpa%252FHB95489_0ff9223239042198ca3d4352660698bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_0ff9223239042198ca3d4352660698bf.jpg not downloaded yet
2026-03-27 10:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TG96584> (referer: https://www.auto1.com/v1/car-details-view/TG96584/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500339e10>
2026-03-27 10:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a27e591-12a2-519c-afee-8da7428cc02c/9a27e591-12a2-519c-afee-8da7428cc02c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fc8%252Fcdc8d0a6994ceda45d66be08f534afbf%252Fpa%252FKY59799_0f909ad531adceb52c889b562948b263.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_0f909ad531adceb52c889b562948b263.jpg saved to cache
2026-03-27 10:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a27e591-12a2-519c-afee-8da7428cc02c
2026-03-27 10:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500436bd0>
2026-03-27 10:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8705a19a-76d9-5f20-b84b-fd75a0cecf27/8705a19a-76d9-5f20-b84b-fd75a0cecf27_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F69%252F2a6979e75847faf2423d079579b84ac2%252Fpa%252FHK36179_4968c6f6959398365edc43d0d0cc773e.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_4968c6f6959398365edc43d0d0cc773e.jpg saved to cache
2026-03-27 10:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8705a19a-76d9-5f20-b84b-fd75a0cecf27
2026-03-27 10:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50049ae90>
2026-03-27 10:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8705a19a-76d9-5f20-b84b-fd75a0cecf27/8705a19a-76d9-5f20-b84b-fd75a0cecf27_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F69%252F2a6979e75847faf2423d079579b84ac2%252Fpa%252FHK36179_b60a8d293f59898678c12c808f946225.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_b60a8d293f59898678c12c808f946225.jpg saved to cache
2026-03-27 10:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8705a19a-76d9-5f20-b84b-fd75a0cecf27
2026-03-27 10:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501683410>
2026-03-27 10:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2717c145-1d62-520f-9847-00fdf35aaef0/2717c145-1d62-520f-9847-00fdf35aaef0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff6%252F26f6acf917e0b4d3a6ac809f0aa8e2b6%252Fpa%252FNG10221_b16fb352d8311d8e5f3f04301ac708c8.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_b16fb352d8311d8e5f3f04301ac708c8.jpg saved to cache
2026-03-27 10:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2717c145-1d62-520f-9847-00fdf35aaef0
2026-03-27 10:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_d2eb828a4ed257ebe854ad293eed483d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_a63857bcf9228a8f4e05cc97bd202e71.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:27 [auto1.de] INFO: Found listing with ID: XB43693
2026-03-27 10:45:27 [auto1.de] INFO: Found listing with ID: FV41920
2026-03-27 10:45:27 [auto1.de] INFO: Found listing with ID: SR15436
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR15436%27 HTTP/1.1" 200 None
2026-03-27 10:45:27 [auto1.de] INFO: Scrape type for SR15436: 2
2026-03-27 10:45:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 039c0a14-9801-5631-9175-8fbdb9cb9c4f with identifier: SR15436
2026-03-27 10:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 039c0a14-9801-5631-9175-8fbdb9cb9c4f with scrape type 2
2026-03-27 10:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 039c0a14-9801-5631-9175-8fbdb9cb9c4f with scrape type 2
2026-03-27 10:45:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 039c0a14-9801-5631-9175-8fbdb9cb9c4f, identifier: SR15436
2026-03-27 10:45:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 039c0a14-9801-5631-9175-8fbdb9cb9c4f with identifier: SR15436
2026-03-27 10:45:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 039c0a14-9801-5631-9175-8fbdb9cb9c4f with identifier: SR15436
2026-03-27 10:45:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 039c0a14-9801-5631-9175-8fbdb9cb9c4f with identifier: SR15436 to the API
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:49:28Z',
 'fuel_type': 'diesel',
 'id': '039c0a14-9801-5631-9175-8fbdb9cb9c4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR15436',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 149497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-01',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 d T 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': 'T 4Matic AMG Line',
 'year': 2019}
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR15436%27 HTTP/1.1" 200 None
2026-03-27 10:45:27 [auto1.de] INFO: Saving data for SR15436: {'auction_closing_time': 1774716568.0, 'created_time': 1773402586.172188, 'last_price_update_time': 1774608327.631121}
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR15436') HTTP/1.1" 204 0
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe7%252F79e7e68d2433c9e4d765a406e6f5c046%252Fpa%252FHB95489_3ff69c44efc23d51d87e2cf8e62758fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_3ff69c44efc23d51d87e2cf8e62758fa.jpg not downloaded yet
2026-03-27 10:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA39027> (referer: https://www.auto1.com/v1/car-details-view/LA39027/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017295d0>
2026-03-27 10:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8705a19a-76d9-5f20-b84b-fd75a0cecf27/8705a19a-76d9-5f20-b84b-fd75a0cecf27_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F69%252F2a6979e75847faf2423d079579b84ac2%252Fpa%252FHK36179_2479bb2a14695ec42f04373a4b221399.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_2479bb2a14695ec42f04373a4b221399.jpg saved to cache
2026-03-27 10:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8705a19a-76d9-5f20-b84b-fd75a0cecf27
2026-03-27 10:45:27 [auto1.de] INFO: Found listing with ID: JR30174
2026-03-27 10:45:27 [auto1.de] INFO: Found listing with ID: FG98454
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG98454%27 HTTP/1.1" 200 None
2026-03-27 10:45:27 [auto1.de] INFO: Scrape type for FG98454: 2
2026-03-27 10:45:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 135badff-bd07-5ffe-bd4f-6037c314d211 with identifier: FG98454
2026-03-27 10:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 135badff-bd07-5ffe-bd4f-6037c314d211 with scrape type 2
2026-03-27 10:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 135badff-bd07-5ffe-bd4f-6037c314d211 with scrape type 2
2026-03-27 10:45:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 135badff-bd07-5ffe-bd4f-6037c314d211, identifier: FG98454
2026-03-27 10:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_90123f7b7968a018bbba89b4d31cc41c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 135badff-bd07-5ffe-bd4f-6037c314d211 with identifier: FG98454
2026-03-27 10:45:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 135badff-bd07-5ffe-bd4f-6037c314d211 with identifier: FG98454
2026-03-27 10:45:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 135badff-bd07-5ffe-bd4f-6037c314d211 with identifier: FG98454 to the API
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:24:52Z',
 'fuel_type': 'diesel',
 'id': '135badff-bd07-5ffe-bd4f-6037c314d211',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG98454',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 282080,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-24',
 'seller_name': None,
 'title': 'Volvo V70 2.4 D Kinetic',
 'transmission': 'automatic',
 'trim': 'Kinetic',
 'year': 2009}
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG98454%27 HTTP/1.1" 200 None
2026-03-27 10:45:28 [auto1.de] INFO: Saving data for FG98454: {'auction_closing_time': 1774715092.0, 'created_time': 1774263790.541595, 'last_price_update_time': 1774608328.250272}
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG98454') HTTP/1.1" 204 0
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe7%252F79e7e68d2433c9e4d765a406e6f5c046%252Fpa%252FHB95489_4fdd2cd6f086e6f4bd202e7fcc6e6d4a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_4fdd2cd6f086e6f4bd202e7fcc6e6d4a.jpg not downloaded yet
2026-03-27 10:45:28 [auto1.de] INFO: Found listing with ID: NZ04570
2026-03-27 10:45:28 [auto1.de] INFO: Found listing with ID: EE83336
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83336%27 HTTP/1.1" 200 None
2026-03-27 10:45:28 [auto1.de] INFO: Scrape type for EE83336: 2
2026-03-27 10:45:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 772f1e3f-30a9-5257-ba44-451fe8bf54e0 with identifier: EE83336
2026-03-27 10:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 772f1e3f-30a9-5257-ba44-451fe8bf54e0 with scrape type 2
2026-03-27 10:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 772f1e3f-30a9-5257-ba44-451fe8bf54e0 with scrape type 2
2026-03-27 10:45:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 772f1e3f-30a9-5257-ba44-451fe8bf54e0, identifier: EE83336
2026-03-27 10:45:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4 with identifier: TG96584
2026-03-27 10:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4 with scrape type 1
2026-03-27 10:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fd4%252F98d41ff5c2c5120e1a068bbf18704d5d%252Fpa%252FTG96584_22fc2e109899065d922dd22b0d92569a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_22fc2e109899065d922dd22b0d92569a.jpg not downloaded yet
2026-03-27 10:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501728550>
2026-03-27 10:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e620f3e6-49a7-5678-840b-c8020f1d696c/e620f3e6-49a7-5678-840b-c8020f1d696c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe7%252F79e7e68d2433c9e4d765a406e6f5c046%252Fpa%252FHB95489_d2eb828a4ed257ebe854ad293eed483d.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_d2eb828a4ed257ebe854ad293eed483d.jpg saved to cache
2026-03-27 10:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e620f3e6-49a7-5678-840b-c8020f1d696c
2026-03-27 10:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501809450>
2026-03-27 10:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2717c145-1d62-520f-9847-00fdf35aaef0/2717c145-1d62-520f-9847-00fdf35aaef0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff6%252F26f6acf917e0b4d3a6ac809f0aa8e2b6%252Fpa%252FNG10221_a63857bcf9228a8f4e05cc97bd202e71.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_a63857bcf9228a8f4e05cc97bd202e71.jpg saved to cache
2026-03-27 10:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2717c145-1d62-520f-9847-00fdf35aaef0
2026-03-27 10:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_bcb4984dd1f8de31de4b3d9810babbf3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_45c15b4f3eaed5a774e8a6d108369b00.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 772f1e3f-30a9-5257-ba44-451fe8bf54e0 with identifier: EE83336
2026-03-27 10:45:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 772f1e3f-30a9-5257-ba44-451fe8bf54e0 with identifier: EE83336
2026-03-27 10:45:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 772f1e3f-30a9-5257-ba44-451fe8bf54e0 with identifier: EE83336 to the API
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 129,
 'expiration_date': '2026-03-28T16:21:50Z',
 'fuel_type': 'petrol',
 'id': '772f1e3f-30a9-5257-ba44-451fe8bf54e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE83336',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4 S-Cross',
 'odometer': 71217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-22',
 'seller_name': None,
 'title': 'Suzuki SX4 S-Cross 1.4 BoosterJet Mild-Hybrid Comfort 4x4',
 'transmission': 'manual',
 'trim': 'Comfort 4x4',
 'year': 2020}
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83336%27 HTTP/1.1" 200 None
2026-03-27 10:45:28 [auto1.de] INFO: Saving data for EE83336: {'auction_closing_time': 1774714910.0, 'created_time': 1773861607.345471, 'last_price_update_time': 1774608328.910991}
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE83336') HTTP/1.1" 204 0
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe7%252F79e7e68d2433c9e4d765a406e6f5c046%252Fpa%252FHB95489_c08f1613e006d44b293a3dca12d243d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_c08f1613e006d44b293a3dca12d243d6.jpg not downloaded yet
2026-03-27 10:45:28 [auto1.de] INFO: Found listing with ID: MK68330
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK68330%27 HTTP/1.1" 200 None
2026-03-27 10:45:28 [auto1.de] INFO: Scrape type for MK68330: 2
2026-03-27 10:45:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48973bba-4eb7-5792-ac31-d9317f2b05dc with identifier: MK68330
2026-03-27 10:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48973bba-4eb7-5792-ac31-d9317f2b05dc with scrape type 2
2026-03-27 10:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48973bba-4eb7-5792-ac31-d9317f2b05dc with scrape type 2
2026-03-27 10:45:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48973bba-4eb7-5792-ac31-d9317f2b05dc, identifier: MK68330
2026-03-27 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fd4%252F98d41ff5c2c5120e1a068bbf18704d5d%252Fpa%252FTG96584_a87f34ca14fde36bd1d880041b7b81a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_a87f34ca14fde36bd1d880041b7b81a2.jpg not downloaded yet
2026-03-27 10:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_64e10acedd02549cc2144064f17560cf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48973bba-4eb7-5792-ac31-d9317f2b05dc with identifier: MK68330
2026-03-27 10:45:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48973bba-4eb7-5792-ac31-d9317f2b05dc with identifier: MK68330
2026-03-27 10:45:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48973bba-4eb7-5792-ac31-d9317f2b05dc with identifier: MK68330 to the API
2026-03-27 10:45:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:39:40Z',
 'fuel_type': 'petrol',
 'id': '48973bba-4eb7-5792-ac31-d9317f2b05dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK68330',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 32237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-30',
 'seller_name': None,
 'title': 'Renault Megane 1.3 TCe Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2019}
2026-03-27 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK68330%27 HTTP/1.1" 200 None
2026-03-27 10:45:30 [auto1.de] INFO: Saving data for MK68330: {'auction_closing_time': 1774715980.0, 'created_time': 1773305686.473593, 'last_price_update_time': 1774608330.431326}
2026-03-27 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK68330') HTTP/1.1" 204 0
2026-03-27 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe7%252F79e7e68d2433c9e4d765a406e6f5c046%252Fpa%252FHB95489_bdf0a4798e8e5dc284ddbbd2b0e94a8f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_bdf0a4798e8e5dc284ddbbd2b0e94a8f.jpg not downloaded yet
2026-03-27 10:45:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8c33c38-7c3a-5b4d-a887-6120b12f3f0c with identifier: LA39027
2026-03-27 10:45:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8c33c38-7c3a-5b4d-a887-6120b12f3f0c with scrape type 1
2026-03-27 10:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8c33c38-7c3a-5b4d-a887-6120b12f3f0c
2026-03-27 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fda%252Fb2da45ec20545949896b1dd08c05615a%252Fpa%252FLA39027_0713ffb105b9539303a27a10496c5b66.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_0713ffb105b9539303a27a10496c5b66.jpg not downloaded yet
2026-03-27 10:45:30 [auto1.de] INFO: Channel: 24h | Page: 33 | totalHits: 10544 | hits on page: 40
2026-03-27 10:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501956f10>
2026-03-27 10:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e620f3e6-49a7-5678-840b-c8020f1d696c/e620f3e6-49a7-5678-840b-c8020f1d696c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe7%252F79e7e68d2433c9e4d765a406e6f5c046%252Fpa%252FHB95489_90123f7b7968a018bbba89b4d31cc41c.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_90123f7b7968a018bbba89b4d31cc41c.jpg saved to cache
2026-03-27 10:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e620f3e6-49a7-5678-840b-c8020f1d696c
2026-03-27 10:45:30 [auto1.de] INFO: Found listing with ID: LZ51858
2026-03-27 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ51858%27 HTTP/1.1" 200 None
2026-03-27 10:45:30 [auto1.de] INFO: Scrape type for LZ51858: 2
2026-03-27 10:45:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05f35297-b75e-5716-a80f-ec691263f1ed with identifier: LZ51858
2026-03-27 10:45:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05f35297-b75e-5716-a80f-ec691263f1ed with scrape type 2
2026-03-27 10:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05f35297-b75e-5716-a80f-ec691263f1ed with scrape type 2
2026-03-27 10:45:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05f35297-b75e-5716-a80f-ec691263f1ed, identifier: LZ51858
2026-03-27 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fd4%252F98d41ff5c2c5120e1a068bbf18704d5d%252Fpa%252FTG96584_75422e48570508327dcf4bd71445e4cb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_75422e48570508327dcf4bd71445e4cb.jpg not downloaded yet
2026-03-27 10:45:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05f35297-b75e-5716-a80f-ec691263f1ed with identifier: LZ51858
2026-03-27 10:45:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05f35297-b75e-5716-a80f-ec691263f1ed with identifier: LZ51858
2026-03-27 10:45:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05f35297-b75e-5716-a80f-ec691263f1ed with identifier: LZ51858 to the API
2026-03-27 10:45:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:14:05Z',
 'fuel_type': 'diesel',
 'id': '05f35297-b75e-5716-a80f-ec691263f1ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ51858',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 397963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-27',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2017}
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ51858%27 HTTP/1.1" 200 None
2026-03-27 10:45:31 [auto1.de] INFO: Saving data for LZ51858: {'auction_closing_time': 1774714445.0, 'created_time': 1773861292.230411, 'last_price_update_time': 1774608331.427469}
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ51858') HTTP/1.1" 204 0
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe7%252F79e7e68d2433c9e4d765a406e6f5c046%252Fpa%252FHB95489_1bd8b6db51020e78828b2f2ca127feac.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_1bd8b6db51020e78828b2f2ca127feac.jpg not downloaded yet
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fda%252Fb2da45ec20545949896b1dd08c05615a%252Fpa%252FLA39027_e70ba10f5418c27a8ec9caf7fb8fc3b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_e70ba10f5418c27a8ec9caf7fb8fc3b6.jpg not downloaded yet
2026-03-27 10:45:31 [auto1.de] INFO: Found listing with ID: LD21016
2026-03-27 10:45:31 [auto1.de] INFO: Found listing with ID: EN87643
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN87643%27 HTTP/1.1" 200 None
2026-03-27 10:45:31 [auto1.de] INFO: Scrape type for EN87643: 1
2026-03-27 10:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_c3bcea0f0e18ab0c26d323662bb40cbc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_0ff9223239042198ca3d4352660698bf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:31 [auto1.de] INFO: Found listing with ID: MM87204
2026-03-27 10:45:31 [auto1.de] INFO: Found listing with ID: DL95738
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95738%27 HTTP/1.1" 200 None
2026-03-27 10:45:31 [auto1.de] INFO: Scrape type for DL95738: 2
2026-03-27 10:45:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 187cd142-355a-50cf-9ea4-36b7f4144508 with identifier: DL95738
2026-03-27 10:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 187cd142-355a-50cf-9ea4-36b7f4144508 with scrape type 2
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 187cd142-355a-50cf-9ea4-36b7f4144508 with scrape type 2
2026-03-27 10:45:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 187cd142-355a-50cf-9ea4-36b7f4144508, identifier: DL95738
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fd4%252F98d41ff5c2c5120e1a068bbf18704d5d%252Fpa%252FTG96584_e3d4ba411cad1862cb1820ecdcf7f1b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_e3d4ba411cad1862cb1820ecdcf7f1b8.jpg not downloaded yet
2026-03-27 10:45:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003c03d0>
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2717c145-1d62-520f-9847-00fdf35aaef0/2717c145-1d62-520f-9847-00fdf35aaef0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff6%252F26f6acf917e0b4d3a6ac809f0aa8e2b6%252Fpa%252FNG10221_bcb4984dd1f8de31de4b3d9810babbf3.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_bcb4984dd1f8de31de4b3d9810babbf3.jpg saved to cache
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2717c145-1d62-520f-9847-00fdf35aaef0
2026-03-27 10:45:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2717c145-1d62-520f-9847-00fdf35aaef0, skipping ID generation
2026-03-27 10:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2717c145-1d62-520f-9847-00fdf35aaef0 with scrape type 1
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2717c145-1d62-520f-9847-00fdf35aaef0 sending to next pipeline
2026-03-27 10:45:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2717c145-1d62-520f-9847-00fdf35aaef0, identifier: NG10221
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501823490>
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8705a19a-76d9-5f20-b84b-fd75a0cecf27/8705a19a-76d9-5f20-b84b-fd75a0cecf27_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F69%252F2a6979e75847faf2423d079579b84ac2%252Fpa%252FHK36179_45c15b4f3eaed5a774e8a6d108369b00.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_45c15b4f3eaed5a774e8a6d108369b00.jpg saved to cache
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8705a19a-76d9-5f20-b84b-fd75a0cecf27
2026-03-27 10:45:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8705a19a-76d9-5f20-b84b-fd75a0cecf27, skipping ID generation
2026-03-27 10:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8705a19a-76d9-5f20-b84b-fd75a0cecf27 with scrape type 1
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8705a19a-76d9-5f20-b84b-fd75a0cecf27 sending to next pipeline
2026-03-27 10:45:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8705a19a-76d9-5f20-b84b-fd75a0cecf27, identifier: HK36179
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500221690>
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e620f3e6-49a7-5678-840b-c8020f1d696c/e620f3e6-49a7-5678-840b-c8020f1d696c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe7%252F79e7e68d2433c9e4d765a406e6f5c046%252Fpa%252FHB95489_64e10acedd02549cc2144064f17560cf.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_64e10acedd02549cc2144064f17560cf.jpg saved to cache
2026-03-27 10:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e620f3e6-49a7-5678-840b-c8020f1d696c
2026-03-27 10:45:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 187cd142-355a-50cf-9ea4-36b7f4144508 with identifier: DL95738
2026-03-27 10:45:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 187cd142-355a-50cf-9ea4-36b7f4144508 with identifier: DL95738
2026-03-27 10:45:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 187cd142-355a-50cf-9ea4-36b7f4144508 with identifier: DL95738 to the API
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:51:30Z',
 'fuel_type': 'petrol',
 'id': '187cd142-355a-50cf-9ea4-36b7f4144508',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL95738',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S40',
 'odometer': 124598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-30',
 'seller_name': None,
 'title': 'Volvo S40 1.8',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95738%27 HTTP/1.1" 200 None
2026-03-27 10:45:32 [auto1.de] INFO: Saving data for DL95738: {'auction_closing_time': 1774716690.0, 'created_time': 1773688963.872421, 'last_price_update_time': 1774608332.330481}
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL95738') HTTP/1.1" 204 0
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fda%252Fb2da45ec20545949896b1dd08c05615a%252Fpa%252FLA39027_6fb6f02d51dfab56456dcc630e1132c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_6fb6f02d51dfab56456dcc630e1132c2.jpg not downloaded yet
2026-03-27 10:45:32 [auto1.de] INFO: Found listing with ID: WK73698
2026-03-27 10:45:32 [auto1.de] INFO: Found listing with ID: VL16221
2026-03-27 10:45:32 [auto1.de] INFO: Found listing with ID: GE21325
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE21325%27 HTTP/1.1" 200 None
2026-03-27 10:45:32 [auto1.de] INFO: Scrape type for GE21325: 2
2026-03-27 10:45:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8 with identifier: GE21325
2026-03-27 10:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8 with scrape type 2
2026-03-27 10:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8 with scrape type 2
2026-03-27 10:45:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8, identifier: GE21325
2026-03-27 10:45:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2717c145-1d62-520f-9847-00fdf35aaef0 with identifier: NG10221
2026-03-27 10:45:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2717c145-1d62-520f-9847-00fdf35aaef0 with identifier: NG10221
2026-03-27 10:45:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2717c145-1d62-520f-9847-00fdf35aaef0 with identifier: NG10221 to the API
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_bcb4984dd1f8de31de4b3d9810babbf3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:43:29Z',
 'fuel_type': 'diesel',
 'id': '2717c145-1d62-520f-9847-00fdf35aaef0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG10221',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 145040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2717c145-1d62-520f-9847-00fdf35aaef0/2717c145-1d62-520f-9847-00fdf35aaef0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_bcb4984dd1f8de31de4b3d9810babbf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2717c145-1d62-520f-9847-00fdf35aaef0/2717c145-1d62-520f-9847-00fdf35aaef0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_01e43677ade9e06b71edbe5ec77a429f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2717c145-1d62-520f-9847-00fdf35aaef0/2717c145-1d62-520f-9847-00fdf35aaef0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_a63857bcf9228a8f4e05cc97bd202e71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2717c145-1d62-520f-9847-00fdf35aaef0/2717c145-1d62-520f-9847-00fdf35aaef0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_b16fb352d8311d8e5f3f04301ac708c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2717c145-1d62-520f-9847-00fdf35aaef0/2717c145-1d62-520f-9847-00fdf35aaef0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_8f406ae1c268334a763a4e3362fe6ecb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2717c145-1d62-520f-9847-00fdf35aaef0/2717c145-1d62-520f-9847-00fdf35aaef0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_e19383a8ee113b1d778e97a121148c4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2717c145-1d62-520f-9847-00fdf35aaef0/2717c145-1d62-520f-9847-00fdf35aaef0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_6c33ae6bdc69278ccf2793d64e50f4e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2717c145-1d62-520f-9847-00fdf35aaef0/2717c145-1d62-520f-9847-00fdf35aaef0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_fbef568b4fd3ce90c72b4dc2360fe84f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2717c145-1d62-520f-9847-00fdf35aaef0/2717c145-1d62-520f-9847-00fdf35aaef0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_f74ae6d924287683f298cefb1535d8ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2717c145-1d62-520f-9847-00fdf35aaef0/2717c145-1d62-520f-9847-00fdf35aaef0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f6/26f6acf917e0b4d3a6ac809f0aa8e2b6/pa/NG10221_d08d1d5f5f6f050dc07eae08d4ad122e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2015}
2026-03-27 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG10221%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [auto1.de] INFO: Saving data for NG10221: {'created_time': 1774608333.001277, 'last_price_update_time': 1774608333.00129, 'auction_closing_time': 1774716209.0}
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG10221') HTTP/1.1" 204 0
2026-03-27 10:45:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8705a19a-76d9-5f20-b84b-fd75a0cecf27 with identifier: HK36179
2026-03-27 10:45:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8705a19a-76d9-5f20-b84b-fd75a0cecf27 with identifier: HK36179
2026-03-27 10:45:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8705a19a-76d9-5f20-b84b-fd75a0cecf27 with identifier: HK36179 to the API
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_45c15b4f3eaed5a774e8a6d108369b00.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 114,
 'expiration_date': '2026-03-28T16:36:48Z',
 'fuel_type': 'petrol',
 'id': '8705a19a-76d9-5f20-b84b-fd75a0cecf27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK36179',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 37244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8705a19a-76d9-5f20-b84b-fd75a0cecf27/8705a19a-76d9-5f20-b84b-fd75a0cecf27_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_0bf5c28e13f4540795cb2d7fb8e6cd70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8705a19a-76d9-5f20-b84b-fd75a0cecf27/8705a19a-76d9-5f20-b84b-fd75a0cecf27_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_45c15b4f3eaed5a774e8a6d108369b00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8705a19a-76d9-5f20-b84b-fd75a0cecf27/8705a19a-76d9-5f20-b84b-fd75a0cecf27_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_776430c9b65c2e44703f4f95a6fa80bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8705a19a-76d9-5f20-b84b-fd75a0cecf27/8705a19a-76d9-5f20-b84b-fd75a0cecf27_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_baba07c1cbe4ca8ee3d6bd5af41bfa02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8705a19a-76d9-5f20-b84b-fd75a0cecf27/8705a19a-76d9-5f20-b84b-fd75a0cecf27_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_8548f3b57458cd38f3707dabc0c70e0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8705a19a-76d9-5f20-b84b-fd75a0cecf27/8705a19a-76d9-5f20-b84b-fd75a0cecf27_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1703061,
             'Height': 2142,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_4968c6f6959398365edc43d0d0cc773e.jpg',
             'Width': 2856},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8705a19a-76d9-5f20-b84b-fd75a0cecf27/8705a19a-76d9-5f20-b84b-fd75a0cecf27_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_2479bb2a14695ec42f04373a4b221399.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8705a19a-76d9-5f20-b84b-fd75a0cecf27/8705a19a-76d9-5f20-b84b-fd75a0cecf27_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_b60a8d293f59898678c12c808f946225.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8705a19a-76d9-5f20-b84b-fd75a0cecf27/8705a19a-76d9-5f20-b84b-fd75a0cecf27_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_60cc99c37424344d30bad5845f57bd92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8705a19a-76d9-5f20-b84b-fd75a0cecf27/8705a19a-76d9-5f20-b84b-fd75a0cecf27_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/69/2a6979e75847faf2423d079579b84ac2/pa/HK36179_570e200b60b6502af9fba7241bd13396.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-01',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.5 TSI Maxi',
 'transmission': 'manual',
 'trim': 'Maxi',
 'year': 2022}
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK36179%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [auto1.de] INFO: Saving data for HK36179: {'created_time': 1774608333.531908, 'last_price_update_time': 1774608333.53193, 'auction_closing_time': 1774715808.0}
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK36179') HTTP/1.1" 204 0
2026-03-27 10:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_a48a1c208e537d5a6a0eeef51cebb8a0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fd4%252F98d41ff5c2c5120e1a068bbf18704d5d%252Fpa%252FTG96584_90ea3cdf7d5d12fbdaba6a97f3112d4d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_90ea3cdf7d5d12fbdaba6a97f3112d4d.jpg not downloaded yet
2026-03-27 10:45:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8 with identifier: GE21325
2026-03-27 10:45:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8 with identifier: GE21325
2026-03-27 10:45:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8 with identifier: GE21325 to the API
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-28T16:21:46Z',
 'fuel_type': 'petrol',
 'id': '76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE21325',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 46070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-03',
 'seller_name': None,
 'title': 'Hyundai i30 2.0 T-GDI N Performance',
 'transmission': 'automatic',
 'trim': 'N Performance',
 'year': 2023}
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE21325%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [auto1.de] INFO: Saving data for GE21325: {'auction_closing_time': 1774714906.0, 'created_time': 1774293452.408471, 'last_price_update_time': 1774608334.067339}
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE21325') HTTP/1.1" 204 0
2026-03-27 10:45:34 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 133.364(s), this was the 1st time calling it.
2026-03-27 10:45:34 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.759854591193049 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-27 10:45:34 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 133.365(s), this was the 1st time calling it.
2026-03-27 10:45:34 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.955109896550425 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fda%252Fb2da45ec20545949896b1dd08c05615a%252Fpa%252FLA39027_522db64c65006545954686ab5f4f0035.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_522db64c65006545954686ab5f4f0035.jpg not downloaded yet
2026-03-27 10:45:34 [auto1.de] INFO: Found listing with ID: XG77480
2026-03-27 10:45:34 [auto1.de] INFO: Found listing with ID: EE47026
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE47026%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [auto1.de] INFO: Scrape type for EE47026: 2
2026-03-27 10:45:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09057ef2-c520-5eca-9db6-88460af5734f with identifier: EE47026
2026-03-27 10:45:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09057ef2-c520-5eca-9db6-88460af5734f with scrape type 2
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09057ef2-c520-5eca-9db6-88460af5734f with scrape type 2
2026-03-27 10:45:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09057ef2-c520-5eca-9db6-88460af5734f, identifier: EE47026
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003e6210>
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e620f3e6-49a7-5678-840b-c8020f1d696c/e620f3e6-49a7-5678-840b-c8020f1d696c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe7%252F79e7e68d2433c9e4d765a406e6f5c046%252Fpa%252FHB95489_c3bcea0f0e18ab0c26d323662bb40cbc.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_c3bcea0f0e18ab0c26d323662bb40cbc.jpg saved to cache
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e620f3e6-49a7-5678-840b-c8020f1d696c
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501958790>
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e620f3e6-49a7-5678-840b-c8020f1d696c/e620f3e6-49a7-5678-840b-c8020f1d696c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe7%252F79e7e68d2433c9e4d765a406e6f5c046%252Fpa%252FHB95489_0ff9223239042198ca3d4352660698bf.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_0ff9223239042198ca3d4352660698bf.jpg saved to cache
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e620f3e6-49a7-5678-840b-c8020f1d696c
2026-03-27 10:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_3ff69c44efc23d51d87e2cf8e62758fa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/42/dd42162d4c5752d4f302d560996b1aed/pa/CR70146_15a85a51b962606ac9dd3819514c2ce6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fd4%252F98d41ff5c2c5120e1a068bbf18704d5d%252Fpa%252FTG96584_65be8aeebebe9558fa7a0d07fa42a3a9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_65be8aeebebe9558fa7a0d07fa42a3a9.jpg not downloaded yet
2026-03-27 10:45:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09057ef2-c520-5eca-9db6-88460af5734f with identifier: EE47026
2026-03-27 10:45:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09057ef2-c520-5eca-9db6-88460af5734f with identifier: EE47026
2026-03-27 10:45:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09057ef2-c520-5eca-9db6-88460af5734f with identifier: EE47026 to the API
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:14:40Z',
 'fuel_type': 'diesel',
 'id': '09057ef2-c520-5eca-9db6-88460af5734f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE47026',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 95412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-24',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 3.0 CDI kompakt BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'kompakt BlueEfficiency Avantgarde',
 'year': 2013}
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE47026%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [auto1.de] INFO: Saving data for EE47026: {'auction_closing_time': 1774714480.0, 'created_time': 1774293542.633676, 'last_price_update_time': 1774608334.754894}
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE47026') HTTP/1.1" 204 0
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fda%252Fb2da45ec20545949896b1dd08c05615a%252Fpa%252FLA39027_ec8c82b938f09a22e2fe78f27e104f47.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_ec8c82b938f09a22e2fe78f27e104f47.jpg not downloaded yet
2026-03-27 10:45:34 [auto1.de] INFO: Found listing with ID: DE85774
2026-03-27 10:45:34 [auto1.de] INFO: Found listing with ID: KF55313
2026-03-27 10:45:34 [auto1.de] INFO: Found listing with ID: LZ09190
2026-03-27 10:45:34 [auto1.de] INFO: Found listing with ID: YU55800
2026-03-27 10:45:34 [auto1.de] INFO: Found listing with ID: MM23773
2026-03-27 10:45:34 [auto1.de] INFO: Found listing with ID: FH64312
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH64312%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [auto1.de] INFO: Scrape type for FH64312: 2
2026-03-27 10:45:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9e61d35-35b1-593f-94ad-78ad9d1aaa23 with identifier: FH64312
2026-03-27 10:45:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9e61d35-35b1-593f-94ad-78ad9d1aaa23 with scrape type 2
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9e61d35-35b1-593f-94ad-78ad9d1aaa23 with scrape type 2
2026-03-27 10:45:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9e61d35-35b1-593f-94ad-78ad9d1aaa23, identifier: FH64312
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500224390>
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8/a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fc5%252F84c5fc3cda12e06e51ecd50da8c71478%252Fpa%252FHV64790_a48a1c208e537d5a6a0eeef51cebb8a0.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_a48a1c208e537d5a6a0eeef51cebb8a0.jpg saved to cache
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8
2026-03-27 10:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/f9/dbf91d296f46f5b583c6ab8a6144c019/pa/PE37736_03f09121a3b4f6f4c6b56c9fe30e53c1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fd4%252F98d41ff5c2c5120e1a068bbf18704d5d%252Fpa%252FTG96584_0ddc5ba73141bad2d91ee14a9c8936d2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_0ddc5ba73141bad2d91ee14a9c8936d2.jpg not downloaded yet
2026-03-27 10:45:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9e61d35-35b1-593f-94ad-78ad9d1aaa23 with identifier: FH64312
2026-03-27 10:45:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9e61d35-35b1-593f-94ad-78ad9d1aaa23 with identifier: FH64312
2026-03-27 10:45:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9e61d35-35b1-593f-94ad-78ad9d1aaa23 with identifier: FH64312 to the API
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:59:28Z',
 'fuel_type': 'diesel',
 'id': 'e9e61d35-35b1-593f-94ad-78ad9d1aaa23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH64312',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 191028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-25',
 'seller_name': None,
 'title': 'BMW 5er 525d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2012}
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH64312%27 HTTP/1.1" 200 None
2026-03-27 10:45:35 [auto1.de] INFO: Saving data for FH64312: {'auction_closing_time': 1774717168.0, 'created_time': 1773305674.986573, 'last_price_update_time': 1774608335.288266}
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH64312') HTTP/1.1" 204 0
2026-03-27 10:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_4fdd2cd6f086e6f4bd202e7fcc6e6d4a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/f9/dbf91d296f46f5b583c6ab8a6144c019/pa/PE37736_8945a40faf5becbcf3ab4941a31d87d0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fda%252Fb2da45ec20545949896b1dd08c05615a%252Fpa%252FLA39027_9377f21c1de49cbb8e135c25c2663a18.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_9377f21c1de49cbb8e135c25c2663a18.jpg not downloaded yet
2026-03-27 10:45:35 [auto1.de] INFO: Found listing with ID: PU00921
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU00921%27 HTTP/1.1" 200 None
2026-03-27 10:45:35 [auto1.de] INFO: Scrape type for PU00921: 2
2026-03-27 10:45:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2 with identifier: PU00921
2026-03-27 10:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2 with scrape type 2
2026-03-27 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2 with scrape type 2
2026-03-27 10:45:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2, identifier: PU00921
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fd4%252F98d41ff5c2c5120e1a068bbf18704d5d%252Fpa%252FTG96584_894a6ae8ce0231243272536b250d64c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_894a6ae8ce0231243272536b250d64c5.jpg not downloaded yet
2026-03-27 10:45:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2 with identifier: PU00921
2026-03-27 10:45:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2 with identifier: PU00921
2026-03-27 10:45:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2 with identifier: PU00921 to the API
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:56:07Z',
 'fuel_type': 'diesel',
 'id': 'c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU00921',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 156668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-30',
 'seller_name': None,
 'title': 'Audi A4 40 TDI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2020}
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU00921%27 HTTP/1.1" 200 None
2026-03-27 10:45:35 [auto1.de] INFO: Saving data for PU00921: {'auction_closing_time': 1774716967.0, 'created_time': 1773302655.443431, 'last_price_update_time': 1774608335.803863}
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU00921') HTTP/1.1" 204 0
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50160d5d0>
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e620f3e6-49a7-5678-840b-c8020f1d696c/e620f3e6-49a7-5678-840b-c8020f1d696c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe7%252F79e7e68d2433c9e4d765a406e6f5c046%252Fpa%252FHB95489_3ff69c44efc23d51d87e2cf8e62758fa.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_3ff69c44efc23d51d87e2cf8e62758fa.jpg saved to cache
2026-03-27 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e620f3e6-49a7-5678-840b-c8020f1d696c
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004ab9d0>
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53f36514-15a5-5ecd-b3ef-379629d48d5a/53f36514-15a5-5ecd-b3ef-379629d48d5a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F42%252Fdd42162d4c5752d4f302d560996b1aed%252Fpa%252FCR70146_15a85a51b962606ac9dd3819514c2ce6.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/42/dd42162d4c5752d4f302d560996b1aed/pa/CR70146_15a85a51b962606ac9dd3819514c2ce6.jpg saved to cache
2026-03-27 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53f36514-15a5-5ecd-b3ef-379629d48d5a
2026-03-27 10:45:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53f36514-15a5-5ecd-b3ef-379629d48d5a, skipping ID generation
2026-03-27 10:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53f36514-15a5-5ecd-b3ef-379629d48d5a with scrape type 1
2026-03-27 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53f36514-15a5-5ecd-b3ef-379629d48d5a sending to next pipeline
2026-03-27 10:45:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53f36514-15a5-5ecd-b3ef-379629d48d5a, identifier: CR70146
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fda%252Fb2da45ec20545949896b1dd08c05615a%252Fpa%252FLA39027_c82ffb62e3f17868821c9882695729f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_c82ffb62e3f17868821c9882695729f6.jpg not downloaded yet
2026-03-27 10:45:36 [auto1.de] INFO: Found listing with ID: CB80286
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB80286%27 HTTP/1.1" 200 None
2026-03-27 10:45:36 [auto1.de] INFO: Scrape type for CB80286: 2
2026-03-27 10:45:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c7b28fe-d7cf-5fd1-b6af-a22385996986 with identifier: CB80286
2026-03-27 10:45:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c7b28fe-d7cf-5fd1-b6af-a22385996986 with scrape type 2
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c7b28fe-d7cf-5fd1-b6af-a22385996986 with scrape type 2
2026-03-27 10:45:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c7b28fe-d7cf-5fd1-b6af-a22385996986, identifier: CB80286
2026-03-27 10:45:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53f36514-15a5-5ecd-b3ef-379629d48d5a with identifier: CR70146
2026-03-27 10:45:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53f36514-15a5-5ecd-b3ef-379629d48d5a with identifier: CR70146
2026-03-27 10:45:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53f36514-15a5-5ecd-b3ef-379629d48d5a with identifier: CR70146 to the API
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdd/42/dd42162d4c5752d4f302d560996b1aed/pa/CR70146_15a85a51b962606ac9dd3819514c2ce6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:33:52Z',
 'fuel_type': 'petrol',
 'id': '53f36514-15a5-5ecd-b3ef-379629d48d5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR70146',
 'listing': 'auction',
 'location': 'DE, Kassel',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 68596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53f36514-15a5-5ecd-b3ef-379629d48d5a/53f36514-15a5-5ecd-b3ef-379629d48d5a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/42/dd42162d4c5752d4f302d560996b1aed/pa/CR70146_35fb2504ca2cb054f24cb62302d02573.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53f36514-15a5-5ecd-b3ef-379629d48d5a/53f36514-15a5-5ecd-b3ef-379629d48d5a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/42/dd42162d4c5752d4f302d560996b1aed/pa/CR70146_afb48dc549a53e4d66b0e5807aff13cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53f36514-15a5-5ecd-b3ef-379629d48d5a/53f36514-15a5-5ecd-b3ef-379629d48d5a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/42/dd42162d4c5752d4f302d560996b1aed/pa/CR70146_70e324a6bc2522a8992106de810e7d2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53f36514-15a5-5ecd-b3ef-379629d48d5a/53f36514-15a5-5ecd-b3ef-379629d48d5a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/42/dd42162d4c5752d4f302d560996b1aed/pa/CR70146_15a85a51b962606ac9dd3819514c2ce6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53f36514-15a5-5ecd-b3ef-379629d48d5a/53f36514-15a5-5ecd-b3ef-379629d48d5a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/42/dd42162d4c5752d4f302d560996b1aed/pa/CR70146_b82dd6fd40287b2ca90aa089c4a25545.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-07',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 MyLive',
 'transmission': 'manual',
 'trim': 'MyLive',
 'year': 2011}
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR70146%27 HTTP/1.1" 200 None
2026-03-27 10:45:36 [auto1.de] INFO: Saving data for CR70146: {'created_time': 1774608336.591064, 'last_price_update_time': 1774608336.591081, 'auction_closing_time': 1774715632.0}
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR70146') HTTP/1.1" 204 0
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fd4%252F98d41ff5c2c5120e1a068bbf18704d5d%252Fpa%252FTG96584_1b49aced4ae827c215f4b396cb1dd557.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_1b49aced4ae827c215f4b396cb1dd557.jpg not downloaded yet
2026-03-27 10:45:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c7b28fe-d7cf-5fd1-b6af-a22385996986 with identifier: CB80286
2026-03-27 10:45:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c7b28fe-d7cf-5fd1-b6af-a22385996986 with identifier: CB80286
2026-03-27 10:45:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c7b28fe-d7cf-5fd1-b6af-a22385996986 with identifier: CB80286 to the API
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:20:51Z',
 'fuel_type': 'diesel',
 'id': '9c7b28fe-d7cf-5fd1-b6af-a22385996986',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB80286',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 237006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-16',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB80286%27 HTTP/1.1" 200 None
2026-03-27 10:45:36 [auto1.de] INFO: Saving data for CB80286: {'auction_closing_time': 1774714851.0, 'created_time': 1773830157.529888, 'last_price_update_time': 1774608336.989567}
2026-03-27 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CB80286') HTTP/1.1" 204 0
2026-03-27 10:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_373da172ef5864ba84c73e1f6a620c3e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_75422e48570508327dcf4bd71445e4cb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_c08f1613e006d44b293a3dca12d243d6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fda%252Fb2da45ec20545949896b1dd08c05615a%252Fpa%252FLA39027_dee8d33e9b419094f0e730716ab848cb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_dee8d33e9b419094f0e730716ab848cb.jpg not downloaded yet
2026-03-27 10:45:37 [auto1.de] INFO: Found listing with ID: ZA74558
2026-03-27 10:45:37 [auto1.de] INFO: Found listing with ID: PE27590
2026-03-27 10:45:37 [auto1.de] INFO: Found listing with ID: DP87789
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP87789%27 HTTP/1.1" 200 None
2026-03-27 10:45:37 [auto1.de] INFO: Scrape type for DP87789: 2
2026-03-27 10:45:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 681d9114-5fc1-5dbd-8986-8212c7fbac96 with identifier: DP87789
2026-03-27 10:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 681d9114-5fc1-5dbd-8986-8212c7fbac96 with scrape type 2
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 681d9114-5fc1-5dbd-8986-8212c7fbac96 with scrape type 2
2026-03-27 10:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 681d9114-5fc1-5dbd-8986-8212c7fbac96, identifier: DP87789
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50038e210>
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6953ed59-abdd-5f0d-896d-f4c10adc917a/6953ed59-abdd-5f0d-896d-f4c10adc917a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Ff9%252Fdbf91d296f46f5b583c6ab8a6144c019%252Fpa%252FPE37736_03f09121a3b4f6f4c6b56c9fe30e53c1.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/f9/dbf91d296f46f5b583c6ab8a6144c019/pa/PE37736_03f09121a3b4f6f4c6b56c9fe30e53c1.jpg saved to cache
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6953ed59-abdd-5f0d-896d-f4c10adc917a
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500225450>
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e620f3e6-49a7-5678-840b-c8020f1d696c/e620f3e6-49a7-5678-840b-c8020f1d696c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe7%252F79e7e68d2433c9e4d765a406e6f5c046%252Fpa%252FHB95489_4fdd2cd6f086e6f4bd202e7fcc6e6d4a.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_4fdd2cd6f086e6f4bd202e7fcc6e6d4a.jpg saved to cache
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e620f3e6-49a7-5678-840b-c8020f1d696c
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a9790>
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6953ed59-abdd-5f0d-896d-f4c10adc917a/6953ed59-abdd-5f0d-896d-f4c10adc917a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Ff9%252Fdbf91d296f46f5b583c6ab8a6144c019%252Fpa%252FPE37736_8945a40faf5becbcf3ab4941a31d87d0.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/f9/dbf91d296f46f5b583c6ab8a6144c019/pa/PE37736_8945a40faf5becbcf3ab4941a31d87d0.jpg saved to cache
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6953ed59-abdd-5f0d-896d-f4c10adc917a
2026-03-27 10:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_e3d4ba411cad1862cb1820ecdcf7f1b8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fd4%252F98d41ff5c2c5120e1a068bbf18704d5d%252Fpa%252FTG96584_a45ddf0ecfea4518f2e49be1ff67bcd3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_a45ddf0ecfea4518f2e49be1ff67bcd3.jpg not downloaded yet
2026-03-27 10:45:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 681d9114-5fc1-5dbd-8986-8212c7fbac96 with identifier: DP87789
2026-03-27 10:45:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 681d9114-5fc1-5dbd-8986-8212c7fbac96 with identifier: DP87789
2026-03-27 10:45:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 681d9114-5fc1-5dbd-8986-8212c7fbac96 with identifier: DP87789 to the API
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:42:03Z',
 'fuel_type': 'diesel',
 'id': '681d9114-5fc1-5dbd-8986-8212c7fbac96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP87789',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 50333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-12',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Join',
 'transmission': 'automatic',
 'trim': 'Join',
 'year': 2019}
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP87789%27 HTTP/1.1" 200 None
2026-03-27 10:45:37 [auto1.de] INFO: Saving data for DP87789: {'auction_closing_time': 1774716123.0, 'created_time': 1773402580.974435, 'last_price_update_time': 1774608337.64154}
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP87789') HTTP/1.1" 204 0
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fda%252Fb2da45ec20545949896b1dd08c05615a%252Fpa%252FLA39027_acce23efef3e3a3629820fc34cf6f117.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_acce23efef3e3a3629820fc34cf6f117.jpg not downloaded yet
2026-03-27 10:45:37 [auto1.de] INFO: Found listing with ID: PY37454
2026-03-27 10:45:37 [auto1.de] INFO: Found listing with ID: XS07294
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS07294%27 HTTP/1.1" 200 None
2026-03-27 10:45:37 [auto1.de] INFO: Scrape type for XS07294: 2
2026-03-27 10:45:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20031c62-cb95-5d60-b6e9-f9b29a1ccfa3 with identifier: XS07294
2026-03-27 10:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20031c62-cb95-5d60-b6e9-f9b29a1ccfa3 with scrape type 2
2026-03-27 10:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20031c62-cb95-5d60-b6e9-f9b29a1ccfa3 with scrape type 2
2026-03-27 10:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20031c62-cb95-5d60-b6e9-f9b29a1ccfa3, identifier: XS07294
2026-03-27 10:45:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20031c62-cb95-5d60-b6e9-f9b29a1ccfa3 with identifier: XS07294
2026-03-27 10:45:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20031c62-cb95-5d60-b6e9-f9b29a1ccfa3 with identifier: XS07294
2026-03-27 10:45:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20031c62-cb95-5d60-b6e9-f9b29a1ccfa3 with identifier: XS07294 to the API
2026-03-27 10:45:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:02:37Z',
 'fuel_type': 'diesel',
 'id': '20031c62-cb95-5d60-b6e9-f9b29a1ccfa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS07294',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 221992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-30',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'manual',
 'trim': 'Ultra',
 'year': 2017}
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS07294%27 HTTP/1.1" 200 None
2026-03-27 10:45:38 [auto1.de] INFO: Saving data for XS07294: {'auction_closing_time': 1774713757.0, 'created_time': 1773773081.119513, 'last_price_update_time': 1774608338.264828}
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS07294') HTTP/1.1" 204 0
2026-03-27 10:45:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018abad0>
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a27e591-12a2-519c-afee-8da7428cc02c/9a27e591-12a2-519c-afee-8da7428cc02c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fc8%252Fcdc8d0a6994ceda45d66be08f534afbf%252Fpa%252FKY59799_373da172ef5864ba84c73e1f6a620c3e.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_373da172ef5864ba84c73e1f6a620c3e.jpg saved to cache
2026-03-27 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a27e591-12a2-519c-afee-8da7428cc02c
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50040b110>
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4/7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fd4%252F98d41ff5c2c5120e1a068bbf18704d5d%252Fpa%252FTG96584_75422e48570508327dcf4bd71445e4cb.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_75422e48570508327dcf4bd71445e4cb.jpg saved to cache
2026-03-27 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500556250>
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e620f3e6-49a7-5678-840b-c8020f1d696c/e620f3e6-49a7-5678-840b-c8020f1d696c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe7%252F79e7e68d2433c9e4d765a406e6f5c046%252Fpa%252FHB95489_c08f1613e006d44b293a3dca12d243d6.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_c08f1613e006d44b293a3dca12d243d6.jpg saved to cache
2026-03-27 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e620f3e6-49a7-5678-840b-c8020f1d696c
2026-03-27 10:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_65be8aeebebe9558fa7a0d07fa42a3a9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_6fb6f02d51dfab56456dcc630e1132c2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fda%252Fb2da45ec20545949896b1dd08c05615a%252Fpa%252FLA39027_4d070a1d090a8f6d4520fae022bc1f6b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_4d070a1d090a8f6d4520fae022bc1f6b.jpg not downloaded yet
2026-03-27 10:45:38 [auto1.de] INFO: Found listing with ID: ZZ72723
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ72723%27 HTTP/1.1" 200 None
2026-03-27 10:45:38 [auto1.de] INFO: Scrape type for ZZ72723: 2
2026-03-27 10:45:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ce9b97a-a5b0-5f31-89ab-6d0fa2d2bd34 with identifier: ZZ72723
2026-03-27 10:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ce9b97a-a5b0-5f31-89ab-6d0fa2d2bd34 with scrape type 2
2026-03-27 10:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ce9b97a-a5b0-5f31-89ab-6d0fa2d2bd34 with scrape type 2
2026-03-27 10:45:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ce9b97a-a5b0-5f31-89ab-6d0fa2d2bd34, identifier: ZZ72723
2026-03-27 10:45:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-27 10:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_0ddc5ba73141bad2d91ee14a9c8936d2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ce9b97a-a5b0-5f31-89ab-6d0fa2d2bd34 with identifier: ZZ72723
2026-03-27 10:45:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ce9b97a-a5b0-5f31-89ab-6d0fa2d2bd34 with identifier: ZZ72723
2026-03-27 10:45:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ce9b97a-a5b0-5f31-89ab-6d0fa2d2bd34 with identifier: ZZ72723 to the API
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-28T16:01:02Z',
 'fuel_type': 'hybrid',
 'id': '3ce9b97a-a5b0-5f31-89ab-6d0fa2d2bd34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ72723',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 47041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-25',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ72723%27 HTTP/1.1" 200 None
2026-03-27 10:45:38 [auto1.de] INFO: Saving data for ZZ72723: {'auction_closing_time': 1774713662.0, 'created_time': 1774292310.691321, 'last_price_update_time': 1774608338.977316}
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ72723') HTTP/1.1" 204 0
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500459f10>
2026-03-27 10:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4/7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fd4%252F98d41ff5c2c5120e1a068bbf18704d5d%252Fpa%252FTG96584_e3d4ba411cad1862cb1820ecdcf7f1b8.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_e3d4ba411cad1862cb1820ecdcf7f1b8.jpg saved to cache
2026-03-27 10:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4
2026-03-27 10:45:39 [auto1.de] INFO: Found listing with ID: SX51992
2026-03-27 10:45:39 [auto1.de] INFO: Found listing with ID: VX77382
2026-03-27 10:45:39 [auto1.de] INFO: Found listing with ID: XR37106
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR37106%27 HTTP/1.1" 200 None
2026-03-27 10:45:39 [auto1.de] INFO: Scrape type for XR37106: 2
2026-03-27 10:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e55bd07a-af40-55a0-a940-fe4573b2fb90 with identifier: XR37106
2026-03-27 10:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e55bd07a-af40-55a0-a940-fe4573b2fb90 with scrape type 2
2026-03-27 10:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e55bd07a-af40-55a0-a940-fe4573b2fb90 with scrape type 2
2026-03-27 10:45:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e55bd07a-af40-55a0-a940-fe4573b2fb90, identifier: XR37106
2026-03-27 10:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_4adf87bfcc700bc262910f7b8c24cc02.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e55bd07a-af40-55a0-a940-fe4573b2fb90 with identifier: XR37106
2026-03-27 10:45:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e55bd07a-af40-55a0-a940-fe4573b2fb90 with identifier: XR37106
2026-03-27 10:45:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e55bd07a-af40-55a0-a940-fe4573b2fb90 with identifier: XR37106 to the API
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:16:48Z',
 'fuel_type': 'diesel',
 'id': 'e55bd07a-af40-55a0-a940-fe4573b2fb90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR37106',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 24278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-22',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Goal',
 'transmission': 'automatic',
 'trim': 'Goal',
 'year': 2024}
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR37106%27 HTTP/1.1" 200 None
2026-03-27 10:45:39 [auto1.de] INFO: Saving data for XR37106: {'auction_closing_time': 1774714608.0, 'created_time': 1773134625.719167, 'last_price_update_time': 1774608339.639961}
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR37106') HTTP/1.1" 204 0
2026-03-27 10:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_c82ffb62e3f17868821c9882695729f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_ec8c82b938f09a22e2fe78f27e104f47.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_894a6ae8ce0231243272536b250d64c5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:39 [auto1.de] INFO: Found listing with ID: GW52920
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW52920%27 HTTP/1.1" 200 None
2026-03-27 10:45:39 [auto1.de] INFO: Scrape type for GW52920: 2
2026-03-27 10:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d4df8ba-03b5-5cec-ade7-dfc338b21c15 with identifier: GW52920
2026-03-27 10:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d4df8ba-03b5-5cec-ade7-dfc338b21c15 with scrape type 2
2026-03-27 10:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d4df8ba-03b5-5cec-ade7-dfc338b21c15 with scrape type 2
2026-03-27 10:45:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d4df8ba-03b5-5cec-ade7-dfc338b21c15, identifier: GW52920
2026-03-27 10:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f1d50>
2026-03-27 10:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4/7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fd4%252F98d41ff5c2c5120e1a068bbf18704d5d%252Fpa%252FTG96584_65be8aeebebe9558fa7a0d07fa42a3a9.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_65be8aeebebe9558fa7a0d07fa42a3a9.jpg saved to cache
2026-03-27 10:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4
2026-03-27 10:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50045a990>
2026-03-27 10:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c33c38-7c3a-5b4d-a887-6120b12f3f0c/e8c33c38-7c3a-5b4d-a887-6120b12f3f0c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fda%252Fb2da45ec20545949896b1dd08c05615a%252Fpa%252FLA39027_6fb6f02d51dfab56456dcc630e1132c2.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_6fb6f02d51dfab56456dcc630e1132c2.jpg saved to cache
2026-03-27 10:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8c33c38-7c3a-5b4d-a887-6120b12f3f0c
2026-03-27 10:45:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016542d0>
2026-03-27 10:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4/7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fd4%252F98d41ff5c2c5120e1a068bbf18704d5d%252Fpa%252FTG96584_0ddc5ba73141bad2d91ee14a9c8936d2.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_0ddc5ba73141bad2d91ee14a9c8936d2.jpg saved to cache
2026-03-27 10:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4
2026-03-27 10:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_8e895ae99b1eb414db869b06b435694c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d4df8ba-03b5-5cec-ade7-dfc338b21c15 with identifier: GW52920
2026-03-27 10:45:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d4df8ba-03b5-5cec-ade7-dfc338b21c15 with identifier: GW52920
2026-03-27 10:45:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d4df8ba-03b5-5cec-ade7-dfc338b21c15 with identifier: GW52920 to the API
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:54:52Z',
 'fuel_type': 'diesel',
 'id': '7d4df8ba-03b5-5cec-ade7-dfc338b21c15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW52920',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 86205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-15',
 'seller_name': None,
 'title': 'BMW 3er 320d GT xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW52920%27 HTTP/1.1" 200 None
2026-03-27 10:45:40 [auto1.de] INFO: Saving data for GW52920: {'auction_closing_time': 1774716892.0, 'created_time': 1774294780.198223, 'last_price_update_time': 1774608340.41037}
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW52920') HTTP/1.1" 204 0
2026-03-27 10:45:40 [auto1.de] INFO: Found listing with ID: AJ88373
2026-03-27 10:45:40 [auto1.de] INFO: Found listing with ID: TG62557
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG62557%27 HTTP/1.1" 200 None
2026-03-27 10:45:40 [auto1.de] INFO: Scrape type for TG62557: 2
2026-03-27 10:45:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d2037bb-c1c6-5a99-aedb-73c658b1b34e with identifier: TG62557
2026-03-27 10:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d2037bb-c1c6-5a99-aedb-73c658b1b34e with scrape type 2
2026-03-27 10:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d2037bb-c1c6-5a99-aedb-73c658b1b34e with scrape type 2
2026-03-27 10:45:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d2037bb-c1c6-5a99-aedb-73c658b1b34e, identifier: TG62557
2026-03-27 10:45:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d2037bb-c1c6-5a99-aedb-73c658b1b34e with identifier: TG62557
2026-03-27 10:45:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d2037bb-c1c6-5a99-aedb-73c658b1b34e with identifier: TG62557
2026-03-27 10:45:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d2037bb-c1c6-5a99-aedb-73c658b1b34e with identifier: TG62557 to the API
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:54:29Z',
 'fuel_type': 'petrol',
 'id': '7d2037bb-c1c6-5a99-aedb-73c658b1b34e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG62557',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 144747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-17',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TSI Cupra 265',
 'transmission': 'automatic',
 'trim': 'Cupra 265',
 'year': 2014}
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG62557%27 HTTP/1.1" 200 None
2026-03-27 10:45:40 [auto1.de] INFO: Saving data for TG62557: {'auction_closing_time': 1774716869.0, 'created_time': 1773775627.53298, 'last_price_update_time': 1774608340.908578}
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG62557') HTTP/1.1" 204 0
2026-03-27 10:45:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-27 10:45:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002cb090>
2026-03-27 10:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a27e591-12a2-519c-afee-8da7428cc02c/9a27e591-12a2-519c-afee-8da7428cc02c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fc8%252Fcdc8d0a6994ceda45d66be08f534afbf%252Fpa%252FKY59799_4adf87bfcc700bc262910f7b8c24cc02.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_4adf87bfcc700bc262910f7b8c24cc02.jpg saved to cache
2026-03-27 10:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a27e591-12a2-519c-afee-8da7428cc02c
2026-03-27 10:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500376a50>
2026-03-27 10:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c33c38-7c3a-5b4d-a887-6120b12f3f0c/e8c33c38-7c3a-5b4d-a887-6120b12f3f0c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fda%252Fb2da45ec20545949896b1dd08c05615a%252Fpa%252FLA39027_c82ffb62e3f17868821c9882695729f6.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_c82ffb62e3f17868821c9882695729f6.jpg saved to cache
2026-03-27 10:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8c33c38-7c3a-5b4d-a887-6120b12f3f0c
2026-03-27 10:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004ab790>
2026-03-27 10:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c33c38-7c3a-5b4d-a887-6120b12f3f0c/e8c33c38-7c3a-5b4d-a887-6120b12f3f0c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fda%252Fb2da45ec20545949896b1dd08c05615a%252Fpa%252FLA39027_ec8c82b938f09a22e2fe78f27e104f47.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_ec8c82b938f09a22e2fe78f27e104f47.jpg saved to cache
2026-03-27 10:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8c33c38-7c3a-5b4d-a887-6120b12f3f0c
2026-03-27 10:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500397c10>
2026-03-27 10:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4/7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fd4%252F98d41ff5c2c5120e1a068bbf18704d5d%252Fpa%252FTG96584_894a6ae8ce0231243272536b250d64c5.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_894a6ae8ce0231243272536b250d64c5.jpg saved to cache
2026-03-27 10:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4
2026-03-27 10:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_a45ddf0ecfea4518f2e49be1ff67bcd3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_1b49aced4ae827c215f4b396cb1dd557.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_acce23efef3e3a3629820fc34cf6f117.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:41 [auto1.de] INFO: Found listing with ID: DG23349
2026-03-27 10:45:41 [auto1.de] INFO: Found listing with ID: MR65343
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR65343%27 HTTP/1.1" 200 None
2026-03-27 10:45:41 [auto1.de] INFO: Scrape type for MR65343: 2
2026-03-27 10:45:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05888734-0499-5bc7-8d60-028692f55005 with identifier: MR65343
2026-03-27 10:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05888734-0499-5bc7-8d60-028692f55005 with scrape type 2
2026-03-27 10:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05888734-0499-5bc7-8d60-028692f55005 with scrape type 2
2026-03-27 10:45:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05888734-0499-5bc7-8d60-028692f55005, identifier: MR65343
2026-03-27 10:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_27f7a93162b55b14cf9677c7b11a6dbd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05888734-0499-5bc7-8d60-028692f55005 with identifier: MR65343
2026-03-27 10:45:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05888734-0499-5bc7-8d60-028692f55005 with identifier: MR65343
2026-03-27 10:45:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05888734-0499-5bc7-8d60-028692f55005 with identifier: MR65343 to the API
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:50:44Z',
 'fuel_type': 'diesel',
 'id': '05888734-0499-5bc7-8d60-028692f55005',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR65343',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 136717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-18',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2019}
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR65343%27 HTTP/1.1" 200 None
2026-03-27 10:45:41 [auto1.de] INFO: Saving data for MR65343: {'auction_closing_time': 1774716644.0, 'created_time': 1773775244.873221, 'last_price_update_time': 1774608341.655597}
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR65343') HTTP/1.1" 204 0
2026-03-27 10:45:41 [auto1.de] INFO: Found listing with ID: KX42000
2026-03-27 10:45:41 [auto1.de] INFO: Found listing with ID: DG34308
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34308%27 HTTP/1.1" 200 None
2026-03-27 10:45:41 [auto1.de] INFO: Scrape type for DG34308: 2
2026-03-27 10:45:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c8f0679-13f1-5bcc-a465-ab1c7e62cdce with identifier: DG34308
2026-03-27 10:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c8f0679-13f1-5bcc-a465-ab1c7e62cdce with scrape type 2
2026-03-27 10:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c8f0679-13f1-5bcc-a465-ab1c7e62cdce with scrape type 2
2026-03-27 10:45:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c8f0679-13f1-5bcc-a465-ab1c7e62cdce, identifier: DG34308
2026-03-27 10:45:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500360ed0>
2026-03-27 10:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a27e591-12a2-519c-afee-8da7428cc02c/9a27e591-12a2-519c-afee-8da7428cc02c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fc8%252Fcdc8d0a6994ceda45d66be08f534afbf%252Fpa%252FKY59799_8e895ae99b1eb414db869b06b435694c.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_8e895ae99b1eb414db869b06b435694c.jpg saved to cache
2026-03-27 10:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a27e591-12a2-519c-afee-8da7428cc02c
2026-03-27 10:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_522db64c65006545954686ab5f4f0035.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c8f0679-13f1-5bcc-a465-ab1c7e62cdce with identifier: DG34308
2026-03-27 10:45:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c8f0679-13f1-5bcc-a465-ab1c7e62cdce with identifier: DG34308
2026-03-27 10:45:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c8f0679-13f1-5bcc-a465-ab1c7e62cdce with identifier: DG34308 to the API
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:40:41Z',
 'fuel_type': 'petrol',
 'id': '6c8f0679-13f1-5bcc-a465-ab1c7e62cdce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG34308',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 162669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-05',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34308%27 HTTP/1.1" 200 None
2026-03-27 10:45:42 [auto1.de] INFO: Saving data for DG34308: {'auction_closing_time': 1774716041.0, 'created_time': 1773303193.409721, 'last_price_update_time': 1774608342.351353}
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG34308') HTTP/1.1" 204 0
2026-03-27 10:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_e70ba10f5418c27a8ec9caf7fb8fc3b6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_4d070a1d090a8f6d4520fae022bc1f6b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:42 [auto1.de] INFO: Found listing with ID: EP44160
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP44160%27 HTTP/1.1" 200 None
2026-03-27 10:45:42 [auto1.de] INFO: Scrape type for EP44160: 2
2026-03-27 10:45:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46ad4b93-e9f9-56bd-b711-f05364dacc0e with identifier: EP44160
2026-03-27 10:45:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46ad4b93-e9f9-56bd-b711-f05364dacc0e with scrape type 2
2026-03-27 10:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46ad4b93-e9f9-56bd-b711-f05364dacc0e with scrape type 2
2026-03-27 10:45:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46ad4b93-e9f9-56bd-b711-f05364dacc0e, identifier: EP44160
2026-03-27 10:45:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46ad4b93-e9f9-56bd-b711-f05364dacc0e with identifier: EP44160
2026-03-27 10:45:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46ad4b93-e9f9-56bd-b711-f05364dacc0e with identifier: EP44160
2026-03-27 10:45:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46ad4b93-e9f9-56bd-b711-f05364dacc0e with identifier: EP44160 to the API
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:55:39Z',
 'fuel_type': 'petrol',
 'id': '46ad4b93-e9f9-56bd-b711-f05364dacc0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP44160',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 119025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI IQ.DRIVE',
 'transmission': 'manual',
 'trim': 'IQ.DRIVE',
 'year': 2019}
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP44160%27 HTTP/1.1" 200 None
2026-03-27 10:45:42 [auto1.de] INFO: Saving data for EP44160: {'auction_closing_time': 1774716939.0, 'created_time': 1773831757.800105, 'last_price_update_time': 1774608342.84938}
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP44160') HTTP/1.1" 204 0
2026-03-27 10:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c0fd0>
2026-03-27 10:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4/7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fd4%252F98d41ff5c2c5120e1a068bbf18704d5d%252Fpa%252FTG96584_a45ddf0ecfea4518f2e49be1ff67bcd3.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_a45ddf0ecfea4518f2e49be1ff67bcd3.jpg saved to cache
2026-03-27 10:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4
2026-03-27 10:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001d40d0>
2026-03-27 10:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4/7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fd4%252F98d41ff5c2c5120e1a068bbf18704d5d%252Fpa%252FTG96584_1b49aced4ae827c215f4b396cb1dd557.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_1b49aced4ae827c215f4b396cb1dd557.jpg saved to cache
2026-03-27 10:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4
2026-03-27 10:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50169ac90>
2026-03-27 10:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c33c38-7c3a-5b4d-a887-6120b12f3f0c/e8c33c38-7c3a-5b4d-a887-6120b12f3f0c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fda%252Fb2da45ec20545949896b1dd08c05615a%252Fpa%252FLA39027_acce23efef3e3a3629820fc34cf6f117.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_acce23efef3e3a3629820fc34cf6f117.jpg saved to cache
2026-03-27 10:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8c33c38-7c3a-5b4d-a887-6120b12f3f0c
2026-03-27 10:45:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50039a110>
2026-03-27 10:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a27e591-12a2-519c-afee-8da7428cc02c/9a27e591-12a2-519c-afee-8da7428cc02c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fc8%252Fcdc8d0a6994ceda45d66be08f534afbf%252Fpa%252FKY59799_27f7a93162b55b14cf9677c7b11a6dbd.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_27f7a93162b55b14cf9677c7b11a6dbd.jpg saved to cache
2026-03-27 10:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a27e591-12a2-519c-afee-8da7428cc02c
2026-03-27 10:45:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:43 [auto1.de] INFO: Found listing with ID: XD56030
2026-03-27 10:45:43 [auto1.de] INFO: Found listing with ID: BF31444
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF31444%27 HTTP/1.1" 200 None
2026-03-27 10:45:43 [auto1.de] INFO: Scrape type for BF31444: 2
2026-03-27 10:45:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c906807-c8b8-59bc-ab89-cf9c4ef6256a with identifier: BF31444
2026-03-27 10:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c906807-c8b8-59bc-ab89-cf9c4ef6256a with scrape type 2
2026-03-27 10:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c906807-c8b8-59bc-ab89-cf9c4ef6256a with scrape type 2
2026-03-27 10:45:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c906807-c8b8-59bc-ab89-cf9c4ef6256a, identifier: BF31444
2026-03-27 10:45:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c906807-c8b8-59bc-ab89-cf9c4ef6256a with identifier: BF31444
2026-03-27 10:45:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c906807-c8b8-59bc-ab89-cf9c4ef6256a with identifier: BF31444
2026-03-27 10:45:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c906807-c8b8-59bc-ab89-cf9c4ef6256a with identifier: BF31444 to the API
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:39:08Z',
 'fuel_type': 'petrol',
 'id': '0c906807-c8b8-59bc-ab89-cf9c4ef6256a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF31444',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 35391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-11',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TSI Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2022}
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF31444%27 HTTP/1.1" 200 None
2026-03-27 10:45:43 [auto1.de] INFO: Saving data for BF31444: {'auction_closing_time': 1774715948.0, 'created_time': 1773400122.577479, 'last_price_update_time': 1774608343.544472}
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF31444') HTTP/1.1" 204 0
2026-03-27 10:45:43 [auto1.de] INFO: Found listing with ID: PL78300
2026-03-27 10:45:43 [auto1.de] INFO: Found listing with ID: KF41308
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF41308%27 HTTP/1.1" 200 None
2026-03-27 10:45:43 [auto1.de] INFO: Scrape type for KF41308: 2
2026-03-27 10:45:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 957eb23d-41ee-505f-b33e-194f71c469a8 with identifier: KF41308
2026-03-27 10:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 957eb23d-41ee-505f-b33e-194f71c469a8 with scrape type 2
2026-03-27 10:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 957eb23d-41ee-505f-b33e-194f71c469a8 with scrape type 2
2026-03-27 10:45:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 957eb23d-41ee-505f-b33e-194f71c469a8, identifier: KF41308
2026-03-27 10:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004a9b10>
2026-03-27 10:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c33c38-7c3a-5b4d-a887-6120b12f3f0c/e8c33c38-7c3a-5b4d-a887-6120b12f3f0c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fda%252Fb2da45ec20545949896b1dd08c05615a%252Fpa%252FLA39027_522db64c65006545954686ab5f4f0035.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_522db64c65006545954686ab5f4f0035.jpg saved to cache
2026-03-27 10:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8c33c38-7c3a-5b4d-a887-6120b12f3f0c
2026-03-27 10:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50058ae50>
2026-03-27 10:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c33c38-7c3a-5b4d-a887-6120b12f3f0c/e8c33c38-7c3a-5b4d-a887-6120b12f3f0c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fda%252Fb2da45ec20545949896b1dd08c05615a%252Fpa%252FLA39027_e70ba10f5418c27a8ec9caf7fb8fc3b6.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_e70ba10f5418c27a8ec9caf7fb8fc3b6.jpg saved to cache
2026-03-27 10:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8c33c38-7c3a-5b4d-a887-6120b12f3f0c
2026-03-27 10:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50044bc10>
2026-03-27 10:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c33c38-7c3a-5b4d-a887-6120b12f3f0c/e8c33c38-7c3a-5b4d-a887-6120b12f3f0c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fda%252Fb2da45ec20545949896b1dd08c05615a%252Fpa%252FLA39027_4d070a1d090a8f6d4520fae022bc1f6b.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_4d070a1d090a8f6d4520fae022bc1f6b.jpg saved to cache
2026-03-27 10:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8c33c38-7c3a-5b4d-a887-6120b12f3f0c
2026-03-27 10:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_bea429431e991108863ec8ff52bf58ad.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_a87f34ca14fde36bd1d880041b7b81a2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 957eb23d-41ee-505f-b33e-194f71c469a8 with identifier: KF41308
2026-03-27 10:45:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 957eb23d-41ee-505f-b33e-194f71c469a8 with identifier: KF41308
2026-03-27 10:45:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 957eb23d-41ee-505f-b33e-194f71c469a8 with identifier: KF41308 to the API
2026-03-27 10:45:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:25:18Z',
 'fuel_type': 'diesel',
 'id': '957eb23d-41ee-505f-b33e-194f71c469a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF41308',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 172823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-29',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 310 L2 Tourneo Titanium',
 'transmission': 'manual',
 'trim': '310 L2 Tourneo Titanium',
 'year': 2016}
2026-03-27 10:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF41308%27 HTTP/1.1" 200 None
2026-03-27 10:45:44 [auto1.de] INFO: Saving data for KF41308: {'auction_closing_time': 1774715118.0, 'created_time': 1774293587.34379, 'last_price_update_time': 1774608344.158311}
2026-03-27 10:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF41308') HTTP/1.1" 204 0
2026-03-27 10:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_0713ffb105b9539303a27a10496c5b66.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_bdf0a4798e8e5dc284ddbbd2b0e94a8f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:44 [auto1.de] INFO: Found listing with ID: TP63810
2026-03-27 10:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63810%27 HTTP/1.1" 200 None
2026-03-27 10:45:44 [auto1.de] INFO: Scrape type for TP63810: 2
2026-03-27 10:45:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 080787a8-56cb-5197-8195-0b0097879d7e with identifier: TP63810
2026-03-27 10:45:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 080787a8-56cb-5197-8195-0b0097879d7e with scrape type 2
2026-03-27 10:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 080787a8-56cb-5197-8195-0b0097879d7e with scrape type 2
2026-03-27 10:45:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 080787a8-56cb-5197-8195-0b0097879d7e, identifier: TP63810
2026-03-27 10:45:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 080787a8-56cb-5197-8195-0b0097879d7e with identifier: TP63810
2026-03-27 10:45:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 080787a8-56cb-5197-8195-0b0097879d7e with identifier: TP63810
2026-03-27 10:45:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 080787a8-56cb-5197-8195-0b0097879d7e with identifier: TP63810 to the API
2026-03-27 10:45:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:25:27Z',
 'fuel_type': 'petrol',
 'id': '080787a8-56cb-5197-8195-0b0097879d7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP63810',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 68201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-01',
 'seller_name': None,
 'title': 'Audi Q2 35 TFSI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-27 10:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63810%27 HTTP/1.1" 200 None
2026-03-27 10:45:44 [auto1.de] INFO: Saving data for TP63810: {'auction_closing_time': 1774715127.0, 'created_time': 1774293682.994105, 'last_price_update_time': 1774608344.647594}
2026-03-27 10:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP63810') HTTP/1.1" 204 0
2026-03-27 10:45:44 [auto1.de] INFO: Found listing with ID: FF92976
2026-03-27 10:45:44 [auto1.de] INFO: Found listing with ID: RF27065
2026-03-27 10:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF27065%27 HTTP/1.1" 200 None
2026-03-27 10:45:44 [auto1.de] INFO: Scrape type for RF27065: 2
2026-03-27 10:45:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67315f09-84fc-51a6-941b-c423ccf4d077 with identifier: RF27065
2026-03-27 10:45:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67315f09-84fc-51a6-941b-c423ccf4d077 with scrape type 2
2026-03-27 10:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67315f09-84fc-51a6-941b-c423ccf4d077 with scrape type 2
2026-03-27 10:45:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67315f09-84fc-51a6-941b-c423ccf4d077, identifier: RF27065
2026-03-27 10:45:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67315f09-84fc-51a6-941b-c423ccf4d077 with identifier: RF27065
2026-03-27 10:45:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67315f09-84fc-51a6-941b-c423ccf4d077 with identifier: RF27065
2026-03-27 10:45:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67315f09-84fc-51a6-941b-c423ccf4d077 with identifier: RF27065 to the API
2026-03-27 10:45:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:17:12Z',
 'fuel_type': 'petrol',
 'id': '67315f09-84fc-51a6-941b-c423ccf4d077',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF27065',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 158589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-25',
 'seller_name': None,
 'title': 'Hyundai i40 1.6 5 Star Edition',
 'transmission': 'manual',
 'trim': '5 Star Edition',
 'year': 2013}
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF27065%27 HTTP/1.1" 200 None
2026-03-27 10:45:45 [auto1.de] INFO: Saving data for RF27065: {'auction_closing_time': 1774714632.0, 'created_time': 1773306092.223411, 'last_price_update_time': 1774608345.148126}
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF27065') HTTP/1.1" 204 0
2026-03-27 10:45:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a12dd0>
2026-03-27 10:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a27e591-12a2-519c-afee-8da7428cc02c/9a27e591-12a2-519c-afee-8da7428cc02c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fc8%252Fcdc8d0a6994ceda45d66be08f534afbf%252Fpa%252FKY59799_bea429431e991108863ec8ff52bf58ad.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_bea429431e991108863ec8ff52bf58ad.jpg saved to cache
2026-03-27 10:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a27e591-12a2-519c-afee-8da7428cc02c
2026-03-27 10:45:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a27e591-12a2-519c-afee-8da7428cc02c, skipping ID generation
2026-03-27 10:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a27e591-12a2-519c-afee-8da7428cc02c with scrape type 1
2026-03-27 10:45:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a27e591-12a2-519c-afee-8da7428cc02c sending to next pipeline
2026-03-27 10:45:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a27e591-12a2-519c-afee-8da7428cc02c, identifier: KY59799
2026-03-27 10:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50378f7d0>
2026-03-27 10:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4/7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fd4%252F98d41ff5c2c5120e1a068bbf18704d5d%252Fpa%252FTG96584_a87f34ca14fde36bd1d880041b7b81a2.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_a87f34ca14fde36bd1d880041b7b81a2.jpg saved to cache
2026-03-27 10:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4
2026-03-27 10:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a14f90>
2026-03-27 10:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c33c38-7c3a-5b4d-a887-6120b12f3f0c/e8c33c38-7c3a-5b4d-a887-6120b12f3f0c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fda%252Fb2da45ec20545949896b1dd08c05615a%252Fpa%252FLA39027_0713ffb105b9539303a27a10496c5b66.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_0713ffb105b9539303a27a10496c5b66.jpg saved to cache
2026-03-27 10:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8c33c38-7c3a-5b4d-a887-6120b12f3f0c
2026-03-27 10:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500561350>
2026-03-27 10:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e620f3e6-49a7-5678-840b-c8020f1d696c/e620f3e6-49a7-5678-840b-c8020f1d696c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe7%252F79e7e68d2433c9e4d765a406e6f5c046%252Fpa%252FHB95489_bdf0a4798e8e5dc284ddbbd2b0e94a8f.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_bdf0a4798e8e5dc284ddbbd2b0e94a8f.jpg saved to cache
2026-03-27 10:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e620f3e6-49a7-5678-840b-c8020f1d696c
2026-03-27 10:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_0b3af86c9c47928190c9d7179927aeee.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:45 [auto1.de] INFO: Found listing with ID: MM04767
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04767%27 HTTP/1.1" 200 None
2026-03-27 10:45:45 [auto1.de] INFO: Scrape type for MM04767: 2
2026-03-27 10:45:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42669363-fad3-5798-b87e-c2fb0ecf5665 with identifier: MM04767
2026-03-27 10:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42669363-fad3-5798-b87e-c2fb0ecf5665 with scrape type 2
2026-03-27 10:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42669363-fad3-5798-b87e-c2fb0ecf5665 with scrape type 2
2026-03-27 10:45:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42669363-fad3-5798-b87e-c2fb0ecf5665, identifier: MM04767
2026-03-27 10:45:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a27e591-12a2-519c-afee-8da7428cc02c with identifier: KY59799
2026-03-27 10:45:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a27e591-12a2-519c-afee-8da7428cc02c with identifier: KY59799
2026-03-27 10:45:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a27e591-12a2-519c-afee-8da7428cc02c with identifier: KY59799 to the API
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_bea429431e991108863ec8ff52bf58ad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:11:28Z',
 'fuel_type': 'petrol',
 'id': '9a27e591-12a2-519c-afee-8da7428cc02c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY59799',
 'listing': 'auction',
 'location': 'DE, Frankfurt',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 28914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a27e591-12a2-519c-afee-8da7428cc02c/9a27e591-12a2-519c-afee-8da7428cc02c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_9c69c96e1dbb1805daa68c548089c8df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a27e591-12a2-519c-afee-8da7428cc02c/9a27e591-12a2-519c-afee-8da7428cc02c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_81ba66b2833620dc99701a35617688fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a27e591-12a2-519c-afee-8da7428cc02c/9a27e591-12a2-519c-afee-8da7428cc02c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2690361,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_373da172ef5864ba84c73e1f6a620c3e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a27e591-12a2-519c-afee-8da7428cc02c/9a27e591-12a2-519c-afee-8da7428cc02c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2912875,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_8e895ae99b1eb414db869b06b435694c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a27e591-12a2-519c-afee-8da7428cc02c/9a27e591-12a2-519c-afee-8da7428cc02c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_8760e05a1582076e09322143b7f06dc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a27e591-12a2-519c-afee-8da7428cc02c/9a27e591-12a2-519c-afee-8da7428cc02c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2712928,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_4adf87bfcc700bc262910f7b8c24cc02.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a27e591-12a2-519c-afee-8da7428cc02c/9a27e591-12a2-519c-afee-8da7428cc02c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_021e0d73e8a8102bd8afda18a0ec641c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a27e591-12a2-519c-afee-8da7428cc02c/9a27e591-12a2-519c-afee-8da7428cc02c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2857779,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_27f7a93162b55b14cf9677c7b11a6dbd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a27e591-12a2-519c-afee-8da7428cc02c/9a27e591-12a2-519c-afee-8da7428cc02c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_0f909ad531adceb52c889b562948b263.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a27e591-12a2-519c-afee-8da7428cc02c/9a27e591-12a2-519c-afee-8da7428cc02c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2831932,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/c8/cdc8d0a6994ceda45d66be08f534afbf/pa/KY59799_bea429431e991108863ec8ff52bf58ad.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2011}
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY59799%27 HTTP/1.1" 200 None
2026-03-27 10:45:46 [auto1.de] INFO: Saving data for KY59799: {'created_time': 1774608345.999984, 'last_price_update_time': 1774608345.999997, 'auction_closing_time': 1774714288.0}
2026-03-27 10:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY59799') HTTP/1.1" 204 0
2026-03-27 10:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/f9/dbf91d296f46f5b583c6ab8a6144c019/pa/PE37736_0e7e42f90fa47b44471aeca04babc2e7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42669363-fad3-5798-b87e-c2fb0ecf5665 with identifier: MM04767
2026-03-27 10:45:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42669363-fad3-5798-b87e-c2fb0ecf5665 with identifier: MM04767
2026-03-27 10:45:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42669363-fad3-5798-b87e-c2fb0ecf5665 with identifier: MM04767 to the API
2026-03-27 10:45:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:29:19Z',
 'fuel_type': 'petrol',
 'id': '42669363-fad3-5798-b87e-c2fb0ecf5665',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM04767',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 115141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-31',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2012}
2026-03-27 10:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04767%27 HTTP/1.1" 200 None
2026-03-27 10:45:46 [auto1.de] INFO: Saving data for MM04767: {'auction_closing_time': 1774715359.0, 'created_time': 1774294718.697982, 'last_price_update_time': 1774608346.497776}
2026-03-27 10:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM04767') HTTP/1.1" 204 0
2026-03-27 10:45:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/f9/dbf91d296f46f5b583c6ab8a6144c019/pa/PE37736_8db7ecd1daaf0ecae5fd1a42968d48d8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50045c510>
2026-03-27 10:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8/a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fc5%252F84c5fc3cda12e06e51ecd50da8c71478%252Fpa%252FHV64790_0b3af86c9c47928190c9d7179927aeee.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_0b3af86c9c47928190c9d7179927aeee.jpg saved to cache
2026-03-27 10:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8
2026-03-27 10:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50033bb90>
2026-03-27 10:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6953ed59-abdd-5f0d-896d-f4c10adc917a/6953ed59-abdd-5f0d-896d-f4c10adc917a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Ff9%252Fdbf91d296f46f5b583c6ab8a6144c019%252Fpa%252FPE37736_0e7e42f90fa47b44471aeca04babc2e7.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/f9/dbf91d296f46f5b583c6ab8a6144c019/pa/PE37736_0e7e42f90fa47b44471aeca04babc2e7.jpg saved to cache
2026-03-27 10:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6953ed59-abdd-5f0d-896d-f4c10adc917a
2026-03-27 10:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_90ea3cdf7d5d12fbdaba6a97f3112d4d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_9377f21c1de49cbb8e135c25c2663a18.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_dee8d33e9b419094f0e730716ab848cb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50169be50>
2026-03-27 10:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6953ed59-abdd-5f0d-896d-f4c10adc917a/6953ed59-abdd-5f0d-896d-f4c10adc917a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Ff9%252Fdbf91d296f46f5b583c6ab8a6144c019%252Fpa%252FPE37736_8db7ecd1daaf0ecae5fd1a42968d48d8.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/f9/dbf91d296f46f5b583c6ab8a6144c019/pa/PE37736_8db7ecd1daaf0ecae5fd1a42968d48d8.jpg saved to cache
2026-03-27 10:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6953ed59-abdd-5f0d-896d-f4c10adc917a
2026-03-27 10:45:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6953ed59-abdd-5f0d-896d-f4c10adc917a, skipping ID generation
2026-03-27 10:45:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6953ed59-abdd-5f0d-896d-f4c10adc917a with scrape type 1
2026-03-27 10:45:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6953ed59-abdd-5f0d-896d-f4c10adc917a sending to next pipeline
2026-03-27 10:45:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6953ed59-abdd-5f0d-896d-f4c10adc917a, identifier: PE37736
2026-03-27 10:45:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6953ed59-abdd-5f0d-896d-f4c10adc917a with identifier: PE37736
2026-03-27 10:45:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6953ed59-abdd-5f0d-896d-f4c10adc917a with identifier: PE37736
2026-03-27 10:45:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6953ed59-abdd-5f0d-896d-f4c10adc917a with identifier: PE37736 to the API
2026-03-27 10:45:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdb/f9/dbf91d296f46f5b583c6ab8a6144c019/pa/PE37736_8db7ecd1daaf0ecae5fd1a42968d48d8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:01:37Z',
 'fuel_type': 'diesel',
 'id': '6953ed59-abdd-5f0d-896d-f4c10adc917a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE37736',
 'listing': 'auction',
 'location': 'DE, Recklinghausen',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 270454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6953ed59-abdd-5f0d-896d-f4c10adc917a/6953ed59-abdd-5f0d-896d-f4c10adc917a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/f9/dbf91d296f46f5b583c6ab8a6144c019/pa/PE37736_0e7e42f90fa47b44471aeca04babc2e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6953ed59-abdd-5f0d-896d-f4c10adc917a/6953ed59-abdd-5f0d-896d-f4c10adc917a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/f9/dbf91d296f46f5b583c6ab8a6144c019/pa/PE37736_8db7ecd1daaf0ecae5fd1a42968d48d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6953ed59-abdd-5f0d-896d-f4c10adc917a/6953ed59-abdd-5f0d-896d-f4c10adc917a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/f9/dbf91d296f46f5b583c6ab8a6144c019/pa/PE37736_e57dc0712c95592c0338cdabf8e1659f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6953ed59-abdd-5f0d-896d-f4c10adc917a/6953ed59-abdd-5f0d-896d-f4c10adc917a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/f9/dbf91d296f46f5b583c6ab8a6144c019/pa/PE37736_8945a40faf5becbcf3ab4941a31d87d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6953ed59-abdd-5f0d-896d-f4c10adc917a/6953ed59-abdd-5f0d-896d-f4c10adc917a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/f9/dbf91d296f46f5b583c6ab8a6144c019/pa/PE37736_03f09121a3b4f6f4c6b56c9fe30e53c1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2013}
2026-03-27 10:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE37736%27 HTTP/1.1" 200 None
2026-03-27 10:45:47 [auto1.de] INFO: Saving data for PE37736: {'created_time': 1774608347.184119, 'last_price_update_time': 1774608347.184131, 'auction_closing_time': 1774713697.0}
2026-03-27 10:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE37736') HTTP/1.1" 204 0
2026-03-27 10:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_ce125a5ebfb0274e4c1aaae6e8e6ca20.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_f3098f0368d0d6a01db58094e1d700a3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_ff71d6db09cca8966254ce7d5e68f2b1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_28e93a3e33ae68493b92d9cb2ef5d6bb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017c4d50>
2026-03-27 10:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4/7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fd4%252F98d41ff5c2c5120e1a068bbf18704d5d%252Fpa%252FTG96584_90ea3cdf7d5d12fbdaba6a97f3112d4d.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_90ea3cdf7d5d12fbdaba6a97f3112d4d.jpg saved to cache
2026-03-27 10:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4
2026-03-27 10:45:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001fd1d0>
2026-03-27 10:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c33c38-7c3a-5b4d-a887-6120b12f3f0c/e8c33c38-7c3a-5b4d-a887-6120b12f3f0c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fda%252Fb2da45ec20545949896b1dd08c05615a%252Fpa%252FLA39027_9377f21c1de49cbb8e135c25c2663a18.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_9377f21c1de49cbb8e135c25c2663a18.jpg saved to cache
2026-03-27 10:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8c33c38-7c3a-5b4d-a887-6120b12f3f0c
2026-03-27 10:45:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5036e0c50>
2026-03-27 10:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8c33c38-7c3a-5b4d-a887-6120b12f3f0c/e8c33c38-7c3a-5b4d-a887-6120b12f3f0c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fda%252Fb2da45ec20545949896b1dd08c05615a%252Fpa%252FLA39027_dee8d33e9b419094f0e730716ab848cb.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_dee8d33e9b419094f0e730716ab848cb.jpg saved to cache
2026-03-27 10:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8c33c38-7c3a-5b4d-a887-6120b12f3f0c
2026-03-27 10:45:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8c33c38-7c3a-5b4d-a887-6120b12f3f0c, skipping ID generation
2026-03-27 10:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8c33c38-7c3a-5b4d-a887-6120b12f3f0c with scrape type 1
2026-03-27 10:45:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8c33c38-7c3a-5b4d-a887-6120b12f3f0c sending to next pipeline
2026-03-27 10:45:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8c33c38-7c3a-5b4d-a887-6120b12f3f0c, identifier: LA39027
2026-03-27 10:45:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8c33c38-7c3a-5b4d-a887-6120b12f3f0c with identifier: LA39027
2026-03-27 10:45:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8c33c38-7c3a-5b4d-a887-6120b12f3f0c with identifier: LA39027
2026-03-27 10:45:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8c33c38-7c3a-5b4d-a887-6120b12f3f0c with identifier: LA39027 to the API
2026-03-27 10:45:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_dee8d33e9b419094f0e730716ab848cb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 240,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:02:52Z',
 'fuel_type': 'diesel',
 'id': 'e8c33c38-7c3a-5b4d-a887-6120b12f3f0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA39027',
 'listing': 'auction',
 'location': 'DE, Jena',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 286842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8c33c38-7c3a-5b4d-a887-6120b12f3f0c/e8c33c38-7c3a-5b4d-a887-6120b12f3f0c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_0713ffb105b9539303a27a10496c5b66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8c33c38-7c3a-5b4d-a887-6120b12f3f0c/e8c33c38-7c3a-5b4d-a887-6120b12f3f0c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_e70ba10f5418c27a8ec9caf7fb8fc3b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8c33c38-7c3a-5b4d-a887-6120b12f3f0c/e8c33c38-7c3a-5b4d-a887-6120b12f3f0c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_6fb6f02d51dfab56456dcc630e1132c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8c33c38-7c3a-5b4d-a887-6120b12f3f0c/e8c33c38-7c3a-5b4d-a887-6120b12f3f0c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_522db64c65006545954686ab5f4f0035.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8c33c38-7c3a-5b4d-a887-6120b12f3f0c/e8c33c38-7c3a-5b4d-a887-6120b12f3f0c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_ec8c82b938f09a22e2fe78f27e104f47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8c33c38-7c3a-5b4d-a887-6120b12f3f0c/e8c33c38-7c3a-5b4d-a887-6120b12f3f0c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2421870,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_9377f21c1de49cbb8e135c25c2663a18.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8c33c38-7c3a-5b4d-a887-6120b12f3f0c/e8c33c38-7c3a-5b4d-a887-6120b12f3f0c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_c82ffb62e3f17868821c9882695729f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8c33c38-7c3a-5b4d-a887-6120b12f3f0c/e8c33c38-7c3a-5b4d-a887-6120b12f3f0c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2542281,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_dee8d33e9b419094f0e730716ab848cb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8c33c38-7c3a-5b4d-a887-6120b12f3f0c/e8c33c38-7c3a-5b4d-a887-6120b12f3f0c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_acce23efef3e3a3629820fc34cf6f117.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8c33c38-7c3a-5b4d-a887-6120b12f3f0c/e8c33c38-7c3a-5b4d-a887-6120b12f3f0c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/da/b2da45ec20545949896b1dd08c05615a/pa/LA39027_4d070a1d090a8f6d4520fae022bc1f6b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-11-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.5 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2004}
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA39027%27 HTTP/1.1" 200 None
2026-03-27 10:45:48 [auto1.de] INFO: Saving data for LA39027: {'created_time': 1774608348.12103, 'last_price_update_time': 1774608348.121043, 'auction_closing_time': 1774713772.0}
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA39027') HTTP/1.1" 204 0
2026-03-27 10:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR69139> (referer: https://www.auto1.com/v1/car-details-view/BR69139/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001fd510>
2026-03-27 10:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8/a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fc5%252F84c5fc3cda12e06e51ecd50da8c71478%252Fpa%252FHV64790_ce125a5ebfb0274e4c1aaae6e8e6ca20.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_ce125a5ebfb0274e4c1aaae6e8e6ca20.jpg saved to cache
2026-03-27 10:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8
2026-03-27 10:45:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8, skipping ID generation
2026-03-27 10:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8 with scrape type 1
2026-03-27 10:45:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8 sending to next pipeline
2026-03-27 10:45:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8, identifier: HV64790
2026-03-27 10:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002073d0>
2026-03-27 10:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30986627-4795-5964-a386-2181452c2a6e/30986627-4795-5964-a386-2181452c2a6e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F5331d13314a0b54db64ac2f75f2df8ce%252Fpa%252FBY90710_f3098f0368d0d6a01db58094e1d700a3.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_f3098f0368d0d6a01db58094e1d700a3.jpg saved to cache
2026-03-27 10:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30986627-4795-5964-a386-2181452c2a6e
2026-03-27 10:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501969810>
2026-03-27 10:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8049887e-e6ec-5ec0-b934-32ee67f4586a/8049887e-e6ec-5ec0-b934-32ee67f4586a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F95%252F3e95111e6d12aed932064814fedf789b%252Fpa%252FJM16548_ff71d6db09cca8966254ce7d5e68f2b1.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_ff71d6db09cca8966254ce7d5e68f2b1.jpg saved to cache
2026-03-27 10:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8049887e-e6ec-5ec0-b934-32ee67f4586a
2026-03-27 10:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501969610>
2026-03-27 10:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8049887e-e6ec-5ec0-b934-32ee67f4586a/8049887e-e6ec-5ec0-b934-32ee67f4586a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F95%252F3e95111e6d12aed932064814fedf789b%252Fpa%252FJM16548_28e93a3e33ae68493b92d9cb2ef5d6bb.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_28e93a3e33ae68493b92d9cb2ef5d6bb.jpg saved to cache
2026-03-27 10:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8049887e-e6ec-5ec0-b934-32ee67f4586a
2026-03-27 10:45:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8049887e-e6ec-5ec0-b934-32ee67f4586a, skipping ID generation
2026-03-27 10:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8049887e-e6ec-5ec0-b934-32ee67f4586a with scrape type 1
2026-03-27 10:45:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8049887e-e6ec-5ec0-b934-32ee67f4586a sending to next pipeline
2026-03-27 10:45:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8049887e-e6ec-5ec0-b934-32ee67f4586a, identifier: JM16548
2026-03-27 10:45:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8 with identifier: HV64790
2026-03-27 10:45:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8 with identifier: HV64790
2026-03-27 10:45:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8 with identifier: HV64790 to the API
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_ce125a5ebfb0274e4c1aaae6e8e6ca20.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:33:10Z',
 'fuel_type': 'diesel',
 'id': 'a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV64790',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'BMW',
 'model': '2er',
 'odometer': 185594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8/a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_25c7aded110f626c5ce190a90f3e47cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8/a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_ce125a5ebfb0274e4c1aaae6e8e6ca20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8/a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_329589e9aca577f1fdfdccdf76df37a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8/a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_0b3af86c9c47928190c9d7179927aeee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8/a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_e0019dbe0bddc27373b55138a009083c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8/a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_e2c22641a5c5e7d3870e559a09ddd298.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8/a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_a48a1c208e537d5a6a0eeef51cebb8a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8/a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_e3f8d7a1759e2738956883ac60657069.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8/a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_6925c979f2ac0a3f0c3644ee1c50abda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8/a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/c5/84c5fc3cda12e06e51ecd50da8c71478/pa/HV64790_7469aa743b98e9cb89761c788f9a902c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 218d Active Tourer Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2018}
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV64790%27 HTTP/1.1" 200 None
2026-03-27 10:45:48 [auto1.de] INFO: Saving data for HV64790: {'created_time': 1774608348.986745, 'last_price_update_time': 1774608348.986757, 'auction_closing_time': 1774715590.0}
2026-03-27 10:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV64790') HTTP/1.1" 204 0
2026-03-27 10:45:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8049887e-e6ec-5ec0-b934-32ee67f4586a with identifier: JM16548
2026-03-27 10:45:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8049887e-e6ec-5ec0-b934-32ee67f4586a with identifier: JM16548
2026-03-27 10:45:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8049887e-e6ec-5ec0-b934-32ee67f4586a with identifier: JM16548 to the API
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_28e93a3e33ae68493b92d9cb2ef5d6bb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:11:27Z',
 'fuel_type': 'petrol',
 'id': '8049887e-e6ec-5ec0-b934-32ee67f4586a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM16548',
 'listing': 'auction',
 'location': 'DE, Jena',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 119026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8049887e-e6ec-5ec0-b934-32ee67f4586a/8049887e-e6ec-5ec0-b934-32ee67f4586a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_28e93a3e33ae68493b92d9cb2ef5d6bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8049887e-e6ec-5ec0-b934-32ee67f4586a/8049887e-e6ec-5ec0-b934-32ee67f4586a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_ff71d6db09cca8966254ce7d5e68f2b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8049887e-e6ec-5ec0-b934-32ee67f4586a/8049887e-e6ec-5ec0-b934-32ee67f4586a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_9c792e468a8d80a3795f299e2b827be0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8049887e-e6ec-5ec0-b934-32ee67f4586a/8049887e-e6ec-5ec0-b934-32ee67f4586a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_953658ca41ae7779d4abb905731ff225.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8049887e-e6ec-5ec0-b934-32ee67f4586a/8049887e-e6ec-5ec0-b934-32ee67f4586a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_36ae7af45ce6fd93701f9d397913dc12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8049887e-e6ec-5ec0-b934-32ee67f4586a/8049887e-e6ec-5ec0-b934-32ee67f4586a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/95/3e95111e6d12aed932064814fedf789b/pa/JM16548_87dac738be14526db7562e9680f4b4b5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.33 Dual VVT-i Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2009}
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM16548%27 HTTP/1.1" 200 None
2026-03-27 10:45:49 [auto1.de] INFO: Saving data for JM16548: {'created_time': 1774608349.382555, 'last_price_update_time': 1774608349.38257, 'auction_closing_time': 1774714287.0}
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM16548') HTTP/1.1" 204 0
2026-03-27 10:45:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60eda562-9dc3-5285-9e14-2312e2ea5c86 with identifier: BR69139
2026-03-27 10:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60eda562-9dc3-5285-9e14-2312e2ea5c86 with scrape type 1
2026-03-27 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60eda562-9dc3-5285-9e14-2312e2ea5c86
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fed%252Fb4edd21a9eefd7e9bc63b1b344d03808%252Fpa%252FBR69139_61a4da9ca67f5f6f69c171b076c087e8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_61a4da9ca67f5f6f69c171b076c087e8.jpg not downloaded yet
2026-03-27 10:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_1bd8b6db51020e78828b2f2ca127feac.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fed%252Fb4edd21a9eefd7e9bc63b1b344d03808%252Fpa%252FBR69139_a6bda467658181252ef39e2a368734e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_a6bda467658181252ef39e2a368734e5.jpg not downloaded yet
2026-03-27 10:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_22fc2e109899065d922dd22b0d92569a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fed%252Fb4edd21a9eefd7e9bc63b1b344d03808%252Fpa%252FBR69139_ed89a38b90b7bfe5d9e7dfc9ece8d76d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_ed89a38b90b7bfe5d9e7dfc9ece8d76d.jpg not downloaded yet
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fed%252Fb4edd21a9eefd7e9bc63b1b344d03808%252Fpa%252FBR69139_b0fceebcc64a89158682261d3188c06a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_b0fceebcc64a89158682261d3188c06a.jpg not downloaded yet
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fed%252Fb4edd21a9eefd7e9bc63b1b344d03808%252Fpa%252FBR69139_af421ae8f4a4c1afa21f9a04c0825726.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_af421ae8f4a4c1afa21f9a04c0825726.jpg not downloaded yet
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fed%252Fb4edd21a9eefd7e9bc63b1b344d03808%252Fpa%252FBR69139_5e731cf5e2528dbbaa1f4320ec3a79fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_5e731cf5e2528dbbaa1f4320ec3a79fc.jpg not downloaded yet
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fed%252Fb4edd21a9eefd7e9bc63b1b344d03808%252Fpa%252FBR69139_c10fed8f89bde73286837081a6731ff8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_c10fed8f89bde73286837081a6731ff8.jpg not downloaded yet
2026-03-27 10:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_61a4da9ca67f5f6f69c171b076c087e8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fed%252Fb4edd21a9eefd7e9bc63b1b344d03808%252Fpa%252FBR69139_f13021d52442abaf566d2d3d0f7426a4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_f13021d52442abaf566d2d3d0f7426a4.jpg not downloaded yet
2026-03-27 10:45:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500448dd0>
2026-03-27 10:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e620f3e6-49a7-5678-840b-c8020f1d696c/e620f3e6-49a7-5678-840b-c8020f1d696c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252Fe7%252F79e7e68d2433c9e4d765a406e6f5c046%252Fpa%252FHB95489_1bd8b6db51020e78828b2f2ca127feac.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_1bd8b6db51020e78828b2f2ca127feac.jpg saved to cache
2026-03-27 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e620f3e6-49a7-5678-840b-c8020f1d696c
2026-03-27 10:45:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e620f3e6-49a7-5678-840b-c8020f1d696c, skipping ID generation
2026-03-27 10:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e620f3e6-49a7-5678-840b-c8020f1d696c with scrape type 1
2026-03-27 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e620f3e6-49a7-5678-840b-c8020f1d696c sending to next pipeline
2026-03-27 10:45:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e620f3e6-49a7-5678-840b-c8020f1d696c, identifier: HB95489
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fed%252Fb4edd21a9eefd7e9bc63b1b344d03808%252Fpa%252FBR69139_e264e8c363efabb99bcfab4c3a72a834.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_e264e8c363efabb99bcfab4c3a72a834.jpg not downloaded yet
2026-03-27 10:45:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e620f3e6-49a7-5678-840b-c8020f1d696c with identifier: HB95489
2026-03-27 10:45:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e620f3e6-49a7-5678-840b-c8020f1d696c with identifier: HB95489
2026-03-27 10:45:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e620f3e6-49a7-5678-840b-c8020f1d696c with identifier: HB95489 to the API
2026-03-27 10:45:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_1bd8b6db51020e78828b2f2ca127feac.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:45:51Z',
 'fuel_type': 'petrol',
 'id': 'e620f3e6-49a7-5678-840b-c8020f1d696c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB95489',
 'listing': 'auction',
 'location': 'DE, Lippstadt',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 19702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e620f3e6-49a7-5678-840b-c8020f1d696c/e620f3e6-49a7-5678-840b-c8020f1d696c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_d2eb828a4ed257ebe854ad293eed483d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e620f3e6-49a7-5678-840b-c8020f1d696c/e620f3e6-49a7-5678-840b-c8020f1d696c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_90123f7b7968a018bbba89b4d31cc41c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e620f3e6-49a7-5678-840b-c8020f1d696c/e620f3e6-49a7-5678-840b-c8020f1d696c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_c3bcea0f0e18ab0c26d323662bb40cbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e620f3e6-49a7-5678-840b-c8020f1d696c/e620f3e6-49a7-5678-840b-c8020f1d696c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_64e10acedd02549cc2144064f17560cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e620f3e6-49a7-5678-840b-c8020f1d696c/e620f3e6-49a7-5678-840b-c8020f1d696c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_0ff9223239042198ca3d4352660698bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e620f3e6-49a7-5678-840b-c8020f1d696c/e620f3e6-49a7-5678-840b-c8020f1d696c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_3ff69c44efc23d51d87e2cf8e62758fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e620f3e6-49a7-5678-840b-c8020f1d696c/e620f3e6-49a7-5678-840b-c8020f1d696c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_4fdd2cd6f086e6f4bd202e7fcc6e6d4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e620f3e6-49a7-5678-840b-c8020f1d696c/e620f3e6-49a7-5678-840b-c8020f1d696c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_c08f1613e006d44b293a3dca12d243d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e620f3e6-49a7-5678-840b-c8020f1d696c/e620f3e6-49a7-5678-840b-c8020f1d696c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_bdf0a4798e8e5dc284ddbbd2b0e94a8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e620f3e6-49a7-5678-840b-c8020f1d696c/e620f3e6-49a7-5678-840b-c8020f1d696c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3038719,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img79/e7/79e7e68d2433c9e4d765a406e6f5c046/pa/HB95489_1bd8b6db51020e78828b2f2ca127feac.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2025}
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB95489%27 HTTP/1.1" 200 None
2026-03-27 10:45:50 [auto1.de] INFO: Saving data for HB95489: {'created_time': 1774608350.293553, 'last_price_update_time': 1774608350.293566, 'auction_closing_time': 1774716351.0}
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB95489') HTTP/1.1" 204 0
2026-03-27 10:45:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500339410>
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4/7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fd4%252F98d41ff5c2c5120e1a068bbf18704d5d%252Fpa%252FTG96584_22fc2e109899065d922dd22b0d92569a.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_22fc2e109899065d922dd22b0d92569a.jpg saved to cache
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4
2026-03-27 10:45:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4, skipping ID generation
2026-03-27 10:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4 with scrape type 1
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4 sending to next pipeline
2026-03-27 10:45:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4, identifier: TG96584
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fed%252Fb4edd21a9eefd7e9bc63b1b344d03808%252Fpa%252FBR69139_cbc7987b0c0332a812881697b2ab38b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_cbc7987b0c0332a812881697b2ab38b4.jpg not downloaded yet
2026-03-27 10:45:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4 with identifier: TG96584
2026-03-27 10:45:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4 with identifier: TG96584
2026-03-27 10:45:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4 with identifier: TG96584 to the API
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_22fc2e109899065d922dd22b0d92569a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:59:51Z',
 'fuel_type': 'diesel',
 'id': '7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG96584',
 'listing': 'auction',
 'location': 'DE, Bautzen',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 82638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4/7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3064874,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_22fc2e109899065d922dd22b0d92569a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4/7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_a87f34ca14fde36bd1d880041b7b81a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4/7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_75422e48570508327dcf4bd71445e4cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4/7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_e3d4ba411cad1862cb1820ecdcf7f1b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4/7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2806220,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_90ea3cdf7d5d12fbdaba6a97f3112d4d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4/7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_65be8aeebebe9558fa7a0d07fa42a3a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4/7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_0ddc5ba73141bad2d91ee14a9c8936d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4/7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_894a6ae8ce0231243272536b250d64c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4/7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_1b49aced4ae827c215f4b396cb1dd557.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4/7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/d4/98d41ff5c2c5120e1a068bbf18704d5d/pa/TG96584_a45ddf0ecfea4518f2e49be1ff67bcd3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 160 CDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG96584%27 HTTP/1.1" 200 None
2026-03-27 10:45:51 [auto1.de] INFO: Saving data for TG96584: {'created_time': 1774608351.072797, 'last_price_update_time': 1774608351.072809, 'auction_closing_time': 1774717191.0}
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG96584') HTTP/1.1" 204 0
2026-03-27 10:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500394d90>
2026-03-27 10:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60eda562-9dc3-5285-9e14-2312e2ea5c86/60eda562-9dc3-5285-9e14-2312e2ea5c86_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fed%252Fb4edd21a9eefd7e9bc63b1b344d03808%252Fpa%252FBR69139_61a4da9ca67f5f6f69c171b076c087e8.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_61a4da9ca67f5f6f69c171b076c087e8.jpg saved to cache
2026-03-27 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60eda562-9dc3-5285-9e14-2312e2ea5c86
2026-03-27 10:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_2182d85258c776bbd88e810c619f39ea.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_632aafca6ea526673bab13c262ecbdc2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501968690>
2026-03-27 10:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30986627-4795-5964-a386-2181452c2a6e/30986627-4795-5964-a386-2181452c2a6e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F31%252F5331d13314a0b54db64ac2f75f2df8ce%252Fpa%252FBY90710_2182d85258c776bbd88e810c619f39ea.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_2182d85258c776bbd88e810c619f39ea.jpg saved to cache
2026-03-27 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30986627-4795-5964-a386-2181452c2a6e
2026-03-27 10:45:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30986627-4795-5964-a386-2181452c2a6e, skipping ID generation
2026-03-27 10:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30986627-4795-5964-a386-2181452c2a6e with scrape type 1
2026-03-27 10:45:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30986627-4795-5964-a386-2181452c2a6e sending to next pipeline
2026-03-27 10:45:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30986627-4795-5964-a386-2181452c2a6e, identifier: BY90710
2026-03-27 10:45:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30986627-4795-5964-a386-2181452c2a6e with identifier: BY90710
2026-03-27 10:45:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30986627-4795-5964-a386-2181452c2a6e with identifier: BY90710
2026-03-27 10:45:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30986627-4795-5964-a386-2181452c2a6e with identifier: BY90710 to the API
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_2182d85258c776bbd88e810c619f39ea.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:57:10Z',
 'fuel_type': 'diesel',
 'id': '30986627-4795-5964-a386-2181452c2a6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY90710',
 'listing': 'auction',
 'location': 'DE, Würzburg',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 244350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30986627-4795-5964-a386-2181452c2a6e/30986627-4795-5964-a386-2181452c2a6e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2237300,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_2182d85258c776bbd88e810c619f39ea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30986627-4795-5964-a386-2181452c2a6e/30986627-4795-5964-a386-2181452c2a6e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_f3098f0368d0d6a01db58094e1d700a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30986627-4795-5964-a386-2181452c2a6e/30986627-4795-5964-a386-2181452c2a6e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2266600,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_ce2484226ea62b63c593c7446957fb33.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30986627-4795-5964-a386-2181452c2a6e/30986627-4795-5964-a386-2181452c2a6e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_c8fcb25c09e30c4adbedf36691262dca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30986627-4795-5964-a386-2181452c2a6e/30986627-4795-5964-a386-2181452c2a6e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2210655,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_b898119c4ba8933ed85cd93c84f7b83d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30986627-4795-5964-a386-2181452c2a6e/30986627-4795-5964-a386-2181452c2a6e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2218477,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_2e37570cd8331dc8459d977687a9f1ba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30986627-4795-5964-a386-2181452c2a6e/30986627-4795-5964-a386-2181452c2a6e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_c0f15395a837ae551696ccbc2a80c9a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30986627-4795-5964-a386-2181452c2a6e/30986627-4795-5964-a386-2181452c2a6e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_9d7b235c29c3010bf64b641c2ebf43e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30986627-4795-5964-a386-2181452c2a6e/30986627-4795-5964-a386-2181452c2a6e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2183341,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_45c9a01b8b3fc445b83d53c420a9c9e6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30986627-4795-5964-a386-2181452c2a6e/30986627-4795-5964-a386-2181452c2a6e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2152167,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/31/5331d13314a0b54db64ac2f75f2df8ce/pa/BY90710_6b8727a3450b866cc248a1292810bc2f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 350 CDI BlueTEC',
 'transmission': 'automatic',
 'trim': 'BlueTEC',
 'year': 2012}
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY90710%27 HTTP/1.1" 200 None
2026-03-27 10:45:51 [auto1.de] INFO: Saving data for BY90710: {'created_time': 1774608351.982587, 'last_price_update_time': 1774608351.9826, 'auction_closing_time': 1774717030.0}
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY90710') HTTP/1.1" 204 0
2026-03-27 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_af421ae8f4a4c1afa21f9a04c0825726.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_cbc7987b0c0332a812881697b2ab38b4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_e264e8c363efabb99bcfab4c3a72a834.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501682f90>
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c218447f-2f05-5fb8-b352-abe4d5938aad/c218447f-2f05-5fb8-b352-abe4d5938aad_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7a%252F4d7a76cf71d17ec266e8856f3c6a5e25%252Fpa%252FKV84804_632aafca6ea526673bab13c262ecbdc2.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_632aafca6ea526673bab13c262ecbdc2.jpg saved to cache
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c218447f-2f05-5fb8-b352-abe4d5938aad
2026-03-27 10:45:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c218447f-2f05-5fb8-b352-abe4d5938aad, skipping ID generation
2026-03-27 10:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c218447f-2f05-5fb8-b352-abe4d5938aad with scrape type 1
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c218447f-2f05-5fb8-b352-abe4d5938aad sending to next pipeline
2026-03-27 10:45:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c218447f-2f05-5fb8-b352-abe4d5938aad, identifier: KV84804
2026-03-27 10:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c218447f-2f05-5fb8-b352-abe4d5938aad with identifier: KV84804
2026-03-27 10:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c218447f-2f05-5fb8-b352-abe4d5938aad with identifier: KV84804
2026-03-27 10:45:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c218447f-2f05-5fb8-b352-abe4d5938aad with identifier: KV84804 to the API
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_632aafca6ea526673bab13c262ecbdc2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:50:46Z',
 'fuel_type': 'diesel',
 'id': 'c218447f-2f05-5fb8-b352-abe4d5938aad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV84804',
 'listing': 'auction',
 'location': 'DE, Potsdam',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 156275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c218447f-2f05-5fb8-b352-abe4d5938aad/c218447f-2f05-5fb8-b352-abe4d5938aad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2493693,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_632aafca6ea526673bab13c262ecbdc2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c218447f-2f05-5fb8-b352-abe4d5938aad/c218447f-2f05-5fb8-b352-abe4d5938aad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_4d449ab612bae0959009c64f92994d2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c218447f-2f05-5fb8-b352-abe4d5938aad/c218447f-2f05-5fb8-b352-abe4d5938aad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_0b8501db71e53964f72e6fb399961d4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c218447f-2f05-5fb8-b352-abe4d5938aad/c218447f-2f05-5fb8-b352-abe4d5938aad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_5a063aafbe9f95071d8f9da8bfb4ecba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c218447f-2f05-5fb8-b352-abe4d5938aad/c218447f-2f05-5fb8-b352-abe4d5938aad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2627287,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_4704305d9c650b867393407b39cddcaa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c218447f-2f05-5fb8-b352-abe4d5938aad/c218447f-2f05-5fb8-b352-abe4d5938aad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2455697,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_45176928420d21403a2dea48e2aadebb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c218447f-2f05-5fb8-b352-abe4d5938aad/c218447f-2f05-5fb8-b352-abe4d5938aad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2503516,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_ac0d1f5b9cd314cfacea960f6aeba169.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c218447f-2f05-5fb8-b352-abe4d5938aad/c218447f-2f05-5fb8-b352-abe4d5938aad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_b34df8658de0c45378cfdba0ada53d80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c218447f-2f05-5fb8-b352-abe4d5938aad/c218447f-2f05-5fb8-b352-abe4d5938aad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2536912,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_0cf204f4de60fc3de9b9539d9d7cce7a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c218447f-2f05-5fb8-b352-abe4d5938aad/c218447f-2f05-5fb8-b352-abe4d5938aad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2463901,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7a/4d7a76cf71d17ec266e8856f3c6a5e25/pa/KV84804_698fc9a55e03743af0dcfa76ae10627b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV84804%27 HTTP/1.1" 200 None
2026-03-27 10:45:52 [auto1.de] INFO: Saving data for KV84804: {'created_time': 1774608352.685398, 'last_price_update_time': 1774608352.685413, 'auction_closing_time': 1774716646.0}
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV84804') HTTP/1.1" 204 0
2026-03-27 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_a6bda467658181252ef39e2a368734e5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500352fd0>
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60eda562-9dc3-5285-9e14-2312e2ea5c86/60eda562-9dc3-5285-9e14-2312e2ea5c86_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fed%252Fb4edd21a9eefd7e9bc63b1b344d03808%252Fpa%252FBR69139_af421ae8f4a4c1afa21f9a04c0825726.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_af421ae8f4a4c1afa21f9a04c0825726.jpg saved to cache
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60eda562-9dc3-5285-9e14-2312e2ea5c86
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002c8e90>
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60eda562-9dc3-5285-9e14-2312e2ea5c86/60eda562-9dc3-5285-9e14-2312e2ea5c86_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fed%252Fb4edd21a9eefd7e9bc63b1b344d03808%252Fpa%252FBR69139_cbc7987b0c0332a812881697b2ab38b4.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_cbc7987b0c0332a812881697b2ab38b4.jpg saved to cache
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60eda562-9dc3-5285-9e14-2312e2ea5c86
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016df910>
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60eda562-9dc3-5285-9e14-2312e2ea5c86/60eda562-9dc3-5285-9e14-2312e2ea5c86_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fed%252Fb4edd21a9eefd7e9bc63b1b344d03808%252Fpa%252FBR69139_e264e8c363efabb99bcfab4c3a72a834.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_e264e8c363efabb99bcfab4c3a72a834.jpg saved to cache
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60eda562-9dc3-5285-9e14-2312e2ea5c86
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500390410>
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60eda562-9dc3-5285-9e14-2312e2ea5c86/60eda562-9dc3-5285-9e14-2312e2ea5c86_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fed%252Fb4edd21a9eefd7e9bc63b1b344d03808%252Fpa%252FBR69139_a6bda467658181252ef39e2a368734e5.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_a6bda467658181252ef39e2a368734e5.jpg saved to cache
2026-03-27 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60eda562-9dc3-5285-9e14-2312e2ea5c86
2026-03-27 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_ed89a38b90b7bfe5d9e7dfc9ece8d76d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_b0fceebcc64a89158682261d3188c06a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_c10fed8f89bde73286837081a6731ff8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_5e731cf5e2528dbbaa1f4320ec3a79fc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_f13021d52442abaf566d2d3d0f7426a4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:45:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500224c10>
2026-03-27 10:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60eda562-9dc3-5285-9e14-2312e2ea5c86/60eda562-9dc3-5285-9e14-2312e2ea5c86_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fed%252Fb4edd21a9eefd7e9bc63b1b344d03808%252Fpa%252FBR69139_ed89a38b90b7bfe5d9e7dfc9ece8d76d.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_ed89a38b90b7bfe5d9e7dfc9ece8d76d.jpg saved to cache
2026-03-27 10:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60eda562-9dc3-5285-9e14-2312e2ea5c86
2026-03-27 10:45:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500391150>
2026-03-27 10:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60eda562-9dc3-5285-9e14-2312e2ea5c86/60eda562-9dc3-5285-9e14-2312e2ea5c86_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fed%252Fb4edd21a9eefd7e9bc63b1b344d03808%252Fpa%252FBR69139_b0fceebcc64a89158682261d3188c06a.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_b0fceebcc64a89158682261d3188c06a.jpg saved to cache
2026-03-27 10:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60eda562-9dc3-5285-9e14-2312e2ea5c86
2026-03-27 10:45:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5036e2450>
2026-03-27 10:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60eda562-9dc3-5285-9e14-2312e2ea5c86/60eda562-9dc3-5285-9e14-2312e2ea5c86_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fed%252Fb4edd21a9eefd7e9bc63b1b344d03808%252Fpa%252FBR69139_c10fed8f89bde73286837081a6731ff8.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_c10fed8f89bde73286837081a6731ff8.jpg saved to cache
2026-03-27 10:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60eda562-9dc3-5285-9e14-2312e2ea5c86
2026-03-27 10:45:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501845750>
2026-03-27 10:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60eda562-9dc3-5285-9e14-2312e2ea5c86/60eda562-9dc3-5285-9e14-2312e2ea5c86_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fed%252Fb4edd21a9eefd7e9bc63b1b344d03808%252Fpa%252FBR69139_5e731cf5e2528dbbaa1f4320ec3a79fc.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_5e731cf5e2528dbbaa1f4320ec3a79fc.jpg saved to cache
2026-03-27 10:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60eda562-9dc3-5285-9e14-2312e2ea5c86
2026-03-27 10:45:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50033a250>
2026-03-27 10:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60eda562-9dc3-5285-9e14-2312e2ea5c86/60eda562-9dc3-5285-9e14-2312e2ea5c86_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fed%252Fb4edd21a9eefd7e9bc63b1b344d03808%252Fpa%252FBR69139_f13021d52442abaf566d2d3d0f7426a4.jpg') HTTP/1.1" 204 0
2026-03-27 10:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_f13021d52442abaf566d2d3d0f7426a4.jpg saved to cache
2026-03-27 10:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60eda562-9dc3-5285-9e14-2312e2ea5c86
2026-03-27 10:45:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60eda562-9dc3-5285-9e14-2312e2ea5c86, skipping ID generation
2026-03-27 10:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60eda562-9dc3-5285-9e14-2312e2ea5c86 with scrape type 1
2026-03-27 10:45:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60eda562-9dc3-5285-9e14-2312e2ea5c86 sending to next pipeline
2026-03-27 10:45:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60eda562-9dc3-5285-9e14-2312e2ea5c86, identifier: BR69139
2026-03-27 10:45:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60eda562-9dc3-5285-9e14-2312e2ea5c86 with identifier: BR69139
2026-03-27 10:45:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60eda562-9dc3-5285-9e14-2312e2ea5c86 with identifier: BR69139
2026-03-27 10:45:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60eda562-9dc3-5285-9e14-2312e2ea5c86 with identifier: BR69139 to the API
2026-03-27 10:45:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:45:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:45:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_f13021d52442abaf566d2d3d0f7426a4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 192,
 'expiration_date': '2026-03-28T16:18:50Z',
 'fuel_type': 'petrol',
 'id': '60eda562-9dc3-5285-9e14-2312e2ea5c86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR69139',
 'listing': 'auction',
 'location': 'DE, Wuppertal',
 'make': 'BMW',
 'model': '2er',
 'odometer': 123085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60eda562-9dc3-5285-9e14-2312e2ea5c86/60eda562-9dc3-5285-9e14-2312e2ea5c86_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_61a4da9ca67f5f6f69c171b076c087e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60eda562-9dc3-5285-9e14-2312e2ea5c86/60eda562-9dc3-5285-9e14-2312e2ea5c86_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_a6bda467658181252ef39e2a368734e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60eda562-9dc3-5285-9e14-2312e2ea5c86/60eda562-9dc3-5285-9e14-2312e2ea5c86_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2969457,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_ed89a38b90b7bfe5d9e7dfc9ece8d76d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60eda562-9dc3-5285-9e14-2312e2ea5c86/60eda562-9dc3-5285-9e14-2312e2ea5c86_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3169196,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_b0fceebcc64a89158682261d3188c06a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60eda562-9dc3-5285-9e14-2312e2ea5c86/60eda562-9dc3-5285-9e14-2312e2ea5c86_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_af421ae8f4a4c1afa21f9a04c0825726.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60eda562-9dc3-5285-9e14-2312e2ea5c86/60eda562-9dc3-5285-9e14-2312e2ea5c86_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2955279,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_5e731cf5e2528dbbaa1f4320ec3a79fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60eda562-9dc3-5285-9e14-2312e2ea5c86/60eda562-9dc3-5285-9e14-2312e2ea5c86_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2961304,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_c10fed8f89bde73286837081a6731ff8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60eda562-9dc3-5285-9e14-2312e2ea5c86/60eda562-9dc3-5285-9e14-2312e2ea5c86_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3157602,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_f13021d52442abaf566d2d3d0f7426a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60eda562-9dc3-5285-9e14-2312e2ea5c86/60eda562-9dc3-5285-9e14-2312e2ea5c86_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_e264e8c363efabb99bcfab4c3a72a834.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60eda562-9dc3-5285-9e14-2312e2ea5c86/60eda562-9dc3-5285-9e14-2312e2ea5c86_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ed/b4edd21a9eefd7e9bc63b1b344d03808/pa/BR69139_cbc7987b0c0332a812881697b2ab38b4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 220i Active Tourer Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2017}
2026-03-27 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR69139%27 HTTP/1.1" 200 None
2026-03-27 10:45:54 [auto1.de] INFO: Saving data for BR69139: {'created_time': 1774608354.263438, 'last_price_update_time': 1774608354.263463, 'auction_closing_time': 1774714730.0}
2026-03-27 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR69139') HTTP/1.1" 204 0
2026-03-27 10:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN87643/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MW80784/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN87643> (referer: https://www.auto1.com/v1/car-details-view/EN87643/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:45:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c982c84-a8cd-576e-ba63-bd456b8b2ebc with identifier: EN87643
2026-03-27 10:45:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c982c84-a8cd-576e-ba63-bd456b8b2ebc with scrape type 1
2026-03-27 10:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c982c84-a8cd-576e-ba63-bd456b8b2ebc
2026-03-27 10:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bee65871635db6746f205b81adfffc%252Fpa%252FEN87643_b6cace50ddc4bbf809e865c2b629b16c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_b6cace50ddc4bbf809e865c2b629b16c.jpg not downloaded yet
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bee65871635db6746f205b81adfffc%252Fpa%252FEN87643_749722f1b5ced517097ec28c22a29901.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_749722f1b5ced517097ec28c22a29901.jpg not downloaded yet
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bee65871635db6746f205b81adfffc%252Fpa%252FEN87643_551c7600e3503a8c0ecd19df9b981bf0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_551c7600e3503a8c0ecd19df9b981bf0.jpg not downloaded yet
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bee65871635db6746f205b81adfffc%252Fpa%252FEN87643_3616ba45f14f4b47a79884310669deea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_3616ba45f14f4b47a79884310669deea.jpg not downloaded yet
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bee65871635db6746f205b81adfffc%252Fpa%252FEN87643_edf574e02f14cc073fc0772ab6d6b3d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_edf574e02f14cc073fc0772ab6d6b3d5.jpg not downloaded yet
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bee65871635db6746f205b81adfffc%252Fpa%252FEN87643_11dd4ae4a34d32e4ca1fc6e11f294a10.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_11dd4ae4a34d32e4ca1fc6e11f294a10.jpg not downloaded yet
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bee65871635db6746f205b81adfffc%252Fpa%252FEN87643_82fbff29bae82e673cba98ce9f89a900.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_82fbff29bae82e673cba98ce9f89a900.jpg not downloaded yet
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bee65871635db6746f205b81adfffc%252Fpa%252FEN87643_7a64833c562b0d276a2442aa88bc92de.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_7a64833c562b0d276a2442aa88bc92de.jpg not downloaded yet
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bee65871635db6746f205b81adfffc%252Fpa%252FEN87643_80658124c1f2de6414246deda754335d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_80658124c1f2de6414246deda754335d.jpg not downloaded yet
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bee65871635db6746f205b81adfffc%252Fpa%252FEN87643_11adfbeadbb007c8f0552f3d91022425.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_11adfbeadbb007c8f0552f3d91022425.jpg not downloaded yet
2026-03-27 10:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_b6cace50ddc4bbf809e865c2b629b16c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_749722f1b5ced517097ec28c22a29901.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_551c7600e3503a8c0ecd19df9b981bf0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_3616ba45f14f4b47a79884310669deea.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5039ec590>
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c982c84-a8cd-576e-ba63-bd456b8b2ebc/9c982c84-a8cd-576e-ba63-bd456b8b2ebc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bee65871635db6746f205b81adfffc%252Fpa%252FEN87643_b6cace50ddc4bbf809e865c2b629b16c.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_b6cace50ddc4bbf809e865c2b629b16c.jpg saved to cache
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c982c84-a8cd-576e-ba63-bd456b8b2ebc
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5036e2190>
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c982c84-a8cd-576e-ba63-bd456b8b2ebc/9c982c84-a8cd-576e-ba63-bd456b8b2ebc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bee65871635db6746f205b81adfffc%252Fpa%252FEN87643_749722f1b5ced517097ec28c22a29901.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_749722f1b5ced517097ec28c22a29901.jpg saved to cache
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c982c84-a8cd-576e-ba63-bd456b8b2ebc
2026-03-27 10:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_11adfbeadbb007c8f0552f3d91022425.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001c9f10>
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c982c84-a8cd-576e-ba63-bd456b8b2ebc/9c982c84-a8cd-576e-ba63-bd456b8b2ebc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bee65871635db6746f205b81adfffc%252Fpa%252FEN87643_551c7600e3503a8c0ecd19df9b981bf0.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_551c7600e3503a8c0ecd19df9b981bf0.jpg saved to cache
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c982c84-a8cd-576e-ba63-bd456b8b2ebc
2026-03-27 10:46:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004496d0>
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c982c84-a8cd-576e-ba63-bd456b8b2ebc/9c982c84-a8cd-576e-ba63-bd456b8b2ebc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bee65871635db6746f205b81adfffc%252Fpa%252FEN87643_3616ba45f14f4b47a79884310669deea.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_3616ba45f14f4b47a79884310669deea.jpg saved to cache
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c982c84-a8cd-576e-ba63-bd456b8b2ebc
2026-03-27 10:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_80658124c1f2de6414246deda754335d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015e0450>
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c982c84-a8cd-576e-ba63-bd456b8b2ebc/9c982c84-a8cd-576e-ba63-bd456b8b2ebc_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bee65871635db6746f205b81adfffc%252Fpa%252FEN87643_11adfbeadbb007c8f0552f3d91022425.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_11adfbeadbb007c8f0552f3d91022425.jpg saved to cache
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9c982c84-a8cd-576e-ba63-bd456b8b2ebc
2026-03-27 10:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_edf574e02f14cc073fc0772ab6d6b3d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_82fbff29bae82e673cba98ce9f89a900.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_7a64833c562b0d276a2442aa88bc92de.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001cb550>
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c982c84-a8cd-576e-ba63-bd456b8b2ebc/9c982c84-a8cd-576e-ba63-bd456b8b2ebc_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bee65871635db6746f205b81adfffc%252Fpa%252FEN87643_80658124c1f2de6414246deda754335d.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_80658124c1f2de6414246deda754335d.jpg saved to cache
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c982c84-a8cd-576e-ba63-bd456b8b2ebc
2026-03-27 10:46:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500453ad0>
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c982c84-a8cd-576e-ba63-bd456b8b2ebc/9c982c84-a8cd-576e-ba63-bd456b8b2ebc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bee65871635db6746f205b81adfffc%252Fpa%252FEN87643_edf574e02f14cc073fc0772ab6d6b3d5.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_edf574e02f14cc073fc0772ab6d6b3d5.jpg saved to cache
2026-03-27 10:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c982c84-a8cd-576e-ba63-bd456b8b2ebc
2026-03-27 10:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_11dd4ae4a34d32e4ca1fc6e11f294a10.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RZ99970/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501681dd0>
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c982c84-a8cd-576e-ba63-bd456b8b2ebc/9c982c84-a8cd-576e-ba63-bd456b8b2ebc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bee65871635db6746f205b81adfffc%252Fpa%252FEN87643_82fbff29bae82e673cba98ce9f89a900.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_82fbff29bae82e673cba98ce9f89a900.jpg saved to cache
2026-03-27 10:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c982c84-a8cd-576e-ba63-bd456b8b2ebc
2026-03-27 10:46:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500394e90>
2026-03-27 10:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c982c84-a8cd-576e-ba63-bd456b8b2ebc/9c982c84-a8cd-576e-ba63-bd456b8b2ebc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bee65871635db6746f205b81adfffc%252Fpa%252FEN87643_7a64833c562b0d276a2442aa88bc92de.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_7a64833c562b0d276a2442aa88bc92de.jpg saved to cache
2026-03-27 10:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c982c84-a8cd-576e-ba63-bd456b8b2ebc
2026-03-27 10:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MW80784> (referer: https://www.auto1.com/v1/car-details-view/MW80784/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f2050>
2026-03-27 10:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c982c84-a8cd-576e-ba63-bd456b8b2ebc/9c982c84-a8cd-576e-ba63-bd456b8b2ebc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fbe%252F63bee65871635db6746f205b81adfffc%252Fpa%252FEN87643_11dd4ae4a34d32e4ca1fc6e11f294a10.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_11dd4ae4a34d32e4ca1fc6e11f294a10.jpg saved to cache
2026-03-27 10:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c982c84-a8cd-576e-ba63-bd456b8b2ebc
2026-03-27 10:46:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c982c84-a8cd-576e-ba63-bd456b8b2ebc, skipping ID generation
2026-03-27 10:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c982c84-a8cd-576e-ba63-bd456b8b2ebc with scrape type 1
2026-03-27 10:46:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c982c84-a8cd-576e-ba63-bd456b8b2ebc sending to next pipeline
2026-03-27 10:46:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c982c84-a8cd-576e-ba63-bd456b8b2ebc, identifier: EN87643
2026-03-27 10:46:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c982c84-a8cd-576e-ba63-bd456b8b2ebc with identifier: EN87643
2026-03-27 10:46:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c982c84-a8cd-576e-ba63-bd456b8b2ebc with identifier: EN87643
2026-03-27 10:46:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c982c84-a8cd-576e-ba63-bd456b8b2ebc with identifier: EN87643 to the API
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_11dd4ae4a34d32e4ca1fc6e11f294a10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': 'Rental',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:04:45Z',
 'fuel_type': 'diesel',
 'id': '9c982c84-a8cd-576e-ba63-bd456b8b2ebc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN87643',
 'listing': 'auction',
 'location': 'DE, Tostedt',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 238117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c982c84-a8cd-576e-ba63-bd456b8b2ebc/9c982c84-a8cd-576e-ba63-bd456b8b2ebc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_b6cace50ddc4bbf809e865c2b629b16c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c982c84-a8cd-576e-ba63-bd456b8b2ebc/9c982c84-a8cd-576e-ba63-bd456b8b2ebc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_749722f1b5ced517097ec28c22a29901.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c982c84-a8cd-576e-ba63-bd456b8b2ebc/9c982c84-a8cd-576e-ba63-bd456b8b2ebc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_551c7600e3503a8c0ecd19df9b981bf0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c982c84-a8cd-576e-ba63-bd456b8b2ebc/9c982c84-a8cd-576e-ba63-bd456b8b2ebc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2594368,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_3616ba45f14f4b47a79884310669deea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c982c84-a8cd-576e-ba63-bd456b8b2ebc/9c982c84-a8cd-576e-ba63-bd456b8b2ebc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2962643,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_edf574e02f14cc073fc0772ab6d6b3d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c982c84-a8cd-576e-ba63-bd456b8b2ebc/9c982c84-a8cd-576e-ba63-bd456b8b2ebc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2240892,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_11dd4ae4a34d32e4ca1fc6e11f294a10.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c982c84-a8cd-576e-ba63-bd456b8b2ebc/9c982c84-a8cd-576e-ba63-bd456b8b2ebc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1900018,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_82fbff29bae82e673cba98ce9f89a900.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c982c84-a8cd-576e-ba63-bd456b8b2ebc/9c982c84-a8cd-576e-ba63-bd456b8b2ebc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2418419,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_7a64833c562b0d276a2442aa88bc92de.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c982c84-a8cd-576e-ba63-bd456b8b2ebc/9c982c84-a8cd-576e-ba63-bd456b8b2ebc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_80658124c1f2de6414246deda754335d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c982c84-a8cd-576e-ba63-bd456b8b2ebc/9c982c84-a8cd-576e-ba63-bd456b8b2ebc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/be/63bee65871635db6746f205b81adfffc/pa/EN87643_11adfbeadbb007c8f0552f3d91022425.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2014}
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN87643%27 HTTP/1.1" 200 None
2026-03-27 10:46:01 [auto1.de] INFO: Saving data for EN87643: {'created_time': 1774608361.892529, 'last_price_update_time': 1774608361.892543, 'auction_closing_time': 1774713885.0}
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN87643') HTTP/1.1" 204 0
2026-03-27 10:46:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:46:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2653b174-06e5-50de-887b-c45ebcc68d2b with identifier: MW80784
2026-03-27 10:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2653b174-06e5-50de-887b-c45ebcc68d2b with scrape type 1
2026-03-27 10:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2653b174-06e5-50de-887b-c45ebcc68d2b
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc6%252F33c6579db49035dc0a5c6fd478ee4641%252Fpa%252FMW80784_a0d7f75dbca84e024ffa0d4a2c0a7690.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_a0d7f75dbca84e024ffa0d4a2c0a7690.jpg not downloaded yet
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc6%252F33c6579db49035dc0a5c6fd478ee4641%252Fpa%252FMW80784_7aac226312da7fdb316e87cfc2be7fb3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_7aac226312da7fdb316e87cfc2be7fb3.jpg not downloaded yet
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc6%252F33c6579db49035dc0a5c6fd478ee4641%252Fpa%252FMW80784_c59e9649cc636cbb371137b39bc140ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_c59e9649cc636cbb371137b39bc140ef.jpg not downloaded yet
2026-03-27 10:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc6%252F33c6579db49035dc0a5c6fd478ee4641%252Fpa%252FMW80784_d91a9498f475e079aa9e975fefbec61a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_d91a9498f475e079aa9e975fefbec61a.jpg not downloaded yet
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc6%252F33c6579db49035dc0a5c6fd478ee4641%252Fpa%252FMW80784_6157175ce2aaaae279672223b36f6f9e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_6157175ce2aaaae279672223b36f6f9e.jpg not downloaded yet
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc6%252F33c6579db49035dc0a5c6fd478ee4641%252Fpa%252FMW80784_fc1694afa9391642c45fce09be044746.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_fc1694afa9391642c45fce09be044746.jpg not downloaded yet
2026-03-27 10:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_a0d7f75dbca84e024ffa0d4a2c0a7690.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc6%252F33c6579db49035dc0a5c6fd478ee4641%252Fpa%252FMW80784_3be5dabc05a60f470787aeca8f571503.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_3be5dabc05a60f470787aeca8f571503.jpg not downloaded yet
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc6%252F33c6579db49035dc0a5c6fd478ee4641%252Fpa%252FMW80784_653c0049602054f2e01f06ada93ce655.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_653c0049602054f2e01f06ada93ce655.jpg not downloaded yet
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc6%252F33c6579db49035dc0a5c6fd478ee4641%252Fpa%252FMW80784_a19d8c0ec68f1f795e37468001d9994d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_a19d8c0ec68f1f795e37468001d9994d.jpg not downloaded yet
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc6%252F33c6579db49035dc0a5c6fd478ee4641%252Fpa%252FMW80784_4abc3205477e6478dd418ed0798969ab.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_4abc3205477e6478dd418ed0798969ab.jpg not downloaded yet
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500450090>
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2653b174-06e5-50de-887b-c45ebcc68d2b/2653b174-06e5-50de-887b-c45ebcc68d2b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc6%252F33c6579db49035dc0a5c6fd478ee4641%252Fpa%252FMW80784_a0d7f75dbca84e024ffa0d4a2c0a7690.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_a0d7f75dbca84e024ffa0d4a2c0a7690.jpg saved to cache
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2653b174-06e5-50de-887b-c45ebcc68d2b
2026-03-27 10:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_d91a9498f475e079aa9e975fefbec61a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_c59e9649cc636cbb371137b39bc140ef.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_a19d8c0ec68f1f795e37468001d9994d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_7aac226312da7fdb316e87cfc2be7fb3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004c6c50>
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2653b174-06e5-50de-887b-c45ebcc68d2b/2653b174-06e5-50de-887b-c45ebcc68d2b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc6%252F33c6579db49035dc0a5c6fd478ee4641%252Fpa%252FMW80784_d91a9498f475e079aa9e975fefbec61a.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_d91a9498f475e079aa9e975fefbec61a.jpg saved to cache
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2653b174-06e5-50de-887b-c45ebcc68d2b
2026-03-27 10:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_4abc3205477e6478dd418ed0798969ab.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004583d0>
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2653b174-06e5-50de-887b-c45ebcc68d2b/2653b174-06e5-50de-887b-c45ebcc68d2b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc6%252F33c6579db49035dc0a5c6fd478ee4641%252Fpa%252FMW80784_c59e9649cc636cbb371137b39bc140ef.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_c59e9649cc636cbb371137b39bc140ef.jpg saved to cache
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2653b174-06e5-50de-887b-c45ebcc68d2b
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50177b790>
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2653b174-06e5-50de-887b-c45ebcc68d2b/2653b174-06e5-50de-887b-c45ebcc68d2b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc6%252F33c6579db49035dc0a5c6fd478ee4641%252Fpa%252FMW80784_a19d8c0ec68f1f795e37468001d9994d.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_a19d8c0ec68f1f795e37468001d9994d.jpg saved to cache
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2653b174-06e5-50de-887b-c45ebcc68d2b
2026-03-27 10:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_6157175ce2aaaae279672223b36f6f9e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500395450>
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2653b174-06e5-50de-887b-c45ebcc68d2b/2653b174-06e5-50de-887b-c45ebcc68d2b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc6%252F33c6579db49035dc0a5c6fd478ee4641%252Fpa%252FMW80784_7aac226312da7fdb316e87cfc2be7fb3.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_7aac226312da7fdb316e87cfc2be7fb3.jpg saved to cache
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2653b174-06e5-50de-887b-c45ebcc68d2b
2026-03-27 10:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_3be5dabc05a60f470787aeca8f571503.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003977d0>
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2653b174-06e5-50de-887b-c45ebcc68d2b/2653b174-06e5-50de-887b-c45ebcc68d2b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc6%252F33c6579db49035dc0a5c6fd478ee4641%252Fpa%252FMW80784_4abc3205477e6478dd418ed0798969ab.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_4abc3205477e6478dd418ed0798969ab.jpg saved to cache
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2653b174-06e5-50de-887b-c45ebcc68d2b
2026-03-27 10:46:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500409a90>
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2653b174-06e5-50de-887b-c45ebcc68d2b/2653b174-06e5-50de-887b-c45ebcc68d2b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc6%252F33c6579db49035dc0a5c6fd478ee4641%252Fpa%252FMW80784_6157175ce2aaaae279672223b36f6f9e.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_6157175ce2aaaae279672223b36f6f9e.jpg saved to cache
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2653b174-06e5-50de-887b-c45ebcc68d2b
2026-03-27 10:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_fc1694afa9391642c45fce09be044746.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501743010>
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2653b174-06e5-50de-887b-c45ebcc68d2b/2653b174-06e5-50de-887b-c45ebcc68d2b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc6%252F33c6579db49035dc0a5c6fd478ee4641%252Fpa%252FMW80784_3be5dabc05a60f470787aeca8f571503.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_3be5dabc05a60f470787aeca8f571503.jpg saved to cache
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2653b174-06e5-50de-887b-c45ebcc68d2b
2026-03-27 10:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_653c0049602054f2e01f06ada93ce655.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50032f510>
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2653b174-06e5-50de-887b-c45ebcc68d2b/2653b174-06e5-50de-887b-c45ebcc68d2b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc6%252F33c6579db49035dc0a5c6fd478ee4641%252Fpa%252FMW80784_fc1694afa9391642c45fce09be044746.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_fc1694afa9391642c45fce09be044746.jpg saved to cache
2026-03-27 10:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2653b174-06e5-50de-887b-c45ebcc68d2b
2026-03-27 10:46:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501740090>
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2653b174-06e5-50de-887b-c45ebcc68d2b/2653b174-06e5-50de-887b-c45ebcc68d2b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fc6%252F33c6579db49035dc0a5c6fd478ee4641%252Fpa%252FMW80784_653c0049602054f2e01f06ada93ce655.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_653c0049602054f2e01f06ada93ce655.jpg saved to cache
2026-03-27 10:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2653b174-06e5-50de-887b-c45ebcc68d2b
2026-03-27 10:46:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2653b174-06e5-50de-887b-c45ebcc68d2b, skipping ID generation
2026-03-27 10:46:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2653b174-06e5-50de-887b-c45ebcc68d2b with scrape type 1
2026-03-27 10:46:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2653b174-06e5-50de-887b-c45ebcc68d2b sending to next pipeline
2026-03-27 10:46:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2653b174-06e5-50de-887b-c45ebcc68d2b, identifier: MW80784
2026-03-27 10:46:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2653b174-06e5-50de-887b-c45ebcc68d2b with identifier: MW80784
2026-03-27 10:46:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2653b174-06e5-50de-887b-c45ebcc68d2b with identifier: MW80784
2026-03-27 10:46:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2653b174-06e5-50de-887b-c45ebcc68d2b with identifier: MW80784 to the API
2026-03-27 10:46:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_653c0049602054f2e01f06ada93ce655.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:28:54Z',
 'fuel_type': 'diesel',
 'id': '2653b174-06e5-50de-887b-c45ebcc68d2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW80784',
 'listing': 'auction',
 'location': 'DE, Hagen',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 121034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2653b174-06e5-50de-887b-c45ebcc68d2b/2653b174-06e5-50de-887b-c45ebcc68d2b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_a0d7f75dbca84e024ffa0d4a2c0a7690.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2653b174-06e5-50de-887b-c45ebcc68d2b/2653b174-06e5-50de-887b-c45ebcc68d2b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2612544,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_7aac226312da7fdb316e87cfc2be7fb3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2653b174-06e5-50de-887b-c45ebcc68d2b/2653b174-06e5-50de-887b-c45ebcc68d2b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_c59e9649cc636cbb371137b39bc140ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2653b174-06e5-50de-887b-c45ebcc68d2b/2653b174-06e5-50de-887b-c45ebcc68d2b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_d91a9498f475e079aa9e975fefbec61a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2653b174-06e5-50de-887b-c45ebcc68d2b/2653b174-06e5-50de-887b-c45ebcc68d2b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2220629,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_6157175ce2aaaae279672223b36f6f9e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2653b174-06e5-50de-887b-c45ebcc68d2b/2653b174-06e5-50de-887b-c45ebcc68d2b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1928997,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_fc1694afa9391642c45fce09be044746.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2653b174-06e5-50de-887b-c45ebcc68d2b/2653b174-06e5-50de-887b-c45ebcc68d2b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1923360,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_3be5dabc05a60f470787aeca8f571503.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2653b174-06e5-50de-887b-c45ebcc68d2b/2653b174-06e5-50de-887b-c45ebcc68d2b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2114657,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_653c0049602054f2e01f06ada93ce655.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2653b174-06e5-50de-887b-c45ebcc68d2b/2653b174-06e5-50de-887b-c45ebcc68d2b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_a19d8c0ec68f1f795e37468001d9994d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2653b174-06e5-50de-887b-c45ebcc68d2b/2653b174-06e5-50de-887b-c45ebcc68d2b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/c6/33c6579db49035dc0a5c6fd478ee4641/pa/MW80784_4abc3205477e6478dd418ed0798969ab.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-08-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Opel Combo 1.6 CDTI Kasten L1H1 2,4t',
 'transmission': 'manual',
 'trim': 'Kasten L1H1 2,4t',
 'year': 2016}
2026-03-27 10:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW80784%27 HTTP/1.1" 200 None
2026-03-27 10:46:03 [auto1.de] INFO: Saving data for MW80784: {'created_time': 1774608363.623562, 'last_price_update_time': 1774608363.623573, 'auction_closing_time': 1774715334.0}
2026-03-27 10:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW80784') HTTP/1.1" 204 0
2026-03-27 10:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RZ99970> (referer: https://www.auto1.com/v1/car-details-view/RZ99970/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f3d696f-5c7b-50cb-bc2b-0f66a171c111 with identifier: RZ99970
2026-03-27 10:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f3d696f-5c7b-50cb-bc2b-0f66a171c111 with scrape type 1
2026-03-27 10:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9f3d696f-5c7b-50cb-bc2b-0f66a171c111
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F63%252F55636b30116f62946315f9a65cdf6009%252Fpa%252FRZ99970_2865a10abd0b8d6e59bbf3d780045df3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/63/55636b30116f62946315f9a65cdf6009/pa/RZ99970_2865a10abd0b8d6e59bbf3d780045df3.jpg not downloaded yet
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F63%252F55636b30116f62946315f9a65cdf6009%252Fpa%252FRZ99970_d6f53826e93d9857d8e9f76711bfa01d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/63/55636b30116f62946315f9a65cdf6009/pa/RZ99970_d6f53826e93d9857d8e9f76711bfa01d.jpg not downloaded yet
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F63%252F55636b30116f62946315f9a65cdf6009%252Fpa%252FRZ99970_b51df7642c9265b7bb03d6e97c5e4984.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/63/55636b30116f62946315f9a65cdf6009/pa/RZ99970_b51df7642c9265b7bb03d6e97c5e4984.jpg not downloaded yet
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F63%252F55636b30116f62946315f9a65cdf6009%252Fpa%252FRZ99970_3f0bc857cf413f3242adf65878d8a67c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/63/55636b30116f62946315f9a65cdf6009/pa/RZ99970_3f0bc857cf413f3242adf65878d8a67c.jpg not downloaded yet
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F63%252F55636b30116f62946315f9a65cdf6009%252Fpa%252FRZ99970_ca36d6159625a89c426c7ade9ad645f2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/63/55636b30116f62946315f9a65cdf6009/pa/RZ99970_ca36d6159625a89c426c7ade9ad645f2.jpg not downloaded yet
2026-03-27 10:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/63/55636b30116f62946315f9a65cdf6009/pa/RZ99970_2865a10abd0b8d6e59bbf3d780045df3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/63/55636b30116f62946315f9a65cdf6009/pa/RZ99970_b51df7642c9265b7bb03d6e97c5e4984.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/63/55636b30116f62946315f9a65cdf6009/pa/RZ99970_ca36d6159625a89c426c7ade9ad645f2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015e0810>
2026-03-27 10:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f3d696f-5c7b-50cb-bc2b-0f66a171c111/9f3d696f-5c7b-50cb-bc2b-0f66a171c111_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F63%252F55636b30116f62946315f9a65cdf6009%252Fpa%252FRZ99970_2865a10abd0b8d6e59bbf3d780045df3.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/63/55636b30116f62946315f9a65cdf6009/pa/RZ99970_2865a10abd0b8d6e59bbf3d780045df3.jpg saved to cache
2026-03-27 10:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f3d696f-5c7b-50cb-bc2b-0f66a171c111
2026-03-27 10:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50040bd90>
2026-03-27 10:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f3d696f-5c7b-50cb-bc2b-0f66a171c111/9f3d696f-5c7b-50cb-bc2b-0f66a171c111_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F63%252F55636b30116f62946315f9a65cdf6009%252Fpa%252FRZ99970_b51df7642c9265b7bb03d6e97c5e4984.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/63/55636b30116f62946315f9a65cdf6009/pa/RZ99970_b51df7642c9265b7bb03d6e97c5e4984.jpg saved to cache
2026-03-27 10:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f3d696f-5c7b-50cb-bc2b-0f66a171c111
2026-03-27 10:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004c4090>
2026-03-27 10:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f3d696f-5c7b-50cb-bc2b-0f66a171c111/9f3d696f-5c7b-50cb-bc2b-0f66a171c111_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F63%252F55636b30116f62946315f9a65cdf6009%252Fpa%252FRZ99970_ca36d6159625a89c426c7ade9ad645f2.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/63/55636b30116f62946315f9a65cdf6009/pa/RZ99970_ca36d6159625a89c426c7ade9ad645f2.jpg saved to cache
2026-03-27 10:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f3d696f-5c7b-50cb-bc2b-0f66a171c111
2026-03-27 10:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/63/55636b30116f62946315f9a65cdf6009/pa/RZ99970_d6f53826e93d9857d8e9f76711bfa01d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/63/55636b30116f62946315f9a65cdf6009/pa/RZ99970_3f0bc857cf413f3242adf65878d8a67c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500453510>
2026-03-27 10:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f3d696f-5c7b-50cb-bc2b-0f66a171c111/9f3d696f-5c7b-50cb-bc2b-0f66a171c111_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F63%252F55636b30116f62946315f9a65cdf6009%252Fpa%252FRZ99970_d6f53826e93d9857d8e9f76711bfa01d.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/63/55636b30116f62946315f9a65cdf6009/pa/RZ99970_d6f53826e93d9857d8e9f76711bfa01d.jpg saved to cache
2026-03-27 10:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f3d696f-5c7b-50cb-bc2b-0f66a171c111
2026-03-27 10:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50519a750>
2026-03-27 10:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f3d696f-5c7b-50cb-bc2b-0f66a171c111/9f3d696f-5c7b-50cb-bc2b-0f66a171c111_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F63%252F55636b30116f62946315f9a65cdf6009%252Fpa%252FRZ99970_3f0bc857cf413f3242adf65878d8a67c.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/63/55636b30116f62946315f9a65cdf6009/pa/RZ99970_3f0bc857cf413f3242adf65878d8a67c.jpg saved to cache
2026-03-27 10:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f3d696f-5c7b-50cb-bc2b-0f66a171c111
2026-03-27 10:46:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f3d696f-5c7b-50cb-bc2b-0f66a171c111, skipping ID generation
2026-03-27 10:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f3d696f-5c7b-50cb-bc2b-0f66a171c111 with scrape type 1
2026-03-27 10:46:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f3d696f-5c7b-50cb-bc2b-0f66a171c111 sending to next pipeline
2026-03-27 10:46:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f3d696f-5c7b-50cb-bc2b-0f66a171c111, identifier: RZ99970
2026-03-27 10:46:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f3d696f-5c7b-50cb-bc2b-0f66a171c111 with identifier: RZ99970
2026-03-27 10:46:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f3d696f-5c7b-50cb-bc2b-0f66a171c111 with identifier: RZ99970
2026-03-27 10:46:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f3d696f-5c7b-50cb-bc2b-0f66a171c111 with identifier: RZ99970 to the API
2026-03-27 10:46:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img55/63/55636b30116f62946315f9a65cdf6009/pa/RZ99970_3f0bc857cf413f3242adf65878d8a67c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:50:30Z',
 'fuel_type': 'petrol',
 'id': '9f3d696f-5c7b-50cb-bc2b-0f66a171c111',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ99970',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 124070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f3d696f-5c7b-50cb-bc2b-0f66a171c111/9f3d696f-5c7b-50cb-bc2b-0f66a171c111_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/63/55636b30116f62946315f9a65cdf6009/pa/RZ99970_2865a10abd0b8d6e59bbf3d780045df3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f3d696f-5c7b-50cb-bc2b-0f66a171c111/9f3d696f-5c7b-50cb-bc2b-0f66a171c111_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/63/55636b30116f62946315f9a65cdf6009/pa/RZ99970_d6f53826e93d9857d8e9f76711bfa01d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f3d696f-5c7b-50cb-bc2b-0f66a171c111/9f3d696f-5c7b-50cb-bc2b-0f66a171c111_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/63/55636b30116f62946315f9a65cdf6009/pa/RZ99970_b51df7642c9265b7bb03d6e97c5e4984.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f3d696f-5c7b-50cb-bc2b-0f66a171c111/9f3d696f-5c7b-50cb-bc2b-0f66a171c111_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/63/55636b30116f62946315f9a65cdf6009/pa/RZ99970_3f0bc857cf413f3242adf65878d8a67c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f3d696f-5c7b-50cb-bc2b-0f66a171c111/9f3d696f-5c7b-50cb-bc2b-0f66a171c111_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/63/55636b30116f62946315f9a65cdf6009/pa/RZ99970_ca36d6159625a89c426c7ade9ad645f2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2009}
2026-03-27 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ99970%27 HTTP/1.1" 200 None
2026-03-27 10:46:05 [auto1.de] INFO: Saving data for RZ99970: {'created_time': 1774608365.526383, 'last_price_update_time': 1774608365.526395, 'auction_closing_time': 1774716630.0}
2026-03-27 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ99970') HTTP/1.1" 204 0
2026-03-27 10:46:06 [scrapy.extensions.logstats] INFO: Crawled 386 pages (at 16 pages/min), scraped 601 items (at 69 items/min)
2026-03-27 10:46:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 10:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH87632> (referer: https://www.auto1.com/v1/car-details-view/PH87632/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7340ca4f-9b8b-5f3a-8bfe-63527741aad2 with identifier: PH87632
2026-03-27 10:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7340ca4f-9b8b-5f3a-8bfe-63527741aad2 with scrape type 1
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7340ca4f-9b8b-5f3a-8bfe-63527741aad2
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb8359d5f0859dab3eb65fa9ef15034e%252Fpa%252FPH87632_f2548ac404c9b7355bc27a3e44ae728c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_f2548ac404c9b7355bc27a3e44ae728c.jpg not downloaded yet
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb8359d5f0859dab3eb65fa9ef15034e%252Fpa%252FPH87632_8e58c3fcfaeeb76897ea333dce4d80d7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_8e58c3fcfaeeb76897ea333dce4d80d7.jpg not downloaded yet
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb8359d5f0859dab3eb65fa9ef15034e%252Fpa%252FPH87632_de4155b9d2f5c8150a7fdb6d6086f398.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_de4155b9d2f5c8150a7fdb6d6086f398.jpg not downloaded yet
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb8359d5f0859dab3eb65fa9ef15034e%252Fpa%252FPH87632_6d33a5b37ea70df6de368e1d9f4bf81f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_6d33a5b37ea70df6de368e1d9f4bf81f.jpg not downloaded yet
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb8359d5f0859dab3eb65fa9ef15034e%252Fpa%252FPH87632_f1fd460548a9c508211b244b375fbf6c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_f1fd460548a9c508211b244b375fbf6c.jpg not downloaded yet
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb8359d5f0859dab3eb65fa9ef15034e%252Fpa%252FPH87632_a75dbf990525ab7a9dc60c0359797942.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_a75dbf990525ab7a9dc60c0359797942.jpg not downloaded yet
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb8359d5f0859dab3eb65fa9ef15034e%252Fpa%252FPH87632_70d58534e41527b0dc5be9656ab36873.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_70d58534e41527b0dc5be9656ab36873.jpg not downloaded yet
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb8359d5f0859dab3eb65fa9ef15034e%252Fpa%252FPH87632_2ea220ed688c49d086a2a21b9aee4581.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_2ea220ed688c49d086a2a21b9aee4581.jpg not downloaded yet
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb8359d5f0859dab3eb65fa9ef15034e%252Fpa%252FPH87632_90aeaa2d4c9848dda2b7fdc43e0de9f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_90aeaa2d4c9848dda2b7fdc43e0de9f6.jpg not downloaded yet
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb8359d5f0859dab3eb65fa9ef15034e%252Fpa%252FPH87632_ac3fd2507808d15d46e17ade3ef5b844.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_ac3fd2507808d15d46e17ade3ef5b844.jpg not downloaded yet
2026-03-27 10:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_f2548ac404c9b7355bc27a3e44ae728c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_8e58c3fcfaeeb76897ea333dce4d80d7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_f1fd460548a9c508211b244b375fbf6c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_a75dbf990525ab7a9dc60c0359797942.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_de4155b9d2f5c8150a7fdb6d6086f398.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_90aeaa2d4c9848dda2b7fdc43e0de9f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_ac3fd2507808d15d46e17ade3ef5b844.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f3210>
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7340ca4f-9b8b-5f3a-8bfe-63527741aad2/7340ca4f-9b8b-5f3a-8bfe-63527741aad2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb8359d5f0859dab3eb65fa9ef15034e%252Fpa%252FPH87632_f2548ac404c9b7355bc27a3e44ae728c.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_f2548ac404c9b7355bc27a3e44ae728c.jpg saved to cache
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7340ca4f-9b8b-5f3a-8bfe-63527741aad2
2026-03-27 10:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_6d33a5b37ea70df6de368e1d9f4bf81f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_2ea220ed688c49d086a2a21b9aee4581.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_70d58534e41527b0dc5be9656ab36873.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500452410>
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7340ca4f-9b8b-5f3a-8bfe-63527741aad2/7340ca4f-9b8b-5f3a-8bfe-63527741aad2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb8359d5f0859dab3eb65fa9ef15034e%252Fpa%252FPH87632_8e58c3fcfaeeb76897ea333dce4d80d7.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_8e58c3fcfaeeb76897ea333dce4d80d7.jpg saved to cache
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7340ca4f-9b8b-5f3a-8bfe-63527741aad2
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50165df90>
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7340ca4f-9b8b-5f3a-8bfe-63527741aad2/7340ca4f-9b8b-5f3a-8bfe-63527741aad2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb8359d5f0859dab3eb65fa9ef15034e%252Fpa%252FPH87632_f1fd460548a9c508211b244b375fbf6c.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_f1fd460548a9c508211b244b375fbf6c.jpg saved to cache
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7340ca4f-9b8b-5f3a-8bfe-63527741aad2
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500343c10>
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7340ca4f-9b8b-5f3a-8bfe-63527741aad2/7340ca4f-9b8b-5f3a-8bfe-63527741aad2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb8359d5f0859dab3eb65fa9ef15034e%252Fpa%252FPH87632_a75dbf990525ab7a9dc60c0359797942.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_a75dbf990525ab7a9dc60c0359797942.jpg saved to cache
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7340ca4f-9b8b-5f3a-8bfe-63527741aad2
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016aa0d0>
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7340ca4f-9b8b-5f3a-8bfe-63527741aad2/7340ca4f-9b8b-5f3a-8bfe-63527741aad2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb8359d5f0859dab3eb65fa9ef15034e%252Fpa%252FPH87632_de4155b9d2f5c8150a7fdb6d6086f398.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_de4155b9d2f5c8150a7fdb6d6086f398.jpg saved to cache
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7340ca4f-9b8b-5f3a-8bfe-63527741aad2
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500401d10>
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7340ca4f-9b8b-5f3a-8bfe-63527741aad2/7340ca4f-9b8b-5f3a-8bfe-63527741aad2_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb8359d5f0859dab3eb65fa9ef15034e%252Fpa%252FPH87632_90aeaa2d4c9848dda2b7fdc43e0de9f6.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_90aeaa2d4c9848dda2b7fdc43e0de9f6.jpg saved to cache
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7340ca4f-9b8b-5f3a-8bfe-63527741aad2
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016a8450>
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7340ca4f-9b8b-5f3a-8bfe-63527741aad2/7340ca4f-9b8b-5f3a-8bfe-63527741aad2_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb8359d5f0859dab3eb65fa9ef15034e%252Fpa%252FPH87632_ac3fd2507808d15d46e17ade3ef5b844.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_ac3fd2507808d15d46e17ade3ef5b844.jpg saved to cache
2026-03-27 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7340ca4f-9b8b-5f3a-8bfe-63527741aad2
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003992d0>
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7340ca4f-9b8b-5f3a-8bfe-63527741aad2/7340ca4f-9b8b-5f3a-8bfe-63527741aad2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb8359d5f0859dab3eb65fa9ef15034e%252Fpa%252FPH87632_6d33a5b37ea70df6de368e1d9f4bf81f.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_6d33a5b37ea70df6de368e1d9f4bf81f.jpg saved to cache
2026-03-27 10:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7340ca4f-9b8b-5f3a-8bfe-63527741aad2
2026-03-27 10:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016de690>
2026-03-27 10:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7340ca4f-9b8b-5f3a-8bfe-63527741aad2/7340ca4f-9b8b-5f3a-8bfe-63527741aad2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb8359d5f0859dab3eb65fa9ef15034e%252Fpa%252FPH87632_2ea220ed688c49d086a2a21b9aee4581.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_2ea220ed688c49d086a2a21b9aee4581.jpg saved to cache
2026-03-27 10:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7340ca4f-9b8b-5f3a-8bfe-63527741aad2
2026-03-27 10:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501732a10>
2026-03-27 10:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7340ca4f-9b8b-5f3a-8bfe-63527741aad2/7340ca4f-9b8b-5f3a-8bfe-63527741aad2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F83%252Fdb8359d5f0859dab3eb65fa9ef15034e%252Fpa%252FPH87632_70d58534e41527b0dc5be9656ab36873.jpg') HTTP/1.1" 204 0
2026-03-27 10:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_70d58534e41527b0dc5be9656ab36873.jpg saved to cache
2026-03-27 10:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7340ca4f-9b8b-5f3a-8bfe-63527741aad2
2026-03-27 10:46:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7340ca4f-9b8b-5f3a-8bfe-63527741aad2, skipping ID generation
2026-03-27 10:46:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7340ca4f-9b8b-5f3a-8bfe-63527741aad2 with scrape type 1
2026-03-27 10:46:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7340ca4f-9b8b-5f3a-8bfe-63527741aad2 sending to next pipeline
2026-03-27 10:46:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7340ca4f-9b8b-5f3a-8bfe-63527741aad2, identifier: PH87632
2026-03-27 10:46:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7340ca4f-9b8b-5f3a-8bfe-63527741aad2 with identifier: PH87632
2026-03-27 10:46:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7340ca4f-9b8b-5f3a-8bfe-63527741aad2 with identifier: PH87632
2026-03-27 10:46:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7340ca4f-9b8b-5f3a-8bfe-63527741aad2 with identifier: PH87632 to the API
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_70d58534e41527b0dc5be9656ab36873.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:20:33Z',
 'fuel_type': 'diesel',
 'id': '7340ca4f-9b8b-5f3a-8bfe-63527741aad2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH87632',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 104045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7340ca4f-9b8b-5f3a-8bfe-63527741aad2/7340ca4f-9b8b-5f3a-8bfe-63527741aad2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_f2548ac404c9b7355bc27a3e44ae728c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7340ca4f-9b8b-5f3a-8bfe-63527741aad2/7340ca4f-9b8b-5f3a-8bfe-63527741aad2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_8e58c3fcfaeeb76897ea333dce4d80d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7340ca4f-9b8b-5f3a-8bfe-63527741aad2/7340ca4f-9b8b-5f3a-8bfe-63527741aad2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_de4155b9d2f5c8150a7fdb6d6086f398.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7340ca4f-9b8b-5f3a-8bfe-63527741aad2/7340ca4f-9b8b-5f3a-8bfe-63527741aad2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_6d33a5b37ea70df6de368e1d9f4bf81f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7340ca4f-9b8b-5f3a-8bfe-63527741aad2/7340ca4f-9b8b-5f3a-8bfe-63527741aad2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_f1fd460548a9c508211b244b375fbf6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7340ca4f-9b8b-5f3a-8bfe-63527741aad2/7340ca4f-9b8b-5f3a-8bfe-63527741aad2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_a75dbf990525ab7a9dc60c0359797942.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7340ca4f-9b8b-5f3a-8bfe-63527741aad2/7340ca4f-9b8b-5f3a-8bfe-63527741aad2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_70d58534e41527b0dc5be9656ab36873.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7340ca4f-9b8b-5f3a-8bfe-63527741aad2/7340ca4f-9b8b-5f3a-8bfe-63527741aad2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_2ea220ed688c49d086a2a21b9aee4581.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7340ca4f-9b8b-5f3a-8bfe-63527741aad2/7340ca4f-9b8b-5f3a-8bfe-63527741aad2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_90aeaa2d4c9848dda2b7fdc43e0de9f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7340ca4f-9b8b-5f3a-8bfe-63527741aad2/7340ca4f-9b8b-5f3a-8bfe-63527741aad2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/83/db8359d5f0859dab3eb65fa9ef15034e/pa/PH87632_ac3fd2507808d15d46e17ade3ef5b844.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 CDI Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2010}
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH87632%27 HTTP/1.1" 200 None
2026-03-27 10:46:12 [auto1.de] INFO: Saving data for PH87632: {'created_time': 1774608372.602594, 'last_price_update_time': 1774608372.602606, 'auction_closing_time': 1774714833.0}
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH87632') HTTP/1.1" 204 0
2026-03-27 10:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:42 [auto1.de] INFO: Channel: 24h | Page: 34 | totalHits: 10551 | hits on page: 40
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: BF31444
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF31444%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for BF31444: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: PL78300
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: KF41308
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF41308%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for KF41308: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: TP63810
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63810%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for TP63810: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: FF92976
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: RF27065
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF27065%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for RF27065: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: MM04767
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04767%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for MM04767: 0
2026-03-27 10:46:42 [auto1.de] INFO: Found listing with ID: AJ13004
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ13004%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Scrape type for AJ13004: 2
2026-03-27 10:46:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2650f5b-4934-5021-821b-9935d661cf49 with identifier: AJ13004
2026-03-27 10:46:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2650f5b-4934-5021-821b-9935d661cf49 with scrape type 2
2026-03-27 10:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2650f5b-4934-5021-821b-9935d661cf49 with scrape type 2
2026-03-27 10:46:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2650f5b-4934-5021-821b-9935d661cf49, identifier: AJ13004
2026-03-27 10:46:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2650f5b-4934-5021-821b-9935d661cf49 with identifier: AJ13004
2026-03-27 10:46:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2650f5b-4934-5021-821b-9935d661cf49 with identifier: AJ13004
2026-03-27 10:46:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2650f5b-4934-5021-821b-9935d661cf49 with identifier: AJ13004 to the API
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:28:56Z',
 'fuel_type': 'petrol',
 'id': 'd2650f5b-4934-5021-821b-9935d661cf49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ13004',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 125993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-29',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 e-VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ13004%27 HTTP/1.1" 200 None
2026-03-27 10:46:42 [auto1.de] INFO: Saving data for AJ13004: {'auction_closing_time': 1774715336.0, 'created_time': 1772543367.94763, 'last_price_update_time': 1774608402.981754}
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ13004') HTTP/1.1" 204 0
2026-03-27 10:46:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: UT93934
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT93934%27 HTTP/1.1" 200 None
2026-03-27 10:46:43 [auto1.de] INFO: Scrape type for UT93934: 2
2026-03-27 10:46:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eca787e8-bbb9-5c5e-9aad-c874b48cb593 with identifier: UT93934
2026-03-27 10:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eca787e8-bbb9-5c5e-9aad-c874b48cb593 with scrape type 2
2026-03-27 10:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eca787e8-bbb9-5c5e-9aad-c874b48cb593 with scrape type 2
2026-03-27 10:46:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eca787e8-bbb9-5c5e-9aad-c874b48cb593, identifier: UT93934
2026-03-27 10:46:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eca787e8-bbb9-5c5e-9aad-c874b48cb593 with identifier: UT93934
2026-03-27 10:46:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eca787e8-bbb9-5c5e-9aad-c874b48cb593 with identifier: UT93934
2026-03-27 10:46:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eca787e8-bbb9-5c5e-9aad-c874b48cb593 with identifier: UT93934 to the API
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:05:02Z',
 'fuel_type': 'petrol',
 'id': 'eca787e8-bbb9-5c5e-9aad-c874b48cb593',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT93934',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 40607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-01',
 'seller_name': None,
 'title': 'Seat Alhambra 1.4 TSI FR-Line',
 'transmission': 'automatic',
 'trim': 'FR-Line',
 'year': 2022}
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT93934%27 HTTP/1.1" 200 None
2026-03-27 10:46:43 [auto1.de] INFO: Saving data for UT93934: {'auction_closing_time': 1774713902.0, 'created_time': 1773308013.532886, 'last_price_update_time': 1774608403.481651}
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT93934') HTTP/1.1" 204 0
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: WG69866
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG69866%27 HTTP/1.1" 200 None
2026-03-27 10:46:43 [auto1.de] INFO: Scrape type for WG69866: 2
2026-03-27 10:46:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e12cb2a1-a2fe-534d-b4fb-81d35620c92c with identifier: WG69866
2026-03-27 10:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e12cb2a1-a2fe-534d-b4fb-81d35620c92c with scrape type 2
2026-03-27 10:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e12cb2a1-a2fe-534d-b4fb-81d35620c92c with scrape type 2
2026-03-27 10:46:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e12cb2a1-a2fe-534d-b4fb-81d35620c92c, identifier: WG69866
2026-03-27 10:46:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e12cb2a1-a2fe-534d-b4fb-81d35620c92c with identifier: WG69866
2026-03-27 10:46:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e12cb2a1-a2fe-534d-b4fb-81d35620c92c with identifier: WG69866
2026-03-27 10:46:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e12cb2a1-a2fe-534d-b4fb-81d35620c92c with identifier: WG69866 to the API
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:54:55Z',
 'fuel_type': 'diesel',
 'id': 'e12cb2a1-a2fe-534d-b4fb-81d35620c92c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG69866',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 114723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-31',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG69866%27 HTTP/1.1" 200 None
2026-03-27 10:46:43 [auto1.de] INFO: Saving data for WG69866: {'auction_closing_time': 1774716895.0, 'created_time': 1773688809.985888, 'last_price_update_time': 1774608403.964187}
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG69866') HTTP/1.1" 204 0
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: CN67479
2026-03-27 10:46:43 [auto1.de] INFO: Found listing with ID: UJ55086
2026-03-27 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ55086%27 HTTP/1.1" 200 None
2026-03-27 10:46:44 [auto1.de] INFO: Scrape type for UJ55086: 2
2026-03-27 10:46:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34 with identifier: UJ55086
2026-03-27 10:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34 with scrape type 2
2026-03-27 10:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34 with scrape type 2
2026-03-27 10:46:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34, identifier: UJ55086
2026-03-27 10:46:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34 with identifier: UJ55086
2026-03-27 10:46:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34 with identifier: UJ55086
2026-03-27 10:46:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34 with identifier: UJ55086 to the API
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:10:15Z',
 'fuel_type': 'diesel',
 'id': 'e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ55086',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 239166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-13',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CDI BlueEfficiency Elegance',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Elegance',
 'year': 2010}
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ55086%27 HTTP/1.1" 200 None
2026-03-27 10:46:44 [auto1.de] INFO: Saving data for UJ55086: {'auction_closing_time': 1774714215.0, 'created_time': 1773380972.326889, 'last_price_update_time': 1774608404.458327}
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ55086') HTTP/1.1" 204 0
2026-03-27 10:46:44 [auto1.de] INFO: Found listing with ID: DJ80434
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ80434%27 HTTP/1.1" 200 None
2026-03-27 10:46:44 [auto1.de] INFO: Scrape type for DJ80434: 2
2026-03-27 10:46:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 289ee44b-35a2-5b13-bbc6-fdac120b2f7e with identifier: DJ80434
2026-03-27 10:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 289ee44b-35a2-5b13-bbc6-fdac120b2f7e with scrape type 2
2026-03-27 10:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 289ee44b-35a2-5b13-bbc6-fdac120b2f7e with scrape type 2
2026-03-27 10:46:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 289ee44b-35a2-5b13-bbc6-fdac120b2f7e, identifier: DJ80434
2026-03-27 10:46:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 289ee44b-35a2-5b13-bbc6-fdac120b2f7e with identifier: DJ80434
2026-03-27 10:46:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 289ee44b-35a2-5b13-bbc6-fdac120b2f7e with identifier: DJ80434
2026-03-27 10:46:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 289ee44b-35a2-5b13-bbc6-fdac120b2f7e with identifier: DJ80434 to the API
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:57:39Z',
 'fuel_type': 'diesel',
 'id': '289ee44b-35a2-5b13-bbc6-fdac120b2f7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ80434',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 282273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-06',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-27 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ80434%27 HTTP/1.1" 200 None
2026-03-27 10:46:45 [auto1.de] INFO: Saving data for DJ80434: {'auction_closing_time': 1774717059.0, 'created_time': 1774264339.259533, 'last_price_update_time': 1774608405.038787}
2026-03-27 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ80434') HTTP/1.1" 204 0
2026-03-27 10:46:45 [auto1.de] INFO: Found listing with ID: AK47916
2026-03-27 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK47916%27 HTTP/1.1" 200 None
2026-03-27 10:46:45 [auto1.de] INFO: Scrape type for AK47916: 2
2026-03-27 10:46:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: febbbca0-2805-5891-b32d-eb10306c292e with identifier: AK47916
2026-03-27 10:46:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item febbbca0-2805-5891-b32d-eb10306c292e with scrape type 2
2026-03-27 10:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item febbbca0-2805-5891-b32d-eb10306c292e with scrape type 2
2026-03-27 10:46:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: febbbca0-2805-5891-b32d-eb10306c292e, identifier: AK47916
2026-03-27 10:46:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: febbbca0-2805-5891-b32d-eb10306c292e with identifier: AK47916
2026-03-27 10:46:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: febbbca0-2805-5891-b32d-eb10306c292e with identifier: AK47916
2026-03-27 10:46:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: febbbca0-2805-5891-b32d-eb10306c292e with identifier: AK47916 to the API
2026-03-27 10:46:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:26:32Z',
 'fuel_type': 'diesel',
 'id': 'febbbca0-2805-5891-b32d-eb10306c292e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK47916',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 300529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-16',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2008}
2026-03-27 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK47916%27 HTTP/1.1" 200 None
2026-03-27 10:46:45 [auto1.de] INFO: Saving data for AK47916: {'auction_closing_time': 1774715192.0, 'created_time': 1773306517.625499, 'last_price_update_time': 1774608405.523901}
2026-03-27 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK47916') HTTP/1.1" 204 0
2026-03-27 10:46:45 [auto1.de] INFO: Found listing with ID: JV68298
2026-03-27 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68298%27 HTTP/1.1" 200 None
2026-03-27 10:46:45 [auto1.de] INFO: Scrape type for JV68298: 2
2026-03-27 10:46:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a38d0bc1-b543-5df0-ba0f-dd8d970ce090 with identifier: JV68298
2026-03-27 10:46:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a38d0bc1-b543-5df0-ba0f-dd8d970ce090 with scrape type 2
2026-03-27 10:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a38d0bc1-b543-5df0-ba0f-dd8d970ce090 with scrape type 2
2026-03-27 10:46:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a38d0bc1-b543-5df0-ba0f-dd8d970ce090, identifier: JV68298
2026-03-27 10:46:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a38d0bc1-b543-5df0-ba0f-dd8d970ce090 with identifier: JV68298
2026-03-27 10:46:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a38d0bc1-b543-5df0-ba0f-dd8d970ce090 with identifier: JV68298
2026-03-27 10:46:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a38d0bc1-b543-5df0-ba0f-dd8d970ce090 with identifier: JV68298 to the API
2026-03-27 10:46:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:56:37Z',
 'fuel_type': 'diesel',
 'id': 'a38d0bc1-b543-5df0-ba0f-dd8d970ce090',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV68298',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 271058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Match',
 'transmission': 'automatic',
 'trim': 'Match',
 'year': 2012}
2026-03-27 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68298%27 HTTP/1.1" 200 None
2026-03-27 10:46:45 [auto1.de] INFO: Saving data for JV68298: {'auction_closing_time': 1774716997.0, 'created_time': 1773861457.989313, 'last_price_update_time': 1774608405.970995}
2026-03-27 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV68298') HTTP/1.1" 204 0
2026-03-27 10:46:45 [auto1.de] INFO: Found listing with ID: MX66491
2026-03-27 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX66491%27 HTTP/1.1" 200 None
2026-03-27 10:46:46 [auto1.de] INFO: Scrape type for MX66491: 2
2026-03-27 10:46:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e581117a-baca-5bcb-806f-ad276e8acf31 with identifier: MX66491
2026-03-27 10:46:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e581117a-baca-5bcb-806f-ad276e8acf31 with scrape type 2
2026-03-27 10:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e581117a-baca-5bcb-806f-ad276e8acf31 with scrape type 2
2026-03-27 10:46:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e581117a-baca-5bcb-806f-ad276e8acf31, identifier: MX66491
2026-03-27 10:46:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e581117a-baca-5bcb-806f-ad276e8acf31 with identifier: MX66491
2026-03-27 10:46:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e581117a-baca-5bcb-806f-ad276e8acf31 with identifier: MX66491
2026-03-27 10:46:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e581117a-baca-5bcb-806f-ad276e8acf31 with identifier: MX66491 to the API
2026-03-27 10:46:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:06:22Z',
 'fuel_type': 'petrol',
 'id': 'e581117a-baca-5bcb-806f-ad276e8acf31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX66491',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 41093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-07',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 220 4Matic Urban',
 'transmission': 'automatic',
 'trim': '4Matic Urban',
 'year': 2015}
2026-03-27 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX66491%27 HTTP/1.1" 200 None
2026-03-27 10:46:46 [auto1.de] INFO: Saving data for MX66491: {'auction_closing_time': 1774713982.0, 'created_time': 1773689000.738637, 'last_price_update_time': 1774608406.470776}
2026-03-27 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX66491') HTTP/1.1" 204 0
2026-03-27 10:46:46 [auto1.de] INFO: Found listing with ID: UW00779
2026-03-27 10:46:46 [auto1.de] INFO: Found listing with ID: FA96638
2026-03-27 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA96638%27 HTTP/1.1" 200 None
2026-03-27 10:46:46 [auto1.de] INFO: Scrape type for FA96638: 1
2026-03-27 10:46:46 [auto1.de] INFO: Found listing with ID: FH45720
2026-03-27 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH45720%27 HTTP/1.1" 200 None
2026-03-27 10:46:46 [auto1.de] INFO: Scrape type for FH45720: 2
2026-03-27 10:46:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 628d424a-e2b7-5244-8333-ca3a03d2c587 with identifier: FH45720
2026-03-27 10:46:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 628d424a-e2b7-5244-8333-ca3a03d2c587 with scrape type 2
2026-03-27 10:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 628d424a-e2b7-5244-8333-ca3a03d2c587 with scrape type 2
2026-03-27 10:46:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 628d424a-e2b7-5244-8333-ca3a03d2c587, identifier: FH45720
2026-03-27 10:46:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 628d424a-e2b7-5244-8333-ca3a03d2c587 with identifier: FH45720
2026-03-27 10:46:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 628d424a-e2b7-5244-8333-ca3a03d2c587 with identifier: FH45720
2026-03-27 10:46:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 628d424a-e2b7-5244-8333-ca3a03d2c587 with identifier: FH45720 to the API
2026-03-27 10:46:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:56:07Z',
 'fuel_type': 'diesel',
 'id': '628d424a-e2b7-5244-8333-ca3a03d2c587',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH45720',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 226990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-14',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Team',
 'transmission': 'automatic',
 'trim': 'Team',
 'year': 2010}
2026-03-27 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH45720%27 HTTP/1.1" 200 None
2026-03-27 10:46:46 [auto1.de] INFO: Saving data for FH45720: {'auction_closing_time': 1774716967.0, 'created_time': 1774293346.592066, 'last_price_update_time': 1774608406.967264}
2026-03-27 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH45720') HTTP/1.1" 204 0
2026-03-27 10:46:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:46:47 [auto1.de] INFO: Found listing with ID: BB05749
2026-03-27 10:46:47 [auto1.de] INFO: Found listing with ID: JY05464
2026-03-27 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY05464%27 HTTP/1.1" 200 None
2026-03-27 10:46:47 [auto1.de] INFO: Scrape type for JY05464: 2
2026-03-27 10:46:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a8054ab-1784-523a-a320-ceb93a6639a2 with identifier: JY05464
2026-03-27 10:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a8054ab-1784-523a-a320-ceb93a6639a2 with scrape type 2
2026-03-27 10:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a8054ab-1784-523a-a320-ceb93a6639a2 with scrape type 2
2026-03-27 10:46:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a8054ab-1784-523a-a320-ceb93a6639a2, identifier: JY05464
2026-03-27 10:46:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a8054ab-1784-523a-a320-ceb93a6639a2 with identifier: JY05464
2026-03-27 10:46:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a8054ab-1784-523a-a320-ceb93a6639a2 with identifier: JY05464
2026-03-27 10:46:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a8054ab-1784-523a-a320-ceb93a6639a2 with identifier: JY05464 to the API
2026-03-27 10:46:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:44:31Z',
 'fuel_type': 'petrol',
 'id': '2a8054ab-1784-523a-a320-ceb93a6639a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY05464',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 59633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-27 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY05464%27 HTTP/1.1" 200 None
2026-03-27 10:46:47 [auto1.de] INFO: Saving data for JY05464: {'auction_closing_time': 1774716271.0, 'created_time': 1773303380.819313, 'last_price_update_time': 1774608407.453368}
2026-03-27 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY05464') HTTP/1.1" 204 0
2026-03-27 10:46:47 [auto1.de] INFO: Found listing with ID: HR96195
2026-03-27 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR96195%27 HTTP/1.1" 200 None
2026-03-27 10:46:47 [auto1.de] INFO: Scrape type for HR96195: 2
2026-03-27 10:46:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8156d24a-632f-5b4e-8099-b781be3d8eb2 with identifier: HR96195
2026-03-27 10:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8156d24a-632f-5b4e-8099-b781be3d8eb2 with scrape type 2
2026-03-27 10:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8156d24a-632f-5b4e-8099-b781be3d8eb2 with scrape type 2
2026-03-27 10:46:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8156d24a-632f-5b4e-8099-b781be3d8eb2, identifier: HR96195
2026-03-27 10:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8156d24a-632f-5b4e-8099-b781be3d8eb2 with identifier: HR96195
2026-03-27 10:46:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8156d24a-632f-5b4e-8099-b781be3d8eb2 with identifier: HR96195
2026-03-27 10:46:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8156d24a-632f-5b4e-8099-b781be3d8eb2 with identifier: HR96195 to the API
2026-03-27 10:46:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:50:26Z',
 'fuel_type': 'petrol',
 'id': '8156d24a-632f-5b4e-8099-b781be3d8eb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR96195',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 20118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-07',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-27 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR96195%27 HTTP/1.1" 200 None
2026-03-27 10:46:47 [auto1.de] INFO: Saving data for HR96195: {'auction_closing_time': 1774716626.0, 'created_time': 1774292457.00928, 'last_price_update_time': 1774608407.887189}
2026-03-27 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR96195') HTTP/1.1" 204 0
2026-03-27 10:46:47 [auto1.de] INFO: Found listing with ID: BN23533
2026-03-27 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN23533%27 HTTP/1.1" 200 None
2026-03-27 10:46:47 [auto1.de] INFO: Scrape type for BN23533: 2
2026-03-27 10:46:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20ed1ddb-9bae-59ae-a83e-22dd22bc2f12 with identifier: BN23533
2026-03-27 10:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20ed1ddb-9bae-59ae-a83e-22dd22bc2f12 with scrape type 2
2026-03-27 10:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20ed1ddb-9bae-59ae-a83e-22dd22bc2f12 with scrape type 2
2026-03-27 10:46:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20ed1ddb-9bae-59ae-a83e-22dd22bc2f12, identifier: BN23533
2026-03-27 10:46:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20ed1ddb-9bae-59ae-a83e-22dd22bc2f12 with identifier: BN23533
2026-03-27 10:46:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20ed1ddb-9bae-59ae-a83e-22dd22bc2f12 with identifier: BN23533
2026-03-27 10:46:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20ed1ddb-9bae-59ae-a83e-22dd22bc2f12 with identifier: BN23533 to the API
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:57:23Z',
 'fuel_type': 'petrol',
 'id': '20ed1ddb-9bae-59ae-a83e-22dd22bc2f12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN23533',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 45668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-08',
 'seller_name': None,
 'title': 'Seat Leon 1.0 TSI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2019}
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN23533%27 HTTP/1.1" 200 None
2026-03-27 10:46:48 [auto1.de] INFO: Saving data for BN23533: {'auction_closing_time': 1774717043.0, 'created_time': 1773858940.22156, 'last_price_update_time': 1774608408.370951}
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN23533') HTTP/1.1" 204 0
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: ZX08266
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: BZ75769
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ75769%27 HTTP/1.1" 200 None
2026-03-27 10:46:48 [auto1.de] INFO: Scrape type for BZ75769: 2
2026-03-27 10:46:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f2497a8-6880-528b-a9a7-69d6d637626d with identifier: BZ75769
2026-03-27 10:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f2497a8-6880-528b-a9a7-69d6d637626d with scrape type 2
2026-03-27 10:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f2497a8-6880-528b-a9a7-69d6d637626d with scrape type 2
2026-03-27 10:46:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f2497a8-6880-528b-a9a7-69d6d637626d, identifier: BZ75769
2026-03-27 10:46:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f2497a8-6880-528b-a9a7-69d6d637626d with identifier: BZ75769
2026-03-27 10:46:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f2497a8-6880-528b-a9a7-69d6d637626d with identifier: BZ75769
2026-03-27 10:46:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f2497a8-6880-528b-a9a7-69d6d637626d with identifier: BZ75769 to the API
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:19:14Z',
 'fuel_type': 'diesel',
 'id': '5f2497a8-6880-528b-a9a7-69d6d637626d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ75769',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 58745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-26',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ75769%27 HTTP/1.1" 200 None
2026-03-27 10:46:48 [auto1.de] INFO: Saving data for BZ75769: {'auction_closing_time': 1774714754.0, 'created_time': 1773135803.608433, 'last_price_update_time': 1774608408.910057}
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ75769') HTTP/1.1" 204 0
2026-03-27 10:46:48 [auto1.de] INFO: Channel: 24h | Page: 35 | totalHits: 10551 | hits on page: 40
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: AL51386
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: BW77657
2026-03-27 10:46:48 [auto1.de] INFO: Found listing with ID: KL73476
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL73476%27 HTTP/1.1" 200 None
2026-03-27 10:46:48 [auto1.de] INFO: Scrape type for KL73476: 2
2026-03-27 10:46:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 947a2bc2-30d5-52e0-b58e-c45210405414 with identifier: KL73476
2026-03-27 10:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 947a2bc2-30d5-52e0-b58e-c45210405414 with scrape type 2
2026-03-27 10:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 947a2bc2-30d5-52e0-b58e-c45210405414 with scrape type 2
2026-03-27 10:46:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 947a2bc2-30d5-52e0-b58e-c45210405414, identifier: KL73476
2026-03-27 10:46:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 947a2bc2-30d5-52e0-b58e-c45210405414 with identifier: KL73476
2026-03-27 10:46:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 947a2bc2-30d5-52e0-b58e-c45210405414 with identifier: KL73476
2026-03-27 10:46:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 947a2bc2-30d5-52e0-b58e-c45210405414 with identifier: KL73476 to the API
2026-03-27 10:46:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:09:59Z',
 'fuel_type': 'petrol',
 'id': '947a2bc2-30d5-52e0-b58e-c45210405414',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL73476',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 178375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-13',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 Exception 2009',
 'transmission': 'manual',
 'trim': 'Exception 2009',
 'year': 2009}
2026-03-27 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL73476%27 HTTP/1.1" 200 None
2026-03-27 10:46:49 [auto1.de] INFO: Saving data for KL73476: {'auction_closing_time': 1774714199.0, 'created_time': 1773383116.479284, 'last_price_update_time': 1774608409.414988}
2026-03-27 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL73476') HTTP/1.1" 204 0
2026-03-27 10:46:49 [auto1.de] INFO: Found listing with ID: BD98070
2026-03-27 10:46:49 [auto1.de] INFO: Found listing with ID: NA20314
2026-03-27 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA20314%27 HTTP/1.1" 200 None
2026-03-27 10:46:49 [auto1.de] INFO: Scrape type for NA20314: 2
2026-03-27 10:46:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 875a4a15-d927-5e75-b325-d151c808c644 with identifier: NA20314
2026-03-27 10:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 875a4a15-d927-5e75-b325-d151c808c644 with scrape type 2
2026-03-27 10:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 875a4a15-d927-5e75-b325-d151c808c644 with scrape type 2
2026-03-27 10:46:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 875a4a15-d927-5e75-b325-d151c808c644, identifier: NA20314
2026-03-27 10:46:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:46:49 [auto1.de] INFO: Found listing with ID: LK12001
2026-03-27 10:46:49 [auto1.de] INFO: Found listing with ID: UF45337
2026-03-27 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF45337%27 HTTP/1.1" 200 None
2026-03-27 10:46:49 [auto1.de] INFO: Scrape type for UF45337: 2
2026-03-27 10:46:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 849444f1-0b58-52fc-9dd5-7e9570ffec46 with identifier: UF45337
2026-03-27 10:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 849444f1-0b58-52fc-9dd5-7e9570ffec46 with scrape type 2
2026-03-27 10:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 849444f1-0b58-52fc-9dd5-7e9570ffec46 with scrape type 2
2026-03-27 10:46:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 849444f1-0b58-52fc-9dd5-7e9570ffec46, identifier: UF45337
2026-03-27 10:46:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 875a4a15-d927-5e75-b325-d151c808c644 with identifier: NA20314
2026-03-27 10:46:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 875a4a15-d927-5e75-b325-d151c808c644 with identifier: NA20314
2026-03-27 10:46:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 875a4a15-d927-5e75-b325-d151c808c644 with identifier: NA20314 to the API
2026-03-27 10:46:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 182,
 'expiration_date': '2026-03-28T16:20:10Z',
 'fuel_type': 'petrol',
 'id': '875a4a15-d927-5e75-b325-d151c808c644',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA20314',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 83295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-25',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2015}
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA20314%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Saving data for NA20314: {'auction_closing_time': 1774714810.0, 'created_time': 1773687381.827153, 'last_price_update_time': 1774608411.378793}
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA20314') HTTP/1.1" 204 0
2026-03-27 10:46:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 849444f1-0b58-52fc-9dd5-7e9570ffec46 with identifier: UF45337
2026-03-27 10:46:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 849444f1-0b58-52fc-9dd5-7e9570ffec46 with identifier: UF45337
2026-03-27 10:46:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 849444f1-0b58-52fc-9dd5-7e9570ffec46 with identifier: UF45337 to the API
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 167,
 'expiration_date': '2026-03-28T16:54:25Z',
 'fuel_type': 'petrol',
 'id': '849444f1-0b58-52fc-9dd5-7e9570ffec46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF45337',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Coupe',
 'odometer': 160218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-25',
 'seller_name': None,
 'title': 'Hyundai Coupe 2.7 V6 GLS',
 'transmission': 'automatic',
 'trim': 'GLS',
 'year': 2006}
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF45337%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Saving data for UF45337: {'auction_closing_time': 1774716865.0, 'created_time': 1773306921.670261, 'last_price_update_time': 1774608411.757522}
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF45337') HTTP/1.1" 204 0
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: YU15721
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU15721%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for YU15721: 2
2026-03-27 10:46:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6516615b-3391-5455-89b1-ecd93cdcf4db with identifier: YU15721
2026-03-27 10:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6516615b-3391-5455-89b1-ecd93cdcf4db with scrape type 2
2026-03-27 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6516615b-3391-5455-89b1-ecd93cdcf4db with scrape type 2
2026-03-27 10:46:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6516615b-3391-5455-89b1-ecd93cdcf4db, identifier: YU15721
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: FV26342
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: PK01210
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: BL84965
2026-03-27 10:46:51 [auto1.de] INFO: Found listing with ID: DB09685
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09685%27 HTTP/1.1" 200 None
2026-03-27 10:46:51 [auto1.de] INFO: Scrape type for DB09685: 2
2026-03-27 10:46:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e12da426-c89b-5f2a-bb11-2542b05274d6 with identifier: DB09685
2026-03-27 10:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e12da426-c89b-5f2a-bb11-2542b05274d6 with scrape type 2
2026-03-27 10:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e12da426-c89b-5f2a-bb11-2542b05274d6 with scrape type 2
2026-03-27 10:46:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e12da426-c89b-5f2a-bb11-2542b05274d6, identifier: DB09685
2026-03-27 10:46:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6516615b-3391-5455-89b1-ecd93cdcf4db with identifier: YU15721
2026-03-27 10:46:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6516615b-3391-5455-89b1-ecd93cdcf4db with identifier: YU15721
2026-03-27 10:46:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6516615b-3391-5455-89b1-ecd93cdcf4db with identifier: YU15721 to the API
2026-03-27 10:46:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:09:52Z',
 'fuel_type': 'petrol',
 'id': '6516615b-3391-5455-89b1-ecd93cdcf4db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU15721',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 57801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-07',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Trend blue',
 'transmission': 'manual',
 'trim': 'Trend blue',
 'year': 2016}
2026-03-27 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU15721%27 HTTP/1.1" 200 None
2026-03-27 10:46:52 [auto1.de] INFO: Saving data for YU15721: {'auction_closing_time': 1774714192.0, 'created_time': 1773859133.93996, 'last_price_update_time': 1774608412.313402}
2026-03-27 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU15721') HTTP/1.1" 204 0
2026-03-27 10:46:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e12da426-c89b-5f2a-bb11-2542b05274d6 with identifier: DB09685
2026-03-27 10:46:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e12da426-c89b-5f2a-bb11-2542b05274d6 with identifier: DB09685
2026-03-27 10:46:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e12da426-c89b-5f2a-bb11-2542b05274d6 with identifier: DB09685 to the API
2026-03-27 10:46:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:38:42Z',
 'fuel_type': 'diesel',
 'id': 'e12da426-c89b-5f2a-bb11-2542b05274d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB09685',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 137843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-30',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 CRDi Spirit 4WD',
 'transmission': 'manual',
 'trim': 'Spirit 4WD',
 'year': 2015}
2026-03-27 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09685%27 HTTP/1.1" 200 None
2026-03-27 10:46:52 [auto1.de] INFO: Saving data for DB09685: {'auction_closing_time': 1774715922.0, 'created_time': 1774293566.586896, 'last_price_update_time': 1774608412.759132}
2026-03-27 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB09685') HTTP/1.1" 204 0
2026-03-27 10:46:52 [auto1.de] INFO: Found listing with ID: NN07588
2026-03-27 10:46:52 [auto1.de] INFO: Found listing with ID: DG61616
2026-03-27 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG61616%27 HTTP/1.1" 200 None
2026-03-27 10:46:52 [auto1.de] INFO: Scrape type for DG61616: 2
2026-03-27 10:46:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7859677f-fbf3-55c2-a7eb-bf191be718de with identifier: DG61616
2026-03-27 10:46:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7859677f-fbf3-55c2-a7eb-bf191be718de with scrape type 2
2026-03-27 10:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7859677f-fbf3-55c2-a7eb-bf191be718de with scrape type 2
2026-03-27 10:46:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7859677f-fbf3-55c2-a7eb-bf191be718de, identifier: DG61616
2026-03-27 10:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FA96638/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:52 [auto1.de] INFO: Found listing with ID: RH12349
2026-03-27 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH12349%27 HTTP/1.1" 200 None
2026-03-27 10:46:52 [auto1.de] INFO: Scrape type for RH12349: 2
2026-03-27 10:46:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adeca68a-a85c-5d02-bffd-c3f1ac7d1db0 with identifier: RH12349
2026-03-27 10:46:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adeca68a-a85c-5d02-bffd-c3f1ac7d1db0 with scrape type 2
2026-03-27 10:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adeca68a-a85c-5d02-bffd-c3f1ac7d1db0 with scrape type 2
2026-03-27 10:46:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: adeca68a-a85c-5d02-bffd-c3f1ac7d1db0, identifier: RH12349
2026-03-27 10:46:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7859677f-fbf3-55c2-a7eb-bf191be718de with identifier: DG61616
2026-03-27 10:46:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7859677f-fbf3-55c2-a7eb-bf191be718de with identifier: DG61616
2026-03-27 10:46:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7859677f-fbf3-55c2-a7eb-bf191be718de with identifier: DG61616 to the API
2026-03-27 10:46:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:45:23Z',
 'fuel_type': 'petrol',
 'id': '7859677f-fbf3-55c2-a7eb-bf191be718de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG61616',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 46593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-30',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2020}
2026-03-27 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG61616%27 HTTP/1.1" 200 None
2026-03-27 10:46:53 [auto1.de] INFO: Saving data for DG61616: {'auction_closing_time': 1774716323.0, 'created_time': 1773346017.777766, 'last_price_update_time': 1774608413.301}
2026-03-27 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG61616') HTTP/1.1" 204 0
2026-03-27 10:46:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: adeca68a-a85c-5d02-bffd-c3f1ac7d1db0 with identifier: RH12349
2026-03-27 10:46:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: adeca68a-a85c-5d02-bffd-c3f1ac7d1db0 with identifier: RH12349
2026-03-27 10:46:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: adeca68a-a85c-5d02-bffd-c3f1ac7d1db0 with identifier: RH12349 to the API
2026-03-27 10:46:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:03:00Z',
 'fuel_type': 'petrol',
 'id': 'adeca68a-a85c-5d02-bffd-c3f1ac7d1db0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH12349',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 116615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-02-12',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 Special 4x4',
 'transmission': 'manual',
 'trim': 'Special 4x4',
 'year': 2001}
2026-03-27 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH12349%27 HTTP/1.1" 200 None
2026-03-27 10:46:53 [auto1.de] INFO: Saving data for RH12349: {'auction_closing_time': 1774713780.0, 'created_time': 1773343815.463306, 'last_price_update_time': 1774608413.652134}
2026-03-27 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RH12349') HTTP/1.1" 204 0
2026-03-27 10:46:53 [auto1.de] INFO: Found listing with ID: JV29717
2026-03-27 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV29717%27 HTTP/1.1" 200 None
2026-03-27 10:46:53 [auto1.de] INFO: Scrape type for JV29717: 1
2026-03-27 10:46:53 [auto1.de] INFO: Found listing with ID: NR72053
2026-03-27 10:46:53 [auto1.de] INFO: Found listing with ID: DA75557
2026-03-27 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA75557%27 HTTP/1.1" 200 None
2026-03-27 10:46:53 [auto1.de] INFO: Scrape type for DA75557: 2
2026-03-27 10:46:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8dabb7f-ded5-5444-a559-3f45af3439c4 with identifier: DA75557
2026-03-27 10:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8dabb7f-ded5-5444-a559-3f45af3439c4 with scrape type 2
2026-03-27 10:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8dabb7f-ded5-5444-a559-3f45af3439c4 with scrape type 2
2026-03-27 10:46:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8dabb7f-ded5-5444-a559-3f45af3439c4, identifier: DA75557
2026-03-27 10:46:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8dabb7f-ded5-5444-a559-3f45af3439c4 with identifier: DA75557
2026-03-27 10:46:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8dabb7f-ded5-5444-a559-3f45af3439c4 with identifier: DA75557
2026-03-27 10:46:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8dabb7f-ded5-5444-a559-3f45af3439c4 with identifier: DA75557 to the API
2026-03-27 10:46:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:02:48Z',
 'fuel_type': 'petrol',
 'id': 'a8dabb7f-ded5-5444-a559-3f45af3439c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA75557',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 234444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-09',
 'seller_name': None,
 'title': 'Skoda Superb 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2019}
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA75557%27 HTTP/1.1" 200 None
2026-03-27 10:46:54 [auto1.de] INFO: Saving data for DA75557: {'auction_closing_time': 1774713768.0, 'created_time': 1773860993.879053, 'last_price_update_time': 1774608414.188226}
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA75557') HTTP/1.1" 204 0
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: SA96746
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA96746%27 HTTP/1.1" 200 None
2026-03-27 10:46:54 [auto1.de] INFO: Scrape type for SA96746: 2
2026-03-27 10:46:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c34e5599-ba6f-5240-a887-6b4cfbb9a79f with identifier: SA96746
2026-03-27 10:46:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c34e5599-ba6f-5240-a887-6b4cfbb9a79f with scrape type 2
2026-03-27 10:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c34e5599-ba6f-5240-a887-6b4cfbb9a79f with scrape type 2
2026-03-27 10:46:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c34e5599-ba6f-5240-a887-6b4cfbb9a79f, identifier: SA96746
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: ML06015
2026-03-27 10:46:54 [auto1.de] INFO: Found listing with ID: JJ83769
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ83769%27 HTTP/1.1" 200 None
2026-03-27 10:46:54 [auto1.de] INFO: Scrape type for JJ83769: 2
2026-03-27 10:46:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc with identifier: JJ83769
2026-03-27 10:46:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc with scrape type 2
2026-03-27 10:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc with scrape type 2
2026-03-27 10:46:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc, identifier: JJ83769
2026-03-27 10:46:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c34e5599-ba6f-5240-a887-6b4cfbb9a79f with identifier: SA96746
2026-03-27 10:46:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c34e5599-ba6f-5240-a887-6b4cfbb9a79f with identifier: SA96746
2026-03-27 10:46:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c34e5599-ba6f-5240-a887-6b4cfbb9a79f with identifier: SA96746 to the API
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:57:56Z',
 'fuel_type': 'hybrid',
 'id': 'c34e5599-ba6f-5240-a887-6b4cfbb9a79f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA96746',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 21082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-29',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.5 Hybrid 4x4',
 'transmission': 'automatic',
 'trim': '4x4',
 'year': 2022}
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA96746%27 HTTP/1.1" 200 None
2026-03-27 10:46:54 [auto1.de] INFO: Saving data for SA96746: {'auction_closing_time': 1774717076.0, 'created_time': 1773307197.38271, 'last_price_update_time': 1774608414.833721}
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA96746') HTTP/1.1" 204 0
2026-03-27 10:46:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:46:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc with identifier: JJ83769
2026-03-27 10:46:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc with identifier: JJ83769
2026-03-27 10:46:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc with identifier: JJ83769 to the API
2026-03-27 10:46:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:50:33Z',
 'fuel_type': 'diesel',
 'id': '8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ83769',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 227076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-08',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-27 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ83769%27 HTTP/1.1" 200 None
2026-03-27 10:46:55 [auto1.de] INFO: Saving data for JJ83769: {'auction_closing_time': 1774716633.0, 'created_time': 1773775704.465636, 'last_price_update_time': 1774608415.345723}
2026-03-27 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ83769') HTTP/1.1" 204 0
2026-03-27 10:46:55 [auto1.de] INFO: Found listing with ID: EL73218
2026-03-27 10:46:55 [auto1.de] INFO: Found listing with ID: JX40120
2026-03-27 10:46:55 [auto1.de] INFO: Found listing with ID: BR95231
2026-03-27 10:46:55 [auto1.de] INFO: Found listing with ID: TX40728
2026-03-27 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40728%27 HTTP/1.1" 200 None
2026-03-27 10:46:55 [auto1.de] INFO: Scrape type for TX40728: 2
2026-03-27 10:46:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af5d53ca-6e7e-55c4-8aa7-221903807e9f with identifier: TX40728
2026-03-27 10:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af5d53ca-6e7e-55c4-8aa7-221903807e9f with scrape type 2
2026-03-27 10:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af5d53ca-6e7e-55c4-8aa7-221903807e9f with scrape type 2
2026-03-27 10:46:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af5d53ca-6e7e-55c4-8aa7-221903807e9f, identifier: TX40728
2026-03-27 10:46:55 [auto1.de] INFO: Found listing with ID: EW68189
2026-03-27 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW68189%27 HTTP/1.1" 200 None
2026-03-27 10:46:55 [auto1.de] INFO: Scrape type for EW68189: 2
2026-03-27 10:46:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f3f1ae1-20c1-58f8-af34-8247319d0ada with identifier: EW68189
2026-03-27 10:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f3f1ae1-20c1-58f8-af34-8247319d0ada with scrape type 2
2026-03-27 10:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f3f1ae1-20c1-58f8-af34-8247319d0ada with scrape type 2
2026-03-27 10:46:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f3f1ae1-20c1-58f8-af34-8247319d0ada, identifier: EW68189
2026-03-27 10:46:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af5d53ca-6e7e-55c4-8aa7-221903807e9f with identifier: TX40728
2026-03-27 10:46:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af5d53ca-6e7e-55c4-8aa7-221903807e9f with identifier: TX40728
2026-03-27 10:46:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af5d53ca-6e7e-55c4-8aa7-221903807e9f with identifier: TX40728 to the API
2026-03-27 10:46:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:11:07Z',
 'fuel_type': 'hybrid',
 'id': 'af5d53ca-6e7e-55c4-8aa7-221903807e9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX40728',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 26280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-16',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 300 de T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2022}
2026-03-27 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40728%27 HTTP/1.1" 200 None
2026-03-27 10:46:56 [auto1.de] INFO: Saving data for TX40728: {'auction_closing_time': 1774714267.0, 'created_time': 1773687758.105501, 'last_price_update_time': 1774608416.015508}
2026-03-27 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX40728') HTTP/1.1" 204 0
2026-03-27 10:46:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:46:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f3f1ae1-20c1-58f8-af34-8247319d0ada with identifier: EW68189
2026-03-27 10:46:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f3f1ae1-20c1-58f8-af34-8247319d0ada with identifier: EW68189
2026-03-27 10:46:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f3f1ae1-20c1-58f8-af34-8247319d0ada with identifier: EW68189 to the API
2026-03-27 10:46:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:33:47Z',
 'fuel_type': 'petrol',
 'id': '7f3f1ae1-20c1-58f8-af34-8247319d0ada',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW68189',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 120296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-20',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S ALL4',
 'transmission': 'manual',
 'trim': 'ALL4',
 'year': 2011}
2026-03-27 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW68189%27 HTTP/1.1" 200 None
2026-03-27 10:46:56 [auto1.de] INFO: Saving data for EW68189: {'auction_closing_time': 1774715627.0, 'created_time': 1773427083.243122, 'last_price_update_time': 1774608416.490125}
2026-03-27 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW68189') HTTP/1.1" 204 0
2026-03-27 10:46:56 [auto1.de] INFO: Found listing with ID: UG67799
2026-03-27 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG67799%27 HTTP/1.1" 200 None
2026-03-27 10:46:56 [auto1.de] INFO: Scrape type for UG67799: 2
2026-03-27 10:46:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a09ef76-c396-5292-8f73-c549689bd410 with identifier: UG67799
2026-03-27 10:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a09ef76-c396-5292-8f73-c549689bd410 with scrape type 2
2026-03-27 10:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a09ef76-c396-5292-8f73-c549689bd410 with scrape type 2
2026-03-27 10:46:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a09ef76-c396-5292-8f73-c549689bd410, identifier: UG67799
2026-03-27 10:46:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a09ef76-c396-5292-8f73-c549689bd410 with identifier: UG67799
2026-03-27 10:46:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a09ef76-c396-5292-8f73-c549689bd410 with identifier: UG67799
2026-03-27 10:46:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a09ef76-c396-5292-8f73-c549689bd410 with identifier: UG67799 to the API
2026-03-27 10:46:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:13:24Z',
 'fuel_type': 'petrol',
 'id': '6a09ef76-c396-5292-8f73-c549689bd410',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG67799',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 135663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-27 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG67799%27 HTTP/1.1" 200 None
2026-03-27 10:46:56 [auto1.de] INFO: Saving data for UG67799: {'auction_closing_time': 1774714404.0, 'created_time': 1774293382.272049, 'last_price_update_time': 1774608416.965568}
2026-03-27 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG67799') HTTP/1.1" 204 0
2026-03-27 10:46:56 [auto1.de] INFO: Found listing with ID: SJ84971
2026-03-27 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ84971%27 HTTP/1.1" 200 None
2026-03-27 10:46:57 [auto1.de] INFO: Scrape type for SJ84971: 2
2026-03-27 10:46:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb75be63-9b9f-5b0c-abff-6533d296129b with identifier: SJ84971
2026-03-27 10:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb75be63-9b9f-5b0c-abff-6533d296129b with scrape type 2
2026-03-27 10:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb75be63-9b9f-5b0c-abff-6533d296129b with scrape type 2
2026-03-27 10:46:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb75be63-9b9f-5b0c-abff-6533d296129b, identifier: SJ84971
2026-03-27 10:46:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb75be63-9b9f-5b0c-abff-6533d296129b with identifier: SJ84971
2026-03-27 10:46:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb75be63-9b9f-5b0c-abff-6533d296129b with identifier: SJ84971
2026-03-27 10:46:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb75be63-9b9f-5b0c-abff-6533d296129b with identifier: SJ84971 to the API
2026-03-27 10:46:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:45:06Z',
 'fuel_type': 'diesel',
 'id': 'fb75be63-9b9f-5b0c-abff-6533d296129b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ84971',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 102769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-10',
 'seller_name': None,
 'title': 'Opel Mokka 1.6 CDTI DPF Edition ecoFlex',
 'transmission': 'manual',
 'trim': 'Edition ecoFlex',
 'year': 2017}
2026-03-27 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ84971%27 HTTP/1.1" 200 None
2026-03-27 10:46:57 [auto1.de] INFO: Saving data for SJ84971: {'auction_closing_time': 1774716306.0, 'created_time': 1773831066.268847, 'last_price_update_time': 1774608417.503967}
2026-03-27 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ84971') HTTP/1.1" 204 0
2026-03-27 10:46:57 [auto1.de] INFO: Found listing with ID: AT56964
2026-03-27 10:46:57 [auto1.de] INFO: Found listing with ID: GC03067
2026-03-27 10:46:57 [auto1.de] INFO: Found listing with ID: KG20268
2026-03-27 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG20268%27 HTTP/1.1" 200 None
2026-03-27 10:46:57 [auto1.de] INFO: Scrape type for KG20268: 2
2026-03-27 10:46:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c0292a8-1cdd-5161-9343-12aaca46971a with identifier: KG20268
2026-03-27 10:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c0292a8-1cdd-5161-9343-12aaca46971a with scrape type 2
2026-03-27 10:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c0292a8-1cdd-5161-9343-12aaca46971a with scrape type 2
2026-03-27 10:46:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c0292a8-1cdd-5161-9343-12aaca46971a, identifier: KG20268
2026-03-27 10:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:46:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c0292a8-1cdd-5161-9343-12aaca46971a with identifier: KG20268
2026-03-27 10:46:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c0292a8-1cdd-5161-9343-12aaca46971a with identifier: KG20268
2026-03-27 10:46:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c0292a8-1cdd-5161-9343-12aaca46971a with identifier: KG20268 to the API
2026-03-27 10:46:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:30:28Z',
 'fuel_type': 'petrol',
 'id': '1c0292a8-1cdd-5161-9343-12aaca46971a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG20268',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 48309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-30',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Mirror',
 'transmission': 'manual',
 'trim': 'Mirror',
 'year': 2017}
2026-03-27 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG20268%27 HTTP/1.1" 200 None
2026-03-27 10:46:57 [auto1.de] INFO: Saving data for KG20268: {'auction_closing_time': 1774715428.0, 'created_time': 1773401724.32914, 'last_price_update_time': 1774608417.95662}
2026-03-27 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG20268') HTTP/1.1" 204 0
2026-03-27 10:46:57 [auto1.de] INFO: Found listing with ID: XW85438
2026-03-27 10:46:57 [auto1.de] INFO: Found listing with ID: TY32384
2026-03-27 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY32384%27 HTTP/1.1" 200 None
2026-03-27 10:46:57 [auto1.de] INFO: Scrape type for TY32384: 2
2026-03-27 10:46:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5da369dc-a854-54dd-943f-c54b415c679d with identifier: TY32384
2026-03-27 10:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da369dc-a854-54dd-943f-c54b415c679d with scrape type 2
2026-03-27 10:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5da369dc-a854-54dd-943f-c54b415c679d with scrape type 2
2026-03-27 10:46:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5da369dc-a854-54dd-943f-c54b415c679d, identifier: TY32384
2026-03-27 10:46:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5da369dc-a854-54dd-943f-c54b415c679d with identifier: TY32384
2026-03-27 10:46:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5da369dc-a854-54dd-943f-c54b415c679d with identifier: TY32384
2026-03-27 10:46:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5da369dc-a854-54dd-943f-c54b415c679d with identifier: TY32384 to the API
2026-03-27 10:46:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:14:08Z',
 'fuel_type': 'diesel',
 'id': '5da369dc-a854-54dd-943f-c54b415c679d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY32384',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 119640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-02',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.2 D-4D Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2012}
2026-03-27 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY32384%27 HTTP/1.1" 200 None
2026-03-27 10:46:58 [auto1.de] INFO: Saving data for TY32384: {'auction_closing_time': 1774714448.0, 'created_time': 1773401550.580781, 'last_price_update_time': 1774608418.41975}
2026-03-27 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY32384') HTTP/1.1" 204 0
2026-03-27 10:46:58 [auto1.de] INFO: Found listing with ID: NZ72675
2026-03-27 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ72675%27 HTTP/1.1" 200 None
2026-03-27 10:46:58 [auto1.de] INFO: Scrape type for NZ72675: 2
2026-03-27 10:46:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b691e249-a160-5e5a-b294-f25dca43bf91 with identifier: NZ72675
2026-03-27 10:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b691e249-a160-5e5a-b294-f25dca43bf91 with scrape type 2
2026-03-27 10:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b691e249-a160-5e5a-b294-f25dca43bf91 with scrape type 2
2026-03-27 10:46:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b691e249-a160-5e5a-b294-f25dca43bf91, identifier: NZ72675
2026-03-27 10:46:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b691e249-a160-5e5a-b294-f25dca43bf91 with identifier: NZ72675
2026-03-27 10:46:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b691e249-a160-5e5a-b294-f25dca43bf91 with identifier: NZ72675
2026-03-27 10:46:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b691e249-a160-5e5a-b294-f25dca43bf91 with identifier: NZ72675 to the API
2026-03-27 10:46:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:57:48Z',
 'fuel_type': 'diesel',
 'id': 'b691e249-a160-5e5a-b294-f25dca43bf91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ72675',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 65341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2024}
2026-03-27 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ72675%27 HTTP/1.1" 200 None
2026-03-27 10:46:58 [auto1.de] INFO: Saving data for NZ72675: {'auction_closing_time': 1774717068.0, 'created_time': 1774291613.56682, 'last_price_update_time': 1774608418.873696}
2026-03-27 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ72675') HTTP/1.1" 204 0
2026-03-27 10:46:58 [auto1.de] INFO: Channel: 24h | Page: 36 | totalHits: 10552 | hits on page: 40
2026-03-27 10:46:58 [auto1.de] INFO: Found listing with ID: HA98136
2026-03-27 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA98136%27 HTTP/1.1" 200 None
2026-03-27 10:46:58 [auto1.de] INFO: Scrape type for HA98136: 2
2026-03-27 10:46:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02ed9ec5-b2fe-5d1f-be32-8b653bbed017 with identifier: HA98136
2026-03-27 10:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02ed9ec5-b2fe-5d1f-be32-8b653bbed017 with scrape type 2
2026-03-27 10:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02ed9ec5-b2fe-5d1f-be32-8b653bbed017 with scrape type 2
2026-03-27 10:46:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02ed9ec5-b2fe-5d1f-be32-8b653bbed017, identifier: HA98136
2026-03-27 10:46:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02ed9ec5-b2fe-5d1f-be32-8b653bbed017 with identifier: HA98136
2026-03-27 10:46:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02ed9ec5-b2fe-5d1f-be32-8b653bbed017 with identifier: HA98136
2026-03-27 10:46:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02ed9ec5-b2fe-5d1f-be32-8b653bbed017 with identifier: HA98136 to the API
2026-03-27 10:46:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:17:33Z',
 'fuel_type': 'diesel',
 'id': '02ed9ec5-b2fe-5d1f-be32-8b653bbed017',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA98136',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 168235,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-29',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2013}
2026-03-27 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA98136%27 HTTP/1.1" 200 None
2026-03-27 10:46:59 [auto1.de] INFO: Saving data for HA98136: {'auction_closing_time': 1774714653.0, 'created_time': 1774294619.554806, 'last_price_update_time': 1774608419.318247}
2026-03-27 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA98136') HTTP/1.1" 204 0
2026-03-27 10:46:59 [auto1.de] INFO: Found listing with ID: TX92660
2026-03-27 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92660%27 HTTP/1.1" 200 None
2026-03-27 10:46:59 [auto1.de] INFO: Scrape type for TX92660: 2
2026-03-27 10:46:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeddfba2-250f-53ba-94e2-ab2cad133537 with identifier: TX92660
2026-03-27 10:46:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeddfba2-250f-53ba-94e2-ab2cad133537 with scrape type 2
2026-03-27 10:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aeddfba2-250f-53ba-94e2-ab2cad133537 with scrape type 2
2026-03-27 10:46:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aeddfba2-250f-53ba-94e2-ab2cad133537, identifier: TX92660
2026-03-27 10:46:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:46:59 [auto1.de] INFO: Found listing with ID: DD09602
2026-03-27 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD09602%27 HTTP/1.1" 200 None
2026-03-27 10:46:59 [auto1.de] INFO: Scrape type for DD09602: 2
2026-03-27 10:46:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6b34d1d-206d-54dc-9a84-cc44e958c5eb with identifier: DD09602
2026-03-27 10:46:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6b34d1d-206d-54dc-9a84-cc44e958c5eb with scrape type 2
2026-03-27 10:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6b34d1d-206d-54dc-9a84-cc44e958c5eb with scrape type 2
2026-03-27 10:46:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6b34d1d-206d-54dc-9a84-cc44e958c5eb, identifier: DD09602
2026-03-27 10:46:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aeddfba2-250f-53ba-94e2-ab2cad133537 with identifier: TX92660
2026-03-27 10:46:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aeddfba2-250f-53ba-94e2-ab2cad133537 with identifier: TX92660
2026-03-27 10:46:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aeddfba2-250f-53ba-94e2-ab2cad133537 with identifier: TX92660 to the API
2026-03-27 10:46:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:46:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:46:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:41:05Z',
 'fuel_type': 'diesel',
 'id': 'aeddfba2-250f-53ba-94e2-ab2cad133537',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX92660',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 187595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-06',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
 'transmission': 'manual',
 'trim': 'Sport & Style 4Motion',
 'year': 2009}
2026-03-27 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92660%27 HTTP/1.1" 200 None
2026-03-27 10:46:59 [auto1.de] INFO: Saving data for TX92660: {'auction_closing_time': 1774716065.0, 'created_time': 1773302854.033142, 'last_price_update_time': 1774608419.901449}
2026-03-27 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX92660') HTTP/1.1" 204 0
2026-03-27 10:47:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6b34d1d-206d-54dc-9a84-cc44e958c5eb with identifier: DD09602
2026-03-27 10:47:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6b34d1d-206d-54dc-9a84-cc44e958c5eb with identifier: DD09602
2026-03-27 10:47:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6b34d1d-206d-54dc-9a84-cc44e958c5eb with identifier: DD09602 to the API
2026-03-27 10:47:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:12:17Z',
 'fuel_type': 'diesel',
 'id': 'f6b34d1d-206d-54dc-9a84-cc44e958c5eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD09602',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 171680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-05',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2015}
2026-03-27 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD09602%27 HTTP/1.1" 200 None
2026-03-27 10:47:00 [auto1.de] INFO: Saving data for DD09602: {'auction_closing_time': 1774714337.0, 'created_time': 1774294105.08387, 'last_price_update_time': 1774608420.350206}
2026-03-27 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD09602') HTTP/1.1" 204 0
2026-03-27 10:47:00 [auto1.de] INFO: Found listing with ID: YY49162
2026-03-27 10:47:00 [auto1.de] INFO: Found listing with ID: XY91338
2026-03-27 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY91338%27 HTTP/1.1" 200 None
2026-03-27 10:47:00 [auto1.de] INFO: Scrape type for XY91338: 2
2026-03-27 10:47:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59e0c513-ccc4-5e57-9334-661cf7013330 with identifier: XY91338
2026-03-27 10:47:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59e0c513-ccc4-5e57-9334-661cf7013330 with scrape type 2
2026-03-27 10:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59e0c513-ccc4-5e57-9334-661cf7013330 with scrape type 2
2026-03-27 10:47:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59e0c513-ccc4-5e57-9334-661cf7013330, identifier: XY91338
2026-03-27 10:47:00 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-27 10:47:00 [auto1.de] INFO: Found listing with ID: SD97689
2026-03-27 10:47:00 [auto1.de] INFO: Found listing with ID: LL81874
2026-03-27 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL81874%27 HTTP/1.1" 200 None
2026-03-27 10:47:00 [auto1.de] INFO: Scrape type for LL81874: 2
2026-03-27 10:47:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25831bd8-eef7-5b83-a637-be43c91607ba with identifier: LL81874
2026-03-27 10:47:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25831bd8-eef7-5b83-a637-be43c91607ba with scrape type 2
2026-03-27 10:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25831bd8-eef7-5b83-a637-be43c91607ba with scrape type 2
2026-03-27 10:47:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25831bd8-eef7-5b83-a637-be43c91607ba, identifier: LL81874
2026-03-27 10:47:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59e0c513-ccc4-5e57-9334-661cf7013330 with identifier: XY91338
2026-03-27 10:47:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59e0c513-ccc4-5e57-9334-661cf7013330 with identifier: XY91338
2026-03-27 10:47:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59e0c513-ccc4-5e57-9334-661cf7013330 with identifier: XY91338 to the API
2026-03-27 10:47:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:08:46Z',
 'fuel_type': 'diesel',
 'id': '59e0c513-ccc4-5e57-9334-661cf7013330',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY91338',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 140507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-05',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-27 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY91338%27 HTTP/1.1" 200 None
2026-03-27 10:47:00 [auto1.de] INFO: Saving data for XY91338: {'auction_closing_time': 1774714126.0, 'created_time': 1773402132.286524, 'last_price_update_time': 1774608420.920202}
2026-03-27 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY91338') HTTP/1.1" 204 0
2026-03-27 10:47:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25831bd8-eef7-5b83-a637-be43c91607ba with identifier: LL81874
2026-03-27 10:47:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25831bd8-eef7-5b83-a637-be43c91607ba with identifier: LL81874
2026-03-27 10:47:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25831bd8-eef7-5b83-a637-be43c91607ba with identifier: LL81874 to the API
2026-03-27 10:47:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:04:50Z',
 'fuel_type': 'diesel',
 'id': '25831bd8-eef7-5b83-a637-be43c91607ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL81874',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T4 Multivan',
 'odometer': 409958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1996-09-17',
 'seller_name': None,
 'title': 'Volkswagen T4 Multivan 2.5 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 1996}
2026-03-27 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL81874%27 HTTP/1.1" 200 None
2026-03-27 10:47:01 [auto1.de] INFO: Saving data for LL81874: {'auction_closing_time': 1774713890.0, 'created_time': 1773686861.975982, 'last_price_update_time': 1774608421.270881}
2026-03-27 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL81874') HTTP/1.1" 204 0
2026-03-27 10:47:01 [auto1.de] INFO: Found listing with ID: HT64251
2026-03-27 10:47:01 [auto1.de] INFO: Found listing with ID: JC56914
2026-03-27 10:47:01 [auto1.de] INFO: Found listing with ID: EC36203
2026-03-27 10:47:01 [auto1.de] INFO: Found listing with ID: JL85877
2026-03-27 10:47:01 [auto1.de] INFO: Found listing with ID: PZ33404
2026-03-27 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ33404%27 HTTP/1.1" 200 None
2026-03-27 10:47:01 [auto1.de] INFO: Scrape type for PZ33404: 2
2026-03-27 10:47:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd00e2f0-2ede-5f93-9455-2fc8e143f02c with identifier: PZ33404
2026-03-27 10:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd00e2f0-2ede-5f93-9455-2fc8e143f02c with scrape type 2
2026-03-27 10:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd00e2f0-2ede-5f93-9455-2fc8e143f02c with scrape type 2
2026-03-27 10:47:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd00e2f0-2ede-5f93-9455-2fc8e143f02c, identifier: PZ33404
2026-03-27 10:47:01 [auto1.de] INFO: Found listing with ID: RF75953
2026-03-27 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF75953%27 HTTP/1.1" 200 None
2026-03-27 10:47:01 [auto1.de] INFO: Scrape type for RF75953: 2
2026-03-27 10:47:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36f702ad-eca1-511f-8f88-30b790758684 with identifier: RF75953
2026-03-27 10:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36f702ad-eca1-511f-8f88-30b790758684 with scrape type 2
2026-03-27 10:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36f702ad-eca1-511f-8f88-30b790758684 with scrape type 2
2026-03-27 10:47:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36f702ad-eca1-511f-8f88-30b790758684, identifier: RF75953
2026-03-27 10:47:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd00e2f0-2ede-5f93-9455-2fc8e143f02c with identifier: PZ33404
2026-03-27 10:47:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd00e2f0-2ede-5f93-9455-2fc8e143f02c with identifier: PZ33404
2026-03-27 10:47:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd00e2f0-2ede-5f93-9455-2fc8e143f02c with identifier: PZ33404 to the API
2026-03-27 10:47:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:00:10Z',
 'fuel_type': 'petrol',
 'id': 'dd00e2f0-2ede-5f93-9455-2fc8e143f02c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ33404',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Exeo',
 'odometer': 214317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-09',
 'seller_name': None,
 'title': 'Seat Exeo 2.0 TFSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2010}
2026-03-27 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ33404%27 HTTP/1.1" 200 None
2026-03-27 10:47:01 [auto1.de] INFO: Saving data for PZ33404: {'auction_closing_time': 1774713610.0, 'created_time': 1774294800.553846, 'last_price_update_time': 1774608421.86455}
2026-03-27 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ33404') HTTP/1.1" 204 0
2026-03-27 10:47:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36f702ad-eca1-511f-8f88-30b790758684 with identifier: RF75953
2026-03-27 10:47:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36f702ad-eca1-511f-8f88-30b790758684 with identifier: RF75953
2026-03-27 10:47:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36f702ad-eca1-511f-8f88-30b790758684 with identifier: RF75953 to the API
2026-03-27 10:47:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 290,
 'expiration_date': '2026-03-28T16:10:17Z',
 'fuel_type': 'diesel',
 'id': '36f702ad-eca1-511f-8f88-30b790758684',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF75953',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 100382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-22',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 300 d Mild-Hybrid 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2023}
2026-03-27 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF75953%27 HTTP/1.1" 200 None
2026-03-27 10:47:02 [auto1.de] INFO: Saving data for RF75953: {'auction_closing_time': 1774714217.0, 'created_time': 1773303160.999371, 'last_price_update_time': 1774608422.332144}
2026-03-27 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF75953') HTTP/1.1" 204 0
2026-03-27 10:47:02 [auto1.de] INFO: Found listing with ID: ZU03053
2026-03-27 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU03053%27 HTTP/1.1" 200 None
2026-03-27 10:47:02 [auto1.de] INFO: Scrape type for ZU03053: 2
2026-03-27 10:47:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 665825aa-3344-5885-a048-7d3ebcfaa2f8 with identifier: ZU03053
2026-03-27 10:47:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 665825aa-3344-5885-a048-7d3ebcfaa2f8 with scrape type 2
2026-03-27 10:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 665825aa-3344-5885-a048-7d3ebcfaa2f8 with scrape type 2
2026-03-27 10:47:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 665825aa-3344-5885-a048-7d3ebcfaa2f8, identifier: ZU03053
2026-03-27 10:47:02 [auto1.de] INFO: Found listing with ID: PN78353
2026-03-27 10:47:02 [auto1.de] INFO: Found listing with ID: YV35353
2026-03-27 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV35353%27 HTTP/1.1" 200 None
2026-03-27 10:47:02 [auto1.de] INFO: Scrape type for YV35353: 2
2026-03-27 10:47:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6758c1aa-38a5-55bf-b3f4-f95362269df5 with identifier: YV35353
2026-03-27 10:47:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6758c1aa-38a5-55bf-b3f4-f95362269df5 with scrape type 2
2026-03-27 10:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6758c1aa-38a5-55bf-b3f4-f95362269df5 with scrape type 2
2026-03-27 10:47:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6758c1aa-38a5-55bf-b3f4-f95362269df5, identifier: YV35353
2026-03-27 10:47:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 665825aa-3344-5885-a048-7d3ebcfaa2f8 with identifier: ZU03053
2026-03-27 10:47:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 665825aa-3344-5885-a048-7d3ebcfaa2f8 with identifier: ZU03053
2026-03-27 10:47:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 665825aa-3344-5885-a048-7d3ebcfaa2f8 with identifier: ZU03053 to the API
2026-03-27 10:47:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:54:57Z',
 'fuel_type': 'petrol',
 'id': '665825aa-3344-5885-a048-7d3ebcfaa2f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU03053',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 123084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-31',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-27 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU03053%27 HTTP/1.1" 200 None
2026-03-27 10:47:02 [auto1.de] INFO: Saving data for ZU03053: {'auction_closing_time': 1774716897.0, 'created_time': 1774290985.241422, 'last_price_update_time': 1774608422.934198}
2026-03-27 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU03053') HTTP/1.1" 204 0
2026-03-27 10:47:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6758c1aa-38a5-55bf-b3f4-f95362269df5 with identifier: YV35353
2026-03-27 10:47:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6758c1aa-38a5-55bf-b3f4-f95362269df5 with identifier: YV35353
2026-03-27 10:47:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6758c1aa-38a5-55bf-b3f4-f95362269df5 with identifier: YV35353 to the API
2026-03-27 10:47:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:05:51Z',
 'fuel_type': 'petrol',
 'id': '6758c1aa-38a5-55bf-b3f4-f95362269df5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV35353',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 161693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-03',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-03-27 10:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV35353%27 HTTP/1.1" 200 None
2026-03-27 10:47:03 [auto1.de] INFO: Saving data for YV35353: {'auction_closing_time': 1774713951.0, 'created_time': 1773308217.977507, 'last_price_update_time': 1774608423.892192}
2026-03-27 10:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV35353') HTTP/1.1" 204 0
2026-03-27 10:47:03 [auto1.de] INFO: Found listing with ID: LL15014
2026-03-27 10:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL15014%27 HTTP/1.1" 200 None
2026-03-27 10:47:03 [auto1.de] INFO: Scrape type for LL15014: 2
2026-03-27 10:47:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b448859e-8e9a-53a2-954f-5e189449354a with identifier: LL15014
2026-03-27 10:47:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b448859e-8e9a-53a2-954f-5e189449354a with scrape type 2
2026-03-27 10:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b448859e-8e9a-53a2-954f-5e189449354a with scrape type 2
2026-03-27 10:47:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b448859e-8e9a-53a2-954f-5e189449354a, identifier: LL15014
2026-03-27 10:47:04 [auto1.de] INFO: Found listing with ID: NG37948
2026-03-27 10:47:04 [auto1.de] INFO: Found listing with ID: RY40991
2026-03-27 10:47:04 [auto1.de] INFO: Found listing with ID: YH81029
2026-03-27 10:47:04 [auto1.de] INFO: Found listing with ID: TB03124
2026-03-27 10:47:04 [auto1.de] INFO: Found listing with ID: ML35786
2026-03-27 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML35786%27 HTTP/1.1" 200 None
2026-03-27 10:47:04 [auto1.de] INFO: Scrape type for ML35786: 2
2026-03-27 10:47:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86d26b60-c34d-531f-beaa-f624ea762118 with identifier: ML35786
2026-03-27 10:47:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86d26b60-c34d-531f-beaa-f624ea762118 with scrape type 2
2026-03-27 10:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86d26b60-c34d-531f-beaa-f624ea762118 with scrape type 2
2026-03-27 10:47:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86d26b60-c34d-531f-beaa-f624ea762118, identifier: ML35786
2026-03-27 10:47:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b448859e-8e9a-53a2-954f-5e189449354a with identifier: LL15014
2026-03-27 10:47:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b448859e-8e9a-53a2-954f-5e189449354a with identifier: LL15014
2026-03-27 10:47:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b448859e-8e9a-53a2-954f-5e189449354a with identifier: LL15014 to the API
2026-03-27 10:47:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-28T16:44:04Z',
 'fuel_type': 'petrol',
 'id': 'b448859e-8e9a-53a2-954f-5e189449354a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL15014',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 116582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-31',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 400 T 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': 'T 4Matic AMG Line',
 'year': 2016}
2026-03-27 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL15014%27 HTTP/1.1" 200 None
2026-03-27 10:47:04 [auto1.de] INFO: Saving data for LL15014: {'auction_closing_time': 1774716244.0, 'created_time': 1774263259.556536, 'last_price_update_time': 1774608424.514923}
2026-03-27 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL15014') HTTP/1.1" 204 0
2026-03-27 10:47:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86d26b60-c34d-531f-beaa-f624ea762118 with identifier: ML35786
2026-03-27 10:47:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86d26b60-c34d-531f-beaa-f624ea762118 with identifier: ML35786
2026-03-27 10:47:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86d26b60-c34d-531f-beaa-f624ea762118 with identifier: ML35786 to the API
2026-03-27 10:47:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:38:34Z',
 'fuel_type': 'diesel',
 'id': '86d26b60-c34d-531f-beaa-f624ea762118',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML35786',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 421767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-10',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-27 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML35786%27 HTTP/1.1" 200 None
2026-03-27 10:47:04 [auto1.de] INFO: Saving data for ML35786: {'auction_closing_time': 1774715914.0, 'created_time': 1773401361.049885, 'last_price_update_time': 1774608424.872862}
2026-03-27 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML35786') HTTP/1.1" 204 0
2026-03-27 10:47:04 [auto1.de] INFO: Found listing with ID: XU56450
2026-03-27 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU56450%27 HTTP/1.1" 200 None
2026-03-27 10:47:04 [auto1.de] INFO: Scrape type for XU56450: 2
2026-03-27 10:47:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93dd912f-6f28-5c89-8314-eed5972696df with identifier: XU56450
2026-03-27 10:47:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93dd912f-6f28-5c89-8314-eed5972696df with scrape type 2
2026-03-27 10:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93dd912f-6f28-5c89-8314-eed5972696df with scrape type 2
2026-03-27 10:47:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93dd912f-6f28-5c89-8314-eed5972696df, identifier: XU56450
2026-03-27 10:47:04 [auto1.de] INFO: Found listing with ID: XJ97474
2026-03-27 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ97474%27 HTTP/1.1" 200 None
2026-03-27 10:47:05 [auto1.de] INFO: Scrape type for XJ97474: 2
2026-03-27 10:47:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acd7d930-180b-51c7-a3dc-6c7306376516 with identifier: XJ97474
2026-03-27 10:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acd7d930-180b-51c7-a3dc-6c7306376516 with scrape type 2
2026-03-27 10:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acd7d930-180b-51c7-a3dc-6c7306376516 with scrape type 2
2026-03-27 10:47:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acd7d930-180b-51c7-a3dc-6c7306376516, identifier: XJ97474
2026-03-27 10:47:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93dd912f-6f28-5c89-8314-eed5972696df with identifier: XU56450
2026-03-27 10:47:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93dd912f-6f28-5c89-8314-eed5972696df with identifier: XU56450
2026-03-27 10:47:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93dd912f-6f28-5c89-8314-eed5972696df with identifier: XU56450 to the API
2026-03-27 10:47:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:42:10Z',
 'fuel_type': 'gas',
 'id': '93dd912f-6f28-5c89-8314-eed5972696df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU56450',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 222655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-24',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 Kasten Economy EcoFuel',
 'transmission': 'manual',
 'trim': 'Kasten Economy EcoFuel',
 'year': 2008}
2026-03-27 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU56450%27 HTTP/1.1" 200 None
2026-03-27 10:47:05 [auto1.de] INFO: Saving data for XU56450: {'auction_closing_time': 1774716130.0, 'created_time': 1773308232.649924, 'last_price_update_time': 1774608425.473913}
2026-03-27 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU56450') HTTP/1.1" 204 0
2026-03-27 10:47:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acd7d930-180b-51c7-a3dc-6c7306376516 with identifier: XJ97474
2026-03-27 10:47:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acd7d930-180b-51c7-a3dc-6c7306376516 with identifier: XJ97474
2026-03-27 10:47:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acd7d930-180b-51c7-a3dc-6c7306376516 with identifier: XJ97474 to the API
2026-03-27 10:47:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-28T16:05:58Z',
 'fuel_type': 'petrol',
 'id': 'acd7d930-180b-51c7-a3dc-6c7306376516',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ97474',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 161860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-28',
 'seller_name': None,
 'title': 'BMW 3er 335i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2012}
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ97474%27 HTTP/1.1" 200 None
2026-03-27 10:47:06 [auto1.de] INFO: Saving data for XJ97474: {'auction_closing_time': 1774713958.0, 'created_time': 1773830191.200506, 'last_price_update_time': 1774608426.011947}
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ97474') HTTP/1.1" 204 0
2026-03-27 10:47:06 [auto1.de] INFO: Found listing with ID: VK31305
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK31305%27 HTTP/1.1" 200 None
2026-03-27 10:47:06 [auto1.de] INFO: Scrape type for VK31305: 2
2026-03-27 10:47:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1201c46e-9f17-5bdc-88aa-a87f1c48e62c with identifier: VK31305
2026-03-27 10:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1201c46e-9f17-5bdc-88aa-a87f1c48e62c with scrape type 2
2026-03-27 10:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1201c46e-9f17-5bdc-88aa-a87f1c48e62c with scrape type 2
2026-03-27 10:47:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1201c46e-9f17-5bdc-88aa-a87f1c48e62c, identifier: VK31305
2026-03-27 10:47:06 [auto1.de] INFO: Found listing with ID: JG82377
2026-03-27 10:47:06 [auto1.de] INFO: Found listing with ID: LF15442
2026-03-27 10:47:06 [auto1.de] INFO: Found listing with ID: WG70910
2026-03-27 10:47:06 [auto1.de] INFO: Found listing with ID: DG85302
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG85302%27 HTTP/1.1" 200 None
2026-03-27 10:47:06 [auto1.de] INFO: Scrape type for DG85302: 2
2026-03-27 10:47:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82bae6de-11ef-5a42-9e9b-934600f12292 with identifier: DG85302
2026-03-27 10:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82bae6de-11ef-5a42-9e9b-934600f12292 with scrape type 2
2026-03-27 10:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82bae6de-11ef-5a42-9e9b-934600f12292 with scrape type 2
2026-03-27 10:47:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82bae6de-11ef-5a42-9e9b-934600f12292, identifier: DG85302
2026-03-27 10:47:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1201c46e-9f17-5bdc-88aa-a87f1c48e62c with identifier: VK31305
2026-03-27 10:47:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1201c46e-9f17-5bdc-88aa-a87f1c48e62c with identifier: VK31305
2026-03-27 10:47:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1201c46e-9f17-5bdc-88aa-a87f1c48e62c with identifier: VK31305 to the API
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:47:07Z',
 'fuel_type': 'diesel',
 'id': '1201c46e-9f17-5bdc-88aa-a87f1c48e62c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK31305',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 48707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-23',
 'seller_name': None,
 'title': 'BMW 1er 120d xDrive Sport Line',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line',
 'year': 2023}
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK31305%27 HTTP/1.1" 200 None
2026-03-27 10:47:06 [auto1.de] INFO: Saving data for VK31305: {'auction_closing_time': 1774716427.0, 'created_time': 1773646543.711592, 'last_price_update_time': 1774608426.553438}
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK31305') HTTP/1.1" 204 0
2026-03-27 10:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:47:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82bae6de-11ef-5a42-9e9b-934600f12292 with identifier: DG85302
2026-03-27 10:47:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82bae6de-11ef-5a42-9e9b-934600f12292 with identifier: DG85302
2026-03-27 10:47:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82bae6de-11ef-5a42-9e9b-934600f12292 with identifier: DG85302 to the API
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:19:42Z',
 'fuel_type': 'petrol',
 'id': '82bae6de-11ef-5a42-9e9b-934600f12292',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG85302',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 189761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-31',
 'seller_name': None,
 'title': 'Opel Zafira 1.6 Njoy mit Style-Paket',
 'transmission': 'manual',
 'trim': 'Njoy mit Style-Paket',
 'year': 2005}
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG85302%27 HTTP/1.1" 200 None
2026-03-27 10:47:06 [auto1.de] INFO: Saving data for DG85302: {'auction_closing_time': 1774714782.0, 'created_time': 1774119106.916775, 'last_price_update_time': 1774608426.898736}
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG85302') HTTP/1.1" 204 0
2026-03-27 10:47:06 [auto1.de] INFO: Found listing with ID: PW95662
2026-03-27 10:47:06 [auto1.de] INFO: Found listing with ID: MW62166
2026-03-27 10:47:06 [auto1.de] INFO: Found listing with ID: LU78971
2026-03-27 10:47:06 [auto1.de] INFO: Found listing with ID: CA11296
2026-03-27 10:47:06 [auto1.de] INFO: Found listing with ID: WA42896
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA42896%27 HTTP/1.1" 200 None
2026-03-27 10:47:06 [auto1.de] INFO: Scrape type for WA42896: 2
2026-03-27 10:47:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 280acc8c-df16-54fe-bc89-53e055223745 with identifier: WA42896
2026-03-27 10:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 280acc8c-df16-54fe-bc89-53e055223745 with scrape type 2
2026-03-27 10:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 280acc8c-df16-54fe-bc89-53e055223745 with scrape type 2
2026-03-27 10:47:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 280acc8c-df16-54fe-bc89-53e055223745, identifier: WA42896
2026-03-27 10:47:07 [scrapy.extensions.logstats] INFO: Crawled 392 pages (at 6 pages/min), scraped 647 items (at 46 items/min)
2026-03-27 10:47:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 10:47:07 [auto1.de] INFO: Found listing with ID: ZH54779
2026-03-27 10:47:07 [auto1.de] INFO: Found listing with ID: GE03555
2026-03-27 10:47:07 [auto1.de] INFO: Found listing with ID: TX92660
2026-03-27 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92660%27 HTTP/1.1" 200 None
2026-03-27 10:47:07 [auto1.de] INFO: Scrape type for TX92660: 0
2026-03-27 10:47:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 280acc8c-df16-54fe-bc89-53e055223745 with identifier: WA42896
2026-03-27 10:47:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 280acc8c-df16-54fe-bc89-53e055223745 with identifier: WA42896
2026-03-27 10:47:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 280acc8c-df16-54fe-bc89-53e055223745 with identifier: WA42896 to the API
2026-03-27 10:47:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:59:14Z',
 'fuel_type': 'hybrid',
 'id': '280acc8c-df16-54fe-bc89-53e055223745',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA42896',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Prius',
 'odometer': 96269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-25',
 'seller_name': None,
 'title': 'Toyota Prius 1.8 Plug-in Hybrid Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2019}
2026-03-27 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA42896%27 HTTP/1.1" 200 None
2026-03-27 10:47:07 [auto1.de] INFO: Saving data for WA42896: {'auction_closing_time': 1774717154.0, 'created_time': 1773831126.268902, 'last_price_update_time': 1774608427.415205}
2026-03-27 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA42896') HTTP/1.1" 204 0
2026-03-27 10:47:07 [auto1.de] INFO: Found listing with ID: JV37620
2026-03-27 10:47:07 [auto1.de] INFO: Found listing with ID: EV99140
2026-03-27 10:47:07 [auto1.de] INFO: Found listing with ID: BC73225
2026-03-27 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC73225%27 HTTP/1.1" 200 None
2026-03-27 10:47:07 [auto1.de] INFO: Scrape type for BC73225: 2
2026-03-27 10:47:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a8a59fe-ffb6-5ce6-9098-02878aa44e70 with identifier: BC73225
2026-03-27 10:47:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a8a59fe-ffb6-5ce6-9098-02878aa44e70 with scrape type 2
2026-03-27 10:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a8a59fe-ffb6-5ce6-9098-02878aa44e70 with scrape type 2
2026-03-27 10:47:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a8a59fe-ffb6-5ce6-9098-02878aa44e70, identifier: BC73225
2026-03-27 10:47:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a8a59fe-ffb6-5ce6-9098-02878aa44e70 with identifier: BC73225
2026-03-27 10:47:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a8a59fe-ffb6-5ce6-9098-02878aa44e70 with identifier: BC73225
2026-03-27 10:47:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a8a59fe-ffb6-5ce6-9098-02878aa44e70 with identifier: BC73225 to the API
2026-03-27 10:47:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:42:09Z',
 'fuel_type': 'petrol',
 'id': '2a8a59fe-ffb6-5ce6-9098-02878aa44e70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC73225',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Kalos',
 'odometer': 39472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-18',
 'seller_name': None,
 'title': 'Chevrolet Kalos 1.4 SX',
 'transmission': 'manual',
 'trim': 'SX',
 'year': 2009}
2026-03-27 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC73225%27 HTTP/1.1" 200 None
2026-03-27 10:47:07 [auto1.de] INFO: Saving data for BC73225: {'auction_closing_time': 1774716129.0, 'created_time': 1773380475.076288, 'last_price_update_time': 1774608427.982774}
2026-03-27 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC73225') HTTP/1.1" 204 0
2026-03-27 10:47:08 [auto1.de] INFO: Found listing with ID: LT72401
2026-03-27 10:47:08 [auto1.de] INFO: Found listing with ID: BP82527
2026-03-27 10:47:08 [auto1.de] INFO: Found listing with ID: LP67164
2026-03-27 10:47:08 [auto1.de] INFO: Found listing with ID: EG39576
2026-03-27 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39576%27 HTTP/1.1" 200 None
2026-03-27 10:47:08 [auto1.de] INFO: Scrape type for EG39576: 2
2026-03-27 10:47:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36f2292a-f4d8-5729-99d8-caa5d157734e with identifier: EG39576
2026-03-27 10:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36f2292a-f4d8-5729-99d8-caa5d157734e with scrape type 2
2026-03-27 10:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36f2292a-f4d8-5729-99d8-caa5d157734e with scrape type 2
2026-03-27 10:47:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36f2292a-f4d8-5729-99d8-caa5d157734e, identifier: EG39576
2026-03-27 10:47:08 [auto1.de] INFO: Channel: 24h | Page: 37 | totalHits: 10552 | hits on page: 40
2026-03-27 10:47:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36f2292a-f4d8-5729-99d8-caa5d157734e with identifier: EG39576
2026-03-27 10:47:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36f2292a-f4d8-5729-99d8-caa5d157734e with identifier: EG39576
2026-03-27 10:47:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36f2292a-f4d8-5729-99d8-caa5d157734e with identifier: EG39576 to the API
2026-03-27 10:47:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:49:11Z',
 'fuel_type': 'diesel',
 'id': '36f2292a-f4d8-5729-99d8-caa5d157734e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG39576',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 229839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-11',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Ambition 4x4',
 'transmission': 'automatic',
 'trim': 'Ambition 4x4',
 'year': 2018}
2026-03-27 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39576%27 HTTP/1.1" 200 None
2026-03-27 10:47:08 [auto1.de] INFO: Saving data for EG39576: {'auction_closing_time': 1774716551.0, 'created_time': 1773861470.681562, 'last_price_update_time': 1774608428.450433}
2026-03-27 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG39576') HTTP/1.1" 204 0
2026-03-27 10:47:08 [auto1.de] INFO: Found listing with ID: LA05422
2026-03-27 10:47:08 [auto1.de] INFO: Found listing with ID: XN26192
2026-03-27 10:47:08 [auto1.de] INFO: Found listing with ID: TJ09014
2026-03-27 10:47:08 [auto1.de] INFO: Found listing with ID: WP15063
2026-03-27 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP15063%27 HTTP/1.1" 200 None
2026-03-27 10:47:08 [auto1.de] INFO: Scrape type for WP15063: 2
2026-03-27 10:47:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6ac52a7-84a1-5052-94a9-288b655f7ab4 with identifier: WP15063
2026-03-27 10:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6ac52a7-84a1-5052-94a9-288b655f7ab4 with scrape type 2
2026-03-27 10:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6ac52a7-84a1-5052-94a9-288b655f7ab4 with scrape type 2
2026-03-27 10:47:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6ac52a7-84a1-5052-94a9-288b655f7ab4, identifier: WP15063
2026-03-27 10:47:08 [auto1.de] INFO: Found listing with ID: GH47357
2026-03-27 10:47:08 [auto1.de] INFO: Found listing with ID: AR39544
2026-03-27 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR39544%27 HTTP/1.1" 200 None
2026-03-27 10:47:08 [auto1.de] INFO: Scrape type for AR39544: 2
2026-03-27 10:47:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 001cbd09-e9c2-5254-841c-b49df085b02d with identifier: AR39544
2026-03-27 10:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 001cbd09-e9c2-5254-841c-b49df085b02d with scrape type 2
2026-03-27 10:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 001cbd09-e9c2-5254-841c-b49df085b02d with scrape type 2
2026-03-27 10:47:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 001cbd09-e9c2-5254-841c-b49df085b02d, identifier: AR39544
2026-03-27 10:47:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6ac52a7-84a1-5052-94a9-288b655f7ab4 with identifier: WP15063
2026-03-27 10:47:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6ac52a7-84a1-5052-94a9-288b655f7ab4 with identifier: WP15063
2026-03-27 10:47:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6ac52a7-84a1-5052-94a9-288b655f7ab4 with identifier: WP15063 to the API
2026-03-27 10:47:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:12:26Z',
 'fuel_type': 'petrol',
 'id': 'b6ac52a7-84a1-5052-94a9-288b655f7ab4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP15063',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 144777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-06',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2005}
2026-03-27 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP15063%27 HTTP/1.1" 200 None
2026-03-27 10:47:09 [auto1.de] INFO: Saving data for WP15063: {'auction_closing_time': 1774714346.0, 'created_time': 1774263787.076058, 'last_price_update_time': 1774608429.101875}
2026-03-27 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP15063') HTTP/1.1" 204 0
2026-03-27 10:47:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 001cbd09-e9c2-5254-841c-b49df085b02d with identifier: AR39544
2026-03-27 10:47:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 001cbd09-e9c2-5254-841c-b49df085b02d with identifier: AR39544
2026-03-27 10:47:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 001cbd09-e9c2-5254-841c-b49df085b02d with identifier: AR39544 to the API
2026-03-27 10:47:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-28T16:45:08Z',
 'fuel_type': 'petrol',
 'id': '001cbd09-e9c2-5254-841c-b49df085b02d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR39544',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 105441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-13',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 Classic blue 2WD',
 'transmission': 'manual',
 'trim': 'Classic blue 2WD',
 'year': 2016}
2026-03-27 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR39544%27 HTTP/1.1" 200 None
2026-03-27 10:47:09 [auto1.de] INFO: Saving data for AR39544: {'auction_closing_time': 1774716308.0, 'created_time': 1774293623.500901, 'last_price_update_time': 1774608429.540062}
2026-03-27 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR39544') HTTP/1.1" 204 0
2026-03-27 10:47:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:47:09 [auto1.de] INFO: Found listing with ID: NX72393
2026-03-27 10:47:09 [auto1.de] INFO: Found listing with ID: SV37503
2026-03-27 10:47:09 [auto1.de] INFO: Found listing with ID: EU55937
2026-03-27 10:47:09 [auto1.de] INFO: Found listing with ID: UE87725
2026-03-27 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE87725%27 HTTP/1.1" 200 None
2026-03-27 10:47:09 [auto1.de] INFO: Scrape type for UE87725: 2
2026-03-27 10:47:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25ce90e7-3ccc-5aad-9400-42c2f91eb8a3 with identifier: UE87725
2026-03-27 10:47:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25ce90e7-3ccc-5aad-9400-42c2f91eb8a3 with scrape type 2
2026-03-27 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25ce90e7-3ccc-5aad-9400-42c2f91eb8a3 with scrape type 2
2026-03-27 10:47:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25ce90e7-3ccc-5aad-9400-42c2f91eb8a3, identifier: UE87725
2026-03-27 10:47:09 [auto1.de] INFO: Found listing with ID: UC84662
2026-03-27 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC84662%27 HTTP/1.1" 200 None
2026-03-27 10:47:09 [auto1.de] INFO: Scrape type for UC84662: 2
2026-03-27 10:47:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 690a8572-9671-584a-9f20-74789ae9bec4 with identifier: UC84662
2026-03-27 10:47:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 690a8572-9671-584a-9f20-74789ae9bec4 with scrape type 2
2026-03-27 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 690a8572-9671-584a-9f20-74789ae9bec4 with scrape type 2
2026-03-27 10:47:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 690a8572-9671-584a-9f20-74789ae9bec4, identifier: UC84662
2026-03-27 10:47:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25ce90e7-3ccc-5aad-9400-42c2f91eb8a3 with identifier: UE87725
2026-03-27 10:47:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25ce90e7-3ccc-5aad-9400-42c2f91eb8a3 with identifier: UE87725
2026-03-27 10:47:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25ce90e7-3ccc-5aad-9400-42c2f91eb8a3 with identifier: UE87725 to the API
2026-03-27 10:47:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:24:47Z',
 'fuel_type': 'diesel',
 'id': '25ce90e7-3ccc-5aad-9400-42c2f91eb8a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE87725',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 138325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-30',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2015}
2026-03-27 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE87725%27 HTTP/1.1" 200 None
2026-03-27 10:47:10 [auto1.de] INFO: Saving data for UE87725: {'auction_closing_time': 1774715087.0, 'created_time': 1774265145.58714, 'last_price_update_time': 1774608430.196638}
2026-03-27 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE87725') HTTP/1.1" 204 0
2026-03-27 10:47:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 690a8572-9671-584a-9f20-74789ae9bec4 with identifier: UC84662
2026-03-27 10:47:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 690a8572-9671-584a-9f20-74789ae9bec4 with identifier: UC84662
2026-03-27 10:47:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 690a8572-9671-584a-9f20-74789ae9bec4 with identifier: UC84662 to the API
2026-03-27 10:47:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:49:25Z',
 'fuel_type': 'hybrid',
 'id': '690a8572-9671-584a-9f20-74789ae9bec4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC84662',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 115269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-27 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC84662%27 HTTP/1.1" 200 None
2026-03-27 10:47:10 [auto1.de] INFO: Saving data for UC84662: {'auction_closing_time': 1774716565.0, 'created_time': 1774290998.447253, 'last_price_update_time': 1774608430.526127}
2026-03-27 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC84662') HTTP/1.1" 204 0
2026-03-27 10:47:10 [auto1.de] INFO: Found listing with ID: KV75239
2026-03-27 10:47:10 [auto1.de] INFO: Found listing with ID: BF85943
2026-03-27 10:47:10 [auto1.de] INFO: Found listing with ID: XG51341
2026-03-27 10:47:10 [auto1.de] INFO: Found listing with ID: BD92511
2026-03-27 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92511%27 HTTP/1.1" 200 None
2026-03-27 10:47:10 [auto1.de] INFO: Scrape type for BD92511: 2
2026-03-27 10:47:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 950e75ad-f261-501d-92bb-cb2887c9412d with identifier: BD92511
2026-03-27 10:47:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 950e75ad-f261-501d-92bb-cb2887c9412d with scrape type 2
2026-03-27 10:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 950e75ad-f261-501d-92bb-cb2887c9412d with scrape type 2
2026-03-27 10:47:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 950e75ad-f261-501d-92bb-cb2887c9412d, identifier: BD92511
2026-03-27 10:47:10 [auto1.de] INFO: Found listing with ID: TE93454
2026-03-27 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE93454%27 HTTP/1.1" 200 None
2026-03-27 10:47:10 [auto1.de] INFO: Scrape type for TE93454: 2
2026-03-27 10:47:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead with identifier: TE93454
2026-03-27 10:47:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead with scrape type 2
2026-03-27 10:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead with scrape type 2
2026-03-27 10:47:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead, identifier: TE93454
2026-03-27 10:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FA96638> (referer: https://www.auto1.com/v1/car-details-view/FA96638/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:47:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 950e75ad-f261-501d-92bb-cb2887c9412d with identifier: BD92511
2026-03-27 10:47:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 950e75ad-f261-501d-92bb-cb2887c9412d with identifier: BD92511
2026-03-27 10:47:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 950e75ad-f261-501d-92bb-cb2887c9412d with identifier: BD92511 to the API
2026-03-27 10:47:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:01:17Z',
 'fuel_type': 'diesel',
 'id': '950e75ad-f261-501d-92bb-cb2887c9412d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD92511',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 192950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-26',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-27 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92511%27 HTTP/1.1" 200 None
2026-03-27 10:47:11 [auto1.de] INFO: Saving data for BD92511: {'auction_closing_time': 1774713677.0, 'created_time': 1774292544.509362, 'last_price_update_time': 1774608431.125458}
2026-03-27 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD92511') HTTP/1.1" 204 0
2026-03-27 10:47:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead with identifier: TE93454
2026-03-27 10:47:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead with identifier: TE93454
2026-03-27 10:47:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead with identifier: TE93454 to the API
2026-03-27 10:47:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:56:09Z',
 'fuel_type': 'petrol',
 'id': 'ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE93454',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 106676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-27',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2015}
2026-03-27 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE93454%27 HTTP/1.1" 200 None
2026-03-27 10:47:11 [auto1.de] INFO: Saving data for TE93454: {'auction_closing_time': 1774716969.0, 'created_time': 1773687927.697873, 'last_price_update_time': 1774608431.533715}
2026-03-27 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE93454') HTTP/1.1" 204 0
2026-03-27 10:47:11 [auto1.de] INFO: Found listing with ID: VC64340
2026-03-27 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC64340%27 HTTP/1.1" 200 None
2026-03-27 10:47:11 [auto1.de] INFO: Scrape type for VC64340: 2
2026-03-27 10:47:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 228be84a-1d2d-5ff7-ada2-26968542c436 with identifier: VC64340
2026-03-27 10:47:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 228be84a-1d2d-5ff7-ada2-26968542c436 with scrape type 2
2026-03-27 10:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 228be84a-1d2d-5ff7-ada2-26968542c436 with scrape type 2
2026-03-27 10:47:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 228be84a-1d2d-5ff7-ada2-26968542c436, identifier: VC64340
2026-03-27 10:47:11 [auto1.de] INFO: Found listing with ID: ZR21062
2026-03-27 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR21062%27 HTTP/1.1" 200 None
2026-03-27 10:47:11 [auto1.de] INFO: Scrape type for ZR21062: 2
2026-03-27 10:47:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90e540df-e4e6-5de2-9ee0-8d97839ac699 with identifier: ZR21062
2026-03-27 10:47:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90e540df-e4e6-5de2-9ee0-8d97839ac699 with scrape type 2
2026-03-27 10:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90e540df-e4e6-5de2-9ee0-8d97839ac699 with scrape type 2
2026-03-27 10:47:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90e540df-e4e6-5de2-9ee0-8d97839ac699, identifier: ZR21062
2026-03-27 10:47:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 228be84a-1d2d-5ff7-ada2-26968542c436 with identifier: VC64340
2026-03-27 10:47:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 228be84a-1d2d-5ff7-ada2-26968542c436 with identifier: VC64340
2026-03-27 10:47:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 228be84a-1d2d-5ff7-ada2-26968542c436 with identifier: VC64340 to the API
2026-03-27 10:47:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:50:53Z',
 'fuel_type': 'diesel',
 'id': '228be84a-1d2d-5ff7-ada2-26968542c436',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC64340',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 168868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-23',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-27 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC64340%27 HTTP/1.1" 200 None
2026-03-27 10:47:12 [auto1.de] INFO: Saving data for VC64340: {'auction_closing_time': 1774716653.0, 'created_time': 1773383411.053913, 'last_price_update_time': 1774608432.136225}
2026-03-27 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC64340') HTTP/1.1" 204 0
2026-03-27 10:47:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90e540df-e4e6-5de2-9ee0-8d97839ac699 with identifier: ZR21062
2026-03-27 10:47:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90e540df-e4e6-5de2-9ee0-8d97839ac699 with identifier: ZR21062
2026-03-27 10:47:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90e540df-e4e6-5de2-9ee0-8d97839ac699 with identifier: ZR21062 to the API
2026-03-27 10:47:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:26:26Z',
 'fuel_type': 'diesel',
 'id': '90e540df-e4e6-5de2-9ee0-8d97839ac699',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR21062',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 243381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-30',
 'seller_name': None,
 'title': 'BMW 3er 320d EfficientDynamics Edition',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Edition',
 'year': 2011}
2026-03-27 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR21062%27 HTTP/1.1" 200 None
2026-03-27 10:47:12 [auto1.de] INFO: Saving data for ZR21062: {'auction_closing_time': 1774715186.0, 'created_time': 1774291963.81644, 'last_price_update_time': 1774608432.732158}
2026-03-27 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR21062') HTTP/1.1" 204 0
2026-03-27 10:47:12 [auto1.de] INFO: Found listing with ID: BB57132
2026-03-27 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB57132%27 HTTP/1.1" 200 None
2026-03-27 10:47:12 [auto1.de] INFO: Scrape type for BB57132: 2
2026-03-27 10:47:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 382b96ba-cfd1-5b9e-b3ae-87896a477e7f with identifier: BB57132
2026-03-27 10:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 382b96ba-cfd1-5b9e-b3ae-87896a477e7f with scrape type 2
2026-03-27 10:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 382b96ba-cfd1-5b9e-b3ae-87896a477e7f with scrape type 2
2026-03-27 10:47:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 382b96ba-cfd1-5b9e-b3ae-87896a477e7f, identifier: BB57132
2026-03-27 10:47:12 [auto1.de] INFO: Found listing with ID: CA65369
2026-03-27 10:47:12 [auto1.de] INFO: Found listing with ID: BD43064
2026-03-27 10:47:12 [auto1.de] INFO: Found listing with ID: KY14800
2026-03-27 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY14800%27 HTTP/1.1" 200 None
2026-03-27 10:47:12 [auto1.de] INFO: Scrape type for KY14800: 2
2026-03-27 10:47:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21b862dc-a0e5-522d-8fdb-fc7118f6ad2a with identifier: KY14800
2026-03-27 10:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21b862dc-a0e5-522d-8fdb-fc7118f6ad2a with scrape type 2
2026-03-27 10:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21b862dc-a0e5-522d-8fdb-fc7118f6ad2a with scrape type 2
2026-03-27 10:47:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21b862dc-a0e5-522d-8fdb-fc7118f6ad2a, identifier: KY14800
2026-03-27 10:47:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 382b96ba-cfd1-5b9e-b3ae-87896a477e7f with identifier: BB57132
2026-03-27 10:47:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 382b96ba-cfd1-5b9e-b3ae-87896a477e7f with identifier: BB57132
2026-03-27 10:47:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 382b96ba-cfd1-5b9e-b3ae-87896a477e7f with identifier: BB57132 to the API
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:16:00Z',
 'fuel_type': 'diesel',
 'id': '382b96ba-cfd1-5b9e-b3ae-87896a477e7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB57132',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 139997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-21',
 'seller_name': None,
 'title': 'Audi A5 Sportback 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB57132%27 HTTP/1.1" 200 None
2026-03-27 10:47:13 [auto1.de] INFO: Saving data for BB57132: {'auction_closing_time': 1774714560.0, 'created_time': 1773307517.033165, 'last_price_update_time': 1774608433.299726}
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB57132') HTTP/1.1" 204 0
2026-03-27 10:47:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21b862dc-a0e5-522d-8fdb-fc7118f6ad2a with identifier: KY14800
2026-03-27 10:47:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21b862dc-a0e5-522d-8fdb-fc7118f6ad2a with identifier: KY14800
2026-03-27 10:47:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21b862dc-a0e5-522d-8fdb-fc7118f6ad2a with identifier: KY14800 to the API
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:01:54Z',
 'fuel_type': 'petrol',
 'id': '21b862dc-a0e5-522d-8fdb-fc7118f6ad2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY14800',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 124071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-03',
 'seller_name': None,
 'title': 'Audi A6 55 TFSI Mild-Hybrid quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2020}
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY14800%27 HTTP/1.1" 200 None
2026-03-27 10:47:13 [auto1.de] INFO: Saving data for KY14800: {'auction_closing_time': 1774713714.0, 'created_time': 1773383156.081231, 'last_price_update_time': 1774608433.649086}
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY14800') HTTP/1.1" 204 0
2026-03-27 10:47:13 [auto1.de] INFO: Found listing with ID: AV32823
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV32823%27 HTTP/1.1" 200 None
2026-03-27 10:47:13 [auto1.de] INFO: Scrape type for AV32823: 2
2026-03-27 10:47:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef8b3f80-d2ce-575a-a690-2a29462954e4 with identifier: AV32823
2026-03-27 10:47:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef8b3f80-d2ce-575a-a690-2a29462954e4 with scrape type 2
2026-03-27 10:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef8b3f80-d2ce-575a-a690-2a29462954e4 with scrape type 2
2026-03-27 10:47:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef8b3f80-d2ce-575a-a690-2a29462954e4, identifier: AV32823
2026-03-27 10:47:13 [auto1.de] INFO: Found listing with ID: RV94916
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV94916%27 HTTP/1.1" 200 None
2026-03-27 10:47:13 [auto1.de] INFO: Scrape type for RV94916: 2
2026-03-27 10:47:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c14711c9-e4f8-5529-9c11-dbeca5fc1b4d with identifier: RV94916
2026-03-27 10:47:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c14711c9-e4f8-5529-9c11-dbeca5fc1b4d with scrape type 2
2026-03-27 10:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c14711c9-e4f8-5529-9c11-dbeca5fc1b4d with scrape type 2
2026-03-27 10:47:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c14711c9-e4f8-5529-9c11-dbeca5fc1b4d, identifier: RV94916
2026-03-27 10:47:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb479ad5-39ea-51e7-ae4c-96d684216893 with identifier: FA96638
2026-03-27 10:47:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb479ad5-39ea-51e7-ae4c-96d684216893 with scrape type 1
2026-03-27 10:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb479ad5-39ea-51e7-ae4c-96d684216893
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F34%252F1434111e7e76e6b64f86ac6643039895%252Fpa%252FFA96638_d723392ff501123c7718bf4f81d78a6d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_d723392ff501123c7718bf4f81d78a6d.jpg already downloaded
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F34%252F1434111e7e76e6b64f86ac6643039895%252Fpa%252FFA96638_4963e9130224b4383fc9222163e21da3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_4963e9130224b4383fc9222163e21da3.jpg already downloaded
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F34%252F1434111e7e76e6b64f86ac6643039895%252Fpa%252FFA96638_aae1bc7e083cf327ee510cac97ecac76.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_aae1bc7e083cf327ee510cac97ecac76.jpg already downloaded
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F34%252F1434111e7e76e6b64f86ac6643039895%252Fpa%252FFA96638_8b6d1f615c5b77af6b420d1a847ca698.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_8b6d1f615c5b77af6b420d1a847ca698.jpg already downloaded
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F34%252F1434111e7e76e6b64f86ac6643039895%252Fpa%252FFA96638_767de6724797de15441a06444d28c732.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_767de6724797de15441a06444d28c732.jpg already downloaded
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F34%252F1434111e7e76e6b64f86ac6643039895%252Fpa%252FFA96638_c360b1c3043d25d86c97b26ccb8fb863.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_c360b1c3043d25d86c97b26ccb8fb863.jpg already downloaded
2026-03-27 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F34%252F1434111e7e76e6b64f86ac6643039895%252Fpa%252FFA96638_246faef06056e71f080a0aa69e348d47.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_246faef06056e71f080a0aa69e348d47.jpg already downloaded
2026-03-27 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F34%252F1434111e7e76e6b64f86ac6643039895%252Fpa%252FFA96638_1f9acb2696737fc7b5ca3c21e26cf41e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_1f9acb2696737fc7b5ca3c21e26cf41e.jpg already downloaded
2026-03-27 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F34%252F1434111e7e76e6b64f86ac6643039895%252Fpa%252FFA96638_3fddf55f56985df97dba53a5bed87b98.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_3fddf55f56985df97dba53a5bed87b98.jpg already downloaded
2026-03-27 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F34%252F1434111e7e76e6b64f86ac6643039895%252Fpa%252FFA96638_9177a67d9219d6e155aa9307e61028ec.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_9177a67d9219d6e155aa9307e61028ec.jpg already downloaded
2026-03-27 10:47:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb479ad5-39ea-51e7-ae4c-96d684216893, identifier: FA96638
2026-03-27 10:47:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef8b3f80-d2ce-575a-a690-2a29462954e4 with identifier: AV32823
2026-03-27 10:47:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef8b3f80-d2ce-575a-a690-2a29462954e4 with identifier: AV32823
2026-03-27 10:47:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef8b3f80-d2ce-575a-a690-2a29462954e4 with identifier: AV32823 to the API
2026-03-27 10:47:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:36:21Z',
 'fuel_type': 'petrol',
 'id': 'ef8b3f80-d2ce-575a-a690-2a29462954e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV32823',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 80531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-31',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2019}
2026-03-27 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV32823%27 HTTP/1.1" 200 None
2026-03-27 10:47:14 [auto1.de] INFO: Saving data for AV32823: {'auction_closing_time': 1774715781.0, 'created_time': 1773553392.869484, 'last_price_update_time': 1774608434.476447}
2026-03-27 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV32823') HTTP/1.1" 204 0
2026-03-27 10:47:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c14711c9-e4f8-5529-9c11-dbeca5fc1b4d with identifier: RV94916
2026-03-27 10:47:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c14711c9-e4f8-5529-9c11-dbeca5fc1b4d with identifier: RV94916
2026-03-27 10:47:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c14711c9-e4f8-5529-9c11-dbeca5fc1b4d with identifier: RV94916 to the API
2026-03-27 10:47:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:04:37Z',
 'fuel_type': 'petrol',
 'id': 'c14711c9-e4f8-5529-9c11-dbeca5fc1b4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV94916',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 138725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-27',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 1.4 TSI Life BlueMotion',
 'transmission': 'manual',
 'trim': 'Life BlueMotion',
 'year': 2013}
2026-03-27 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV94916%27 HTTP/1.1" 200 None
2026-03-27 10:47:14 [auto1.de] INFO: Saving data for RV94916: {'auction_closing_time': 1774713877.0, 'created_time': 1773307705.810263, 'last_price_update_time': 1774608434.819237}
2026-03-27 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV94916') HTTP/1.1" 204 0
2026-03-27 10:47:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb479ad5-39ea-51e7-ae4c-96d684216893 with identifier: FA96638
2026-03-27 10:47:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb479ad5-39ea-51e7-ae4c-96d684216893 with identifier: FA96638
2026-03-27 10:47:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb479ad5-39ea-51e7-ae4c-96d684216893 with identifier: FA96638 to the API
2026-03-27 10:47:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FA96638>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:43:44Z',
 'fuel_type': 'petrol',
 'id': 'cb479ad5-39ea-51e7-ae4c-96d684216893',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA96638',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 137198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_d723392ff501123c7718bf4f81d78a6d.jpg',
                'https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_4963e9130224b4383fc9222163e21da3.jpg',
                'https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_aae1bc7e083cf327ee510cac97ecac76.jpg',
                'https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_8b6d1f615c5b77af6b420d1a847ca698.jpg',
                'https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_767de6724797de15441a06444d28c732.jpg',
                'https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_c360b1c3043d25d86c97b26ccb8fb863.jpg',
                'https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_246faef06056e71f080a0aa69e348d47.jpg',
                'https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_1f9acb2696737fc7b5ca3c21e26cf41e.jpg',
                'https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_3fddf55f56985df97dba53a5bed87b98.jpg',
                'https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_9177a67d9219d6e155aa9307e61028ec.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb479ad5-39ea-51e7-ae4c-96d684216893/cb479ad5-39ea-51e7-ae4c-96d684216893_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_d723392ff501123c7718bf4f81d78a6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb479ad5-39ea-51e7-ae4c-96d684216893/cb479ad5-39ea-51e7-ae4c-96d684216893_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_4963e9130224b4383fc9222163e21da3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb479ad5-39ea-51e7-ae4c-96d684216893/cb479ad5-39ea-51e7-ae4c-96d684216893_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_aae1bc7e083cf327ee510cac97ecac76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb479ad5-39ea-51e7-ae4c-96d684216893/cb479ad5-39ea-51e7-ae4c-96d684216893_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2634722,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_8b6d1f615c5b77af6b420d1a847ca698.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb479ad5-39ea-51e7-ae4c-96d684216893/cb479ad5-39ea-51e7-ae4c-96d684216893_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_767de6724797de15441a06444d28c732.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb479ad5-39ea-51e7-ae4c-96d684216893/cb479ad5-39ea-51e7-ae4c-96d684216893_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_c360b1c3043d25d86c97b26ccb8fb863.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb479ad5-39ea-51e7-ae4c-96d684216893/cb479ad5-39ea-51e7-ae4c-96d684216893_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_246faef06056e71f080a0aa69e348d47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb479ad5-39ea-51e7-ae4c-96d684216893/cb479ad5-39ea-51e7-ae4c-96d684216893_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_1f9acb2696737fc7b5ca3c21e26cf41e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb479ad5-39ea-51e7-ae4c-96d684216893/cb479ad5-39ea-51e7-ae4c-96d684216893_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_3fddf55f56985df97dba53a5bed87b98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb479ad5-39ea-51e7-ae4c-96d684216893/cb479ad5-39ea-51e7-ae4c-96d684216893_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/34/1434111e7e76e6b64f86ac6643039895/pa/FA96638_9177a67d9219d6e155aa9307e61028ec.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-03-11',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Style',
 'year': 2014}
2026-03-27 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA96638%27 HTTP/1.1" 200 None
2026-03-27 10:47:15 [auto1.de] INFO: Saving data for FA96638: {'created_time': 1774608435.155741, 'last_price_update_time': 1774608435.155752, 'auction_closing_time': 1774716224.0}
2026-03-27 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FA96638') HTTP/1.1" 204 0
2026-03-27 10:47:15 [auto1.de] INFO: Found listing with ID: NS04983
2026-03-27 10:47:15 [auto1.de] INFO: Found listing with ID: UF29194
2026-03-27 10:47:15 [auto1.de] INFO: Found listing with ID: UK28152
2026-03-27 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28152%27 HTTP/1.1" 200 None
2026-03-27 10:47:15 [auto1.de] INFO: Scrape type for UK28152: 2
2026-03-27 10:47:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 070edb50-ff92-5b9f-a8a9-3d4f41aef509 with identifier: UK28152
2026-03-27 10:47:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 070edb50-ff92-5b9f-a8a9-3d4f41aef509 with scrape type 2
2026-03-27 10:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 070edb50-ff92-5b9f-a8a9-3d4f41aef509 with scrape type 2
2026-03-27 10:47:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 070edb50-ff92-5b9f-a8a9-3d4f41aef509, identifier: UK28152
2026-03-27 10:47:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 070edb50-ff92-5b9f-a8a9-3d4f41aef509 with identifier: UK28152
2026-03-27 10:47:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 070edb50-ff92-5b9f-a8a9-3d4f41aef509 with identifier: UK28152
2026-03-27 10:47:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 070edb50-ff92-5b9f-a8a9-3d4f41aef509 with identifier: UK28152 to the API
2026-03-27 10:47:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:27:55Z',
 'fuel_type': 'petrol',
 'id': '070edb50-ff92-5b9f-a8a9-3d4f41aef509',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK28152',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 123669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-31',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.4 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2009}
2026-03-27 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28152%27 HTTP/1.1" 200 None
2026-03-27 10:47:15 [auto1.de] INFO: Saving data for UK28152: {'auction_closing_time': 1774715275.0, 'created_time': 1774293401.032985, 'last_price_update_time': 1774608435.625301}
2026-03-27 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK28152') HTTP/1.1" 204 0
2026-03-27 10:47:15 [auto1.de] INFO: Found listing with ID: GV91786
2026-03-27 10:47:15 [auto1.de] INFO: Found listing with ID: TN59671
2026-03-27 10:47:15 [auto1.de] INFO: Found listing with ID: EJ47665
2026-03-27 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47665%27 HTTP/1.1" 200 None
2026-03-27 10:47:15 [auto1.de] INFO: Scrape type for EJ47665: 1
2026-03-27 10:47:15 [auto1.de] INFO: Found listing with ID: UZ90215
2026-03-27 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90215%27 HTTP/1.1" 200 None
2026-03-27 10:47:15 [auto1.de] INFO: Scrape type for UZ90215: 2
2026-03-27 10:47:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe053552-3315-56c8-bbd8-1bc54e34e7ae with identifier: UZ90215
2026-03-27 10:47:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe053552-3315-56c8-bbd8-1bc54e34e7ae with scrape type 2
2026-03-27 10:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe053552-3315-56c8-bbd8-1bc54e34e7ae with scrape type 2
2026-03-27 10:47:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe053552-3315-56c8-bbd8-1bc54e34e7ae, identifier: UZ90215
2026-03-27 10:47:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:47:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe053552-3315-56c8-bbd8-1bc54e34e7ae with identifier: UZ90215
2026-03-27 10:47:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe053552-3315-56c8-bbd8-1bc54e34e7ae with identifier: UZ90215
2026-03-27 10:47:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe053552-3315-56c8-bbd8-1bc54e34e7ae with identifier: UZ90215 to the API
2026-03-27 10:47:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:30:28Z',
 'fuel_type': 'petrol',
 'id': 'fe053552-3315-56c8-bbd8-1bc54e34e7ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ90215',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-08',
 'seller_name': None,
 'title': 'BMW X4 xDrive 30i xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2019}
2026-03-27 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90215%27 HTTP/1.1" 200 None
2026-03-27 10:47:16 [auto1.de] INFO: Saving data for UZ90215: {'auction_closing_time': 1774715428.0, 'created_time': 1773774006.999903, 'last_price_update_time': 1774608436.102792}
2026-03-27 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ90215') HTTP/1.1" 204 0
2026-03-27 10:47:16 [auto1.de] INFO: Found listing with ID: CZ08846
2026-03-27 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ08846%27 HTTP/1.1" 200 None
2026-03-27 10:47:16 [auto1.de] INFO: Scrape type for CZ08846: 2
2026-03-27 10:47:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bb34ff7-682c-530c-81a5-fee68133c246 with identifier: CZ08846
2026-03-27 10:47:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bb34ff7-682c-530c-81a5-fee68133c246 with scrape type 2
2026-03-27 10:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bb34ff7-682c-530c-81a5-fee68133c246 with scrape type 2
2026-03-27 10:47:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bb34ff7-682c-530c-81a5-fee68133c246, identifier: CZ08846
2026-03-27 10:47:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bb34ff7-682c-530c-81a5-fee68133c246 with identifier: CZ08846
2026-03-27 10:47:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bb34ff7-682c-530c-81a5-fee68133c246 with identifier: CZ08846
2026-03-27 10:47:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bb34ff7-682c-530c-81a5-fee68133c246 with identifier: CZ08846 to the API
2026-03-27 10:47:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:16:48Z',
 'fuel_type': 'petrol',
 'id': '4bb34ff7-682c-530c-81a5-fee68133c246',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ08846',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 48174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-31',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2017}
2026-03-27 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ08846%27 HTTP/1.1" 200 None
2026-03-27 10:47:16 [auto1.de] INFO: Saving data for CZ08846: {'auction_closing_time': 1774714608.0, 'created_time': 1773380482.275538, 'last_price_update_time': 1774608436.666868}
2026-03-27 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ08846') HTTP/1.1" 204 0
2026-03-27 10:47:16 [auto1.de] INFO: Found listing with ID: RW84791
2026-03-27 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW84791%27 HTTP/1.1" 200 None
2026-03-27 10:47:16 [auto1.de] INFO: Scrape type for RW84791: 2
2026-03-27 10:47:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec0771a0-fadd-589a-8c26-6732aeac7bcd with identifier: RW84791
2026-03-27 10:47:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec0771a0-fadd-589a-8c26-6732aeac7bcd with scrape type 2
2026-03-27 10:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec0771a0-fadd-589a-8c26-6732aeac7bcd with scrape type 2
2026-03-27 10:47:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec0771a0-fadd-589a-8c26-6732aeac7bcd, identifier: RW84791
2026-03-27 10:47:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec0771a0-fadd-589a-8c26-6732aeac7bcd with identifier: RW84791
2026-03-27 10:47:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec0771a0-fadd-589a-8c26-6732aeac7bcd with identifier: RW84791
2026-03-27 10:47:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec0771a0-fadd-589a-8c26-6732aeac7bcd with identifier: RW84791 to the API
2026-03-27 10:47:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:24:09Z',
 'fuel_type': 'diesel',
 'id': 'ec0771a0-fadd-589a-8c26-6732aeac7bcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW84791',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 98258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-17',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI clean diesel',
 'transmission': 'automatic',
 'trim': 'clean diesel',
 'year': 2016}
2026-03-27 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW84791%27 HTTP/1.1" 200 None
2026-03-27 10:47:17 [auto1.de] INFO: Saving data for RW84791: {'auction_closing_time': 1774715049.0, 'created_time': 1773861770.607587, 'last_price_update_time': 1774608437.202609}
2026-03-27 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW84791') HTTP/1.1" 204 0
2026-03-27 10:47:17 [auto1.de] INFO: Found listing with ID: GK53222
2026-03-27 10:47:17 [auto1.de] INFO: Found listing with ID: GK41748
2026-03-27 10:47:17 [auto1.de] INFO: Found listing with ID: DM49539
2026-03-27 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM49539%27 HTTP/1.1" 200 None
2026-03-27 10:47:17 [auto1.de] INFO: Scrape type for DM49539: 2
2026-03-27 10:47:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e482be7a-5a9d-5107-be5f-6d26aa03110a with identifier: DM49539
2026-03-27 10:47:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e482be7a-5a9d-5107-be5f-6d26aa03110a with scrape type 2
2026-03-27 10:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e482be7a-5a9d-5107-be5f-6d26aa03110a with scrape type 2
2026-03-27 10:47:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e482be7a-5a9d-5107-be5f-6d26aa03110a, identifier: DM49539
2026-03-27 10:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:47:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e482be7a-5a9d-5107-be5f-6d26aa03110a with identifier: DM49539
2026-03-27 10:47:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e482be7a-5a9d-5107-be5f-6d26aa03110a with identifier: DM49539
2026-03-27 10:47:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e482be7a-5a9d-5107-be5f-6d26aa03110a with identifier: DM49539 to the API
2026-03-27 10:47:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:12:50Z',
 'fuel_type': 'petrol',
 'id': 'e482be7a-5a9d-5107-be5f-6d26aa03110a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM49539',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 174379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-30',
 'seller_name': None,
 'title': 'Honda Civic 1.8 i-VTEC Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2014}
2026-03-27 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM49539%27 HTTP/1.1" 200 None
2026-03-27 10:47:17 [auto1.de] INFO: Saving data for DM49539: {'auction_closing_time': 1774714370.0, 'created_time': 1774291496.620035, 'last_price_update_time': 1774608437.671789}
2026-03-27 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM49539') HTTP/1.1" 204 0
2026-03-27 10:47:17 [auto1.de] INFO: Found listing with ID: WE65713
2026-03-27 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE65713%27 HTTP/1.1" 200 None
2026-03-27 10:47:17 [auto1.de] INFO: Scrape type for WE65713: 2
2026-03-27 10:47:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f328ce28-1ef9-5fc2-b973-1c08e853dc14 with identifier: WE65713
2026-03-27 10:47:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f328ce28-1ef9-5fc2-b973-1c08e853dc14 with scrape type 2
2026-03-27 10:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f328ce28-1ef9-5fc2-b973-1c08e853dc14 with scrape type 2
2026-03-27 10:47:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f328ce28-1ef9-5fc2-b973-1c08e853dc14, identifier: WE65713
2026-03-27 10:47:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f328ce28-1ef9-5fc2-b973-1c08e853dc14 with identifier: WE65713
2026-03-27 10:47:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f328ce28-1ef9-5fc2-b973-1c08e853dc14 with identifier: WE65713
2026-03-27 10:47:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f328ce28-1ef9-5fc2-b973-1c08e853dc14 with identifier: WE65713 to the API
2026-03-27 10:47:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:53:33Z',
 'fuel_type': 'petrol',
 'id': 'f328ce28-1ef9-5fc2-b973-1c08e853dc14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE65713',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 107995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2009}
2026-03-27 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE65713%27 HTTP/1.1" 200 None
2026-03-27 10:47:18 [auto1.de] INFO: Saving data for WE65713: {'auction_closing_time': 1774716813.0, 'created_time': 1773383274.734436, 'last_price_update_time': 1774608438.109289}
2026-03-27 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE65713') HTTP/1.1" 204 0
2026-03-27 10:47:18 [auto1.de] INFO: Found listing with ID: YH44643
2026-03-27 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44643%27 HTTP/1.1" 200 None
2026-03-27 10:47:18 [auto1.de] INFO: Scrape type for YH44643: 2
2026-03-27 10:47:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39e0e204-c581-50ff-a6d4-9e7c2b92be50 with identifier: YH44643
2026-03-27 10:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39e0e204-c581-50ff-a6d4-9e7c2b92be50 with scrape type 2
2026-03-27 10:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39e0e204-c581-50ff-a6d4-9e7c2b92be50 with scrape type 2
2026-03-27 10:47:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39e0e204-c581-50ff-a6d4-9e7c2b92be50, identifier: YH44643
2026-03-27 10:47:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39e0e204-c581-50ff-a6d4-9e7c2b92be50 with identifier: YH44643
2026-03-27 10:47:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39e0e204-c581-50ff-a6d4-9e7c2b92be50 with identifier: YH44643
2026-03-27 10:47:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39e0e204-c581-50ff-a6d4-9e7c2b92be50 with identifier: YH44643 to the API
2026-03-27 10:47:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:21:33Z',
 'fuel_type': 'petrol',
 'id': '39e0e204-c581-50ff-a6d4-9e7c2b92be50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH44643',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 88326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-19',
 'seller_name': None,
 'title': 'Ford S-Max 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-27 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44643%27 HTTP/1.1" 200 None
2026-03-27 10:47:18 [auto1.de] INFO: Saving data for YH44643: {'auction_closing_time': 1774714893.0, 'created_time': 1774262620.755654, 'last_price_update_time': 1774608438.586053}
2026-03-27 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH44643') HTTP/1.1" 204 0
2026-03-27 10:47:18 [auto1.de] INFO: Channel: 24h | Page: 38 | totalHits: 10552 | hits on page: 40
2026-03-27 10:47:18 [auto1.de] INFO: Found listing with ID: UH91436
2026-03-27 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH91436%27 HTTP/1.1" 200 None
2026-03-27 10:47:18 [auto1.de] INFO: Scrape type for UH91436: 2
2026-03-27 10:47:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83d39a44-8562-54af-b1e6-acda3330eaed with identifier: UH91436
2026-03-27 10:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83d39a44-8562-54af-b1e6-acda3330eaed with scrape type 2
2026-03-27 10:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83d39a44-8562-54af-b1e6-acda3330eaed with scrape type 2
2026-03-27 10:47:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83d39a44-8562-54af-b1e6-acda3330eaed, identifier: UH91436
2026-03-27 10:47:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83d39a44-8562-54af-b1e6-acda3330eaed with identifier: UH91436
2026-03-27 10:47:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83d39a44-8562-54af-b1e6-acda3330eaed with identifier: UH91436
2026-03-27 10:47:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83d39a44-8562-54af-b1e6-acda3330eaed with identifier: UH91436 to the API
2026-03-27 10:47:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:18:20Z',
 'fuel_type': 'hybrid',
 'id': '83d39a44-8562-54af-b1e6-acda3330eaed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH91436',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 91304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-21',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSIe',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-27 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH91436%27 HTTP/1.1" 200 None
2026-03-27 10:47:19 [auto1.de] INFO: Saving data for UH91436: {'auction_closing_time': 1774714700.0, 'created_time': 1773772567.508528, 'last_price_update_time': 1774608439.054433}
2026-03-27 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH91436') HTTP/1.1" 204 0
2026-03-27 10:47:19 [auto1.de] INFO: Found listing with ID: ZK30866
2026-03-27 10:47:19 [auto1.de] INFO: Found listing with ID: VC63070
2026-03-27 10:47:19 [auto1.de] INFO: Found listing with ID: RS52465
2026-03-27 10:47:19 [auto1.de] INFO: Found listing with ID: FK93583
2026-03-27 10:47:19 [auto1.de] INFO: Found listing with ID: ZN44804
2026-03-27 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN44804%27 HTTP/1.1" 200 None
2026-03-27 10:47:19 [auto1.de] INFO: Scrape type for ZN44804: 2
2026-03-27 10:47:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b057cf17-7d75-5278-82a8-a956ea96ed8a with identifier: ZN44804
2026-03-27 10:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b057cf17-7d75-5278-82a8-a956ea96ed8a with scrape type 2
2026-03-27 10:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b057cf17-7d75-5278-82a8-a956ea96ed8a with scrape type 2
2026-03-27 10:47:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b057cf17-7d75-5278-82a8-a956ea96ed8a, identifier: ZN44804
2026-03-27 10:47:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:47:19 [auto1.de] INFO: Found listing with ID: ZY93547
2026-03-27 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY93547%27 HTTP/1.1" 200 None
2026-03-27 10:47:19 [auto1.de] INFO: Scrape type for ZY93547: 2
2026-03-27 10:47:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ae146cf-7f04-5b2e-b308-fd145b35ddfb with identifier: ZY93547
2026-03-27 10:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ae146cf-7f04-5b2e-b308-fd145b35ddfb with scrape type 2
2026-03-27 10:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ae146cf-7f04-5b2e-b308-fd145b35ddfb with scrape type 2
2026-03-27 10:47:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ae146cf-7f04-5b2e-b308-fd145b35ddfb, identifier: ZY93547
2026-03-27 10:47:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b057cf17-7d75-5278-82a8-a956ea96ed8a with identifier: ZN44804
2026-03-27 10:47:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b057cf17-7d75-5278-82a8-a956ea96ed8a with identifier: ZN44804
2026-03-27 10:47:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b057cf17-7d75-5278-82a8-a956ea96ed8a with identifier: ZN44804 to the API
2026-03-27 10:47:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 380,
 'expiration_date': '2026-03-28T16:56:40Z',
 'fuel_type': 'diesel',
 'id': 'b057cf17-7d75-5278-82a8-a956ea96ed8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN44804',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 235997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-09',
 'seller_name': None,
 'title': 'BMW X5 M50d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-27 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN44804%27 HTTP/1.1" 200 None
2026-03-27 10:47:19 [auto1.de] INFO: Saving data for ZN44804: {'auction_closing_time': 1774717000.0, 'created_time': 1773340684.657667, 'last_price_update_time': 1774608439.637266}
2026-03-27 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN44804') HTTP/1.1" 204 0
2026-03-27 10:47:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ae146cf-7f04-5b2e-b308-fd145b35ddfb with identifier: ZY93547
2026-03-27 10:47:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ae146cf-7f04-5b2e-b308-fd145b35ddfb with identifier: ZY93547
2026-03-27 10:47:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ae146cf-7f04-5b2e-b308-fd145b35ddfb with identifier: ZY93547 to the API
2026-03-27 10:47:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:13:33Z',
 'fuel_type': 'petrol',
 'id': '3ae146cf-7f04-5b2e-b308-fd145b35ddfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY93547',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 59267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-03',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2021}
2026-03-27 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY93547%27 HTTP/1.1" 200 None
2026-03-27 10:47:20 [auto1.de] INFO: Saving data for ZY93547: {'auction_closing_time': 1774714413.0, 'created_time': 1773830309.988095, 'last_price_update_time': 1774608440.072645}
2026-03-27 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY93547') HTTP/1.1" 204 0
2026-03-27 10:47:20 [auto1.de] INFO: Found listing with ID: YF25460
2026-03-27 10:47:20 [auto1.de] INFO: Found listing with ID: YT48598
2026-03-27 10:47:20 [auto1.de] INFO: Found listing with ID: ME69590
2026-03-27 10:47:20 [auto1.de] INFO: Found listing with ID: XY70185
2026-03-27 10:47:20 [auto1.de] INFO: Found listing with ID: JP08522
2026-03-27 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP08522%27 HTTP/1.1" 200 None
2026-03-27 10:47:20 [auto1.de] INFO: Scrape type for JP08522: 1
2026-03-27 10:47:20 [auto1.de] INFO: Found listing with ID: NC65519
2026-03-27 10:47:20 [auto1.de] INFO: Found listing with ID: LB73186
2026-03-27 10:47:20 [auto1.de] INFO: Found listing with ID: WB73740
2026-03-27 10:47:20 [auto1.de] INFO: Found listing with ID: CN87800
2026-03-27 10:47:20 [auto1.de] INFO: Found listing with ID: FS06029
2026-03-27 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS06029%27 HTTP/1.1" 200 None
2026-03-27 10:47:20 [auto1.de] INFO: Scrape type for FS06029: 2
2026-03-27 10:47:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db44d376-ccb5-5dfc-97a7-3802a6813b36 with identifier: FS06029
2026-03-27 10:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db44d376-ccb5-5dfc-97a7-3802a6813b36 with scrape type 2
2026-03-27 10:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db44d376-ccb5-5dfc-97a7-3802a6813b36 with scrape type 2
2026-03-27 10:47:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db44d376-ccb5-5dfc-97a7-3802a6813b36, identifier: FS06029
2026-03-27 10:47:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db44d376-ccb5-5dfc-97a7-3802a6813b36 with identifier: FS06029
2026-03-27 10:47:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db44d376-ccb5-5dfc-97a7-3802a6813b36 with identifier: FS06029
2026-03-27 10:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db44d376-ccb5-5dfc-97a7-3802a6813b36 with identifier: FS06029 to the API
2026-03-27 10:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:02:46Z',
 'fuel_type': 'petrol',
 'id': 'db44d376-ccb5-5dfc-97a7-3802a6813b36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS06029',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 139364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-15',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 Style Viva',
 'transmission': 'manual',
 'trim': 'Style Viva',
 'year': 2012}
2026-03-27 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS06029%27 HTTP/1.1" 200 None
2026-03-27 10:47:20 [auto1.de] INFO: Saving data for FS06029: {'auction_closing_time': 1774713766.0, 'created_time': 1774330536.165143, 'last_price_update_time': 1774608440.570303}
2026-03-27 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS06029') HTTP/1.1" 204 0
2026-03-27 10:47:20 [auto1.de] INFO: Found listing with ID: NM28513
2026-03-27 10:47:20 [auto1.de] INFO: Found listing with ID: YW59624
2026-03-27 10:47:20 [auto1.de] INFO: Found listing with ID: HD52891
2026-03-27 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD52891%27 HTTP/1.1" 200 None
2026-03-27 10:47:20 [auto1.de] INFO: Scrape type for HD52891: 2
2026-03-27 10:47:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c04c2bd-a3af-503f-937e-3b7c5fafe64d with identifier: HD52891
2026-03-27 10:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c04c2bd-a3af-503f-937e-3b7c5fafe64d with scrape type 2
2026-03-27 10:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c04c2bd-a3af-503f-937e-3b7c5fafe64d with scrape type 2
2026-03-27 10:47:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c04c2bd-a3af-503f-937e-3b7c5fafe64d, identifier: HD52891
2026-03-27 10:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EJ47665/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:47:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:47:20 [auto1.de] INFO: Found listing with ID: TH26087
2026-03-27 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH26087%27 HTTP/1.1" 200 None
2026-03-27 10:47:20 [auto1.de] INFO: Scrape type for TH26087: 2
2026-03-27 10:47:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92172397-a815-5672-a7d9-fb09af2f7bbd with identifier: TH26087
2026-03-27 10:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92172397-a815-5672-a7d9-fb09af2f7bbd with scrape type 2
2026-03-27 10:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92172397-a815-5672-a7d9-fb09af2f7bbd with scrape type 2
2026-03-27 10:47:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92172397-a815-5672-a7d9-fb09af2f7bbd, identifier: TH26087
2026-03-27 10:47:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c04c2bd-a3af-503f-937e-3b7c5fafe64d with identifier: HD52891
2026-03-27 10:47:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c04c2bd-a3af-503f-937e-3b7c5fafe64d with identifier: HD52891
2026-03-27 10:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c04c2bd-a3af-503f-937e-3b7c5fafe64d with identifier: HD52891 to the API
2026-03-27 10:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 156,
 'expiration_date': '2026-03-28T16:20:27Z',
 'fuel_type': 'petrol',
 'id': '2c04c2bd-a3af-503f-937e-3b7c5fafe64d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD52891',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 126447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-06',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2020}
2026-03-27 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD52891%27 HTTP/1.1" 200 None
2026-03-27 10:47:21 [auto1.de] INFO: Saving data for HD52891: {'auction_closing_time': 1774714827.0, 'created_time': 1772542408.492189, 'last_price_update_time': 1774608441.211545}
2026-03-27 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD52891') HTTP/1.1" 204 0
2026-03-27 10:47:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92172397-a815-5672-a7d9-fb09af2f7bbd with identifier: TH26087
2026-03-27 10:47:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92172397-a815-5672-a7d9-fb09af2f7bbd with identifier: TH26087
2026-03-27 10:47:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92172397-a815-5672-a7d9-fb09af2f7bbd with identifier: TH26087 to the API
2026-03-27 10:47:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:23:52Z',
 'fuel_type': 'petrol',
 'id': '92172397-a815-5672-a7d9-fb09af2f7bbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH26087',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 138024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-31',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2009}
2026-03-27 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH26087%27 HTTP/1.1" 200 None
2026-03-27 10:47:21 [auto1.de] INFO: Saving data for TH26087: {'auction_closing_time': 1774715032.0, 'created_time': 1773689134.606667, 'last_price_update_time': 1774608441.88455}
2026-03-27 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH26087') HTTP/1.1" 204 0
2026-03-27 10:47:21 [auto1.de] INFO: Found listing with ID: RG82987
2026-03-27 10:47:21 [auto1.de] INFO: Found listing with ID: MG28857
2026-03-27 10:47:21 [auto1.de] INFO: Found listing with ID: JT86021
2026-03-27 10:47:21 [auto1.de] INFO: Found listing with ID: JV68869
2026-03-27 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68869%27 HTTP/1.1" 200 None
2026-03-27 10:47:21 [auto1.de] INFO: Scrape type for JV68869: 2
2026-03-27 10:47:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e2de161-0c17-555e-b043-9e5ef9d21310 with identifier: JV68869
2026-03-27 10:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e2de161-0c17-555e-b043-9e5ef9d21310 with scrape type 2
2026-03-27 10:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e2de161-0c17-555e-b043-9e5ef9d21310 with scrape type 2
2026-03-27 10:47:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e2de161-0c17-555e-b043-9e5ef9d21310, identifier: JV68869
2026-03-27 10:47:22 [auto1.de] INFO: Found listing with ID: NF34057
2026-03-27 10:47:22 [auto1.de] INFO: Found listing with ID: UB65858
2026-03-27 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB65858%27 HTTP/1.1" 200 None
2026-03-27 10:47:22 [auto1.de] INFO: Scrape type for UB65858: 2
2026-03-27 10:47:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 932b5149-bb5d-5fe5-8957-cb4cb7ab3051 with identifier: UB65858
2026-03-27 10:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932b5149-bb5d-5fe5-8957-cb4cb7ab3051 with scrape type 2
2026-03-27 10:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 932b5149-bb5d-5fe5-8957-cb4cb7ab3051 with scrape type 2
2026-03-27 10:47:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 932b5149-bb5d-5fe5-8957-cb4cb7ab3051, identifier: UB65858
2026-03-27 10:47:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e2de161-0c17-555e-b043-9e5ef9d21310 with identifier: JV68869
2026-03-27 10:47:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e2de161-0c17-555e-b043-9e5ef9d21310 with identifier: JV68869
2026-03-27 10:47:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e2de161-0c17-555e-b043-9e5ef9d21310 with identifier: JV68869 to the API
2026-03-27 10:47:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 174,
 'expiration_date': '2026-03-28T16:05:57Z',
 'fuel_type': 'diesel',
 'id': '7e2de161-0c17-555e-b043-9e5ef9d21310',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV68869',
 'listing': 'auction',
 'make': 'Cadillac',
 'model': 'XT4',
 'odometer': 31053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-16',
 'seller_name': None,
 'title': 'Cadillac XT4 350D Launch Edition 2WD',
 'transmission': 'automatic',
 'trim': 'Launch Edition 2WD',
 'year': 2021}
2026-03-27 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68869%27 HTTP/1.1" 200 None
2026-03-27 10:47:22 [auto1.de] INFO: Saving data for JV68869: {'auction_closing_time': 1774713957.0, 'created_time': 1774293852.557589, 'last_price_update_time': 1774608442.566869}
2026-03-27 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV68869') HTTP/1.1" 204 0
2026-03-27 10:47:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 932b5149-bb5d-5fe5-8957-cb4cb7ab3051 with identifier: UB65858
2026-03-27 10:47:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 932b5149-bb5d-5fe5-8957-cb4cb7ab3051 with identifier: UB65858
2026-03-27 10:47:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 932b5149-bb5d-5fe5-8957-cb4cb7ab3051 with identifier: UB65858 to the API
2026-03-27 10:47:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:13:49Z',
 'fuel_type': 'petrol',
 'id': '932b5149-bb5d-5fe5-8957-cb4cb7ab3051',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB65858',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 168406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'GTI BlueMotion Tech',
 'year': 2013}
2026-03-27 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB65858%27 HTTP/1.1" 200 None
2026-03-27 10:47:22 [auto1.de] INFO: Saving data for UB65858: {'auction_closing_time': 1774714429.0, 'created_time': 1773303320.417177, 'last_price_update_time': 1774608442.933088}
2026-03-27 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB65858') HTTP/1.1" 204 0
2026-03-27 10:47:22 [auto1.de] INFO: Found listing with ID: SB93381
2026-03-27 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB93381%27 HTTP/1.1" 200 None
2026-03-27 10:47:22 [auto1.de] INFO: Scrape type for SB93381: 2
2026-03-27 10:47:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9925289e-67ef-51a3-84d2-bb86a3f5093c with identifier: SB93381
2026-03-27 10:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9925289e-67ef-51a3-84d2-bb86a3f5093c with scrape type 2
2026-03-27 10:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9925289e-67ef-51a3-84d2-bb86a3f5093c with scrape type 2
2026-03-27 10:47:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9925289e-67ef-51a3-84d2-bb86a3f5093c, identifier: SB93381
2026-03-27 10:47:23 [auto1.de] INFO: Found listing with ID: AW17852
2026-03-27 10:47:23 [auto1.de] INFO: Found listing with ID: WU91677
2026-03-27 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU91677%27 HTTP/1.1" 200 None
2026-03-27 10:47:23 [auto1.de] INFO: Scrape type for WU91677: 2
2026-03-27 10:47:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 458562e3-27f6-52aa-9eaf-998992f036b9 with identifier: WU91677
2026-03-27 10:47:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 458562e3-27f6-52aa-9eaf-998992f036b9 with scrape type 2
2026-03-27 10:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 458562e3-27f6-52aa-9eaf-998992f036b9 with scrape type 2
2026-03-27 10:47:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 458562e3-27f6-52aa-9eaf-998992f036b9, identifier: WU91677
2026-03-27 10:47:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9925289e-67ef-51a3-84d2-bb86a3f5093c with identifier: SB93381
2026-03-27 10:47:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9925289e-67ef-51a3-84d2-bb86a3f5093c with identifier: SB93381
2026-03-27 10:47:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9925289e-67ef-51a3-84d2-bb86a3f5093c with identifier: SB93381 to the API
2026-03-27 10:47:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:23:19Z',
 'fuel_type': 'diesel',
 'id': '9925289e-67ef-51a3-84d2-bb86a3f5093c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB93381',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 488170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-18',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2010}
2026-03-27 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB93381%27 HTTP/1.1" 200 None
2026-03-27 10:47:23 [auto1.de] INFO: Saving data for SB93381: {'auction_closing_time': 1774714999.0, 'created_time': 1773659355.284287, 'last_price_update_time': 1774608443.522658}
2026-03-27 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB93381') HTTP/1.1" 204 0
2026-03-27 10:47:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 458562e3-27f6-52aa-9eaf-998992f036b9 with identifier: WU91677
2026-03-27 10:47:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 458562e3-27f6-52aa-9eaf-998992f036b9 with identifier: WU91677
2026-03-27 10:47:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 458562e3-27f6-52aa-9eaf-998992f036b9 with identifier: WU91677 to the API
2026-03-27 10:47:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:09:07Z',
 'fuel_type': 'diesel',
 'id': '458562e3-27f6-52aa-9eaf-998992f036b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU91677',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 191761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-29',
 'seller_name': None,
 'title': 'Nissan X-Trail 2.0 dCi LE 4x4',
 'transmission': 'manual',
 'trim': 'LE 4x4',
 'year': 2014}
2026-03-27 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU91677%27 HTTP/1.1" 200 None
2026-03-27 10:47:23 [auto1.de] INFO: Saving data for WU91677: {'auction_closing_time': 1774714147.0, 'created_time': 1773307687.957752, 'last_price_update_time': 1774608443.858073}
2026-03-27 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WU91677') HTTP/1.1" 204 0
2026-03-27 10:47:23 [auto1.de] INFO: Found listing with ID: KY06770
2026-03-27 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY06770%27 HTTP/1.1" 200 None
2026-03-27 10:47:23 [auto1.de] INFO: Scrape type for KY06770: 2
2026-03-27 10:47:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35a331a9-dbf4-553e-9de9-e36818d279e2 with identifier: KY06770
2026-03-27 10:47:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35a331a9-dbf4-553e-9de9-e36818d279e2 with scrape type 2
2026-03-27 10:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35a331a9-dbf4-553e-9de9-e36818d279e2 with scrape type 2
2026-03-27 10:47:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 35a331a9-dbf4-553e-9de9-e36818d279e2, identifier: KY06770
2026-03-27 10:47:23 [auto1.de] INFO: Found listing with ID: BM76815
2026-03-27 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM76815%27 HTTP/1.1" 200 None
2026-03-27 10:47:24 [auto1.de] INFO: Scrape type for BM76815: 2
2026-03-27 10:47:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e186861a-a067-5e46-8066-0a3c3b6c158d with identifier: BM76815
2026-03-27 10:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e186861a-a067-5e46-8066-0a3c3b6c158d with scrape type 2
2026-03-27 10:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e186861a-a067-5e46-8066-0a3c3b6c158d with scrape type 2
2026-03-27 10:47:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e186861a-a067-5e46-8066-0a3c3b6c158d, identifier: BM76815
2026-03-27 10:47:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 35a331a9-dbf4-553e-9de9-e36818d279e2 with identifier: KY06770
2026-03-27 10:47:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 35a331a9-dbf4-553e-9de9-e36818d279e2 with identifier: KY06770
2026-03-27 10:47:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 35a331a9-dbf4-553e-9de9-e36818d279e2 with identifier: KY06770 to the API
2026-03-27 10:47:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-28T16:05:48Z',
 'fuel_type': 'diesel',
 'id': '35a331a9-dbf4-553e-9de9-e36818d279e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY06770',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 86624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-28',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2019}
2026-03-27 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY06770%27 HTTP/1.1" 200 None
2026-03-27 10:47:24 [auto1.de] INFO: Saving data for KY06770: {'auction_closing_time': 1774713948.0, 'created_time': 1774265070.092529, 'last_price_update_time': 1774608444.421919}
2026-03-27 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY06770') HTTP/1.1" 204 0
2026-03-27 10:47:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:47:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e186861a-a067-5e46-8066-0a3c3b6c158d with identifier: BM76815
2026-03-27 10:47:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e186861a-a067-5e46-8066-0a3c3b6c158d with identifier: BM76815
2026-03-27 10:47:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e186861a-a067-5e46-8066-0a3c3b6c158d with identifier: BM76815 to the API
2026-03-27 10:47:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:39:39Z',
 'fuel_type': 'diesel',
 'id': 'e186861a-a067-5e46-8066-0a3c3b6c158d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM76815',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 227357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-26',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-27 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM76815%27 HTTP/1.1" 200 None
2026-03-27 10:47:24 [auto1.de] INFO: Saving data for BM76815: {'auction_closing_time': 1774715979.0, 'created_time': 1773860126.575271, 'last_price_update_time': 1774608444.864771}
2026-03-27 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM76815') HTTP/1.1" 204 0
2026-03-27 10:47:24 [auto1.de] INFO: Found listing with ID: PL48246
2026-03-27 10:47:24 [auto1.de] INFO: Found listing with ID: FS76993
2026-03-27 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS76993%27 HTTP/1.1" 200 None
2026-03-27 10:47:24 [auto1.de] INFO: Scrape type for FS76993: 2
2026-03-27 10:47:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23d532b8-0c6e-5906-a5cb-993b1fc60640 with identifier: FS76993
2026-03-27 10:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23d532b8-0c6e-5906-a5cb-993b1fc60640 with scrape type 2
2026-03-27 10:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23d532b8-0c6e-5906-a5cb-993b1fc60640 with scrape type 2
2026-03-27 10:47:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23d532b8-0c6e-5906-a5cb-993b1fc60640, identifier: FS76993
2026-03-27 10:47:25 [auto1.de] INFO: Found listing with ID: ZN72039
2026-03-27 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN72039%27 HTTP/1.1" 200 None
2026-03-27 10:47:25 [auto1.de] INFO: Scrape type for ZN72039: 2
2026-03-27 10:47:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ee9e216-363a-52e9-a4cf-dae96a837a26 with identifier: ZN72039
2026-03-27 10:47:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ee9e216-363a-52e9-a4cf-dae96a837a26 with scrape type 2
2026-03-27 10:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ee9e216-363a-52e9-a4cf-dae96a837a26 with scrape type 2
2026-03-27 10:47:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ee9e216-363a-52e9-a4cf-dae96a837a26, identifier: ZN72039
2026-03-27 10:47:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23d532b8-0c6e-5906-a5cb-993b1fc60640 with identifier: FS76993
2026-03-27 10:47:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23d532b8-0c6e-5906-a5cb-993b1fc60640 with identifier: FS76993
2026-03-27 10:47:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23d532b8-0c6e-5906-a5cb-993b1fc60640 with identifier: FS76993 to the API
2026-03-27 10:47:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:23:01Z',
 'fuel_type': 'petrol',
 'id': '23d532b8-0c6e-5906-a5cb-993b1fc60640',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS76993',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 193868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-19',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Match BlueMotion',
 'transmission': 'manual',
 'trim': 'Match BlueMotion',
 'year': 2012}
2026-03-27 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS76993%27 HTTP/1.1" 200 None
2026-03-27 10:47:25 [auto1.de] INFO: Saving data for FS76993: {'auction_closing_time': 1774714981.0, 'created_time': 1773775079.926346, 'last_price_update_time': 1774608445.461706}
2026-03-27 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS76993') HTTP/1.1" 204 0
2026-03-27 10:47:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ee9e216-363a-52e9-a4cf-dae96a837a26 with identifier: ZN72039
2026-03-27 10:47:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ee9e216-363a-52e9-a4cf-dae96a837a26 with identifier: ZN72039
2026-03-27 10:47:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ee9e216-363a-52e9-a4cf-dae96a837a26 with identifier: ZN72039 to the API
2026-03-27 10:47:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 394,
 'expiration_date': '2026-03-28T16:33:32Z',
 'fuel_type': 'hybrid',
 'id': '3ee9e216-363a-52e9-a4cf-dae96a837a26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN72039',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 94022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-06',
 'seller_name': None,
 'title': 'BMW 5er 545e xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2021}
2026-03-27 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN72039%27 HTTP/1.1" 200 None
2026-03-27 10:47:25 [auto1.de] INFO: Saving data for ZN72039: {'auction_closing_time': 1774715612.0, 'created_time': 1773307898.885622, 'last_price_update_time': 1774608445.804587}
2026-03-27 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN72039') HTTP/1.1" 204 0
2026-03-27 10:47:25 [auto1.de] INFO: Found listing with ID: LC91854
2026-03-27 10:47:25 [auto1.de] INFO: Found listing with ID: ZF67159
2026-03-27 10:47:25 [auto1.de] INFO: Found listing with ID: LK50983
2026-03-27 10:47:25 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-27 10:47:25 [auto1.de] INFO: Found listing with ID: EF84485
2026-03-27 10:47:25 [auto1.de] INFO: Found listing with ID: JN93492
2026-03-27 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN93492%27 HTTP/1.1" 200 None
2026-03-27 10:47:25 [auto1.de] INFO: Scrape type for JN93492: 2
2026-03-27 10:47:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87992e54-b8ab-516c-b637-17cf4457785d with identifier: JN93492
2026-03-27 10:47:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87992e54-b8ab-516c-b637-17cf4457785d with scrape type 2
2026-03-27 10:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87992e54-b8ab-516c-b637-17cf4457785d with scrape type 2
2026-03-27 10:47:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87992e54-b8ab-516c-b637-17cf4457785d, identifier: JN93492
2026-03-27 10:47:25 [auto1.de] INFO: Found listing with ID: YS21206
2026-03-27 10:47:25 [auto1.de] INFO: Found listing with ID: ZY07029
2026-03-27 10:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY07029%27 HTTP/1.1" 200 None
2026-03-27 10:47:26 [auto1.de] INFO: Scrape type for ZY07029: 2
2026-03-27 10:47:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d077a248-a8f1-5071-81c9-68e9f53a0bb6 with identifier: ZY07029
2026-03-27 10:47:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d077a248-a8f1-5071-81c9-68e9f53a0bb6 with scrape type 2
2026-03-27 10:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d077a248-a8f1-5071-81c9-68e9f53a0bb6 with scrape type 2
2026-03-27 10:47:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d077a248-a8f1-5071-81c9-68e9f53a0bb6, identifier: ZY07029
2026-03-27 10:47:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87992e54-b8ab-516c-b637-17cf4457785d with identifier: JN93492
2026-03-27 10:47:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87992e54-b8ab-516c-b637-17cf4457785d with identifier: JN93492
2026-03-27 10:47:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87992e54-b8ab-516c-b637-17cf4457785d with identifier: JN93492 to the API
2026-03-27 10:47:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:59:07Z',
 'fuel_type': 'petrol',
 'id': '87992e54-b8ab-516c-b637-17cf4457785d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN93492',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 136744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-25',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Edition 7 2WD',
 'transmission': 'manual',
 'trim': 'Edition 7 2WD',
 'year': 2015}
2026-03-27 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN93492%27 HTTP/1.1" 200 None
2026-03-27 10:47:26 [auto1.de] INFO: Saving data for JN93492: {'auction_closing_time': 1774717147.0, 'created_time': 1774263097.869643, 'last_price_update_time': 1774608446.505375}
2026-03-27 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN93492') HTTP/1.1" 204 0
2026-03-27 10:47:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d077a248-a8f1-5071-81c9-68e9f53a0bb6 with identifier: ZY07029
2026-03-27 10:47:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d077a248-a8f1-5071-81c9-68e9f53a0bb6 with identifier: ZY07029
2026-03-27 10:47:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d077a248-a8f1-5071-81c9-68e9f53a0bb6 with identifier: ZY07029 to the API
2026-03-27 10:47:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 360,
 'expiration_date': '2026-03-28T16:35:56Z',
 'fuel_type': 'petrol',
 'id': 'd077a248-a8f1-5071-81c9-68e9f53a0bb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY07029',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 94990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-13',
 'seller_name': None,
 'title': 'Porsche Macan GTS',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-27 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY07029%27 HTTP/1.1" 200 None
2026-03-27 10:47:26 [auto1.de] INFO: Saving data for ZY07029: {'auction_closing_time': 1774715756.0, 'created_time': 1773819347.510762, 'last_price_update_time': 1774608446.947776}
2026-03-27 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY07029') HTTP/1.1" 204 0
2026-03-27 10:47:26 [auto1.de] INFO: Found listing with ID: CD81555
2026-03-27 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD81555%27 HTTP/1.1" 200 None
2026-03-27 10:47:26 [auto1.de] INFO: Scrape type for CD81555: 2
2026-03-27 10:47:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 953a0633-1769-5717-8fec-b8892482a997 with identifier: CD81555
2026-03-27 10:47:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 953a0633-1769-5717-8fec-b8892482a997 with scrape type 2
2026-03-27 10:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 953a0633-1769-5717-8fec-b8892482a997 with scrape type 2
2026-03-27 10:47:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 953a0633-1769-5717-8fec-b8892482a997, identifier: CD81555
2026-03-27 10:47:27 [auto1.de] INFO: Found listing with ID: WF94997
2026-03-27 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF94997%27 HTTP/1.1" 200 None
2026-03-27 10:47:27 [auto1.de] INFO: Scrape type for WF94997: 2
2026-03-27 10:47:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73659620-789d-5430-ac35-bd3f82392bfb with identifier: WF94997
2026-03-27 10:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73659620-789d-5430-ac35-bd3f82392bfb with scrape type 2
2026-03-27 10:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73659620-789d-5430-ac35-bd3f82392bfb with scrape type 2
2026-03-27 10:47:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73659620-789d-5430-ac35-bd3f82392bfb, identifier: WF94997
2026-03-27 10:47:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 953a0633-1769-5717-8fec-b8892482a997 with identifier: CD81555
2026-03-27 10:47:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 953a0633-1769-5717-8fec-b8892482a997 with identifier: CD81555
2026-03-27 10:47:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 953a0633-1769-5717-8fec-b8892482a997 with identifier: CD81555 to the API
2026-03-27 10:47:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 238,
 'expiration_date': '2026-03-28T16:07:39Z',
 'fuel_type': 'diesel',
 'id': '953a0633-1769-5717-8fec-b8892482a997',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD81555',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Edge',
 'odometer': 94289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-02',
 'seller_name': None,
 'title': 'Ford Edge 2.0 TDCi EcoBlue ST-Line 4x4',
 'transmission': 'automatic',
 'trim': 'ST-Line 4x4',
 'year': 2019}
2026-03-27 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD81555%27 HTTP/1.1" 200 None
2026-03-27 10:47:27 [auto1.de] INFO: Saving data for CD81555: {'auction_closing_time': 1774714059.0, 'created_time': 1774293613.284069, 'last_price_update_time': 1774608447.513402}
2026-03-27 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD81555') HTTP/1.1" 204 0
2026-03-27 10:47:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73659620-789d-5430-ac35-bd3f82392bfb with identifier: WF94997
2026-03-27 10:47:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73659620-789d-5430-ac35-bd3f82392bfb with identifier: WF94997
2026-03-27 10:47:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73659620-789d-5430-ac35-bd3f82392bfb with identifier: WF94997 to the API
2026-03-27 10:47:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:13:22Z',
 'fuel_type': 'petrol',
 'id': '73659620-789d-5430-ac35-bd3f82392bfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF94997',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 221038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI ACT Join',
 'transmission': 'automatic',
 'trim': 'Join',
 'year': 2018}
2026-03-27 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF94997%27 HTTP/1.1" 200 None
2026-03-27 10:47:27 [auto1.de] INFO: Saving data for WF94997: {'auction_closing_time': 1774714402.0, 'created_time': 1773307720.280905, 'last_price_update_time': 1774608447.870165}
2026-03-27 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF94997') HTTP/1.1" 204 0
2026-03-27 10:47:27 [auto1.de] INFO: Found listing with ID: HR27692
2026-03-27 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR27692%27 HTTP/1.1" 200 None
2026-03-27 10:47:27 [auto1.de] INFO: Scrape type for HR27692: 2
2026-03-27 10:47:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe34305e-32dd-5705-aee0-73c52ad7fd9d with identifier: HR27692
2026-03-27 10:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe34305e-32dd-5705-aee0-73c52ad7fd9d with scrape type 2
2026-03-27 10:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe34305e-32dd-5705-aee0-73c52ad7fd9d with scrape type 2
2026-03-27 10:47:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe34305e-32dd-5705-aee0-73c52ad7fd9d, identifier: HR27692
2026-03-27 10:47:28 [auto1.de] INFO: Found listing with ID: BU23510
2026-03-27 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU23510%27 HTTP/1.1" 200 None
2026-03-27 10:47:28 [auto1.de] INFO: Scrape type for BU23510: 2
2026-03-27 10:47:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13d5bf30-0db6-5a11-bfe6-d6afa666a633 with identifier: BU23510
2026-03-27 10:47:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13d5bf30-0db6-5a11-bfe6-d6afa666a633 with scrape type 2
2026-03-27 10:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13d5bf30-0db6-5a11-bfe6-d6afa666a633 with scrape type 2
2026-03-27 10:47:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13d5bf30-0db6-5a11-bfe6-d6afa666a633, identifier: BU23510
2026-03-27 10:47:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe34305e-32dd-5705-aee0-73c52ad7fd9d with identifier: HR27692
2026-03-27 10:47:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe34305e-32dd-5705-aee0-73c52ad7fd9d with identifier: HR27692
2026-03-27 10:47:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe34305e-32dd-5705-aee0-73c52ad7fd9d with identifier: HR27692 to the API
2026-03-27 10:47:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:33:45Z',
 'fuel_type': 'petrol',
 'id': 'fe34305e-32dd-5705-aee0-73c52ad7fd9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR27692',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 155016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-12',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-27 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR27692%27 HTTP/1.1" 200 None
2026-03-27 10:47:28 [auto1.de] INFO: Saving data for HR27692: {'auction_closing_time': 1774715625.0, 'created_time': 1773383253.046544, 'last_price_update_time': 1774608448.447106}
2026-03-27 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR27692') HTTP/1.1" 204 0
2026-03-27 10:47:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13d5bf30-0db6-5a11-bfe6-d6afa666a633 with identifier: BU23510
2026-03-27 10:47:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13d5bf30-0db6-5a11-bfe6-d6afa666a633 with identifier: BU23510
2026-03-27 10:47:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13d5bf30-0db6-5a11-bfe6-d6afa666a633 with identifier: BU23510 to the API
2026-03-27 10:47:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-28T16:56:19Z',
 'fuel_type': 'petrol',
 'id': '13d5bf30-0db6-5a11-bfe6-d6afa666a633',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU23510',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 117986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-15',
 'seller_name': None,
 'title': 'Opel Adam 1.4 Jam',
 'transmission': 'manual',
 'trim': 'Jam',
 'year': 2014}
2026-03-27 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU23510%27 HTTP/1.1" 200 None
2026-03-27 10:47:28 [auto1.de] INFO: Saving data for BU23510: {'auction_closing_time': 1774716979.0, 'created_time': 1773743756.13656, 'last_price_update_time': 1774608448.824924}
2026-03-27 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU23510') HTTP/1.1" 204 0
2026-03-27 10:47:28 [auto1.de] INFO: Found listing with ID: VW42745
2026-03-27 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW42745%27 HTTP/1.1" 200 None
2026-03-27 10:47:28 [auto1.de] INFO: Scrape type for VW42745: 2
2026-03-27 10:47:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd9697cc-688a-521b-a151-50100d46ec6b with identifier: VW42745
2026-03-27 10:47:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd9697cc-688a-521b-a151-50100d46ec6b with scrape type 2
2026-03-27 10:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd9697cc-688a-521b-a151-50100d46ec6b with scrape type 2
2026-03-27 10:47:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd9697cc-688a-521b-a151-50100d46ec6b, identifier: VW42745
2026-03-27 10:47:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd9697cc-688a-521b-a151-50100d46ec6b with identifier: VW42745
2026-03-27 10:47:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd9697cc-688a-521b-a151-50100d46ec6b with identifier: VW42745
2026-03-27 10:47:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd9697cc-688a-521b-a151-50100d46ec6b with identifier: VW42745 to the API
2026-03-27 10:47:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:56:16Z',
 'fuel_type': 'diesel',
 'id': 'fd9697cc-688a-521b-a151-50100d46ec6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW42745',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 256460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-02',
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI S line Sportpaket plus',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket plus',
 'year': 2014}
2026-03-27 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW42745%27 HTTP/1.1" 200 None
2026-03-27 10:47:30 [auto1.de] INFO: Saving data for VW42745: {'auction_closing_time': 1774716976.0, 'created_time': 1773305991.729086, 'last_price_update_time': 1774608450.353181}
2026-03-27 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW42745') HTTP/1.1" 204 0
2026-03-27 10:47:30 [auto1.de] INFO: Found listing with ID: TZ19731
2026-03-27 10:47:30 [auto1.de] INFO: Found listing with ID: SP58738
2026-03-27 10:47:30 [auto1.de] INFO: Found listing with ID: SW77788
2026-03-27 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW77788%27 HTTP/1.1" 200 None
2026-03-27 10:47:30 [auto1.de] INFO: Scrape type for SW77788: 2
2026-03-27 10:47:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eab29c30-b714-5e56-9f83-942f66d0503f with identifier: SW77788
2026-03-27 10:47:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eab29c30-b714-5e56-9f83-942f66d0503f with scrape type 2
2026-03-27 10:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eab29c30-b714-5e56-9f83-942f66d0503f with scrape type 2
2026-03-27 10:47:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eab29c30-b714-5e56-9f83-942f66d0503f, identifier: SW77788
2026-03-27 10:47:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eab29c30-b714-5e56-9f83-942f66d0503f with identifier: SW77788
2026-03-27 10:47:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eab29c30-b714-5e56-9f83-942f66d0503f with identifier: SW77788
2026-03-27 10:47:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eab29c30-b714-5e56-9f83-942f66d0503f with identifier: SW77788 to the API
2026-03-27 10:47:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:29:58Z',
 'fuel_type': 'diesel',
 'id': 'eab29c30-b714-5e56-9f83-942f66d0503f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW77788',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 268536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-31',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-27 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW77788%27 HTTP/1.1" 200 None
2026-03-27 10:47:30 [auto1.de] INFO: Saving data for SW77788: {'auction_closing_time': 1774715398.0, 'created_time': 1774292264.939093, 'last_price_update_time': 1774608450.795014}
2026-03-27 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW77788') HTTP/1.1" 204 0
2026-03-27 10:47:30 [auto1.de] INFO: Found listing with ID: KG12536
2026-03-27 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG12536%27 HTTP/1.1" 200 None
2026-03-27 10:47:30 [auto1.de] INFO: Scrape type for KG12536: 2
2026-03-27 10:47:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c05c1b57-e540-5855-8256-e1d569276788 with identifier: KG12536
2026-03-27 10:47:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c05c1b57-e540-5855-8256-e1d569276788 with scrape type 2
2026-03-27 10:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c05c1b57-e540-5855-8256-e1d569276788 with scrape type 2
2026-03-27 10:47:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c05c1b57-e540-5855-8256-e1d569276788, identifier: KG12536
2026-03-27 10:47:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c05c1b57-e540-5855-8256-e1d569276788 with identifier: KG12536
2026-03-27 10:47:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c05c1b57-e540-5855-8256-e1d569276788 with identifier: KG12536
2026-03-27 10:47:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c05c1b57-e540-5855-8256-e1d569276788 with identifier: KG12536 to the API
2026-03-27 10:47:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:09:23Z',
 'fuel_type': 'diesel',
 'id': 'c05c1b57-e540-5855-8256-e1d569276788',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG12536',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 233115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-27',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Maxi Comfortline',
 'transmission': 'automatic',
 'trim': 'Maxi Comfortline',
 'year': 2013}
2026-03-27 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG12536%27 HTTP/1.1" 200 None
2026-03-27 10:47:31 [auto1.de] INFO: Saving data for KG12536: {'auction_closing_time': 1774714163.0, 'created_time': 1773831739.05196, 'last_price_update_time': 1774608451.52016}
2026-03-27 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG12536') HTTP/1.1" 204 0
2026-03-27 10:47:31 [auto1.de] INFO: Found listing with ID: VW82123
2026-03-27 10:47:31 [auto1.de] INFO: Found listing with ID: UH14154
2026-03-27 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH14154%27 HTTP/1.1" 200 None
2026-03-27 10:47:31 [auto1.de] INFO: Scrape type for UH14154: 2
2026-03-27 10:47:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28da6de1-f323-539f-9b1f-4f6a5cd5bfe1 with identifier: UH14154
2026-03-27 10:47:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28da6de1-f323-539f-9b1f-4f6a5cd5bfe1 with scrape type 2
2026-03-27 10:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28da6de1-f323-539f-9b1f-4f6a5cd5bfe1 with scrape type 2
2026-03-27 10:47:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28da6de1-f323-539f-9b1f-4f6a5cd5bfe1, identifier: UH14154
2026-03-27 10:47:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28da6de1-f323-539f-9b1f-4f6a5cd5bfe1 with identifier: UH14154
2026-03-27 10:47:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28da6de1-f323-539f-9b1f-4f6a5cd5bfe1 with identifier: UH14154
2026-03-27 10:47:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28da6de1-f323-539f-9b1f-4f6a5cd5bfe1 with identifier: UH14154 to the API
2026-03-27 10:47:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:17:24Z',
 'fuel_type': 'diesel',
 'id': '28da6de1-f323-539f-9b1f-4f6a5cd5bfe1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH14154',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 330018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-31',
 'seller_name': None,
 'title': 'Opel Zafira 1.7 CDTI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2012}
2026-03-27 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH14154%27 HTTP/1.1" 200 None
2026-03-27 10:47:32 [auto1.de] INFO: Saving data for UH14154: {'auction_closing_time': 1774714644.0, 'created_time': 1774291482.065451, 'last_price_update_time': 1774608452.031138}
2026-03-27 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH14154') HTTP/1.1" 204 0
2026-03-27 10:47:32 [auto1.de] INFO: Found listing with ID: XZ46710
2026-03-27 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ46710%27 HTTP/1.1" 200 None
2026-03-27 10:47:32 [auto1.de] INFO: Scrape type for XZ46710: 2
2026-03-27 10:47:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86ca72a1-cfb2-599e-8fe4-7e4ed134f053 with identifier: XZ46710
2026-03-27 10:47:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86ca72a1-cfb2-599e-8fe4-7e4ed134f053 with scrape type 2
2026-03-27 10:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86ca72a1-cfb2-599e-8fe4-7e4ed134f053 with scrape type 2
2026-03-27 10:47:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86ca72a1-cfb2-599e-8fe4-7e4ed134f053, identifier: XZ46710
2026-03-27 10:47:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86ca72a1-cfb2-599e-8fe4-7e4ed134f053 with identifier: XZ46710
2026-03-27 10:47:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86ca72a1-cfb2-599e-8fe4-7e4ed134f053 with identifier: XZ46710
2026-03-27 10:47:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86ca72a1-cfb2-599e-8fe4-7e4ed134f053 with identifier: XZ46710 to the API
2026-03-27 10:47:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:57:50Z',
 'fuel_type': 'petrol',
 'id': '86ca72a1-cfb2-599e-8fe4-7e4ed134f053',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ46710',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Captiva',
 'odometer': 142565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-07',
 'seller_name': None,
 'title': 'Chevrolet Captiva 2.4 LS 2WD',
 'transmission': 'manual',
 'trim': 'LS 2WD',
 'year': 2010}
2026-03-27 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ46710%27 HTTP/1.1" 200 None
2026-03-27 10:47:32 [auto1.de] INFO: Saving data for XZ46710: {'auction_closing_time': 1774717070.0, 'created_time': 1773304326.026895, 'last_price_update_time': 1774608452.544063}
2026-03-27 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ46710') HTTP/1.1" 204 0
2026-03-27 10:47:32 [auto1.de] INFO: Found listing with ID: VE70317
2026-03-27 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE70317%27 HTTP/1.1" 200 None
2026-03-27 10:47:32 [auto1.de] INFO: Scrape type for VE70317: 2
2026-03-27 10:47:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 002e40f6-1d77-52ee-9d5c-990cb80dcea0 with identifier: VE70317
2026-03-27 10:47:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 002e40f6-1d77-52ee-9d5c-990cb80dcea0 with scrape type 2
2026-03-27 10:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 002e40f6-1d77-52ee-9d5c-990cb80dcea0 with scrape type 2
2026-03-27 10:47:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 002e40f6-1d77-52ee-9d5c-990cb80dcea0, identifier: VE70317
2026-03-27 10:47:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 002e40f6-1d77-52ee-9d5c-990cb80dcea0 with identifier: VE70317
2026-03-27 10:47:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 002e40f6-1d77-52ee-9d5c-990cb80dcea0 with identifier: VE70317
2026-03-27 10:47:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 002e40f6-1d77-52ee-9d5c-990cb80dcea0 with identifier: VE70317 to the API
2026-03-27 10:47:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:28:09Z',
 'fuel_type': 'diesel',
 'id': '002e40f6-1d77-52ee-9d5c-990cb80dcea0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE70317',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 214769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-14',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2015}
2026-03-27 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE70317%27 HTTP/1.1" 200 None
2026-03-27 10:47:32 [auto1.de] INFO: Saving data for VE70317: {'auction_closing_time': 1774715289.0, 'created_time': 1774263237.745154, 'last_price_update_time': 1774608452.988796}
2026-03-27 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE70317') HTTP/1.1" 204 0
2026-03-27 10:47:33 [auto1.de] INFO: Found listing with ID: XZ35475
2026-03-27 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ35475%27 HTTP/1.1" 200 None
2026-03-27 10:47:33 [auto1.de] INFO: Scrape type for XZ35475: 2
2026-03-27 10:47:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b03ad88f-08f3-552b-a128-229003eeefb7 with identifier: XZ35475
2026-03-27 10:47:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b03ad88f-08f3-552b-a128-229003eeefb7 with scrape type 2
2026-03-27 10:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b03ad88f-08f3-552b-a128-229003eeefb7 with scrape type 2
2026-03-27 10:47:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b03ad88f-08f3-552b-a128-229003eeefb7, identifier: XZ35475
2026-03-27 10:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JP08522/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:47:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b03ad88f-08f3-552b-a128-229003eeefb7 with identifier: XZ35475
2026-03-27 10:47:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b03ad88f-08f3-552b-a128-229003eeefb7 with identifier: XZ35475
2026-03-27 10:47:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b03ad88f-08f3-552b-a128-229003eeefb7 with identifier: XZ35475 to the API
2026-03-27 10:47:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:47:04Z',
 'fuel_type': 'diesel',
 'id': 'b03ad88f-08f3-552b-a128-229003eeefb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ35475',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 279155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-10',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.5 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2006}
2026-03-27 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ35475%27 HTTP/1.1" 200 None
2026-03-27 10:47:33 [auto1.de] INFO: Saving data for XZ35475: {'auction_closing_time': 1774716424.0, 'created_time': 1773858921.766989, 'last_price_update_time': 1774608453.435232}
2026-03-27 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ35475') HTTP/1.1" 204 0
2026-03-27 10:47:33 [auto1.de] INFO: Found listing with ID: RP50374
2026-03-27 10:47:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EJ47665> (referer: https://www.auto1.com/v1/car-details-view/EJ47665/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:47:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8602143-0418-52e3-871e-5f5ebbfae78c with identifier: EJ47665
2026-03-27 10:47:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8602143-0418-52e3-871e-5f5ebbfae78c with scrape type 1
2026-03-27 10:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8602143-0418-52e3-871e-5f5ebbfae78c
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F92%252F6a9290cefa471fb049e182aca89dacc5%252Fpa%252FEJ47665_d5b1b77424f7c84384f9a087a224eb5a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_d5b1b77424f7c84384f9a087a224eb5a.jpg already downloaded
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F92%252F6a9290cefa471fb049e182aca89dacc5%252Fpa%252FEJ47665_22c2f649301b862a6a72d73c7e92ecee.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_22c2f649301b862a6a72d73c7e92ecee.jpg already downloaded
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F92%252F6a9290cefa471fb049e182aca89dacc5%252Fpa%252FEJ47665_4280a20fc783fb35a76c6e05389d561e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_4280a20fc783fb35a76c6e05389d561e.jpg already downloaded
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F92%252F6a9290cefa471fb049e182aca89dacc5%252Fpa%252FEJ47665_1b2c2d21d33b4ba94cb05b2fdff64f4c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_1b2c2d21d33b4ba94cb05b2fdff64f4c.jpg already downloaded
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F92%252F6a9290cefa471fb049e182aca89dacc5%252Fpa%252FEJ47665_8eb5d972e03fc3eaab0e8ce555daaaf0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_8eb5d972e03fc3eaab0e8ce555daaaf0.jpg already downloaded
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F92%252F6a9290cefa471fb049e182aca89dacc5%252Fpa%252FEJ47665_52d3e3296cb71e3b1b41fdd0905d8777.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_52d3e3296cb71e3b1b41fdd0905d8777.jpg already downloaded
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F92%252F6a9290cefa471fb049e182aca89dacc5%252Fpa%252FEJ47665_ccf0d45380ef4b01dc950d24c7647b9a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_ccf0d45380ef4b01dc950d24c7647b9a.jpg already downloaded
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F92%252F6a9290cefa471fb049e182aca89dacc5%252Fpa%252FEJ47665_a2c9bc33028e50530cd4b362c359d14e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_a2c9bc33028e50530cd4b362c359d14e.jpg already downloaded
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F92%252F6a9290cefa471fb049e182aca89dacc5%252Fpa%252FEJ47665_3d4845571a03d5f66e29800a51ae60fe.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_3d4845571a03d5f66e29800a51ae60fe.jpg already downloaded
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F92%252F6a9290cefa471fb049e182aca89dacc5%252Fpa%252FEJ47665_7211b43e6a6ed0d5a13fa899b235b124.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_7211b43e6a6ed0d5a13fa899b235b124.jpg already downloaded
2026-03-27 10:47:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8602143-0418-52e3-871e-5f5ebbfae78c, identifier: EJ47665
2026-03-27 10:47:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8602143-0418-52e3-871e-5f5ebbfae78c with identifier: EJ47665
2026-03-27 10:47:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8602143-0418-52e3-871e-5f5ebbfae78c with identifier: EJ47665
2026-03-27 10:47:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8602143-0418-52e3-871e-5f5ebbfae78c with identifier: EJ47665 to the API
2026-03-27 10:47:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EJ47665>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:00:48Z',
 'fuel_type': 'diesel',
 'id': 'd8602143-0418-52e3-871e-5f5ebbfae78c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ47665',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'BMW',
 'model': '7er',
 'odometer': 286365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_d5b1b77424f7c84384f9a087a224eb5a.jpg',
                'https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_22c2f649301b862a6a72d73c7e92ecee.jpg',
                'https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_4280a20fc783fb35a76c6e05389d561e.jpg',
                'https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_1b2c2d21d33b4ba94cb05b2fdff64f4c.jpg',
                'https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_8eb5d972e03fc3eaab0e8ce555daaaf0.jpg',
                'https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_52d3e3296cb71e3b1b41fdd0905d8777.jpg',
                'https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_ccf0d45380ef4b01dc950d24c7647b9a.jpg',
                'https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_a2c9bc33028e50530cd4b362c359d14e.jpg',
                'https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_3d4845571a03d5f66e29800a51ae60fe.jpg',
                'https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_7211b43e6a6ed0d5a13fa899b235b124.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8602143-0418-52e3-871e-5f5ebbfae78c/d8602143-0418-52e3-871e-5f5ebbfae78c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_d5b1b77424f7c84384f9a087a224eb5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8602143-0418-52e3-871e-5f5ebbfae78c/d8602143-0418-52e3-871e-5f5ebbfae78c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_22c2f649301b862a6a72d73c7e92ecee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8602143-0418-52e3-871e-5f5ebbfae78c/d8602143-0418-52e3-871e-5f5ebbfae78c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_4280a20fc783fb35a76c6e05389d561e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8602143-0418-52e3-871e-5f5ebbfae78c/d8602143-0418-52e3-871e-5f5ebbfae78c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_1b2c2d21d33b4ba94cb05b2fdff64f4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8602143-0418-52e3-871e-5f5ebbfae78c/d8602143-0418-52e3-871e-5f5ebbfae78c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_8eb5d972e03fc3eaab0e8ce555daaaf0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8602143-0418-52e3-871e-5f5ebbfae78c/d8602143-0418-52e3-871e-5f5ebbfae78c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_52d3e3296cb71e3b1b41fdd0905d8777.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8602143-0418-52e3-871e-5f5ebbfae78c/d8602143-0418-52e3-871e-5f5ebbfae78c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_ccf0d45380ef4b01dc950d24c7647b9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8602143-0418-52e3-871e-5f5ebbfae78c/d8602143-0418-52e3-871e-5f5ebbfae78c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_a2c9bc33028e50530cd4b362c359d14e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8602143-0418-52e3-871e-5f5ebbfae78c/d8602143-0418-52e3-871e-5f5ebbfae78c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_3d4845571a03d5f66e29800a51ae60fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8602143-0418-52e3-871e-5f5ebbfae78c/d8602143-0418-52e3-871e-5f5ebbfae78c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/92/6a9290cefa471fb049e182aca89dacc5/pa/EJ47665_7211b43e6a6ed0d5a13fa899b235b124.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 7er 730d L xDrive',
 'transmission': 'automatic',
 'trim': 'L xDrive',
 'year': 2018}
2026-03-27 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47665%27 HTTP/1.1" 200 None
2026-03-27 10:47:37 [auto1.de] INFO: Saving data for EJ47665: {'created_time': 1774608457.001777, 'last_price_update_time': 1774608457.001788, 'auction_closing_time': 1774713648.0}
2026-03-27 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ47665') HTTP/1.1" 204 0
2026-03-27 10:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:47:39 [auto1.de] INFO: Channel: 24h | Page: 39 | totalHits: 10554 | hits on page: 40
2026-03-27 10:47:39 [auto1.de] INFO: Found listing with ID: XZ35475
2026-03-27 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ35475%27 HTTP/1.1" 200 None
2026-03-27 10:47:39 [auto1.de] INFO: Scrape type for XZ35475: 0
2026-03-27 10:47:39 [auto1.de] INFO: Found listing with ID: RP50374
2026-03-27 10:47:39 [auto1.de] INFO: Found listing with ID: XD11713
2026-03-27 10:47:39 [auto1.de] INFO: Found listing with ID: TE25882
2026-03-27 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE25882%27 HTTP/1.1" 200 None
2026-03-27 10:47:39 [auto1.de] INFO: Scrape type for TE25882: 2
2026-03-27 10:47:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a58472f-dd8f-5a0c-88f0-5d45a91ba20e with identifier: TE25882
2026-03-27 10:47:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a58472f-dd8f-5a0c-88f0-5d45a91ba20e with scrape type 2
2026-03-27 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a58472f-dd8f-5a0c-88f0-5d45a91ba20e with scrape type 2
2026-03-27 10:47:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a58472f-dd8f-5a0c-88f0-5d45a91ba20e, identifier: TE25882
2026-03-27 10:47:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a58472f-dd8f-5a0c-88f0-5d45a91ba20e with identifier: TE25882
2026-03-27 10:47:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a58472f-dd8f-5a0c-88f0-5d45a91ba20e with identifier: TE25882
2026-03-27 10:47:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a58472f-dd8f-5a0c-88f0-5d45a91ba20e with identifier: TE25882 to the API
2026-03-27 10:47:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:48:20Z',
 'fuel_type': 'petrol',
 'id': '9a58472f-dd8f-5a0c-88f0-5d45a91ba20e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE25882',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 173670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-27 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE25882%27 HTTP/1.1" 200 None
2026-03-27 10:47:39 [auto1.de] INFO: Saving data for TE25882: {'auction_closing_time': 1774716500.0, 'created_time': 1772546331.785917, 'last_price_update_time': 1774608459.837751}
2026-03-27 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE25882') HTTP/1.1" 204 0
2026-03-27 10:47:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:47:39 [auto1.de] INFO: Found listing with ID: MW91304
2026-03-27 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW91304%27 HTTP/1.1" 200 None
2026-03-27 10:47:39 [auto1.de] INFO: Scrape type for MW91304: 2
2026-03-27 10:47:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 131f0396-9ca0-54c4-9b3e-48194e51609a with identifier: MW91304
2026-03-27 10:47:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 131f0396-9ca0-54c4-9b3e-48194e51609a with scrape type 2
2026-03-27 10:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 131f0396-9ca0-54c4-9b3e-48194e51609a with scrape type 2
2026-03-27 10:47:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 131f0396-9ca0-54c4-9b3e-48194e51609a, identifier: MW91304
2026-03-27 10:47:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 131f0396-9ca0-54c4-9b3e-48194e51609a with identifier: MW91304
2026-03-27 10:47:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 131f0396-9ca0-54c4-9b3e-48194e51609a with identifier: MW91304
2026-03-27 10:47:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 131f0396-9ca0-54c4-9b3e-48194e51609a with identifier: MW91304 to the API
2026-03-27 10:47:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:28:23Z',
 'fuel_type': 'petrol',
 'id': '131f0396-9ca0-54c4-9b3e-48194e51609a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW91304',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 188416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-27 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW91304%27 HTTP/1.1" 200 None
2026-03-27 10:47:40 [auto1.de] INFO: Saving data for MW91304: {'auction_closing_time': 1774715303.0, 'created_time': 1773303177.190709, 'last_price_update_time': 1774608460.307535}
2026-03-27 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW91304') HTTP/1.1" 204 0
2026-03-27 10:47:40 [auto1.de] INFO: Found listing with ID: YT60499
2026-03-27 10:47:40 [auto1.de] INFO: Found listing with ID: NV33173
2026-03-27 10:47:40 [auto1.de] INFO: Found listing with ID: WD55568
2026-03-27 10:47:40 [auto1.de] INFO: Found listing with ID: XE26333
2026-03-27 10:47:40 [auto1.de] INFO: Found listing with ID: HS55483
2026-03-27 10:47:40 [auto1.de] INFO: Found listing with ID: JL71783
2026-03-27 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL71783%27 HTTP/1.1" 200 None
2026-03-27 10:47:40 [auto1.de] INFO: Scrape type for JL71783: 2
2026-03-27 10:47:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f with identifier: JL71783
2026-03-27 10:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f with scrape type 2
2026-03-27 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f with scrape type 2
2026-03-27 10:47:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f, identifier: JL71783
2026-03-27 10:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JP08522> (referer: https://www.auto1.com/v1/car-details-view/JP08522/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:47:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f with identifier: JL71783
2026-03-27 10:47:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f with identifier: JL71783
2026-03-27 10:47:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f with identifier: JL71783 to the API
2026-03-27 10:47:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:01:44Z',
 'fuel_type': 'petrol',
 'id': '11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL71783',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 141940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-15',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-03-27 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL71783%27 HTTP/1.1" 200 None
2026-03-27 10:47:40 [auto1.de] INFO: Saving data for JL71783: {'auction_closing_time': 1774713704.0, 'created_time': 1773400722.145193, 'last_price_update_time': 1774608460.753782}
2026-03-27 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL71783') HTTP/1.1" 204 0
2026-03-27 10:47:40 [auto1.de] INFO: Found listing with ID: FZ40219
2026-03-27 10:47:40 [auto1.de] INFO: Found listing with ID: GM47642
2026-03-27 10:47:40 [auto1.de] INFO: Found listing with ID: UG93766
2026-03-27 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG93766%27 HTTP/1.1" 200 None
2026-03-27 10:47:40 [auto1.de] INFO: Scrape type for UG93766: 2
2026-03-27 10:47:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3222c970-a66b-53ff-a91c-54520670399b with identifier: UG93766
2026-03-27 10:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3222c970-a66b-53ff-a91c-54520670399b with scrape type 2
2026-03-27 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3222c970-a66b-53ff-a91c-54520670399b with scrape type 2
2026-03-27 10:47:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3222c970-a66b-53ff-a91c-54520670399b, identifier: UG93766
2026-03-27 10:47:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3222c970-a66b-53ff-a91c-54520670399b with identifier: UG93766
2026-03-27 10:47:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3222c970-a66b-53ff-a91c-54520670399b with identifier: UG93766
2026-03-27 10:47:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3222c970-a66b-53ff-a91c-54520670399b with identifier: UG93766 to the API
2026-03-27 10:47:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:47:45Z',
 'fuel_type': 'diesel',
 'id': '3222c970-a66b-53ff-a91c-54520670399b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG93766',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 274786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-03',
 'seller_name': None,
 'title': 'Hyundai i40 1.7 CRDi FIFA World Cup Edition',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition',
 'year': 2014}
2026-03-27 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG93766%27 HTTP/1.1" 200 None
2026-03-27 10:47:41 [auto1.de] INFO: Saving data for UG93766: {'auction_closing_time': 1774716465.0, 'created_time': 1773307900.243244, 'last_price_update_time': 1774608461.351155}
2026-03-27 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG93766') HTTP/1.1" 204 0
2026-03-27 10:47:41 [auto1.de] INFO: Found listing with ID: FM56481
2026-03-27 10:47:41 [auto1.de] INFO: Found listing with ID: MY83778
2026-03-27 10:47:41 [auto1.de] INFO: Found listing with ID: TL69510
2026-03-27 10:47:41 [auto1.de] INFO: Found listing with ID: RV05301
2026-03-27 10:47:41 [auto1.de] INFO: Found listing with ID: WW79477
2026-03-27 10:47:41 [auto1.de] INFO: Found listing with ID: GG14507
2026-03-27 10:47:41 [auto1.de] INFO: Found listing with ID: VS86742
2026-03-27 10:47:41 [auto1.de] INFO: Found listing with ID: PX08843
2026-03-27 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX08843%27 HTTP/1.1" 200 None
2026-03-27 10:47:41 [auto1.de] INFO: Scrape type for PX08843: 2
2026-03-27 10:47:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b2d2639-29b2-5fcf-866b-4b898fdbe17d with identifier: PX08843
2026-03-27 10:47:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b2d2639-29b2-5fcf-866b-4b898fdbe17d with scrape type 2
2026-03-27 10:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b2d2639-29b2-5fcf-866b-4b898fdbe17d with scrape type 2
2026-03-27 10:47:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b2d2639-29b2-5fcf-866b-4b898fdbe17d, identifier: PX08843
2026-03-27 10:47:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b2d2639-29b2-5fcf-866b-4b898fdbe17d with identifier: PX08843
2026-03-27 10:47:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b2d2639-29b2-5fcf-866b-4b898fdbe17d with identifier: PX08843
2026-03-27 10:47:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b2d2639-29b2-5fcf-866b-4b898fdbe17d with identifier: PX08843 to the API
2026-03-27 10:47:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:47:45Z',
 'fuel_type': 'petrol',
 'id': '7b2d2639-29b2-5fcf-866b-4b898fdbe17d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX08843',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 20237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-23',
 'seller_name': None,
 'title': 'BMW 1er 118i Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2023}
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX08843%27 HTTP/1.1" 200 None
2026-03-27 10:47:42 [auto1.de] INFO: Saving data for PX08843: {'auction_closing_time': 1774716465.0, 'created_time': 1773861459.200383, 'last_price_update_time': 1774608462.238367}
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX08843') HTTP/1.1" 204 0
2026-03-27 10:47:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13a10737-a574-5160-975e-4171b70477a8 with identifier: JP08522
2026-03-27 10:47:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13a10737-a574-5160-975e-4171b70477a8 with scrape type 1
2026-03-27 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13a10737-a574-5160-975e-4171b70477a8
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F9a%252Fc89a2ef5f708b46c98d4a7e5e2868c22%252Fpa%252FJP08522_e4814a2df5ee40211b794ab7cb3daf05.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_e4814a2df5ee40211b794ab7cb3daf05.jpg already downloaded
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F9a%252Fc89a2ef5f708b46c98d4a7e5e2868c22%252Fpa%252FJP08522_0f7dac1701c64e9862c0438ff62403fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_0f7dac1701c64e9862c0438ff62403fc.jpg already downloaded
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F9a%252Fc89a2ef5f708b46c98d4a7e5e2868c22%252Fpa%252FJP08522_95205f66d7ace83ee94c0878567e9ab4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_95205f66d7ace83ee94c0878567e9ab4.jpg already downloaded
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F9a%252Fc89a2ef5f708b46c98d4a7e5e2868c22%252Fpa%252FJP08522_516bc1d18d1af9ec070ea7c580557f62.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_516bc1d18d1af9ec070ea7c580557f62.jpg already downloaded
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F9a%252Fc89a2ef5f708b46c98d4a7e5e2868c22%252Fpa%252FJP08522_173aaa0688b234dd8359931d7fc72f48.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_173aaa0688b234dd8359931d7fc72f48.jpg already downloaded
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F9a%252Fc89a2ef5f708b46c98d4a7e5e2868c22%252Fpa%252FJP08522_eca0157a67351be9cd008f31baa8e839.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_eca0157a67351be9cd008f31baa8e839.jpg already downloaded
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F9a%252Fc89a2ef5f708b46c98d4a7e5e2868c22%252Fpa%252FJP08522_ff14ad4b6d013c99900620d96015b794.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_ff14ad4b6d013c99900620d96015b794.jpg already downloaded
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F9a%252Fc89a2ef5f708b46c98d4a7e5e2868c22%252Fpa%252FJP08522_b4683d5d2bd437bc29c621875af013ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_b4683d5d2bd437bc29c621875af013ae.jpg already downloaded
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F9a%252Fc89a2ef5f708b46c98d4a7e5e2868c22%252Fpa%252FJP08522_8d915485be9e51678db96d1382c2c4f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_8d915485be9e51678db96d1382c2c4f3.jpg already downloaded
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F9a%252Fc89a2ef5f708b46c98d4a7e5e2868c22%252Fpa%252FJP08522_9e35f89fff96e7b76f11db0fd78907b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_9e35f89fff96e7b76f11db0fd78907b0.jpg already downloaded
2026-03-27 10:47:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13a10737-a574-5160-975e-4171b70477a8, identifier: JP08522
2026-03-27 10:47:42 [auto1.de] INFO: Found listing with ID: YA95886
2026-03-27 10:47:42 [auto1.de] INFO: Found listing with ID: BN16879
2026-03-27 10:47:42 [auto1.de] INFO: Found listing with ID: ZG28999
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG28999%27 HTTP/1.1" 200 None
2026-03-27 10:47:42 [auto1.de] INFO: Scrape type for ZG28999: 2
2026-03-27 10:47:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adcebea2-b840-51ca-b32c-db2785840a8c with identifier: ZG28999
2026-03-27 10:47:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adcebea2-b840-51ca-b32c-db2785840a8c with scrape type 2
2026-03-27 10:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adcebea2-b840-51ca-b32c-db2785840a8c with scrape type 2
2026-03-27 10:47:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: adcebea2-b840-51ca-b32c-db2785840a8c, identifier: ZG28999
2026-03-27 10:47:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13a10737-a574-5160-975e-4171b70477a8 with identifier: JP08522
2026-03-27 10:47:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13a10737-a574-5160-975e-4171b70477a8 with identifier: JP08522
2026-03-27 10:47:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13a10737-a574-5160-975e-4171b70477a8 with identifier: JP08522 to the API
2026-03-27 10:47:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JP08522>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:21:31Z',
 'fuel_type': 'petrol',
 'id': '13a10737-a574-5160-975e-4171b70477a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP08522',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 54082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_e4814a2df5ee40211b794ab7cb3daf05.jpg',
                'https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_0f7dac1701c64e9862c0438ff62403fc.jpg',
                'https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_95205f66d7ace83ee94c0878567e9ab4.jpg',
                'https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_516bc1d18d1af9ec070ea7c580557f62.jpg',
                'https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_173aaa0688b234dd8359931d7fc72f48.jpg',
                'https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_eca0157a67351be9cd008f31baa8e839.jpg',
                'https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_ff14ad4b6d013c99900620d96015b794.jpg',
                'https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_b4683d5d2bd437bc29c621875af013ae.jpg',
                'https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_8d915485be9e51678db96d1382c2c4f3.jpg',
                'https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_9e35f89fff96e7b76f11db0fd78907b0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a10737-a574-5160-975e-4171b70477a8/13a10737-a574-5160-975e-4171b70477a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_e4814a2df5ee40211b794ab7cb3daf05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a10737-a574-5160-975e-4171b70477a8/13a10737-a574-5160-975e-4171b70477a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_0f7dac1701c64e9862c0438ff62403fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a10737-a574-5160-975e-4171b70477a8/13a10737-a574-5160-975e-4171b70477a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_95205f66d7ace83ee94c0878567e9ab4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a10737-a574-5160-975e-4171b70477a8/13a10737-a574-5160-975e-4171b70477a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_516bc1d18d1af9ec070ea7c580557f62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a10737-a574-5160-975e-4171b70477a8/13a10737-a574-5160-975e-4171b70477a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_173aaa0688b234dd8359931d7fc72f48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a10737-a574-5160-975e-4171b70477a8/13a10737-a574-5160-975e-4171b70477a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_eca0157a67351be9cd008f31baa8e839.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a10737-a574-5160-975e-4171b70477a8/13a10737-a574-5160-975e-4171b70477a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_ff14ad4b6d013c99900620d96015b794.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a10737-a574-5160-975e-4171b70477a8/13a10737-a574-5160-975e-4171b70477a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_b4683d5d2bd437bc29c621875af013ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a10737-a574-5160-975e-4171b70477a8/13a10737-a574-5160-975e-4171b70477a8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_8d915485be9e51678db96d1382c2c4f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13a10737-a574-5160-975e-4171b70477a8/13a10737-a574-5160-975e-4171b70477a8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/9a/c89a2ef5f708b46c98d4a7e5e2868c22/pa/JP08522_9e35f89fff96e7b76f11db0fd78907b0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Tarraco 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2021}
2026-03-27 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP08522%27 HTTP/1.1" 200 None
2026-03-27 10:47:43 [auto1.de] INFO: Saving data for JP08522: {'created_time': 1774608463.639286, 'last_price_update_time': 1774608463.639298, 'auction_closing_time': 1774714891.0}
2026-03-27 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP08522') HTTP/1.1" 204 0
2026-03-27 10:47:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: adcebea2-b840-51ca-b32c-db2785840a8c with identifier: ZG28999
2026-03-27 10:47:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: adcebea2-b840-51ca-b32c-db2785840a8c with identifier: ZG28999
2026-03-27 10:47:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: adcebea2-b840-51ca-b32c-db2785840a8c with identifier: ZG28999 to the API
2026-03-27 10:47:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:05:37Z',
 'fuel_type': 'petrol',
 'id': 'adcebea2-b840-51ca-b32c-db2785840a8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG28999',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 33273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-14',
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2019}
2026-03-27 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG28999%27 HTTP/1.1" 200 None
2026-03-27 10:47:43 [auto1.de] INFO: Saving data for ZG28999: {'auction_closing_time': 1774713937.0, 'created_time': 1773688203.154083, 'last_price_update_time': 1774608463.995768}
2026-03-27 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG28999') HTTP/1.1" 204 0
2026-03-27 10:47:44 [auto1.de] INFO: Found listing with ID: JS31219
2026-03-27 10:47:44 [auto1.de] INFO: Found listing with ID: CC89680
2026-03-27 10:47:44 [auto1.de] INFO: Found listing with ID: RY91150
2026-03-27 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY91150%27 HTTP/1.1" 200 None
2026-03-27 10:47:44 [auto1.de] INFO: Scrape type for RY91150: 2
2026-03-27 10:47:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b78815eb-7af1-54a0-bd6d-8606612fd8bf with identifier: RY91150
2026-03-27 10:47:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b78815eb-7af1-54a0-bd6d-8606612fd8bf with scrape type 2
2026-03-27 10:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b78815eb-7af1-54a0-bd6d-8606612fd8bf with scrape type 2
2026-03-27 10:47:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b78815eb-7af1-54a0-bd6d-8606612fd8bf, identifier: RY91150
2026-03-27 10:47:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b78815eb-7af1-54a0-bd6d-8606612fd8bf with identifier: RY91150
2026-03-27 10:47:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b78815eb-7af1-54a0-bd6d-8606612fd8bf with identifier: RY91150
2026-03-27 10:47:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b78815eb-7af1-54a0-bd6d-8606612fd8bf with identifier: RY91150 to the API
2026-03-27 10:47:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:17:49Z',
 'fuel_type': 'diesel',
 'id': 'b78815eb-7af1-54a0-bd6d-8606612fd8bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY91150',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 189022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-08',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 Biturbo CDTI Kasten L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'Kasten L1H1 2,7t',
 'year': 2018}
2026-03-27 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY91150%27 HTTP/1.1" 200 None
2026-03-27 10:47:45 [auto1.de] INFO: Saving data for RY91150: {'auction_closing_time': 1774714669.0, 'created_time': 1774294198.161717, 'last_price_update_time': 1774608465.17565}
2026-03-27 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY91150') HTTP/1.1" 204 0
2026-03-27 10:47:45 [auto1.de] INFO: Found listing with ID: BR76788
2026-03-27 10:47:45 [auto1.de] INFO: Found listing with ID: BK33721
2026-03-27 10:47:45 [auto1.de] INFO: Found listing with ID: JH55559
2026-03-27 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH55559%27 HTTP/1.1" 200 None
2026-03-27 10:47:45 [auto1.de] INFO: Scrape type for JH55559: 2
2026-03-27 10:47:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed1f10e2-161f-58d5-8371-53961ca29a46 with identifier: JH55559
2026-03-27 10:47:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed1f10e2-161f-58d5-8371-53961ca29a46 with scrape type 2
2026-03-27 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed1f10e2-161f-58d5-8371-53961ca29a46 with scrape type 2
2026-03-27 10:47:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed1f10e2-161f-58d5-8371-53961ca29a46, identifier: JH55559
2026-03-27 10:47:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed1f10e2-161f-58d5-8371-53961ca29a46 with identifier: JH55559
2026-03-27 10:47:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed1f10e2-161f-58d5-8371-53961ca29a46 with identifier: JH55559
2026-03-27 10:47:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed1f10e2-161f-58d5-8371-53961ca29a46 with identifier: JH55559 to the API
2026-03-27 10:47:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:10:22Z',
 'fuel_type': 'diesel',
 'id': 'ed1f10e2-161f-58d5-8371-53961ca29a46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH55559',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 154726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.6 TDI Allstar BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-27 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH55559%27 HTTP/1.1" 200 None
2026-03-27 10:47:45 [auto1.de] INFO: Saving data for JH55559: {'auction_closing_time': 1774714222.0, 'created_time': 1773341410.568232, 'last_price_update_time': 1774608465.626211}
2026-03-27 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH55559') HTTP/1.1" 204 0
2026-03-27 10:47:45 [auto1.de] INFO: Found listing with ID: CG27437
2026-03-27 10:47:45 [auto1.de] INFO: Found listing with ID: RD48040
2026-03-27 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD48040%27 HTTP/1.1" 200 None
2026-03-27 10:47:45 [auto1.de] INFO: Scrape type for RD48040: 2
2026-03-27 10:47:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c32564bb-c139-52af-bbbe-d4f17d68ca7b with identifier: RD48040
2026-03-27 10:47:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32564bb-c139-52af-bbbe-d4f17d68ca7b with scrape type 2
2026-03-27 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c32564bb-c139-52af-bbbe-d4f17d68ca7b with scrape type 2
2026-03-27 10:47:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c32564bb-c139-52af-bbbe-d4f17d68ca7b, identifier: RD48040
2026-03-27 10:47:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c32564bb-c139-52af-bbbe-d4f17d68ca7b with identifier: RD48040
2026-03-27 10:47:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c32564bb-c139-52af-bbbe-d4f17d68ca7b with identifier: RD48040
2026-03-27 10:47:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c32564bb-c139-52af-bbbe-d4f17d68ca7b with identifier: RD48040 to the API
2026-03-27 10:47:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:53:26Z',
 'fuel_type': 'petrol',
 'id': 'c32564bb-c139-52af-bbbe-d4f17d68ca7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD48040',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 305523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1992-10-31',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse 200 E',
 'transmission': 'manual',
 'trim': '',
 'year': 1992}
2026-03-27 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD48040%27 HTTP/1.1" 200 None
2026-03-27 10:47:46 [auto1.de] INFO: Saving data for RD48040: {'auction_closing_time': 1774716806.0, 'created_time': 1774294103.875521, 'last_price_update_time': 1774608466.057189}
2026-03-27 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD48040') HTTP/1.1" 204 0
2026-03-27 10:47:46 [auto1.de] INFO: Found listing with ID: UA99950
2026-03-27 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA99950%27 HTTP/1.1" 200 None
2026-03-27 10:47:46 [auto1.de] INFO: Scrape type for UA99950: 2
2026-03-27 10:47:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d05bba50-ef86-5855-bfcb-1a0f73147370 with identifier: UA99950
2026-03-27 10:47:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d05bba50-ef86-5855-bfcb-1a0f73147370 with scrape type 2
2026-03-27 10:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d05bba50-ef86-5855-bfcb-1a0f73147370 with scrape type 2
2026-03-27 10:47:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d05bba50-ef86-5855-bfcb-1a0f73147370, identifier: UA99950
2026-03-27 10:47:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d05bba50-ef86-5855-bfcb-1a0f73147370 with identifier: UA99950
2026-03-27 10:47:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d05bba50-ef86-5855-bfcb-1a0f73147370 with identifier: UA99950
2026-03-27 10:47:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d05bba50-ef86-5855-bfcb-1a0f73147370 with identifier: UA99950 to the API
2026-03-27 10:47:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:51:03Z',
 'fuel_type': 'diesel',
 'id': 'd05bba50-ef86-5855-bfcb-1a0f73147370',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA99950',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 265743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-21',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-27 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA99950%27 HTTP/1.1" 200 None
2026-03-27 10:47:46 [auto1.de] INFO: Saving data for UA99950: {'auction_closing_time': 1774716663.0, 'created_time': 1773429101.222429, 'last_price_update_time': 1774608466.604089}
2026-03-27 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA99950') HTTP/1.1" 204 0
2026-03-27 10:47:46 [auto1.de] INFO: Found listing with ID: NT60185
2026-03-27 10:47:46 [auto1.de] INFO: Found listing with ID: DV93424
2026-03-27 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV93424%27 HTTP/1.1" 200 None
2026-03-27 10:47:46 [auto1.de] INFO: Scrape type for DV93424: 2
2026-03-27 10:47:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1760e2c3-297e-5518-8b89-54d2c988df78 with identifier: DV93424
2026-03-27 10:47:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1760e2c3-297e-5518-8b89-54d2c988df78 with scrape type 2
2026-03-27 10:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1760e2c3-297e-5518-8b89-54d2c988df78 with scrape type 2
2026-03-27 10:47:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1760e2c3-297e-5518-8b89-54d2c988df78, identifier: DV93424
2026-03-27 10:47:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1760e2c3-297e-5518-8b89-54d2c988df78 with identifier: DV93424
2026-03-27 10:47:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1760e2c3-297e-5518-8b89-54d2c988df78 with identifier: DV93424
2026-03-27 10:47:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1760e2c3-297e-5518-8b89-54d2c988df78 with identifier: DV93424 to the API
2026-03-27 10:47:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:10:17Z',
 'fuel_type': 'petrol',
 'id': '1760e2c3-297e-5518-8b89-54d2c988df78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV93424',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 50708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-28',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-27 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV93424%27 HTTP/1.1" 200 None
2026-03-27 10:47:47 [auto1.de] INFO: Saving data for DV93424: {'auction_closing_time': 1774714217.0, 'created_time': 1773307152.263145, 'last_price_update_time': 1774608467.062622}
2026-03-27 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV93424') HTTP/1.1" 204 0
2026-03-27 10:47:47 [auto1.de] INFO: Found listing with ID: NY07773
2026-03-27 10:47:47 [auto1.de] INFO: Found listing with ID: DJ76178
2026-03-27 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ76178%27 HTTP/1.1" 200 None
2026-03-27 10:47:47 [auto1.de] INFO: Scrape type for DJ76178: 2
2026-03-27 10:47:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12ec19a0-9dda-57ad-96dd-a4a9d1192aa4 with identifier: DJ76178
2026-03-27 10:47:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12ec19a0-9dda-57ad-96dd-a4a9d1192aa4 with scrape type 2
2026-03-27 10:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12ec19a0-9dda-57ad-96dd-a4a9d1192aa4 with scrape type 2
2026-03-27 10:47:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12ec19a0-9dda-57ad-96dd-a4a9d1192aa4, identifier: DJ76178
2026-03-27 10:47:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12ec19a0-9dda-57ad-96dd-a4a9d1192aa4 with identifier: DJ76178
2026-03-27 10:47:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12ec19a0-9dda-57ad-96dd-a4a9d1192aa4 with identifier: DJ76178
2026-03-27 10:47:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12ec19a0-9dda-57ad-96dd-a4a9d1192aa4 with identifier: DJ76178 to the API
2026-03-27 10:47:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:38:22Z',
 'fuel_type': 'petrol',
 'id': '12ec19a0-9dda-57ad-96dd-a4a9d1192aa4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ76178',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 207047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-30',
 'seller_name': None,
 'title': 'Seat Alhambra 2.8 V6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2005}
2026-03-27 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ76178%27 HTTP/1.1" 200 None
2026-03-27 10:47:48 [auto1.de] INFO: Saving data for DJ76178: {'auction_closing_time': 1774715902.0, 'created_time': 1773380506.854756, 'last_price_update_time': 1774608468.155763}
2026-03-27 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ76178') HTTP/1.1" 204 0
2026-03-27 10:47:48 [auto1.de] INFO: Found listing with ID: SF51688
2026-03-27 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF51688%27 HTTP/1.1" 200 None
2026-03-27 10:47:48 [auto1.de] INFO: Scrape type for SF51688: 1
2026-03-27 10:47:48 [auto1.de] INFO: Found listing with ID: UT22988
2026-03-27 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT22988%27 HTTP/1.1" 200 None
2026-03-27 10:47:48 [auto1.de] INFO: Scrape type for UT22988: 2
2026-03-27 10:47:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 966ecc0f-723b-5611-84f1-abfa73e497d3 with identifier: UT22988
2026-03-27 10:47:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 966ecc0f-723b-5611-84f1-abfa73e497d3 with scrape type 2
2026-03-27 10:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 966ecc0f-723b-5611-84f1-abfa73e497d3 with scrape type 2
2026-03-27 10:47:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 966ecc0f-723b-5611-84f1-abfa73e497d3, identifier: UT22988
2026-03-27 10:47:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 966ecc0f-723b-5611-84f1-abfa73e497d3 with identifier: UT22988
2026-03-27 10:47:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 966ecc0f-723b-5611-84f1-abfa73e497d3 with identifier: UT22988
2026-03-27 10:47:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 966ecc0f-723b-5611-84f1-abfa73e497d3 with identifier: UT22988 to the API
2026-03-27 10:47:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:52:37Z',
 'fuel_type': 'petrol',
 'id': '966ecc0f-723b-5611-84f1-abfa73e497d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT22988',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Jimny',
 'odometer': 90814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-23',
 'seller_name': None,
 'title': 'Suzuki Jimny 1.3 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2015}
2026-03-27 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT22988%27 HTTP/1.1" 200 None
2026-03-27 10:47:48 [auto1.de] INFO: Saving data for UT22988: {'auction_closing_time': 1774716757.0, 'created_time': 1773380973.573565, 'last_price_update_time': 1774608468.647628}
2026-03-27 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT22988') HTTP/1.1" 204 0
2026-03-27 10:47:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SF51688/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:47:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SF51688> (referer: https://www.auto1.com/v1/car-details-view/SF51688/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:47:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cef081bb-b369-51fa-a235-9d3a33f23b83 with identifier: SF51688
2026-03-27 10:47:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cef081bb-b369-51fa-a235-9d3a33f23b83 with scrape type 1
2026-03-27 10:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cef081bb-b369-51fa-a235-9d3a33f23b83
2026-03-27 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F00%252Fd30008780aca2f237a76082066246bfa%252Fpa%252FSF51688_26ab9649db7b3a868fc1a188fdd05e81.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_26ab9649db7b3a868fc1a188fdd05e81.jpg already downloaded
2026-03-27 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F00%252Fd30008780aca2f237a76082066246bfa%252Fpa%252FSF51688_0362e55b8d5823e3053ea1dcce67d365.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_0362e55b8d5823e3053ea1dcce67d365.jpg already downloaded
2026-03-27 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F00%252Fd30008780aca2f237a76082066246bfa%252Fpa%252FSF51688_d5a8e8cc8a0311ea49b6753b788db22e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_d5a8e8cc8a0311ea49b6753b788db22e.jpg already downloaded
2026-03-27 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F00%252Fd30008780aca2f237a76082066246bfa%252Fpa%252FSF51688_fab99a5dbb49e58cd96886c7b44467b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_fab99a5dbb49e58cd96886c7b44467b4.jpg already downloaded
2026-03-27 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F00%252Fd30008780aca2f237a76082066246bfa%252Fpa%252FSF51688_ba426f791451c4fc857ace1ac1aa58a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_ba426f791451c4fc857ace1ac1aa58a3.jpg already downloaded
2026-03-27 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F00%252Fd30008780aca2f237a76082066246bfa%252Fpa%252FSF51688_bb35bce9208039d5d8006f1be1051518.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_bb35bce9208039d5d8006f1be1051518.jpg already downloaded
2026-03-27 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F00%252Fd30008780aca2f237a76082066246bfa%252Fpa%252FSF51688_32a36576a9be443cf8a9e15493837284.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_32a36576a9be443cf8a9e15493837284.jpg already downloaded
2026-03-27 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F00%252Fd30008780aca2f237a76082066246bfa%252Fpa%252FSF51688_fc39d1f32c46f9e53ffb0b7e1b920d5b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_fc39d1f32c46f9e53ffb0b7e1b920d5b.jpg already downloaded
2026-03-27 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F00%252Fd30008780aca2f237a76082066246bfa%252Fpa%252FSF51688_9e1fc65308059a46618a436a0583c06e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_9e1fc65308059a46618a436a0583c06e.jpg already downloaded
2026-03-27 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F00%252Fd30008780aca2f237a76082066246bfa%252Fpa%252FSF51688_ddfd937992f692813f03fc6ff8338874.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_ddfd937992f692813f03fc6ff8338874.jpg already downloaded
2026-03-27 10:47:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cef081bb-b369-51fa-a235-9d3a33f23b83, identifier: SF51688
2026-03-27 10:47:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cef081bb-b369-51fa-a235-9d3a33f23b83 with identifier: SF51688
2026-03-27 10:47:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cef081bb-b369-51fa-a235-9d3a33f23b83 with identifier: SF51688
2026-03-27 10:47:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cef081bb-b369-51fa-a235-9d3a33f23b83 with identifier: SF51688 to the API
2026-03-27 10:47:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SF51688>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:02:29Z',
 'fuel_type': 'petrol',
 'id': 'cef081bb-b369-51fa-a235-9d3a33f23b83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF51688',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 10925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_26ab9649db7b3a868fc1a188fdd05e81.jpg',
                'https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_0362e55b8d5823e3053ea1dcce67d365.jpg',
                'https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_d5a8e8cc8a0311ea49b6753b788db22e.jpg',
                'https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_fab99a5dbb49e58cd96886c7b44467b4.jpg',
                'https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_ba426f791451c4fc857ace1ac1aa58a3.jpg',
                'https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_bb35bce9208039d5d8006f1be1051518.jpg',
                'https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_32a36576a9be443cf8a9e15493837284.jpg',
                'https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_fc39d1f32c46f9e53ffb0b7e1b920d5b.jpg',
                'https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_9e1fc65308059a46618a436a0583c06e.jpg',
                'https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_ddfd937992f692813f03fc6ff8338874.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef081bb-b369-51fa-a235-9d3a33f23b83/cef081bb-b369-51fa-a235-9d3a33f23b83_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_26ab9649db7b3a868fc1a188fdd05e81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef081bb-b369-51fa-a235-9d3a33f23b83/cef081bb-b369-51fa-a235-9d3a33f23b83_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1217184,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_0362e55b8d5823e3053ea1dcce67d365.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef081bb-b369-51fa-a235-9d3a33f23b83/cef081bb-b369-51fa-a235-9d3a33f23b83_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1206708,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_d5a8e8cc8a0311ea49b6753b788db22e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef081bb-b369-51fa-a235-9d3a33f23b83/cef081bb-b369-51fa-a235-9d3a33f23b83_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_fab99a5dbb49e58cd96886c7b44467b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef081bb-b369-51fa-a235-9d3a33f23b83/cef081bb-b369-51fa-a235-9d3a33f23b83_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1277124,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_ba426f791451c4fc857ace1ac1aa58a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef081bb-b369-51fa-a235-9d3a33f23b83/cef081bb-b369-51fa-a235-9d3a33f23b83_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_bb35bce9208039d5d8006f1be1051518.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef081bb-b369-51fa-a235-9d3a33f23b83/cef081bb-b369-51fa-a235-9d3a33f23b83_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_32a36576a9be443cf8a9e15493837284.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef081bb-b369-51fa-a235-9d3a33f23b83/cef081bb-b369-51fa-a235-9d3a33f23b83_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1147519,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_fc39d1f32c46f9e53ffb0b7e1b920d5b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef081bb-b369-51fa-a235-9d3a33f23b83/cef081bb-b369-51fa-a235-9d3a33f23b83_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_9e1fc65308059a46618a436a0583c06e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef081bb-b369-51fa-a235-9d3a33f23b83/cef081bb-b369-51fa-a235-9d3a33f23b83_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/00/d30008780aca2f237a76082066246bfa/pa/SF51688_ddfd937992f692813f03fc6ff8338874.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 Sportback 30 TFSI Advanced',
 'transmission': 'automatic',
 'trim': 'Advanced',
 'year': 2024}
2026-03-27 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF51688%27 HTTP/1.1" 200 None
2026-03-27 10:47:51 [auto1.de] INFO: Saving data for SF51688: {'created_time': 1774608471.425328, 'last_price_update_time': 1774608471.425339, 'auction_closing_time': 1774713749.0}
2026-03-27 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF51688') HTTP/1.1" 204 0
2026-03-27 10:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:47:52 [auto1.de] INFO: Channel: 24h | Page: 40 | totalHits: 10557 | hits on page: 40
2026-03-27 10:47:52 [auto1.de] INFO: Found listing with ID: DJ76178
2026-03-27 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ76178%27 HTTP/1.1" 200 None
2026-03-27 10:47:52 [auto1.de] INFO: Scrape type for DJ76178: 0
2026-03-27 10:47:52 [auto1.de] INFO: Found listing with ID: SF51688
2026-03-27 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF51688%27 HTTP/1.1" 200 None
2026-03-27 10:47:52 [auto1.de] INFO: Scrape type for SF51688: 0
2026-03-27 10:47:52 [auto1.de] INFO: Found listing with ID: UT22988
2026-03-27 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT22988%27 HTTP/1.1" 200 None
2026-03-27 10:47:52 [auto1.de] INFO: Scrape type for UT22988: 0
2026-03-27 10:47:52 [auto1.de] INFO: Found listing with ID: KL53261
2026-03-27 10:47:52 [auto1.de] INFO: Found listing with ID: XJ26035
2026-03-27 10:47:52 [auto1.de] INFO: Found listing with ID: VH64157
2026-03-27 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH64157%27 HTTP/1.1" 200 None
2026-03-27 10:47:52 [auto1.de] INFO: Scrape type for VH64157: 2
2026-03-27 10:47:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d3d2342-effd-5ec6-bf30-e10f98816ea0 with identifier: VH64157
2026-03-27 10:47:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d3d2342-effd-5ec6-bf30-e10f98816ea0 with scrape type 2
2026-03-27 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d3d2342-effd-5ec6-bf30-e10f98816ea0 with scrape type 2
2026-03-27 10:47:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d3d2342-effd-5ec6-bf30-e10f98816ea0, identifier: VH64157
2026-03-27 10:47:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d3d2342-effd-5ec6-bf30-e10f98816ea0 with identifier: VH64157
2026-03-27 10:47:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d3d2342-effd-5ec6-bf30-e10f98816ea0 with identifier: VH64157
2026-03-27 10:47:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d3d2342-effd-5ec6-bf30-e10f98816ea0 with identifier: VH64157 to the API
2026-03-27 10:47:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:04:47Z',
 'fuel_type': 'petrol',
 'id': '6d3d2342-effd-5ec6-bf30-e10f98816ea0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH64157',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 178681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-27',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 250 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2015}
2026-03-27 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH64157%27 HTTP/1.1" 200 None
2026-03-27 10:47:53 [auto1.de] INFO: Saving data for VH64157: {'auction_closing_time': 1774713887.0, 'created_time': 1774292166.560878, 'last_price_update_time': 1774608473.425512}
2026-03-27 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH64157') HTTP/1.1" 204 0
2026-03-27 10:47:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:47:53 [auto1.de] INFO: Found listing with ID: EB92999
2026-03-27 10:47:53 [auto1.de] INFO: Found listing with ID: GN10929
2026-03-27 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN10929%27 HTTP/1.1" 200 None
2026-03-27 10:47:53 [auto1.de] INFO: Scrape type for GN10929: 2
2026-03-27 10:47:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2131cd56-c29c-5882-8015-c739915f157d with identifier: GN10929
2026-03-27 10:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2131cd56-c29c-5882-8015-c739915f157d with scrape type 2
2026-03-27 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2131cd56-c29c-5882-8015-c739915f157d with scrape type 2
2026-03-27 10:47:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2131cd56-c29c-5882-8015-c739915f157d, identifier: GN10929
2026-03-27 10:47:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2131cd56-c29c-5882-8015-c739915f157d with identifier: GN10929
2026-03-27 10:47:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2131cd56-c29c-5882-8015-c739915f157d with identifier: GN10929
2026-03-27 10:47:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2131cd56-c29c-5882-8015-c739915f157d with identifier: GN10929 to the API
2026-03-27 10:47:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:26:39Z',
 'fuel_type': 'diesel',
 'id': '2131cd56-c29c-5882-8015-c739915f157d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN10929',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 207316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-22',
 'seller_name': None,
 'title': 'Audi A6 Allroad 50 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2026-03-27 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN10929%27 HTTP/1.1" 200 None
2026-03-27 10:47:54 [auto1.de] INFO: Saving data for GN10929: {'auction_closing_time': 1774715199.0, 'created_time': 1773775069.022754, 'last_price_update_time': 1774608474.096856}
2026-03-27 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN10929') HTTP/1.1" 204 0
2026-03-27 10:47:54 [auto1.de] INFO: Found listing with ID: GR11096
2026-03-27 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR11096%27 HTTP/1.1" 200 None
2026-03-27 10:47:54 [auto1.de] INFO: Scrape type for GR11096: 2
2026-03-27 10:47:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6 with identifier: GR11096
2026-03-27 10:47:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6 with scrape type 2
2026-03-27 10:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6 with scrape type 2
2026-03-27 10:47:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6, identifier: GR11096
2026-03-27 10:47:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6 with identifier: GR11096
2026-03-27 10:47:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6 with identifier: GR11096
2026-03-27 10:47:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6 with identifier: GR11096 to the API
2026-03-27 10:47:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:36:42Z',
 'fuel_type': 'petrol',
 'id': 'cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR11096',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 76482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-03',
 'seller_name': None,
 'title': 'Hyundai i20 1.4 Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2026-03-27 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR11096%27 HTTP/1.1" 200 None
2026-03-27 10:47:54 [auto1.de] INFO: Saving data for GR11096: {'auction_closing_time': 1774715802.0, 'created_time': 1773861611.305294, 'last_price_update_time': 1774608474.640847}
2026-03-27 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR11096') HTTP/1.1" 204 0
2026-03-27 10:47:54 [auto1.de] INFO: Found listing with ID: GA31653
2026-03-27 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31653%27 HTTP/1.1" 200 None
2026-03-27 10:47:54 [auto1.de] INFO: Scrape type for GA31653: 2
2026-03-27 10:47:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08b001bf-ba1b-54de-ac6b-409fcb5c8f48 with identifier: GA31653
2026-03-27 10:47:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08b001bf-ba1b-54de-ac6b-409fcb5c8f48 with scrape type 2
2026-03-27 10:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08b001bf-ba1b-54de-ac6b-409fcb5c8f48 with scrape type 2
2026-03-27 10:47:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08b001bf-ba1b-54de-ac6b-409fcb5c8f48, identifier: GA31653
2026-03-27 10:47:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08b001bf-ba1b-54de-ac6b-409fcb5c8f48 with identifier: GA31653
2026-03-27 10:47:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08b001bf-ba1b-54de-ac6b-409fcb5c8f48 with identifier: GA31653
2026-03-27 10:47:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08b001bf-ba1b-54de-ac6b-409fcb5c8f48 with identifier: GA31653 to the API
2026-03-27 10:47:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:09:14Z',
 'fuel_type': 'petrol',
 'id': '08b001bf-ba1b-54de-ac6b-409fcb5c8f48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA31653',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 86445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-04-14',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2003}
2026-03-27 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31653%27 HTTP/1.1" 200 None
2026-03-27 10:47:55 [auto1.de] INFO: Saving data for GA31653: {'auction_closing_time': 1774714154.0, 'created_time': 1774293769.249585, 'last_price_update_time': 1774608475.080078}
2026-03-27 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA31653') HTTP/1.1" 204 0
2026-03-27 10:47:55 [auto1.de] INFO: Found listing with ID: NP49973
2026-03-27 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP49973%27 HTTP/1.1" 200 None
2026-03-27 10:47:55 [auto1.de] INFO: Scrape type for NP49973: 2
2026-03-27 10:47:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d5a3740-d5e5-5d3e-896b-f870b538d12a with identifier: NP49973
2026-03-27 10:47:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d5a3740-d5e5-5d3e-896b-f870b538d12a with scrape type 2
2026-03-27 10:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d5a3740-d5e5-5d3e-896b-f870b538d12a with scrape type 2
2026-03-27 10:47:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d5a3740-d5e5-5d3e-896b-f870b538d12a, identifier: NP49973
2026-03-27 10:47:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d5a3740-d5e5-5d3e-896b-f870b538d12a with identifier: NP49973
2026-03-27 10:47:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d5a3740-d5e5-5d3e-896b-f870b538d12a with identifier: NP49973
2026-03-27 10:47:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d5a3740-d5e5-5d3e-896b-f870b538d12a with identifier: NP49973 to the API
2026-03-27 10:47:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:10:03Z',
 'fuel_type': 'diesel',
 'id': '5d5a3740-d5e5-5d3e-896b-f870b538d12a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP49973',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 207529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-21',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2014}
2026-03-27 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP49973%27 HTTP/1.1" 200 None
2026-03-27 10:47:55 [auto1.de] INFO: Saving data for NP49973: {'auction_closing_time': 1774714203.0, 'created_time': 1773302032.312806, 'last_price_update_time': 1774608475.546144}
2026-03-27 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP49973') HTTP/1.1" 204 0
2026-03-27 10:47:55 [auto1.de] INFO: Found listing with ID: EU72034
2026-03-27 10:47:55 [auto1.de] INFO: Found listing with ID: JU59461
2026-03-27 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU59461%27 HTTP/1.1" 200 None
2026-03-27 10:47:55 [auto1.de] INFO: Scrape type for JU59461: 2
2026-03-27 10:47:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3c5fe71-8c07-56e2-8f58-968243bff05b with identifier: JU59461
2026-03-27 10:47:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3c5fe71-8c07-56e2-8f58-968243bff05b with scrape type 2
2026-03-27 10:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3c5fe71-8c07-56e2-8f58-968243bff05b with scrape type 2
2026-03-27 10:47:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3c5fe71-8c07-56e2-8f58-968243bff05b, identifier: JU59461
2026-03-27 10:47:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3c5fe71-8c07-56e2-8f58-968243bff05b with identifier: JU59461
2026-03-27 10:47:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3c5fe71-8c07-56e2-8f58-968243bff05b with identifier: JU59461
2026-03-27 10:47:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3c5fe71-8c07-56e2-8f58-968243bff05b with identifier: JU59461 to the API
2026-03-27 10:47:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:11:34Z',
 'fuel_type': 'petrol',
 'id': 'd3c5fe71-8c07-56e2-8f58-968243bff05b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU59461',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 68105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-28',
 'seller_name': None,
 'title': 'MINI Cooper Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2021}
2026-03-27 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU59461%27 HTTP/1.1" 200 None
2026-03-27 10:47:55 [auto1.de] INFO: Saving data for JU59461: {'auction_closing_time': 1774714294.0, 'created_time': 1773306705.259039, 'last_price_update_time': 1774608475.993679}
2026-03-27 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU59461') HTTP/1.1" 204 0
2026-03-27 10:47:56 [auto1.de] INFO: Found listing with ID: FB31140
2026-03-27 10:47:56 [auto1.de] INFO: Found listing with ID: CP54704
2026-03-27 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP54704%27 HTTP/1.1" 200 None
2026-03-27 10:47:56 [auto1.de] INFO: Scrape type for CP54704: 2
2026-03-27 10:47:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9cf7670-9fcc-535f-8fce-5ba5a944cd9c with identifier: CP54704
2026-03-27 10:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9cf7670-9fcc-535f-8fce-5ba5a944cd9c with scrape type 2
2026-03-27 10:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9cf7670-9fcc-535f-8fce-5ba5a944cd9c with scrape type 2
2026-03-27 10:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9cf7670-9fcc-535f-8fce-5ba5a944cd9c, identifier: CP54704
2026-03-27 10:47:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9cf7670-9fcc-535f-8fce-5ba5a944cd9c with identifier: CP54704
2026-03-27 10:47:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9cf7670-9fcc-535f-8fce-5ba5a944cd9c with identifier: CP54704
2026-03-27 10:47:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9cf7670-9fcc-535f-8fce-5ba5a944cd9c with identifier: CP54704 to the API
2026-03-27 10:47:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-28T16:57:00Z',
 'fuel_type': 'diesel',
 'id': 'c9cf7670-9fcc-535f-8fce-5ba5a944cd9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP54704',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 227355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-08',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2018}
2026-03-27 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP54704%27 HTTP/1.1" 200 None
2026-03-27 10:47:56 [auto1.de] INFO: Saving data for CP54704: {'auction_closing_time': 1774717020.0, 'created_time': 1773302641.74825, 'last_price_update_time': 1774608476.50928}
2026-03-27 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP54704') HTTP/1.1" 204 0
2026-03-27 10:47:56 [auto1.de] INFO: Found listing with ID: UX71045
2026-03-27 10:47:56 [auto1.de] INFO: Found listing with ID: NC35007
2026-03-27 10:47:56 [auto1.de] INFO: Found listing with ID: YS81277
2026-03-27 10:47:56 [auto1.de] INFO: Found listing with ID: AH29152
2026-03-27 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH29152%27 HTTP/1.1" 200 None
2026-03-27 10:47:56 [auto1.de] INFO: Scrape type for AH29152: 2
2026-03-27 10:47:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49f56615-52d0-5321-b845-93fc1858acd7 with identifier: AH29152
2026-03-27 10:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49f56615-52d0-5321-b845-93fc1858acd7 with scrape type 2
2026-03-27 10:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49f56615-52d0-5321-b845-93fc1858acd7 with scrape type 2
2026-03-27 10:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49f56615-52d0-5321-b845-93fc1858acd7, identifier: AH29152
2026-03-27 10:47:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49f56615-52d0-5321-b845-93fc1858acd7 with identifier: AH29152
2026-03-27 10:47:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49f56615-52d0-5321-b845-93fc1858acd7 with identifier: AH29152
2026-03-27 10:47:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49f56615-52d0-5321-b845-93fc1858acd7 with identifier: AH29152 to the API
2026-03-27 10:47:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:28:19Z',
 'fuel_type': 'diesel',
 'id': '49f56615-52d0-5321-b845-93fc1858acd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH29152',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 152409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-27',
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Style 4Drive',
 'transmission': 'manual',
 'trim': 'Style 4Drive',
 'year': 2015}
2026-03-27 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH29152%27 HTTP/1.1" 200 None
2026-03-27 10:47:57 [auto1.de] INFO: Saving data for AH29152: {'auction_closing_time': 1774715299.0, 'created_time': 1773861732.855108, 'last_price_update_time': 1774608477.027822}
2026-03-27 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH29152') HTTP/1.1" 204 0
2026-03-27 10:47:57 [auto1.de] INFO: Found listing with ID: FM08350
2026-03-27 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM08350%27 HTTP/1.1" 200 None
2026-03-27 10:47:57 [auto1.de] INFO: Scrape type for FM08350: 2
2026-03-27 10:47:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8 with identifier: FM08350
2026-03-27 10:47:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8 with scrape type 2
2026-03-27 10:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8 with scrape type 2
2026-03-27 10:47:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8, identifier: FM08350
2026-03-27 10:47:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8 with identifier: FM08350
2026-03-27 10:47:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8 with identifier: FM08350
2026-03-27 10:47:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8 with identifier: FM08350 to the API
2026-03-27 10:47:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:55:10Z',
 'fuel_type': 'petrol',
 'id': 'b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM08350',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 123104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-26',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-27 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM08350%27 HTTP/1.1" 200 None
2026-03-27 10:47:57 [auto1.de] INFO: Saving data for FM08350: {'auction_closing_time': 1774716910.0, 'created_time': 1773859217.239419, 'last_price_update_time': 1774608477.730299}
2026-03-27 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM08350') HTTP/1.1" 204 0
2026-03-27 10:47:57 [auto1.de] INFO: Found listing with ID: YY76457
2026-03-27 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY76457%27 HTTP/1.1" 200 None
2026-03-27 10:47:57 [auto1.de] INFO: Scrape type for YY76457: 2
2026-03-27 10:47:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb6b7c9e-2962-5a4f-8022-7a697f5711f9 with identifier: YY76457
2026-03-27 10:47:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb6b7c9e-2962-5a4f-8022-7a697f5711f9 with scrape type 2
2026-03-27 10:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb6b7c9e-2962-5a4f-8022-7a697f5711f9 with scrape type 2
2026-03-27 10:47:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb6b7c9e-2962-5a4f-8022-7a697f5711f9, identifier: YY76457
2026-03-27 10:47:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb6b7c9e-2962-5a4f-8022-7a697f5711f9 with identifier: YY76457
2026-03-27 10:47:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb6b7c9e-2962-5a4f-8022-7a697f5711f9 with identifier: YY76457
2026-03-27 10:47:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb6b7c9e-2962-5a4f-8022-7a697f5711f9 with identifier: YY76457 to the API
2026-03-27 10:47:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:11:29Z',
 'fuel_type': 'petrol',
 'id': 'eb6b7c9e-2962-5a4f-8022-7a697f5711f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY76457',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 110081,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-23',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-27 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY76457%27 HTTP/1.1" 200 None
2026-03-27 10:47:58 [auto1.de] INFO: Saving data for YY76457: {'auction_closing_time': 1774714289.0, 'created_time': 1773687981.50687, 'last_price_update_time': 1774608478.247644}
2026-03-27 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY76457') HTTP/1.1" 204 0
2026-03-27 10:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:47:58 [auto1.de] INFO: Found listing with ID: BA73417
2026-03-27 10:47:58 [auto1.de] INFO: Found listing with ID: JF95451
2026-03-27 10:47:58 [auto1.de] INFO: Found listing with ID: TB15164
2026-03-27 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB15164%27 HTTP/1.1" 200 None
2026-03-27 10:47:58 [auto1.de] INFO: Scrape type for TB15164: 2
2026-03-27 10:47:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcbe0df5-f8c1-503e-b8d3-0c5217a51678 with identifier: TB15164
2026-03-27 10:47:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcbe0df5-f8c1-503e-b8d3-0c5217a51678 with scrape type 2
2026-03-27 10:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcbe0df5-f8c1-503e-b8d3-0c5217a51678 with scrape type 2
2026-03-27 10:47:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dcbe0df5-f8c1-503e-b8d3-0c5217a51678, identifier: TB15164
2026-03-27 10:47:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dcbe0df5-f8c1-503e-b8d3-0c5217a51678 with identifier: TB15164
2026-03-27 10:47:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dcbe0df5-f8c1-503e-b8d3-0c5217a51678 with identifier: TB15164
2026-03-27 10:47:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dcbe0df5-f8c1-503e-b8d3-0c5217a51678 with identifier: TB15164 to the API
2026-03-27 10:47:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:30:36Z',
 'fuel_type': 'petrol',
 'id': 'dcbe0df5-f8c1-503e-b8d3-0c5217a51678',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB15164',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 177678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-01',
 'seller_name': None,
 'title': 'Opel Adam 1.0 Turbo Slam ecoFlex',
 'transmission': 'manual',
 'trim': 'Slam ecoFlex',
 'year': 2016}
2026-03-27 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB15164%27 HTTP/1.1" 200 None
2026-03-27 10:47:58 [auto1.de] INFO: Saving data for TB15164: {'auction_closing_time': 1774715436.0, 'created_time': 1773401242.008756, 'last_price_update_time': 1774608478.913795}
2026-03-27 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB15164') HTTP/1.1" 204 0
2026-03-27 10:47:58 [auto1.de] INFO: Found listing with ID: DF02739
2026-03-27 10:47:58 [auto1.de] INFO: Found listing with ID: YE46941
2026-03-27 10:47:58 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-27 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02201%27 HTTP/1.1" 200 None
2026-03-27 10:47:58 [auto1.de] INFO: Scrape type for FZ02201: 2
2026-03-27 10:47:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fa5303c-8ac4-5446-b0a9-88a39c883c47 with identifier: FZ02201
2026-03-27 10:47:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fa5303c-8ac4-5446-b0a9-88a39c883c47 with scrape type 2
2026-03-27 10:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fa5303c-8ac4-5446-b0a9-88a39c883c47 with scrape type 2
2026-03-27 10:47:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fa5303c-8ac4-5446-b0a9-88a39c883c47, identifier: FZ02201
2026-03-27 10:47:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fa5303c-8ac4-5446-b0a9-88a39c883c47 with identifier: FZ02201
2026-03-27 10:47:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fa5303c-8ac4-5446-b0a9-88a39c883c47 with identifier: FZ02201
2026-03-27 10:47:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fa5303c-8ac4-5446-b0a9-88a39c883c47 with identifier: FZ02201 to the API
2026-03-27 10:47:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:38:23Z',
 'fuel_type': 'diesel',
 'id': '0fa5303c-8ac4-5446-b0a9-88a39c883c47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ02201',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Country Tourer',
 'odometer': 154239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-01',
 'seller_name': None,
 'title': 'Opel Insignia Country Tourer 2.0 CDTI Basis ecoFlex',
 'transmission': 'manual',
 'trim': 'Basis ecoFlex',
 'year': 2015}
2026-03-27 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02201%27 HTTP/1.1" 200 None
2026-03-27 10:47:59 [auto1.de] INFO: Saving data for FZ02201: {'auction_closing_time': 1774715903.0, 'created_time': 1773383109.789682, 'last_price_update_time': 1774608479.373253}
2026-03-27 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ02201') HTTP/1.1" 204 0
2026-03-27 10:47:59 [auto1.de] INFO: Channel: 24h | Page: 41 | totalHits: 10558 | hits on page: 40
2026-03-27 10:47:59 [auto1.de] INFO: Found listing with ID: JG77097
2026-03-27 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG77097%27 HTTP/1.1" 200 None
2026-03-27 10:47:59 [auto1.de] INFO: Scrape type for JG77097: 2
2026-03-27 10:47:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 772d95fe-2c21-52ae-be91-3df75dad471a with identifier: JG77097
2026-03-27 10:47:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 772d95fe-2c21-52ae-be91-3df75dad471a with scrape type 2
2026-03-27 10:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 772d95fe-2c21-52ae-be91-3df75dad471a with scrape type 2
2026-03-27 10:47:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 772d95fe-2c21-52ae-be91-3df75dad471a, identifier: JG77097
2026-03-27 10:47:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 772d95fe-2c21-52ae-be91-3df75dad471a with identifier: JG77097
2026-03-27 10:47:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 772d95fe-2c21-52ae-be91-3df75dad471a with identifier: JG77097
2026-03-27 10:47:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 772d95fe-2c21-52ae-be91-3df75dad471a with identifier: JG77097 to the API
2026-03-27 10:47:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:47:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:47:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:09:51Z',
 'fuel_type': 'diesel',
 'id': '772d95fe-2c21-52ae-be91-3df75dad471a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG77097',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 240905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-29',
 'seller_name': None,
 'title': 'Ford C-Max 1.5 TDCi Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2016}
2026-03-27 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG77097%27 HTTP/1.1" 200 None
2026-03-27 10:47:59 [auto1.de] INFO: Saving data for JG77097: {'auction_closing_time': 1774714191.0, 'created_time': 1773307859.902645, 'last_price_update_time': 1774608479.849451}
2026-03-27 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG77097') HTTP/1.1" 204 0
2026-03-27 10:47:59 [auto1.de] INFO: Found listing with ID: TJ16115
2026-03-27 10:47:59 [auto1.de] INFO: Found listing with ID: ZM88975
2026-03-27 10:47:59 [auto1.de] INFO: Found listing with ID: BU48960
2026-03-27 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU48960%27 HTTP/1.1" 200 None
2026-03-27 10:47:59 [auto1.de] INFO: Scrape type for BU48960: 1
2026-03-27 10:47:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:47:59 [auto1.de] INFO: Found listing with ID: ZT19745
2026-03-27 10:47:59 [auto1.de] INFO: Found listing with ID: CJ75518
2026-03-27 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ75518%27 HTTP/1.1" 200 None
2026-03-27 10:47:59 [auto1.de] INFO: Scrape type for CJ75518: 2
2026-03-27 10:47:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c5377ac-5e28-5ad9-b9c4-8eab17b465ff with identifier: CJ75518
2026-03-27 10:47:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c5377ac-5e28-5ad9-b9c4-8eab17b465ff with scrape type 2
2026-03-27 10:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c5377ac-5e28-5ad9-b9c4-8eab17b465ff with scrape type 2
2026-03-27 10:47:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c5377ac-5e28-5ad9-b9c4-8eab17b465ff, identifier: CJ75518
2026-03-27 10:47:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c5377ac-5e28-5ad9-b9c4-8eab17b465ff with identifier: CJ75518
2026-03-27 10:47:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c5377ac-5e28-5ad9-b9c4-8eab17b465ff with identifier: CJ75518
2026-03-27 10:48:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c5377ac-5e28-5ad9-b9c4-8eab17b465ff with identifier: CJ75518 to the API
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:10:19Z',
 'fuel_type': 'diesel',
 'id': '1c5377ac-5e28-5ad9-b9c4-8eab17b465ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ75518',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 125691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-08',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2016}
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ75518%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Saving data for CJ75518: {'auction_closing_time': 1774714219.0, 'created_time': 1774292273.678197, 'last_price_update_time': 1774608480.356422}
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ75518') HTTP/1.1" 204 0
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: NX83651
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX83651%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for NX83651: 2
2026-03-27 10:48:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9de8fa7f-5417-5574-a78b-1bdb61662d9f with identifier: NX83651
2026-03-27 10:48:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9de8fa7f-5417-5574-a78b-1bdb61662d9f with scrape type 2
2026-03-27 10:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9de8fa7f-5417-5574-a78b-1bdb61662d9f with scrape type 2
2026-03-27 10:48:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9de8fa7f-5417-5574-a78b-1bdb61662d9f, identifier: NX83651
2026-03-27 10:48:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: KH46132
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: AB79504
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: TE39343
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: US92808
2026-03-27 10:48:00 [auto1.de] INFO: Found listing with ID: UM10671
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM10671%27 HTTP/1.1" 200 None
2026-03-27 10:48:00 [auto1.de] INFO: Scrape type for UM10671: 2
2026-03-27 10:48:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af290f05-34d9-53ae-9ec7-07ccb5a76ca6 with identifier: UM10671
2026-03-27 10:48:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af290f05-34d9-53ae-9ec7-07ccb5a76ca6 with scrape type 2
2026-03-27 10:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af290f05-34d9-53ae-9ec7-07ccb5a76ca6 with scrape type 2
2026-03-27 10:48:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af290f05-34d9-53ae-9ec7-07ccb5a76ca6, identifier: UM10671
2026-03-27 10:48:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9de8fa7f-5417-5574-a78b-1bdb61662d9f with identifier: NX83651
2026-03-27 10:48:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9de8fa7f-5417-5574-a78b-1bdb61662d9f with identifier: NX83651
2026-03-27 10:48:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9de8fa7f-5417-5574-a78b-1bdb61662d9f with identifier: NX83651 to the API
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:00:40Z',
 'fuel_type': 'petrol',
 'id': '9de8fa7f-5417-5574-a78b-1bdb61662d9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX83651',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 127594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-23',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2016}
2026-03-27 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX83651%27 HTTP/1.1" 200 None
2026-03-27 10:48:01 [auto1.de] INFO: Saving data for NX83651: {'auction_closing_time': 1774713640.0, 'created_time': 1773227981.692358, 'last_price_update_time': 1774608481.111001}
2026-03-27 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX83651') HTTP/1.1" 204 0
2026-03-27 10:48:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af290f05-34d9-53ae-9ec7-07ccb5a76ca6 with identifier: UM10671
2026-03-27 10:48:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af290f05-34d9-53ae-9ec7-07ccb5a76ca6 with identifier: UM10671
2026-03-27 10:48:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af290f05-34d9-53ae-9ec7-07ccb5a76ca6 with identifier: UM10671 to the API
2026-03-27 10:48:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:53:27Z',
 'fuel_type': 'petrol',
 'id': 'af290f05-34d9-53ae-9ec7-07ccb5a76ca6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM10671',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Orlando',
 'odometer': 219462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-30',
 'seller_name': None,
 'title': 'Chevrolet Orlando 1.4 TURBO LTZ',
 'transmission': 'manual',
 'trim': 'LTZ',
 'year': 2014}
2026-03-27 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM10671%27 HTTP/1.1" 200 None
2026-03-27 10:48:01 [auto1.de] INFO: Saving data for UM10671: {'auction_closing_time': 1774716807.0, 'created_time': 1773860982.54036, 'last_price_update_time': 1774608481.495993}
2026-03-27 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM10671') HTTP/1.1" 204 0
2026-03-27 10:48:01 [auto1.de] INFO: Found listing with ID: GE73392
2026-03-27 10:48:01 [auto1.de] INFO: Found listing with ID: AK97582
2026-03-27 10:48:01 [auto1.de] INFO: Found listing with ID: EJ25575
2026-03-27 10:48:01 [auto1.de] INFO: Found listing with ID: PE88968
2026-03-27 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE88968%27 HTTP/1.1" 200 None
2026-03-27 10:48:01 [auto1.de] INFO: Scrape type for PE88968: 2
2026-03-27 10:48:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e77a5f20-5f7c-5084-92de-b0e69f17457e with identifier: PE88968
2026-03-27 10:48:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e77a5f20-5f7c-5084-92de-b0e69f17457e with scrape type 2
2026-03-27 10:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e77a5f20-5f7c-5084-92de-b0e69f17457e with scrape type 2
2026-03-27 10:48:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e77a5f20-5f7c-5084-92de-b0e69f17457e, identifier: PE88968
2026-03-27 10:48:01 [auto1.de] INFO: Found listing with ID: AK65785
2026-03-27 10:48:01 [auto1.de] INFO: Found listing with ID: DX61886
2026-03-27 10:48:01 [auto1.de] INFO: Found listing with ID: GN84809
2026-03-27 10:48:01 [auto1.de] INFO: Found listing with ID: RS52276
2026-03-27 10:48:01 [auto1.de] INFO: Found listing with ID: TJ16115
2026-03-27 10:48:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e77a5f20-5f7c-5084-92de-b0e69f17457e with identifier: PE88968
2026-03-27 10:48:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e77a5f20-5f7c-5084-92de-b0e69f17457e with identifier: PE88968
2026-03-27 10:48:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e77a5f20-5f7c-5084-92de-b0e69f17457e with identifier: PE88968 to the API
2026-03-27 10:48:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-28T16:28:42Z',
 'fuel_type': 'diesel',
 'id': 'e77a5f20-5f7c-5084-92de-b0e69f17457e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE88968',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 353995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-25',
 'seller_name': None,
 'title': 'BMW X5 3.0d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-27 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE88968%27 HTTP/1.1" 200 None
2026-03-27 10:48:01 [auto1.de] INFO: Saving data for PE88968: {'auction_closing_time': 1774715322.0, 'created_time': 1773687900.911489, 'last_price_update_time': 1774608481.943181}
2026-03-27 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE88968') HTTP/1.1" 204 0
2026-03-27 10:48:02 [auto1.de] INFO: Found listing with ID: DG35961
2026-03-27 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG35961%27 HTTP/1.1" 200 None
2026-03-27 10:48:02 [auto1.de] INFO: Scrape type for DG35961: 2
2026-03-27 10:48:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 862f8487-4ffd-5030-9284-77a35a5d4a5d with identifier: DG35961
2026-03-27 10:48:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 862f8487-4ffd-5030-9284-77a35a5d4a5d with scrape type 2
2026-03-27 10:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 862f8487-4ffd-5030-9284-77a35a5d4a5d with scrape type 2
2026-03-27 10:48:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 862f8487-4ffd-5030-9284-77a35a5d4a5d, identifier: DG35961
2026-03-27 10:48:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 862f8487-4ffd-5030-9284-77a35a5d4a5d with identifier: DG35961
2026-03-27 10:48:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 862f8487-4ffd-5030-9284-77a35a5d4a5d with identifier: DG35961
2026-03-27 10:48:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 862f8487-4ffd-5030-9284-77a35a5d4a5d with identifier: DG35961 to the API
2026-03-27 10:48:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:39:06Z',
 'fuel_type': 'petrol',
 'id': '862f8487-4ffd-5030-9284-77a35a5d4a5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG35961',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 99624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-05',
 'seller_name': None,
 'title': 'Fiat Punto 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2005}
2026-03-27 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG35961%27 HTTP/1.1" 200 None
2026-03-27 10:48:02 [auto1.de] INFO: Saving data for DG35961: {'auction_closing_time': 1774715946.0, 'created_time': 1773689068.822942, 'last_price_update_time': 1774608482.888307}
2026-03-27 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG35961') HTTP/1.1" 204 0
2026-03-27 10:48:02 [auto1.de] INFO: Found listing with ID: WJ93096
2026-03-27 10:48:02 [auto1.de] INFO: Found listing with ID: PE74408
2026-03-27 10:48:02 [auto1.de] INFO: Found listing with ID: UY58997
2026-03-27 10:48:02 [auto1.de] INFO: Found listing with ID: GG04913
2026-03-27 10:48:02 [auto1.de] INFO: Found listing with ID: DM95893
2026-03-27 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM95893%27 HTTP/1.1" 200 None
2026-03-27 10:48:02 [auto1.de] INFO: Scrape type for DM95893: 2
2026-03-27 10:48:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 554b29d2-a347-5b52-86dd-7131753e682d with identifier: DM95893
2026-03-27 10:48:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 554b29d2-a347-5b52-86dd-7131753e682d with scrape type 2
2026-03-27 10:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 554b29d2-a347-5b52-86dd-7131753e682d with scrape type 2
2026-03-27 10:48:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 554b29d2-a347-5b52-86dd-7131753e682d, identifier: DM95893
2026-03-27 10:48:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 554b29d2-a347-5b52-86dd-7131753e682d with identifier: DM95893
2026-03-27 10:48:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 554b29d2-a347-5b52-86dd-7131753e682d with identifier: DM95893
2026-03-27 10:48:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 554b29d2-a347-5b52-86dd-7131753e682d with identifier: DM95893 to the API
2026-03-27 10:48:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:47:33Z',
 'fuel_type': 'diesel',
 'id': '554b29d2-a347-5b52-86dd-7131753e682d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM95893',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 186747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-18',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2018}
2026-03-27 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM95893%27 HTTP/1.1" 200 None
2026-03-27 10:48:03 [auto1.de] INFO: Saving data for DM95893: {'auction_closing_time': 1774716453.0, 'created_time': 1773858966.321153, 'last_price_update_time': 1774608483.337095}
2026-03-27 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM95893') HTTP/1.1" 204 0
2026-03-27 10:48:03 [auto1.de] INFO: Found listing with ID: ZV64166
2026-03-27 10:48:03 [auto1.de] INFO: Found listing with ID: JL44277
2026-03-27 10:48:03 [auto1.de] INFO: Found listing with ID: BH52991
2026-03-27 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH52991%27 HTTP/1.1" 200 None
2026-03-27 10:48:03 [auto1.de] INFO: Scrape type for BH52991: 2
2026-03-27 10:48:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c245e84d-4d51-5afd-a186-d7366278e0a2 with identifier: BH52991
2026-03-27 10:48:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c245e84d-4d51-5afd-a186-d7366278e0a2 with scrape type 2
2026-03-27 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c245e84d-4d51-5afd-a186-d7366278e0a2 with scrape type 2
2026-03-27 10:48:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c245e84d-4d51-5afd-a186-d7366278e0a2, identifier: BH52991
2026-03-27 10:48:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c245e84d-4d51-5afd-a186-d7366278e0a2 with identifier: BH52991
2026-03-27 10:48:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c245e84d-4d51-5afd-a186-d7366278e0a2 with identifier: BH52991
2026-03-27 10:48:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c245e84d-4d51-5afd-a186-d7366278e0a2 with identifier: BH52991 to the API
2026-03-27 10:48:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:25:06Z',
 'fuel_type': 'diesel',
 'id': 'c245e84d-4d51-5afd-a186-d7366278e0a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH52991',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 217795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-13',
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Business Class',
 'transmission': 'manual',
 'trim': 'Business Class',
 'year': 2013}
2026-03-27 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH52991%27 HTTP/1.1" 200 None
2026-03-27 10:48:03 [auto1.de] INFO: Saving data for BH52991: {'auction_closing_time': 1774715106.0, 'created_time': 1773401314.713024, 'last_price_update_time': 1774608483.788518}
2026-03-27 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH52991') HTTP/1.1" 204 0
2026-03-27 10:48:03 [auto1.de] INFO: Found listing with ID: ZS47676
2026-03-27 10:48:03 [auto1.de] INFO: Found listing with ID: EG39650
2026-03-27 10:48:03 [auto1.de] INFO: Found listing with ID: XD89320
2026-03-27 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD89320%27 HTTP/1.1" 200 None
2026-03-27 10:48:03 [auto1.de] INFO: Scrape type for XD89320: 2
2026-03-27 10:48:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2f67830-93b5-5be8-a012-51868dbdf652 with identifier: XD89320
2026-03-27 10:48:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2f67830-93b5-5be8-a012-51868dbdf652 with scrape type 2
2026-03-27 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2f67830-93b5-5be8-a012-51868dbdf652 with scrape type 2
2026-03-27 10:48:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2f67830-93b5-5be8-a012-51868dbdf652, identifier: XD89320
2026-03-27 10:48:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2f67830-93b5-5be8-a012-51868dbdf652 with identifier: XD89320
2026-03-27 10:48:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2f67830-93b5-5be8-a012-51868dbdf652 with identifier: XD89320
2026-03-27 10:48:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2f67830-93b5-5be8-a012-51868dbdf652 with identifier: XD89320 to the API
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:35:54Z',
 'fuel_type': 'petrol',
 'id': 'd2f67830-93b5-5be8-a012-51868dbdf652',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD89320',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 117789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-11',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2014}
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD89320%27 HTTP/1.1" 200 None
2026-03-27 10:48:04 [auto1.de] INFO: Saving data for XD89320: {'auction_closing_time': 1774715754.0, 'created_time': 1773401439.753579, 'last_price_update_time': 1774608484.239219}
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD89320') HTTP/1.1" 204 0
2026-03-27 10:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: KB62018
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: BK94674
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: XR69964
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR69964%27 HTTP/1.1" 200 None
2026-03-27 10:48:04 [auto1.de] INFO: Scrape type for XR69964: 2
2026-03-27 10:48:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34ea99b0-957c-5d11-ac60-e10e72cfdb88 with identifier: XR69964
2026-03-27 10:48:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34ea99b0-957c-5d11-ac60-e10e72cfdb88 with scrape type 2
2026-03-27 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34ea99b0-957c-5d11-ac60-e10e72cfdb88 with scrape type 2
2026-03-27 10:48:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34ea99b0-957c-5d11-ac60-e10e72cfdb88, identifier: XR69964
2026-03-27 10:48:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34ea99b0-957c-5d11-ac60-e10e72cfdb88 with identifier: XR69964
2026-03-27 10:48:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34ea99b0-957c-5d11-ac60-e10e72cfdb88 with identifier: XR69964
2026-03-27 10:48:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34ea99b0-957c-5d11-ac60-e10e72cfdb88 with identifier: XR69964 to the API
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:57:47Z',
 'fuel_type': 'petrol',
 'id': '34ea99b0-957c-5d11-ac60-e10e72cfdb88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR69964',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 159236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-04',
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR69964%27 HTTP/1.1" 200 None
2026-03-27 10:48:04 [auto1.de] INFO: Saving data for XR69964: {'auction_closing_time': 1774717067.0, 'created_time': 1773732952.323723, 'last_price_update_time': 1774608484.819794}
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR69964') HTTP/1.1" 204 0
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: HD14897
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: EC93517
2026-03-27 10:48:04 [auto1.de] INFO: Found listing with ID: CA38480
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA38480%27 HTTP/1.1" 200 None
2026-03-27 10:48:04 [auto1.de] INFO: Scrape type for CA38480: 2
2026-03-27 10:48:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac with identifier: CA38480
2026-03-27 10:48:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac with scrape type 2
2026-03-27 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac with scrape type 2
2026-03-27 10:48:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac, identifier: CA38480
2026-03-27 10:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU48960/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac with identifier: CA38480
2026-03-27 10:48:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac with identifier: CA38480
2026-03-27 10:48:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac with identifier: CA38480 to the API
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:40:25Z',
 'fuel_type': 'petrol',
 'id': '1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA38480',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'Z4',
 'odometer': 124018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-05',
 'seller_name': None,
 'title': 'BMW Z4 sDrive 30i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA38480%27 HTTP/1.1" 200 None
2026-03-27 10:48:05 [auto1.de] INFO: Saving data for CA38480: {'auction_closing_time': 1774716025.0, 'created_time': 1773686206.157547, 'last_price_update_time': 1774608485.43655}
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA38480') HTTP/1.1" 204 0
2026-03-27 10:48:05 [auto1.de] INFO: Channel: 24h | Page: 42 | totalHits: 10558 | hits on page: 40
2026-03-27 10:48:05 [auto1.de] INFO: Found listing with ID: WP47747
2026-03-27 10:48:05 [auto1.de] INFO: Found listing with ID: ZZ79893
2026-03-27 10:48:05 [auto1.de] INFO: Found listing with ID: AR19685
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR19685%27 HTTP/1.1" 200 None
2026-03-27 10:48:05 [auto1.de] INFO: Scrape type for AR19685: 2
2026-03-27 10:48:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bac0db4c-2fb6-50ca-9e6a-94a67850eed9 with identifier: AR19685
2026-03-27 10:48:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bac0db4c-2fb6-50ca-9e6a-94a67850eed9 with scrape type 2
2026-03-27 10:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bac0db4c-2fb6-50ca-9e6a-94a67850eed9 with scrape type 2
2026-03-27 10:48:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bac0db4c-2fb6-50ca-9e6a-94a67850eed9, identifier: AR19685
2026-03-27 10:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JV29717/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bac0db4c-2fb6-50ca-9e6a-94a67850eed9 with identifier: AR19685
2026-03-27 10:48:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bac0db4c-2fb6-50ca-9e6a-94a67850eed9 with identifier: AR19685
2026-03-27 10:48:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bac0db4c-2fb6-50ca-9e6a-94a67850eed9 with identifier: AR19685 to the API
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:56:42Z',
 'fuel_type': 'hybrid',
 'id': 'bac0db4c-2fb6-50ca-9e6a-94a67850eed9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR19685',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 84667,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-18',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR19685%27 HTTP/1.1" 200 None
2026-03-27 10:48:05 [auto1.de] INFO: Saving data for AR19685: {'auction_closing_time': 1774717002.0, 'created_time': 1773301624.038718, 'last_price_update_time': 1774608485.888254}
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR19685') HTTP/1.1" 204 0
2026-03-27 10:48:05 [auto1.de] INFO: Found listing with ID: YJ19270
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ19270%27 HTTP/1.1" 200 None
2026-03-27 10:48:05 [auto1.de] INFO: Scrape type for YJ19270: 2
2026-03-27 10:48:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b2259c8-ff4b-5bb2-982d-b1d787e7c128 with identifier: YJ19270
2026-03-27 10:48:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b2259c8-ff4b-5bb2-982d-b1d787e7c128 with scrape type 2
2026-03-27 10:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b2259c8-ff4b-5bb2-982d-b1d787e7c128 with scrape type 2
2026-03-27 10:48:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b2259c8-ff4b-5bb2-982d-b1d787e7c128, identifier: YJ19270
2026-03-27 10:48:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:06 [auto1.de] INFO: Found listing with ID: NA39997
2026-03-27 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA39997%27 HTTP/1.1" 200 None
2026-03-27 10:48:06 [auto1.de] INFO: Scrape type for NA39997: 2
2026-03-27 10:48:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 953fa758-7e5a-5ae5-ab72-fa71fec34dd3 with identifier: NA39997
2026-03-27 10:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 953fa758-7e5a-5ae5-ab72-fa71fec34dd3 with scrape type 2
2026-03-27 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 953fa758-7e5a-5ae5-ab72-fa71fec34dd3 with scrape type 2
2026-03-27 10:48:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 953fa758-7e5a-5ae5-ab72-fa71fec34dd3, identifier: NA39997
2026-03-27 10:48:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b2259c8-ff4b-5bb2-982d-b1d787e7c128 with identifier: YJ19270
2026-03-27 10:48:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b2259c8-ff4b-5bb2-982d-b1d787e7c128 with identifier: YJ19270
2026-03-27 10:48:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b2259c8-ff4b-5bb2-982d-b1d787e7c128 with identifier: YJ19270 to the API
2026-03-27 10:48:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:41:00Z',
 'fuel_type': 'petrol',
 'id': '6b2259c8-ff4b-5bb2-982d-b1d787e7c128',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ19270',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 69432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-04',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2019}
2026-03-27 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ19270%27 HTTP/1.1" 200 None
2026-03-27 10:48:06 [auto1.de] INFO: Saving data for YJ19270: {'auction_closing_time': 1774716060.0, 'created_time': 1773861661.218184, 'last_price_update_time': 1774608486.52612}
2026-03-27 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ19270') HTTP/1.1" 204 0
2026-03-27 10:48:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 953fa758-7e5a-5ae5-ab72-fa71fec34dd3 with identifier: NA39997
2026-03-27 10:48:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 953fa758-7e5a-5ae5-ab72-fa71fec34dd3 with identifier: NA39997
2026-03-27 10:48:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 953fa758-7e5a-5ae5-ab72-fa71fec34dd3 with identifier: NA39997 to the API
2026-03-27 10:48:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:04:18Z',
 'fuel_type': 'petrol',
 'id': '953fa758-7e5a-5ae5-ab72-fa71fec34dd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA39997',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 116813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-24',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-27 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA39997%27 HTTP/1.1" 200 None
2026-03-27 10:48:06 [auto1.de] INFO: Saving data for NA39997: {'auction_closing_time': 1774713858.0, 'created_time': 1773303371.600227, 'last_price_update_time': 1774608486.957508}
2026-03-27 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA39997') HTTP/1.1" 204 0
2026-03-27 10:48:06 [auto1.de] INFO: Found listing with ID: XC54847
2026-03-27 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC54847%27 HTTP/1.1" 200 None
2026-03-27 10:48:06 [auto1.de] INFO: Scrape type for XC54847: 2
2026-03-27 10:48:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94cff63e-1ade-50c7-a6f7-6d82f95a28f3 with identifier: XC54847
2026-03-27 10:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94cff63e-1ade-50c7-a6f7-6d82f95a28f3 with scrape type 2
2026-03-27 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94cff63e-1ade-50c7-a6f7-6d82f95a28f3 with scrape type 2
2026-03-27 10:48:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94cff63e-1ade-50c7-a6f7-6d82f95a28f3, identifier: XC54847
2026-03-27 10:48:07 [auto1.de] INFO: Found listing with ID: HK54486
2026-03-27 10:48:07 [auto1.de] INFO: Found listing with ID: LR85001
2026-03-27 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR85001%27 HTTP/1.1" 200 None
2026-03-27 10:48:07 [auto1.de] INFO: Scrape type for LR85001: 2
2026-03-27 10:48:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8855642-69c3-5419-94e0-4fedac5943c0 with identifier: LR85001
2026-03-27 10:48:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8855642-69c3-5419-94e0-4fedac5943c0 with scrape type 2
2026-03-27 10:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8855642-69c3-5419-94e0-4fedac5943c0 with scrape type 2
2026-03-27 10:48:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8855642-69c3-5419-94e0-4fedac5943c0, identifier: LR85001
2026-03-27 10:48:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94cff63e-1ade-50c7-a6f7-6d82f95a28f3 with identifier: XC54847
2026-03-27 10:48:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94cff63e-1ade-50c7-a6f7-6d82f95a28f3 with identifier: XC54847
2026-03-27 10:48:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94cff63e-1ade-50c7-a6f7-6d82f95a28f3 with identifier: XC54847 to the API
2026-03-27 10:48:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:19:46Z',
 'fuel_type': 'petrol',
 'id': '94cff63e-1ade-50c7-a6f7-6d82f95a28f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC54847',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 163517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-21',
 'seller_name': None,
 'title': 'BMW 5er 523i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-27 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC54847%27 HTTP/1.1" 200 None
2026-03-27 10:48:07 [auto1.de] INFO: Saving data for XC54847: {'auction_closing_time': 1774714786.0, 'created_time': 1773305245.493745, 'last_price_update_time': 1774608487.533717}
2026-03-27 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC54847') HTTP/1.1" 204 0
2026-03-27 10:48:07 [scrapy.extensions.logstats] INFO: Crawled 406 pages (at 14 pages/min), scraped 740 items (at 93 items/min)
2026-03-27 10:48:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 10:48:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8855642-69c3-5419-94e0-4fedac5943c0 with identifier: LR85001
2026-03-27 10:48:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8855642-69c3-5419-94e0-4fedac5943c0 with identifier: LR85001
2026-03-27 10:48:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8855642-69c3-5419-94e0-4fedac5943c0 with identifier: LR85001 to the API
2026-03-27 10:48:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:33:04Z',
 'fuel_type': 'diesel',
 'id': 'd8855642-69c3-5419-94e0-4fedac5943c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR85001',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 296009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-09',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 114 CDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2017}
2026-03-27 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR85001%27 HTTP/1.1" 200 None
2026-03-27 10:48:07 [auto1.de] INFO: Saving data for LR85001: {'auction_closing_time': 1774715584.0, 'created_time': 1773401169.283806, 'last_price_update_time': 1774608487.906234}
2026-03-27 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR85001') HTTP/1.1" 204 0
2026-03-27 10:48:07 [auto1.de] INFO: Found listing with ID: EN47046
2026-03-27 10:48:07 [auto1.de] INFO: Found listing with ID: DF63833
2026-03-27 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF63833%27 HTTP/1.1" 200 None
2026-03-27 10:48:07 [auto1.de] INFO: Scrape type for DF63833: 2
2026-03-27 10:48:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed48b641-bcbe-5e87-81c0-2a01c90703b8 with identifier: DF63833
2026-03-27 10:48:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed48b641-bcbe-5e87-81c0-2a01c90703b8 with scrape type 2
2026-03-27 10:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed48b641-bcbe-5e87-81c0-2a01c90703b8 with scrape type 2
2026-03-27 10:48:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed48b641-bcbe-5e87-81c0-2a01c90703b8, identifier: DF63833
2026-03-27 10:48:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:08 [auto1.de] INFO: Found listing with ID: PK38056
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK38056%27 HTTP/1.1" 200 None
2026-03-27 10:48:08 [auto1.de] INFO: Scrape type for PK38056: 2
2026-03-27 10:48:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02ce3750-4fc2-521f-ab84-c34c1a9a7a61 with identifier: PK38056
2026-03-27 10:48:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02ce3750-4fc2-521f-ab84-c34c1a9a7a61 with scrape type 2
2026-03-27 10:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02ce3750-4fc2-521f-ab84-c34c1a9a7a61 with scrape type 2
2026-03-27 10:48:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02ce3750-4fc2-521f-ab84-c34c1a9a7a61, identifier: PK38056
2026-03-27 10:48:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed48b641-bcbe-5e87-81c0-2a01c90703b8 with identifier: DF63833
2026-03-27 10:48:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed48b641-bcbe-5e87-81c0-2a01c90703b8 with identifier: DF63833
2026-03-27 10:48:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed48b641-bcbe-5e87-81c0-2a01c90703b8 with identifier: DF63833 to the API
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:48:43Z',
 'fuel_type': 'diesel',
 'id': 'ed48b641-bcbe-5e87-81c0-2a01c90703b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF63833',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 111776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-01',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2020}
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF63833%27 HTTP/1.1" 200 None
2026-03-27 10:48:08 [auto1.de] INFO: Saving data for DF63833: {'auction_closing_time': 1774716523.0, 'created_time': 1773383086.297877, 'last_price_update_time': 1774608488.517801}
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF63833') HTTP/1.1" 204 0
2026-03-27 10:48:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02ce3750-4fc2-521f-ab84-c34c1a9a7a61 with identifier: PK38056
2026-03-27 10:48:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02ce3750-4fc2-521f-ab84-c34c1a9a7a61 with identifier: PK38056
2026-03-27 10:48:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02ce3750-4fc2-521f-ab84-c34c1a9a7a61 with identifier: PK38056 to the API
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:48:31Z',
 'fuel_type': 'petrol',
 'id': '02ce3750-4fc2-521f-ab84-c34c1a9a7a61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK38056',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 231862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-28',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2010}
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK38056%27 HTTP/1.1" 200 None
2026-03-27 10:48:08 [auto1.de] INFO: Saving data for PK38056: {'auction_closing_time': 1774716511.0, 'created_time': 1773861139.727464, 'last_price_update_time': 1774608488.932192}
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK38056') HTTP/1.1" 204 0
2026-03-27 10:48:08 [auto1.de] INFO: Found listing with ID: MS86460
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS86460%27 HTTP/1.1" 200 None
2026-03-27 10:48:08 [auto1.de] INFO: Scrape type for MS86460: 2
2026-03-27 10:48:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d with identifier: MS86460
2026-03-27 10:48:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d with scrape type 2
2026-03-27 10:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d with scrape type 2
2026-03-27 10:48:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d, identifier: MS86460
2026-03-27 10:48:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: KK51592
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK51592%27 HTTP/1.1" 200 None
2026-03-27 10:48:09 [auto1.de] INFO: Scrape type for KK51592: 1
2026-03-27 10:48:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d with identifier: MS86460
2026-03-27 10:48:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d with identifier: MS86460
2026-03-27 10:48:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d with identifier: MS86460 to the API
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:05:04Z',
 'fuel_type': 'diesel',
 'id': 'df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS86460',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 157618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-29',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS86460%27 HTTP/1.1" 200 None
2026-03-27 10:48:09 [auto1.de] INFO: Saving data for MS86460: {'auction_closing_time': 1774713904.0, 'created_time': 1773402213.553474, 'last_price_update_time': 1774608489.518164}
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS86460') HTTP/1.1" 204 0
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: ZU48886
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU48886%27 HTTP/1.1" 200 None
2026-03-27 10:48:09 [auto1.de] INFO: Scrape type for ZU48886: 2
2026-03-27 10:48:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4133d45-57bd-557c-bb08-5ae85945d7ae with identifier: ZU48886
2026-03-27 10:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4133d45-57bd-557c-bb08-5ae85945d7ae with scrape type 2
2026-03-27 10:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4133d45-57bd-557c-bb08-5ae85945d7ae with scrape type 2
2026-03-27 10:48:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4133d45-57bd-557c-bb08-5ae85945d7ae, identifier: ZU48886
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: XD58993
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: PA88457
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: CU93791
2026-03-27 10:48:09 [auto1.de] INFO: Found listing with ID: RC78323
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC78323%27 HTTP/1.1" 200 None
2026-03-27 10:48:09 [auto1.de] INFO: Scrape type for RC78323: 2
2026-03-27 10:48:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69289757-5979-5a6e-9285-c307ec39bc45 with identifier: RC78323
2026-03-27 10:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69289757-5979-5a6e-9285-c307ec39bc45 with scrape type 2
2026-03-27 10:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69289757-5979-5a6e-9285-c307ec39bc45 with scrape type 2
2026-03-27 10:48:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69289757-5979-5a6e-9285-c307ec39bc45, identifier: RC78323
2026-03-27 10:48:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4133d45-57bd-557c-bb08-5ae85945d7ae with identifier: ZU48886
2026-03-27 10:48:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4133d45-57bd-557c-bb08-5ae85945d7ae with identifier: ZU48886
2026-03-27 10:48:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4133d45-57bd-557c-bb08-5ae85945d7ae with identifier: ZU48886 to the API
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:44:09Z',
 'fuel_type': 'petrol',
 'id': 'e4133d45-57bd-557c-bb08-5ae85945d7ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU48886',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 182132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-12',
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-27 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU48886%27 HTTP/1.1" 200 None
2026-03-27 10:48:10 [auto1.de] INFO: Saving data for ZU48886: {'auction_closing_time': 1774716249.0, 'created_time': 1773688878.788102, 'last_price_update_time': 1774608490.08704}
2026-03-27 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU48886') HTTP/1.1" 204 0
2026-03-27 10:48:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69289757-5979-5a6e-9285-c307ec39bc45 with identifier: RC78323
2026-03-27 10:48:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69289757-5979-5a6e-9285-c307ec39bc45 with identifier: RC78323
2026-03-27 10:48:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69289757-5979-5a6e-9285-c307ec39bc45 with identifier: RC78323 to the API
2026-03-27 10:48:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:10:58Z',
 'fuel_type': 'diesel',
 'id': '69289757-5979-5a6e-9285-c307ec39bc45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC78323',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 310154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-31',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-27 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC78323%27 HTTP/1.1" 200 None
2026-03-27 10:48:10 [auto1.de] INFO: Saving data for RC78323: {'auction_closing_time': 1774714258.0, 'created_time': 1773307252.562048, 'last_price_update_time': 1774608490.565819}
2026-03-27 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC78323') HTTP/1.1" 204 0
2026-03-27 10:48:10 [auto1.de] INFO: Found listing with ID: NC07165
2026-03-27 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC07165%27 HTTP/1.1" 200 None
2026-03-27 10:48:10 [auto1.de] INFO: Scrape type for NC07165: 2
2026-03-27 10:48:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23e20c78-22ae-553e-bea3-0fb0b9d05184 with identifier: NC07165
2026-03-27 10:48:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23e20c78-22ae-553e-bea3-0fb0b9d05184 with scrape type 2
2026-03-27 10:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23e20c78-22ae-553e-bea3-0fb0b9d05184 with scrape type 2
2026-03-27 10:48:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23e20c78-22ae-553e-bea3-0fb0b9d05184, identifier: NC07165
2026-03-27 10:48:10 [auto1.de] INFO: Found listing with ID: XA05617
2026-03-27 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA05617%27 HTTP/1.1" 200 None
2026-03-27 10:48:10 [auto1.de] INFO: Scrape type for XA05617: 2
2026-03-27 10:48:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc3c4b08-3b82-5a58-b5e5-282acadf2628 with identifier: XA05617
2026-03-27 10:48:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc3c4b08-3b82-5a58-b5e5-282acadf2628 with scrape type 2
2026-03-27 10:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc3c4b08-3b82-5a58-b5e5-282acadf2628 with scrape type 2
2026-03-27 10:48:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc3c4b08-3b82-5a58-b5e5-282acadf2628, identifier: XA05617
2026-03-27 10:48:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23e20c78-22ae-553e-bea3-0fb0b9d05184 with identifier: NC07165
2026-03-27 10:48:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23e20c78-22ae-553e-bea3-0fb0b9d05184 with identifier: NC07165
2026-03-27 10:48:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23e20c78-22ae-553e-bea3-0fb0b9d05184 with identifier: NC07165 to the API
2026-03-27 10:48:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:14:34Z',
 'fuel_type': 'diesel',
 'id': '23e20c78-22ae-553e-bea3-0fb0b9d05184',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC07165',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 152443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-13',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2013}
2026-03-27 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC07165%27 HTTP/1.1" 200 None
2026-03-27 10:48:11 [auto1.de] INFO: Saving data for NC07165: {'auction_closing_time': 1774714474.0, 'created_time': 1773772525.232938, 'last_price_update_time': 1774608491.184704}
2026-03-27 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC07165') HTTP/1.1" 204 0
2026-03-27 10:48:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc3c4b08-3b82-5a58-b5e5-282acadf2628 with identifier: XA05617
2026-03-27 10:48:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc3c4b08-3b82-5a58-b5e5-282acadf2628 with identifier: XA05617
2026-03-27 10:48:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc3c4b08-3b82-5a58-b5e5-282acadf2628 with identifier: XA05617 to the API
2026-03-27 10:48:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:14:11Z',
 'fuel_type': 'petrol',
 'id': 'bc3c4b08-3b82-5a58-b5e5-282acadf2628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA05617',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 158300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-31',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-27 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA05617%27 HTTP/1.1" 200 None
2026-03-27 10:48:11 [auto1.de] INFO: Saving data for XA05617: {'auction_closing_time': 1774714451.0, 'created_time': 1773383087.839684, 'last_price_update_time': 1774608491.541054}
2026-03-27 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA05617') HTTP/1.1" 204 0
2026-03-27 10:48:11 [auto1.de] INFO: Found listing with ID: NU47228
2026-03-27 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU47228%27 HTTP/1.1" 200 None
2026-03-27 10:48:11 [auto1.de] INFO: Scrape type for NU47228: 2
2026-03-27 10:48:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 466e3ba1-442e-5d10-b729-3c813070917a with identifier: NU47228
2026-03-27 10:48:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 466e3ba1-442e-5d10-b729-3c813070917a with scrape type 2
2026-03-27 10:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 466e3ba1-442e-5d10-b729-3c813070917a with scrape type 2
2026-03-27 10:48:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 466e3ba1-442e-5d10-b729-3c813070917a, identifier: NU47228
2026-03-27 10:48:11 [auto1.de] INFO: Found listing with ID: VB96558
2026-03-27 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB96558%27 HTTP/1.1" 200 None
2026-03-27 10:48:11 [auto1.de] INFO: Scrape type for VB96558: 2
2026-03-27 10:48:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 449f08bb-ac24-543d-8dbe-c0b409c9a547 with identifier: VB96558
2026-03-27 10:48:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 449f08bb-ac24-543d-8dbe-c0b409c9a547 with scrape type 2
2026-03-27 10:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 449f08bb-ac24-543d-8dbe-c0b409c9a547 with scrape type 2
2026-03-27 10:48:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 449f08bb-ac24-543d-8dbe-c0b409c9a547, identifier: VB96558
2026-03-27 10:48:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 466e3ba1-442e-5d10-b729-3c813070917a with identifier: NU47228
2026-03-27 10:48:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 466e3ba1-442e-5d10-b729-3c813070917a with identifier: NU47228
2026-03-27 10:48:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 466e3ba1-442e-5d10-b729-3c813070917a with identifier: NU47228 to the API
2026-03-27 10:48:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:00:46Z',
 'fuel_type': 'petrol',
 'id': '466e3ba1-442e-5d10-b729-3c813070917a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU47228',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 118552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-14',
 'seller_name': None,
 'title': "Renault Megane 1.6 Je t'aime",
 'transmission': 'manual',
 'trim': "Je t'aime",
 'year': 2011}
2026-03-27 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU47228%27 HTTP/1.1" 200 None
2026-03-27 10:48:12 [auto1.de] INFO: Saving data for NU47228: {'auction_closing_time': 1774713646.0, 'created_time': 1773401167.45213, 'last_price_update_time': 1774608492.12517}
2026-03-27 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU47228') HTTP/1.1" 204 0
2026-03-27 10:48:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 449f08bb-ac24-543d-8dbe-c0b409c9a547 with identifier: VB96558
2026-03-27 10:48:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 449f08bb-ac24-543d-8dbe-c0b409c9a547 with identifier: VB96558
2026-03-27 10:48:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 449f08bb-ac24-543d-8dbe-c0b409c9a547 with identifier: VB96558 to the API
2026-03-27 10:48:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:40:43Z',
 'fuel_type': 'diesel',
 'id': '449f08bb-ac24-543d-8dbe-c0b409c9a547',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB96558',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 153124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-14',
 'seller_name': None,
 'title': 'Skoda Karoq 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2017}
2026-03-27 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB96558%27 HTTP/1.1" 200 None
2026-03-27 10:48:12 [auto1.de] INFO: Saving data for VB96558: {'auction_closing_time': 1774716043.0, 'created_time': 1773307711.84879, 'last_price_update_time': 1774608492.459544}
2026-03-27 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VB96558') HTTP/1.1" 204 0
2026-03-27 10:48:12 [auto1.de] INFO: Found listing with ID: FA01437
2026-03-27 10:48:12 [auto1.de] INFO: Found listing with ID: PF96299
2026-03-27 10:48:12 [auto1.de] INFO: Found listing with ID: YW30878
2026-03-27 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW30878%27 HTTP/1.1" 200 None
2026-03-27 10:48:12 [auto1.de] INFO: Scrape type for YW30878: 2
2026-03-27 10:48:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abcc4438-1203-530a-9154-115fa3c28a5d with identifier: YW30878
2026-03-27 10:48:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abcc4438-1203-530a-9154-115fa3c28a5d with scrape type 2
2026-03-27 10:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abcc4438-1203-530a-9154-115fa3c28a5d with scrape type 2
2026-03-27 10:48:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abcc4438-1203-530a-9154-115fa3c28a5d, identifier: YW30878
2026-03-27 10:48:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abcc4438-1203-530a-9154-115fa3c28a5d with identifier: YW30878
2026-03-27 10:48:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abcc4438-1203-530a-9154-115fa3c28a5d with identifier: YW30878
2026-03-27 10:48:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abcc4438-1203-530a-9154-115fa3c28a5d with identifier: YW30878 to the API
2026-03-27 10:48:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:51:42Z',
 'fuel_type': 'diesel',
 'id': 'abcc4438-1203-530a-9154-115fa3c28a5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW30878',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 317085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-28',
 'seller_name': None,
 'title': 'BMW 4er 420d Gran Coupé Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2015}
2026-03-27 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW30878%27 HTTP/1.1" 200 None
2026-03-27 10:48:13 [auto1.de] INFO: Saving data for YW30878: {'auction_closing_time': 1774716702.0, 'created_time': 1773858941.75772, 'last_price_update_time': 1774608493.047828}
2026-03-27 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW30878') HTTP/1.1" 204 0
2026-03-27 10:48:13 [auto1.de] INFO: Found listing with ID: WS30363
2026-03-27 10:48:13 [auto1.de] INFO: Found listing with ID: KV22200
2026-03-27 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV22200%27 HTTP/1.1" 200 None
2026-03-27 10:48:13 [auto1.de] INFO: Scrape type for KV22200: 1
2026-03-27 10:48:13 [auto1.de] INFO: Found listing with ID: XL62342
2026-03-27 10:48:13 [auto1.de] INFO: Found listing with ID: MS46414
2026-03-27 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS46414%27 HTTP/1.1" 200 None
2026-03-27 10:48:13 [auto1.de] INFO: Scrape type for MS46414: 2
2026-03-27 10:48:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 503f72bb-64fa-5a0d-b94d-40863b41395d with identifier: MS46414
2026-03-27 10:48:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 503f72bb-64fa-5a0d-b94d-40863b41395d with scrape type 2
2026-03-27 10:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 503f72bb-64fa-5a0d-b94d-40863b41395d with scrape type 2
2026-03-27 10:48:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 503f72bb-64fa-5a0d-b94d-40863b41395d, identifier: MS46414
2026-03-27 10:48:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 503f72bb-64fa-5a0d-b94d-40863b41395d with identifier: MS46414
2026-03-27 10:48:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 503f72bb-64fa-5a0d-b94d-40863b41395d with identifier: MS46414
2026-03-27 10:48:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 503f72bb-64fa-5a0d-b94d-40863b41395d with identifier: MS46414 to the API
2026-03-27 10:48:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:12:19Z',
 'fuel_type': 'diesel',
 'id': '503f72bb-64fa-5a0d-b94d-40863b41395d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS46414',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'C30',
 'odometer': 106636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-01-30',
 'seller_name': None,
 'title': 'Volvo C30 1.6 D Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2007}
2026-03-27 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS46414%27 HTTP/1.1" 200 None
2026-03-27 10:48:13 [auto1.de] INFO: Saving data for MS46414: {'auction_closing_time': 1774714339.0, 'created_time': 1772544816.353118, 'last_price_update_time': 1774608493.533937}
2026-03-27 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS46414') HTTP/1.1" 204 0
2026-03-27 10:48:13 [auto1.de] INFO: Found listing with ID: JV32404
2026-03-27 10:48:13 [auto1.de] INFO: Found listing with ID: LT68556
2026-03-27 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT68556%27 HTTP/1.1" 200 None
2026-03-27 10:48:13 [auto1.de] INFO: Scrape type for LT68556: 1
2026-03-27 10:48:13 [auto1.de] INFO: Found listing with ID: KF96010
2026-03-27 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96010%27 HTTP/1.1" 200 None
2026-03-27 10:48:13 [auto1.de] INFO: Scrape type for KF96010: 2
2026-03-27 10:48:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21 with identifier: KF96010
2026-03-27 10:48:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21 with scrape type 2
2026-03-27 10:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21 with scrape type 2
2026-03-27 10:48:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21, identifier: KF96010
2026-03-27 10:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JV29717> (referer: https://www.auto1.com/v1/car-details-view/JV29717/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21 with identifier: KF96010
2026-03-27 10:48:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21 with identifier: KF96010
2026-03-27 10:48:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21 with identifier: KF96010 to the API
2026-03-27 10:48:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 326,
 'expiration_date': '2026-03-28T16:51:15Z',
 'fuel_type': 'hybrid',
 'id': '96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF96010',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 61499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-22',
 'seller_name': None,
 'title': 'BMW 7er 740e L',
 'transmission': 'automatic',
 'trim': 'L',
 'year': 2017}
2026-03-27 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96010%27 HTTP/1.1" 200 None
2026-03-27 10:48:14 [auto1.de] INFO: Saving data for KF96010: {'auction_closing_time': 1774716675.0, 'created_time': 1773308230.26714, 'last_price_update_time': 1774608494.103892}
2026-03-27 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF96010') HTTP/1.1" 204 0
2026-03-27 10:48:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:14 [auto1.de] INFO: Found listing with ID: CC75051
2026-03-27 10:48:14 [auto1.de] INFO: Found listing with ID: GF62239
2026-03-27 10:48:14 [auto1.de] INFO: Found listing with ID: DZ79939
2026-03-27 10:48:14 [auto1.de] INFO: Found listing with ID: ND02727
2026-03-27 10:48:14 [auto1.de] INFO: Found listing with ID: AJ85569
2026-03-27 10:48:14 [auto1.de] INFO: Found listing with ID: PW65541
2026-03-27 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW65541%27 HTTP/1.1" 200 None
2026-03-27 10:48:14 [auto1.de] INFO: Scrape type for PW65541: 2
2026-03-27 10:48:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6c019c7-4d81-59ad-8739-7977ca54f042 with identifier: PW65541
2026-03-27 10:48:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6c019c7-4d81-59ad-8739-7977ca54f042 with scrape type 2
2026-03-27 10:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6c019c7-4d81-59ad-8739-7977ca54f042 with scrape type 2
2026-03-27 10:48:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6c019c7-4d81-59ad-8739-7977ca54f042, identifier: PW65541
2026-03-27 10:48:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6c019c7-4d81-59ad-8739-7977ca54f042 with identifier: PW65541
2026-03-27 10:48:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6c019c7-4d81-59ad-8739-7977ca54f042 with identifier: PW65541
2026-03-27 10:48:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6c019c7-4d81-59ad-8739-7977ca54f042 with identifier: PW65541 to the API
2026-03-27 10:48:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:55:20Z',
 'fuel_type': 'diesel',
 'id': 'a6c019c7-4d81-59ad-8739-7977ca54f042',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW65541',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 329772,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-25',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2012}
2026-03-27 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW65541%27 HTTP/1.1" 200 None
2026-03-27 10:48:14 [auto1.de] INFO: Saving data for PW65541: {'auction_closing_time': 1774716920.0, 'created_time': 1774265294.143686, 'last_price_update_time': 1774608494.54921}
2026-03-27 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW65541') HTTP/1.1" 204 0
2026-03-27 10:48:14 [auto1.de] INFO: Found listing with ID: DC90555
2026-03-27 10:48:14 [auto1.de] INFO: Found listing with ID: YF42870
2026-03-27 10:48:14 [auto1.de] INFO: Found listing with ID: TE97467
2026-03-27 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE97467%27 HTTP/1.1" 200 None
2026-03-27 10:48:14 [auto1.de] INFO: Scrape type for TE97467: 2
2026-03-27 10:48:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08753a89-d7c3-5b67-9b86-47ea2c2b1030 with identifier: TE97467
2026-03-27 10:48:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08753a89-d7c3-5b67-9b86-47ea2c2b1030 with scrape type 2
2026-03-27 10:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08753a89-d7c3-5b67-9b86-47ea2c2b1030 with scrape type 2
2026-03-27 10:48:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08753a89-d7c3-5b67-9b86-47ea2c2b1030, identifier: TE97467
2026-03-27 10:48:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU48960> (referer: https://www.auto1.com/v1/car-details-view/BU48960/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08753a89-d7c3-5b67-9b86-47ea2c2b1030 with identifier: TE97467
2026-03-27 10:48:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08753a89-d7c3-5b67-9b86-47ea2c2b1030 with identifier: TE97467
2026-03-27 10:48:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08753a89-d7c3-5b67-9b86-47ea2c2b1030 with identifier: TE97467 to the API
2026-03-27 10:48:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:08:33Z',
 'fuel_type': 'hybrid',
 'id': '08753a89-d7c3-5b67-9b86-47ea2c2b1030',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE97467',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 22601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-06',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.4 PHEV 4WD',
 'transmission': 'automatic',
 'trim': '4WD',
 'year': 2020}
2026-03-27 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE97467%27 HTTP/1.1" 200 None
2026-03-27 10:48:15 [auto1.de] INFO: Saving data for TE97467: {'auction_closing_time': 1774714113.0, 'created_time': 1773860939.920139, 'last_price_update_time': 1774608495.01185}
2026-03-27 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE97467') HTTP/1.1" 204 0
2026-03-27 10:48:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37cbefa3-116c-527d-bd73-7fd02a8ea455 with identifier: JV29717
2026-03-27 10:48:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37cbefa3-116c-527d-bd73-7fd02a8ea455 with scrape type 1
2026-03-27 10:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 37cbefa3-116c-527d-bd73-7fd02a8ea455
2026-03-27 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F1e%252Fd91ea9f971f7ec5b879ef7de161d2180%252Fpa%252FJV29717_a7caf4f60d945fa27fd6418c6c3a716c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_a7caf4f60d945fa27fd6418c6c3a716c.jpg not downloaded yet
2026-03-27 10:48:15 [auto1.de] INFO: Found listing with ID: JU04620
2026-03-27 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU04620%27 HTTP/1.1" 200 None
2026-03-27 10:48:15 [auto1.de] INFO: Scrape type for JU04620: 2
2026-03-27 10:48:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 295ef3dd-2af7-55ec-9caf-674555bcf3d0 with identifier: JU04620
2026-03-27 10:48:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 295ef3dd-2af7-55ec-9caf-674555bcf3d0 with scrape type 2
2026-03-27 10:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 295ef3dd-2af7-55ec-9caf-674555bcf3d0 with scrape type 2
2026-03-27 10:48:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 295ef3dd-2af7-55ec-9caf-674555bcf3d0, identifier: JU04620
2026-03-27 10:48:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 295ef3dd-2af7-55ec-9caf-674555bcf3d0 with identifier: JU04620
2026-03-27 10:48:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 295ef3dd-2af7-55ec-9caf-674555bcf3d0 with identifier: JU04620
2026-03-27 10:48:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 295ef3dd-2af7-55ec-9caf-674555bcf3d0 with identifier: JU04620 to the API
2026-03-27 10:48:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:10:09Z',
 'fuel_type': 'petrol',
 'id': '295ef3dd-2af7-55ec-9caf-674555bcf3d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU04620',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 135705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-12',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-27 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU04620%27 HTTP/1.1" 200 None
2026-03-27 10:48:15 [auto1.de] INFO: Saving data for JU04620: {'auction_closing_time': 1774714209.0, 'created_time': 1773858928.198178, 'last_price_update_time': 1774608495.653494}
2026-03-27 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU04620') HTTP/1.1" 204 0
2026-03-27 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F1e%252Fd91ea9f971f7ec5b879ef7de161d2180%252Fpa%252FJV29717_41c70fae957445dd12d3dc48abdbeb8a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_41c70fae957445dd12d3dc48abdbeb8a.jpg not downloaded yet
2026-03-27 10:48:15 [auto1.de] INFO: Found listing with ID: VW56389
2026-03-27 10:48:15 [auto1.de] INFO: Found listing with ID: AE19293
2026-03-27 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE19293%27 HTTP/1.1" 200 None
2026-03-27 10:48:15 [auto1.de] INFO: Scrape type for AE19293: 2
2026-03-27 10:48:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24cdf4b6-0ff2-50c4-9ff7-b88c84864b56 with identifier: AE19293
2026-03-27 10:48:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24cdf4b6-0ff2-50c4-9ff7-b88c84864b56 with scrape type 2
2026-03-27 10:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24cdf4b6-0ff2-50c4-9ff7-b88c84864b56 with scrape type 2
2026-03-27 10:48:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24cdf4b6-0ff2-50c4-9ff7-b88c84864b56, identifier: AE19293
2026-03-27 10:48:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24cdf4b6-0ff2-50c4-9ff7-b88c84864b56 with identifier: AE19293
2026-03-27 10:48:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24cdf4b6-0ff2-50c4-9ff7-b88c84864b56 with identifier: AE19293
2026-03-27 10:48:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24cdf4b6-0ff2-50c4-9ff7-b88c84864b56 with identifier: AE19293 to the API
2026-03-27 10:48:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:12:48Z',
 'fuel_type': 'diesel',
 'id': '24cdf4b6-0ff2-50c4-9ff7-b88c84864b56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE19293',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 59267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-04',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2021}
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE19293%27 HTTP/1.1" 200 None
2026-03-27 10:48:16 [auto1.de] INFO: Saving data for AE19293: {'auction_closing_time': 1774714368.0, 'created_time': 1773303958.611126, 'last_price_update_time': 1774608496.134469}
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE19293') HTTP/1.1" 204 0
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F1e%252Fd91ea9f971f7ec5b879ef7de161d2180%252Fpa%252FJV29717_0723b437f21fac996a05afd52603698d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_0723b437f21fac996a05afd52603698d.jpg not downloaded yet
2026-03-27 10:48:16 [auto1.de] INFO: Found listing with ID: PS95073
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS95073%27 HTTP/1.1" 200 None
2026-03-27 10:48:16 [auto1.de] INFO: Scrape type for PS95073: 2
2026-03-27 10:48:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66485b15-77cf-58d8-b686-73650737398a with identifier: PS95073
2026-03-27 10:48:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66485b15-77cf-58d8-b686-73650737398a with scrape type 2
2026-03-27 10:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66485b15-77cf-58d8-b686-73650737398a with scrape type 2
2026-03-27 10:48:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66485b15-77cf-58d8-b686-73650737398a, identifier: PS95073
2026-03-27 10:48:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92a3dd8e-5578-5352-8644-f125f393ccfe with identifier: BU48960
2026-03-27 10:48:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92a3dd8e-5578-5352-8644-f125f393ccfe with scrape type 1
2026-03-27 10:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 92a3dd8e-5578-5352-8644-f125f393ccfe
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F6f%252Fce6fa855fddaffcbd45c086dd70161ba%252Fpa%252FBU48960_3d7d94675b88e4a76a9e138db6200931.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_3d7d94675b88e4a76a9e138db6200931.jpg not downloaded yet
2026-03-27 10:48:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66485b15-77cf-58d8-b686-73650737398a with identifier: PS95073
2026-03-27 10:48:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66485b15-77cf-58d8-b686-73650737398a with identifier: PS95073
2026-03-27 10:48:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66485b15-77cf-58d8-b686-73650737398a with identifier: PS95073 to the API
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:10:51Z',
 'fuel_type': 'petrol',
 'id': '66485b15-77cf-58d8-b686-73650737398a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS95073',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 22143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-07',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2010}
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS95073%27 HTTP/1.1" 200 None
2026-03-27 10:48:16 [auto1.de] INFO: Saving data for PS95073: {'auction_closing_time': 1774714251.0, 'created_time': 1774293402.954572, 'last_price_update_time': 1774608496.615745}
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS95073') HTTP/1.1" 204 0
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F1e%252Fd91ea9f971f7ec5b879ef7de161d2180%252Fpa%252FJV29717_4e936de528dcb2dd08c347275503a921.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_4e936de528dcb2dd08c347275503a921.jpg not downloaded yet
2026-03-27 10:48:16 [auto1.de] INFO: Found listing with ID: FV21429
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV21429%27 HTTP/1.1" 200 None
2026-03-27 10:48:16 [auto1.de] INFO: Scrape type for FV21429: 2
2026-03-27 10:48:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffbe1fad-6da1-58c2-a81d-eea7784a439f with identifier: FV21429
2026-03-27 10:48:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffbe1fad-6da1-58c2-a81d-eea7784a439f with scrape type 2
2026-03-27 10:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffbe1fad-6da1-58c2-a81d-eea7784a439f with scrape type 2
2026-03-27 10:48:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffbe1fad-6da1-58c2-a81d-eea7784a439f, identifier: FV21429
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F6f%252Fce6fa855fddaffcbd45c086dd70161ba%252Fpa%252FBU48960_c03a75e2532a40cbd875bd9a6a839e62.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_c03a75e2532a40cbd875bd9a6a839e62.jpg not downloaded yet
2026-03-27 10:48:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffbe1fad-6da1-58c2-a81d-eea7784a439f with identifier: FV21429
2026-03-27 10:48:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffbe1fad-6da1-58c2-a81d-eea7784a439f with identifier: FV21429
2026-03-27 10:48:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffbe1fad-6da1-58c2-a81d-eea7784a439f with identifier: FV21429 to the API
2026-03-27 10:48:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:08:10Z',
 'fuel_type': 'hybrid',
 'id': 'ffbe1fad-6da1-58c2-a81d-eea7784a439f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV21429',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 99531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-08',
 'seller_name': None,
 'title': 'Seat Tarraco 1.4 TSI e-HYBRID FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2021}
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV21429%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Saving data for FV21429: {'auction_closing_time': 1774714090.0, 'created_time': 1772543706.558235, 'last_price_update_time': 1774608497.184237}
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV21429') HTTP/1.1" 204 0
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F1e%252Fd91ea9f971f7ec5b879ef7de161d2180%252Fpa%252FJV29717_3c016506e483dee386ba98c787f6f210.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_3c016506e483dee386ba98c787f6f210.jpg not downloaded yet
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: NR64586
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: CE61200
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE61200%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for CE61200: 2
2026-03-27 10:48:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64da2ce5-2ef0-5cd6-8910-8e346b8a16b3 with identifier: CE61200
2026-03-27 10:48:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64da2ce5-2ef0-5cd6-8910-8e346b8a16b3 with scrape type 2
2026-03-27 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64da2ce5-2ef0-5cd6-8910-8e346b8a16b3 with scrape type 2
2026-03-27 10:48:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64da2ce5-2ef0-5cd6-8910-8e346b8a16b3, identifier: CE61200
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F6f%252Fce6fa855fddaffcbd45c086dd70161ba%252Fpa%252FBU48960_cc24a502b7dd0d83ebeb03033102b568.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_cc24a502b7dd0d83ebeb03033102b568.jpg not downloaded yet
2026-03-27 10:48:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64da2ce5-2ef0-5cd6-8910-8e346b8a16b3 with identifier: CE61200
2026-03-27 10:48:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64da2ce5-2ef0-5cd6-8910-8e346b8a16b3 with identifier: CE61200
2026-03-27 10:48:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64da2ce5-2ef0-5cd6-8910-8e346b8a16b3 with identifier: CE61200 to the API
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:11:43Z',
 'fuel_type': 'diesel',
 'id': '64da2ce5-2ef0-5cd6-8910-8e346b8a16b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE61200',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 285801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-24',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Trend & Fun BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trend & Fun BlueMotion Tech',
 'year': 2012}
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE61200%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Saving data for CE61200: {'auction_closing_time': 1774714303.0, 'created_time': 1773402861.405778, 'last_price_update_time': 1774608497.769748}
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE61200') HTTP/1.1" 204 0
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F1e%252Fd91ea9f971f7ec5b879ef7de161d2180%252Fpa%252FJV29717_8f4a486444d5702a21090d548b247d9d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_8f4a486444d5702a21090d548b247d9d.jpg not downloaded yet
2026-03-27 10:48:17 [auto1.de] INFO: Found listing with ID: PW98263
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW98263%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [auto1.de] INFO: Scrape type for PW98263: 2
2026-03-27 10:48:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cd92968-1add-585a-8ddc-05fdc08056a1 with identifier: PW98263
2026-03-27 10:48:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cd92968-1add-585a-8ddc-05fdc08056a1 with scrape type 2
2026-03-27 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cd92968-1add-585a-8ddc-05fdc08056a1 with scrape type 2
2026-03-27 10:48:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cd92968-1add-585a-8ddc-05fdc08056a1, identifier: PW98263
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F6f%252Fce6fa855fddaffcbd45c086dd70161ba%252Fpa%252FBU48960_99d5a4c56736d34263e0c66c30cee1bb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_99d5a4c56736d34263e0c66c30cee1bb.jpg not downloaded yet
2026-03-27 10:48:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cd92968-1add-585a-8ddc-05fdc08056a1 with identifier: PW98263
2026-03-27 10:48:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cd92968-1add-585a-8ddc-05fdc08056a1 with identifier: PW98263
2026-03-27 10:48:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cd92968-1add-585a-8ddc-05fdc08056a1 with identifier: PW98263 to the API
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:06:50Z',
 'fuel_type': 'petrol',
 'id': '6cd92968-1add-585a-8ddc-05fdc08056a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW98263',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 119518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-06',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2010}
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW98263%27 HTTP/1.1" 200 None
2026-03-27 10:48:18 [auto1.de] INFO: Saving data for PW98263: {'auction_closing_time': 1774714010.0, 'created_time': 1773775262.30705, 'last_price_update_time': 1774608498.298307}
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW98263') HTTP/1.1" 204 0
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F1e%252Fd91ea9f971f7ec5b879ef7de161d2180%252Fpa%252FJV29717_bcc5cf2b6b89796cec51ad7ca015fd63.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_bcc5cf2b6b89796cec51ad7ca015fd63.jpg not downloaded yet
2026-03-27 10:48:18 [auto1.de] INFO: Found listing with ID: KR34750
2026-03-27 10:48:18 [auto1.de] INFO: Found listing with ID: DL69348
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL69348%27 HTTP/1.1" 200 None
2026-03-27 10:48:18 [auto1.de] INFO: Scrape type for DL69348: 2
2026-03-27 10:48:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ece55db-40b9-5ea8-911a-7c385298c104 with identifier: DL69348
2026-03-27 10:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ece55db-40b9-5ea8-911a-7c385298c104 with scrape type 2
2026-03-27 10:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ece55db-40b9-5ea8-911a-7c385298c104 with scrape type 2
2026-03-27 10:48:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ece55db-40b9-5ea8-911a-7c385298c104, identifier: DL69348
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F6f%252Fce6fa855fddaffcbd45c086dd70161ba%252Fpa%252FBU48960_47f875c207ef8016af0a2b0c087426c6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_47f875c207ef8016af0a2b0c087426c6.jpg not downloaded yet
2026-03-27 10:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ece55db-40b9-5ea8-911a-7c385298c104 with identifier: DL69348
2026-03-27 10:48:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ece55db-40b9-5ea8-911a-7c385298c104 with identifier: DL69348
2026-03-27 10:48:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ece55db-40b9-5ea8-911a-7c385298c104 with identifier: DL69348 to the API
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 421,
 'expiration_date': '2026-03-28T16:42:15Z',
 'fuel_type': 'diesel',
 'id': '0ece55db-40b9-5ea8-911a-7c385298c104',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL69348',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 137317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-06',
 'seller_name': None,
 'title': 'Volkswagen Touareg 4.0 TDI Atmosphere 4Motion',
 'transmission': 'automatic',
 'trim': 'Atmosphere 4Motion',
 'year': 2020}
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL69348%27 HTTP/1.1" 200 None
2026-03-27 10:48:18 [auto1.de] INFO: Saving data for DL69348: {'auction_closing_time': 1774716135.0, 'created_time': 1773305795.149433, 'last_price_update_time': 1774608498.767813}
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL69348') HTTP/1.1" 204 0
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F1e%252Fd91ea9f971f7ec5b879ef7de161d2180%252Fpa%252FJV29717_af613cdb53a1a92744d5f9898214a55e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_af613cdb53a1a92744d5f9898214a55e.jpg not downloaded yet
2026-03-27 10:48:18 [auto1.de] INFO: Found listing with ID: UF21072
2026-03-27 10:48:18 [auto1.de] INFO: Found listing with ID: PB99961
2026-03-27 10:48:18 [auto1.de] INFO: Found listing with ID: ZM08692
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F6f%252Fce6fa855fddaffcbd45c086dd70161ba%252Fpa%252FBU48960_0506c2ef90b8495236d381d09e1427a4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_0506c2ef90b8495236d381d09e1427a4.jpg not downloaded yet
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F1e%252Fd91ea9f971f7ec5b879ef7de161d2180%252Fpa%252FJV29717_99814ed1b0131583675a8855ab2170a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_99814ed1b0131583675a8855ab2170a3.jpg not downloaded yet
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F6f%252Fce6fa855fddaffcbd45c086dd70161ba%252Fpa%252FBU48960_726bd11edc6be0800a666f5a93c26f17.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_726bd11edc6be0800a666f5a93c26f17.jpg not downloaded yet
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F1e%252Fd91ea9f971f7ec5b879ef7de161d2180%252Fpa%252FJV29717_ea439a4ef9a46c0e238dfd25b67a883d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_ea439a4ef9a46c0e238dfd25b67a883d.jpg not downloaded yet
2026-03-27 10:48:18 [auto1.de] INFO: Channel: 24h | Page: 43 | totalHits: 10564 | hits on page: 40
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F6f%252Fce6fa855fddaffcbd45c086dd70161ba%252Fpa%252FBU48960_9859d3dce130c556f6d9af9f750671c4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_9859d3dce130c556f6d9af9f750671c4.jpg not downloaded yet
2026-03-27 10:48:18 [auto1.de] INFO: Found listing with ID: PW98263
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW98263%27 HTTP/1.1" 200 None
2026-03-27 10:48:18 [auto1.de] INFO: Scrape type for PW98263: 0
2026-03-27 10:48:18 [auto1.de] INFO: Found listing with ID: KR34750
2026-03-27 10:48:18 [auto1.de] INFO: Found listing with ID: DL69348
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL69348%27 HTTP/1.1" 200 None
2026-03-27 10:48:18 [auto1.de] INFO: Scrape type for DL69348: 0
2026-03-27 10:48:18 [auto1.de] INFO: Found listing with ID: UF21072
2026-03-27 10:48:18 [auto1.de] INFO: Found listing with ID: PB99961
2026-03-27 10:48:18 [auto1.de] INFO: Found listing with ID: ZM08692
2026-03-27 10:48:18 [auto1.de] INFO: Found listing with ID: ZZ71304
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ71304%27 HTTP/1.1" 200 None
2026-03-27 10:48:18 [auto1.de] INFO: Scrape type for ZZ71304: 2
2026-03-27 10:48:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 110572ef-11c3-5e40-afde-5b395c5fe3a4 with identifier: ZZ71304
2026-03-27 10:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 110572ef-11c3-5e40-afde-5b395c5fe3a4 with scrape type 2
2026-03-27 10:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 110572ef-11c3-5e40-afde-5b395c5fe3a4 with scrape type 2
2026-03-27 10:48:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 110572ef-11c3-5e40-afde-5b395c5fe3a4, identifier: ZZ71304
2026-03-27 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F6f%252Fce6fa855fddaffcbd45c086dd70161ba%252Fpa%252FBU48960_eecc926ba80d09bdfcbb595f95844b3f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_eecc926ba80d09bdfcbb595f95844b3f.jpg not downloaded yet
2026-03-27 10:48:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 110572ef-11c3-5e40-afde-5b395c5fe3a4 with identifier: ZZ71304
2026-03-27 10:48:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 110572ef-11c3-5e40-afde-5b395c5fe3a4 with identifier: ZZ71304
2026-03-27 10:48:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 110572ef-11c3-5e40-afde-5b395c5fe3a4 with identifier: ZZ71304 to the API
2026-03-27 10:48:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:58:02Z',
 'fuel_type': 'petrol',
 'id': '110572ef-11c3-5e40-afde-5b395c5fe3a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ71304',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 114935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-27 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ71304%27 HTTP/1.1" 200 None
2026-03-27 10:48:19 [auto1.de] INFO: Saving data for ZZ71304: {'auction_closing_time': 1774717082.0, 'created_time': 1773861825.663401, 'last_price_update_time': 1774608499.493096}
2026-03-27 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ71304') HTTP/1.1" 204 0
2026-03-27 10:48:19 [auto1.de] INFO: Found listing with ID: US46384
2026-03-27 10:48:19 [auto1.de] INFO: Found listing with ID: MM29891
2026-03-27 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM29891%27 HTTP/1.1" 200 None
2026-03-27 10:48:19 [auto1.de] INFO: Scrape type for MM29891: 2
2026-03-27 10:48:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2 with identifier: MM29891
2026-03-27 10:48:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2 with scrape type 2
2026-03-27 10:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2 with scrape type 2
2026-03-27 10:48:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2, identifier: MM29891
2026-03-27 10:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_41c70fae957445dd12d3dc48abdbeb8a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F6f%252Fce6fa855fddaffcbd45c086dd70161ba%252Fpa%252FBU48960_8fcf30dde9bcd1371349a435994dfe87.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_8fcf30dde9bcd1371349a435994dfe87.jpg not downloaded yet
2026-03-27 10:48:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2 with identifier: MM29891
2026-03-27 10:48:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2 with identifier: MM29891
2026-03-27 10:48:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2 with identifier: MM29891 to the API
2026-03-27 10:48:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:21:19Z',
 'fuel_type': 'diesel',
 'id': '8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM29891',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 77208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-14',
 'seller_name': None,
 'title': 'Audi A6 40 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-27 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM29891%27 HTTP/1.1" 200 None
2026-03-27 10:48:20 [auto1.de] INFO: Saving data for MM29891: {'auction_closing_time': 1774714879.0, 'created_time': 1774293920.003838, 'last_price_update_time': 1774608500.159681}
2026-03-27 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM29891') HTTP/1.1" 204 0
2026-03-27 10:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_3d7d94675b88e4a76a9e138db6200931.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_3c016506e483dee386ba98c787f6f210.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:20 [auto1.de] INFO: Found listing with ID: ZR48762
2026-03-27 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR48762%27 HTTP/1.1" 200 None
2026-03-27 10:48:20 [auto1.de] INFO: Scrape type for ZR48762: 2
2026-03-27 10:48:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a165d659-cf53-5485-8d8f-a7b809a13826 with identifier: ZR48762
2026-03-27 10:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a165d659-cf53-5485-8d8f-a7b809a13826 with scrape type 2
2026-03-27 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a165d659-cf53-5485-8d8f-a7b809a13826 with scrape type 2
2026-03-27 10:48:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a165d659-cf53-5485-8d8f-a7b809a13826, identifier: ZR48762
2026-03-27 10:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_cc24a502b7dd0d83ebeb03033102b568.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a165d659-cf53-5485-8d8f-a7b809a13826 with identifier: ZR48762
2026-03-27 10:48:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a165d659-cf53-5485-8d8f-a7b809a13826 with identifier: ZR48762
2026-03-27 10:48:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a165d659-cf53-5485-8d8f-a7b809a13826 with identifier: ZR48762 to the API
2026-03-27 10:48:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:37:00Z',
 'fuel_type': 'petrol',
 'id': 'a165d659-cf53-5485-8d8f-a7b809a13826',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR48762',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 178540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-03',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 280 T 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic Avantgarde',
 'year': 2007}
2026-03-27 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR48762%27 HTTP/1.1" 200 None
2026-03-27 10:48:20 [auto1.de] INFO: Saving data for ZR48762: {'auction_closing_time': 1774715820.0, 'created_time': 1773427831.35327, 'last_price_update_time': 1774608500.605551}
2026-03-27 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR48762') HTTP/1.1" 204 0
2026-03-27 10:48:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_c03a75e2532a40cbd875bd9a6a839e62.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:20 [auto1.de] INFO: Found listing with ID: VY61993
2026-03-27 10:48:20 [auto1.de] INFO: Found listing with ID: ZD02189
2026-03-27 10:48:20 [auto1.de] INFO: Found listing with ID: BP02747
2026-03-27 10:48:20 [auto1.de] INFO: Found listing with ID: AX34994
2026-03-27 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX34994%27 HTTP/1.1" 200 None
2026-03-27 10:48:20 [auto1.de] INFO: Scrape type for AX34994: 2
2026-03-27 10:48:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d41989d1-c454-55c8-a89f-5beb9c4d5963 with identifier: AX34994
2026-03-27 10:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d41989d1-c454-55c8-a89f-5beb9c4d5963 with scrape type 2
2026-03-27 10:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d41989d1-c454-55c8-a89f-5beb9c4d5963 with scrape type 2
2026-03-27 10:48:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d41989d1-c454-55c8-a89f-5beb9c4d5963, identifier: AX34994
2026-03-27 10:48:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d41989d1-c454-55c8-a89f-5beb9c4d5963 with identifier: AX34994
2026-03-27 10:48:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d41989d1-c454-55c8-a89f-5beb9c4d5963 with identifier: AX34994
2026-03-27 10:48:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d41989d1-c454-55c8-a89f-5beb9c4d5963 with identifier: AX34994 to the API
2026-03-27 10:48:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:18:25Z',
 'fuel_type': 'diesel',
 'id': 'd41989d1-c454-55c8-a89f-5beb9c4d5963',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX34994',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 114962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2017}
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX34994%27 HTTP/1.1" 200 None
2026-03-27 10:48:21 [auto1.de] INFO: Saving data for AX34994: {'auction_closing_time': 1774714705.0, 'created_time': 1773382439.492193, 'last_price_update_time': 1774608501.067725}
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX34994') HTTP/1.1" 204 0
2026-03-27 10:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50058ae10>
2026-03-27 10:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37cbefa3-116c-527d-bd73-7fd02a8ea455/37cbefa3-116c-527d-bd73-7fd02a8ea455_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F1e%252Fd91ea9f971f7ec5b879ef7de161d2180%252Fpa%252FJV29717_41c70fae957445dd12d3dc48abdbeb8a.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_41c70fae957445dd12d3dc48abdbeb8a.jpg saved to cache
2026-03-27 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37cbefa3-116c-527d-bd73-7fd02a8ea455
2026-03-27 10:48:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50022a650>
2026-03-27 10:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92a3dd8e-5578-5352-8644-f125f393ccfe/92a3dd8e-5578-5352-8644-f125f393ccfe_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F6f%252Fce6fa855fddaffcbd45c086dd70161ba%252Fpa%252FBU48960_3d7d94675b88e4a76a9e138db6200931.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_3d7d94675b88e4a76a9e138db6200931.jpg saved to cache
2026-03-27 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92a3dd8e-5578-5352-8644-f125f393ccfe
2026-03-27 10:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500392990>
2026-03-27 10:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37cbefa3-116c-527d-bd73-7fd02a8ea455/37cbefa3-116c-527d-bd73-7fd02a8ea455_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F1e%252Fd91ea9f971f7ec5b879ef7de161d2180%252Fpa%252FJV29717_3c016506e483dee386ba98c787f6f210.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_3c016506e483dee386ba98c787f6f210.jpg saved to cache
2026-03-27 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 37cbefa3-116c-527d-bd73-7fd02a8ea455
2026-03-27 10:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_99d5a4c56736d34263e0c66c30cee1bb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_8f4a486444d5702a21090d548b247d9d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:21 [auto1.de] INFO: Found listing with ID: LC37503
2026-03-27 10:48:21 [auto1.de] INFO: Found listing with ID: AN93893
2026-03-27 10:48:21 [auto1.de] INFO: Found listing with ID: PZ17668
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ17668%27 HTTP/1.1" 200 None
2026-03-27 10:48:21 [auto1.de] INFO: Scrape type for PZ17668: 2
2026-03-27 10:48:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19c8b7f1-9307-5d29-a989-6196049c4e18 with identifier: PZ17668
2026-03-27 10:48:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19c8b7f1-9307-5d29-a989-6196049c4e18 with scrape type 2
2026-03-27 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19c8b7f1-9307-5d29-a989-6196049c4e18 with scrape type 2
2026-03-27 10:48:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19c8b7f1-9307-5d29-a989-6196049c4e18, identifier: PZ17668
2026-03-27 10:48:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19c8b7f1-9307-5d29-a989-6196049c4e18 with identifier: PZ17668
2026-03-27 10:48:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19c8b7f1-9307-5d29-a989-6196049c4e18 with identifier: PZ17668
2026-03-27 10:48:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19c8b7f1-9307-5d29-a989-6196049c4e18 with identifier: PZ17668 to the API
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:13:21Z',
 'fuel_type': 'diesel',
 'id': '19c8b7f1-9307-5d29-a989-6196049c4e18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ17668',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 198302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-16',
 'seller_name': None,
 'title': 'Audi Q5 50 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ17668%27 HTTP/1.1" 200 None
2026-03-27 10:48:21 [auto1.de] INFO: Saving data for PZ17668: {'auction_closing_time': 1774714401.0, 'created_time': 1773686200.93384, 'last_price_update_time': 1774608501.935171}
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ17668') HTTP/1.1" 204 0
2026-03-27 10:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_af613cdb53a1a92744d5f9898214a55e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:21 [auto1.de] INFO: Found listing with ID: MG63340
2026-03-27 10:48:21 [auto1.de] INFO: Found listing with ID: MY79904
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY79904%27 HTTP/1.1" 200 None
2026-03-27 10:48:21 [auto1.de] INFO: Scrape type for MY79904: 2
2026-03-27 10:48:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79bbc902-3b1f-580e-a0e7-9c7c5f2182be with identifier: MY79904
2026-03-27 10:48:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79bbc902-3b1f-580e-a0e7-9c7c5f2182be with scrape type 2
2026-03-27 10:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79bbc902-3b1f-580e-a0e7-9c7c5f2182be with scrape type 2
2026-03-27 10:48:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79bbc902-3b1f-580e-a0e7-9c7c5f2182be, identifier: MY79904
2026-03-27 10:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004585d0>
2026-03-27 10:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92a3dd8e-5578-5352-8644-f125f393ccfe/92a3dd8e-5578-5352-8644-f125f393ccfe_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F6f%252Fce6fa855fddaffcbd45c086dd70161ba%252Fpa%252FBU48960_cc24a502b7dd0d83ebeb03033102b568.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_cc24a502b7dd0d83ebeb03033102b568.jpg saved to cache
2026-03-27 10:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92a3dd8e-5578-5352-8644-f125f393ccfe
2026-03-27 10:48:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb502610ad0>
2026-03-27 10:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92a3dd8e-5578-5352-8644-f125f393ccfe/92a3dd8e-5578-5352-8644-f125f393ccfe_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F6f%252Fce6fa855fddaffcbd45c086dd70161ba%252Fpa%252FBU48960_c03a75e2532a40cbd875bd9a6a839e62.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_c03a75e2532a40cbd875bd9a6a839e62.jpg saved to cache
2026-03-27 10:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 92a3dd8e-5578-5352-8644-f125f393ccfe
2026-03-27 10:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_8fcf30dde9bcd1371349a435994dfe87.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79bbc902-3b1f-580e-a0e7-9c7c5f2182be with identifier: MY79904
2026-03-27 10:48:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79bbc902-3b1f-580e-a0e7-9c7c5f2182be with identifier: MY79904
2026-03-27 10:48:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79bbc902-3b1f-580e-a0e7-9c7c5f2182be with identifier: MY79904 to the API
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-28T16:53:15Z',
 'fuel_type': 'hybrid',
 'id': '79bbc902-3b1f-580e-a0e7-9c7c5f2182be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY79904',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 202654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T8 Plug-in Hybrid R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2019}
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY79904%27 HTTP/1.1" 200 None
2026-03-27 10:48:22 [auto1.de] INFO: Saving data for MY79904: {'auction_closing_time': 1774716795.0, 'created_time': 1773861179.070441, 'last_price_update_time': 1774608502.61389}
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY79904') HTTP/1.1" 204 0
2026-03-27 10:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_eecc926ba80d09bdfcbb595f95844b3f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:22 [auto1.de] INFO: Found listing with ID: AY58726
2026-03-27 10:48:22 [auto1.de] INFO: Found listing with ID: SK36887
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK36887%27 HTTP/1.1" 200 None
2026-03-27 10:48:22 [auto1.de] INFO: Scrape type for SK36887: 2
2026-03-27 10:48:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe976862-08ce-54f4-a9a7-2d63afbb4567 with identifier: SK36887
2026-03-27 10:48:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe976862-08ce-54f4-a9a7-2d63afbb4567 with scrape type 2
2026-03-27 10:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe976862-08ce-54f4-a9a7-2d63afbb4567 with scrape type 2
2026-03-27 10:48:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe976862-08ce-54f4-a9a7-2d63afbb4567, identifier: SK36887
2026-03-27 10:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016dc910>
2026-03-27 10:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92a3dd8e-5578-5352-8644-f125f393ccfe/92a3dd8e-5578-5352-8644-f125f393ccfe_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F6f%252Fce6fa855fddaffcbd45c086dd70161ba%252Fpa%252FBU48960_99d5a4c56736d34263e0c66c30cee1bb.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_99d5a4c56736d34263e0c66c30cee1bb.jpg saved to cache
2026-03-27 10:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92a3dd8e-5578-5352-8644-f125f393ccfe
2026-03-27 10:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50162a590>
2026-03-27 10:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37cbefa3-116c-527d-bd73-7fd02a8ea455/37cbefa3-116c-527d-bd73-7fd02a8ea455_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F1e%252Fd91ea9f971f7ec5b879ef7de161d2180%252Fpa%252FJV29717_8f4a486444d5702a21090d548b247d9d.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_8f4a486444d5702a21090d548b247d9d.jpg saved to cache
2026-03-27 10:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37cbefa3-116c-527d-bd73-7fd02a8ea455
2026-03-27 10:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_47f875c207ef8016af0a2b0c087426c6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_9859d3dce130c556f6d9af9f750671c4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe976862-08ce-54f4-a9a7-2d63afbb4567 with identifier: SK36887
2026-03-27 10:48:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe976862-08ce-54f4-a9a7-2d63afbb4567 with identifier: SK36887
2026-03-27 10:48:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe976862-08ce-54f4-a9a7-2d63afbb4567 with identifier: SK36887 to the API
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:16:11Z',
 'fuel_type': 'petrol',
 'id': 'fe976862-08ce-54f4-a9a7-2d63afbb4567',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK36887',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Eclipse Cross',
 'odometer': 81942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-25',
 'seller_name': None,
 'title': 'Mitsubishi Eclipse Cross 1.5 T-MIVEC Diamant Edition+ 4WD',
 'transmission': 'automatic',
 'trim': 'Diamant Edition+ 4WD',
 'year': 2019}
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK36887%27 HTTP/1.1" 200 None
2026-03-27 10:48:23 [auto1.de] INFO: Saving data for SK36887: {'auction_closing_time': 1774714571.0, 'created_time': 1773304653.377913, 'last_price_update_time': 1774608503.255657}
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK36887') HTTP/1.1" 204 0
2026-03-27 10:48:23 [auto1.de] INFO: Found listing with ID: FX88340
2026-03-27 10:48:23 [auto1.de] INFO: Found listing with ID: SX14499
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX14499%27 HTTP/1.1" 200 None
2026-03-27 10:48:23 [auto1.de] INFO: Scrape type for SX14499: 2
2026-03-27 10:48:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6da77647-6a9b-52f4-bdb9-d629b3ec6bbb with identifier: SX14499
2026-03-27 10:48:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6da77647-6a9b-52f4-bdb9-d629b3ec6bbb with scrape type 2
2026-03-27 10:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6da77647-6a9b-52f4-bdb9-d629b3ec6bbb with scrape type 2
2026-03-27 10:48:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6da77647-6a9b-52f4-bdb9-d629b3ec6bbb, identifier: SX14499
2026-03-27 10:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_726bd11edc6be0800a666f5a93c26f17.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6da77647-6a9b-52f4-bdb9-d629b3ec6bbb with identifier: SX14499
2026-03-27 10:48:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6da77647-6a9b-52f4-bdb9-d629b3ec6bbb with identifier: SX14499
2026-03-27 10:48:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6da77647-6a9b-52f4-bdb9-d629b3ec6bbb with identifier: SX14499 to the API
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:54:53Z',
 'fuel_type': 'petrol',
 'id': '6da77647-6a9b-52f4-bdb9-d629b3ec6bbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX14499',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 47609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-11',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2021}
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX14499%27 HTTP/1.1" 200 None
2026-03-27 10:48:23 [auto1.de] INFO: Saving data for SX14499: {'auction_closing_time': 1774716893.0, 'created_time': 1773383209.397009, 'last_price_update_time': 1774608503.733633}
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX14499') HTTP/1.1" 204 0
2026-03-27 10:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50170f190>
2026-03-27 10:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37cbefa3-116c-527d-bd73-7fd02a8ea455/37cbefa3-116c-527d-bd73-7fd02a8ea455_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F1e%252Fd91ea9f971f7ec5b879ef7de161d2180%252Fpa%252FJV29717_af613cdb53a1a92744d5f9898214a55e.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_af613cdb53a1a92744d5f9898214a55e.jpg saved to cache
2026-03-27 10:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 37cbefa3-116c-527d-bd73-7fd02a8ea455
2026-03-27 10:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003e7450>
2026-03-27 10:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92a3dd8e-5578-5352-8644-f125f393ccfe/92a3dd8e-5578-5352-8644-f125f393ccfe_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F6f%252Fce6fa855fddaffcbd45c086dd70161ba%252Fpa%252FBU48960_8fcf30dde9bcd1371349a435994dfe87.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_8fcf30dde9bcd1371349a435994dfe87.jpg saved to cache
2026-03-27 10:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 92a3dd8e-5578-5352-8644-f125f393ccfe
2026-03-27 10:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015d55d0>
2026-03-27 10:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92a3dd8e-5578-5352-8644-f125f393ccfe/92a3dd8e-5578-5352-8644-f125f393ccfe_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F6f%252Fce6fa855fddaffcbd45c086dd70161ba%252Fpa%252FBU48960_eecc926ba80d09bdfcbb595f95844b3f.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_eecc926ba80d09bdfcbb595f95844b3f.jpg saved to cache
2026-03-27 10:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 92a3dd8e-5578-5352-8644-f125f393ccfe
2026-03-27 10:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_0506c2ef90b8495236d381d09e1427a4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_ea439a4ef9a46c0e238dfd25b67a883d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:23 [auto1.de] INFO: Found listing with ID: YH93335
2026-03-27 10:48:23 [auto1.de] INFO: Found listing with ID: EF65370
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF65370%27 HTTP/1.1" 200 None
2026-03-27 10:48:23 [auto1.de] INFO: Scrape type for EF65370: 2
2026-03-27 10:48:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa8cb44a-aee9-57d4-aceb-98384cd313ce with identifier: EF65370
2026-03-27 10:48:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa8cb44a-aee9-57d4-aceb-98384cd313ce with scrape type 2
2026-03-27 10:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa8cb44a-aee9-57d4-aceb-98384cd313ce with scrape type 2
2026-03-27 10:48:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa8cb44a-aee9-57d4-aceb-98384cd313ce, identifier: EF65370
2026-03-27 10:48:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa8cb44a-aee9-57d4-aceb-98384cd313ce with identifier: EF65370
2026-03-27 10:48:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa8cb44a-aee9-57d4-aceb-98384cd313ce with identifier: EF65370
2026-03-27 10:48:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa8cb44a-aee9-57d4-aceb-98384cd313ce with identifier: EF65370 to the API
2026-03-27 10:48:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 435,
 'expiration_date': '2026-03-28T16:04:44Z',
 'fuel_type': 'diesel',
 'id': 'fa8cb44a-aee9-57d4-aceb-98384cd313ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF65370',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ7',
 'odometer': 59603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-12',
 'seller_name': None,
 'title': 'Audi SQ7 4.0 V8 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-27 10:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF65370%27 HTTP/1.1" 200 None
2026-03-27 10:48:24 [auto1.de] INFO: Saving data for EF65370: {'auction_closing_time': 1774713884.0, 'created_time': 1773302040.019792, 'last_price_update_time': 1774608504.314823}
2026-03-27 10:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF65370') HTTP/1.1" 204 0
2026-03-27 10:48:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015fc0d0>
2026-03-27 10:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92a3dd8e-5578-5352-8644-f125f393ccfe/92a3dd8e-5578-5352-8644-f125f393ccfe_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F6f%252Fce6fa855fddaffcbd45c086dd70161ba%252Fpa%252FBU48960_47f875c207ef8016af0a2b0c087426c6.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_47f875c207ef8016af0a2b0c087426c6.jpg saved to cache
2026-03-27 10:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92a3dd8e-5578-5352-8644-f125f393ccfe
2026-03-27 10:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018ab090>
2026-03-27 10:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92a3dd8e-5578-5352-8644-f125f393ccfe/92a3dd8e-5578-5352-8644-f125f393ccfe_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F6f%252Fce6fa855fddaffcbd45c086dd70161ba%252Fpa%252FBU48960_9859d3dce130c556f6d9af9f750671c4.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_9859d3dce130c556f6d9af9f750671c4.jpg saved to cache
2026-03-27 10:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 92a3dd8e-5578-5352-8644-f125f393ccfe
2026-03-27 10:48:24 [auto1.de] INFO: Found listing with ID: AH95980
2026-03-27 10:48:24 [auto1.de] INFO: Found listing with ID: MH69826
2026-03-27 10:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH69826%27 HTTP/1.1" 200 None
2026-03-27 10:48:24 [auto1.de] INFO: Scrape type for MH69826: 2
2026-03-27 10:48:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3b8ddb2-9118-5795-9e70-c35dfed8b986 with identifier: MH69826
2026-03-27 10:48:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3b8ddb2-9118-5795-9e70-c35dfed8b986 with scrape type 2
2026-03-27 10:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3b8ddb2-9118-5795-9e70-c35dfed8b986 with scrape type 2
2026-03-27 10:48:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3b8ddb2-9118-5795-9e70-c35dfed8b986, identifier: MH69826
2026-03-27 10:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV22200/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3b8ddb2-9118-5795-9e70-c35dfed8b986 with identifier: MH69826
2026-03-27 10:48:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3b8ddb2-9118-5795-9e70-c35dfed8b986 with identifier: MH69826
2026-03-27 10:48:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3b8ddb2-9118-5795-9e70-c35dfed8b986 with identifier: MH69826 to the API
2026-03-27 10:48:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:37:05Z',
 'fuel_type': 'petrol',
 'id': 'a3b8ddb2-9118-5795-9e70-c35dfed8b986',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH69826',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 68421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-27',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.5 TSI ACT Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2023}
2026-03-27 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH69826%27 HTTP/1.1" 200 None
2026-03-27 10:48:25 [auto1.de] INFO: Saving data for MH69826: {'auction_closing_time': 1774715825.0, 'created_time': 1773830790.420453, 'last_price_update_time': 1774608505.359328}
2026-03-27 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH69826') HTTP/1.1" 204 0
2026-03-27 10:48:25 [auto1.de] INFO: Found listing with ID: AR05539
2026-03-27 10:48:25 [auto1.de] INFO: Found listing with ID: WF31302
2026-03-27 10:48:25 [auto1.de] INFO: Found listing with ID: ER51805
2026-03-27 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51805%27 HTTP/1.1" 200 None
2026-03-27 10:48:25 [auto1.de] INFO: Scrape type for ER51805: 2
2026-03-27 10:48:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9d39367-cd17-51f1-a41e-d7c8af251282 with identifier: ER51805
2026-03-27 10:48:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9d39367-cd17-51f1-a41e-d7c8af251282 with scrape type 2
2026-03-27 10:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9d39367-cd17-51f1-a41e-d7c8af251282 with scrape type 2
2026-03-27 10:48:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9d39367-cd17-51f1-a41e-d7c8af251282, identifier: ER51805
2026-03-27 10:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002fecd0>
2026-03-27 10:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92a3dd8e-5578-5352-8644-f125f393ccfe/92a3dd8e-5578-5352-8644-f125f393ccfe_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F6f%252Fce6fa855fddaffcbd45c086dd70161ba%252Fpa%252FBU48960_726bd11edc6be0800a666f5a93c26f17.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_726bd11edc6be0800a666f5a93c26f17.jpg saved to cache
2026-03-27 10:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 92a3dd8e-5578-5352-8644-f125f393ccfe
2026-03-27 10:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501752190>
2026-03-27 10:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92a3dd8e-5578-5352-8644-f125f393ccfe/92a3dd8e-5578-5352-8644-f125f393ccfe_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F6f%252Fce6fa855fddaffcbd45c086dd70161ba%252Fpa%252FBU48960_0506c2ef90b8495236d381d09e1427a4.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_0506c2ef90b8495236d381d09e1427a4.jpg saved to cache
2026-03-27 10:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 92a3dd8e-5578-5352-8644-f125f393ccfe
2026-03-27 10:48:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92a3dd8e-5578-5352-8644-f125f393ccfe, skipping ID generation
2026-03-27 10:48:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92a3dd8e-5578-5352-8644-f125f393ccfe with scrape type 1
2026-03-27 10:48:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92a3dd8e-5578-5352-8644-f125f393ccfe sending to next pipeline
2026-03-27 10:48:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92a3dd8e-5578-5352-8644-f125f393ccfe, identifier: BU48960
2026-03-27 10:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50037f010>
2026-03-27 10:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37cbefa3-116c-527d-bd73-7fd02a8ea455/37cbefa3-116c-527d-bd73-7fd02a8ea455_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F1e%252Fd91ea9f971f7ec5b879ef7de161d2180%252Fpa%252FJV29717_ea439a4ef9a46c0e238dfd25b67a883d.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_ea439a4ef9a46c0e238dfd25b67a883d.jpg saved to cache
2026-03-27 10:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 37cbefa3-116c-527d-bd73-7fd02a8ea455
2026-03-27 10:48:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9d39367-cd17-51f1-a41e-d7c8af251282 with identifier: ER51805
2026-03-27 10:48:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9d39367-cd17-51f1-a41e-d7c8af251282 with identifier: ER51805
2026-03-27 10:48:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9d39367-cd17-51f1-a41e-d7c8af251282 with identifier: ER51805 to the API
2026-03-27 10:48:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:04:00Z',
 'fuel_type': 'petrol',
 'id': 'f9d39367-cd17-51f1-a41e-d7c8af251282',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER51805',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 43542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-28',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2018}
2026-03-27 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51805%27 HTTP/1.1" 200 None
2026-03-27 10:48:26 [auto1.de] INFO: Saving data for ER51805: {'auction_closing_time': 1774713840.0, 'created_time': 1773383159.346075, 'last_price_update_time': 1774608506.521194}
2026-03-27 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER51805') HTTP/1.1" 204 0
2026-03-27 10:48:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92a3dd8e-5578-5352-8644-f125f393ccfe with identifier: BU48960
2026-03-27 10:48:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92a3dd8e-5578-5352-8644-f125f393ccfe with identifier: BU48960
2026-03-27 10:48:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92a3dd8e-5578-5352-8644-f125f393ccfe with identifier: BU48960 to the API
2026-03-27 10:48:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_0506c2ef90b8495236d381d09e1427a4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:24:03Z',
 'fuel_type': 'diesel',
 'id': '92a3dd8e-5578-5352-8644-f125f393ccfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU48960',
 'listing': 'auction',
 'location': 'DE, Hilden',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 52927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92a3dd8e-5578-5352-8644-f125f393ccfe/92a3dd8e-5578-5352-8644-f125f393ccfe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277879,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_3d7d94675b88e4a76a9e138db6200931.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92a3dd8e-5578-5352-8644-f125f393ccfe/92a3dd8e-5578-5352-8644-f125f393ccfe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286683,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_c03a75e2532a40cbd875bd9a6a839e62.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92a3dd8e-5578-5352-8644-f125f393ccfe/92a3dd8e-5578-5352-8644-f125f393ccfe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41954,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_cc24a502b7dd0d83ebeb03033102b568.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92a3dd8e-5578-5352-8644-f125f393ccfe/92a3dd8e-5578-5352-8644-f125f393ccfe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36397,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_99d5a4c56736d34263e0c66c30cee1bb.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92a3dd8e-5578-5352-8644-f125f393ccfe/92a3dd8e-5578-5352-8644-f125f393ccfe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260812,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_47f875c207ef8016af0a2b0c087426c6.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92a3dd8e-5578-5352-8644-f125f393ccfe/92a3dd8e-5578-5352-8644-f125f393ccfe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40994,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_0506c2ef90b8495236d381d09e1427a4.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92a3dd8e-5578-5352-8644-f125f393ccfe/92a3dd8e-5578-5352-8644-f125f393ccfe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33691,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_726bd11edc6be0800a666f5a93c26f17.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92a3dd8e-5578-5352-8644-f125f393ccfe/92a3dd8e-5578-5352-8644-f125f393ccfe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37397,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_9859d3dce130c556f6d9af9f750671c4.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92a3dd8e-5578-5352-8644-f125f393ccfe/92a3dd8e-5578-5352-8644-f125f393ccfe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_eecc926ba80d09bdfcbb595f95844b3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92a3dd8e-5578-5352-8644-f125f393ccfe/92a3dd8e-5578-5352-8644-f125f393ccfe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50582,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/6f/ce6fa855fddaffcbd45c086dd70161ba/pa/BU48960_8fcf30dde9bcd1371349a435994dfe87.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-09',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 CDTI Kasten L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'Kasten L1H1 2,7t',
 'year': 2018}
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU48960%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Saving data for BU48960: {'created_time': 1774608507.813317, 'last_price_update_time': 1774608507.813328, 'auction_closing_time': 1774715043.0}
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU48960') HTTP/1.1" 204 0
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: YM46431
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: RN03307
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: TW44182
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44182%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for TW44182: 1
2026-03-27 10:48:27 [auto1.de] INFO: Found listing with ID: UK53846
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK53846%27 HTTP/1.1" 200 None
2026-03-27 10:48:27 [auto1.de] INFO: Scrape type for UK53846: 2
2026-03-27 10:48:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f7401ab-5e10-5402-a6c8-c37fa7f68cb6 with identifier: UK53846
2026-03-27 10:48:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f7401ab-5e10-5402-a6c8-c37fa7f68cb6 with scrape type 2
2026-03-27 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f7401ab-5e10-5402-a6c8-c37fa7f68cb6 with scrape type 2
2026-03-27 10:48:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f7401ab-5e10-5402-a6c8-c37fa7f68cb6, identifier: UK53846
2026-03-27 10:48:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f7401ab-5e10-5402-a6c8-c37fa7f68cb6 with identifier: UK53846
2026-03-27 10:48:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f7401ab-5e10-5402-a6c8-c37fa7f68cb6 with identifier: UK53846
2026-03-27 10:48:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f7401ab-5e10-5402-a6c8-c37fa7f68cb6 with identifier: UK53846 to the API
2026-03-27 10:48:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:07:37Z',
 'fuel_type': 'petrol',
 'id': '7f7401ab-5e10-5402-a6c8-c37fa7f68cb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK53846',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 54342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-22',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Skyactiv-G Mild-Hybrid Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2020}
2026-03-27 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK53846%27 HTTP/1.1" 200 None
2026-03-27 10:48:28 [auto1.de] INFO: Saving data for UK53846: {'auction_closing_time': 1774714057.0, 'created_time': 1774291040.363657, 'last_price_update_time': 1774608508.292287}
2026-03-27 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK53846') HTTP/1.1" 204 0
2026-03-27 10:48:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:28 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-27 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72135%27 HTTP/1.1" 200 None
2026-03-27 10:48:28 [auto1.de] INFO: Scrape type for KP72135: 2
2026-03-27 10:48:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d13bf739-275b-5dcd-b228-9a5c2ebfe20e with identifier: KP72135
2026-03-27 10:48:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d13bf739-275b-5dcd-b228-9a5c2ebfe20e with scrape type 2
2026-03-27 10:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d13bf739-275b-5dcd-b228-9a5c2ebfe20e with scrape type 2
2026-03-27 10:48:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d13bf739-275b-5dcd-b228-9a5c2ebfe20e, identifier: KP72135
2026-03-27 10:48:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d13bf739-275b-5dcd-b228-9a5c2ebfe20e with identifier: KP72135
2026-03-27 10:48:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d13bf739-275b-5dcd-b228-9a5c2ebfe20e with identifier: KP72135
2026-03-27 10:48:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d13bf739-275b-5dcd-b228-9a5c2ebfe20e with identifier: KP72135 to the API
2026-03-27 10:48:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:03:30Z',
 'fuel_type': 'petrol',
 'id': 'd13bf739-275b-5dcd-b228-9a5c2ebfe20e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP72135',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 79414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-30',
 'seller_name': None,
 'title': 'Dacia Lodgy 1.2 TCe Stepway',
 'transmission': 'manual',
 'trim': 'Stepway',
 'year': 2018}
2026-03-27 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72135%27 HTTP/1.1" 200 None
2026-03-27 10:48:28 [auto1.de] INFO: Saving data for KP72135: {'auction_closing_time': 1774713810.0, 'created_time': 1773398843.753394, 'last_price_update_time': 1774608508.789278}
2026-03-27 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP72135') HTTP/1.1" 204 0
2026-03-27 10:48:28 [auto1.de] INFO: Found listing with ID: PG30420
2026-03-27 10:48:28 [auto1.de] INFO: Found listing with ID: NZ32972
2026-03-27 10:48:28 [auto1.de] INFO: Found listing with ID: TH91647
2026-03-27 10:48:28 [auto1.de] INFO: Found listing with ID: MF45027
2026-03-27 10:48:28 [auto1.de] INFO: Found listing with ID: MY29921
2026-03-27 10:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LT68556/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_a7caf4f60d945fa27fd6418c6c3a716c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_bcc5cf2b6b89796cec51ad7ca015fd63.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_0723b437f21fac996a05afd52603698d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_4e936de528dcb2dd08c347275503a921.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_99814ed1b0131583675a8855ab2170a3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017325d0>
2026-03-27 10:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37cbefa3-116c-527d-bd73-7fd02a8ea455/37cbefa3-116c-527d-bd73-7fd02a8ea455_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F1e%252Fd91ea9f971f7ec5b879ef7de161d2180%252Fpa%252FJV29717_a7caf4f60d945fa27fd6418c6c3a716c.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_a7caf4f60d945fa27fd6418c6c3a716c.jpg saved to cache
2026-03-27 10:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37cbefa3-116c-527d-bd73-7fd02a8ea455
2026-03-27 10:48:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f2490>
2026-03-27 10:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37cbefa3-116c-527d-bd73-7fd02a8ea455/37cbefa3-116c-527d-bd73-7fd02a8ea455_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F1e%252Fd91ea9f971f7ec5b879ef7de161d2180%252Fpa%252FJV29717_bcc5cf2b6b89796cec51ad7ca015fd63.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_bcc5cf2b6b89796cec51ad7ca015fd63.jpg saved to cache
2026-03-27 10:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37cbefa3-116c-527d-bd73-7fd02a8ea455
2026-03-27 10:48:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50037f2d0>
2026-03-27 10:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37cbefa3-116c-527d-bd73-7fd02a8ea455/37cbefa3-116c-527d-bd73-7fd02a8ea455_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F1e%252Fd91ea9f971f7ec5b879ef7de161d2180%252Fpa%252FJV29717_0723b437f21fac996a05afd52603698d.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_0723b437f21fac996a05afd52603698d.jpg saved to cache
2026-03-27 10:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 37cbefa3-116c-527d-bd73-7fd02a8ea455
2026-03-27 10:48:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001d7410>
2026-03-27 10:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37cbefa3-116c-527d-bd73-7fd02a8ea455/37cbefa3-116c-527d-bd73-7fd02a8ea455_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F1e%252Fd91ea9f971f7ec5b879ef7de161d2180%252Fpa%252FJV29717_4e936de528dcb2dd08c347275503a921.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_4e936de528dcb2dd08c347275503a921.jpg saved to cache
2026-03-27 10:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37cbefa3-116c-527d-bd73-7fd02a8ea455
2026-03-27 10:48:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500571c50>
2026-03-27 10:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37cbefa3-116c-527d-bd73-7fd02a8ea455/37cbefa3-116c-527d-bd73-7fd02a8ea455_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F1e%252Fd91ea9f971f7ec5b879ef7de161d2180%252Fpa%252FJV29717_99814ed1b0131583675a8855ab2170a3.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_99814ed1b0131583675a8855ab2170a3.jpg saved to cache
2026-03-27 10:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 37cbefa3-116c-527d-bd73-7fd02a8ea455
2026-03-27 10:48:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37cbefa3-116c-527d-bd73-7fd02a8ea455, skipping ID generation
2026-03-27 10:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37cbefa3-116c-527d-bd73-7fd02a8ea455 with scrape type 1
2026-03-27 10:48:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37cbefa3-116c-527d-bd73-7fd02a8ea455 sending to next pipeline
2026-03-27 10:48:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37cbefa3-116c-527d-bd73-7fd02a8ea455, identifier: JV29717
2026-03-27 10:48:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37cbefa3-116c-527d-bd73-7fd02a8ea455 with identifier: JV29717
2026-03-27 10:48:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37cbefa3-116c-527d-bd73-7fd02a8ea455 with identifier: JV29717
2026-03-27 10:48:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37cbefa3-116c-527d-bd73-7fd02a8ea455 with identifier: JV29717 to the API
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_99814ed1b0131583675a8855ab2170a3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 229,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:18:18Z',
 'fuel_type': 'diesel',
 'id': '37cbefa3-116c-527d-bd73-7fd02a8ea455',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV29717',
 'listing': 'auction',
 'location': 'DE, Gießen',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 191465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37cbefa3-116c-527d-bd73-7fd02a8ea455/37cbefa3-116c-527d-bd73-7fd02a8ea455_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2904033,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_a7caf4f60d945fa27fd6418c6c3a716c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37cbefa3-116c-527d-bd73-7fd02a8ea455/37cbefa3-116c-527d-bd73-7fd02a8ea455_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_41c70fae957445dd12d3dc48abdbeb8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37cbefa3-116c-527d-bd73-7fd02a8ea455/37cbefa3-116c-527d-bd73-7fd02a8ea455_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2841870,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_0723b437f21fac996a05afd52603698d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37cbefa3-116c-527d-bd73-7fd02a8ea455/37cbefa3-116c-527d-bd73-7fd02a8ea455_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2722984,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_4e936de528dcb2dd08c347275503a921.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37cbefa3-116c-527d-bd73-7fd02a8ea455/37cbefa3-116c-527d-bd73-7fd02a8ea455_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_3c016506e483dee386ba98c787f6f210.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37cbefa3-116c-527d-bd73-7fd02a8ea455/37cbefa3-116c-527d-bd73-7fd02a8ea455_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_8f4a486444d5702a21090d548b247d9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37cbefa3-116c-527d-bd73-7fd02a8ea455/37cbefa3-116c-527d-bd73-7fd02a8ea455_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2680580,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_bcc5cf2b6b89796cec51ad7ca015fd63.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37cbefa3-116c-527d-bd73-7fd02a8ea455/37cbefa3-116c-527d-bd73-7fd02a8ea455_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_af613cdb53a1a92744d5f9898214a55e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37cbefa3-116c-527d-bd73-7fd02a8ea455/37cbefa3-116c-527d-bd73-7fd02a8ea455_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2864587,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_99814ed1b0131583675a8855ab2170a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37cbefa3-116c-527d-bd73-7fd02a8ea455/37cbefa3-116c-527d-bd73-7fd02a8ea455_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/1e/d91ea9f971f7ec5b879ef7de161d2180/pa/JV29717_ea439a4ef9a46c0e238dfd25b67a883d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 3.0d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-27 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV29717%27 HTTP/1.1" 200 None
2026-03-27 10:48:30 [auto1.de] INFO: Saving data for JV29717: {'created_time': 1774608510.180632, 'last_price_update_time': 1774608510.180643, 'auction_closing_time': 1774714698.0}
2026-03-27 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV29717') HTTP/1.1" 204 0
2026-03-27 10:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KK51592/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW44182/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV22200> (referer: https://www.auto1.com/v1/car-details-view/KV22200/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc39fa41-ec43-5868-8f4f-2ec14a28bc7d with identifier: KV22200
2026-03-27 10:48:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc39fa41-ec43-5868-8f4f-2ec14a28bc7d with scrape type 1
2026-03-27 10:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item dc39fa41-ec43-5868-8f4f-2ec14a28bc7d
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa2%252F5aa253c3f3cee92846aa9b0410aa10f7%252Fpa%252FKV22200_a4d6f38448a3bc78d6ad09a4b23aee15.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a2/5aa253c3f3cee92846aa9b0410aa10f7/pa/KV22200_a4d6f38448a3bc78d6ad09a4b23aee15.jpg not downloaded yet
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa2%252F5aa253c3f3cee92846aa9b0410aa10f7%252Fpa%252FKV22200_6c3b034414a60240c59b29769f2ee469.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a2/5aa253c3f3cee92846aa9b0410aa10f7/pa/KV22200_6c3b034414a60240c59b29769f2ee469.jpg not downloaded yet
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa2%252F5aa253c3f3cee92846aa9b0410aa10f7%252Fpa%252FKV22200_43e1ab1113f3a8cfe747350448056da8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a2/5aa253c3f3cee92846aa9b0410aa10f7/pa/KV22200_43e1ab1113f3a8cfe747350448056da8.jpg not downloaded yet
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa2%252F5aa253c3f3cee92846aa9b0410aa10f7%252Fpa%252FKV22200_09915fb4191b285a5542f76746d62ec3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a2/5aa253c3f3cee92846aa9b0410aa10f7/pa/KV22200_09915fb4191b285a5542f76746d62ec3.jpg not downloaded yet
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa2%252F5aa253c3f3cee92846aa9b0410aa10f7%252Fpa%252FKV22200_3e5cdf45742e8b33cf9275af271bd9bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a2/5aa253c3f3cee92846aa9b0410aa10f7/pa/KV22200_3e5cdf45742e8b33cf9275af271bd9bf.jpg not downloaded yet
2026-03-27 10:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/a2/5aa253c3f3cee92846aa9b0410aa10f7/pa/KV22200_6c3b034414a60240c59b29769f2ee469.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/a2/5aa253c3f3cee92846aa9b0410aa10f7/pa/KV22200_a4d6f38448a3bc78d6ad09a4b23aee15.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/a2/5aa253c3f3cee92846aa9b0410aa10f7/pa/KV22200_43e1ab1113f3a8cfe747350448056da8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50058be10>
2026-03-27 10:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc39fa41-ec43-5868-8f4f-2ec14a28bc7d/dc39fa41-ec43-5868-8f4f-2ec14a28bc7d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa2%252F5aa253c3f3cee92846aa9b0410aa10f7%252Fpa%252FKV22200_6c3b034414a60240c59b29769f2ee469.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a2/5aa253c3f3cee92846aa9b0410aa10f7/pa/KV22200_6c3b034414a60240c59b29769f2ee469.jpg saved to cache
2026-03-27 10:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc39fa41-ec43-5868-8f4f-2ec14a28bc7d
2026-03-27 10:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001df290>
2026-03-27 10:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc39fa41-ec43-5868-8f4f-2ec14a28bc7d/dc39fa41-ec43-5868-8f4f-2ec14a28bc7d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa2%252F5aa253c3f3cee92846aa9b0410aa10f7%252Fpa%252FKV22200_a4d6f38448a3bc78d6ad09a4b23aee15.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a2/5aa253c3f3cee92846aa9b0410aa10f7/pa/KV22200_a4d6f38448a3bc78d6ad09a4b23aee15.jpg saved to cache
2026-03-27 10:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc39fa41-ec43-5868-8f4f-2ec14a28bc7d
2026-03-27 10:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002068d0>
2026-03-27 10:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc39fa41-ec43-5868-8f4f-2ec14a28bc7d/dc39fa41-ec43-5868-8f4f-2ec14a28bc7d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa2%252F5aa253c3f3cee92846aa9b0410aa10f7%252Fpa%252FKV22200_43e1ab1113f3a8cfe747350448056da8.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a2/5aa253c3f3cee92846aa9b0410aa10f7/pa/KV22200_43e1ab1113f3a8cfe747350448056da8.jpg saved to cache
2026-03-27 10:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc39fa41-ec43-5868-8f4f-2ec14a28bc7d
2026-03-27 10:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/a2/5aa253c3f3cee92846aa9b0410aa10f7/pa/KV22200_09915fb4191b285a5542f76746d62ec3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/a2/5aa253c3f3cee92846aa9b0410aa10f7/pa/KV22200_3e5cdf45742e8b33cf9275af271bd9bf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501680090>
2026-03-27 10:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc39fa41-ec43-5868-8f4f-2ec14a28bc7d/dc39fa41-ec43-5868-8f4f-2ec14a28bc7d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa2%252F5aa253c3f3cee92846aa9b0410aa10f7%252Fpa%252FKV22200_09915fb4191b285a5542f76746d62ec3.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a2/5aa253c3f3cee92846aa9b0410aa10f7/pa/KV22200_09915fb4191b285a5542f76746d62ec3.jpg saved to cache
2026-03-27 10:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc39fa41-ec43-5868-8f4f-2ec14a28bc7d
2026-03-27 10:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb502610710>
2026-03-27 10:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc39fa41-ec43-5868-8f4f-2ec14a28bc7d/dc39fa41-ec43-5868-8f4f-2ec14a28bc7d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa2%252F5aa253c3f3cee92846aa9b0410aa10f7%252Fpa%252FKV22200_3e5cdf45742e8b33cf9275af271bd9bf.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a2/5aa253c3f3cee92846aa9b0410aa10f7/pa/KV22200_3e5cdf45742e8b33cf9275af271bd9bf.jpg saved to cache
2026-03-27 10:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc39fa41-ec43-5868-8f4f-2ec14a28bc7d
2026-03-27 10:48:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc39fa41-ec43-5868-8f4f-2ec14a28bc7d, skipping ID generation
2026-03-27 10:48:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc39fa41-ec43-5868-8f4f-2ec14a28bc7d with scrape type 1
2026-03-27 10:48:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc39fa41-ec43-5868-8f4f-2ec14a28bc7d sending to next pipeline
2026-03-27 10:48:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc39fa41-ec43-5868-8f4f-2ec14a28bc7d, identifier: KV22200
2026-03-27 10:48:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc39fa41-ec43-5868-8f4f-2ec14a28bc7d with identifier: KV22200
2026-03-27 10:48:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc39fa41-ec43-5868-8f4f-2ec14a28bc7d with identifier: KV22200
2026-03-27 10:48:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc39fa41-ec43-5868-8f4f-2ec14a28bc7d with identifier: KV22200 to the API
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5a/a2/5aa253c3f3cee92846aa9b0410aa10f7/pa/KV22200_3e5cdf45742e8b33cf9275af271bd9bf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:31:52Z',
 'fuel_type': 'petrol',
 'id': 'dc39fa41-ec43-5868-8f4f-2ec14a28bc7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV22200',
 'listing': 'auction',
 'location': 'DE, Beckum',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 101003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc39fa41-ec43-5868-8f4f-2ec14a28bc7d/dc39fa41-ec43-5868-8f4f-2ec14a28bc7d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/a2/5aa253c3f3cee92846aa9b0410aa10f7/pa/KV22200_a4d6f38448a3bc78d6ad09a4b23aee15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc39fa41-ec43-5868-8f4f-2ec14a28bc7d/dc39fa41-ec43-5868-8f4f-2ec14a28bc7d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/a2/5aa253c3f3cee92846aa9b0410aa10f7/pa/KV22200_6c3b034414a60240c59b29769f2ee469.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc39fa41-ec43-5868-8f4f-2ec14a28bc7d/dc39fa41-ec43-5868-8f4f-2ec14a28bc7d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/a2/5aa253c3f3cee92846aa9b0410aa10f7/pa/KV22200_43e1ab1113f3a8cfe747350448056da8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc39fa41-ec43-5868-8f4f-2ec14a28bc7d/dc39fa41-ec43-5868-8f4f-2ec14a28bc7d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/a2/5aa253c3f3cee92846aa9b0410aa10f7/pa/KV22200_09915fb4191b285a5542f76746d62ec3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc39fa41-ec43-5868-8f4f-2ec14a28bc7d/dc39fa41-ec43-5868-8f4f-2ec14a28bc7d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/a2/5aa253c3f3cee92846aa9b0410aa10f7/pa/KV22200_3e5cdf45742e8b33cf9275af271bd9bf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-11-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Rip Curl',
 'transmission': 'manual',
 'trim': 'Rip Curl',
 'year': 2011}
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV22200%27 HTTP/1.1" 200 None
2026-03-27 10:48:33 [auto1.de] INFO: Saving data for KV22200: {'created_time': 1774608513.908405, 'last_price_update_time': 1774608513.908417, 'auction_closing_time': 1774715512.0}
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV22200') HTTP/1.1" 204 0
2026-03-27 10:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LT68556> (referer: https://www.auto1.com/v1/car-details-view/LT68556/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a50451e-ab53-50ed-8c20-f2a44ca81a22 with identifier: LT68556
2026-03-27 10:48:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a50451e-ab53-50ed-8c20-f2a44ca81a22 with scrape type 1
2026-03-27 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a50451e-ab53-50ed-8c20-f2a44ca81a22
2026-03-27 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a9f8eec9070160db95c7fede69c231%252Fpa%252FLT68556_eb507b4480716ec5664eb19a06301760.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_eb507b4480716ec5664eb19a06301760.jpg not downloaded yet
2026-03-27 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a9f8eec9070160db95c7fede69c231%252Fpa%252FLT68556_a9eda3aa262dd067081a8e267c03dcfa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_a9eda3aa262dd067081a8e267c03dcfa.jpg not downloaded yet
2026-03-27 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a9f8eec9070160db95c7fede69c231%252Fpa%252FLT68556_a65f5ff5b6e7aa37040d72682da272fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_a65f5ff5b6e7aa37040d72682da272fa.jpg not downloaded yet
2026-03-27 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a9f8eec9070160db95c7fede69c231%252Fpa%252FLT68556_a6df1191e1ceb6034b26ad0fd0fe02a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_a6df1191e1ceb6034b26ad0fd0fe02a7.jpg not downloaded yet
2026-03-27 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a9f8eec9070160db95c7fede69c231%252Fpa%252FLT68556_5a451f7cac629f56695de025f867c6ec.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_5a451f7cac629f56695de025f867c6ec.jpg not downloaded yet
2026-03-27 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a9f8eec9070160db95c7fede69c231%252Fpa%252FLT68556_cc2ae99f7578b2c6fafe84d208265a75.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_cc2ae99f7578b2c6fafe84d208265a75.jpg not downloaded yet
2026-03-27 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a9f8eec9070160db95c7fede69c231%252Fpa%252FLT68556_b4e2adb8d617df86806c333478b5ce91.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_b4e2adb8d617df86806c333478b5ce91.jpg not downloaded yet
2026-03-27 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a9f8eec9070160db95c7fede69c231%252Fpa%252FLT68556_b7ed53bf73588e0f43f26323b1d2f286.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_b7ed53bf73588e0f43f26323b1d2f286.jpg not downloaded yet
2026-03-27 10:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_a9eda3aa262dd067081a8e267c03dcfa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a9f8eec9070160db95c7fede69c231%252Fpa%252FLT68556_f33ee13a6db6028d920f142008fa233f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_f33ee13a6db6028d920f142008fa233f.jpg not downloaded yet
2026-03-27 10:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_eb507b4480716ec5664eb19a06301760.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a9f8eec9070160db95c7fede69c231%252Fpa%252FLT68556_106aed41623558be4b0b8d0ac515c66d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_106aed41623558be4b0b8d0ac515c66d.jpg not downloaded yet
2026-03-27 10:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_a65f5ff5b6e7aa37040d72682da272fa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_b7ed53bf73588e0f43f26323b1d2f286.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500556a10>
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a50451e-ab53-50ed-8c20-f2a44ca81a22/9a50451e-ab53-50ed-8c20-f2a44ca81a22_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a9f8eec9070160db95c7fede69c231%252Fpa%252FLT68556_a9eda3aa262dd067081a8e267c03dcfa.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_a9eda3aa262dd067081a8e267c03dcfa.jpg saved to cache
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a50451e-ab53-50ed-8c20-f2a44ca81a22
2026-03-27 10:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_b4e2adb8d617df86806c333478b5ce91.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_106aed41623558be4b0b8d0ac515c66d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501948f10>
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a50451e-ab53-50ed-8c20-f2a44ca81a22/9a50451e-ab53-50ed-8c20-f2a44ca81a22_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a9f8eec9070160db95c7fede69c231%252Fpa%252FLT68556_eb507b4480716ec5664eb19a06301760.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_eb507b4480716ec5664eb19a06301760.jpg saved to cache
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a50451e-ab53-50ed-8c20-f2a44ca81a22
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500494850>
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a50451e-ab53-50ed-8c20-f2a44ca81a22/9a50451e-ab53-50ed-8c20-f2a44ca81a22_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a9f8eec9070160db95c7fede69c231%252Fpa%252FLT68556_a65f5ff5b6e7aa37040d72682da272fa.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_a65f5ff5b6e7aa37040d72682da272fa.jpg saved to cache
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a50451e-ab53-50ed-8c20-f2a44ca81a22
2026-03-27 10:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_a6df1191e1ceb6034b26ad0fd0fe02a7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_cc2ae99f7578b2c6fafe84d208265a75.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_f33ee13a6db6028d920f142008fa233f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_5a451f7cac629f56695de025f867c6ec.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a17e10>
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a50451e-ab53-50ed-8c20-f2a44ca81a22/9a50451e-ab53-50ed-8c20-f2a44ca81a22_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a9f8eec9070160db95c7fede69c231%252Fpa%252FLT68556_b7ed53bf73588e0f43f26323b1d2f286.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_b7ed53bf73588e0f43f26323b1d2f286.jpg saved to cache
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a50451e-ab53-50ed-8c20-f2a44ca81a22
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501742450>
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a50451e-ab53-50ed-8c20-f2a44ca81a22/9a50451e-ab53-50ed-8c20-f2a44ca81a22_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a9f8eec9070160db95c7fede69c231%252Fpa%252FLT68556_b4e2adb8d617df86806c333478b5ce91.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_b4e2adb8d617df86806c333478b5ce91.jpg saved to cache
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a50451e-ab53-50ed-8c20-f2a44ca81a22
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015f1b10>
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a50451e-ab53-50ed-8c20-f2a44ca81a22/9a50451e-ab53-50ed-8c20-f2a44ca81a22_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a9f8eec9070160db95c7fede69c231%252Fpa%252FLT68556_106aed41623558be4b0b8d0ac515c66d.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_106aed41623558be4b0b8d0ac515c66d.jpg saved to cache
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a50451e-ab53-50ed-8c20-f2a44ca81a22
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50033bc10>
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a50451e-ab53-50ed-8c20-f2a44ca81a22/9a50451e-ab53-50ed-8c20-f2a44ca81a22_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a9f8eec9070160db95c7fede69c231%252Fpa%252FLT68556_a6df1191e1ceb6034b26ad0fd0fe02a7.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_a6df1191e1ceb6034b26ad0fd0fe02a7.jpg saved to cache
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a50451e-ab53-50ed-8c20-f2a44ca81a22
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004d3ad0>
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a50451e-ab53-50ed-8c20-f2a44ca81a22/9a50451e-ab53-50ed-8c20-f2a44ca81a22_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a9f8eec9070160db95c7fede69c231%252Fpa%252FLT68556_cc2ae99f7578b2c6fafe84d208265a75.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_cc2ae99f7578b2c6fafe84d208265a75.jpg saved to cache
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a50451e-ab53-50ed-8c20-f2a44ca81a22
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50178fed0>
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a50451e-ab53-50ed-8c20-f2a44ca81a22/9a50451e-ab53-50ed-8c20-f2a44ca81a22_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a9f8eec9070160db95c7fede69c231%252Fpa%252FLT68556_f33ee13a6db6028d920f142008fa233f.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_f33ee13a6db6028d920f142008fa233f.jpg saved to cache
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a50451e-ab53-50ed-8c20-f2a44ca81a22
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a3790>
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a50451e-ab53-50ed-8c20-f2a44ca81a22/9a50451e-ab53-50ed-8c20-f2a44ca81a22_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa9%252Fb9a9f8eec9070160db95c7fede69c231%252Fpa%252FLT68556_5a451f7cac629f56695de025f867c6ec.jpg') HTTP/1.1" 204 0
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_5a451f7cac629f56695de025f867c6ec.jpg saved to cache
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a50451e-ab53-50ed-8c20-f2a44ca81a22
2026-03-27 10:48:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a50451e-ab53-50ed-8c20-f2a44ca81a22, skipping ID generation
2026-03-27 10:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a50451e-ab53-50ed-8c20-f2a44ca81a22 with scrape type 1
2026-03-27 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a50451e-ab53-50ed-8c20-f2a44ca81a22 sending to next pipeline
2026-03-27 10:48:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a50451e-ab53-50ed-8c20-f2a44ca81a22, identifier: LT68556
2026-03-27 10:48:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a50451e-ab53-50ed-8c20-f2a44ca81a22 with identifier: LT68556
2026-03-27 10:48:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a50451e-ab53-50ed-8c20-f2a44ca81a22 with identifier: LT68556
2026-03-27 10:48:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a50451e-ab53-50ed-8c20-f2a44ca81a22 with identifier: LT68556 to the API
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_5a451f7cac629f56695de025f867c6ec.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 283,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:32:32Z',
 'fuel_type': 'diesel',
 'id': '9a50451e-ab53-50ed-8c20-f2a44ca81a22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT68556',
 'listing': 'auction',
 'location': 'DE, Mönchengladbach',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 242542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a50451e-ab53-50ed-8c20-f2a44ca81a22/9a50451e-ab53-50ed-8c20-f2a44ca81a22_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_eb507b4480716ec5664eb19a06301760.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a50451e-ab53-50ed-8c20-f2a44ca81a22/9a50451e-ab53-50ed-8c20-f2a44ca81a22_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_a9eda3aa262dd067081a8e267c03dcfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a50451e-ab53-50ed-8c20-f2a44ca81a22/9a50451e-ab53-50ed-8c20-f2a44ca81a22_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_a65f5ff5b6e7aa37040d72682da272fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a50451e-ab53-50ed-8c20-f2a44ca81a22/9a50451e-ab53-50ed-8c20-f2a44ca81a22_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_a6df1191e1ceb6034b26ad0fd0fe02a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a50451e-ab53-50ed-8c20-f2a44ca81a22/9a50451e-ab53-50ed-8c20-f2a44ca81a22_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_5a451f7cac629f56695de025f867c6ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a50451e-ab53-50ed-8c20-f2a44ca81a22/9a50451e-ab53-50ed-8c20-f2a44ca81a22_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_cc2ae99f7578b2c6fafe84d208265a75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a50451e-ab53-50ed-8c20-f2a44ca81a22/9a50451e-ab53-50ed-8c20-f2a44ca81a22_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_b4e2adb8d617df86806c333478b5ce91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a50451e-ab53-50ed-8c20-f2a44ca81a22/9a50451e-ab53-50ed-8c20-f2a44ca81a22_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_b7ed53bf73588e0f43f26323b1d2f286.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a50451e-ab53-50ed-8c20-f2a44ca81a22/9a50451e-ab53-50ed-8c20-f2a44ca81a22_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_f33ee13a6db6028d920f142008fa233f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a50451e-ab53-50ed-8c20-f2a44ca81a22/9a50451e-ab53-50ed-8c20-f2a44ca81a22_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a9/b9a9f8eec9070160db95c7fede69c231/pa/LT68556_106aed41623558be4b0b8d0ac515c66d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-27 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT68556%27 HTTP/1.1" 200 None
2026-03-27 10:48:37 [auto1.de] INFO: Saving data for LT68556: {'created_time': 1774608517.035784, 'last_price_update_time': 1774608517.035795, 'auction_closing_time': 1774715552.0}
2026-03-27 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT68556') HTTP/1.1" 204 0
2026-03-27 10:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KK51592> (referer: https://www.auto1.com/v1/car-details-view/KK51592/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d00ef788-d77a-50fd-ab82-2445915f1f3d with identifier: KK51592
2026-03-27 10:48:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d00ef788-d77a-50fd-ab82-2445915f1f3d with scrape type 1
2026-03-27 10:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d00ef788-d77a-50fd-ab82-2445915f1f3d
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F9f%252F2f9f425d169fd9b04a278ac799104b1e%252Fpa%252FKK51592_9aafe3a22239f4f737d90969042bad94.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_9aafe3a22239f4f737d90969042bad94.jpg already downloaded
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F9f%252F2f9f425d169fd9b04a278ac799104b1e%252Fpa%252FKK51592_0e57dc241d2faa08cc9ca083f3bb98a4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_0e57dc241d2faa08cc9ca083f3bb98a4.jpg already downloaded
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F9f%252F2f9f425d169fd9b04a278ac799104b1e%252Fpa%252FKK51592_2029015dced46873c8a0ccf57e574ab8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_2029015dced46873c8a0ccf57e574ab8.jpg already downloaded
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F9f%252F2f9f425d169fd9b04a278ac799104b1e%252Fpa%252FKK51592_f9cd5136cac8ea0a6093d52439879638.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_f9cd5136cac8ea0a6093d52439879638.jpg already downloaded
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F9f%252F2f9f425d169fd9b04a278ac799104b1e%252Fpa%252FKK51592_e7a3d393cc8cb958e2995a90f1cd5c4d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_e7a3d393cc8cb958e2995a90f1cd5c4d.jpg already downloaded
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F9f%252F2f9f425d169fd9b04a278ac799104b1e%252Fpa%252FKK51592_05ebb72ab2017dd507d970f3c6a6cb83.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_05ebb72ab2017dd507d970f3c6a6cb83.jpg already downloaded
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F9f%252F2f9f425d169fd9b04a278ac799104b1e%252Fpa%252FKK51592_ed5cbb5cb0ff97956d732e4a04e4d6e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_ed5cbb5cb0ff97956d732e4a04e4d6e3.jpg already downloaded
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F9f%252F2f9f425d169fd9b04a278ac799104b1e%252Fpa%252FKK51592_1d4b527d146419eb718df39dfcf5085d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_1d4b527d146419eb718df39dfcf5085d.jpg already downloaded
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F9f%252F2f9f425d169fd9b04a278ac799104b1e%252Fpa%252FKK51592_14ee5003467a4dcca2055ef7f0c59559.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_14ee5003467a4dcca2055ef7f0c59559.jpg already downloaded
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F9f%252F2f9f425d169fd9b04a278ac799104b1e%252Fpa%252FKK51592_0cbeed28116df8373e65c718dec5624e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_0cbeed28116df8373e65c718dec5624e.jpg already downloaded
2026-03-27 10:48:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d00ef788-d77a-50fd-ab82-2445915f1f3d, identifier: KK51592
2026-03-27 10:48:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d00ef788-d77a-50fd-ab82-2445915f1f3d with identifier: KK51592
2026-03-27 10:48:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d00ef788-d77a-50fd-ab82-2445915f1f3d with identifier: KK51592
2026-03-27 10:48:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d00ef788-d77a-50fd-ab82-2445915f1f3d with identifier: KK51592 to the API
2026-03-27 10:48:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KK51592>
{'auction_title': '',
 'c_o_2_emission_value': 195,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:46:29Z',
 'fuel_type': 'diesel',
 'id': 'd00ef788-d77a-50fd-ab82-2445915f1f3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK51592',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_9aafe3a22239f4f737d90969042bad94.jpg',
                'https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_0e57dc241d2faa08cc9ca083f3bb98a4.jpg',
                'https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_2029015dced46873c8a0ccf57e574ab8.jpg',
                'https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_f9cd5136cac8ea0a6093d52439879638.jpg',
                'https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_e7a3d393cc8cb958e2995a90f1cd5c4d.jpg',
                'https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_05ebb72ab2017dd507d970f3c6a6cb83.jpg',
                'https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_ed5cbb5cb0ff97956d732e4a04e4d6e3.jpg',
                'https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_1d4b527d146419eb718df39dfcf5085d.jpg',
                'https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_14ee5003467a4dcca2055ef7f0c59559.jpg',
                'https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_0cbeed28116df8373e65c718dec5624e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00ef788-d77a-50fd-ab82-2445915f1f3d/d00ef788-d77a-50fd-ab82-2445915f1f3d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_9aafe3a22239f4f737d90969042bad94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00ef788-d77a-50fd-ab82-2445915f1f3d/d00ef788-d77a-50fd-ab82-2445915f1f3d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_0e57dc241d2faa08cc9ca083f3bb98a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00ef788-d77a-50fd-ab82-2445915f1f3d/d00ef788-d77a-50fd-ab82-2445915f1f3d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_2029015dced46873c8a0ccf57e574ab8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00ef788-d77a-50fd-ab82-2445915f1f3d/d00ef788-d77a-50fd-ab82-2445915f1f3d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_f9cd5136cac8ea0a6093d52439879638.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00ef788-d77a-50fd-ab82-2445915f1f3d/d00ef788-d77a-50fd-ab82-2445915f1f3d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_e7a3d393cc8cb958e2995a90f1cd5c4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00ef788-d77a-50fd-ab82-2445915f1f3d/d00ef788-d77a-50fd-ab82-2445915f1f3d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_05ebb72ab2017dd507d970f3c6a6cb83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00ef788-d77a-50fd-ab82-2445915f1f3d/d00ef788-d77a-50fd-ab82-2445915f1f3d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_ed5cbb5cb0ff97956d732e4a04e4d6e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00ef788-d77a-50fd-ab82-2445915f1f3d/d00ef788-d77a-50fd-ab82-2445915f1f3d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_1d4b527d146419eb718df39dfcf5085d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00ef788-d77a-50fd-ab82-2445915f1f3d/d00ef788-d77a-50fd-ab82-2445915f1f3d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_14ee5003467a4dcca2055ef7f0c59559.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d00ef788-d77a-50fd-ab82-2445915f1f3d/d00ef788-d77a-50fd-ab82-2445915f1f3d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/9f/2f9f425d169fd9b04a278ac799104b1e/pa/KK51592_0cbeed28116df8373e65c718dec5624e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi Energy L3H1 4,5t',
 'transmission': 'manual',
 'trim': 'L3H1 4,5t',
 'year': 2019}
2026-03-27 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK51592%27 HTTP/1.1" 200 None
2026-03-27 10:48:39 [auto1.de] INFO: Saving data for KK51592: {'created_time': 1774608519.157895, 'last_price_update_time': 1774608519.157906, 'auction_closing_time': 1774716389.0}
2026-03-27 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK51592') HTTP/1.1" 204 0
2026-03-27 10:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW44182> (referer: https://www.auto1.com/v1/car-details-view/TW44182/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e2cb989-aea7-5d9f-80a9-95f8506662a2 with identifier: TW44182
2026-03-27 10:48:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e2cb989-aea7-5d9f-80a9-95f8506662a2 with scrape type 1
2026-03-27 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e2cb989-aea7-5d9f-80a9-95f8506662a2
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F31%252F27317617ca1c33c1528001a0cc325bfe%252Fpa%252FTW44182_f34b7987cd36356822b0d6fed0b2638c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_f34b7987cd36356822b0d6fed0b2638c.jpg already downloaded
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F31%252F27317617ca1c33c1528001a0cc325bfe%252Fpa%252FTW44182_7230646ee1d8bcc2b55d701fca996e68.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_7230646ee1d8bcc2b55d701fca996e68.jpg already downloaded
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F31%252F27317617ca1c33c1528001a0cc325bfe%252Fpa%252FTW44182_ecb23136dc0998c482a41b6576039a9f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_ecb23136dc0998c482a41b6576039a9f.jpg already downloaded
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F31%252F27317617ca1c33c1528001a0cc325bfe%252Fpa%252FTW44182_17f5f6cf5c48cbda78b992657fb1c6fd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_17f5f6cf5c48cbda78b992657fb1c6fd.jpg already downloaded
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F31%252F27317617ca1c33c1528001a0cc325bfe%252Fpa%252FTW44182_5d307bb679d5bfb7eebb4355d6a7847c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_5d307bb679d5bfb7eebb4355d6a7847c.jpg already downloaded
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F31%252F27317617ca1c33c1528001a0cc325bfe%252Fpa%252FTW44182_51bf4809444c1f6acb95af9ef020d813.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_51bf4809444c1f6acb95af9ef020d813.jpg already downloaded
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F31%252F27317617ca1c33c1528001a0cc325bfe%252Fpa%252FTW44182_26d98cf79f10c5b5e95f19c11388ebfd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_26d98cf79f10c5b5e95f19c11388ebfd.jpg already downloaded
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F31%252F27317617ca1c33c1528001a0cc325bfe%252Fpa%252FTW44182_1b9b1d4385b516bdd79cb940fb7f5f08.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_1b9b1d4385b516bdd79cb940fb7f5f08.jpg already downloaded
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F31%252F27317617ca1c33c1528001a0cc325bfe%252Fpa%252FTW44182_bc0fcc1e2870e90f6ec131c7eed41286.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_bc0fcc1e2870e90f6ec131c7eed41286.jpg already downloaded
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F31%252F27317617ca1c33c1528001a0cc325bfe%252Fpa%252FTW44182_9aa3f76459a5d4191bae1c53a5e42e4c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_9aa3f76459a5d4191bae1c53a5e42e4c.jpg already downloaded
2026-03-27 10:48:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e2cb989-aea7-5d9f-80a9-95f8506662a2, identifier: TW44182
2026-03-27 10:48:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e2cb989-aea7-5d9f-80a9-95f8506662a2 with identifier: TW44182
2026-03-27 10:48:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e2cb989-aea7-5d9f-80a9-95f8506662a2 with identifier: TW44182
2026-03-27 10:48:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e2cb989-aea7-5d9f-80a9-95f8506662a2 with identifier: TW44182 to the API
2026-03-27 10:48:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TW44182>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.5L',
 'engine_horse_power': 299,
 'expiration_date': '2026-03-28T16:33:01Z',
 'fuel_type': 'hybrid',
 'id': '2e2cb989-aea7-5d9f-80a9-95f8506662a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW44182',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Lexus',
 'model': 'RX-Serie',
 'odometer': 129826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_f34b7987cd36356822b0d6fed0b2638c.jpg',
                'https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_7230646ee1d8bcc2b55d701fca996e68.jpg',
                'https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_ecb23136dc0998c482a41b6576039a9f.jpg',
                'https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_17f5f6cf5c48cbda78b992657fb1c6fd.jpg',
                'https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_5d307bb679d5bfb7eebb4355d6a7847c.jpg',
                'https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_51bf4809444c1f6acb95af9ef020d813.jpg',
                'https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_26d98cf79f10c5b5e95f19c11388ebfd.jpg',
                'https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_1b9b1d4385b516bdd79cb940fb7f5f08.jpg',
                'https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_bc0fcc1e2870e90f6ec131c7eed41286.jpg',
                'https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_9aa3f76459a5d4191bae1c53a5e42e4c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e2cb989-aea7-5d9f-80a9-95f8506662a2/2e2cb989-aea7-5d9f-80a9-95f8506662a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_f34b7987cd36356822b0d6fed0b2638c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e2cb989-aea7-5d9f-80a9-95f8506662a2/2e2cb989-aea7-5d9f-80a9-95f8506662a2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_7230646ee1d8bcc2b55d701fca996e68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e2cb989-aea7-5d9f-80a9-95f8506662a2/2e2cb989-aea7-5d9f-80a9-95f8506662a2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_ecb23136dc0998c482a41b6576039a9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e2cb989-aea7-5d9f-80a9-95f8506662a2/2e2cb989-aea7-5d9f-80a9-95f8506662a2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_17f5f6cf5c48cbda78b992657fb1c6fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e2cb989-aea7-5d9f-80a9-95f8506662a2/2e2cb989-aea7-5d9f-80a9-95f8506662a2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_5d307bb679d5bfb7eebb4355d6a7847c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e2cb989-aea7-5d9f-80a9-95f8506662a2/2e2cb989-aea7-5d9f-80a9-95f8506662a2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_51bf4809444c1f6acb95af9ef020d813.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e2cb989-aea7-5d9f-80a9-95f8506662a2/2e2cb989-aea7-5d9f-80a9-95f8506662a2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_26d98cf79f10c5b5e95f19c11388ebfd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e2cb989-aea7-5d9f-80a9-95f8506662a2/2e2cb989-aea7-5d9f-80a9-95f8506662a2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_1b9b1d4385b516bdd79cb940fb7f5f08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e2cb989-aea7-5d9f-80a9-95f8506662a2/2e2cb989-aea7-5d9f-80a9-95f8506662a2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_bc0fcc1e2870e90f6ec131c7eed41286.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e2cb989-aea7-5d9f-80a9-95f8506662a2/2e2cb989-aea7-5d9f-80a9-95f8506662a2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/31/27317617ca1c33c1528001a0cc325bfe/pa/TW44182_9aa3f76459a5d4191bae1c53a5e42e4c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lexus RX-Serie RX 450h Impression',
 'transmission': 'automatic',
 'trim': 'Impression',
 'year': 2010}
2026-03-27 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44182%27 HTTP/1.1" 200 None
2026-03-27 10:48:47 [auto1.de] INFO: Saving data for TW44182: {'created_time': 1774608527.39522, 'last_price_update_time': 1774608527.395232, 'auction_closing_time': 1774715581.0}
2026-03-27 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW44182') HTTP/1.1" 204 0
2026-03-27 10:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:48:56 [auto1.de] INFO: Channel: 24h | Page: 44 | totalHits: 10570 | hits on page: 40
2026-03-27 10:48:56 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-27 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72135%27 HTTP/1.1" 200 None
2026-03-27 10:48:56 [auto1.de] INFO: Scrape type for KP72135: 0
2026-03-27 10:48:56 [auto1.de] INFO: Found listing with ID: PG30420
2026-03-27 10:48:56 [auto1.de] INFO: Found listing with ID: NZ32972
2026-03-27 10:48:56 [auto1.de] INFO: Found listing with ID: TH91647
2026-03-27 10:48:56 [auto1.de] INFO: Found listing with ID: MF45027
2026-03-27 10:48:56 [auto1.de] INFO: Found listing with ID: MY29921
2026-03-27 10:48:56 [auto1.de] INFO: Found listing with ID: FB84476
2026-03-27 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB84476%27 HTTP/1.1" 200 None
2026-03-27 10:48:56 [auto1.de] INFO: Scrape type for FB84476: 2
2026-03-27 10:48:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 769549db-d892-59e7-93d8-e495c48928ce with identifier: FB84476
2026-03-27 10:48:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 769549db-d892-59e7-93d8-e495c48928ce with scrape type 2
2026-03-27 10:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 769549db-d892-59e7-93d8-e495c48928ce with scrape type 2
2026-03-27 10:48:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 769549db-d892-59e7-93d8-e495c48928ce, identifier: FB84476
2026-03-27 10:48:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 769549db-d892-59e7-93d8-e495c48928ce with identifier: FB84476
2026-03-27 10:48:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 769549db-d892-59e7-93d8-e495c48928ce with identifier: FB84476
2026-03-27 10:48:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 769549db-d892-59e7-93d8-e495c48928ce with identifier: FB84476 to the API
2026-03-27 10:48:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:35:36Z',
 'fuel_type': 'petrol',
 'id': '769549db-d892-59e7-93d8-e495c48928ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB84476',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 144759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-08',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CGI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-27 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB84476%27 HTTP/1.1" 200 None
2026-03-27 10:48:56 [auto1.de] INFO: Saving data for FB84476: {'auction_closing_time': 1774715736.0, 'created_time': 1773341611.653298, 'last_price_update_time': 1774608536.79286}
2026-03-27 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB84476') HTTP/1.1" 204 0
2026-03-27 10:48:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:56 [auto1.de] INFO: Found listing with ID: ST57334
2026-03-27 10:48:56 [auto1.de] INFO: Found listing with ID: FS00408
2026-03-27 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS00408%27 HTTP/1.1" 200 None
2026-03-27 10:48:56 [auto1.de] INFO: Scrape type for FS00408: 2
2026-03-27 10:48:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0e4d6eb-965b-5ee3-8193-f5b3332c0fea with identifier: FS00408
2026-03-27 10:48:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0e4d6eb-965b-5ee3-8193-f5b3332c0fea with scrape type 2
2026-03-27 10:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0e4d6eb-965b-5ee3-8193-f5b3332c0fea with scrape type 2
2026-03-27 10:48:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0e4d6eb-965b-5ee3-8193-f5b3332c0fea, identifier: FS00408
2026-03-27 10:48:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0e4d6eb-965b-5ee3-8193-f5b3332c0fea with identifier: FS00408
2026-03-27 10:48:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0e4d6eb-965b-5ee3-8193-f5b3332c0fea with identifier: FS00408
2026-03-27 10:48:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0e4d6eb-965b-5ee3-8193-f5b3332c0fea with identifier: FS00408 to the API
2026-03-27 10:48:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-28T16:53:34Z',
 'fuel_type': 'petrol',
 'id': 'a0e4d6eb-965b-5ee3-8193-f5b3332c0fea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS00408',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 53248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 200 Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-27 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS00408%27 HTTP/1.1" 200 None
2026-03-27 10:48:57 [auto1.de] INFO: Saving data for FS00408: {'auction_closing_time': 1774716814.0, 'created_time': 1774292936.275523, 'last_price_update_time': 1774608537.333605}
2026-03-27 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS00408') HTTP/1.1" 204 0
2026-03-27 10:48:57 [auto1.de] INFO: Found listing with ID: KM30220
2026-03-27 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM30220%27 HTTP/1.1" 200 None
2026-03-27 10:48:57 [auto1.de] INFO: Scrape type for KM30220: 2
2026-03-27 10:48:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4083ecd1-3298-5b57-950f-261d48ab49cf with identifier: KM30220
2026-03-27 10:48:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4083ecd1-3298-5b57-950f-261d48ab49cf with scrape type 2
2026-03-27 10:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4083ecd1-3298-5b57-950f-261d48ab49cf with scrape type 2
2026-03-27 10:48:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4083ecd1-3298-5b57-950f-261d48ab49cf, identifier: KM30220
2026-03-27 10:48:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4083ecd1-3298-5b57-950f-261d48ab49cf with identifier: KM30220
2026-03-27 10:48:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4083ecd1-3298-5b57-950f-261d48ab49cf with identifier: KM30220
2026-03-27 10:48:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4083ecd1-3298-5b57-950f-261d48ab49cf with identifier: KM30220 to the API
2026-03-27 10:48:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:35:31Z',
 'fuel_type': 'petrol',
 'id': '4083ecd1-3298-5b57-950f-261d48ab49cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM30220',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 243376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-16',
 'seller_name': None,
 'title': 'Audi A1 1.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-27 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM30220%27 HTTP/1.1" 200 None
2026-03-27 10:48:57 [auto1.de] INFO: Saving data for KM30220: {'auction_closing_time': 1774715731.0, 'created_time': 1773341525.447016, 'last_price_update_time': 1774608537.770004}
2026-03-27 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM30220') HTTP/1.1" 204 0
2026-03-27 10:48:57 [auto1.de] INFO: Found listing with ID: YC77608
2026-03-27 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC77608%27 HTTP/1.1" 200 None
2026-03-27 10:48:57 [auto1.de] INFO: Scrape type for YC77608: 2
2026-03-27 10:48:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 320515d7-50b6-5e19-935c-fc4085b6edbf with identifier: YC77608
2026-03-27 10:48:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 320515d7-50b6-5e19-935c-fc4085b6edbf with scrape type 2
2026-03-27 10:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 320515d7-50b6-5e19-935c-fc4085b6edbf with scrape type 2
2026-03-27 10:48:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 320515d7-50b6-5e19-935c-fc4085b6edbf, identifier: YC77608
2026-03-27 10:48:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 320515d7-50b6-5e19-935c-fc4085b6edbf with identifier: YC77608
2026-03-27 10:48:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 320515d7-50b6-5e19-935c-fc4085b6edbf with identifier: YC77608
2026-03-27 10:48:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 320515d7-50b6-5e19-935c-fc4085b6edbf with identifier: YC77608 to the API
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 255,
 'expiration_date': '2026-03-28T16:23:44Z',
 'fuel_type': 'diesel',
 'id': '320515d7-50b6-5e19-935c-fc4085b6edbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC77608',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 4',
 'odometer': 133239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-19',
 'seller_name': None,
 'title': 'Land Rover Discovery 4 3.0 TD V6 SDV6 HSE',
 'transmission': 'automatic',
 'trim': 'SDV6 HSE',
 'year': 2014}
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC77608%27 HTTP/1.1" 200 None
2026-03-27 10:48:58 [auto1.de] INFO: Saving data for YC77608: {'auction_closing_time': 1774715024.0, 'created_time': 1773224642.009803, 'last_price_update_time': 1774608538.271647}
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC77608') HTTP/1.1" 204 0
2026-03-27 10:48:58 [auto1.de] INFO: Found listing with ID: ZM90265
2026-03-27 10:48:58 [auto1.de] INFO: Found listing with ID: YS55163
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS55163%27 HTTP/1.1" 200 None
2026-03-27 10:48:58 [auto1.de] INFO: Scrape type for YS55163: 2
2026-03-27 10:48:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59314d11-3d3a-53a2-873c-52c843a5a3d7 with identifier: YS55163
2026-03-27 10:48:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59314d11-3d3a-53a2-873c-52c843a5a3d7 with scrape type 2
2026-03-27 10:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59314d11-3d3a-53a2-873c-52c843a5a3d7 with scrape type 2
2026-03-27 10:48:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59314d11-3d3a-53a2-873c-52c843a5a3d7, identifier: YS55163
2026-03-27 10:48:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59314d11-3d3a-53a2-873c-52c843a5a3d7 with identifier: YS55163
2026-03-27 10:48:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59314d11-3d3a-53a2-873c-52c843a5a3d7 with identifier: YS55163
2026-03-27 10:48:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59314d11-3d3a-53a2-873c-52c843a5a3d7 with identifier: YS55163 to the API
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:39:41Z',
 'fuel_type': 'petrol',
 'id': '59314d11-3d3a-53a2-873c-52c843a5a3d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS55163',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 41237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-25',
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe Extreme+',
 'transmission': 'manual',
 'trim': 'Extreme+',
 'year': 2023}
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS55163%27 HTTP/1.1" 200 None
2026-03-27 10:48:58 [auto1.de] INFO: Saving data for YS55163: {'auction_closing_time': 1774715981.0, 'created_time': 1773946868.913418, 'last_price_update_time': 1774608538.815811}
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS55163') HTTP/1.1" 204 0
2026-03-27 10:48:58 [auto1.de] INFO: Found listing with ID: YM28187
2026-03-27 10:48:58 [auto1.de] INFO: Found listing with ID: XU02017
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU02017%27 HTTP/1.1" 200 None
2026-03-27 10:48:58 [auto1.de] INFO: Scrape type for XU02017: 1
2026-03-27 10:48:58 [auto1.de] INFO: Found listing with ID: UD14847
2026-03-27 10:48:58 [auto1.de] INFO: Found listing with ID: PA85998
2026-03-27 10:48:58 [auto1.de] INFO: Found listing with ID: VX06464
2026-03-27 10:48:58 [auto1.de] INFO: Found listing with ID: PV05136
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV05136%27 HTTP/1.1" 200 None
2026-03-27 10:48:58 [auto1.de] INFO: Scrape type for PV05136: 1
2026-03-27 10:48:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:58 [auto1.de] INFO: Found listing with ID: EC48687
2026-03-27 10:48:58 [auto1.de] INFO: Found listing with ID: VC27283
2026-03-27 10:48:58 [auto1.de] INFO: Found listing with ID: KR59987
2026-03-27 10:48:58 [auto1.de] INFO: Found listing with ID: RN45636
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN45636%27 HTTP/1.1" 200 None
2026-03-27 10:48:58 [auto1.de] INFO: Scrape type for RN45636: 1
2026-03-27 10:48:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:58 [auto1.de] INFO: Found listing with ID: BX38798
2026-03-27 10:48:58 [auto1.de] INFO: Found listing with ID: XG58500
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG58500%27 HTTP/1.1" 200 None
2026-03-27 10:48:58 [auto1.de] INFO: Scrape type for XG58500: 2
2026-03-27 10:48:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0af9bfdb-44c0-542c-9938-0fe1aa99ed42 with identifier: XG58500
2026-03-27 10:48:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0af9bfdb-44c0-542c-9938-0fe1aa99ed42 with scrape type 2
2026-03-27 10:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0af9bfdb-44c0-542c-9938-0fe1aa99ed42 with scrape type 2
2026-03-27 10:48:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0af9bfdb-44c0-542c-9938-0fe1aa99ed42, identifier: XG58500
2026-03-27 10:48:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0af9bfdb-44c0-542c-9938-0fe1aa99ed42 with identifier: XG58500
2026-03-27 10:48:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0af9bfdb-44c0-542c-9938-0fe1aa99ed42 with identifier: XG58500
2026-03-27 10:48:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0af9bfdb-44c0-542c-9938-0fe1aa99ed42 with identifier: XG58500 to the API
2026-03-27 10:48:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:37:50Z',
 'fuel_type': 'petrol',
 'id': '0af9bfdb-44c0-542c-9938-0fe1aa99ed42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG58500',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 128302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-22',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Celebration',
 'transmission': 'manual',
 'trim': 'Celebration',
 'year': 2016}
2026-03-27 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG58500%27 HTTP/1.1" 200 None
2026-03-27 10:48:59 [auto1.de] INFO: Saving data for XG58500: {'auction_closing_time': 1774715870.0, 'created_time': 1773137723.070419, 'last_price_update_time': 1774608539.333253}
2026-03-27 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG58500') HTTP/1.1" 204 0
2026-03-27 10:48:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:59 [auto1.de] INFO: Found listing with ID: AE20511
2026-03-27 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE20511%27 HTTP/1.1" 200 None
2026-03-27 10:48:59 [auto1.de] INFO: Scrape type for AE20511: 1
2026-03-27 10:48:59 [auto1.de] INFO: Found listing with ID: RT05682
2026-03-27 10:48:59 [auto1.de] INFO: Found listing with ID: EM07898
2026-03-27 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM07898%27 HTTP/1.1" 200 None
2026-03-27 10:48:59 [auto1.de] INFO: Scrape type for EM07898: 2
2026-03-27 10:48:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 450f596c-fd6c-5a87-9dd4-97fd03dd6f06 with identifier: EM07898
2026-03-27 10:48:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 450f596c-fd6c-5a87-9dd4-97fd03dd6f06 with scrape type 2
2026-03-27 10:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 450f596c-fd6c-5a87-9dd4-97fd03dd6f06 with scrape type 2
2026-03-27 10:48:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 450f596c-fd6c-5a87-9dd4-97fd03dd6f06, identifier: EM07898
2026-03-27 10:48:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 450f596c-fd6c-5a87-9dd4-97fd03dd6f06 with identifier: EM07898
2026-03-27 10:48:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 450f596c-fd6c-5a87-9dd4-97fd03dd6f06 with identifier: EM07898
2026-03-27 10:48:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 450f596c-fd6c-5a87-9dd4-97fd03dd6f06 with identifier: EM07898 to the API
2026-03-27 10:48:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:48:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:48:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:43:26Z',
 'fuel_type': 'diesel',
 'id': '450f596c-fd6c-5a87-9dd4-97fd03dd6f06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM07898',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 217595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-13',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-27 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM07898%27 HTTP/1.1" 200 None
2026-03-27 10:48:59 [auto1.de] INFO: Saving data for EM07898: {'auction_closing_time': 1774716206.0, 'created_time': 1773343257.987719, 'last_price_update_time': 1774608539.902488}
2026-03-27 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM07898') HTTP/1.1" 204 0
2026-03-27 10:48:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:48:59 [auto1.de] INFO: Found listing with ID: ZK76499
2026-03-27 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK76499%27 HTTP/1.1" 200 None
2026-03-27 10:48:59 [auto1.de] INFO: Scrape type for ZK76499: 1
2026-03-27 10:48:59 [auto1.de] INFO: Found listing with ID: NB76223
2026-03-27 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB76223%27 HTTP/1.1" 200 None
2026-03-27 10:48:59 [auto1.de] INFO: Scrape type for NB76223: 2
2026-03-27 10:48:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4965aa78-b986-54e4-9159-09473ccee85c with identifier: NB76223
2026-03-27 10:48:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4965aa78-b986-54e4-9159-09473ccee85c with scrape type 2
2026-03-27 10:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4965aa78-b986-54e4-9159-09473ccee85c with scrape type 2
2026-03-27 10:49:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4965aa78-b986-54e4-9159-09473ccee85c, identifier: NB76223
2026-03-27 10:49:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4965aa78-b986-54e4-9159-09473ccee85c with identifier: NB76223
2026-03-27 10:49:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4965aa78-b986-54e4-9159-09473ccee85c with identifier: NB76223
2026-03-27 10:49:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4965aa78-b986-54e4-9159-09473ccee85c with identifier: NB76223 to the API
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:58:28Z',
 'fuel_type': 'diesel',
 'id': '4965aa78-b986-54e4-9159-09473ccee85c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB76223',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Amarok',
 'odometer': 260843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-01',
 'seller_name': None,
 'title': 'Volkswagen Amarok 3.0 V6 TDI Aventura DoubleCab 4Motion',
 'transmission': 'automatic',
 'trim': 'Aventura DoubleCab 4Motion',
 'year': 2020}
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB76223%27 HTTP/1.1" 200 None
2026-03-27 10:49:00 [auto1.de] INFO: Saving data for NB76223: {'auction_closing_time': 1774717108.0, 'created_time': 1773946906.485409, 'last_price_update_time': 1774608540.409047}
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB76223') HTTP/1.1" 204 0
2026-03-27 10:49:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: VD78060
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD78060%27 HTTP/1.1" 200 None
2026-03-27 10:49:00 [auto1.de] INFO: Scrape type for VD78060: 1
2026-03-27 10:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: AH76263
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH76263%27 HTTP/1.1" 200 None
2026-03-27 10:49:00 [auto1.de] INFO: Scrape type for AH76263: 1
2026-03-27 10:49:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: JZ27200
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ27200%27 HTTP/1.1" 200 None
2026-03-27 10:49:00 [auto1.de] INFO: Scrape type for JZ27200: 1
2026-03-27 10:49:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: EN46705
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: ZS04919
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: RM03411
2026-03-27 10:49:00 [auto1.de] INFO: Found listing with ID: WG01413
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG01413%27 HTTP/1.1" 200 None
2026-03-27 10:49:00 [auto1.de] INFO: Scrape type for WG01413: 2
2026-03-27 10:49:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96608814-f411-529b-a1a4-098b0d966baf with identifier: WG01413
2026-03-27 10:49:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96608814-f411-529b-a1a4-098b0d966baf with scrape type 2
2026-03-27 10:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96608814-f411-529b-a1a4-098b0d966baf with scrape type 2
2026-03-27 10:49:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96608814-f411-529b-a1a4-098b0d966baf, identifier: WG01413
2026-03-27 10:49:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96608814-f411-529b-a1a4-098b0d966baf with identifier: WG01413
2026-03-27 10:49:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96608814-f411-529b-a1a4-098b0d966baf with identifier: WG01413
2026-03-27 10:49:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96608814-f411-529b-a1a4-098b0d966baf with identifier: WG01413 to the API
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:26:09Z',
 'fuel_type': 'petrol',
 'id': '96608814-f411-529b-a1a4-098b0d966baf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG01413',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 64125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-12',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2017}
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG01413%27 HTTP/1.1" 200 None
2026-03-27 10:49:01 [auto1.de] INFO: Saving data for WG01413: {'auction_closing_time': 1774715169.0, 'created_time': 1774034538.020237, 'last_price_update_time': 1774608541.073572}
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG01413') HTTP/1.1" 204 0
2026-03-27 10:49:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:01 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-27 10:49:01 [auto1.de] INFO: Found listing with ID: MN31316
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN31316%27 HTTP/1.1" 200 None
2026-03-27 10:49:01 [auto1.de] INFO: Scrape type for MN31316: 1
2026-03-27 10:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN45636/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:01 [auto1.de] INFO: Channel: 24h | Page: 45 | totalHits: 10573 | hits on page: 40
2026-03-27 10:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PV05136/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XU02017/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:01 [auto1.de] INFO: Found listing with ID: WG01413
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG01413%27 HTTP/1.1" 200 None
2026-03-27 10:49:01 [auto1.de] INFO: Scrape type for WG01413: 0
2026-03-27 10:49:01 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-27 10:49:01 [auto1.de] INFO: Found listing with ID: MN31316
2026-03-27 10:49:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:01 [auto1.de] INFO: Found listing with ID: BJ91996
2026-03-27 10:49:01 [auto1.de] INFO: Found listing with ID: MV29238
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV29238%27 HTTP/1.1" 200 None
2026-03-27 10:49:01 [auto1.de] INFO: Scrape type for MV29238: 2
2026-03-27 10:49:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 230e7d0c-7df9-58fe-bfd4-47e164e3c4c8 with identifier: MV29238
2026-03-27 10:49:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 230e7d0c-7df9-58fe-bfd4-47e164e3c4c8 with scrape type 2
2026-03-27 10:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 230e7d0c-7df9-58fe-bfd4-47e164e3c4c8 with scrape type 2
2026-03-27 10:49:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 230e7d0c-7df9-58fe-bfd4-47e164e3c4c8, identifier: MV29238
2026-03-27 10:49:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 230e7d0c-7df9-58fe-bfd4-47e164e3c4c8 with identifier: MV29238
2026-03-27 10:49:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 230e7d0c-7df9-58fe-bfd4-47e164e3c4c8 with identifier: MV29238
2026-03-27 10:49:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 230e7d0c-7df9-58fe-bfd4-47e164e3c4c8 with identifier: MV29238 to the API
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:20:09Z',
 'fuel_type': 'petrol',
 'id': '230e7d0c-7df9-58fe-bfd4-47e164e3c4c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV29238',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 222173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-28',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2015}
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV29238%27 HTTP/1.1" 200 None
2026-03-27 10:49:01 [auto1.de] INFO: Saving data for MV29238: {'auction_closing_time': 1774714809.0, 'created_time': 1774002542.443089, 'last_price_update_time': 1774608541.769947}
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV29238') HTTP/1.1" 204 0
2026-03-27 10:49:01 [auto1.de] INFO: Found listing with ID: AB14083
2026-03-27 10:49:01 [auto1.de] INFO: Found listing with ID: HL71363
2026-03-27 10:49:01 [auto1.de] INFO: Found listing with ID: ZZ67378
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ67378%27 HTTP/1.1" 200 None
2026-03-27 10:49:01 [auto1.de] INFO: Scrape type for ZZ67378: 1
2026-03-27 10:49:01 [auto1.de] INFO: Found listing with ID: GH57189
2026-03-27 10:49:01 [auto1.de] INFO: Found listing with ID: DP29257
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP29257%27 HTTP/1.1" 200 None
2026-03-27 10:49:01 [auto1.de] INFO: Scrape type for DP29257: 1
2026-03-27 10:49:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:01 [auto1.de] INFO: Found listing with ID: NB18835
2026-03-27 10:49:01 [auto1.de] INFO: Found listing with ID: AB91647
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB91647%27 HTTP/1.1" 200 None
2026-03-27 10:49:01 [auto1.de] INFO: Scrape type for AB91647: 2
2026-03-27 10:49:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82514085-ea9c-5a21-a143-2bb590533a6a with identifier: AB91647
2026-03-27 10:49:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82514085-ea9c-5a21-a143-2bb590533a6a with scrape type 2
2026-03-27 10:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82514085-ea9c-5a21-a143-2bb590533a6a with scrape type 2
2026-03-27 10:49:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82514085-ea9c-5a21-a143-2bb590533a6a, identifier: AB91647
2026-03-27 10:49:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82514085-ea9c-5a21-a143-2bb590533a6a with identifier: AB91647
2026-03-27 10:49:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82514085-ea9c-5a21-a143-2bb590533a6a with identifier: AB91647
2026-03-27 10:49:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82514085-ea9c-5a21-a143-2bb590533a6a with identifier: AB91647 to the API
2026-03-27 10:49:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:52:20Z',
 'fuel_type': 'petrol',
 'id': '82514085-ea9c-5a21-a143-2bb590533a6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB91647',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 49148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-23',
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI Style Copa Ecomotive',
 'transmission': 'manual',
 'trim': 'Style Copa Ecomotive',
 'year': 2012}
2026-03-27 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB91647%27 HTTP/1.1" 200 None
2026-03-27 10:49:02 [auto1.de] INFO: Saving data for AB91647: {'auction_closing_time': 1774716740.0, 'created_time': 1773946002.100934, 'last_price_update_time': 1774608542.379733}
2026-03-27 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB91647') HTTP/1.1" 204 0
2026-03-27 10:49:02 [auto1.de] INFO: Found listing with ID: CR29385
2026-03-27 10:49:02 [auto1.de] INFO: Found listing with ID: GD61504
2026-03-27 10:49:02 [auto1.de] INFO: Found listing with ID: LM89812
2026-03-27 10:49:02 [auto1.de] INFO: Found listing with ID: DE97424
2026-03-27 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE97424%27 HTTP/1.1" 200 None
2026-03-27 10:49:02 [auto1.de] INFO: Scrape type for DE97424: 2
2026-03-27 10:49:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3606559e-1b44-59b2-9815-d525fe678338 with identifier: DE97424
2026-03-27 10:49:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3606559e-1b44-59b2-9815-d525fe678338 with scrape type 2
2026-03-27 10:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3606559e-1b44-59b2-9815-d525fe678338 with scrape type 2
2026-03-27 10:49:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3606559e-1b44-59b2-9815-d525fe678338, identifier: DE97424
2026-03-27 10:49:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3606559e-1b44-59b2-9815-d525fe678338 with identifier: DE97424
2026-03-27 10:49:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3606559e-1b44-59b2-9815-d525fe678338 with identifier: DE97424
2026-03-27 10:49:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3606559e-1b44-59b2-9815-d525fe678338 with identifier: DE97424 to the API
2026-03-27 10:49:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:35:08Z',
 'fuel_type': 'diesel',
 'id': '3606559e-1b44-59b2-9815-d525fe678338',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE97424',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 225783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-30',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Life BlueMotion',
 'transmission': 'manual',
 'trim': 'Life BlueMotion',
 'year': 2013}
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE97424%27 HTTP/1.1" 200 None
2026-03-27 10:49:03 [auto1.de] INFO: Saving data for DE97424: {'auction_closing_time': 1774715708.0, 'created_time': 1773137287.788719, 'last_price_update_time': 1774608543.055338}
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE97424') HTTP/1.1" 204 0
2026-03-27 10:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AE20511/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK76499/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: MC56654
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: VU87810
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU87810%27 HTTP/1.1" 200 None
2026-03-27 10:49:03 [auto1.de] INFO: Scrape type for VU87810: 2
2026-03-27 10:49:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2966244-205c-5a48-8407-8c2f6b4a6763 with identifier: VU87810
2026-03-27 10:49:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2966244-205c-5a48-8407-8c2f6b4a6763 with scrape type 2
2026-03-27 10:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2966244-205c-5a48-8407-8c2f6b4a6763 with scrape type 2
2026-03-27 10:49:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2966244-205c-5a48-8407-8c2f6b4a6763, identifier: VU87810
2026-03-27 10:49:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2966244-205c-5a48-8407-8c2f6b4a6763 with identifier: VU87810
2026-03-27 10:49:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2966244-205c-5a48-8407-8c2f6b4a6763 with identifier: VU87810
2026-03-27 10:49:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2966244-205c-5a48-8407-8c2f6b4a6763 with identifier: VU87810 to the API
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:58:48Z',
 'fuel_type': 'diesel',
 'id': 'd2966244-205c-5a48-8407-8c2f6b4a6763',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU87810',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 188480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-18',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TDI quattro Plus',
 'transmission': 'automatic',
 'trim': 'quattro Plus',
 'year': 2016}
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU87810%27 HTTP/1.1" 200 None
2026-03-27 10:49:03 [auto1.de] INFO: Saving data for VU87810: {'auction_closing_time': 1774717128.0, 'created_time': 1773307341.11041, 'last_price_update_time': 1774608543.53795}
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU87810') HTTP/1.1" 204 0
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: ZE75344
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: TN35459
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN35459%27 HTTP/1.1" 200 None
2026-03-27 10:49:03 [auto1.de] INFO: Scrape type for TN35459: 1
2026-03-27 10:49:03 [auto1.de] INFO: Found listing with ID: YT23493
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT23493%27 HTTP/1.1" 200 None
2026-03-27 10:49:03 [auto1.de] INFO: Scrape type for YT23493: 2
2026-03-27 10:49:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 261ba68c-bdfc-5869-8653-b5da35019a0f with identifier: YT23493
2026-03-27 10:49:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 261ba68c-bdfc-5869-8653-b5da35019a0f with scrape type 2
2026-03-27 10:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 261ba68c-bdfc-5869-8653-b5da35019a0f with scrape type 2
2026-03-27 10:49:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 261ba68c-bdfc-5869-8653-b5da35019a0f, identifier: YT23493
2026-03-27 10:49:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 261ba68c-bdfc-5869-8653-b5da35019a0f with identifier: YT23493
2026-03-27 10:49:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 261ba68c-bdfc-5869-8653-b5da35019a0f with identifier: YT23493
2026-03-27 10:49:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 261ba68c-bdfc-5869-8653-b5da35019a0f with identifier: YT23493 to the API
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:42:32Z',
 'fuel_type': 'diesel',
 'id': '261ba68c-bdfc-5869-8653-b5da35019a0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT23493',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 257620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-31',
 'seller_name': None,
 'title': 'BMW 1er 123d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT23493%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Saving data for YT23493: {'auction_closing_time': 1774716152.0, 'created_time': 1773228656.593994, 'last_price_update_time': 1774608544.012374}
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT23493') HTTP/1.1" 204 0
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: JR97371
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: SG45396
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG45396%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for SG45396: 1
2026-03-27 10:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: XJ62576
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: MV46979
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46979%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for MV46979: 1
2026-03-27 10:49:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VD78060/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN31316/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: ZV10923
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV10923%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for ZV10923: 1
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: XX83628
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: ZY72717
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY72717%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for ZY72717: 1
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: CY44920
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY44920%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for CY44920: 1
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: DM13382
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: DV32986
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV32986%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for DV32986: 1
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: CC90437
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: SM08668
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: ND31150
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: CB12842
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB12842%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for CB12842: 1
2026-03-27 10:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ27200/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:04 [auto1.de] INFO: Channel: 24h | Page: 46 | totalHits: 10573 | hits on page: 40
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: YB40017
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: UZ74086
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ74086%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for UZ74086: 1
2026-03-27 10:49:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: ML66978
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML66978%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for ML66978: 1
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: UT27249
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT27249%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for UT27249: 1
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: CJ75930
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ75930%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for CJ75930: 1
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: YB62347
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: UY13477
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: XW49468
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW49468%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for XW49468: 1
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: SR08314
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: PC62397
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC62397%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for PC62397: 2
2026-03-27 10:49:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2dc4ca7-d578-5e38-9e27-d40533f5c795 with identifier: PC62397
2026-03-27 10:49:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2dc4ca7-d578-5e38-9e27-d40533f5c795 with scrape type 2
2026-03-27 10:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2dc4ca7-d578-5e38-9e27-d40533f5c795 with scrape type 2
2026-03-27 10:49:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2dc4ca7-d578-5e38-9e27-d40533f5c795, identifier: PC62397
2026-03-27 10:49:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2dc4ca7-d578-5e38-9e27-d40533f5c795 with identifier: PC62397
2026-03-27 10:49:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2dc4ca7-d578-5e38-9e27-d40533f5c795 with identifier: PC62397
2026-03-27 10:49:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2dc4ca7-d578-5e38-9e27-d40533f5c795 with identifier: PC62397 to the API
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:12:15Z',
 'fuel_type': 'petrol',
 'id': 'f2dc4ca7-d578-5e38-9e27-d40533f5c795',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC62397',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 119149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-03',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC62397%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Saving data for PC62397: {'auction_closing_time': 1774714335.0, 'created_time': 1774381067.864226, 'last_price_update_time': 1774608544.754055}
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC62397') HTTP/1.1" 204 0
2026-03-27 10:49:04 [auto1.de] INFO: Found listing with ID: MX32750
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX32750%27 HTTP/1.1" 200 None
2026-03-27 10:49:04 [auto1.de] INFO: Scrape type for MX32750: 2
2026-03-27 10:49:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28d0485f-6f00-5e44-befc-b2c3cfd474d7 with identifier: MX32750
2026-03-27 10:49:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28d0485f-6f00-5e44-befc-b2c3cfd474d7 with scrape type 2
2026-03-27 10:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28d0485f-6f00-5e44-befc-b2c3cfd474d7 with scrape type 2
2026-03-27 10:49:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28d0485f-6f00-5e44-befc-b2c3cfd474d7, identifier: MX32750
2026-03-27 10:49:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28d0485f-6f00-5e44-befc-b2c3cfd474d7 with identifier: MX32750
2026-03-27 10:49:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28d0485f-6f00-5e44-befc-b2c3cfd474d7 with identifier: MX32750
2026-03-27 10:49:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28d0485f-6f00-5e44-befc-b2c3cfd474d7 with identifier: MX32750 to the API
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:14:09Z',
 'fuel_type': 'diesel',
 'id': '28d0485f-6f00-5e44-befc-b2c3cfd474d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX32750',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 248448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-24',
 'seller_name': None,
 'title': 'Audi A7 Sportback 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX32750%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Saving data for MX32750: {'auction_closing_time': 1774714449.0, 'created_time': 1774291761.918241, 'last_price_update_time': 1774608545.307107}
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX32750') HTTP/1.1" 204 0
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: JS15071
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: RA07752
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA07752%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for RA07752: 1
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: CD13649
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: WF06816
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF06816%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for WF06816: 1
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: HR10791
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: GS36326
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: XV66825
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV66825%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for XV66825: 2
2026-03-27 10:49:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57d6148c-6d35-533b-9614-6b7c45ebfac6 with identifier: XV66825
2026-03-27 10:49:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57d6148c-6d35-533b-9614-6b7c45ebfac6 with scrape type 2
2026-03-27 10:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57d6148c-6d35-533b-9614-6b7c45ebfac6 with scrape type 2
2026-03-27 10:49:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57d6148c-6d35-533b-9614-6b7c45ebfac6, identifier: XV66825
2026-03-27 10:49:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57d6148c-6d35-533b-9614-6b7c45ebfac6 with identifier: XV66825
2026-03-27 10:49:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57d6148c-6d35-533b-9614-6b7c45ebfac6 with identifier: XV66825
2026-03-27 10:49:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57d6148c-6d35-533b-9614-6b7c45ebfac6 with identifier: XV66825 to the API
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:24:50Z',
 'fuel_type': 'diesel',
 'id': '57d6148c-6d35-533b-9614-6b7c45ebfac6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV66825',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 253179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-10',
 'seller_name': None,
 'title': 'BMW 5er 535d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2015}
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV66825%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Saving data for XV66825: {'auction_closing_time': 1774715090.0, 'created_time': 1774380511.660144, 'last_price_update_time': 1774608545.772272}
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV66825') HTTP/1.1" 204 0
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: FR75488
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: MD11027
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: VT63702
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: JW24568
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW24568%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for JW24568: 1
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: SU14933
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: LG62730
2026-03-27 10:49:05 [auto1.de] INFO: Found listing with ID: RT88012
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT88012%27 HTTP/1.1" 200 None
2026-03-27 10:49:05 [auto1.de] INFO: Scrape type for RT88012: 2
2026-03-27 10:49:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4b82cf3-9568-570f-b60b-d688c75f5a53 with identifier: RT88012
2026-03-27 10:49:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4b82cf3-9568-570f-b60b-d688c75f5a53 with scrape type 2
2026-03-27 10:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4b82cf3-9568-570f-b60b-d688c75f5a53 with scrape type 2
2026-03-27 10:49:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4b82cf3-9568-570f-b60b-d688c75f5a53, identifier: RT88012
2026-03-27 10:49:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4b82cf3-9568-570f-b60b-d688c75f5a53 with identifier: RT88012
2026-03-27 10:49:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4b82cf3-9568-570f-b60b-d688c75f5a53 with identifier: RT88012
2026-03-27 10:49:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4b82cf3-9568-570f-b60b-d688c75f5a53 with identifier: RT88012 to the API
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:59:14Z',
 'fuel_type': 'diesel',
 'id': 'f4b82cf3-9568-570f-b60b-d688c75f5a53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT88012',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 363475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-16',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT88012%27 HTTP/1.1" 200 None
2026-03-27 10:49:06 [auto1.de] INFO: Saving data for RT88012: {'auction_closing_time': 1774717154.0, 'created_time': 1774381184.789998, 'last_price_update_time': 1774608546.215475}
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT88012') HTTP/1.1" 204 0
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: JH21308
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: EU73133
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU73133%27 HTTP/1.1" 200 None
2026-03-27 10:49:06 [auto1.de] INFO: Scrape type for EU73133: 2
2026-03-27 10:49:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4cfc360-18ec-5681-b5f7-3fc32aeeea95 with identifier: EU73133
2026-03-27 10:49:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4cfc360-18ec-5681-b5f7-3fc32aeeea95 with scrape type 2
2026-03-27 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4cfc360-18ec-5681-b5f7-3fc32aeeea95 with scrape type 2
2026-03-27 10:49:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4cfc360-18ec-5681-b5f7-3fc32aeeea95, identifier: EU73133
2026-03-27 10:49:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4cfc360-18ec-5681-b5f7-3fc32aeeea95 with identifier: EU73133
2026-03-27 10:49:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4cfc360-18ec-5681-b5f7-3fc32aeeea95 with identifier: EU73133
2026-03-27 10:49:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4cfc360-18ec-5681-b5f7-3fc32aeeea95 with identifier: EU73133 to the API
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:24:01Z',
 'fuel_type': 'diesel',
 'id': 'd4cfc360-18ec-5681-b5f7-3fc32aeeea95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU73133',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 364229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-11',
 'seller_name': None,
 'title': 'Volkswagen Beetle 2.0 TDI Design BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Design BlueMotion Tech',
 'year': 2016}
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU73133%27 HTTP/1.1" 200 None
2026-03-27 10:49:06 [auto1.de] INFO: Saving data for EU73133: {'auction_closing_time': 1774715041.0, 'created_time': 1774349873.51942, 'last_price_update_time': 1774608546.802268}
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU73133') HTTP/1.1" 204 0
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: HB31061
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: AN15165
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN15165%27 HTTP/1.1" 200 None
2026-03-27 10:49:06 [auto1.de] INFO: Scrape type for AN15165: 1
2026-03-27 10:49:06 [scrapy.extensions.logstats] INFO: Crawled 428 pages (at 22 pages/min), scraped 800 items (at 60 items/min)
2026-03-27 10:49:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 10:49:06 [auto1.de] INFO: Found listing with ID: YK99785
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK99785%27 HTTP/1.1" 200 None
2026-03-27 10:49:06 [auto1.de] INFO: Scrape type for YK99785: 2
2026-03-27 10:49:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75fcfc91-0954-57fe-9278-05d171145ec5 with identifier: YK99785
2026-03-27 10:49:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75fcfc91-0954-57fe-9278-05d171145ec5 with scrape type 2
2026-03-27 10:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75fcfc91-0954-57fe-9278-05d171145ec5 with scrape type 2
2026-03-27 10:49:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75fcfc91-0954-57fe-9278-05d171145ec5, identifier: YK99785
2026-03-27 10:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ67378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75fcfc91-0954-57fe-9278-05d171145ec5 with identifier: YK99785
2026-03-27 10:49:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75fcfc91-0954-57fe-9278-05d171145ec5 with identifier: YK99785
2026-03-27 10:49:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75fcfc91-0954-57fe-9278-05d171145ec5 with identifier: YK99785 to the API
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:29:36Z',
 'fuel_type': 'petrol',
 'id': '75fcfc91-0954-57fe-9278-05d171145ec5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK99785',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 56197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-02',
 'seller_name': None,
 'title': 'Skoda Yeti 1.2 TSI Joy',
 'transmission': 'manual',
 'trim': 'Joy',
 'year': 2016}
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK99785%27 HTTP/1.1" 200 None
2026-03-27 10:49:07 [auto1.de] INFO: Saving data for YK99785: {'auction_closing_time': 1774715376.0, 'created_time': 1773308107.320436, 'last_price_update_time': 1774608547.274236}
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK99785') HTTP/1.1" 204 0
2026-03-27 10:49:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: AB88110
2026-03-27 10:49:07 [auto1.de] INFO: Found listing with ID: EG76856
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG76856%27 HTTP/1.1" 200 None
2026-03-27 10:49:07 [auto1.de] INFO: Scrape type for EG76856: 2
2026-03-27 10:49:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ed4170d-8620-5afc-8278-3fe9f4bc1f06 with identifier: EG76856
2026-03-27 10:49:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed4170d-8620-5afc-8278-3fe9f4bc1f06 with scrape type 2
2026-03-27 10:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ed4170d-8620-5afc-8278-3fe9f4bc1f06 with scrape type 2
2026-03-27 10:49:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ed4170d-8620-5afc-8278-3fe9f4bc1f06, identifier: EG76856
2026-03-27 10:49:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ed4170d-8620-5afc-8278-3fe9f4bc1f06 with identifier: EG76856
2026-03-27 10:49:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ed4170d-8620-5afc-8278-3fe9f4bc1f06 with identifier: EG76856
2026-03-27 10:49:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ed4170d-8620-5afc-8278-3fe9f4bc1f06 with identifier: EG76856 to the API
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:39:05Z',
 'fuel_type': 'petrol',
 'id': '8ed4170d-8620-5afc-8278-3fe9f4bc1f06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG76856',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 114975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-13',
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TSI FR 4Drive',
 'transmission': 'automatic',
 'trim': 'FR 4Drive',
 'year': 2017}
2026-03-27 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG76856%27 HTTP/1.1" 200 None
2026-03-27 10:49:08 [auto1.de] INFO: Saving data for EG76856: {'auction_closing_time': 1774715945.0, 'created_time': 1773381186.949201, 'last_price_update_time': 1774608548.076831}
2026-03-27 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG76856') HTTP/1.1" 204 0
2026-03-27 10:49:08 [auto1.de] INFO: Found listing with ID: FU68975
2026-03-27 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU68975%27 HTTP/1.1" 200 None
2026-03-27 10:49:08 [auto1.de] INFO: Scrape type for FU68975: 2
2026-03-27 10:49:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1 with identifier: FU68975
2026-03-27 10:49:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1 with scrape type 2
2026-03-27 10:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1 with scrape type 2
2026-03-27 10:49:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1, identifier: FU68975
2026-03-27 10:49:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1 with identifier: FU68975
2026-03-27 10:49:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1 with identifier: FU68975
2026-03-27 10:49:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1 with identifier: FU68975 to the API
2026-03-27 10:49:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:13:49Z',
 'fuel_type': 'diesel',
 'id': 'cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU68975',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 243868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-14',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-27 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU68975%27 HTTP/1.1" 200 None
2026-03-27 10:49:08 [auto1.de] INFO: Saving data for FU68975: {'auction_closing_time': 1774714429.0, 'created_time': 1773946014.772895, 'last_price_update_time': 1774608548.568738}
2026-03-27 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FU68975') HTTP/1.1" 204 0
2026-03-27 10:49:08 [auto1.de] INFO: Found listing with ID: GP68218
2026-03-27 10:49:08 [auto1.de] INFO: Found listing with ID: WZ51755
2026-03-27 10:49:08 [auto1.de] INFO: Found listing with ID: VN54723
2026-03-27 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN54723%27 HTTP/1.1" 200 None
2026-03-27 10:49:08 [auto1.de] INFO: Scrape type for VN54723: 2
2026-03-27 10:49:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 476b3956-3a5e-5b10-945d-c0e3d5343e6b with identifier: VN54723
2026-03-27 10:49:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 476b3956-3a5e-5b10-945d-c0e3d5343e6b with scrape type 2
2026-03-27 10:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 476b3956-3a5e-5b10-945d-c0e3d5343e6b with scrape type 2
2026-03-27 10:49:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 476b3956-3a5e-5b10-945d-c0e3d5343e6b, identifier: VN54723
2026-03-27 10:49:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 476b3956-3a5e-5b10-945d-c0e3d5343e6b with identifier: VN54723
2026-03-27 10:49:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 476b3956-3a5e-5b10-945d-c0e3d5343e6b with identifier: VN54723
2026-03-27 10:49:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 476b3956-3a5e-5b10-945d-c0e3d5343e6b with identifier: VN54723 to the API
2026-03-27 10:49:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:35:34Z',
 'fuel_type': 'diesel',
 'id': '476b3956-3a5e-5b10-945d-c0e3d5343e6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN54723',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 60946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-05',
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 HDi L2 Multispace Selection',
 'transmission': 'automatic',
 'trim': 'L2 Multispace Selection',
 'year': 2015}
2026-03-27 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN54723%27 HTTP/1.1" 200 None
2026-03-27 10:49:09 [auto1.de] INFO: Saving data for VN54723: {'auction_closing_time': 1774715734.0, 'created_time': 1773304582.772322, 'last_price_update_time': 1774608549.058273}
2026-03-27 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN54723') HTTP/1.1" 204 0
2026-03-27 10:49:09 [auto1.de] INFO: Found listing with ID: AE42693
2026-03-27 10:49:09 [auto1.de] INFO: Found listing with ID: DK89074
2026-03-27 10:49:09 [auto1.de] INFO: Found listing with ID: RC64301
2026-03-27 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64301%27 HTTP/1.1" 200 None
2026-03-27 10:49:09 [auto1.de] INFO: Scrape type for RC64301: 2
2026-03-27 10:49:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41 with identifier: RC64301
2026-03-27 10:49:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41 with scrape type 2
2026-03-27 10:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41 with scrape type 2
2026-03-27 10:49:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41, identifier: RC64301
2026-03-27 10:49:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41 with identifier: RC64301
2026-03-27 10:49:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41 with identifier: RC64301
2026-03-27 10:49:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41 with identifier: RC64301 to the API
2026-03-27 10:49:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-28T16:10:53Z',
 'fuel_type': 'diesel',
 'id': '1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC64301',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 161156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-10',
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-27 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64301%27 HTTP/1.1" 200 None
2026-03-27 10:49:09 [auto1.de] INFO: Saving data for RC64301: {'auction_closing_time': 1774714253.0, 'created_time': 1773831286.755957, 'last_price_update_time': 1774608549.591834}
2026-03-27 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC64301') HTTP/1.1" 204 0
2026-03-27 10:49:09 [auto1.de] INFO: Found listing with ID: TB14981
2026-03-27 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB14981%27 HTTP/1.1" 200 None
2026-03-27 10:49:09 [auto1.de] INFO: Scrape type for TB14981: 1
2026-03-27 10:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AH76263/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:09 [auto1.de] INFO: Found listing with ID: RJ96114
2026-03-27 10:49:09 [auto1.de] INFO: Found listing with ID: PA20304
2026-03-27 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA20304%27 HTTP/1.1" 200 None
2026-03-27 10:49:09 [auto1.de] INFO: Scrape type for PA20304: 2
2026-03-27 10:49:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17c774f4-b417-59c9-80e4-a49e0620b47c with identifier: PA20304
2026-03-27 10:49:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17c774f4-b417-59c9-80e4-a49e0620b47c with scrape type 2
2026-03-27 10:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17c774f4-b417-59c9-80e4-a49e0620b47c with scrape type 2
2026-03-27 10:49:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17c774f4-b417-59c9-80e4-a49e0620b47c, identifier: PA20304
2026-03-27 10:49:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17c774f4-b417-59c9-80e4-a49e0620b47c with identifier: PA20304
2026-03-27 10:49:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17c774f4-b417-59c9-80e4-a49e0620b47c with identifier: PA20304
2026-03-27 10:49:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17c774f4-b417-59c9-80e4-a49e0620b47c with identifier: PA20304 to the API
2026-03-27 10:49:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:32:30Z',
 'fuel_type': 'diesel',
 'id': '17c774f4-b417-59c9-80e4-a49e0620b47c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA20304',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 91106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-29',
 'seller_name': None,
 'title': 'Hyundai ix35 1.7 CRDi FIFA World Cup Edition 2WD',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition 2WD',
 'year': 2014}
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA20304%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [auto1.de] INFO: Saving data for PA20304: {'auction_closing_time': 1774715550.0, 'created_time': 1774350283.299845, 'last_price_update_time': 1774608550.080521}
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA20304') HTTP/1.1" 204 0
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: EE00996
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE00996%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [auto1.de] INFO: Scrape type for EE00996: 2
2026-03-27 10:49:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29a91ab9-2670-5ef0-baa3-cfd18d76a1dc with identifier: EE00996
2026-03-27 10:49:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a91ab9-2670-5ef0-baa3-cfd18d76a1dc with scrape type 2
2026-03-27 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29a91ab9-2670-5ef0-baa3-cfd18d76a1dc with scrape type 2
2026-03-27 10:49:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29a91ab9-2670-5ef0-baa3-cfd18d76a1dc, identifier: EE00996
2026-03-27 10:49:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29a91ab9-2670-5ef0-baa3-cfd18d76a1dc with identifier: EE00996
2026-03-27 10:49:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29a91ab9-2670-5ef0-baa3-cfd18d76a1dc with identifier: EE00996
2026-03-27 10:49:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29a91ab9-2670-5ef0-baa3-cfd18d76a1dc with identifier: EE00996 to the API
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:53:42Z',
 'fuel_type': 'diesel',
 'id': '29a91ab9-2670-5ef0-baa3-cfd18d76a1dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE00996',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XE',
 'odometer': 156194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-21',
 'seller_name': None,
 'title': 'Jaguar XE 20d Prestige',
 'transmission': 'automatic',
 'trim': 'Prestige',
 'year': 2015}
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE00996%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [auto1.de] INFO: Saving data for EE00996: {'auction_closing_time': 1774716822.0, 'created_time': 1773225737.530438, 'last_price_update_time': 1774608550.535845}
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE00996') HTTP/1.1" 204 0
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: NP68778
2026-03-27 10:49:10 [auto1.de] INFO: Found listing with ID: VJ29661
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ29661%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [auto1.de] INFO: Scrape type for VJ29661: 1
2026-03-27 10:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TN35459/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN45636> (referer: https://www.auto1.com/v1/car-details-view/RN45636/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AE20511> (referer: https://www.auto1.com/v1/car-details-view/AE20511/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9324c65-06d3-597a-9b7f-5a45f7503fbd with identifier: RN45636
2026-03-27 10:49:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9324c65-06d3-597a-9b7f-5a45f7503fbd with scrape type 1
2026-03-27 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b9324c65-06d3-597a-9b7f-5a45f7503fbd
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb12933384c20cd14a8653ed80673f0d%252Fpa%252FRN45636_c5dec4efe9a32a6aae78b617d6273ab2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_c5dec4efe9a32a6aae78b617d6273ab2.jpg not downloaded yet
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb12933384c20cd14a8653ed80673f0d%252Fpa%252FRN45636_ccac13e729e8c677e674cd66a09854f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_ccac13e729e8c677e674cd66a09854f5.jpg not downloaded yet
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb12933384c20cd14a8653ed80673f0d%252Fpa%252FRN45636_b9e7e7183f5ae5149fd2b0a6759317b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_b9e7e7183f5ae5149fd2b0a6759317b6.jpg not downloaded yet
2026-03-27 10:49:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 434b8019-9dbb-5bd8-bdee-ea8338802c1f with identifier: AE20511
2026-03-27 10:49:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 434b8019-9dbb-5bd8-bdee-ea8338802c1f with scrape type 1
2026-03-27 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 434b8019-9dbb-5bd8-bdee-ea8338802c1f
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fb5%252Fd4b569e5e7c4e4d6cc66d5522ef296da%252Fpa%252FAE20511_e5aa4fc82bb4e9e67fbe0e8a9e92bca9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_e5aa4fc82bb4e9e67fbe0e8a9e92bca9.jpg already downloaded
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fb5%252Fd4b569e5e7c4e4d6cc66d5522ef296da%252Fpa%252FAE20511_fa17c5748d93fed800173709e9168f8f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_fa17c5748d93fed800173709e9168f8f.jpg already downloaded
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fb5%252Fd4b569e5e7c4e4d6cc66d5522ef296da%252Fpa%252FAE20511_f33f31ad151aa8014832819afed0130f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_f33f31ad151aa8014832819afed0130f.jpg already downloaded
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fb5%252Fd4b569e5e7c4e4d6cc66d5522ef296da%252Fpa%252FAE20511_9f4b92ce1df77494d23be6fe16a0edb2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_9f4b92ce1df77494d23be6fe16a0edb2.jpg already downloaded
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fb5%252Fd4b569e5e7c4e4d6cc66d5522ef296da%252Fpa%252FAE20511_796e9e51695f1e5e6e0d13f1ccdc7b0f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_796e9e51695f1e5e6e0d13f1ccdc7b0f.jpg already downloaded
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fb5%252Fd4b569e5e7c4e4d6cc66d5522ef296da%252Fpa%252FAE20511_9402a7a65cf6e23407119650affd6ff8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_9402a7a65cf6e23407119650affd6ff8.jpg already downloaded
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fb5%252Fd4b569e5e7c4e4d6cc66d5522ef296da%252Fpa%252FAE20511_f1275020a3164ab063a6de716014d996.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_f1275020a3164ab063a6de716014d996.jpg already downloaded
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fb5%252Fd4b569e5e7c4e4d6cc66d5522ef296da%252Fpa%252FAE20511_1b4dd0407866ba068969856a98292dc8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_1b4dd0407866ba068969856a98292dc8.jpg already downloaded
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fb5%252Fd4b569e5e7c4e4d6cc66d5522ef296da%252Fpa%252FAE20511_633eba7bb65c0be45470e9f3a6fd4cc2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_633eba7bb65c0be45470e9f3a6fd4cc2.jpg already downloaded
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fb5%252Fd4b569e5e7c4e4d6cc66d5522ef296da%252Fpa%252FAE20511_8e0c1d616b87551c61dc2c8f406d290b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_8e0c1d616b87551c61dc2c8f406d290b.jpg already downloaded
2026-03-27 10:49:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 434b8019-9dbb-5bd8-bdee-ea8338802c1f, identifier: AE20511
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb12933384c20cd14a8653ed80673f0d%252Fpa%252FRN45636_3ab04271f4d221fdcfee142d40cd200d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_3ab04271f4d221fdcfee142d40cd200d.jpg not downloaded yet
2026-03-27 10:49:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 434b8019-9dbb-5bd8-bdee-ea8338802c1f with identifier: AE20511
2026-03-27 10:49:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 434b8019-9dbb-5bd8-bdee-ea8338802c1f with identifier: AE20511
2026-03-27 10:49:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 434b8019-9dbb-5bd8-bdee-ea8338802c1f with identifier: AE20511 to the API
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AE20511>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:53:50Z',
 'fuel_type': 'petrol',
 'id': '434b8019-9dbb-5bd8-bdee-ea8338802c1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE20511',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 79526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_e5aa4fc82bb4e9e67fbe0e8a9e92bca9.jpg',
                'https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_fa17c5748d93fed800173709e9168f8f.jpg',
                'https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_f33f31ad151aa8014832819afed0130f.jpg',
                'https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_9f4b92ce1df77494d23be6fe16a0edb2.jpg',
                'https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_796e9e51695f1e5e6e0d13f1ccdc7b0f.jpg',
                'https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_9402a7a65cf6e23407119650affd6ff8.jpg',
                'https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_f1275020a3164ab063a6de716014d996.jpg',
                'https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_1b4dd0407866ba068969856a98292dc8.jpg',
                'https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_633eba7bb65c0be45470e9f3a6fd4cc2.jpg',
                'https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_8e0c1d616b87551c61dc2c8f406d290b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_434b8019-9dbb-5bd8-bdee-ea8338802c1f/434b8019-9dbb-5bd8-bdee-ea8338802c1f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_e5aa4fc82bb4e9e67fbe0e8a9e92bca9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_434b8019-9dbb-5bd8-bdee-ea8338802c1f/434b8019-9dbb-5bd8-bdee-ea8338802c1f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_fa17c5748d93fed800173709e9168f8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_434b8019-9dbb-5bd8-bdee-ea8338802c1f/434b8019-9dbb-5bd8-bdee-ea8338802c1f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_f33f31ad151aa8014832819afed0130f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_434b8019-9dbb-5bd8-bdee-ea8338802c1f/434b8019-9dbb-5bd8-bdee-ea8338802c1f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3245326,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_9f4b92ce1df77494d23be6fe16a0edb2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_434b8019-9dbb-5bd8-bdee-ea8338802c1f/434b8019-9dbb-5bd8-bdee-ea8338802c1f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3022365,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_796e9e51695f1e5e6e0d13f1ccdc7b0f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_434b8019-9dbb-5bd8-bdee-ea8338802c1f/434b8019-9dbb-5bd8-bdee-ea8338802c1f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3064864,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_9402a7a65cf6e23407119650affd6ff8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_434b8019-9dbb-5bd8-bdee-ea8338802c1f/434b8019-9dbb-5bd8-bdee-ea8338802c1f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_f1275020a3164ab063a6de716014d996.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_434b8019-9dbb-5bd8-bdee-ea8338802c1f/434b8019-9dbb-5bd8-bdee-ea8338802c1f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3126927,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_1b4dd0407866ba068969856a98292dc8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_434b8019-9dbb-5bd8-bdee-ea8338802c1f/434b8019-9dbb-5bd8-bdee-ea8338802c1f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_633eba7bb65c0be45470e9f3a6fd4cc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_434b8019-9dbb-5bd8-bdee-ea8338802c1f/434b8019-9dbb-5bd8-bdee-ea8338802c1f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/b5/d4b569e5e7c4e4d6cc66d5522ef296da/pa/AE20511_8e0c1d616b87551c61dc2c8f406d290b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2018}
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE20511%27 HTTP/1.1" 200 None
2026-03-27 10:49:11 [auto1.de] INFO: Saving data for AE20511: {'created_time': 1774608551.404671, 'last_price_update_time': 1774608551.404684, 'auction_closing_time': 1774716830.0}
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE20511') HTTP/1.1" 204 0
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb12933384c20cd14a8653ed80673f0d%252Fpa%252FRN45636_c274162a582f07eaf3407c0f5637ccaa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_c274162a582f07eaf3407c0f5637ccaa.jpg not downloaded yet
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb12933384c20cd14a8653ed80673f0d%252Fpa%252FRN45636_2955e5e1375204c4d6156b7969cece8b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_2955e5e1375204c4d6156b7969cece8b.jpg not downloaded yet
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb12933384c20cd14a8653ed80673f0d%252Fpa%252FRN45636_858e695c6763a7a7246805011cc4f12b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_858e695c6763a7a7246805011cc4f12b.jpg not downloaded yet
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb12933384c20cd14a8653ed80673f0d%252Fpa%252FRN45636_b37ed5746180db891b9d9f3362fb21da.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_b37ed5746180db891b9d9f3362fb21da.jpg not downloaded yet
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb12933384c20cd14a8653ed80673f0d%252Fpa%252FRN45636_ec04893b9e0e8b131b4597a246e79972.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_ec04893b9e0e8b131b4597a246e79972.jpg not downloaded yet
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb12933384c20cd14a8653ed80673f0d%252Fpa%252FRN45636_9783e0b0148e7d4abe409cc6f7e04f10.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_9783e0b0148e7d4abe409cc6f7e04f10.jpg not downloaded yet
2026-03-27 10:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PV05136> (referer: https://www.auto1.com/v1/car-details-view/PV05136/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_9783e0b0148e7d4abe409cc6f7e04f10.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bd4e256-9c3d-5f18-81f3-082a8445b94c with identifier: PV05136
2026-03-27 10:49:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bd4e256-9c3d-5f18-81f3-082a8445b94c with scrape type 1
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1bd4e256-9c3d-5f18-81f3-082a8445b94c
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F24%252F84246eb7d24493a1517a07e7392a489a%252Fpa%252FPV05136_a22d77436f16d1bed37de5085bfe7502.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/24/84246eb7d24493a1517a07e7392a489a/pa/PV05136_a22d77436f16d1bed37de5085bfe7502.jpg not downloaded yet
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F24%252F84246eb7d24493a1517a07e7392a489a%252Fpa%252FPV05136_d64ffdee13e7ae5c958adbd7b4faa987.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/24/84246eb7d24493a1517a07e7392a489a/pa/PV05136_d64ffdee13e7ae5c958adbd7b4faa987.jpg not downloaded yet
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F24%252F84246eb7d24493a1517a07e7392a489a%252Fpa%252FPV05136_642d588e5fabaa13403167f21a707baf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/24/84246eb7d24493a1517a07e7392a489a/pa/PV05136_642d588e5fabaa13403167f21a707baf.jpg not downloaded yet
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F24%252F84246eb7d24493a1517a07e7392a489a%252Fpa%252FPV05136_612aa6efe0c7e94da1efbfe0d3131a5c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/24/84246eb7d24493a1517a07e7392a489a/pa/PV05136_612aa6efe0c7e94da1efbfe0d3131a5c.jpg not downloaded yet
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F24%252F84246eb7d24493a1517a07e7392a489a%252Fpa%252FPV05136_09f6b7dccd6f24ba8dda43b6e7736d36.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/24/84246eb7d24493a1517a07e7392a489a/pa/PV05136_09f6b7dccd6f24ba8dda43b6e7736d36.jpg not downloaded yet
2026-03-27 10:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XU02017> (referer: https://www.auto1.com/v1/car-details-view/XU02017/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_ec04893b9e0e8b131b4597a246e79972.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501973150>
2026-03-27 10:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9324c65-06d3-597a-9b7f-5a45f7503fbd/b9324c65-06d3-597a-9b7f-5a45f7503fbd_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb12933384c20cd14a8653ed80673f0d%252Fpa%252FRN45636_9783e0b0148e7d4abe409cc6f7e04f10.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_9783e0b0148e7d4abe409cc6f7e04f10.jpg saved to cache
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b9324c65-06d3-597a-9b7f-5a45f7503fbd
2026-03-27 10:49:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 333517a7-9ca2-50fa-81fe-4be169d8b89d with identifier: XU02017
2026-03-27 10:49:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 333517a7-9ca2-50fa-81fe-4be169d8b89d with scrape type 1
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 333517a7-9ca2-50fa-81fe-4be169d8b89d
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fac%252Fb7acd6a5236799733724c6e49f24ba73%252Fpa%252FXU02017_322e556e87c41cf971d23ce36b8bed86.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ac/b7acd6a5236799733724c6e49f24ba73/pa/XU02017_322e556e87c41cf971d23ce36b8bed86.jpg not downloaded yet
2026-03-27 10:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001dce10>
2026-03-27 10:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9324c65-06d3-597a-9b7f-5a45f7503fbd/b9324c65-06d3-597a-9b7f-5a45f7503fbd_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb12933384c20cd14a8653ed80673f0d%252Fpa%252FRN45636_ec04893b9e0e8b131b4597a246e79972.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_ec04893b9e0e8b131b4597a246e79972.jpg saved to cache
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b9324c65-06d3-597a-9b7f-5a45f7503fbd
2026-03-27 10:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/24/84246eb7d24493a1517a07e7392a489a/pa/PV05136_612aa6efe0c7e94da1efbfe0d3131a5c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fac%252Fb7acd6a5236799733724c6e49f24ba73%252Fpa%252FXU02017_96434549a5ef48cc01fcb30cfd2d9c34.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ac/b7acd6a5236799733724c6e49f24ba73/pa/XU02017_96434549a5ef48cc01fcb30cfd2d9c34.jpg not downloaded yet
2026-03-27 10:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/24/84246eb7d24493a1517a07e7392a489a/pa/PV05136_09f6b7dccd6f24ba8dda43b6e7736d36.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fac%252Fb7acd6a5236799733724c6e49f24ba73%252Fpa%252FXU02017_b7c0d4c31d30280d44d547764103cb54.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ac/b7acd6a5236799733724c6e49f24ba73/pa/XU02017_b7c0d4c31d30280d44d547764103cb54.jpg not downloaded yet
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fac%252Fb7acd6a5236799733724c6e49f24ba73%252Fpa%252FXU02017_b0cafceb24b4214b2f251eb6beefd061.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ac/b7acd6a5236799733724c6e49f24ba73/pa/XU02017_b0cafceb24b4214b2f251eb6beefd061.jpg not downloaded yet
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fac%252Fb7acd6a5236799733724c6e49f24ba73%252Fpa%252FXU02017_15a691cb03b628ba8c09fa77aedca6c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ac/b7acd6a5236799733724c6e49f24ba73/pa/XU02017_15a691cb03b628ba8c09fa77aedca6c0.jpg not downloaded yet
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50378f4d0>
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bd4e256-9c3d-5f18-81f3-082a8445b94c/1bd4e256-9c3d-5f18-81f3-082a8445b94c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F24%252F84246eb7d24493a1517a07e7392a489a%252Fpa%252FPV05136_612aa6efe0c7e94da1efbfe0d3131a5c.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/24/84246eb7d24493a1517a07e7392a489a/pa/PV05136_612aa6efe0c7e94da1efbfe0d3131a5c.jpg saved to cache
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1bd4e256-9c3d-5f18-81f3-082a8445b94c
2026-03-27 10:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/ac/b7acd6a5236799733724c6e49f24ba73/pa/XU02017_322e556e87c41cf971d23ce36b8bed86.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503c07390>
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bd4e256-9c3d-5f18-81f3-082a8445b94c/1bd4e256-9c3d-5f18-81f3-082a8445b94c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F24%252F84246eb7d24493a1517a07e7392a489a%252Fpa%252FPV05136_09f6b7dccd6f24ba8dda43b6e7736d36.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/24/84246eb7d24493a1517a07e7392a489a/pa/PV05136_09f6b7dccd6f24ba8dda43b6e7736d36.jpg saved to cache
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1bd4e256-9c3d-5f18-81f3-082a8445b94c
2026-03-27 10:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/ac/b7acd6a5236799733724c6e49f24ba73/pa/XU02017_15a691cb03b628ba8c09fa77aedca6c0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019717d0>
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_333517a7-9ca2-50fa-81fe-4be169d8b89d/333517a7-9ca2-50fa-81fe-4be169d8b89d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fac%252Fb7acd6a5236799733724c6e49f24ba73%252Fpa%252FXU02017_322e556e87c41cf971d23ce36b8bed86.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ac/b7acd6a5236799733724c6e49f24ba73/pa/XU02017_322e556e87c41cf971d23ce36b8bed86.jpg saved to cache
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 333517a7-9ca2-50fa-81fe-4be169d8b89d
2026-03-27 10:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/24/84246eb7d24493a1517a07e7392a489a/pa/PV05136_642d588e5fabaa13403167f21a707baf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG45396/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50183d010>
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_333517a7-9ca2-50fa-81fe-4be169d8b89d/333517a7-9ca2-50fa-81fe-4be169d8b89d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fac%252Fb7acd6a5236799733724c6e49f24ba73%252Fpa%252FXU02017_15a691cb03b628ba8c09fa77aedca6c0.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ac/b7acd6a5236799733724c6e49f24ba73/pa/XU02017_15a691cb03b628ba8c09fa77aedca6c0.jpg saved to cache
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 333517a7-9ca2-50fa-81fe-4be169d8b89d
2026-03-27 10:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/ac/b7acd6a5236799733724c6e49f24ba73/pa/XU02017_96434549a5ef48cc01fcb30cfd2d9c34.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/ac/b7acd6a5236799733724c6e49f24ba73/pa/XU02017_b7c0d4c31d30280d44d547764103cb54.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016554d0>
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bd4e256-9c3d-5f18-81f3-082a8445b94c/1bd4e256-9c3d-5f18-81f3-082a8445b94c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F24%252F84246eb7d24493a1517a07e7392a489a%252Fpa%252FPV05136_642d588e5fabaa13403167f21a707baf.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/24/84246eb7d24493a1517a07e7392a489a/pa/PV05136_642d588e5fabaa13403167f21a707baf.jpg saved to cache
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1bd4e256-9c3d-5f18-81f3-082a8445b94c
2026-03-27 10:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/ac/b7acd6a5236799733724c6e49f24ba73/pa/XU02017_b0cafceb24b4214b2f251eb6beefd061.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/24/84246eb7d24493a1517a07e7392a489a/pa/PV05136_d64ffdee13e7ae5c958adbd7b4faa987.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/24/84246eb7d24493a1517a07e7392a489a/pa/PV05136_a22d77436f16d1bed37de5085bfe7502.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501895450>
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_333517a7-9ca2-50fa-81fe-4be169d8b89d/333517a7-9ca2-50fa-81fe-4be169d8b89d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fac%252Fb7acd6a5236799733724c6e49f24ba73%252Fpa%252FXU02017_96434549a5ef48cc01fcb30cfd2d9c34.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ac/b7acd6a5236799733724c6e49f24ba73/pa/XU02017_96434549a5ef48cc01fcb30cfd2d9c34.jpg saved to cache
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 333517a7-9ca2-50fa-81fe-4be169d8b89d
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a14d10>
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_333517a7-9ca2-50fa-81fe-4be169d8b89d/333517a7-9ca2-50fa-81fe-4be169d8b89d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fac%252Fb7acd6a5236799733724c6e49f24ba73%252Fpa%252FXU02017_b7c0d4c31d30280d44d547764103cb54.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ac/b7acd6a5236799733724c6e49f24ba73/pa/XU02017_b7c0d4c31d30280d44d547764103cb54.jpg saved to cache
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 333517a7-9ca2-50fa-81fe-4be169d8b89d
2026-03-27 10:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_858e695c6763a7a7246805011cc4f12b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501654d10>
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_333517a7-9ca2-50fa-81fe-4be169d8b89d/333517a7-9ca2-50fa-81fe-4be169d8b89d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fac%252Fb7acd6a5236799733724c6e49f24ba73%252Fpa%252FXU02017_b0cafceb24b4214b2f251eb6beefd061.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/ac/b7acd6a5236799733724c6e49f24ba73/pa/XU02017_b0cafceb24b4214b2f251eb6beefd061.jpg saved to cache
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 333517a7-9ca2-50fa-81fe-4be169d8b89d
2026-03-27 10:49:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 333517a7-9ca2-50fa-81fe-4be169d8b89d, skipping ID generation
2026-03-27 10:49:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 333517a7-9ca2-50fa-81fe-4be169d8b89d with scrape type 1
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 333517a7-9ca2-50fa-81fe-4be169d8b89d sending to next pipeline
2026-03-27 10:49:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 333517a7-9ca2-50fa-81fe-4be169d8b89d, identifier: XU02017
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5036e0a50>
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bd4e256-9c3d-5f18-81f3-082a8445b94c/1bd4e256-9c3d-5f18-81f3-082a8445b94c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F24%252F84246eb7d24493a1517a07e7392a489a%252Fpa%252FPV05136_d64ffdee13e7ae5c958adbd7b4faa987.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/24/84246eb7d24493a1517a07e7392a489a/pa/PV05136_d64ffdee13e7ae5c958adbd7b4faa987.jpg saved to cache
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1bd4e256-9c3d-5f18-81f3-082a8445b94c
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500207b10>
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bd4e256-9c3d-5f18-81f3-082a8445b94c/1bd4e256-9c3d-5f18-81f3-082a8445b94c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F24%252F84246eb7d24493a1517a07e7392a489a%252Fpa%252FPV05136_a22d77436f16d1bed37de5085bfe7502.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/24/84246eb7d24493a1517a07e7392a489a/pa/PV05136_a22d77436f16d1bed37de5085bfe7502.jpg saved to cache
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1bd4e256-9c3d-5f18-81f3-082a8445b94c
2026-03-27 10:49:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1bd4e256-9c3d-5f18-81f3-082a8445b94c, skipping ID generation
2026-03-27 10:49:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bd4e256-9c3d-5f18-81f3-082a8445b94c with scrape type 1
2026-03-27 10:49:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1bd4e256-9c3d-5f18-81f3-082a8445b94c sending to next pipeline
2026-03-27 10:49:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1bd4e256-9c3d-5f18-81f3-082a8445b94c, identifier: PV05136
2026-03-27 10:49:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 333517a7-9ca2-50fa-81fe-4be169d8b89d with identifier: XU02017
2026-03-27 10:49:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 333517a7-9ca2-50fa-81fe-4be169d8b89d with identifier: XU02017
2026-03-27 10:49:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 333517a7-9ca2-50fa-81fe-4be169d8b89d with identifier: XU02017 to the API
2026-03-27 10:49:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb7/ac/b7acd6a5236799733724c6e49f24ba73/pa/XU02017_b0cafceb24b4214b2f251eb6beefd061.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '1.9L',
 'engine_horse_power': 118,
 'expiration_date': '2026-03-28T16:47:11Z',
 'fuel_type': 'petrol',
 'id': '333517a7-9ca2-50fa-81fe-4be169d8b89d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU02017',
 'listing': 'auction',
 'location': 'DE, Arnsberg',
 'make': 'BMW',
 'model': '3er',
 'odometer': 124011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333517a7-9ca2-50fa-81fe-4be169d8b89d/333517a7-9ca2-50fa-81fe-4be169d8b89d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/ac/b7acd6a5236799733724c6e49f24ba73/pa/XU02017_322e556e87c41cf971d23ce36b8bed86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333517a7-9ca2-50fa-81fe-4be169d8b89d/333517a7-9ca2-50fa-81fe-4be169d8b89d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/ac/b7acd6a5236799733724c6e49f24ba73/pa/XU02017_96434549a5ef48cc01fcb30cfd2d9c34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333517a7-9ca2-50fa-81fe-4be169d8b89d/333517a7-9ca2-50fa-81fe-4be169d8b89d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/ac/b7acd6a5236799733724c6e49f24ba73/pa/XU02017_b7c0d4c31d30280d44d547764103cb54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333517a7-9ca2-50fa-81fe-4be169d8b89d/333517a7-9ca2-50fa-81fe-4be169d8b89d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/ac/b7acd6a5236799733724c6e49f24ba73/pa/XU02017_b0cafceb24b4214b2f251eb6beefd061.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333517a7-9ca2-50fa-81fe-4be169d8b89d/333517a7-9ca2-50fa-81fe-4be169d8b89d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/ac/b7acd6a5236799733724c6e49f24ba73/pa/XU02017_15a691cb03b628ba8c09fa77aedca6c0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2000-08-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318Ci',
 'transmission': 'manual',
 'trim': '',
 'year': 2000}
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU02017%27 HTTP/1.1" 200 None
2026-03-27 10:49:13 [auto1.de] INFO: Saving data for XU02017: {'created_time': 1774608553.211322, 'last_price_update_time': 1774608553.211331, 'auction_closing_time': 1774716431.0}
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU02017') HTTP/1.1" 204 0
2026-03-27 10:49:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1bd4e256-9c3d-5f18-81f3-082a8445b94c with identifier: PV05136
2026-03-27 10:49:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1bd4e256-9c3d-5f18-81f3-082a8445b94c with identifier: PV05136
2026-03-27 10:49:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1bd4e256-9c3d-5f18-81f3-082a8445b94c with identifier: PV05136 to the API
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img84/24/84246eb7d24493a1517a07e7392a489a/pa/PV05136_a22d77436f16d1bed37de5085bfe7502.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:33:51Z',
 'fuel_type': 'diesel',
 'id': '1bd4e256-9c3d-5f18-81f3-082a8445b94c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV05136',
 'listing': 'auction',
 'location': 'DE, Kaufbeuren',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 193793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd4e256-9c3d-5f18-81f3-082a8445b94c/1bd4e256-9c3d-5f18-81f3-082a8445b94c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/24/84246eb7d24493a1517a07e7392a489a/pa/PV05136_a22d77436f16d1bed37de5085bfe7502.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd4e256-9c3d-5f18-81f3-082a8445b94c/1bd4e256-9c3d-5f18-81f3-082a8445b94c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/24/84246eb7d24493a1517a07e7392a489a/pa/PV05136_d64ffdee13e7ae5c958adbd7b4faa987.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd4e256-9c3d-5f18-81f3-082a8445b94c/1bd4e256-9c3d-5f18-81f3-082a8445b94c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/24/84246eb7d24493a1517a07e7392a489a/pa/PV05136_642d588e5fabaa13403167f21a707baf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd4e256-9c3d-5f18-81f3-082a8445b94c/1bd4e256-9c3d-5f18-81f3-082a8445b94c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/24/84246eb7d24493a1517a07e7392a489a/pa/PV05136_612aa6efe0c7e94da1efbfe0d3131a5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd4e256-9c3d-5f18-81f3-082a8445b94c/1bd4e256-9c3d-5f18-81f3-082a8445b94c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/24/84246eb7d24493a1517a07e7392a489a/pa/PV05136_09f6b7dccd6f24ba8dda43b6e7736d36.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Auris 1.4 Turbodiesel Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2008}
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV05136%27 HTTP/1.1" 200 None
2026-03-27 10:49:13 [auto1.de] INFO: Saving data for PV05136: {'created_time': 1774608553.594502, 'last_price_update_time': 1774608553.594513, 'auction_closing_time': 1774715631.0}
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV05136') HTTP/1.1" 204 0
2026-03-27 10:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_b37ed5746180db891b9d9f3362fb21da.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_2955e5e1375204c4d6156b7969cece8b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZY72717/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DV32986/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MV46979/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50160f350>
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9324c65-06d3-597a-9b7f-5a45f7503fbd/b9324c65-06d3-597a-9b7f-5a45f7503fbd_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb12933384c20cd14a8653ed80673f0d%252Fpa%252FRN45636_858e695c6763a7a7246805011cc4f12b.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_858e695c6763a7a7246805011cc4f12b.jpg saved to cache
2026-03-27 10:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b9324c65-06d3-597a-9b7f-5a45f7503fbd
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50169a150>
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9324c65-06d3-597a-9b7f-5a45f7503fbd/b9324c65-06d3-597a-9b7f-5a45f7503fbd_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb12933384c20cd14a8653ed80673f0d%252Fpa%252FRN45636_b37ed5746180db891b9d9f3362fb21da.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_b37ed5746180db891b9d9f3362fb21da.jpg saved to cache
2026-03-27 10:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b9324c65-06d3-597a-9b7f-5a45f7503fbd
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501946190>
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9324c65-06d3-597a-9b7f-5a45f7503fbd/b9324c65-06d3-597a-9b7f-5a45f7503fbd_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb12933384c20cd14a8653ed80673f0d%252Fpa%252FRN45636_2955e5e1375204c4d6156b7969cece8b.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_2955e5e1375204c4d6156b7969cece8b.jpg saved to cache
2026-03-27 10:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b9324c65-06d3-597a-9b7f-5a45f7503fbd
2026-03-27 10:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_c5dec4efe9a32a6aae78b617d6273ab2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_c274162a582f07eaf3407c0f5637ccaa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_3ab04271f4d221fdcfee142d40cd200d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_ccac13e729e8c677e674cd66a09854f5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_b9e7e7183f5ae5149fd2b0a6759317b6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001d5410>
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9324c65-06d3-597a-9b7f-5a45f7503fbd/b9324c65-06d3-597a-9b7f-5a45f7503fbd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb12933384c20cd14a8653ed80673f0d%252Fpa%252FRN45636_c5dec4efe9a32a6aae78b617d6273ab2.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_c5dec4efe9a32a6aae78b617d6273ab2.jpg saved to cache
2026-03-27 10:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9324c65-06d3-597a-9b7f-5a45f7503fbd
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500572750>
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9324c65-06d3-597a-9b7f-5a45f7503fbd/b9324c65-06d3-597a-9b7f-5a45f7503fbd_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb12933384c20cd14a8653ed80673f0d%252Fpa%252FRN45636_c274162a582f07eaf3407c0f5637ccaa.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_c274162a582f07eaf3407c0f5637ccaa.jpg saved to cache
2026-03-27 10:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b9324c65-06d3-597a-9b7f-5a45f7503fbd
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50378e090>
2026-03-27 10:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9324c65-06d3-597a-9b7f-5a45f7503fbd/b9324c65-06d3-597a-9b7f-5a45f7503fbd_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb12933384c20cd14a8653ed80673f0d%252Fpa%252FRN45636_3ab04271f4d221fdcfee142d40cd200d.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_3ab04271f4d221fdcfee142d40cd200d.jpg saved to cache
2026-03-27 10:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b9324c65-06d3-597a-9b7f-5a45f7503fbd
2026-03-27 10:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50033b850>
2026-03-27 10:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9324c65-06d3-597a-9b7f-5a45f7503fbd/b9324c65-06d3-597a-9b7f-5a45f7503fbd_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb12933384c20cd14a8653ed80673f0d%252Fpa%252FRN45636_ccac13e729e8c677e674cd66a09854f5.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_ccac13e729e8c677e674cd66a09854f5.jpg saved to cache
2026-03-27 10:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b9324c65-06d3-597a-9b7f-5a45f7503fbd
2026-03-27 10:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003855d0>
2026-03-27 10:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9324c65-06d3-597a-9b7f-5a45f7503fbd/b9324c65-06d3-597a-9b7f-5a45f7503fbd_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F12%252Fdb12933384c20cd14a8653ed80673f0d%252Fpa%252FRN45636_b9e7e7183f5ae5149fd2b0a6759317b6.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_b9e7e7183f5ae5149fd2b0a6759317b6.jpg saved to cache
2026-03-27 10:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b9324c65-06d3-597a-9b7f-5a45f7503fbd
2026-03-27 10:49:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9324c65-06d3-597a-9b7f-5a45f7503fbd, skipping ID generation
2026-03-27 10:49:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9324c65-06d3-597a-9b7f-5a45f7503fbd with scrape type 1
2026-03-27 10:49:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9324c65-06d3-597a-9b7f-5a45f7503fbd sending to next pipeline
2026-03-27 10:49:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9324c65-06d3-597a-9b7f-5a45f7503fbd, identifier: RN45636
2026-03-27 10:49:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9324c65-06d3-597a-9b7f-5a45f7503fbd with identifier: RN45636
2026-03-27 10:49:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9324c65-06d3-597a-9b7f-5a45f7503fbd with identifier: RN45636
2026-03-27 10:49:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9324c65-06d3-597a-9b7f-5a45f7503fbd with identifier: RN45636 to the API
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_b9e7e7183f5ae5149fd2b0a6759317b6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 380,
 'expiration_date': '2026-03-28T16:40:21Z',
 'fuel_type': 'diesel',
 'id': 'b9324c65-06d3-597a-9b7f-5a45f7503fbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN45636',
 'listing': 'auction',
 'location': 'DE',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 324236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9324c65-06d3-597a-9b7f-5a45f7503fbd/b9324c65-06d3-597a-9b7f-5a45f7503fbd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_c5dec4efe9a32a6aae78b617d6273ab2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9324c65-06d3-597a-9b7f-5a45f7503fbd/b9324c65-06d3-597a-9b7f-5a45f7503fbd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_ccac13e729e8c677e674cd66a09854f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9324c65-06d3-597a-9b7f-5a45f7503fbd/b9324c65-06d3-597a-9b7f-5a45f7503fbd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_b9e7e7183f5ae5149fd2b0a6759317b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9324c65-06d3-597a-9b7f-5a45f7503fbd/b9324c65-06d3-597a-9b7f-5a45f7503fbd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 138443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_3ab04271f4d221fdcfee142d40cd200d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9324c65-06d3-597a-9b7f-5a45f7503fbd/b9324c65-06d3-597a-9b7f-5a45f7503fbd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 147410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_c274162a582f07eaf3407c0f5637ccaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9324c65-06d3-597a-9b7f-5a45f7503fbd/b9324c65-06d3-597a-9b7f-5a45f7503fbd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_2955e5e1375204c4d6156b7969cece8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9324c65-06d3-597a-9b7f-5a45f7503fbd/b9324c65-06d3-597a-9b7f-5a45f7503fbd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_858e695c6763a7a7246805011cc4f12b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9324c65-06d3-597a-9b7f-5a45f7503fbd/b9324c65-06d3-597a-9b7f-5a45f7503fbd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_b37ed5746180db891b9d9f3362fb21da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9324c65-06d3-597a-9b7f-5a45f7503fbd/b9324c65-06d3-597a-9b7f-5a45f7503fbd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_ec04893b9e0e8b131b4597a246e79972.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9324c65-06d3-597a-9b7f-5a45f7503fbd/b9324c65-06d3-597a-9b7f-5a45f7503fbd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/12/db12933384c20cd14a8653ed80673f0d/pa/RN45636_9783e0b0148e7d4abe409cc6f7e04f10.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 M50d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN45636%27 HTTP/1.1" 200 None
2026-03-27 10:49:14 [auto1.de] INFO: Saving data for RN45636: {'created_time': 1774608554.621551, 'last_price_update_time': 1774608554.621565, 'auction_closing_time': 1774716021.0}
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN45636') HTTP/1.1" 204 0
2026-03-27 10:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY44920/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP29257/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK76499> (referer: https://www.auto1.com/v1/car-details-view/ZK76499/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98406f2b-f0be-567c-993e-31d972116fd2 with identifier: ZK76499
2026-03-27 10:49:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98406f2b-f0be-567c-993e-31d972116fd2 with scrape type 1
2026-03-27 10:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98406f2b-f0be-567c-993e-31d972116fd2
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ff3%252F4bf3e1eb38a1b9cc7dc32003f2ba5e57%252Fpa%252FZK76499_1b561861ddb92467e64df8e78542fec3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_1b561861ddb92467e64df8e78542fec3.jpg not downloaded yet
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ff3%252F4bf3e1eb38a1b9cc7dc32003f2ba5e57%252Fpa%252FZK76499_b9f08f98700370d8959cefcd7ab6ee40.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_b9f08f98700370d8959cefcd7ab6ee40.jpg not downloaded yet
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ff3%252F4bf3e1eb38a1b9cc7dc32003f2ba5e57%252Fpa%252FZK76499_d09ba126798a710844277c0d425a10fd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_d09ba126798a710844277c0d425a10fd.jpg not downloaded yet
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ff3%252F4bf3e1eb38a1b9cc7dc32003f2ba5e57%252Fpa%252FZK76499_bd3d7617327252c66255dbb843acc086.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_bd3d7617327252c66255dbb843acc086.jpg not downloaded yet
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ff3%252F4bf3e1eb38a1b9cc7dc32003f2ba5e57%252Fpa%252FZK76499_be445fe5cae66192ddf11c4c9dc13d64.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_be445fe5cae66192ddf11c4c9dc13d64.jpg not downloaded yet
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ff3%252F4bf3e1eb38a1b9cc7dc32003f2ba5e57%252Fpa%252FZK76499_40d2f35d2846a83905880a93783b2c04.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_40d2f35d2846a83905880a93783b2c04.jpg not downloaded yet
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ff3%252F4bf3e1eb38a1b9cc7dc32003f2ba5e57%252Fpa%252FZK76499_f32e02a3f714d0bb6153c83483113286.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_f32e02a3f714d0bb6153c83483113286.jpg not downloaded yet
2026-03-27 10:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ff3%252F4bf3e1eb38a1b9cc7dc32003f2ba5e57%252Fpa%252FZK76499_f387786936792de22e5bae8bf0690919.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_f387786936792de22e5bae8bf0690919.jpg not downloaded yet
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ff3%252F4bf3e1eb38a1b9cc7dc32003f2ba5e57%252Fpa%252FZK76499_33e0bd24c90a1f41c0a91f0ecec6a960.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_33e0bd24c90a1f41c0a91f0ecec6a960.jpg not downloaded yet
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ff3%252F4bf3e1eb38a1b9cc7dc32003f2ba5e57%252Fpa%252FZK76499_d67a395a8fc7df6f71111de3d70182ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_d67a395a8fc7df6f71111de3d70182ed.jpg not downloaded yet
2026-03-27 10:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JW24568/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ67378> (referer: https://www.auto1.com/v1/car-details-view/ZZ67378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_d67a395a8fc7df6f71111de3d70182ed.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eca5aac-39b2-5b93-af6a-b38550816051 with identifier: ZZ67378
2026-03-27 10:49:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eca5aac-39b2-5b93-af6a-b38550816051 with scrape type 1
2026-03-27 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2eca5aac-39b2-5b93-af6a-b38550816051
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F08%252Fb1085347a0f1c643ecd13a66ebe3aa24%252Fpa%252FZZ67378_e4d11677df5b6a8976ed55cac29fd71a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_e4d11677df5b6a8976ed55cac29fd71a.jpg not downloaded yet
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F08%252Fb1085347a0f1c643ecd13a66ebe3aa24%252Fpa%252FZZ67378_3094651bd2394d259355c03e10c11e76.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_3094651bd2394d259355c03e10c11e76.jpg not downloaded yet
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F08%252Fb1085347a0f1c643ecd13a66ebe3aa24%252Fpa%252FZZ67378_8454f481041caca3d56d1eef5dd62cbd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_8454f481041caca3d56d1eef5dd62cbd.jpg not downloaded yet
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F08%252Fb1085347a0f1c643ecd13a66ebe3aa24%252Fpa%252FZZ67378_fab22c416fdd403c81280de81730b7bd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_fab22c416fdd403c81280de81730b7bd.jpg not downloaded yet
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F08%252Fb1085347a0f1c643ecd13a66ebe3aa24%252Fpa%252FZZ67378_a94727583223d63d4720944a92673d14.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_a94727583223d63d4720944a92673d14.jpg not downloaded yet
2026-03-27 10:49:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50183e790>
2026-03-27 10:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98406f2b-f0be-567c-993e-31d972116fd2/98406f2b-f0be-567c-993e-31d972116fd2_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ff3%252F4bf3e1eb38a1b9cc7dc32003f2ba5e57%252Fpa%252FZK76499_d67a395a8fc7df6f71111de3d70182ed.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_d67a395a8fc7df6f71111de3d70182ed.jpg saved to cache
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 98406f2b-f0be-567c-993e-31d972116fd2
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F08%252Fb1085347a0f1c643ecd13a66ebe3aa24%252Fpa%252FZZ67378_4dfd0ef583e69ff388398f0013f5d2fd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_4dfd0ef583e69ff388398f0013f5d2fd.jpg not downloaded yet
2026-03-27 10:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_33e0bd24c90a1f41c0a91f0ecec6a960.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F08%252Fb1085347a0f1c643ecd13a66ebe3aa24%252Fpa%252FZZ67378_7d303b785fa7ac0e671c17118f1ec7bb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_7d303b785fa7ac0e671c17118f1ec7bb.jpg not downloaded yet
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F08%252Fb1085347a0f1c643ecd13a66ebe3aa24%252Fpa%252FZZ67378_6244d0f7b098453d716008e554df71dc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_6244d0f7b098453d716008e554df71dc.jpg not downloaded yet
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F08%252Fb1085347a0f1c643ecd13a66ebe3aa24%252Fpa%252FZZ67378_1b427f527ca1bb9a82fc398bb537d3e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_1b427f527ca1bb9a82fc398bb537d3e2.jpg not downloaded yet
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F08%252Fb1085347a0f1c643ecd13a66ebe3aa24%252Fpa%252FZZ67378_cf8e0b5138d794a08131e306b3584bc0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_cf8e0b5138d794a08131e306b3584bc0.jpg not downloaded yet
2026-03-27 10:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500362790>
2026-03-27 10:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98406f2b-f0be-567c-993e-31d972116fd2/98406f2b-f0be-567c-993e-31d972116fd2_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ff3%252F4bf3e1eb38a1b9cc7dc32003f2ba5e57%252Fpa%252FZK76499_33e0bd24c90a1f41c0a91f0ecec6a960.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_33e0bd24c90a1f41c0a91f0ecec6a960.jpg saved to cache
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 98406f2b-f0be-567c-993e-31d972116fd2
2026-03-27 10:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_4dfd0ef583e69ff388398f0013f5d2fd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001ca8d0>
2026-03-27 10:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eca5aac-39b2-5b93-af6a-b38550816051/2eca5aac-39b2-5b93-af6a-b38550816051_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F08%252Fb1085347a0f1c643ecd13a66ebe3aa24%252Fpa%252FZZ67378_4dfd0ef583e69ff388398f0013f5d2fd.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_4dfd0ef583e69ff388398f0013f5d2fd.jpg saved to cache
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2eca5aac-39b2-5b93-af6a-b38550816051
2026-03-27 10:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AH76263> (referer: https://www.auto1.com/v1/car-details-view/AH76263/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_cf8e0b5138d794a08131e306b3584bc0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a9926c6-1a01-552a-83db-73be151299c7 with identifier: AH76263
2026-03-27 10:49:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a9926c6-1a01-552a-83db-73be151299c7 with scrape type 1
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a9926c6-1a01-552a-83db-73be151299c7
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fae%252Ff7ae2783ab342603e2b9ab3aba3d7ef1%252Fpa%252FAH76263_f6f1ebb09f010461b0a208c2ef6663f4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_f6f1ebb09f010461b0a208c2ef6663f4.jpg not downloaded yet
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fae%252Ff7ae2783ab342603e2b9ab3aba3d7ef1%252Fpa%252FAH76263_c5fe35d3632636733b26bd43039ff9c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_c5fe35d3632636733b26bd43039ff9c5.jpg not downloaded yet
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fae%252Ff7ae2783ab342603e2b9ab3aba3d7ef1%252Fpa%252FAH76263_afaf590de2dcdc5e48c3237703127185.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_afaf590de2dcdc5e48c3237703127185.jpg not downloaded yet
2026-03-27 10:49:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50160ef50>
2026-03-27 10:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eca5aac-39b2-5b93-af6a-b38550816051/2eca5aac-39b2-5b93-af6a-b38550816051_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F08%252Fb1085347a0f1c643ecd13a66ebe3aa24%252Fpa%252FZZ67378_cf8e0b5138d794a08131e306b3584bc0.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_cf8e0b5138d794a08131e306b3584bc0.jpg saved to cache
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2eca5aac-39b2-5b93-af6a-b38550816051
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fae%252Ff7ae2783ab342603e2b9ab3aba3d7ef1%252Fpa%252FAH76263_acdbac2fec4534350136927b462d7e3a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_acdbac2fec4534350136927b462d7e3a.jpg not downloaded yet
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fae%252Ff7ae2783ab342603e2b9ab3aba3d7ef1%252Fpa%252FAH76263_9221e66b4466e3cfbb7cbb207f76e164.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_9221e66b4466e3cfbb7cbb207f76e164.jpg not downloaded yet
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fae%252Ff7ae2783ab342603e2b9ab3aba3d7ef1%252Fpa%252FAH76263_6d0234d3ae9451bd92ce7b421a956223.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_6d0234d3ae9451bd92ce7b421a956223.jpg not downloaded yet
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fae%252Ff7ae2783ab342603e2b9ab3aba3d7ef1%252Fpa%252FAH76263_30fac7ffab2af352dea15476200713ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_30fac7ffab2af352dea15476200713ef.jpg not downloaded yet
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fae%252Ff7ae2783ab342603e2b9ab3aba3d7ef1%252Fpa%252FAH76263_f77fac26b296ecc9de371b78a75930be.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_f77fac26b296ecc9de371b78a75930be.jpg not downloaded yet
2026-03-27 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fae%252Ff7ae2783ab342603e2b9ab3aba3d7ef1%252Fpa%252FAH76263_9ba9b434fa97a607486a167ea761a134.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_9ba9b434fa97a607486a167ea761a134.jpg not downloaded yet
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fae%252Ff7ae2783ab342603e2b9ab3aba3d7ef1%252Fpa%252FAH76263_d4da2bac90a90a87880b988b3562243e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_d4da2bac90a90a87880b988b3562243e.jpg not downloaded yet
2026-03-27 10:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_1b427f527ca1bb9a82fc398bb537d3e2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_6244d0f7b098453d716008e554df71dc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50167ef50>
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eca5aac-39b2-5b93-af6a-b38550816051/2eca5aac-39b2-5b93-af6a-b38550816051_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F08%252Fb1085347a0f1c643ecd13a66ebe3aa24%252Fpa%252FZZ67378_1b427f527ca1bb9a82fc398bb537d3e2.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_1b427f527ca1bb9a82fc398bb537d3e2.jpg saved to cache
2026-03-27 10:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2eca5aac-39b2-5b93-af6a-b38550816051
2026-03-27 10:49:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500402490>
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eca5aac-39b2-5b93-af6a-b38550816051/2eca5aac-39b2-5b93-af6a-b38550816051_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F08%252Fb1085347a0f1c643ecd13a66ebe3aa24%252Fpa%252FZZ67378_6244d0f7b098453d716008e554df71dc.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_6244d0f7b098453d716008e554df71dc.jpg saved to cache
2026-03-27 10:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2eca5aac-39b2-5b93-af6a-b38550816051
2026-03-27 10:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_d4da2bac90a90a87880b988b3562243e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_9ba9b434fa97a607486a167ea761a134.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003864d0>
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9926c6-1a01-552a-83db-73be151299c7/1a9926c6-1a01-552a-83db-73be151299c7_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fae%252Ff7ae2783ab342603e2b9ab3aba3d7ef1%252Fpa%252FAH76263_d4da2bac90a90a87880b988b3562243e.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_d4da2bac90a90a87880b988b3562243e.jpg saved to cache
2026-03-27 10:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a9926c6-1a01-552a-83db-73be151299c7
2026-03-27 10:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_30fac7ffab2af352dea15476200713ef.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500400590>
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9926c6-1a01-552a-83db-73be151299c7/1a9926c6-1a01-552a-83db-73be151299c7_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fae%252Ff7ae2783ab342603e2b9ab3aba3d7ef1%252Fpa%252FAH76263_9ba9b434fa97a607486a167ea761a134.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_9ba9b434fa97a607486a167ea761a134.jpg saved to cache
2026-03-27 10:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a9926c6-1a01-552a-83db-73be151299c7
2026-03-27 10:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_f77fac26b296ecc9de371b78a75930be.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500431250>
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9926c6-1a01-552a-83db-73be151299c7/1a9926c6-1a01-552a-83db-73be151299c7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fae%252Ff7ae2783ab342603e2b9ab3aba3d7ef1%252Fpa%252FAH76263_30fac7ffab2af352dea15476200713ef.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_30fac7ffab2af352dea15476200713ef.jpg saved to cache
2026-03-27 10:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a9926c6-1a01-552a-83db-73be151299c7
2026-03-27 10:49:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5113d1890>
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9926c6-1a01-552a-83db-73be151299c7/1a9926c6-1a01-552a-83db-73be151299c7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fae%252Ff7ae2783ab342603e2b9ab3aba3d7ef1%252Fpa%252FAH76263_f77fac26b296ecc9de371b78a75930be.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_f77fac26b296ecc9de371b78a75930be.jpg saved to cache
2026-03-27 10:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a9926c6-1a01-552a-83db-73be151299c7
2026-03-27 10:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_6d0234d3ae9451bd92ce7b421a956223.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV10923/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG45396> (referer: https://www.auto1.com/v1/car-details-view/SG45396/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_9221e66b4466e3cfbb7cbb207f76e164.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_f6f1ebb09f010461b0a208c2ef6663f4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500403b50>
2026-03-27 10:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9926c6-1a01-552a-83db-73be151299c7/1a9926c6-1a01-552a-83db-73be151299c7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fae%252Ff7ae2783ab342603e2b9ab3aba3d7ef1%252Fpa%252FAH76263_6d0234d3ae9451bd92ce7b421a956223.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_6d0234d3ae9451bd92ce7b421a956223.jpg saved to cache
2026-03-27 10:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a9926c6-1a01-552a-83db-73be151299c7
2026-03-27 10:49:18 [auto1.de] INFO: Channel: 24h | Page: 47 | totalHits: 10576 | hits on page: 40
2026-03-27 10:49:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65b14690-fdc5-55ad-a2e2-b11dc317f145 with identifier: SG45396
2026-03-27 10:49:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65b14690-fdc5-55ad-a2e2-b11dc317f145 with scrape type 1
2026-03-27 10:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 65b14690-fdc5-55ad-a2e2-b11dc317f145
2026-03-27 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fff%252Ff1ff7662619fc54ac2b3a4a4bb18ea61%252Fpa%252FSG45396_c9094750a6e29bdc60ca51383e5d2f05.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ff/f1ff7662619fc54ac2b3a4a4bb18ea61/pa/SG45396_c9094750a6e29bdc60ca51383e5d2f05.jpg not downloaded yet
2026-03-27 10:49:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50037f850>
2026-03-27 10:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9926c6-1a01-552a-83db-73be151299c7/1a9926c6-1a01-552a-83db-73be151299c7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fae%252Ff7ae2783ab342603e2b9ab3aba3d7ef1%252Fpa%252FAH76263_9221e66b4466e3cfbb7cbb207f76e164.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_9221e66b4466e3cfbb7cbb207f76e164.jpg saved to cache
2026-03-27 10:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a9926c6-1a01-552a-83db-73be151299c7
2026-03-27 10:49:19 [auto1.de] INFO: Found listing with ID: EE00996
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE00996%27 HTTP/1.1" 200 None
2026-03-27 10:49:19 [auto1.de] INFO: Scrape type for EE00996: 0
2026-03-27 10:49:19 [auto1.de] INFO: Found listing with ID: NP68778
2026-03-27 10:49:19 [auto1.de] INFO: Found listing with ID: VJ29661
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fff%252Ff1ff7662619fc54ac2b3a4a4bb18ea61%252Fpa%252FSG45396_f7875edbaaf6683ac851a7f2adeadaf5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ff/f1ff7662619fc54ac2b3a4a4bb18ea61/pa/SG45396_f7875edbaaf6683ac851a7f2adeadaf5.jpg not downloaded yet
2026-03-27 10:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_7d303b785fa7ac0e671c17118f1ec7bb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004da050>
2026-03-27 10:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9926c6-1a01-552a-83db-73be151299c7/1a9926c6-1a01-552a-83db-73be151299c7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fae%252Ff7ae2783ab342603e2b9ab3aba3d7ef1%252Fpa%252FAH76263_f6f1ebb09f010461b0a208c2ef6663f4.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_f6f1ebb09f010461b0a208c2ef6663f4.jpg saved to cache
2026-03-27 10:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a9926c6-1a01-552a-83db-73be151299c7
2026-03-27 10:49:19 [auto1.de] INFO: Found listing with ID: SX40224
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX40224%27 HTTP/1.1" 200 None
2026-03-27 10:49:19 [auto1.de] INFO: Scrape type for SX40224: 2
2026-03-27 10:49:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd814f5c-6156-58a7-86fd-c1e606c64ac9 with identifier: SX40224
2026-03-27 10:49:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd814f5c-6156-58a7-86fd-c1e606c64ac9 with scrape type 2
2026-03-27 10:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd814f5c-6156-58a7-86fd-c1e606c64ac9 with scrape type 2
2026-03-27 10:49:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd814f5c-6156-58a7-86fd-c1e606c64ac9, identifier: SX40224
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fff%252Ff1ff7662619fc54ac2b3a4a4bb18ea61%252Fpa%252FSG45396_f25e6f45fc143b5241fb6d4abae1839e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ff/f1ff7662619fc54ac2b3a4a4bb18ea61/pa/SG45396_f25e6f45fc143b5241fb6d4abae1839e.jpg not downloaded yet
2026-03-27 10:49:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd814f5c-6156-58a7-86fd-c1e606c64ac9 with identifier: SX40224
2026-03-27 10:49:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd814f5c-6156-58a7-86fd-c1e606c64ac9 with identifier: SX40224
2026-03-27 10:49:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd814f5c-6156-58a7-86fd-c1e606c64ac9 with identifier: SX40224 to the API
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:02:59Z',
 'fuel_type': 'petrol',
 'id': 'fd814f5c-6156-58a7-86fd-c1e606c64ac9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX40224',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 47453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-24',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2017}
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX40224%27 HTTP/1.1" 200 None
2026-03-27 10:49:19 [auto1.de] INFO: Saving data for SX40224: {'auction_closing_time': 1774713779.0, 'created_time': 1773303355.25174, 'last_price_update_time': 1774608559.775581}
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX40224') HTTP/1.1" 204 0
2026-03-27 10:49:19 [auto1.de] INFO: Found listing with ID: XS17240
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS17240%27 HTTP/1.1" 200 None
2026-03-27 10:49:19 [auto1.de] INFO: Scrape type for XS17240: 2
2026-03-27 10:49:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5860693d-9dc9-54b0-8435-c0fecdb95f12 with identifier: XS17240
2026-03-27 10:49:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5860693d-9dc9-54b0-8435-c0fecdb95f12 with scrape type 2
2026-03-27 10:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5860693d-9dc9-54b0-8435-c0fecdb95f12 with scrape type 2
2026-03-27 10:49:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5860693d-9dc9-54b0-8435-c0fecdb95f12, identifier: XS17240
2026-03-27 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fff%252Ff1ff7662619fc54ac2b3a4a4bb18ea61%252Fpa%252FSG45396_9042ed66463912043b864b2b69febfe9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ff/f1ff7662619fc54ac2b3a4a4bb18ea61/pa/SG45396_9042ed66463912043b864b2b69febfe9.jpg not downloaded yet
2026-03-27 10:49:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5860693d-9dc9-54b0-8435-c0fecdb95f12 with identifier: XS17240
2026-03-27 10:49:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5860693d-9dc9-54b0-8435-c0fecdb95f12 with identifier: XS17240
2026-03-27 10:49:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5860693d-9dc9-54b0-8435-c0fecdb95f12 with identifier: XS17240 to the API
2026-03-27 10:49:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:49:12Z',
 'fuel_type': 'petrol',
 'id': '5860693d-9dc9-54b0-8435-c0fecdb95f12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS17240',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 156557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-31',
 'seller_name': None,
 'title': 'Ford Focus 1.8 White Magic',
 'transmission': 'manual',
 'trim': 'White Magic',
 'year': 2010}
2026-03-27 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS17240%27 HTTP/1.1" 200 None
2026-03-27 10:49:20 [auto1.de] INFO: Saving data for XS17240: {'auction_closing_time': 1774716552.0, 'created_time': 1773228264.113777, 'last_price_update_time': 1774608560.348203}
2026-03-27 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS17240') HTTP/1.1" 204 0
2026-03-27 10:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/ff/f1ff7662619fc54ac2b3a4a4bb18ea61/pa/SG45396_c9094750a6e29bdc60ca51383e5d2f05.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:20 [auto1.de] INFO: Found listing with ID: MV46012
2026-03-27 10:49:20 [auto1.de] INFO: Found listing with ID: JL91815
2026-03-27 10:49:20 [auto1.de] INFO: Found listing with ID: EK35927
2026-03-27 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK35927%27 HTTP/1.1" 200 None
2026-03-27 10:49:20 [auto1.de] INFO: Scrape type for EK35927: 1
2026-03-27 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fff%252Ff1ff7662619fc54ac2b3a4a4bb18ea61%252Fpa%252FSG45396_1cd7aeb66b155580a7c711ab97c74b4b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ff/f1ff7662619fc54ac2b3a4a4bb18ea61/pa/SG45396_1cd7aeb66b155580a7c711ab97c74b4b.jpg not downloaded yet
2026-03-27 10:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TN35459> (referer: https://www.auto1.com/v1/car-details-view/TN35459/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015feb90>
2026-03-27 10:49:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eca5aac-39b2-5b93-af6a-b38550816051/2eca5aac-39b2-5b93-af6a-b38550816051_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F08%252Fb1085347a0f1c643ecd13a66ebe3aa24%252Fpa%252FZZ67378_7d303b785fa7ac0e671c17118f1ec7bb.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_7d303b785fa7ac0e671c17118f1ec7bb.jpg saved to cache
2026-03-27 10:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2eca5aac-39b2-5b93-af6a-b38550816051
2026-03-27 10:49:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:20 [auto1.de] INFO: Found listing with ID: PC18756
2026-03-27 10:49:20 [auto1.de] INFO: Found listing with ID: AY57435
2026-03-27 10:49:20 [auto1.de] INFO: Found listing with ID: NV35825
2026-03-27 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV35825%27 HTTP/1.1" 200 None
2026-03-27 10:49:20 [auto1.de] INFO: Scrape type for NV35825: 1
2026-03-27 10:49:20 [auto1.de] INFO: Found listing with ID: GB27132
2026-03-27 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27132%27 HTTP/1.1" 200 None
2026-03-27 10:49:20 [auto1.de] INFO: Scrape type for GB27132: 2
2026-03-27 10:49:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f08fbb12-8df3-56bc-8412-a06904636da1 with identifier: GB27132
2026-03-27 10:49:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f08fbb12-8df3-56bc-8412-a06904636da1 with scrape type 2
2026-03-27 10:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f08fbb12-8df3-56bc-8412-a06904636da1 with scrape type 2
2026-03-27 10:49:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f08fbb12-8df3-56bc-8412-a06904636da1, identifier: GB27132
2026-03-27 10:49:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f08fbb12-8df3-56bc-8412-a06904636da1 with identifier: GB27132
2026-03-27 10:49:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f08fbb12-8df3-56bc-8412-a06904636da1 with identifier: GB27132
2026-03-27 10:49:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f08fbb12-8df3-56bc-8412-a06904636da1 with identifier: GB27132 to the API
2026-03-27 10:49:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:36:34Z',
 'fuel_type': 'petrol',
 'id': 'f08fbb12-8df3-56bc-8412-a06904636da1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB27132',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 67639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-02',
 'seller_name': None,
 'title': 'Ford Fiesta 1.5 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2019}
2026-03-27 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27132%27 HTTP/1.1" 200 None
2026-03-27 10:49:21 [auto1.de] INFO: Saving data for GB27132: {'auction_closing_time': 1774715794.0, 'created_time': 1773302926.630431, 'last_price_update_time': 1774608561.176089}
2026-03-27 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB27132') HTTP/1.1" 204 0
2026-03-27 10:49:21 [auto1.de] INFO: Found listing with ID: SR34905
2026-03-27 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR34905%27 HTTP/1.1" 200 None
2026-03-27 10:49:21 [auto1.de] INFO: Scrape type for SR34905: 2
2026-03-27 10:49:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f63e23b5-1882-5871-b246-011db2b0e393 with identifier: SR34905
2026-03-27 10:49:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f63e23b5-1882-5871-b246-011db2b0e393 with scrape type 2
2026-03-27 10:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f63e23b5-1882-5871-b246-011db2b0e393 with scrape type 2
2026-03-27 10:49:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f63e23b5-1882-5871-b246-011db2b0e393, identifier: SR34905
2026-03-27 10:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/ff/f1ff7662619fc54ac2b3a4a4bb18ea61/pa/SG45396_9042ed66463912043b864b2b69febfe9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/ff/f1ff7662619fc54ac2b3a4a4bb18ea61/pa/SG45396_f25e6f45fc143b5241fb6d4abae1839e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f63e23b5-1882-5871-b246-011db2b0e393 with identifier: SR34905
2026-03-27 10:49:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 10:49:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=purple HTTP/1.1" 200 None
2026-03-27 10:49:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 10:49:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f63e23b5-1882-5871-b246-011db2b0e393 with identifier: SR34905
2026-03-27 10:49:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f63e23b5-1882-5871-b246-011db2b0e393 with identifier: SR34905 to the API
2026-03-27 10:49:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'purple',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:04:16Z',
 'fuel_type': 'diesel',
 'id': 'f63e23b5-1882-5871-b246-011db2b0e393',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR34905',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 263024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-08',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.7 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-27 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR34905%27 HTTP/1.1" 200 None
2026-03-27 10:49:21 [auto1.de] INFO: Saving data for SR34905: {'auction_closing_time': 1774713856.0, 'created_time': 1773306502.164623, 'last_price_update_time': 1774608561.975271}
2026-03-27 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR34905') HTTP/1.1" 204 0
2026-03-27 10:49:21 [auto1.de] INFO: Found listing with ID: BN62296
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN62296%27 HTTP/1.1" 200 None
2026-03-27 10:49:22 [auto1.de] INFO: Scrape type for BN62296: 1
2026-03-27 10:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001e0090>
2026-03-27 10:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b14690-fdc5-55ad-a2e2-b11dc317f145/65b14690-fdc5-55ad-a2e2-b11dc317f145_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fff%252Ff1ff7662619fc54ac2b3a4a4bb18ea61%252Fpa%252FSG45396_c9094750a6e29bdc60ca51383e5d2f05.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ff/f1ff7662619fc54ac2b3a4a4bb18ea61/pa/SG45396_c9094750a6e29bdc60ca51383e5d2f05.jpg saved to cache
2026-03-27 10:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65b14690-fdc5-55ad-a2e2-b11dc317f145
2026-03-27 10:49:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4 with identifier: TN35459
2026-03-27 10:49:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4 with scrape type 1
2026-03-27 10:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F63%252F0b6324e98c554f5bb4714061bb3eb813%252Fpa%252FTN35459_ae0c3e070dd9cdef23e6a53908ec1a79.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/63/0b6324e98c554f5bb4714061bb3eb813/pa/TN35459_ae0c3e070dd9cdef23e6a53908ec1a79.jpg not downloaded yet
2026-03-27 10:49:22 [auto1.de] INFO: Found listing with ID: PJ38214
2026-03-27 10:49:22 [auto1.de] INFO: Found listing with ID: AJ78717
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ78717%27 HTTP/1.1" 200 None
2026-03-27 10:49:22 [auto1.de] INFO: Scrape type for AJ78717: 2
2026-03-27 10:49:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b507cde-33b3-5619-ba75-c9ec008a6871 with identifier: AJ78717
2026-03-27 10:49:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b507cde-33b3-5619-ba75-c9ec008a6871 with scrape type 2
2026-03-27 10:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b507cde-33b3-5619-ba75-c9ec008a6871 with scrape type 2
2026-03-27 10:49:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b507cde-33b3-5619-ba75-c9ec008a6871, identifier: AJ78717
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F63%252F0b6324e98c554f5bb4714061bb3eb813%252Fpa%252FTN35459_c5432817af0e4efc657e30ed87322d1e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/63/0b6324e98c554f5bb4714061bb3eb813/pa/TN35459_c5432817af0e4efc657e30ed87322d1e.jpg not downloaded yet
2026-03-27 10:49:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b507cde-33b3-5619-ba75-c9ec008a6871 with identifier: AJ78717
2026-03-27 10:49:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b507cde-33b3-5619-ba75-c9ec008a6871 with identifier: AJ78717
2026-03-27 10:49:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b507cde-33b3-5619-ba75-c9ec008a6871 with identifier: AJ78717 to the API
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:39:10Z',
 'fuel_type': 'petrol',
 'id': '7b507cde-33b3-5619-ba75-c9ec008a6871',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ78717',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 214777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-17',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI ACT S line Sportpaket ultra',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket ultra',
 'year': 2016}
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ78717%27 HTTP/1.1" 200 None
2026-03-27 10:49:22 [auto1.de] INFO: Saving data for AJ78717: {'auction_closing_time': 1774715950.0, 'created_time': 1773831157.482878, 'last_price_update_time': 1774608562.685362}
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ78717') HTTP/1.1" 204 0
2026-03-27 10:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50032efd0>
2026-03-27 10:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b14690-fdc5-55ad-a2e2-b11dc317f145/65b14690-fdc5-55ad-a2e2-b11dc317f145_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fff%252Ff1ff7662619fc54ac2b3a4a4bb18ea61%252Fpa%252FSG45396_9042ed66463912043b864b2b69febfe9.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ff/f1ff7662619fc54ac2b3a4a4bb18ea61/pa/SG45396_9042ed66463912043b864b2b69febfe9.jpg saved to cache
2026-03-27 10:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65b14690-fdc5-55ad-a2e2-b11dc317f145
2026-03-27 10:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500397550>
2026-03-27 10:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b14690-fdc5-55ad-a2e2-b11dc317f145/65b14690-fdc5-55ad-a2e2-b11dc317f145_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fff%252Ff1ff7662619fc54ac2b3a4a4bb18ea61%252Fpa%252FSG45396_f25e6f45fc143b5241fb6d4abae1839e.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ff/f1ff7662619fc54ac2b3a4a4bb18ea61/pa/SG45396_f25e6f45fc143b5241fb6d4abae1839e.jpg saved to cache
2026-03-27 10:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65b14690-fdc5-55ad-a2e2-b11dc317f145
2026-03-27 10:49:22 [auto1.de] INFO: Found listing with ID: TA14554
2026-03-27 10:49:22 [auto1.de] INFO: Found listing with ID: GN45872
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN45872%27 HTTP/1.1" 200 None
2026-03-27 10:49:22 [auto1.de] INFO: Scrape type for GN45872: 2
2026-03-27 10:49:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19e056ce-3716-5bdb-8648-4146a7792edd with identifier: GN45872
2026-03-27 10:49:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19e056ce-3716-5bdb-8648-4146a7792edd with scrape type 2
2026-03-27 10:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19e056ce-3716-5bdb-8648-4146a7792edd with scrape type 2
2026-03-27 10:49:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19e056ce-3716-5bdb-8648-4146a7792edd, identifier: GN45872
2026-03-27 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F63%252F0b6324e98c554f5bb4714061bb3eb813%252Fpa%252FTN35459_70f67c06f5edde4bb2a40d716e2acdf8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/63/0b6324e98c554f5bb4714061bb3eb813/pa/TN35459_70f67c06f5edde4bb2a40d716e2acdf8.jpg not downloaded yet
2026-03-27 10:49:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19e056ce-3716-5bdb-8648-4146a7792edd with identifier: GN45872
2026-03-27 10:49:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19e056ce-3716-5bdb-8648-4146a7792edd with identifier: GN45872
2026-03-27 10:49:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19e056ce-3716-5bdb-8648-4146a7792edd with identifier: GN45872 to the API
2026-03-27 10:49:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:13:05Z',
 'fuel_type': 'petrol',
 'id': '19e056ce-3716-5bdb-8648-4146a7792edd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN45872',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 53136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-01',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-27 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN45872%27 HTTP/1.1" 200 None
2026-03-27 10:49:23 [auto1.de] INFO: Saving data for GN45872: {'auction_closing_time': 1774714385.0, 'created_time': 1774293983.015387, 'last_price_update_time': 1774608563.534179}
2026-03-27 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN45872') HTTP/1.1" 204 0
2026-03-27 10:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/ff/f1ff7662619fc54ac2b3a4a4bb18ea61/pa/SG45396_1cd7aeb66b155580a7c711ab97c74b4b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:23 [auto1.de] INFO: Found listing with ID: NS35673
2026-03-27 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS35673%27 HTTP/1.1" 200 None
2026-03-27 10:49:23 [auto1.de] INFO: Scrape type for NS35673: 2
2026-03-27 10:49:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9accb1a7-ed74-52ab-adc1-480dd60d15d2 with identifier: NS35673
2026-03-27 10:49:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9accb1a7-ed74-52ab-adc1-480dd60d15d2 with scrape type 2
2026-03-27 10:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9accb1a7-ed74-52ab-adc1-480dd60d15d2 with scrape type 2
2026-03-27 10:49:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9accb1a7-ed74-52ab-adc1-480dd60d15d2, identifier: NS35673
2026-03-27 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F63%252F0b6324e98c554f5bb4714061bb3eb813%252Fpa%252FTN35459_2581a006940bb4379bd4b8b1266751c6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/63/0b6324e98c554f5bb4714061bb3eb813/pa/TN35459_2581a006940bb4379bd4b8b1266751c6.jpg not downloaded yet
2026-03-27 10:49:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9accb1a7-ed74-52ab-adc1-480dd60d15d2 with identifier: NS35673
2026-03-27 10:49:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9accb1a7-ed74-52ab-adc1-480dd60d15d2 with identifier: NS35673
2026-03-27 10:49:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9accb1a7-ed74-52ab-adc1-480dd60d15d2 with identifier: NS35673 to the API
2026-03-27 10:49:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:26:57Z',
 'fuel_type': 'diesel',
 'id': '9accb1a7-ed74-52ab-adc1-480dd60d15d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS35673',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 244766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-04',
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten lang',
 'transmission': 'manual',
 'trim': 'Kasten lang',
 'year': 2012}
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS35673%27 HTTP/1.1" 200 None
2026-03-27 10:49:24 [auto1.de] INFO: Saving data for NS35673: {'auction_closing_time': 1774715217.0, 'created_time': 1774350967.889293, 'last_price_update_time': 1774608564.070027}
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS35673') HTTP/1.1" 204 0
2026-03-27 10:49:24 [auto1.de] INFO: Found listing with ID: FW84065
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW84065%27 HTTP/1.1" 200 None
2026-03-27 10:49:24 [auto1.de] INFO: Scrape type for FW84065: 2
2026-03-27 10:49:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e003a27-8c1c-51cb-b27b-70faf71aabeb with identifier: FW84065
2026-03-27 10:49:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e003a27-8c1c-51cb-b27b-70faf71aabeb with scrape type 2
2026-03-27 10:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e003a27-8c1c-51cb-b27b-70faf71aabeb with scrape type 2
2026-03-27 10:49:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e003a27-8c1c-51cb-b27b-70faf71aabeb, identifier: FW84065
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F63%252F0b6324e98c554f5bb4714061bb3eb813%252Fpa%252FTN35459_a2259401537ff212e9eaba64b483e700.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/63/0b6324e98c554f5bb4714061bb3eb813/pa/TN35459_a2259401537ff212e9eaba64b483e700.jpg not downloaded yet
2026-03-27 10:49:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e003a27-8c1c-51cb-b27b-70faf71aabeb with identifier: FW84065
2026-03-27 10:49:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e003a27-8c1c-51cb-b27b-70faf71aabeb with identifier: FW84065
2026-03-27 10:49:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e003a27-8c1c-51cb-b27b-70faf71aabeb with identifier: FW84065 to the API
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:16:16Z',
 'fuel_type': 'diesel',
 'id': '4e003a27-8c1c-51cb-b27b-70faf71aabeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW84065',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C-Crosser',
 'odometer': 195626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-04',
 'seller_name': None,
 'title': 'Citroen C-Crosser 2.2 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2008}
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW84065%27 HTTP/1.1" 200 None
2026-03-27 10:49:24 [auto1.de] INFO: Saving data for FW84065: {'auction_closing_time': 1774714576.0, 'created_time': 1773946450.424906, 'last_price_update_time': 1774608564.602943}
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW84065') HTTP/1.1" 204 0
2026-03-27 10:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb502611c90>
2026-03-27 10:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b14690-fdc5-55ad-a2e2-b11dc317f145/65b14690-fdc5-55ad-a2e2-b11dc317f145_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fff%252Ff1ff7662619fc54ac2b3a4a4bb18ea61%252Fpa%252FSG45396_1cd7aeb66b155580a7c711ab97c74b4b.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ff/f1ff7662619fc54ac2b3a4a4bb18ea61/pa/SG45396_1cd7aeb66b155580a7c711ab97c74b4b.jpg saved to cache
2026-03-27 10:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65b14690-fdc5-55ad-a2e2-b11dc317f145
2026-03-27 10:49:24 [auto1.de] INFO: Found listing with ID: BP24575
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP24575%27 HTTP/1.1" 200 None
2026-03-27 10:49:24 [auto1.de] INFO: Scrape type for BP24575: 1
2026-03-27 10:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/63/0b6324e98c554f5bb4714061bb3eb813/pa/TN35459_70f67c06f5edde4bb2a40d716e2acdf8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:24 [auto1.de] INFO: Found listing with ID: JA25299
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA25299%27 HTTP/1.1" 200 None
2026-03-27 10:49:24 [auto1.de] INFO: Scrape type for JA25299: 2
2026-03-27 10:49:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7db8dd64-8d7e-5bc4-ab81-7a4f73128132 with identifier: JA25299
2026-03-27 10:49:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7db8dd64-8d7e-5bc4-ab81-7a4f73128132 with scrape type 2
2026-03-27 10:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7db8dd64-8d7e-5bc4-ab81-7a4f73128132 with scrape type 2
2026-03-27 10:49:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7db8dd64-8d7e-5bc4-ab81-7a4f73128132, identifier: JA25299
2026-03-27 10:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WF06816/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZY72717> (referer: https://www.auto1.com/v1/car-details-view/ZY72717/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ29661/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7db8dd64-8d7e-5bc4-ab81-7a4f73128132 with identifier: JA25299
2026-03-27 10:49:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7db8dd64-8d7e-5bc4-ab81-7a4f73128132 with identifier: JA25299
2026-03-27 10:49:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7db8dd64-8d7e-5bc4-ab81-7a4f73128132 with identifier: JA25299 to the API
2026-03-27 10:49:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:57:18Z',
 'fuel_type': 'petrol',
 'id': '7db8dd64-8d7e-5bc4-ab81-7a4f73128132',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA25299',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 36660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-06',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2021}
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA25299%27 HTTP/1.1" 200 None
2026-03-27 10:49:25 [auto1.de] INFO: Saving data for JA25299: {'auction_closing_time': 1774717038.0, 'created_time': 1773383012.053168, 'last_price_update_time': 1774608565.198765}
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA25299') HTTP/1.1" 204 0
2026-03-27 10:49:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:25 [auto1.de] INFO: Found listing with ID: HV14674
2026-03-27 10:49:25 [auto1.de] INFO: Found listing with ID: VH71903
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH71903%27 HTTP/1.1" 200 None
2026-03-27 10:49:25 [auto1.de] INFO: Scrape type for VH71903: 2
2026-03-27 10:49:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4be3bbd5-ae53-5068-86f9-87028fff9951 with identifier: VH71903
2026-03-27 10:49:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4be3bbd5-ae53-5068-86f9-87028fff9951 with scrape type 2
2026-03-27 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4be3bbd5-ae53-5068-86f9-87028fff9951 with scrape type 2
2026-03-27 10:49:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4be3bbd5-ae53-5068-86f9-87028fff9951, identifier: VH71903
2026-03-27 10:49:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4be3bbd5-ae53-5068-86f9-87028fff9951 with identifier: VH71903
2026-03-27 10:49:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4be3bbd5-ae53-5068-86f9-87028fff9951 with identifier: VH71903
2026-03-27 10:49:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4be3bbd5-ae53-5068-86f9-87028fff9951 with identifier: VH71903 to the API
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:04:48Z',
 'fuel_type': 'diesel',
 'id': '4be3bbd5-ae53-5068-86f9-87028fff9951',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH71903',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 197821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-16',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH71903%27 HTTP/1.1" 200 None
2026-03-27 10:49:25 [auto1.de] INFO: Saving data for VH71903: {'auction_closing_time': 1774713888.0, 'created_time': 1773306884.353655, 'last_price_update_time': 1774608565.723071}
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH71903') HTTP/1.1" 204 0
2026-03-27 10:49:25 [auto1.de] INFO: Found listing with ID: ZD28576
2026-03-27 10:49:25 [auto1.de] INFO: Found listing with ID: GD02806
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD02806%27 HTTP/1.1" 200 None
2026-03-27 10:49:25 [auto1.de] INFO: Scrape type for GD02806: 2
2026-03-27 10:49:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9e24433-cdb7-5712-89ca-b4f94b858d9c with identifier: GD02806
2026-03-27 10:49:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9e24433-cdb7-5712-89ca-b4f94b858d9c with scrape type 2
2026-03-27 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9e24433-cdb7-5712-89ca-b4f94b858d9c with scrape type 2
2026-03-27 10:49:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9e24433-cdb7-5712-89ca-b4f94b858d9c, identifier: GD02806
2026-03-27 10:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500225450>
2026-03-27 10:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4/80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F63%252F0b6324e98c554f5bb4714061bb3eb813%252Fpa%252FTN35459_70f67c06f5edde4bb2a40d716e2acdf8.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/63/0b6324e98c554f5bb4714061bb3eb813/pa/TN35459_70f67c06f5edde4bb2a40d716e2acdf8.jpg saved to cache
2026-03-27 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4
2026-03-27 10:49:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9 with identifier: ZY72717
2026-03-27 10:49:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9 with scrape type 1
2026-03-27 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fb2%252Fabb281e5c0a12889cdeb6f859891c7e8%252Fpa%252FZY72717_39cb3fd70a931fd26d9a8354713f081e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b2/abb281e5c0a12889cdeb6f859891c7e8/pa/ZY72717_39cb3fd70a931fd26d9a8354713f081e.jpg already downloaded
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fb2%252Fabb281e5c0a12889cdeb6f859891c7e8%252Fpa%252FZY72717_e064f66f3105dc254e41a85873e4ec79.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b2/abb281e5c0a12889cdeb6f859891c7e8/pa/ZY72717_e064f66f3105dc254e41a85873e4ec79.jpg already downloaded
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fb2%252Fabb281e5c0a12889cdeb6f859891c7e8%252Fpa%252FZY72717_935ba5adb391836b51f54bab9fd7e9ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b2/abb281e5c0a12889cdeb6f859891c7e8/pa/ZY72717_935ba5adb391836b51f54bab9fd7e9ca.jpg already downloaded
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fb2%252Fabb281e5c0a12889cdeb6f859891c7e8%252Fpa%252FZY72717_1f65a04cd6e486250037a3e291f840e9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b2/abb281e5c0a12889cdeb6f859891c7e8/pa/ZY72717_1f65a04cd6e486250037a3e291f840e9.jpg already downloaded
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fb2%252Fabb281e5c0a12889cdeb6f859891c7e8%252Fpa%252FZY72717_5661a7466f41b68a98e3bf882129fd4e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b2/abb281e5c0a12889cdeb6f859891c7e8/pa/ZY72717_5661a7466f41b68a98e3bf882129fd4e.jpg already downloaded
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fb2%252Fabb281e5c0a12889cdeb6f859891c7e8%252Fpa%252FZY72717_fcb942430e3d50420544338afd898df0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b2/abb281e5c0a12889cdeb6f859891c7e8/pa/ZY72717_fcb942430e3d50420544338afd898df0.jpg already downloaded
2026-03-27 10:49:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9, identifier: ZY72717
2026-03-27 10:49:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9e24433-cdb7-5712-89ca-b4f94b858d9c with identifier: GD02806
2026-03-27 10:49:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9e24433-cdb7-5712-89ca-b4f94b858d9c with identifier: GD02806
2026-03-27 10:49:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9e24433-cdb7-5712-89ca-b4f94b858d9c with identifier: GD02806 to the API
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:15:33Z',
 'fuel_type': 'petrol',
 'id': 'c9e24433-cdb7-5712-89ca-b4f94b858d9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD02806',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 216912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-04',
 'seller_name': None,
 'title': 'Kia Rio 1.6 EX Top',
 'transmission': 'automatic',
 'trim': 'EX Top',
 'year': 2006}
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD02806%27 HTTP/1.1" 200 None
2026-03-27 10:49:26 [auto1.de] INFO: Saving data for GD02806: {'auction_closing_time': 1774714533.0, 'created_time': 1773307109.445441, 'last_price_update_time': 1774608566.538059}
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD02806') HTTP/1.1" 204 0
2026-03-27 10:49:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9 with identifier: ZY72717
2026-03-27 10:49:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9 with identifier: ZY72717
2026-03-27 10:49:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9 with identifier: ZY72717 to the API
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZY72717>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 83,
 'expiration_date': '2026-03-28T16:59:11Z',
 'fuel_type': 'petrol',
 'id': '7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY72717',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 126249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgab/b2/abb281e5c0a12889cdeb6f859891c7e8/pa/ZY72717_39cb3fd70a931fd26d9a8354713f081e.jpg',
                'https://img-pa.auto1.com/imgab/b2/abb281e5c0a12889cdeb6f859891c7e8/pa/ZY72717_e064f66f3105dc254e41a85873e4ec79.jpg',
                'https://img-pa.auto1.com/imgab/b2/abb281e5c0a12889cdeb6f859891c7e8/pa/ZY72717_935ba5adb391836b51f54bab9fd7e9ca.jpg',
                'https://img-pa.auto1.com/imgab/b2/abb281e5c0a12889cdeb6f859891c7e8/pa/ZY72717_1f65a04cd6e486250037a3e291f840e9.jpg',
                'https://img-pa.auto1.com/imgab/b2/abb281e5c0a12889cdeb6f859891c7e8/pa/ZY72717_5661a7466f41b68a98e3bf882129fd4e.jpg',
                'https://img-pa.auto1.com/imgab/b2/abb281e5c0a12889cdeb6f859891c7e8/pa/ZY72717_fcb942430e3d50420544338afd898df0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9/7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/b2/abb281e5c0a12889cdeb6f859891c7e8/pa/ZY72717_39cb3fd70a931fd26d9a8354713f081e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9/7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/b2/abb281e5c0a12889cdeb6f859891c7e8/pa/ZY72717_e064f66f3105dc254e41a85873e4ec79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9/7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/b2/abb281e5c0a12889cdeb6f859891c7e8/pa/ZY72717_935ba5adb391836b51f54bab9fd7e9ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9/7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/b2/abb281e5c0a12889cdeb6f859891c7e8/pa/ZY72717_1f65a04cd6e486250037a3e291f840e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9/7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/b2/abb281e5c0a12889cdeb6f859891c7e8/pa/ZY72717_5661a7466f41b68a98e3bf882129fd4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9/7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/b2/abb281e5c0a12889cdeb6f859891c7e8/pa/ZY72717_fcb942430e3d50420544338afd898df0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Lodgy 1.6 Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2013}
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY72717%27 HTTP/1.1" 200 None
2026-03-27 10:49:26 [auto1.de] INFO: Saving data for ZY72717: {'created_time': 1774608566.910485, 'last_price_update_time': 1774608566.910498, 'auction_closing_time': 1774717151.0}
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY72717') HTTP/1.1" 204 0
2026-03-27 10:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/63/0b6324e98c554f5bb4714061bb3eb813/pa/TN35459_a2259401537ff212e9eaba64b483e700.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/63/0b6324e98c554f5bb4714061bb3eb813/pa/TN35459_2581a006940bb4379bd4b8b1266751c6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/63/0b6324e98c554f5bb4714061bb3eb813/pa/TN35459_c5432817af0e4efc657e30ed87322d1e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:26 [auto1.de] INFO: Found listing with ID: GB27977
2026-03-27 10:49:26 [auto1.de] INFO: Found listing with ID: GH74073
2026-03-27 10:49:26 [auto1.de] INFO: Found listing with ID: SL27608
2026-03-27 10:49:26 [auto1.de] INFO: Found listing with ID: DN13458
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN13458%27 HTTP/1.1" 200 None
2026-03-27 10:49:26 [auto1.de] INFO: Scrape type for DN13458: 1
2026-03-27 10:49:26 [auto1.de] INFO: Found listing with ID: YV03143
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV03143%27 HTTP/1.1" 200 None
2026-03-27 10:49:26 [auto1.de] INFO: Scrape type for YV03143: 2
2026-03-27 10:49:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95497ab5-d796-5a75-b63c-adc9989dba64 with identifier: YV03143
2026-03-27 10:49:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95497ab5-d796-5a75-b63c-adc9989dba64 with scrape type 2
2026-03-27 10:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95497ab5-d796-5a75-b63c-adc9989dba64 with scrape type 2
2026-03-27 10:49:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95497ab5-d796-5a75-b63c-adc9989dba64, identifier: YV03143
2026-03-27 10:49:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95497ab5-d796-5a75-b63c-adc9989dba64 with identifier: YV03143
2026-03-27 10:49:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95497ab5-d796-5a75-b63c-adc9989dba64 with identifier: YV03143
2026-03-27 10:49:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95497ab5-d796-5a75-b63c-adc9989dba64 with identifier: YV03143 to the API
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 330,
 'expiration_date': '2026-03-28T16:51:28Z',
 'fuel_type': 'diesel',
 'id': '95497ab5-d796-5a75-b63c-adc9989dba64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV03143',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 81188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-23',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 400 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV03143%27 HTTP/1.1" 200 None
2026-03-27 10:49:27 [auto1.de] INFO: Saving data for YV03143: {'auction_closing_time': 1774716688.0, 'created_time': 1773302118.407971, 'last_price_update_time': 1774608567.482385}
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV03143') HTTP/1.1" 204 0
2026-03-27 10:49:27 [auto1.de] INFO: Found listing with ID: GY83216
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY83216%27 HTTP/1.1" 200 None
2026-03-27 10:49:27 [auto1.de] INFO: Scrape type for GY83216: 1
2026-03-27 10:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500374510>
2026-03-27 10:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4/80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F63%252F0b6324e98c554f5bb4714061bb3eb813%252Fpa%252FTN35459_a2259401537ff212e9eaba64b483e700.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/63/0b6324e98c554f5bb4714061bb3eb813/pa/TN35459_a2259401537ff212e9eaba64b483e700.jpg saved to cache
2026-03-27 10:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4
2026-03-27 10:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500323510>
2026-03-27 10:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4/80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F63%252F0b6324e98c554f5bb4714061bb3eb813%252Fpa%252FTN35459_2581a006940bb4379bd4b8b1266751c6.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/63/0b6324e98c554f5bb4714061bb3eb813/pa/TN35459_2581a006940bb4379bd4b8b1266751c6.jpg saved to cache
2026-03-27 10:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4
2026-03-27 10:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002fc350>
2026-03-27 10:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4/80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F63%252F0b6324e98c554f5bb4714061bb3eb813%252Fpa%252FTN35459_c5432817af0e4efc657e30ed87322d1e.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/63/0b6324e98c554f5bb4714061bb3eb813/pa/TN35459_c5432817af0e4efc657e30ed87322d1e.jpg saved to cache
2026-03-27 10:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4
2026-03-27 10:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/63/0b6324e98c554f5bb4714061bb3eb813/pa/TN35459_ae0c3e070dd9cdef23e6a53908ec1a79.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:27 [auto1.de] INFO: Found listing with ID: UR56671
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR56671%27 HTTP/1.1" 200 None
2026-03-27 10:49:27 [auto1.de] INFO: Scrape type for UR56671: 1
2026-03-27 10:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_acdbac2fec4534350136927b462d7e3a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:27 [auto1.de] INFO: Found listing with ID: DB09023
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09023%27 HTTP/1.1" 200 None
2026-03-27 10:49:27 [auto1.de] INFO: Scrape type for DB09023: 1
2026-03-27 10:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_c5fe35d3632636733b26bd43039ff9c5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:27 [auto1.de] INFO: Found listing with ID: GA20411
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA20411%27 HTTP/1.1" 200 None
2026-03-27 10:49:27 [auto1.de] INFO: Scrape type for GA20411: 2
2026-03-27 10:49:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46284532-db18-5b34-8a18-4bdf04d8994b with identifier: GA20411
2026-03-27 10:49:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46284532-db18-5b34-8a18-4bdf04d8994b with scrape type 2
2026-03-27 10:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46284532-db18-5b34-8a18-4bdf04d8994b with scrape type 2
2026-03-27 10:49:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46284532-db18-5b34-8a18-4bdf04d8994b, identifier: GA20411
2026-03-27 10:49:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46284532-db18-5b34-8a18-4bdf04d8994b with identifier: GA20411
2026-03-27 10:49:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46284532-db18-5b34-8a18-4bdf04d8994b with identifier: GA20411
2026-03-27 10:49:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46284532-db18-5b34-8a18-4bdf04d8994b with identifier: GA20411 to the API
2026-03-27 10:49:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:18:23Z',
 'fuel_type': 'diesel',
 'id': '46284532-db18-5b34-8a18-4bdf04d8994b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA20411',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 120718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-01',
 'seller_name': None,
 'title': 'Jaguar XF 30d S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2018}
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA20411%27 HTTP/1.1" 200 None
2026-03-27 10:49:28 [auto1.de] INFO: Saving data for GA20411: {'auction_closing_time': 1774714703.0, 'created_time': 1773344437.804729, 'last_price_update_time': 1774608568.251346}
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA20411') HTTP/1.1" 204 0
2026-03-27 10:49:28 [auto1.de] INFO: Found listing with ID: VU07666
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU07666%27 HTTP/1.1" 200 None
2026-03-27 10:49:28 [auto1.de] INFO: Scrape type for VU07666: 2
2026-03-27 10:49:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3827f639-5d5e-5139-b41b-3c23f81f2347 with identifier: VU07666
2026-03-27 10:49:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3827f639-5d5e-5139-b41b-3c23f81f2347 with scrape type 2
2026-03-27 10:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3827f639-5d5e-5139-b41b-3c23f81f2347 with scrape type 2
2026-03-27 10:49:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3827f639-5d5e-5139-b41b-3c23f81f2347, identifier: VU07666
2026-03-27 10:49:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3827f639-5d5e-5139-b41b-3c23f81f2347 with identifier: VU07666
2026-03-27 10:49:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3827f639-5d5e-5139-b41b-3c23f81f2347 with identifier: VU07666
2026-03-27 10:49:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3827f639-5d5e-5139-b41b-3c23f81f2347 with identifier: VU07666 to the API
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-28T16:23:47Z',
 'fuel_type': 'petrol',
 'id': '3827f639-5d5e-5139-b41b-3c23f81f2347',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU07666',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 24791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Stepway Comfort',
 'transmission': 'automatic',
 'trim': 'Stepway Comfort',
 'year': 2021}
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU07666%27 HTTP/1.1" 200 None
2026-03-27 10:49:28 [auto1.de] INFO: Saving data for VU07666: {'auction_closing_time': 1774715027.0, 'created_time': 1773946057.757767, 'last_price_update_time': 1774608568.706444}
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU07666') HTTP/1.1" 204 0
2026-03-27 10:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_afaf590de2dcdc5e48c3237703127185.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:28 [auto1.de] INFO: Found listing with ID: VX14305
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14305%27 HTTP/1.1" 200 None
2026-03-27 10:49:28 [auto1.de] INFO: Scrape type for VX14305: 2
2026-03-27 10:49:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f39087bf-9e2e-5b16-809a-b3173873d7fe with identifier: VX14305
2026-03-27 10:49:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f39087bf-9e2e-5b16-809a-b3173873d7fe with scrape type 2
2026-03-27 10:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f39087bf-9e2e-5b16-809a-b3173873d7fe with scrape type 2
2026-03-27 10:49:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f39087bf-9e2e-5b16-809a-b3173873d7fe, identifier: VX14305
2026-03-27 10:49:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f39087bf-9e2e-5b16-809a-b3173873d7fe with identifier: VX14305
2026-03-27 10:49:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f39087bf-9e2e-5b16-809a-b3173873d7fe with identifier: VX14305
2026-03-27 10:49:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f39087bf-9e2e-5b16-809a-b3173873d7fe with identifier: VX14305 to the API
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:36:15Z',
 'fuel_type': 'petrol',
 'id': 'f39087bf-9e2e-5b16-809a-b3173873d7fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX14305',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 80422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-19',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2023}
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14305%27 HTTP/1.1" 200 None
2026-03-27 10:49:29 [auto1.de] INFO: Saving data for VX14305: {'auction_closing_time': 1774715775.0, 'created_time': 1773381502.143565, 'last_price_update_time': 1774608569.26887}
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX14305') HTTP/1.1" 204 0
2026-03-27 10:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002244d0>
2026-03-27 10:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4/80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F63%252F0b6324e98c554f5bb4714061bb3eb813%252Fpa%252FTN35459_ae0c3e070dd9cdef23e6a53908ec1a79.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/63/0b6324e98c554f5bb4714061bb3eb813/pa/TN35459_ae0c3e070dd9cdef23e6a53908ec1a79.jpg saved to cache
2026-03-27 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4
2026-03-27 10:49:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4, skipping ID generation
2026-03-27 10:49:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4 with scrape type 1
2026-03-27 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4 sending to next pipeline
2026-03-27 10:49:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4, identifier: TN35459
2026-03-27 10:49:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500363490>
2026-03-27 10:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9926c6-1a01-552a-83db-73be151299c7/1a9926c6-1a01-552a-83db-73be151299c7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fae%252Ff7ae2783ab342603e2b9ab3aba3d7ef1%252Fpa%252FAH76263_acdbac2fec4534350136927b462d7e3a.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_acdbac2fec4534350136927b462d7e3a.jpg saved to cache
2026-03-27 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a9926c6-1a01-552a-83db-73be151299c7
2026-03-27 10:49:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50371c250>
2026-03-27 10:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9926c6-1a01-552a-83db-73be151299c7/1a9926c6-1a01-552a-83db-73be151299c7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fae%252Ff7ae2783ab342603e2b9ab3aba3d7ef1%252Fpa%252FAH76263_c5fe35d3632636733b26bd43039ff9c5.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_c5fe35d3632636733b26bd43039ff9c5.jpg saved to cache
2026-03-27 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a9926c6-1a01-552a-83db-73be151299c7
2026-03-27 10:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_a94727583223d63d4720944a92673d14.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:29 [auto1.de] INFO: Found listing with ID: YU21879
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU21879%27 HTTP/1.1" 200 None
2026-03-27 10:49:29 [auto1.de] INFO: Scrape type for YU21879: 2
2026-03-27 10:49:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c849ee50-57bc-5110-9c4a-d1eb0e5ade48 with identifier: YU21879
2026-03-27 10:49:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c849ee50-57bc-5110-9c4a-d1eb0e5ade48 with scrape type 2
2026-03-27 10:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c849ee50-57bc-5110-9c4a-d1eb0e5ade48 with scrape type 2
2026-03-27 10:49:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c849ee50-57bc-5110-9c4a-d1eb0e5ade48, identifier: YU21879
2026-03-27 10:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DV32986> (referer: https://www.auto1.com/v1/car-details-view/DV32986/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4 with identifier: TN35459
2026-03-27 10:49:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4 with identifier: TN35459
2026-03-27 10:49:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4 with identifier: TN35459 to the API
2026-03-27 10:49:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/63/0b6324e98c554f5bb4714061bb3eb813/pa/TN35459_ae0c3e070dd9cdef23e6a53908ec1a79.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.6L',
 'engine_horse_power': 98,
 'expiration_date': '2026-03-28T16:28:54Z',
 'fuel_type': 'petrol',
 'id': '80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN35459',
 'listing': 'auction',
 'location': 'DE, Bruchsal',
 'make': 'Mazda',
 'model': '323',
 'odometer': 80891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4/80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/63/0b6324e98c554f5bb4714061bb3eb813/pa/TN35459_ae0c3e070dd9cdef23e6a53908ec1a79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4/80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/63/0b6324e98c554f5bb4714061bb3eb813/pa/TN35459_c5432817af0e4efc657e30ed87322d1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4/80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/63/0b6324e98c554f5bb4714061bb3eb813/pa/TN35459_70f67c06f5edde4bb2a40d716e2acdf8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4/80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/63/0b6324e98c554f5bb4714061bb3eb813/pa/TN35459_2581a006940bb4379bd4b8b1266751c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4/80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/63/0b6324e98c554f5bb4714061bb3eb813/pa/TN35459_a2259401537ff212e9eaba64b483e700.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2001-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 323 1.6 F Exclusive',
 'transmission': 'manual',
 'trim': 'F Exclusive',
 'year': 2001}
2026-03-27 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN35459%27 HTTP/1.1" 200 None
2026-03-27 10:49:30 [auto1.de] INFO: Saving data for TN35459: {'created_time': 1774608570.271162, 'last_price_update_time': 1774608570.271173, 'auction_closing_time': 1774715334.0}
2026-03-27 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN35459') HTTP/1.1" 204 0
2026-03-27 10:49:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c849ee50-57bc-5110-9c4a-d1eb0e5ade48 with identifier: YU21879
2026-03-27 10:49:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c849ee50-57bc-5110-9c4a-d1eb0e5ade48 with identifier: YU21879
2026-03-27 10:49:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c849ee50-57bc-5110-9c4a-d1eb0e5ade48 with identifier: YU21879 to the API
2026-03-27 10:49:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:10:35Z',
 'fuel_type': 'diesel',
 'id': 'c849ee50-57bc-5110-9c4a-d1eb0e5ade48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU21879',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 272863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2011}
2026-03-27 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU21879%27 HTTP/1.1" 200 None
2026-03-27 10:49:30 [auto1.de] INFO: Saving data for YU21879: {'auction_closing_time': 1774714235.0, 'created_time': 1773230155.984021, 'last_price_update_time': 1774608570.666903}
2026-03-27 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU21879') HTTP/1.1" 204 0
2026-03-27 10:49:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501894690>
2026-03-27 10:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9926c6-1a01-552a-83db-73be151299c7/1a9926c6-1a01-552a-83db-73be151299c7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fae%252Ff7ae2783ab342603e2b9ab3aba3d7ef1%252Fpa%252FAH76263_afaf590de2dcdc5e48c3237703127185.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_afaf590de2dcdc5e48c3237703127185.jpg saved to cache
2026-03-27 10:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a9926c6-1a01-552a-83db-73be151299c7
2026-03-27 10:49:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a9926c6-1a01-552a-83db-73be151299c7, skipping ID generation
2026-03-27 10:49:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a9926c6-1a01-552a-83db-73be151299c7 with scrape type 1
2026-03-27 10:49:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a9926c6-1a01-552a-83db-73be151299c7 sending to next pipeline
2026-03-27 10:49:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a9926c6-1a01-552a-83db-73be151299c7, identifier: AH76263
2026-03-27 10:49:30 [auto1.de] INFO: Found listing with ID: BP39068
2026-03-27 10:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39068%27 HTTP/1.1" 200 None
2026-03-27 10:49:31 [auto1.de] INFO: Scrape type for BP39068: 1
2026-03-27 10:49:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a9926c6-1a01-552a-83db-73be151299c7 with identifier: AH76263
2026-03-27 10:49:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a9926c6-1a01-552a-83db-73be151299c7 with identifier: AH76263
2026-03-27 10:49:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a9926c6-1a01-552a-83db-73be151299c7 with identifier: AH76263 to the API
2026-03-27 10:49:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_afaf590de2dcdc5e48c3237703127185.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:02:09Z',
 'fuel_type': 'petrol',
 'id': '1a9926c6-1a01-552a-83db-73be151299c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH76263',
 'listing': 'auction',
 'location': 'DE, Freiburg im Breisgau',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 41610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9926c6-1a01-552a-83db-73be151299c7/1a9926c6-1a01-552a-83db-73be151299c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_f6f1ebb09f010461b0a208c2ef6663f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9926c6-1a01-552a-83db-73be151299c7/1a9926c6-1a01-552a-83db-73be151299c7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3010811,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_c5fe35d3632636733b26bd43039ff9c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9926c6-1a01-552a-83db-73be151299c7/1a9926c6-1a01-552a-83db-73be151299c7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3140726,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_afaf590de2dcdc5e48c3237703127185.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9926c6-1a01-552a-83db-73be151299c7/1a9926c6-1a01-552a-83db-73be151299c7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3040204,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_acdbac2fec4534350136927b462d7e3a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9926c6-1a01-552a-83db-73be151299c7/1a9926c6-1a01-552a-83db-73be151299c7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3130681,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_9221e66b4466e3cfbb7cbb207f76e164.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9926c6-1a01-552a-83db-73be151299c7/1a9926c6-1a01-552a-83db-73be151299c7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_6d0234d3ae9451bd92ce7b421a956223.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9926c6-1a01-552a-83db-73be151299c7/1a9926c6-1a01-552a-83db-73be151299c7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_30fac7ffab2af352dea15476200713ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9926c6-1a01-552a-83db-73be151299c7/1a9926c6-1a01-552a-83db-73be151299c7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2992940,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_f77fac26b296ecc9de371b78a75930be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9926c6-1a01-552a-83db-73be151299c7/1a9926c6-1a01-552a-83db-73be151299c7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_9ba9b434fa97a607486a167ea761a134.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9926c6-1a01-552a-83db-73be151299c7/1a9926c6-1a01-552a-83db-73be151299c7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3138139,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ae/f7ae2783ab342603e2b9ab3aba3d7ef1/pa/AH76263_d4da2bac90a90a87880b988b3562243e.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TFSI ACT S line',
 'transmission': 'manual',
 'trim': 'ACT S line',
 'year': 2022}
2026-03-27 10:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH76263%27 HTTP/1.1" 200 None
2026-03-27 10:49:31 [auto1.de] INFO: Saving data for AH76263: {'created_time': 1774608571.800093, 'last_price_update_time': 1774608571.800103, 'auction_closing_time': 1774713729.0}
2026-03-27 10:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH76263') HTTP/1.1" 204 0
2026-03-27 10:49:31 [auto1.de] INFO: Found listing with ID: SK60410
2026-03-27 10:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK60410%27 HTTP/1.1" 200 None
2026-03-27 10:49:31 [auto1.de] INFO: Scrape type for SK60410: 1
2026-03-27 10:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NV35825/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ27200> (referer: https://www.auto1.com/v1/car-details-view/JZ27200/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50045e490>
2026-03-27 10:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eca5aac-39b2-5b93-af6a-b38550816051/2eca5aac-39b2-5b93-af6a-b38550816051_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F08%252Fb1085347a0f1c643ecd13a66ebe3aa24%252Fpa%252FZZ67378_a94727583223d63d4720944a92673d14.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_a94727583223d63d4720944a92673d14.jpg saved to cache
2026-03-27 10:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2eca5aac-39b2-5b93-af6a-b38550816051
2026-03-27 10:49:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3d50fd0-7194-5dd9-a7a5-09d00fa6f944 with identifier: DV32986
2026-03-27 10:49:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3d50fd0-7194-5dd9-a7a5-09d00fa6f944 with scrape type 1
2026-03-27 10:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c3d50fd0-7194-5dd9-a7a5-09d00fa6f944
2026-03-27 10:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F4c%252Fa94c1675c974d61420cc1802f0fbc1d1%252Fpa%252FDV32986_8be64669bfa874b0d6233eb5ae1d25b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_8be64669bfa874b0d6233eb5ae1d25b2.jpg not downloaded yet
2026-03-27 10:49:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F4c%252Fa94c1675c974d61420cc1802f0fbc1d1%252Fpa%252FDV32986_d434deba01996b936918a3a85a942ba7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_d434deba01996b936918a3a85a942ba7.jpg not downloaded yet
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F4c%252Fa94c1675c974d61420cc1802f0fbc1d1%252Fpa%252FDV32986_0bd43e585a6e07bdf64e3ab3ce19aa5b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_0bd43e585a6e07bdf64e3ab3ce19aa5b.jpg not downloaded yet
2026-03-27 10:49:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae with identifier: JZ27200
2026-03-27 10:49:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae with scrape type 1
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F97%252Fa097c047b21e7027399863d67a3ca03f%252Fpa%252FJZ27200_8eabc13ba42c796a69cfe6b96fb2cff7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_8eabc13ba42c796a69cfe6b96fb2cff7.jpg not downloaded yet
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F4c%252Fa94c1675c974d61420cc1802f0fbc1d1%252Fpa%252FDV32986_409645a7f09266796c4bd624efca6af7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_409645a7f09266796c4bd624efca6af7.jpg not downloaded yet
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F97%252Fa097c047b21e7027399863d67a3ca03f%252Fpa%252FJZ27200_cb9ff04022bc1eb33792169522567105.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_cb9ff04022bc1eb33792169522567105.jpg not downloaded yet
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F4c%252Fa94c1675c974d61420cc1802f0fbc1d1%252Fpa%252FDV32986_83d0e6ce161690f1c246b0fc30a7433b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_83d0e6ce161690f1c246b0fc30a7433b.jpg not downloaded yet
2026-03-27 10:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_8be64669bfa874b0d6233eb5ae1d25b2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F97%252Fa097c047b21e7027399863d67a3ca03f%252Fpa%252FJZ27200_6b7d6d68745cb82530677e2d980599aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_6b7d6d68745cb82530677e2d980599aa.jpg not downloaded yet
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F4c%252Fa94c1675c974d61420cc1802f0fbc1d1%252Fpa%252FDV32986_63e0d66470b29e7071aa2de511b623f4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_63e0d66470b29e7071aa2de511b623f4.jpg not downloaded yet
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F97%252Fa097c047b21e7027399863d67a3ca03f%252Fpa%252FJZ27200_38b3d4f1299c7673b1c026cf9fc8d33b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_38b3d4f1299c7673b1c026cf9fc8d33b.jpg not downloaded yet
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F97%252Fa097c047b21e7027399863d67a3ca03f%252Fpa%252FJZ27200_13a214da8704c81a7b973286d7ce26c9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_13a214da8704c81a7b973286d7ce26c9.jpg not downloaded yet
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F97%252Fa097c047b21e7027399863d67a3ca03f%252Fpa%252FJZ27200_2bcb506b0eec082406194126f3536d1f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_2bcb506b0eec082406194126f3536d1f.jpg not downloaded yet
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F97%252Fa097c047b21e7027399863d67a3ca03f%252Fpa%252FJZ27200_9a6a1e35b35ddc815a1ac118293d547c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_9a6a1e35b35ddc815a1ac118293d547c.jpg not downloaded yet
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F97%252Fa097c047b21e7027399863d67a3ca03f%252Fpa%252FJZ27200_e34aa4d64ea0c2ae7b95971ec2885e43.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_e34aa4d64ea0c2ae7b95971ec2885e43.jpg not downloaded yet
2026-03-27 10:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001e33d0>
2026-03-27 10:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d50fd0-7194-5dd9-a7a5-09d00fa6f944/c3d50fd0-7194-5dd9-a7a5-09d00fa6f944_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F4c%252Fa94c1675c974d61420cc1802f0fbc1d1%252Fpa%252FDV32986_8be64669bfa874b0d6233eb5ae1d25b2.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_8be64669bfa874b0d6233eb5ae1d25b2.jpg saved to cache
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3d50fd0-7194-5dd9-a7a5-09d00fa6f944
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F97%252Fa097c047b21e7027399863d67a3ca03f%252Fpa%252FJZ27200_71ca7dc561267ccba37f54b15103149f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_71ca7dc561267ccba37f54b15103149f.jpg not downloaded yet
2026-03-27 10:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_cb9ff04022bc1eb33792169522567105.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F97%252Fa097c047b21e7027399863d67a3ca03f%252Fpa%252FJZ27200_fd0b4c233ce7d8dc7b1c9f1e491eef02.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_fd0b4c233ce7d8dc7b1c9f1e491eef02.jpg not downloaded yet
2026-03-27 10:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5025e70d0>
2026-03-27 10:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae/8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F97%252Fa097c047b21e7027399863d67a3ca03f%252Fpa%252FJZ27200_cb9ff04022bc1eb33792169522567105.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_cb9ff04022bc1eb33792169522567105.jpg saved to cache
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae
2026-03-27 10:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TB14981/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_e34aa4d64ea0c2ae7b95971ec2885e43.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AN15165/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001d5f10>
2026-03-27 10:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae/8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F97%252Fa097c047b21e7027399863d67a3ca03f%252Fpa%252FJZ27200_e34aa4d64ea0c2ae7b95971ec2885e43.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_e34aa4d64ea0c2ae7b95971ec2885e43.jpg saved to cache
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae
2026-03-27 10:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MV46979> (referer: https://www.auto1.com/v1/car-details-view/MV46979/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA07752/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_fd0b4c233ce7d8dc7b1c9f1e491eef02.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP24575/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f9d0c6b-fb03-5824-9546-47daf1064832 with identifier: MV46979
2026-03-27 10:49:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f9d0c6b-fb03-5824-9546-47daf1064832 with scrape type 1
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8f9d0c6b-fb03-5824-9546-47daf1064832
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F7a%252Fa97ae314306b0a8f87d652796d1d5c5b%252Fpa%252FMV46979_b144da9c8e3b2889c3589405a9ad341f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/7a/a97ae314306b0a8f87d652796d1d5c5b/pa/MV46979_b144da9c8e3b2889c3589405a9ad341f.jpg not downloaded yet
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F7a%252Fa97ae314306b0a8f87d652796d1d5c5b%252Fpa%252FMV46979_36e6d20fa6c7fda98118355c8088a4ff.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/7a/a97ae314306b0a8f87d652796d1d5c5b/pa/MV46979_36e6d20fa6c7fda98118355c8088a4ff.jpg not downloaded yet
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F7a%252Fa97ae314306b0a8f87d652796d1d5c5b%252Fpa%252FMV46979_e2c0196d69eb25ef1c31fd1e27b66a94.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/7a/a97ae314306b0a8f87d652796d1d5c5b/pa/MV46979_e2c0196d69eb25ef1c31fd1e27b66a94.jpg not downloaded yet
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F7a%252Fa97ae314306b0a8f87d652796d1d5c5b%252Fpa%252FMV46979_c943f4c2ec646c0f9fe71e519c7e8e05.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/7a/a97ae314306b0a8f87d652796d1d5c5b/pa/MV46979_c943f4c2ec646c0f9fe71e519c7e8e05.jpg not downloaded yet
2026-03-27 10:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501949c50>
2026-03-27 10:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae/8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F97%252Fa097c047b21e7027399863d67a3ca03f%252Fpa%252FJZ27200_fd0b4c233ce7d8dc7b1c9f1e491eef02.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_fd0b4c233ce7d8dc7b1c9f1e491eef02.jpg saved to cache
2026-03-27 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F7a%252Fa97ae314306b0a8f87d652796d1d5c5b%252Fpa%252FMV46979_0663a9172cf442e0efcc1635832111d0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/7a/a97ae314306b0a8f87d652796d1d5c5b/pa/MV46979_0663a9172cf442e0efcc1635832111d0.jpg not downloaded yet
2026-03-27 10:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_71ca7dc561267ccba37f54b15103149f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ29661> (referer: https://www.auto1.com/v1/car-details-view/VJ29661/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_9a6a1e35b35ddc815a1ac118293d547c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_2bcb506b0eec082406194126f3536d1f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_13a214da8704c81a7b973286d7ce26c9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/7a/a97ae314306b0a8f87d652796d1d5c5b/pa/MV46979_0663a9172cf442e0efcc1635832111d0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/7a/a97ae314306b0a8f87d652796d1d5c5b/pa/MV46979_c943f4c2ec646c0f9fe71e519c7e8e05.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001dccd0>
2026-03-27 10:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae/8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F97%252Fa097c047b21e7027399863d67a3ca03f%252Fpa%252FJZ27200_71ca7dc561267ccba37f54b15103149f.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_71ca7dc561267ccba37f54b15103149f.jpg saved to cache
2026-03-27 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae
2026-03-27 10:49:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36dccb9f-bede-593e-a7e5-6d4749ac3052 with identifier: VJ29661
2026-03-27 10:49:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36dccb9f-bede-593e-a7e5-6d4749ac3052 with scrape type 1
2026-03-27 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 36dccb9f-bede-593e-a7e5-6d4749ac3052
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F8b%252Fb08b7931d55a7e59c3e002a46a3a73b8%252Fpa%252FVJ29661_106089ba00d564c2e1b7d5188b37bc68.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/8b/b08b7931d55a7e59c3e002a46a3a73b8/pa/VJ29661_106089ba00d564c2e1b7d5188b37bc68.jpg already downloaded
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F8b%252Fb08b7931d55a7e59c3e002a46a3a73b8%252Fpa%252FVJ29661_19f8705e4804455037b8d0735bb8c408.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/8b/b08b7931d55a7e59c3e002a46a3a73b8/pa/VJ29661_19f8705e4804455037b8d0735bb8c408.jpg already downloaded
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F8b%252Fb08b7931d55a7e59c3e002a46a3a73b8%252Fpa%252FVJ29661_41e16bf756d995de210fc2ccd09898f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/8b/b08b7931d55a7e59c3e002a46a3a73b8/pa/VJ29661_41e16bf756d995de210fc2ccd09898f8.jpg already downloaded
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F8b%252Fb08b7931d55a7e59c3e002a46a3a73b8%252Fpa%252FVJ29661_aec39ea1fc4b0212d5a5e84f5838c65d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/8b/b08b7931d55a7e59c3e002a46a3a73b8/pa/VJ29661_aec39ea1fc4b0212d5a5e84f5838c65d.jpg already downloaded
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F8b%252Fb08b7931d55a7e59c3e002a46a3a73b8%252Fpa%252FVJ29661_166d1ef60a19749baaf3033a8bb22a7c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/8b/b08b7931d55a7e59c3e002a46a3a73b8/pa/VJ29661_166d1ef60a19749baaf3033a8bb22a7c.jpg already downloaded
2026-03-27 10:49:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36dccb9f-bede-593e-a7e5-6d4749ac3052, identifier: VJ29661
2026-03-27 10:49:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018ac610>
2026-03-27 10:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae/8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F97%252Fa097c047b21e7027399863d67a3ca03f%252Fpa%252FJZ27200_9a6a1e35b35ddc815a1ac118293d547c.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_9a6a1e35b35ddc815a1ac118293d547c.jpg saved to cache
2026-03-27 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae
2026-03-27 10:49:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001fd550>
2026-03-27 10:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae/8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F97%252Fa097c047b21e7027399863d67a3ca03f%252Fpa%252FJZ27200_2bcb506b0eec082406194126f3536d1f.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_2bcb506b0eec082406194126f3536d1f.jpg saved to cache
2026-03-27 10:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae
2026-03-27 10:49:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500495810>
2026-03-27 10:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae/8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F97%252Fa097c047b21e7027399863d67a3ca03f%252Fpa%252FJZ27200_13a214da8704c81a7b973286d7ce26c9.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_13a214da8704c81a7b973286d7ce26c9.jpg saved to cache
2026-03-27 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae
2026-03-27 10:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50167c8d0>
2026-03-27 10:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f9d0c6b-fb03-5824-9546-47daf1064832/8f9d0c6b-fb03-5824-9546-47daf1064832_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F7a%252Fa97ae314306b0a8f87d652796d1d5c5b%252Fpa%252FMV46979_0663a9172cf442e0efcc1635832111d0.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/7a/a97ae314306b0a8f87d652796d1d5c5b/pa/MV46979_0663a9172cf442e0efcc1635832111d0.jpg saved to cache
2026-03-27 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f9d0c6b-fb03-5824-9546-47daf1064832
2026-03-27 10:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5036e24d0>
2026-03-27 10:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f9d0c6b-fb03-5824-9546-47daf1064832/8f9d0c6b-fb03-5824-9546-47daf1064832_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F7a%252Fa97ae314306b0a8f87d652796d1d5c5b%252Fpa%252FMV46979_c943f4c2ec646c0f9fe71e519c7e8e05.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/7a/a97ae314306b0a8f87d652796d1d5c5b/pa/MV46979_c943f4c2ec646c0f9fe71e519c7e8e05.jpg saved to cache
2026-03-27 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f9d0c6b-fb03-5824-9546-47daf1064832
2026-03-27 10:49:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36dccb9f-bede-593e-a7e5-6d4749ac3052 with identifier: VJ29661
2026-03-27 10:49:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36dccb9f-bede-593e-a7e5-6d4749ac3052 with identifier: VJ29661
2026-03-27 10:49:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36dccb9f-bede-593e-a7e5-6d4749ac3052 with identifier: VJ29661 to the API
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VJ29661>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:25:58Z',
 'fuel_type': 'petrol',
 'id': '36dccb9f-bede-593e-a7e5-6d4749ac3052',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ29661',
 'listing': 'auction',
 'location': 'DE, Fockbek',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 54306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgb0/8b/b08b7931d55a7e59c3e002a46a3a73b8/pa/VJ29661_106089ba00d564c2e1b7d5188b37bc68.jpg',
                'https://img-pa.auto1.com/imgb0/8b/b08b7931d55a7e59c3e002a46a3a73b8/pa/VJ29661_19f8705e4804455037b8d0735bb8c408.jpg',
                'https://img-pa.auto1.com/imgb0/8b/b08b7931d55a7e59c3e002a46a3a73b8/pa/VJ29661_41e16bf756d995de210fc2ccd09898f8.jpg',
                'https://img-pa.auto1.com/imgb0/8b/b08b7931d55a7e59c3e002a46a3a73b8/pa/VJ29661_aec39ea1fc4b0212d5a5e84f5838c65d.jpg',
                'https://img-pa.auto1.com/imgb0/8b/b08b7931d55a7e59c3e002a46a3a73b8/pa/VJ29661_166d1ef60a19749baaf3033a8bb22a7c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36dccb9f-bede-593e-a7e5-6d4749ac3052/36dccb9f-bede-593e-a7e5-6d4749ac3052_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/8b/b08b7931d55a7e59c3e002a46a3a73b8/pa/VJ29661_106089ba00d564c2e1b7d5188b37bc68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36dccb9f-bede-593e-a7e5-6d4749ac3052/36dccb9f-bede-593e-a7e5-6d4749ac3052_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/8b/b08b7931d55a7e59c3e002a46a3a73b8/pa/VJ29661_19f8705e4804455037b8d0735bb8c408.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36dccb9f-bede-593e-a7e5-6d4749ac3052/36dccb9f-bede-593e-a7e5-6d4749ac3052_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/8b/b08b7931d55a7e59c3e002a46a3a73b8/pa/VJ29661_41e16bf756d995de210fc2ccd09898f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36dccb9f-bede-593e-a7e5-6d4749ac3052/36dccb9f-bede-593e-a7e5-6d4749ac3052_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/8b/b08b7931d55a7e59c3e002a46a3a73b8/pa/VJ29661_aec39ea1fc4b0212d5a5e84f5838c65d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36dccb9f-bede-593e-a7e5-6d4749ac3052/36dccb9f-bede-593e-a7e5-6d4749ac3052_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/8b/b08b7931d55a7e59c3e002a46a3a73b8/pa/VJ29661_166d1ef60a19749baaf3033a8bb22a7c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.6 VTi VTR Plus',
 'transmission': 'automatic',
 'trim': 'VTR Plus',
 'year': 2009}
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ29661%27 HTTP/1.1" 200 None
2026-03-27 10:49:34 [auto1.de] INFO: Saving data for VJ29661: {'created_time': 1774608574.469571, 'last_price_update_time': 1774608574.469582, 'auction_closing_time': 1774715158.0}
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ29661') HTTP/1.1" 204 0
2026-03-27 10:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WF06816> (referer: https://www.auto1.com/v1/car-details-view/WF06816/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/7a/a97ae314306b0a8f87d652796d1d5c5b/pa/MV46979_e2c0196d69eb25ef1c31fd1e27b66a94.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/7a/a97ae314306b0a8f87d652796d1d5c5b/pa/MV46979_b144da9c8e3b2889c3589405a9ad341f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/7a/a97ae314306b0a8f87d652796d1d5c5b/pa/MV46979_36e6d20fa6c7fda98118355c8088a4ff.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6f353d6-f828-52d6-8f35-8ce9b635c49d with identifier: WF06816
2026-03-27 10:49:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6f353d6-f828-52d6-8f35-8ce9b635c49d with scrape type 1
2026-03-27 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319139f43ca4ebf03c0306acc465749%252Fpa%252FWF06816_60f1939d1d4584df3935322814c10827.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_60f1939d1d4584df3935322814c10827.jpg not downloaded yet
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319139f43ca4ebf03c0306acc465749%252Fpa%252FWF06816_3e9c9cc53e98ceeb356a71a798610e5f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_3e9c9cc53e98ceeb356a71a798610e5f.jpg not downloaded yet
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319139f43ca4ebf03c0306acc465749%252Fpa%252FWF06816_388c7c6e5880e48dc7d2450ef0724df7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_388c7c6e5880e48dc7d2450ef0724df7.jpg not downloaded yet
2026-03-27 10:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_63e0d66470b29e7071aa2de511b623f4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319139f43ca4ebf03c0306acc465749%252Fpa%252FWF06816_9a6b1e64218151c0571511df677de05d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_9a6b1e64218151c0571511df677de05d.jpg not downloaded yet
2026-03-27 10:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50059c990>
2026-03-27 10:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f9d0c6b-fb03-5824-9546-47daf1064832/8f9d0c6b-fb03-5824-9546-47daf1064832_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F7a%252Fa97ae314306b0a8f87d652796d1d5c5b%252Fpa%252FMV46979_e2c0196d69eb25ef1c31fd1e27b66a94.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/7a/a97ae314306b0a8f87d652796d1d5c5b/pa/MV46979_e2c0196d69eb25ef1c31fd1e27b66a94.jpg saved to cache
2026-03-27 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f9d0c6b-fb03-5824-9546-47daf1064832
2026-03-27 10:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500497610>
2026-03-27 10:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f9d0c6b-fb03-5824-9546-47daf1064832/8f9d0c6b-fb03-5824-9546-47daf1064832_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F7a%252Fa97ae314306b0a8f87d652796d1d5c5b%252Fpa%252FMV46979_b144da9c8e3b2889c3589405a9ad341f.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/7a/a97ae314306b0a8f87d652796d1d5c5b/pa/MV46979_b144da9c8e3b2889c3589405a9ad341f.jpg saved to cache
2026-03-27 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f9d0c6b-fb03-5824-9546-47daf1064832
2026-03-27 10:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002052d0>
2026-03-27 10:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f9d0c6b-fb03-5824-9546-47daf1064832/8f9d0c6b-fb03-5824-9546-47daf1064832_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F7a%252Fa97ae314306b0a8f87d652796d1d5c5b%252Fpa%252FMV46979_36e6d20fa6c7fda98118355c8088a4ff.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/7a/a97ae314306b0a8f87d652796d1d5c5b/pa/MV46979_36e6d20fa6c7fda98118355c8088a4ff.jpg saved to cache
2026-03-27 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f9d0c6b-fb03-5824-9546-47daf1064832
2026-03-27 10:49:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f9d0c6b-fb03-5824-9546-47daf1064832, skipping ID generation
2026-03-27 10:49:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f9d0c6b-fb03-5824-9546-47daf1064832 with scrape type 1
2026-03-27 10:49:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f9d0c6b-fb03-5824-9546-47daf1064832 sending to next pipeline
2026-03-27 10:49:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f9d0c6b-fb03-5824-9546-47daf1064832, identifier: MV46979
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319139f43ca4ebf03c0306acc465749%252Fpa%252FWF06816_897bc007e16aba819dcf0a87c7fd3789.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_897bc007e16aba819dcf0a87c7fd3789.jpg not downloaded yet
2026-03-27 10:49:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f9d0c6b-fb03-5824-9546-47daf1064832 with identifier: MV46979
2026-03-27 10:49:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f9d0c6b-fb03-5824-9546-47daf1064832 with identifier: MV46979
2026-03-27 10:49:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f9d0c6b-fb03-5824-9546-47daf1064832 with identifier: MV46979 to the API
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga9/7a/a97ae314306b0a8f87d652796d1d5c5b/pa/MV46979_36e6d20fa6c7fda98118355c8088a4ff.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:31:48Z',
 'fuel_type': 'petrol',
 'id': '8f9d0c6b-fb03-5824-9546-47daf1064832',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV46979',
 'listing': 'auction',
 'location': 'DE, Bremen',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 119885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f9d0c6b-fb03-5824-9546-47daf1064832/8f9d0c6b-fb03-5824-9546-47daf1064832_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/7a/a97ae314306b0a8f87d652796d1d5c5b/pa/MV46979_b144da9c8e3b2889c3589405a9ad341f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f9d0c6b-fb03-5824-9546-47daf1064832/8f9d0c6b-fb03-5824-9546-47daf1064832_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/7a/a97ae314306b0a8f87d652796d1d5c5b/pa/MV46979_36e6d20fa6c7fda98118355c8088a4ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f9d0c6b-fb03-5824-9546-47daf1064832/8f9d0c6b-fb03-5824-9546-47daf1064832_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/7a/a97ae314306b0a8f87d652796d1d5c5b/pa/MV46979_e2c0196d69eb25ef1c31fd1e27b66a94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f9d0c6b-fb03-5824-9546-47daf1064832/8f9d0c6b-fb03-5824-9546-47daf1064832_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/7a/a97ae314306b0a8f87d652796d1d5c5b/pa/MV46979_c943f4c2ec646c0f9fe71e519c7e8e05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f9d0c6b-fb03-5824-9546-47daf1064832/8f9d0c6b-fb03-5824-9546-47daf1064832_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/7a/a97ae314306b0a8f87d652796d1d5c5b/pa/MV46979_0663a9172cf442e0efcc1635832111d0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46979%27 HTTP/1.1" 200 None
2026-03-27 10:49:35 [auto1.de] INFO: Saving data for MV46979: {'created_time': 1774608575.467988, 'last_price_update_time': 1774608575.468002, 'auction_closing_time': 1774715508.0}
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV46979') HTTP/1.1" 204 0
2026-03-27 10:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_83d0e6ce161690f1c246b0fc30a7433b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319139f43ca4ebf03c0306acc465749%252Fpa%252FWF06816_4a32902e07bc6736b00a8950e00a4bdb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_4a32902e07bc6736b00a8950e00a4bdb.jpg not downloaded yet
2026-03-27 10:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500393950>
2026-03-27 10:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d50fd0-7194-5dd9-a7a5-09d00fa6f944/c3d50fd0-7194-5dd9-a7a5-09d00fa6f944_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F4c%252Fa94c1675c974d61420cc1802f0fbc1d1%252Fpa%252FDV32986_63e0d66470b29e7071aa2de511b623f4.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_63e0d66470b29e7071aa2de511b623f4.jpg saved to cache
2026-03-27 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3d50fd0-7194-5dd9-a7a5-09d00fa6f944
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319139f43ca4ebf03c0306acc465749%252Fpa%252FWF06816_a57f48994a24e27356812a75be14caca.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_a57f48994a24e27356812a75be14caca.jpg not downloaded yet
2026-03-27 10:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UR56671/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319139f43ca4ebf03c0306acc465749%252Fpa%252FWF06816_303413ec486c6dff808cdf3e460c7c11.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_303413ec486c6dff808cdf3e460c7c11.jpg not downloaded yet
2026-03-27 10:49:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319139f43ca4ebf03c0306acc465749%252Fpa%252FWF06816_b4de01fd2c4f44c3d7e1ab6ab5f46c85.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_b4de01fd2c4f44c3d7e1ab6ab5f46c85.jpg not downloaded yet
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319139f43ca4ebf03c0306acc465749%252Fpa%252FWF06816_20000645dd1a308233a92aacb30efb8e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_20000645dd1a308233a92aacb30efb8e.jpg not downloaded yet
2026-03-27 10:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500377150>
2026-03-27 10:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d50fd0-7194-5dd9-a7a5-09d00fa6f944/c3d50fd0-7194-5dd9-a7a5-09d00fa6f944_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F4c%252Fa94c1675c974d61420cc1802f0fbc1d1%252Fpa%252FDV32986_83d0e6ce161690f1c246b0fc30a7433b.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_83d0e6ce161690f1c246b0fc30a7433b.jpg saved to cache
2026-03-27 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3d50fd0-7194-5dd9-a7a5-09d00fa6f944
2026-03-27 10:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_388c7c6e5880e48dc7d2450ef0724df7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_a57f48994a24e27356812a75be14caca.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_38b3d4f1299c7673b1c026cf9fc8d33b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_6b7d6d68745cb82530677e2d980599aa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_897bc007e16aba819dcf0a87c7fd3789.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500360690>
2026-03-27 10:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319139f43ca4ebf03c0306acc465749%252Fpa%252FWF06816_388c7c6e5880e48dc7d2450ef0724df7.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_388c7c6e5880e48dc7d2450ef0724df7.jpg saved to cache
2026-03-27 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-27 10:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_b4de01fd2c4f44c3d7e1ab6ab5f46c85.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_20000645dd1a308233a92aacb30efb8e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50160cb10>
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319139f43ca4ebf03c0306acc465749%252Fpa%252FWF06816_a57f48994a24e27356812a75be14caca.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_a57f48994a24e27356812a75be14caca.jpg saved to cache
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-27 10:49:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500343950>
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae/8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F97%252Fa097c047b21e7027399863d67a3ca03f%252Fpa%252FJZ27200_38b3d4f1299c7673b1c026cf9fc8d33b.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_38b3d4f1299c7673b1c026cf9fc8d33b.jpg saved to cache
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae
2026-03-27 10:49:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501655fd0>
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae/8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F97%252Fa097c047b21e7027399863d67a3ca03f%252Fpa%252FJZ27200_6b7d6d68745cb82530677e2d980599aa.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_6b7d6d68745cb82530677e2d980599aa.jpg saved to cache
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016554d0>
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319139f43ca4ebf03c0306acc465749%252Fpa%252FWF06816_897bc007e16aba819dcf0a87c7fd3789.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_897bc007e16aba819dcf0a87c7fd3789.jpg saved to cache
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50175fc90>
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319139f43ca4ebf03c0306acc465749%252Fpa%252FWF06816_b4de01fd2c4f44c3d7e1ab6ab5f46c85.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_b4de01fd2c4f44c3d7e1ab6ab5f46c85.jpg saved to cache
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50045cc50>
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319139f43ca4ebf03c0306acc465749%252Fpa%252FWF06816_20000645dd1a308233a92aacb30efb8e.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_20000645dd1a308233a92aacb30efb8e.jpg saved to cache
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-27 10:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_9a6b1e64218151c0571511df677de05d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_4a32902e07bc6736b00a8950e00a4bdb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_3e9c9cc53e98ceeb356a71a798610e5f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_60f1939d1d4584df3935322814c10827.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503707690>
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319139f43ca4ebf03c0306acc465749%252Fpa%252FWF06816_9a6b1e64218151c0571511df677de05d.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_9a6b1e64218151c0571511df677de05d.jpg saved to cache
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001d6450>
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319139f43ca4ebf03c0306acc465749%252Fpa%252FWF06816_4a32902e07bc6736b00a8950e00a4bdb.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_4a32902e07bc6736b00a8950e00a4bdb.jpg saved to cache
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50037f7d0>
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319139f43ca4ebf03c0306acc465749%252Fpa%252FWF06816_3e9c9cc53e98ceeb356a71a798610e5f.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_3e9c9cc53e98ceeb356a71a798610e5f.jpg saved to cache
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-27 10:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_303413ec486c6dff808cdf3e460c7c11.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_409645a7f09266796c4bd624efca6af7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN62296/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016dfd10>
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319139f43ca4ebf03c0306acc465749%252Fpa%252FWF06816_60f1939d1d4584df3935322814c10827.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_60f1939d1d4584df3935322814c10827.jpg saved to cache
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-27 10:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_d434deba01996b936918a3a85a942ba7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_8eabc13ba42c796a69cfe6b96fb2cff7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50170e8d0>
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F19%252F5319139f43ca4ebf03c0306acc465749%252Fpa%252FWF06816_303413ec486c6dff808cdf3e460c7c11.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_303413ec486c6dff808cdf3e460c7c11.jpg saved to cache
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c6f353d6-f828-52d6-8f35-8ce9b635c49d
2026-03-27 10:49:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6f353d6-f828-52d6-8f35-8ce9b635c49d, skipping ID generation
2026-03-27 10:49:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6f353d6-f828-52d6-8f35-8ce9b635c49d with scrape type 1
2026-03-27 10:49:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6f353d6-f828-52d6-8f35-8ce9b635c49d sending to next pipeline
2026-03-27 10:49:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6f353d6-f828-52d6-8f35-8ce9b635c49d, identifier: WF06816
2026-03-27 10:49:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6f353d6-f828-52d6-8f35-8ce9b635c49d with identifier: WF06816
2026-03-27 10:49:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6f353d6-f828-52d6-8f35-8ce9b635c49d with identifier: WF06816
2026-03-27 10:49:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6f353d6-f828-52d6-8f35-8ce9b635c49d with identifier: WF06816 to the API
2026-03-27 10:49:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_303413ec486c6dff808cdf3e460c7c11.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:31:55Z',
 'fuel_type': 'electro',
 'id': 'c6f353d6-f828-52d6-8f35-8ce9b635c49d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF06816',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 13,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_60f1939d1d4584df3935322814c10827.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_3e9c9cc53e98ceeb356a71a798610e5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_388c7c6e5880e48dc7d2450ef0724df7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_9a6b1e64218151c0571511df677de05d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_897bc007e16aba819dcf0a87c7fd3789.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_4a32902e07bc6736b00a8950e00a4bdb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_a57f48994a24e27356812a75be14caca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_303413ec486c6dff808cdf3e460c7c11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_b4de01fd2c4f44c3d7e1ab6ab5f46c85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f353d6-f828-52d6-8f35-8ce9b635c49d/c6f353d6-f828-52d6-8f35-8ce9b635c49d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/19/5319139f43ca4ebf03c0306acc465749/pa/WF06816_20000645dd1a308233a92aacb30efb8e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-12-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-27 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF06816%27 HTTP/1.1" 200 None
2026-03-27 10:49:37 [auto1.de] INFO: Saving data for WF06816: {'created_time': 1774608577.591837, 'last_price_update_time': 1774608577.591847, 'auction_closing_time': 1774715515.0}
2026-03-27 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF06816') HTTP/1.1" 204 0
2026-03-27 10:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500495e50>
2026-03-27 10:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d50fd0-7194-5dd9-a7a5-09d00fa6f944/c3d50fd0-7194-5dd9-a7a5-09d00fa6f944_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F4c%252Fa94c1675c974d61420cc1802f0fbc1d1%252Fpa%252FDV32986_409645a7f09266796c4bd624efca6af7.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_409645a7f09266796c4bd624efca6af7.jpg saved to cache
2026-03-27 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3d50fd0-7194-5dd9-a7a5-09d00fa6f944
2026-03-27 10:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_0bd43e585a6e07bdf64e3ab3ce19aa5b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/ff/f1ff7662619fc54ac2b3a4a4bb18ea61/pa/SG45396_f7875edbaaf6683ac851a7f2adeadaf5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DN13458/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50175dc90>
2026-03-27 10:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d50fd0-7194-5dd9-a7a5-09d00fa6f944/c3d50fd0-7194-5dd9-a7a5-09d00fa6f944_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F4c%252Fa94c1675c974d61420cc1802f0fbc1d1%252Fpa%252FDV32986_d434deba01996b936918a3a85a942ba7.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_d434deba01996b936918a3a85a942ba7.jpg saved to cache
2026-03-27 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3d50fd0-7194-5dd9-a7a5-09d00fa6f944
2026-03-27 10:49:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001eee90>
2026-03-27 10:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae/8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F97%252Fa097c047b21e7027399863d67a3ca03f%252Fpa%252FJZ27200_8eabc13ba42c796a69cfe6b96fb2cff7.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_8eabc13ba42c796a69cfe6b96fb2cff7.jpg saved to cache
2026-03-27 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae
2026-03-27 10:49:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae, skipping ID generation
2026-03-27 10:49:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae with scrape type 1
2026-03-27 10:49:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae sending to next pipeline
2026-03-27 10:49:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae, identifier: JZ27200
2026-03-27 10:49:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae with identifier: JZ27200
2026-03-27 10:49:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae with identifier: JZ27200
2026-03-27 10:49:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae with identifier: JZ27200 to the API
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_8eabc13ba42c796a69cfe6b96fb2cff7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:23:43Z',
 'fuel_type': 'diesel',
 'id': '8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ27200',
 'listing': 'auction',
 'location': 'DE, Leipzig',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 198394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae/8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2913527,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_8eabc13ba42c796a69cfe6b96fb2cff7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae/8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_cb9ff04022bc1eb33792169522567105.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae/8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2778527,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_6b7d6d68745cb82530677e2d980599aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae/8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2480342,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_38b3d4f1299c7673b1c026cf9fc8d33b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae/8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2826054,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_13a214da8704c81a7b973286d7ce26c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae/8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2721286,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_2bcb506b0eec082406194126f3536d1f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae/8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2570529,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_9a6a1e35b35ddc815a1ac118293d547c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae/8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_e34aa4d64ea0c2ae7b95971ec2885e43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae/8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2306291,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_71ca7dc561267ccba37f54b15103149f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae/8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/97/a097c047b21e7027399863d67a3ca03f/pa/JZ27200_fd0b4c233ce7d8dc7b1c9f1e491eef02.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2012}
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ27200%27 HTTP/1.1" 200 None
2026-03-27 10:49:38 [auto1.de] INFO: Saving data for JZ27200: {'created_time': 1774608578.564494, 'last_price_update_time': 1774608578.564504, 'auction_closing_time': 1774715023.0}
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ27200') HTTP/1.1" 204 0
2026-03-27 10:49:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TB14981> (referer: https://www.auto1.com/v1/car-details-view/TB14981/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500497610>
2026-03-27 10:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3d50fd0-7194-5dd9-a7a5-09d00fa6f944/c3d50fd0-7194-5dd9-a7a5-09d00fa6f944_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F4c%252Fa94c1675c974d61420cc1802f0fbc1d1%252Fpa%252FDV32986_0bd43e585a6e07bdf64e3ab3ce19aa5b.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_0bd43e585a6e07bdf64e3ab3ce19aa5b.jpg saved to cache
2026-03-27 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3d50fd0-7194-5dd9-a7a5-09d00fa6f944
2026-03-27 10:49:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3d50fd0-7194-5dd9-a7a5-09d00fa6f944, skipping ID generation
2026-03-27 10:49:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3d50fd0-7194-5dd9-a7a5-09d00fa6f944 with scrape type 1
2026-03-27 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3d50fd0-7194-5dd9-a7a5-09d00fa6f944 sending to next pipeline
2026-03-27 10:49:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3d50fd0-7194-5dd9-a7a5-09d00fa6f944, identifier: DV32986
2026-03-27 10:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018a1490>
2026-03-27 10:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b14690-fdc5-55ad-a2e2-b11dc317f145/65b14690-fdc5-55ad-a2e2-b11dc317f145_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fff%252Ff1ff7662619fc54ac2b3a4a4bb18ea61%252Fpa%252FSG45396_f7875edbaaf6683ac851a7f2adeadaf5.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ff/f1ff7662619fc54ac2b3a4a4bb18ea61/pa/SG45396_f7875edbaaf6683ac851a7f2adeadaf5.jpg saved to cache
2026-03-27 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65b14690-fdc5-55ad-a2e2-b11dc317f145
2026-03-27 10:49:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65b14690-fdc5-55ad-a2e2-b11dc317f145, skipping ID generation
2026-03-27 10:49:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65b14690-fdc5-55ad-a2e2-b11dc317f145 with scrape type 1
2026-03-27 10:49:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65b14690-fdc5-55ad-a2e2-b11dc317f145 sending to next pipeline
2026-03-27 10:49:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65b14690-fdc5-55ad-a2e2-b11dc317f145, identifier: SG45396
2026-03-27 10:49:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3d50fd0-7194-5dd9-a7a5-09d00fa6f944 with identifier: DV32986
2026-03-27 10:49:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3d50fd0-7194-5dd9-a7a5-09d00fa6f944 with identifier: DV32986
2026-03-27 10:49:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3d50fd0-7194-5dd9-a7a5-09d00fa6f944 with identifier: DV32986 to the API
2026-03-27 10:49:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_0bd43e585a6e07bdf64e3ab3ce19aa5b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 55,
 'expiration_date': '2026-03-28T16:23:09Z',
 'fuel_type': 'petrol',
 'id': 'c3d50fd0-7194-5dd9-a7a5-09d00fa6f944',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV32986',
 'listing': 'auction',
 'location': 'DE, Singen',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 150564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d50fd0-7194-5dd9-a7a5-09d00fa6f944/c3d50fd0-7194-5dd9-a7a5-09d00fa6f944_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_8be64669bfa874b0d6233eb5ae1d25b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d50fd0-7194-5dd9-a7a5-09d00fa6f944/c3d50fd0-7194-5dd9-a7a5-09d00fa6f944_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_d434deba01996b936918a3a85a942ba7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d50fd0-7194-5dd9-a7a5-09d00fa6f944/c3d50fd0-7194-5dd9-a7a5-09d00fa6f944_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_0bd43e585a6e07bdf64e3ab3ce19aa5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d50fd0-7194-5dd9-a7a5-09d00fa6f944/c3d50fd0-7194-5dd9-a7a5-09d00fa6f944_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_409645a7f09266796c4bd624efca6af7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d50fd0-7194-5dd9-a7a5-09d00fa6f944/c3d50fd0-7194-5dd9-a7a5-09d00fa6f944_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_83d0e6ce161690f1c246b0fc30a7433b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3d50fd0-7194-5dd9-a7a5-09d00fa6f944/c3d50fd0-7194-5dd9-a7a5-09d00fa6f944_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/4c/a94c1675c974d61420cc1802f0fbc1d1/pa/DV32986_63e0d66470b29e7071aa2de511b623f4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-01-13',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.1 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2009}
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV32986%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [auto1.de] INFO: Saving data for DV32986: {'created_time': 1774608579.247262, 'last_price_update_time': 1774608579.247273, 'auction_closing_time': 1774714989.0}
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV32986') HTTP/1.1" 204 0
2026-03-27 10:49:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65b14690-fdc5-55ad-a2e2-b11dc317f145 with identifier: SG45396
2026-03-27 10:49:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65b14690-fdc5-55ad-a2e2-b11dc317f145 with identifier: SG45396
2026-03-27 10:49:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65b14690-fdc5-55ad-a2e2-b11dc317f145 with identifier: SG45396 to the API
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/ff/f1ff7662619fc54ac2b3a4a4bb18ea61/pa/SG45396_f7875edbaaf6683ac851a7f2adeadaf5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:25:48Z',
 'fuel_type': 'petrol',
 'id': '65b14690-fdc5-55ad-a2e2-b11dc317f145',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG45396',
 'listing': 'auction',
 'location': 'DE, Oldenburg',
 'make': 'Mazda',
 'model': '5',
 'odometer': 157871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b14690-fdc5-55ad-a2e2-b11dc317f145/65b14690-fdc5-55ad-a2e2-b11dc317f145_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/ff/f1ff7662619fc54ac2b3a4a4bb18ea61/pa/SG45396_c9094750a6e29bdc60ca51383e5d2f05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b14690-fdc5-55ad-a2e2-b11dc317f145/65b14690-fdc5-55ad-a2e2-b11dc317f145_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/ff/f1ff7662619fc54ac2b3a4a4bb18ea61/pa/SG45396_f7875edbaaf6683ac851a7f2adeadaf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b14690-fdc5-55ad-a2e2-b11dc317f145/65b14690-fdc5-55ad-a2e2-b11dc317f145_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/ff/f1ff7662619fc54ac2b3a4a4bb18ea61/pa/SG45396_f25e6f45fc143b5241fb6d4abae1839e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b14690-fdc5-55ad-a2e2-b11dc317f145/65b14690-fdc5-55ad-a2e2-b11dc317f145_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/ff/f1ff7662619fc54ac2b3a4a4bb18ea61/pa/SG45396_9042ed66463912043b864b2b69febfe9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b14690-fdc5-55ad-a2e2-b11dc317f145/65b14690-fdc5-55ad-a2e2-b11dc317f145_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/ff/f1ff7662619fc54ac2b3a4a4bb18ea61/pa/SG45396_1cd7aeb66b155580a7c711ab97c74b4b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-10-29',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Mazda 5 1.8 Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2008}
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG45396%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [auto1.de] INFO: Saving data for SG45396: {'created_time': 1774608579.644029, 'last_price_update_time': 1774608579.64404, 'auction_closing_time': 1774715148.0}
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG45396') HTTP/1.1" 204 0
2026-03-27 10:49:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AN15165> (referer: https://www.auto1.com/v1/car-details-view/AN15165/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31e77e6e-db64-5fd3-a646-138ff878c268 with identifier: TB14981
2026-03-27 10:49:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31e77e6e-db64-5fd3-a646-138ff878c268 with scrape type 1
2026-03-27 10:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 31e77e6e-db64-5fd3-a646-138ff878c268
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fec%252F6decec89841d51b7102016dc899b75ef%252Fpa%252FTB14981_03144aa5132f8eae78243765517d61e7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ec/6decec89841d51b7102016dc899b75ef/pa/TB14981_03144aa5132f8eae78243765517d61e7.jpg already downloaded
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fec%252F6decec89841d51b7102016dc899b75ef%252Fpa%252FTB14981_9eae20fb36d3fb9eae350a396c6a880b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ec/6decec89841d51b7102016dc899b75ef/pa/TB14981_9eae20fb36d3fb9eae350a396c6a880b.jpg already downloaded
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fec%252F6decec89841d51b7102016dc899b75ef%252Fpa%252FTB14981_6dd05d7f7c804208b55fa0700fbac743.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ec/6decec89841d51b7102016dc899b75ef/pa/TB14981_6dd05d7f7c804208b55fa0700fbac743.jpg already downloaded
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fec%252F6decec89841d51b7102016dc899b75ef%252Fpa%252FTB14981_d74df460cca4f7d12ee08ed8a2a910c9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ec/6decec89841d51b7102016dc899b75ef/pa/TB14981_d74df460cca4f7d12ee08ed8a2a910c9.jpg already downloaded
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fec%252F6decec89841d51b7102016dc899b75ef%252Fpa%252FTB14981_5b543d772c8c86c2459b6dd7ab2c0c6b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/ec/6decec89841d51b7102016dc899b75ef/pa/TB14981_5b543d772c8c86c2459b6dd7ab2c0c6b.jpg already downloaded
2026-03-27 10:49:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31e77e6e-db64-5fd3-a646-138ff878c268, identifier: TB14981
2026-03-27 10:49:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31e77e6e-db64-5fd3-a646-138ff878c268 with identifier: TB14981
2026-03-27 10:49:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31e77e6e-db64-5fd3-a646-138ff878c268 with identifier: TB14981
2026-03-27 10:49:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31e77e6e-db64-5fd3-a646-138ff878c268 with identifier: TB14981 to the API
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TB14981>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:00:51Z',
 'fuel_type': 'diesel',
 'id': '31e77e6e-db64-5fd3-a646-138ff878c268',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB14981',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 265743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img6d/ec/6decec89841d51b7102016dc899b75ef/pa/TB14981_03144aa5132f8eae78243765517d61e7.jpg',
                'https://img-pa.auto1.com/img6d/ec/6decec89841d51b7102016dc899b75ef/pa/TB14981_9eae20fb36d3fb9eae350a396c6a880b.jpg',
                'https://img-pa.auto1.com/img6d/ec/6decec89841d51b7102016dc899b75ef/pa/TB14981_6dd05d7f7c804208b55fa0700fbac743.jpg',
                'https://img-pa.auto1.com/img6d/ec/6decec89841d51b7102016dc899b75ef/pa/TB14981_d74df460cca4f7d12ee08ed8a2a910c9.jpg',
                'https://img-pa.auto1.com/img6d/ec/6decec89841d51b7102016dc899b75ef/pa/TB14981_5b543d772c8c86c2459b6dd7ab2c0c6b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31e77e6e-db64-5fd3-a646-138ff878c268/31e77e6e-db64-5fd3-a646-138ff878c268_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/ec/6decec89841d51b7102016dc899b75ef/pa/TB14981_03144aa5132f8eae78243765517d61e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31e77e6e-db64-5fd3-a646-138ff878c268/31e77e6e-db64-5fd3-a646-138ff878c268_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/ec/6decec89841d51b7102016dc899b75ef/pa/TB14981_9eae20fb36d3fb9eae350a396c6a880b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31e77e6e-db64-5fd3-a646-138ff878c268/31e77e6e-db64-5fd3-a646-138ff878c268_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/ec/6decec89841d51b7102016dc899b75ef/pa/TB14981_6dd05d7f7c804208b55fa0700fbac743.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31e77e6e-db64-5fd3-a646-138ff878c268/31e77e6e-db64-5fd3-a646-138ff878c268_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/ec/6decec89841d51b7102016dc899b75ef/pa/TB14981_d74df460cca4f7d12ee08ed8a2a910c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31e77e6e-db64-5fd3-a646-138ff878c268/31e77e6e-db64-5fd3-a646-138ff878c268_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/ec/6decec89841d51b7102016dc899b75ef/pa/TB14981_5b543d772c8c86c2459b6dd7ab2c0c6b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 2.0 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2010}
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB14981%27 HTTP/1.1" 200 None
2026-03-27 10:49:40 [auto1.de] INFO: Saving data for TB14981: {'created_time': 1774608580.341538, 'last_price_update_time': 1774608580.341548, 'auction_closing_time': 1774713651.0}
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB14981') HTTP/1.1" 204 0
2026-03-27 10:49:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c212417-4fab-50a3-a22a-bc2614180ae0 with identifier: AN15165
2026-03-27 10:49:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c212417-4fab-50a3-a22a-bc2614180ae0 with scrape type 1
2026-03-27 10:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c212417-4fab-50a3-a22a-bc2614180ae0
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F16%252F1416cdab4f9e0a564560cf39974475e6%252Fpa%252FAN15165_9b9bbe2cecb262aadcb3ee5a81af52bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_9b9bbe2cecb262aadcb3ee5a81af52bf.jpg already downloaded
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F16%252F1416cdab4f9e0a564560cf39974475e6%252Fpa%252FAN15165_93a4b91eeb1350ae4677067a26844c6b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_93a4b91eeb1350ae4677067a26844c6b.jpg already downloaded
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F16%252F1416cdab4f9e0a564560cf39974475e6%252Fpa%252FAN15165_3813db0dd0b6a2087ebc859e464a2af6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_3813db0dd0b6a2087ebc859e464a2af6.jpg already downloaded
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F16%252F1416cdab4f9e0a564560cf39974475e6%252Fpa%252FAN15165_f6d042908de802bffa258aa92b1261ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_f6d042908de802bffa258aa92b1261ea.jpg already downloaded
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F16%252F1416cdab4f9e0a564560cf39974475e6%252Fpa%252FAN15165_45c0fa3195eb0792ee5361c399c7345f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_45c0fa3195eb0792ee5361c399c7345f.jpg already downloaded
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F16%252F1416cdab4f9e0a564560cf39974475e6%252Fpa%252FAN15165_c3d8eaf6364e59e2f1d25927ae786ac3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_c3d8eaf6364e59e2f1d25927ae786ac3.jpg already downloaded
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F16%252F1416cdab4f9e0a564560cf39974475e6%252Fpa%252FAN15165_e2296b99f06aecb637446be875791ed3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_e2296b99f06aecb637446be875791ed3.jpg already downloaded
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F16%252F1416cdab4f9e0a564560cf39974475e6%252Fpa%252FAN15165_676c41b3c065141bc5f0d24363a1dc8b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_676c41b3c065141bc5f0d24363a1dc8b.jpg already downloaded
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F16%252F1416cdab4f9e0a564560cf39974475e6%252Fpa%252FAN15165_60efe9879828824f9b39188b2efad4a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_60efe9879828824f9b39188b2efad4a2.jpg already downloaded
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F16%252F1416cdab4f9e0a564560cf39974475e6%252Fpa%252FAN15165_cb2d21f6ee4c32e6686c990a7bac1cf3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_cb2d21f6ee4c32e6686c990a7bac1cf3.jpg already downloaded
2026-03-27 10:49:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c212417-4fab-50a3-a22a-bc2614180ae0, identifier: AN15165
2026-03-27 10:49:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c212417-4fab-50a3-a22a-bc2614180ae0 with identifier: AN15165
2026-03-27 10:49:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c212417-4fab-50a3-a22a-bc2614180ae0 with identifier: AN15165
2026-03-27 10:49:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c212417-4fab-50a3-a22a-bc2614180ae0 with identifier: AN15165 to the API
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AN15165>
{'auction_title': '',
 'c_o_2_emission_value': 24,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:45:24Z',
 'fuel_type': 'hybrid',
 'id': '3c212417-4fab-50a3-a22a-bc2614180ae0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN15165',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 96025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_9b9bbe2cecb262aadcb3ee5a81af52bf.jpg',
                'https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_93a4b91eeb1350ae4677067a26844c6b.jpg',
                'https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_3813db0dd0b6a2087ebc859e464a2af6.jpg',
                'https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_f6d042908de802bffa258aa92b1261ea.jpg',
                'https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_45c0fa3195eb0792ee5361c399c7345f.jpg',
                'https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_c3d8eaf6364e59e2f1d25927ae786ac3.jpg',
                'https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_e2296b99f06aecb637446be875791ed3.jpg',
                'https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_676c41b3c065141bc5f0d24363a1dc8b.jpg',
                'https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_60efe9879828824f9b39188b2efad4a2.jpg',
                'https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_cb2d21f6ee4c32e6686c990a7bac1cf3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c212417-4fab-50a3-a22a-bc2614180ae0/3c212417-4fab-50a3-a22a-bc2614180ae0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_9b9bbe2cecb262aadcb3ee5a81af52bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c212417-4fab-50a3-a22a-bc2614180ae0/3c212417-4fab-50a3-a22a-bc2614180ae0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_93a4b91eeb1350ae4677067a26844c6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c212417-4fab-50a3-a22a-bc2614180ae0/3c212417-4fab-50a3-a22a-bc2614180ae0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_3813db0dd0b6a2087ebc859e464a2af6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c212417-4fab-50a3-a22a-bc2614180ae0/3c212417-4fab-50a3-a22a-bc2614180ae0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2720068,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_f6d042908de802bffa258aa92b1261ea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c212417-4fab-50a3-a22a-bc2614180ae0/3c212417-4fab-50a3-a22a-bc2614180ae0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2748094,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_45c0fa3195eb0792ee5361c399c7345f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c212417-4fab-50a3-a22a-bc2614180ae0/3c212417-4fab-50a3-a22a-bc2614180ae0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_c3d8eaf6364e59e2f1d25927ae786ac3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c212417-4fab-50a3-a22a-bc2614180ae0/3c212417-4fab-50a3-a22a-bc2614180ae0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2753531,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_e2296b99f06aecb637446be875791ed3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c212417-4fab-50a3-a22a-bc2614180ae0/3c212417-4fab-50a3-a22a-bc2614180ae0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_676c41b3c065141bc5f0d24363a1dc8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c212417-4fab-50a3-a22a-bc2614180ae0/3c212417-4fab-50a3-a22a-bc2614180ae0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_60efe9879828824f9b39188b2efad4a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c212417-4fab-50a3-a22a-bc2614180ae0/3c212417-4fab-50a3-a22a-bc2614180ae0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/16/1416cdab4f9e0a564560cf39974475e6/pa/AN15165_cb2d21f6ee4c32e6686c990a7bac1cf3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2022}
2026-03-27 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN15165%27 HTTP/1.1" 200 None
2026-03-27 10:49:41 [auto1.de] INFO: Saving data for AN15165: {'created_time': 1774608581.029984, 'last_price_update_time': 1774608581.029996, 'auction_closing_time': 1774716324.0}
2026-03-27 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN15165') HTTP/1.1" 204 0
2026-03-27 10:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_fab22c416fdd403c81280de81730b7bd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_8454f481041caca3d56d1eef5dd62cbd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_3094651bd2394d259355c03e10c11e76.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500433710>
2026-03-27 10:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eca5aac-39b2-5b93-af6a-b38550816051/2eca5aac-39b2-5b93-af6a-b38550816051_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F08%252Fb1085347a0f1c643ecd13a66ebe3aa24%252Fpa%252FZZ67378_fab22c416fdd403c81280de81730b7bd.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_fab22c416fdd403c81280de81730b7bd.jpg saved to cache
2026-03-27 10:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2eca5aac-39b2-5b93-af6a-b38550816051
2026-03-27 10:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP39068/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500377150>
2026-03-27 10:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eca5aac-39b2-5b93-af6a-b38550816051/2eca5aac-39b2-5b93-af6a-b38550816051_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F08%252Fb1085347a0f1c643ecd13a66ebe3aa24%252Fpa%252FZZ67378_8454f481041caca3d56d1eef5dd62cbd.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_8454f481041caca3d56d1eef5dd62cbd.jpg saved to cache
2026-03-27 10:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2eca5aac-39b2-5b93-af6a-b38550816051
2026-03-27 10:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50170d350>
2026-03-27 10:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eca5aac-39b2-5b93-af6a-b38550816051/2eca5aac-39b2-5b93-af6a-b38550816051_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F08%252Fb1085347a0f1c643ecd13a66ebe3aa24%252Fpa%252FZZ67378_3094651bd2394d259355c03e10c11e76.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_3094651bd2394d259355c03e10c11e76.jpg saved to cache
2026-03-27 10:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2eca5aac-39b2-5b93-af6a-b38550816051
2026-03-27 10:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_e4d11677df5b6a8976ed55cac29fd71a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500343f50>
2026-03-27 10:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eca5aac-39b2-5b93-af6a-b38550816051/2eca5aac-39b2-5b93-af6a-b38550816051_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F08%252Fb1085347a0f1c643ecd13a66ebe3aa24%252Fpa%252FZZ67378_e4d11677df5b6a8976ed55cac29fd71a.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_e4d11677df5b6a8976ed55cac29fd71a.jpg saved to cache
2026-03-27 10:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2eca5aac-39b2-5b93-af6a-b38550816051
2026-03-27 10:49:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2eca5aac-39b2-5b93-af6a-b38550816051, skipping ID generation
2026-03-27 10:49:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eca5aac-39b2-5b93-af6a-b38550816051 with scrape type 1
2026-03-27 10:49:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2eca5aac-39b2-5b93-af6a-b38550816051 sending to next pipeline
2026-03-27 10:49:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2eca5aac-39b2-5b93-af6a-b38550816051, identifier: ZZ67378
2026-03-27 10:49:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2eca5aac-39b2-5b93-af6a-b38550816051 with identifier: ZZ67378
2026-03-27 10:49:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2eca5aac-39b2-5b93-af6a-b38550816051 with identifier: ZZ67378
2026-03-27 10:49:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2eca5aac-39b2-5b93-af6a-b38550816051 with identifier: ZZ67378 to the API
2026-03-27 10:49:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_e4d11677df5b6a8976ed55cac29fd71a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 197,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:35:09Z',
 'fuel_type': 'diesel',
 'id': '2eca5aac-39b2-5b93-af6a-b38550816051',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ67378',
 'listing': 'auction',
 'location': 'DE, Delmenhorst',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 175932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eca5aac-39b2-5b93-af6a-b38550816051/2eca5aac-39b2-5b93-af6a-b38550816051_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_e4d11677df5b6a8976ed55cac29fd71a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eca5aac-39b2-5b93-af6a-b38550816051/2eca5aac-39b2-5b93-af6a-b38550816051_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_3094651bd2394d259355c03e10c11e76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eca5aac-39b2-5b93-af6a-b38550816051/2eca5aac-39b2-5b93-af6a-b38550816051_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3215236,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_8454f481041caca3d56d1eef5dd62cbd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eca5aac-39b2-5b93-af6a-b38550816051/2eca5aac-39b2-5b93-af6a-b38550816051_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2536462,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_fab22c416fdd403c81280de81730b7bd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eca5aac-39b2-5b93-af6a-b38550816051/2eca5aac-39b2-5b93-af6a-b38550816051_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3395573,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_a94727583223d63d4720944a92673d14.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eca5aac-39b2-5b93-af6a-b38550816051/2eca5aac-39b2-5b93-af6a-b38550816051_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_4dfd0ef583e69ff388398f0013f5d2fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eca5aac-39b2-5b93-af6a-b38550816051/2eca5aac-39b2-5b93-af6a-b38550816051_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_7d303b785fa7ac0e671c17118f1ec7bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eca5aac-39b2-5b93-af6a-b38550816051/2eca5aac-39b2-5b93-af6a-b38550816051_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2570972,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_6244d0f7b098453d716008e554df71dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eca5aac-39b2-5b93-af6a-b38550816051/2eca5aac-39b2-5b93-af6a-b38550816051_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3006366,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_1b427f527ca1bb9a82fc398bb537d3e2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eca5aac-39b2-5b93-af6a-b38550816051/2eca5aac-39b2-5b93-af6a-b38550816051_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3171786,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/08/b1085347a0f1c643ecd13a66ebe3aa24/pa/ZZ67378_cf8e0b5138d794a08131e306b3584bc0.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi 310 L2 Einzelkabine',
 'transmission': 'manual',
 'trim': '310 L2 Einzelkabine',
 'year': 2014}
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ67378%27 HTTP/1.1" 200 None
2026-03-27 10:49:42 [auto1.de] INFO: Saving data for ZZ67378: {'created_time': 1774608582.222404, 'last_price_update_time': 1774608582.222415, 'auction_closing_time': 1774715709.0}
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ67378') HTTP/1.1" 204 0
2026-03-27 10:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UR56671> (referer: https://www.auto1.com/v1/car-details-view/UR56671/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DB09023/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_f387786936792de22e5bae8bf0690919.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_f32e02a3f714d0bb6153c83483113286.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 565e9f4a-3958-5cfb-9584-f9498047c744 with identifier: UR56671
2026-03-27 10:49:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 565e9f4a-3958-5cfb-9584-f9498047c744 with scrape type 1
2026-03-27 10:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 565e9f4a-3958-5cfb-9584-f9498047c744
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F51%252F48517c9fe5e3ff2ce27587624925c3c9%252Fpa%252FUR56671_779dcbeb8f7232928dc4ea3d784b8602.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/51/48517c9fe5e3ff2ce27587624925c3c9/pa/UR56671_779dcbeb8f7232928dc4ea3d784b8602.jpg not downloaded yet
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F51%252F48517c9fe5e3ff2ce27587624925c3c9%252Fpa%252FUR56671_9ff5d72fd8e9eb41ff78c142c6dcccfd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/51/48517c9fe5e3ff2ce27587624925c3c9/pa/UR56671_9ff5d72fd8e9eb41ff78c142c6dcccfd.jpg not downloaded yet
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F51%252F48517c9fe5e3ff2ce27587624925c3c9%252Fpa%252FUR56671_5de7adb7a934418f0dbd78520ed93f14.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/51/48517c9fe5e3ff2ce27587624925c3c9/pa/UR56671_5de7adb7a934418f0dbd78520ed93f14.jpg not downloaded yet
2026-03-27 10:49:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50198b4d0>
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98406f2b-f0be-567c-993e-31d972116fd2/98406f2b-f0be-567c-993e-31d972116fd2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ff3%252F4bf3e1eb38a1b9cc7dc32003f2ba5e57%252Fpa%252FZK76499_f387786936792de22e5bae8bf0690919.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_f387786936792de22e5bae8bf0690919.jpg saved to cache
2026-03-27 10:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98406f2b-f0be-567c-993e-31d972116fd2
2026-03-27 10:49:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5037871d0>
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98406f2b-f0be-567c-993e-31d972116fd2/98406f2b-f0be-567c-993e-31d972116fd2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ff3%252F4bf3e1eb38a1b9cc7dc32003f2ba5e57%252Fpa%252FZK76499_f32e02a3f714d0bb6153c83483113286.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_f32e02a3f714d0bb6153c83483113286.jpg saved to cache
2026-03-27 10:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98406f2b-f0be-567c-993e-31d972116fd2
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F51%252F48517c9fe5e3ff2ce27587624925c3c9%252Fpa%252FUR56671_16555831736906752dfde8d8661f81e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/51/48517c9fe5e3ff2ce27587624925c3c9/pa/UR56671_16555831736906752dfde8d8661f81e2.jpg not downloaded yet
2026-03-27 10:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_40d2f35d2846a83905880a93783b2c04.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F51%252F48517c9fe5e3ff2ce27587624925c3c9%252Fpa%252FUR56671_f058533d6b6eccc74cde1c5956c07859.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/51/48517c9fe5e3ff2ce27587624925c3c9/pa/UR56671_f058533d6b6eccc74cde1c5956c07859.jpg not downloaded yet
2026-03-27 10:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NV35825> (referer: https://www.auto1.com/v1/car-details-view/NV35825/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_bd3d7617327252c66255dbb843acc086.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/51/48517c9fe5e3ff2ce27587624925c3c9/pa/UR56671_5de7adb7a934418f0dbd78520ed93f14.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/51/48517c9fe5e3ff2ce27587624925c3c9/pa/UR56671_16555831736906752dfde8d8661f81e2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50198b4d0>
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98406f2b-f0be-567c-993e-31d972116fd2/98406f2b-f0be-567c-993e-31d972116fd2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ff3%252F4bf3e1eb38a1b9cc7dc32003f2ba5e57%252Fpa%252FZK76499_40d2f35d2846a83905880a93783b2c04.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_40d2f35d2846a83905880a93783b2c04.jpg saved to cache
2026-03-27 10:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98406f2b-f0be-567c-993e-31d972116fd2
2026-03-27 10:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/51/48517c9fe5e3ff2ce27587624925c3c9/pa/UR56671_f058533d6b6eccc74cde1c5956c07859.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/51/48517c9fe5e3ff2ce27587624925c3c9/pa/UR56671_9ff5d72fd8e9eb41ff78c142c6dcccfd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0 with identifier: NV35825
2026-03-27 10:49:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0 with scrape type 1
2026-03-27 10:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F52%252F4352441487033681dc4d35ff2c59ac12%252Fpa%252FNV35825_5ea0bdd6cc204d0ca53c26f51dd3c36c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_5ea0bdd6cc204d0ca53c26f51dd3c36c.jpg not downloaded yet
2026-03-27 10:49:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50039b5d0>
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98406f2b-f0be-567c-993e-31d972116fd2/98406f2b-f0be-567c-993e-31d972116fd2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ff3%252F4bf3e1eb38a1b9cc7dc32003f2ba5e57%252Fpa%252FZK76499_bd3d7617327252c66255dbb843acc086.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_bd3d7617327252c66255dbb843acc086.jpg saved to cache
2026-03-27 10:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98406f2b-f0be-567c-993e-31d972116fd2
2026-03-27 10:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/51/48517c9fe5e3ff2ce27587624925c3c9/pa/UR56671_779dcbeb8f7232928dc4ea3d784b8602.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F52%252F4352441487033681dc4d35ff2c59ac12%252Fpa%252FNV35825_57cfe13afd8aa10ca657da156b4514a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_57cfe13afd8aa10ca657da156b4514a7.jpg not downloaded yet
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500204310>
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_565e9f4a-3958-5cfb-9584-f9498047c744/565e9f4a-3958-5cfb-9584-f9498047c744_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F51%252F48517c9fe5e3ff2ce27587624925c3c9%252Fpa%252FUR56671_5de7adb7a934418f0dbd78520ed93f14.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/51/48517c9fe5e3ff2ce27587624925c3c9/pa/UR56671_5de7adb7a934418f0dbd78520ed93f14.jpg saved to cache
2026-03-27 10:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 565e9f4a-3958-5cfb-9584-f9498047c744
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501751190>
2026-03-27 10:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_565e9f4a-3958-5cfb-9584-f9498047c744/565e9f4a-3958-5cfb-9584-f9498047c744_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F51%252F48517c9fe5e3ff2ce27587624925c3c9%252Fpa%252FUR56671_16555831736906752dfde8d8661f81e2.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/51/48517c9fe5e3ff2ce27587624925c3c9/pa/UR56671_16555831736906752dfde8d8661f81e2.jpg saved to cache
2026-03-27 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 565e9f4a-3958-5cfb-9584-f9498047c744
2026-03-27 10:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500394c50>
2026-03-27 10:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_565e9f4a-3958-5cfb-9584-f9498047c744/565e9f4a-3958-5cfb-9584-f9498047c744_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F51%252F48517c9fe5e3ff2ce27587624925c3c9%252Fpa%252FUR56671_f058533d6b6eccc74cde1c5956c07859.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/51/48517c9fe5e3ff2ce27587624925c3c9/pa/UR56671_f058533d6b6eccc74cde1c5956c07859.jpg saved to cache
2026-03-27 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 565e9f4a-3958-5cfb-9584-f9498047c744
2026-03-27 10:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501680ad0>
2026-03-27 10:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_565e9f4a-3958-5cfb-9584-f9498047c744/565e9f4a-3958-5cfb-9584-f9498047c744_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F51%252F48517c9fe5e3ff2ce27587624925c3c9%252Fpa%252FUR56671_9ff5d72fd8e9eb41ff78c142c6dcccfd.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/51/48517c9fe5e3ff2ce27587624925c3c9/pa/UR56671_9ff5d72fd8e9eb41ff78c142c6dcccfd.jpg saved to cache
2026-03-27 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 565e9f4a-3958-5cfb-9584-f9498047c744
2026-03-27 10:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_d09ba126798a710844277c0d425a10fd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F52%252F4352441487033681dc4d35ff2c59ac12%252Fpa%252FNV35825_b64d13b12f4e2195b37c25864a7a1861.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_b64d13b12f4e2195b37c25864a7a1861.jpg not downloaded yet
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F52%252F4352441487033681dc4d35ff2c59ac12%252Fpa%252FNV35825_a474d3518497047967cd489fb1050311.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_a474d3518497047967cd489fb1050311.jpg not downloaded yet
2026-03-27 10:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004a8e50>
2026-03-27 10:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_565e9f4a-3958-5cfb-9584-f9498047c744/565e9f4a-3958-5cfb-9584-f9498047c744_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F51%252F48517c9fe5e3ff2ce27587624925c3c9%252Fpa%252FUR56671_779dcbeb8f7232928dc4ea3d784b8602.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/51/48517c9fe5e3ff2ce27587624925c3c9/pa/UR56671_779dcbeb8f7232928dc4ea3d784b8602.jpg saved to cache
2026-03-27 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 565e9f4a-3958-5cfb-9584-f9498047c744
2026-03-27 10:49:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 565e9f4a-3958-5cfb-9584-f9498047c744, skipping ID generation
2026-03-27 10:49:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 565e9f4a-3958-5cfb-9584-f9498047c744 with scrape type 1
2026-03-27 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 565e9f4a-3958-5cfb-9584-f9498047c744 sending to next pipeline
2026-03-27 10:49:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 565e9f4a-3958-5cfb-9584-f9498047c744, identifier: UR56671
2026-03-27 10:49:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 565e9f4a-3958-5cfb-9584-f9498047c744 with identifier: UR56671
2026-03-27 10:49:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 565e9f4a-3958-5cfb-9584-f9498047c744 with identifier: UR56671
2026-03-27 10:49:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 565e9f4a-3958-5cfb-9584-f9498047c744 with identifier: UR56671 to the API
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img48/51/48517c9fe5e3ff2ce27587624925c3c9/pa/UR56671_779dcbeb8f7232928dc4ea3d784b8602.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '2.2L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:43:57Z',
 'fuel_type': 'diesel',
 'id': '565e9f4a-3958-5cfb-9584-f9498047c744',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR56671',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 99529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565e9f4a-3958-5cfb-9584-f9498047c744/565e9f4a-3958-5cfb-9584-f9498047c744_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/51/48517c9fe5e3ff2ce27587624925c3c9/pa/UR56671_779dcbeb8f7232928dc4ea3d784b8602.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565e9f4a-3958-5cfb-9584-f9498047c744/565e9f4a-3958-5cfb-9584-f9498047c744_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/51/48517c9fe5e3ff2ce27587624925c3c9/pa/UR56671_9ff5d72fd8e9eb41ff78c142c6dcccfd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565e9f4a-3958-5cfb-9584-f9498047c744/565e9f4a-3958-5cfb-9584-f9498047c744_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/51/48517c9fe5e3ff2ce27587624925c3c9/pa/UR56671_5de7adb7a934418f0dbd78520ed93f14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565e9f4a-3958-5cfb-9584-f9498047c744/565e9f4a-3958-5cfb-9584-f9498047c744_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/51/48517c9fe5e3ff2ce27587624925c3c9/pa/UR56671_16555831736906752dfde8d8661f81e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565e9f4a-3958-5cfb-9584-f9498047c744/565e9f4a-3958-5cfb-9584-f9498047c744_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/51/48517c9fe5e3ff2ce27587624925c3c9/pa/UR56671_f058533d6b6eccc74cde1c5956c07859.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan X-Trail 2.2 dCi Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2005}
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR56671%27 HTTP/1.1" 200 None
2026-03-27 10:49:43 [auto1.de] INFO: Saving data for UR56671: {'created_time': 1774608583.712453, 'last_price_update_time': 1774608583.712464, 'auction_closing_time': 1774716237.0}
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR56671') HTTP/1.1" 204 0
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F52%252F4352441487033681dc4d35ff2c59ac12%252Fpa%252FNV35825_813695275b74d5140b8dba349ea4113b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_813695275b74d5140b8dba349ea4113b.jpg not downloaded yet
2026-03-27 10:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_5ea0bdd6cc204d0ca53c26f51dd3c36c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_57cfe13afd8aa10ca657da156b4514a7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F52%252F4352441487033681dc4d35ff2c59ac12%252Fpa%252FNV35825_b8f17a9c8c09eb6c6c424832c312cbc3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_b8f17a9c8c09eb6c6c424832c312cbc3.jpg not downloaded yet
2026-03-27 10:49:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV10923> (referer: https://www.auto1.com/v1/car-details-view/ZV10923/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016dda90>
2026-03-27 10:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98406f2b-f0be-567c-993e-31d972116fd2/98406f2b-f0be-567c-993e-31d972116fd2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ff3%252F4bf3e1eb38a1b9cc7dc32003f2ba5e57%252Fpa%252FZK76499_d09ba126798a710844277c0d425a10fd.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_d09ba126798a710844277c0d425a10fd.jpg saved to cache
2026-03-27 10:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98406f2b-f0be-567c-993e-31d972116fd2
2026-03-27 10:49:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F52%252F4352441487033681dc4d35ff2c59ac12%252Fpa%252FNV35825_90a93966188a46070f4e94fbf330bd8b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_90a93966188a46070f4e94fbf330bd8b.jpg not downloaded yet
2026-03-27 10:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SK60410/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50049be50>
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0f9732-f4a7-5a17-a2d0-4ab1561931e0/5a0f9732-f4a7-5a17-a2d0-4ab1561931e0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F52%252F4352441487033681dc4d35ff2c59ac12%252Fpa%252FNV35825_5ea0bdd6cc204d0ca53c26f51dd3c36c.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_5ea0bdd6cc204d0ca53c26f51dd3c36c.jpg saved to cache
2026-03-27 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0
2026-03-27 10:49:44 [auto1.de] INFO: Channel: 24h | Page: 48 | totalHits: 10581 | hits on page: 40
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50176aa10>
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0f9732-f4a7-5a17-a2d0-4ab1561931e0/5a0f9732-f4a7-5a17-a2d0-4ab1561931e0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F52%252F4352441487033681dc4d35ff2c59ac12%252Fpa%252FNV35825_57cfe13afd8aa10ca657da156b4514a7.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_57cfe13afd8aa10ca657da156b4514a7.jpg saved to cache
2026-03-27 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0
2026-03-27 10:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_a474d3518497047967cd489fb1050311.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F52%252F4352441487033681dc4d35ff2c59ac12%252Fpa%252FNV35825_61624e8d41516a7646cdf0deaa3ab141.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_61624e8d41516a7646cdf0deaa3ab141.jpg not downloaded yet
2026-03-27 10:49:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_1b561861ddb92467e64df8e78542fec3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_813695275b74d5140b8dba349ea4113b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_b64d13b12f4e2195b37c25864a7a1861.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:44 [auto1.de] INFO: Found listing with ID: VU07666
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU07666%27 HTTP/1.1" 200 None
2026-03-27 10:49:44 [auto1.de] INFO: Scrape type for VU07666: 0
2026-03-27 10:49:44 [auto1.de] INFO: Found listing with ID: VX14305
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14305%27 HTTP/1.1" 200 None
2026-03-27 10:49:44 [auto1.de] INFO: Scrape type for VX14305: 0
2026-03-27 10:49:44 [auto1.de] INFO: Found listing with ID: YU21879
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU21879%27 HTTP/1.1" 200 None
2026-03-27 10:49:44 [auto1.de] INFO: Scrape type for YU21879: 0
2026-03-27 10:49:44 [auto1.de] INFO: Found listing with ID: BP39068
2026-03-27 10:49:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad with identifier: ZV10923
2026-03-27 10:49:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad with scrape type 1
2026-03-27 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F2a%252F132a76305092f4948dfd44160c3efcd9%252Fpa%252FZV10923_37b77246f682e1ded218f999089a3839.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_37b77246f682e1ded218f999089a3839.jpg not downloaded yet
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F52%252F4352441487033681dc4d35ff2c59ac12%252Fpa%252FNV35825_eb33904a71a4221681ec70c3e974cddf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_eb33904a71a4221681ec70c3e974cddf.jpg not downloaded yet
2026-03-27 10:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_be445fe5cae66192ddf11c4c9dc13d64.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:44 [auto1.de] INFO: Found listing with ID: SK60410
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F2a%252F132a76305092f4948dfd44160c3efcd9%252Fpa%252FZV10923_3d55a37fc1c7d9614e100c5c13947f9f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_3d55a37fc1c7d9614e100c5c13947f9f.jpg not downloaded yet
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F52%252F4352441487033681dc4d35ff2c59ac12%252Fpa%252FNV35825_e78c4b842221b9262436b13c52fb31bc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_e78c4b842221b9262436b13c52fb31bc.jpg not downloaded yet
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500396210>
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0f9732-f4a7-5a17-a2d0-4ab1561931e0/5a0f9732-f4a7-5a17-a2d0-4ab1561931e0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F52%252F4352441487033681dc4d35ff2c59ac12%252Fpa%252FNV35825_a474d3518497047967cd489fb1050311.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_a474d3518497047967cd489fb1050311.jpg saved to cache
2026-03-27 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501822550>
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98406f2b-f0be-567c-993e-31d972116fd2/98406f2b-f0be-567c-993e-31d972116fd2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ff3%252F4bf3e1eb38a1b9cc7dc32003f2ba5e57%252Fpa%252FZK76499_1b561861ddb92467e64df8e78542fec3.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_1b561861ddb92467e64df8e78542fec3.jpg saved to cache
2026-03-27 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98406f2b-f0be-567c-993e-31d972116fd2
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50057e950>
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0f9732-f4a7-5a17-a2d0-4ab1561931e0/5a0f9732-f4a7-5a17-a2d0-4ab1561931e0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F52%252F4352441487033681dc4d35ff2c59ac12%252Fpa%252FNV35825_813695275b74d5140b8dba349ea4113b.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_813695275b74d5140b8dba349ea4113b.jpg saved to cache
2026-03-27 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501955390>
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0f9732-f4a7-5a17-a2d0-4ab1561931e0/5a0f9732-f4a7-5a17-a2d0-4ab1561931e0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F52%252F4352441487033681dc4d35ff2c59ac12%252Fpa%252FNV35825_b64d13b12f4e2195b37c25864a7a1861.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_b64d13b12f4e2195b37c25864a7a1861.jpg saved to cache
2026-03-27 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0
2026-03-27 10:49:44 [auto1.de] INFO: Found listing with ID: XS67256
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS67256%27 HTTP/1.1" 200 None
2026-03-27 10:49:44 [auto1.de] INFO: Scrape type for XS67256: 2
2026-03-27 10:49:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e527202-c413-5ec0-8f06-997fa5d36237 with identifier: XS67256
2026-03-27 10:49:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e527202-c413-5ec0-8f06-997fa5d36237 with scrape type 2
2026-03-27 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e527202-c413-5ec0-8f06-997fa5d36237 with scrape type 2
2026-03-27 10:49:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e527202-c413-5ec0-8f06-997fa5d36237, identifier: XS67256
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F2a%252F132a76305092f4948dfd44160c3efcd9%252Fpa%252FZV10923_7febd926e0d27c55158d72ccd5310615.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_7febd926e0d27c55158d72ccd5310615.jpg not downloaded yet
2026-03-27 10:49:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e527202-c413-5ec0-8f06-997fa5d36237 with identifier: XS67256
2026-03-27 10:49:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e527202-c413-5ec0-8f06-997fa5d36237 with identifier: XS67256
2026-03-27 10:49:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e527202-c413-5ec0-8f06-997fa5d36237 with identifier: XS67256 to the API
2026-03-27 10:49:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:15:48Z',
 'fuel_type': 'petrol',
 'id': '3e527202-c413-5ec0-8f06-997fa5d36237',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS67256',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 189175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-30',
 'seller_name': None,
 'title': 'Fiat 500C 0.9 TwinAir Plus',
 'transmission': 'manual',
 'trim': 'TwinAir Plus',
 'year': 2011}
2026-03-27 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS67256%27 HTTP/1.1" 200 None
2026-03-27 10:49:45 [auto1.de] INFO: Saving data for XS67256: {'auction_closing_time': 1774714548.0, 'created_time': 1774350402.095544, 'last_price_update_time': 1774608585.260816}
2026-03-27 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS67256') HTTP/1.1" 204 0
2026-03-27 10:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_90a93966188a46070f4e94fbf330bd8b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_b8f17a9c8c09eb6c6c424832c312cbc3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:45 [auto1.de] INFO: Found listing with ID: CS24568
2026-03-27 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS24568%27 HTTP/1.1" 200 None
2026-03-27 10:49:45 [auto1.de] INFO: Scrape type for CS24568: 2
2026-03-27 10:49:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03179b01-338a-57da-85c5-d3dbbdb45cd8 with identifier: CS24568
2026-03-27 10:49:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03179b01-338a-57da-85c5-d3dbbdb45cd8 with scrape type 2
2026-03-27 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03179b01-338a-57da-85c5-d3dbbdb45cd8 with scrape type 2
2026-03-27 10:49:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03179b01-338a-57da-85c5-d3dbbdb45cd8, identifier: CS24568
2026-03-27 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F2a%252F132a76305092f4948dfd44160c3efcd9%252Fpa%252FZV10923_7e88425b019e1ee760b9f125196b4445.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_7e88425b019e1ee760b9f125196b4445.jpg not downloaded yet
2026-03-27 10:49:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50174b690>
2026-03-27 10:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98406f2b-f0be-567c-993e-31d972116fd2/98406f2b-f0be-567c-993e-31d972116fd2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ff3%252F4bf3e1eb38a1b9cc7dc32003f2ba5e57%252Fpa%252FZK76499_be445fe5cae66192ddf11c4c9dc13d64.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_be445fe5cae66192ddf11c4c9dc13d64.jpg saved to cache
2026-03-27 10:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98406f2b-f0be-567c-993e-31d972116fd2
2026-03-27 10:49:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03179b01-338a-57da-85c5-d3dbbdb45cd8 with identifier: CS24568
2026-03-27 10:49:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03179b01-338a-57da-85c5-d3dbbdb45cd8 with identifier: CS24568
2026-03-27 10:49:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03179b01-338a-57da-85c5-d3dbbdb45cd8 with identifier: CS24568 to the API
2026-03-27 10:49:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:01:37Z',
 'fuel_type': 'petrol',
 'id': '03179b01-338a-57da-85c5-d3dbbdb45cd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS24568',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Leon',
 'odometer': 68574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-24',
 'seller_name': None,
 'title': 'Cupra Leon 2.0 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS24568%27 HTTP/1.1" 200 None
2026-03-27 10:49:46 [auto1.de] INFO: Saving data for CS24568: {'auction_closing_time': 1774713697.0, 'created_time': 1774035480.243479, 'last_price_update_time': 1774608586.204303}
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS24568') HTTP/1.1" 204 0
2026-03-27 10:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_eb33904a71a4221681ec70c3e974cddf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:46 [auto1.de] INFO: Found listing with ID: DV41377
2026-03-27 10:49:46 [auto1.de] INFO: Found listing with ID: RR95104
2026-03-27 10:49:46 [auto1.de] INFO: Found listing with ID: RB29698
2026-03-27 10:49:46 [auto1.de] INFO: Found listing with ID: TJ54274
2026-03-27 10:49:46 [auto1.de] INFO: Found listing with ID: BN99160
2026-03-27 10:49:46 [auto1.de] INFO: Found listing with ID: YS72291
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS72291%27 HTTP/1.1" 200 None
2026-03-27 10:49:46 [auto1.de] INFO: Scrape type for YS72291: 2
2026-03-27 10:49:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afcd1e36-5f40-5674-bdb0-78a09c64f7c4 with identifier: YS72291
2026-03-27 10:49:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afcd1e36-5f40-5674-bdb0-78a09c64f7c4 with scrape type 2
2026-03-27 10:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afcd1e36-5f40-5674-bdb0-78a09c64f7c4 with scrape type 2
2026-03-27 10:49:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afcd1e36-5f40-5674-bdb0-78a09c64f7c4, identifier: YS72291
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F2a%252F132a76305092f4948dfd44160c3efcd9%252Fpa%252FZV10923_a3cca8fc2cf3ffc002035455b806940b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_a3cca8fc2cf3ffc002035455b806940b.jpg not downloaded yet
2026-03-27 10:49:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afcd1e36-5f40-5674-bdb0-78a09c64f7c4 with identifier: YS72291
2026-03-27 10:49:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afcd1e36-5f40-5674-bdb0-78a09c64f7c4 with identifier: YS72291
2026-03-27 10:49:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afcd1e36-5f40-5674-bdb0-78a09c64f7c4 with identifier: YS72291 to the API
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:22:33Z',
 'fuel_type': 'diesel',
 'id': 'afcd1e36-5f40-5674-bdb0-78a09c64f7c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS72291',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 91799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-20',
 'seller_name': None,
 'title': 'Seat Arona 1.6 TDI Xcellence',
 'transmission': 'manual',
 'trim': 'Xcellence',
 'year': 2018}
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS72291%27 HTTP/1.1" 200 None
2026-03-27 10:49:46 [auto1.de] INFO: Saving data for YS72291: {'auction_closing_time': 1774714953.0, 'created_time': 1773226157.857367, 'last_price_update_time': 1774608586.766435}
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS72291') HTTP/1.1" 204 0
2026-03-27 10:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001b9d90>
2026-03-27 10:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0f9732-f4a7-5a17-a2d0-4ab1561931e0/5a0f9732-f4a7-5a17-a2d0-4ab1561931e0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F52%252F4352441487033681dc4d35ff2c59ac12%252Fpa%252FNV35825_90a93966188a46070f4e94fbf330bd8b.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_90a93966188a46070f4e94fbf330bd8b.jpg saved to cache
2026-03-27 10:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0
2026-03-27 10:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002c8810>
2026-03-27 10:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0f9732-f4a7-5a17-a2d0-4ab1561931e0/5a0f9732-f4a7-5a17-a2d0-4ab1561931e0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F52%252F4352441487033681dc4d35ff2c59ac12%252Fpa%252FNV35825_b8f17a9c8c09eb6c6c424832c312cbc3.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_b8f17a9c8c09eb6c6c424832c312cbc3.jpg saved to cache
2026-03-27 10:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0
2026-03-27 10:49:46 [auto1.de] INFO: Found listing with ID: NU40384
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU40384%27 HTTP/1.1" 200 None
2026-03-27 10:49:46 [auto1.de] INFO: Scrape type for NU40384: 2
2026-03-27 10:49:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2508733c-c736-5841-bf1b-aecfddd1804b with identifier: NU40384
2026-03-27 10:49:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2508733c-c736-5841-bf1b-aecfddd1804b with scrape type 2
2026-03-27 10:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2508733c-c736-5841-bf1b-aecfddd1804b with scrape type 2
2026-03-27 10:49:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2508733c-c736-5841-bf1b-aecfddd1804b, identifier: NU40384
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F2a%252F132a76305092f4948dfd44160c3efcd9%252Fpa%252FZV10923_b5939ef986cda815b9f0d3348ddc791c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_b5939ef986cda815b9f0d3348ddc791c.jpg not downloaded yet
2026-03-27 10:49:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2508733c-c736-5841-bf1b-aecfddd1804b with identifier: NU40384
2026-03-27 10:49:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2508733c-c736-5841-bf1b-aecfddd1804b with identifier: NU40384
2026-03-27 10:49:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2508733c-c736-5841-bf1b-aecfddd1804b with identifier: NU40384 to the API
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:21:58Z',
 'fuel_type': 'diesel',
 'id': '2508733c-c736-5841-bf1b-aecfddd1804b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU40384',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 214090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-20',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU40384%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Saving data for NU40384: {'auction_closing_time': 1774714918.0, 'created_time': 1773132508.486764, 'last_price_update_time': 1774608587.381778}
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU40384') HTTP/1.1" 204 0
2026-03-27 10:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019a53d0>
2026-03-27 10:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0f9732-f4a7-5a17-a2d0-4ab1561931e0/5a0f9732-f4a7-5a17-a2d0-4ab1561931e0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F52%252F4352441487033681dc4d35ff2c59ac12%252Fpa%252FNV35825_eb33904a71a4221681ec70c3e974cddf.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_eb33904a71a4221681ec70c3e974cddf.jpg saved to cache
2026-03-27 10:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0
2026-03-27 10:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_7febd926e0d27c55158d72ccd5310615.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: SU61840
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU61840%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Scrape type for SU61840: 1
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F2a%252F132a76305092f4948dfd44160c3efcd9%252Fpa%252FZV10923_9f503a3a5b845cc34c8f52d47b3bc576.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_9f503a3a5b845cc34c8f52d47b3bc576.jpg not downloaded yet
2026-03-27 10:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_7e88425b019e1ee760b9f125196b4445.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: FD22353
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD22353%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Scrape type for FD22353: 1
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F2a%252F132a76305092f4948dfd44160c3efcd9%252Fpa%252FZV10923_9caca97f67caec052a65d79c696997c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_9caca97f67caec052a65d79c696997c0.jpg not downloaded yet
2026-03-27 10:49:47 [auto1.de] INFO: Found listing with ID: WZ92700
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ92700%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [auto1.de] INFO: Scrape type for WZ92700: 2
2026-03-27 10:49:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a0b7c11-2db7-5c80-8844-a0215f1ea09d with identifier: WZ92700
2026-03-27 10:49:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a0b7c11-2db7-5c80-8844-a0215f1ea09d with scrape type 2
2026-03-27 10:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a0b7c11-2db7-5c80-8844-a0215f1ea09d with scrape type 2
2026-03-27 10:49:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a0b7c11-2db7-5c80-8844-a0215f1ea09d, identifier: WZ92700
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F2a%252F132a76305092f4948dfd44160c3efcd9%252Fpa%252FZV10923_b47ec73e17efc000c2580774bdff056f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_b47ec73e17efc000c2580774bdff056f.jpg not downloaded yet
2026-03-27 10:49:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a0b7c11-2db7-5c80-8844-a0215f1ea09d with identifier: WZ92700
2026-03-27 10:49:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a0b7c11-2db7-5c80-8844-a0215f1ea09d with identifier: WZ92700
2026-03-27 10:49:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a0b7c11-2db7-5c80-8844-a0215f1ea09d with identifier: WZ92700 to the API
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:55:10Z',
 'fuel_type': 'petrol',
 'id': '9a0b7c11-2db7-5c80-8844-a0215f1ea09d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ92700',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 149302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-04',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport 4Motion',
 'year': 2018}
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ92700%27 HTTP/1.1" 200 None
2026-03-27 10:49:48 [auto1.de] INFO: Saving data for WZ92700: {'auction_closing_time': 1774716910.0, 'created_time': 1773131998.002393, 'last_price_update_time': 1774608588.098492}
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ92700') HTTP/1.1" 204 0
2026-03-27 10:49:48 [auto1.de] INFO: Found listing with ID: XN26589
2026-03-27 10:49:48 [auto1.de] INFO: Found listing with ID: HP95404
2026-03-27 10:49:48 [auto1.de] INFO: Found listing with ID: XY63966
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY63966%27 HTTP/1.1" 200 None
2026-03-27 10:49:48 [auto1.de] INFO: Scrape type for XY63966: 1
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F2a%252F132a76305092f4948dfd44160c3efcd9%252Fpa%252FZV10923_d62741caff560f4bb5fcc49bd757a79d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_d62741caff560f4bb5fcc49bd757a79d.jpg not downloaded yet
2026-03-27 10:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK35927/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500470750>
2026-03-27 10:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad/998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F2a%252F132a76305092f4948dfd44160c3efcd9%252Fpa%252FZV10923_7febd926e0d27c55158d72ccd5310615.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_7febd926e0d27c55158d72ccd5310615.jpg saved to cache
2026-03-27 10:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad
2026-03-27 10:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018298d0>
2026-03-27 10:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad/998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F2a%252F132a76305092f4948dfd44160c3efcd9%252Fpa%252FZV10923_7e88425b019e1ee760b9f125196b4445.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_7e88425b019e1ee760b9f125196b4445.jpg saved to cache
2026-03-27 10:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad
2026-03-27 10:49:48 [auto1.de] INFO: Found listing with ID: AB73354
2026-03-27 10:49:48 [auto1.de] INFO: Found listing with ID: FZ45055
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ45055%27 HTTP/1.1" 200 None
2026-03-27 10:49:48 [auto1.de] INFO: Scrape type for FZ45055: 2
2026-03-27 10:49:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fef3f42b-d660-505b-abd0-a09fd8ac0fd0 with identifier: FZ45055
2026-03-27 10:49:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fef3f42b-d660-505b-abd0-a09fd8ac0fd0 with scrape type 2
2026-03-27 10:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fef3f42b-d660-505b-abd0-a09fd8ac0fd0 with scrape type 2
2026-03-27 10:49:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fef3f42b-d660-505b-abd0-a09fd8ac0fd0, identifier: FZ45055
2026-03-27 10:49:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fef3f42b-d660-505b-abd0-a09fd8ac0fd0 with identifier: FZ45055
2026-03-27 10:49:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fef3f42b-d660-505b-abd0-a09fd8ac0fd0 with identifier: FZ45055
2026-03-27 10:49:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fef3f42b-d660-505b-abd0-a09fd8ac0fd0 with identifier: FZ45055 to the API
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:01:49Z',
 'fuel_type': 'diesel',
 'id': 'fef3f42b-d660-505b-abd0-a09fd8ac0fd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ45055',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Scala',
 'odometer': 132822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-31',
 'seller_name': None,
 'title': 'Skoda Scala 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2020}
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ45055%27 HTTP/1.1" 200 None
2026-03-27 10:49:48 [auto1.de] INFO: Saving data for FZ45055: {'auction_closing_time': 1774713709.0, 'created_time': 1773992658.24959, 'last_price_update_time': 1774608588.811915}
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ45055') HTTP/1.1" 204 0
2026-03-27 10:49:48 [auto1.de] INFO: Found listing with ID: AR79819
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR79819%27 HTTP/1.1" 200 None
2026-03-27 10:49:48 [auto1.de] INFO: Scrape type for AR79819: 2
2026-03-27 10:49:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f48bcb96-79e0-5a94-aa7e-0b74b41c6676 with identifier: AR79819
2026-03-27 10:49:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f48bcb96-79e0-5a94-aa7e-0b74b41c6676 with scrape type 2
2026-03-27 10:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f48bcb96-79e0-5a94-aa7e-0b74b41c6676 with scrape type 2
2026-03-27 10:49:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f48bcb96-79e0-5a94-aa7e-0b74b41c6676, identifier: AR79819
2026-03-27 10:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DN13458> (referer: https://www.auto1.com/v1/car-details-view/DN13458/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f48bcb96-79e0-5a94-aa7e-0b74b41c6676 with identifier: AR79819
2026-03-27 10:49:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f48bcb96-79e0-5a94-aa7e-0b74b41c6676 with identifier: AR79819
2026-03-27 10:49:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f48bcb96-79e0-5a94-aa7e-0b74b41c6676 with identifier: AR79819 to the API
2026-03-27 10:49:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:03:15Z',
 'fuel_type': 'diesel',
 'id': 'f48bcb96-79e0-5a94-aa7e-0b74b41c6676',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR79819',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 201775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-11',
 'seller_name': None,
 'title': 'Skoda Fabia 1.6 TDI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2012}
2026-03-27 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR79819%27 HTTP/1.1" 200 None
2026-03-27 10:49:49 [auto1.de] INFO: Saving data for AR79819: {'auction_closing_time': 1774713795.0, 'created_time': 1773831137.132372, 'last_price_update_time': 1774608589.257264}
2026-03-27 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR79819') HTTP/1.1" 204 0
2026-03-27 10:49:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:49 [auto1.de] INFO: Found listing with ID: SZ74678
2026-03-27 10:49:49 [auto1.de] INFO: Found listing with ID: RT76020
2026-03-27 10:49:49 [auto1.de] INFO: Found listing with ID: EL90308
2026-03-27 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL90308%27 HTTP/1.1" 200 None
2026-03-27 10:49:49 [auto1.de] INFO: Scrape type for EL90308: 2
2026-03-27 10:49:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f652e903-b139-5056-98e1-d42b447e55eb with identifier: EL90308
2026-03-27 10:49:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f652e903-b139-5056-98e1-d42b447e55eb with scrape type 2
2026-03-27 10:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f652e903-b139-5056-98e1-d42b447e55eb with scrape type 2
2026-03-27 10:49:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f652e903-b139-5056-98e1-d42b447e55eb, identifier: EL90308
2026-03-27 10:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA07752> (referer: https://www.auto1.com/v1/car-details-view/RA07752/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f652e903-b139-5056-98e1-d42b447e55eb with identifier: EL90308
2026-03-27 10:49:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f652e903-b139-5056-98e1-d42b447e55eb with identifier: EL90308
2026-03-27 10:49:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f652e903-b139-5056-98e1-d42b447e55eb with identifier: EL90308 to the API
2026-03-27 10:49:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:47:15Z',
 'fuel_type': 'diesel',
 'id': 'f652e903-b139-5056-98e1-d42b447e55eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL90308',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 152943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-25',
 'seller_name': None,
 'title': 'Opel Meriva 1.3 CDTI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-27 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL90308%27 HTTP/1.1" 200 None
2026-03-27 10:49:49 [auto1.de] INFO: Saving data for EL90308: {'auction_closing_time': 1774716435.0, 'created_time': 1773136515.237769, 'last_price_update_time': 1774608589.744116}
2026-03-27 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL90308') HTTP/1.1" 204 0
2026-03-27 10:49:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_d62741caff560f4bb5fcc49bd757a79d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:49 [auto1.de] INFO: Found listing with ID: GV00084
2026-03-27 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV00084%27 HTTP/1.1" 200 None
2026-03-27 10:49:49 [auto1.de] INFO: Scrape type for GV00084: 2
2026-03-27 10:49:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb777bb0-50dc-5dcf-8f94-81f9a66d26b6 with identifier: GV00084
2026-03-27 10:49:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb777bb0-50dc-5dcf-8f94-81f9a66d26b6 with scrape type 2
2026-03-27 10:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb777bb0-50dc-5dcf-8f94-81f9a66d26b6 with scrape type 2
2026-03-27 10:49:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb777bb0-50dc-5dcf-8f94-81f9a66d26b6, identifier: GV00084
2026-03-27 10:49:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb777bb0-50dc-5dcf-8f94-81f9a66d26b6 with identifier: GV00084
2026-03-27 10:49:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb777bb0-50dc-5dcf-8f94-81f9a66d26b6 with identifier: GV00084
2026-03-27 10:49:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb777bb0-50dc-5dcf-8f94-81f9a66d26b6 with identifier: GV00084 to the API
2026-03-27 10:49:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:15:54Z',
 'fuel_type': 'diesel',
 'id': 'fb777bb0-50dc-5dcf-8f94-81f9a66d26b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV00084',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 123712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-24',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2018}
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV00084%27 HTTP/1.1" 200 None
2026-03-27 10:49:50 [auto1.de] INFO: Saving data for GV00084: {'auction_closing_time': 1774714554.0, 'created_time': 1774002225.84921, 'last_price_update_time': 1774608590.210097}
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV00084') HTTP/1.1" 204 0
2026-03-27 10:49:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 658e31ff-5926-5c1e-878e-d24a5d33b43d with identifier: DN13458
2026-03-27 10:49:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 658e31ff-5926-5c1e-878e-d24a5d33b43d with scrape type 1
2026-03-27 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 658e31ff-5926-5c1e-878e-d24a5d33b43d
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F2d%252Fca2da100d7e2baf2011fdeb5e4749d24%252Fpa%252FDN13458_0347166d0336caa293a782cd475c7c2d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/2d/ca2da100d7e2baf2011fdeb5e4749d24/pa/DN13458_0347166d0336caa293a782cd475c7c2d.jpg already downloaded
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F2d%252Fca2da100d7e2baf2011fdeb5e4749d24%252Fpa%252FDN13458_270b00c774c3fc597206893146d9aba8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/2d/ca2da100d7e2baf2011fdeb5e4749d24/pa/DN13458_270b00c774c3fc597206893146d9aba8.jpg already downloaded
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F2d%252Fca2da100d7e2baf2011fdeb5e4749d24%252Fpa%252FDN13458_52d1273df22ca8aaba3e9432dd6ae40d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/2d/ca2da100d7e2baf2011fdeb5e4749d24/pa/DN13458_52d1273df22ca8aaba3e9432dd6ae40d.jpg already downloaded
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F2d%252Fca2da100d7e2baf2011fdeb5e4749d24%252Fpa%252FDN13458_d32ec41e6d8309cf987aa2e66681d2cb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/2d/ca2da100d7e2baf2011fdeb5e4749d24/pa/DN13458_d32ec41e6d8309cf987aa2e66681d2cb.jpg already downloaded
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F2d%252Fca2da100d7e2baf2011fdeb5e4749d24%252Fpa%252FDN13458_3301502225fe07d2bc893ad5ad7ef349.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/2d/ca2da100d7e2baf2011fdeb5e4749d24/pa/DN13458_3301502225fe07d2bc893ad5ad7ef349.jpg already downloaded
2026-03-27 10:49:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 658e31ff-5926-5c1e-878e-d24a5d33b43d, identifier: DN13458
2026-03-27 10:49:50 [auto1.de] INFO: Found listing with ID: SA17140
2026-03-27 10:49:50 [auto1.de] INFO: Found listing with ID: MH67551
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67551%27 HTTP/1.1" 200 None
2026-03-27 10:49:50 [auto1.de] INFO: Scrape type for MH67551: 2
2026-03-27 10:49:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a775d95-122c-5cc6-afc1-2c51c9555770 with identifier: MH67551
2026-03-27 10:49:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a775d95-122c-5cc6-afc1-2c51c9555770 with scrape type 2
2026-03-27 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a775d95-122c-5cc6-afc1-2c51c9555770 with scrape type 2
2026-03-27 10:49:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a775d95-122c-5cc6-afc1-2c51c9555770, identifier: MH67551
2026-03-27 10:49:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 658e31ff-5926-5c1e-878e-d24a5d33b43d with identifier: DN13458
2026-03-27 10:49:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 658e31ff-5926-5c1e-878e-d24a5d33b43d with identifier: DN13458
2026-03-27 10:49:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 658e31ff-5926-5c1e-878e-d24a5d33b43d with identifier: DN13458 to the API
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DN13458>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:22:38Z',
 'fuel_type': 'petrol',
 'id': '658e31ff-5926-5c1e-878e-d24a5d33b43d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN13458',
 'listing': 'auction',
 'location': 'DE, Schweitenkirchen',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 174340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgca/2d/ca2da100d7e2baf2011fdeb5e4749d24/pa/DN13458_0347166d0336caa293a782cd475c7c2d.jpg',
                'https://img-pa.auto1.com/imgca/2d/ca2da100d7e2baf2011fdeb5e4749d24/pa/DN13458_270b00c774c3fc597206893146d9aba8.jpg',
                'https://img-pa.auto1.com/imgca/2d/ca2da100d7e2baf2011fdeb5e4749d24/pa/DN13458_52d1273df22ca8aaba3e9432dd6ae40d.jpg',
                'https://img-pa.auto1.com/imgca/2d/ca2da100d7e2baf2011fdeb5e4749d24/pa/DN13458_d32ec41e6d8309cf987aa2e66681d2cb.jpg',
                'https://img-pa.auto1.com/imgca/2d/ca2da100d7e2baf2011fdeb5e4749d24/pa/DN13458_3301502225fe07d2bc893ad5ad7ef349.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_658e31ff-5926-5c1e-878e-d24a5d33b43d/658e31ff-5926-5c1e-878e-d24a5d33b43d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/2d/ca2da100d7e2baf2011fdeb5e4749d24/pa/DN13458_0347166d0336caa293a782cd475c7c2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_658e31ff-5926-5c1e-878e-d24a5d33b43d/658e31ff-5926-5c1e-878e-d24a5d33b43d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/2d/ca2da100d7e2baf2011fdeb5e4749d24/pa/DN13458_270b00c774c3fc597206893146d9aba8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_658e31ff-5926-5c1e-878e-d24a5d33b43d/658e31ff-5926-5c1e-878e-d24a5d33b43d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/2d/ca2da100d7e2baf2011fdeb5e4749d24/pa/DN13458_52d1273df22ca8aaba3e9432dd6ae40d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_658e31ff-5926-5c1e-878e-d24a5d33b43d/658e31ff-5926-5c1e-878e-d24a5d33b43d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/2d/ca2da100d7e2baf2011fdeb5e4749d24/pa/DN13458_d32ec41e6d8309cf987aa2e66681d2cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_658e31ff-5926-5c1e-878e-d24a5d33b43d/658e31ff-5926-5c1e-878e-d24a5d33b43d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/2d/ca2da100d7e2baf2011fdeb5e4749d24/pa/DN13458_3301502225fe07d2bc893ad5ad7ef349.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 Tour Edition',
 'transmission': 'manual',
 'trim': 'Tour Edition',
 'year': 2007}
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN13458%27 HTTP/1.1" 200 None
2026-03-27 10:49:50 [auto1.de] INFO: Saving data for DN13458: {'created_time': 1774608590.887549, 'last_price_update_time': 1774608590.887561, 'auction_closing_time': 1774714958.0}
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN13458') HTTP/1.1" 204 0
2026-03-27 10:49:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a775d95-122c-5cc6-afc1-2c51c9555770 with identifier: MH67551
2026-03-27 10:49:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a775d95-122c-5cc6-afc1-2c51c9555770 with identifier: MH67551
2026-03-27 10:49:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a775d95-122c-5cc6-afc1-2c51c9555770 with identifier: MH67551 to the API
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:41:41Z',
 'fuel_type': 'diesel',
 'id': '1a775d95-122c-5cc6-afc1-2c51c9555770',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH67551',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 145093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-19',
 'seller_name': None,
 'title': 'Skoda Roomster 1.9 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2007}
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67551%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [auto1.de] INFO: Saving data for MH67551: {'auction_closing_time': 1774716101.0, 'created_time': 1774350356.484311, 'last_price_update_time': 1774608591.306607}
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH67551') HTTP/1.1" 204 0
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: VY78817
2026-03-27 10:49:51 [auto1.de] INFO: Found listing with ID: HN51683
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN51683%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [auto1.de] INFO: Scrape type for HN51683: 2
2026-03-27 10:49:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef40ab49-c4ee-54d1-b189-3b30df34a458 with identifier: HN51683
2026-03-27 10:49:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef40ab49-c4ee-54d1-b189-3b30df34a458 with scrape type 2
2026-03-27 10:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef40ab49-c4ee-54d1-b189-3b30df34a458 with scrape type 2
2026-03-27 10:49:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef40ab49-c4ee-54d1-b189-3b30df34a458, identifier: HN51683
2026-03-27 10:49:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cc68881-27cf-58d2-8d57-2c290ae3eb12 with identifier: RA07752
2026-03-27 10:49:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cc68881-27cf-58d2-8d57-2c290ae3eb12 with scrape type 1
2026-03-27 10:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1cc68881-27cf-58d2-8d57-2c290ae3eb12
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa1%252Fb2a1b930e64ac2a1887acb562080b834%252Fpa%252FRA07752_7899a05ec06040decef130ede7ca18da.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_7899a05ec06040decef130ede7ca18da.jpg already downloaded
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa1%252Fb2a1b930e64ac2a1887acb562080b834%252Fpa%252FRA07752_e0060274440f4af217f4adb850f99cff.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_e0060274440f4af217f4adb850f99cff.jpg already downloaded
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa1%252Fb2a1b930e64ac2a1887acb562080b834%252Fpa%252FRA07752_e6abe4051e0d41d46ae22408febe0b83.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_e6abe4051e0d41d46ae22408febe0b83.jpg already downloaded
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa1%252Fb2a1b930e64ac2a1887acb562080b834%252Fpa%252FRA07752_0767f6a49992d228de905386cbe505d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_0767f6a49992d228de905386cbe505d6.jpg already downloaded
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa1%252Fb2a1b930e64ac2a1887acb562080b834%252Fpa%252FRA07752_28e73c2ec1aceee7a00ef843c60551cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_28e73c2ec1aceee7a00ef843c60551cf.jpg already downloaded
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa1%252Fb2a1b930e64ac2a1887acb562080b834%252Fpa%252FRA07752_d648f87f227d0e5ae99ea32c1fd2d364.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_d648f87f227d0e5ae99ea32c1fd2d364.jpg already downloaded
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa1%252Fb2a1b930e64ac2a1887acb562080b834%252Fpa%252FRA07752_6ee4bec3e261034e07e2d177c5a9c86e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_6ee4bec3e261034e07e2d177c5a9c86e.jpg already downloaded
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa1%252Fb2a1b930e64ac2a1887acb562080b834%252Fpa%252FRA07752_c9d856478c3b51b43458d352779f840f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_c9d856478c3b51b43458d352779f840f.jpg already downloaded
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa1%252Fb2a1b930e64ac2a1887acb562080b834%252Fpa%252FRA07752_fb2ffbe836c6d914f5945e7a1173d0e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_fb2ffbe836c6d914f5945e7a1173d0e3.jpg already downloaded
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fa1%252Fb2a1b930e64ac2a1887acb562080b834%252Fpa%252FRA07752_837cea38ac561853d1d500866d85fe6c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_837cea38ac561853d1d500866d85fe6c.jpg already downloaded
2026-03-27 10:49:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cc68881-27cf-58d2-8d57-2c290ae3eb12, identifier: RA07752
2026-03-27 10:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501841d50>
2026-03-27 10:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad/998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F2a%252F132a76305092f4948dfd44160c3efcd9%252Fpa%252FZV10923_d62741caff560f4bb5fcc49bd757a79d.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_d62741caff560f4bb5fcc49bd757a79d.jpg saved to cache
2026-03-27 10:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad
2026-03-27 10:49:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef40ab49-c4ee-54d1-b189-3b30df34a458 with identifier: HN51683
2026-03-27 10:49:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef40ab49-c4ee-54d1-b189-3b30df34a458 with identifier: HN51683
2026-03-27 10:49:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef40ab49-c4ee-54d1-b189-3b30df34a458 with identifier: HN51683 to the API
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:59:23Z',
 'fuel_type': 'petrol',
 'id': 'ef40ab49-c4ee-54d1-b189-3b30df34a458',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN51683',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 95167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-26',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2013}
2026-03-27 10:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN51683%27 HTTP/1.1" 200 None
2026-03-27 10:49:52 [auto1.de] INFO: Saving data for HN51683: {'auction_closing_time': 1774717163.0, 'created_time': 1774034602.752146, 'last_price_update_time': 1774608592.109757}
2026-03-27 10:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN51683') HTTP/1.1" 204 0
2026-03-27 10:49:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cc68881-27cf-58d2-8d57-2c290ae3eb12 with identifier: RA07752
2026-03-27 10:49:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cc68881-27cf-58d2-8d57-2c290ae3eb12 with identifier: RA07752
2026-03-27 10:49:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cc68881-27cf-58d2-8d57-2c290ae3eb12 with identifier: RA07752 to the API
2026-03-27 10:49:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RA07752>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:14:30Z',
 'fuel_type': 'petrol',
 'id': '1cc68881-27cf-58d2-8d57-2c290ae3eb12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA07752',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 70640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_7899a05ec06040decef130ede7ca18da.jpg',
                'https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_e0060274440f4af217f4adb850f99cff.jpg',
                'https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_e6abe4051e0d41d46ae22408febe0b83.jpg',
                'https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_0767f6a49992d228de905386cbe505d6.jpg',
                'https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_28e73c2ec1aceee7a00ef843c60551cf.jpg',
                'https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_d648f87f227d0e5ae99ea32c1fd2d364.jpg',
                'https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_6ee4bec3e261034e07e2d177c5a9c86e.jpg',
                'https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_c9d856478c3b51b43458d352779f840f.jpg',
                'https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_fb2ffbe836c6d914f5945e7a1173d0e3.jpg',
                'https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_837cea38ac561853d1d500866d85fe6c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc68881-27cf-58d2-8d57-2c290ae3eb12/1cc68881-27cf-58d2-8d57-2c290ae3eb12_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_7899a05ec06040decef130ede7ca18da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc68881-27cf-58d2-8d57-2c290ae3eb12/1cc68881-27cf-58d2-8d57-2c290ae3eb12_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_e0060274440f4af217f4adb850f99cff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc68881-27cf-58d2-8d57-2c290ae3eb12/1cc68881-27cf-58d2-8d57-2c290ae3eb12_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_e6abe4051e0d41d46ae22408febe0b83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc68881-27cf-58d2-8d57-2c290ae3eb12/1cc68881-27cf-58d2-8d57-2c290ae3eb12_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_0767f6a49992d228de905386cbe505d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc68881-27cf-58d2-8d57-2c290ae3eb12/1cc68881-27cf-58d2-8d57-2c290ae3eb12_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_28e73c2ec1aceee7a00ef843c60551cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc68881-27cf-58d2-8d57-2c290ae3eb12/1cc68881-27cf-58d2-8d57-2c290ae3eb12_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_d648f87f227d0e5ae99ea32c1fd2d364.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc68881-27cf-58d2-8d57-2c290ae3eb12/1cc68881-27cf-58d2-8d57-2c290ae3eb12_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_6ee4bec3e261034e07e2d177c5a9c86e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc68881-27cf-58d2-8d57-2c290ae3eb12/1cc68881-27cf-58d2-8d57-2c290ae3eb12_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_c9d856478c3b51b43458d352779f840f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc68881-27cf-58d2-8d57-2c290ae3eb12/1cc68881-27cf-58d2-8d57-2c290ae3eb12_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_fb2ffbe836c6d914f5945e7a1173d0e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc68881-27cf-58d2-8d57-2c290ae3eb12/1cc68881-27cf-58d2-8d57-2c290ae3eb12_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/a1/b2a1b930e64ac2a1887acb562080b834/pa/RA07752_837cea38ac561853d1d500866d85fe6c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI Performance BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI Performance BlueMotion',
 'year': 2017}
2026-03-27 10:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA07752%27 HTTP/1.1" 200 None
2026-03-27 10:49:52 [auto1.de] INFO: Saving data for RA07752: {'created_time': 1774608592.55816, 'last_price_update_time': 1774608592.558174, 'auction_closing_time': 1774714470.0}
2026-03-27 10:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA07752') HTTP/1.1" 204 0
2026-03-27 10:49:52 [auto1.de] INFO: Found listing with ID: VT53198
2026-03-27 10:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT53198%27 HTTP/1.1" 200 None
2026-03-27 10:49:52 [auto1.de] INFO: Scrape type for VT53198: 1
2026-03-27 10:49:52 [auto1.de] INFO: Found listing with ID: AY50267
2026-03-27 10:49:52 [auto1.de] INFO: Found listing with ID: HP12091
2026-03-27 10:49:52 [auto1.de] INFO: Found listing with ID: PB00515
2026-03-27 10:49:52 [auto1.de] INFO: Found listing with ID: XX92411
2026-03-27 10:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX92411%27 HTTP/1.1" 200 None
2026-03-27 10:49:52 [auto1.de] INFO: Scrape type for XX92411: 1
2026-03-27 10:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_b9f08f98700370d8959cefcd7ab6ee40.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:52 [auto1.de] INFO: Found listing with ID: PD95192
2026-03-27 10:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD95192%27 HTTP/1.1" 200 None
2026-03-27 10:49:52 [auto1.de] INFO: Scrape type for PD95192: 2
2026-03-27 10:49:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb with identifier: PD95192
2026-03-27 10:49:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb with scrape type 2
2026-03-27 10:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb with scrape type 2
2026-03-27 10:49:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb, identifier: PD95192
2026-03-27 10:49:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb with identifier: PD95192
2026-03-27 10:49:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb with identifier: PD95192
2026-03-27 10:49:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb with identifier: PD95192 to the API
2026-03-27 10:49:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 152,
 'expiration_date': '2026-03-28T16:10:00Z',
 'fuel_type': 'petrol',
 'id': 'b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD95192',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 262858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-02',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2009}
2026-03-27 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD95192%27 HTTP/1.1" 200 None
2026-03-27 10:49:53 [auto1.de] INFO: Saving data for PD95192: {'auction_closing_time': 1774714200.0, 'created_time': 1773230521.43815, 'last_price_update_time': 1774608593.060295}
2026-03-27 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD95192') HTTP/1.1" 204 0
2026-03-27 10:49:53 [auto1.de] INFO: Found listing with ID: GV20028
2026-03-27 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV20028%27 HTTP/1.1" 200 None
2026-03-27 10:49:53 [auto1.de] INFO: Scrape type for GV20028: 2
2026-03-27 10:49:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3136b3ae-e420-5266-906c-a11d1d526dfd with identifier: GV20028
2026-03-27 10:49:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3136b3ae-e420-5266-906c-a11d1d526dfd with scrape type 2
2026-03-27 10:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3136b3ae-e420-5266-906c-a11d1d526dfd with scrape type 2
2026-03-27 10:49:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3136b3ae-e420-5266-906c-a11d1d526dfd, identifier: GV20028
2026-03-27 10:49:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3136b3ae-e420-5266-906c-a11d1d526dfd with identifier: GV20028
2026-03-27 10:49:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3136b3ae-e420-5266-906c-a11d1d526dfd with identifier: GV20028
2026-03-27 10:49:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3136b3ae-e420-5266-906c-a11d1d526dfd with identifier: GV20028 to the API
2026-03-27 10:49:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:32:23Z',
 'fuel_type': 'diesel',
 'id': '3136b3ae-e420-5266-906c-a11d1d526dfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV20028',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 234382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-16',
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-03-27 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV20028%27 HTTP/1.1" 200 None
2026-03-27 10:49:53 [auto1.de] INFO: Saving data for GV20028: {'auction_closing_time': 1774715543.0, 'created_time': 1774349872.15789, 'last_price_update_time': 1774608593.518175}
2026-03-27 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV20028') HTTP/1.1" 204 0
2026-03-27 10:49:53 [auto1.de] INFO: Found listing with ID: NY45710
2026-03-27 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY45710%27 HTTP/1.1" 200 None
2026-03-27 10:49:53 [auto1.de] INFO: Scrape type for NY45710: 2
2026-03-27 10:49:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55e1c178-7256-522c-a1ef-c7ba89be420c with identifier: NY45710
2026-03-27 10:49:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55e1c178-7256-522c-a1ef-c7ba89be420c with scrape type 2
2026-03-27 10:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55e1c178-7256-522c-a1ef-c7ba89be420c with scrape type 2
2026-03-27 10:49:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55e1c178-7256-522c-a1ef-c7ba89be420c, identifier: NY45710
2026-03-27 10:49:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55e1c178-7256-522c-a1ef-c7ba89be420c with identifier: NY45710
2026-03-27 10:49:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55e1c178-7256-522c-a1ef-c7ba89be420c with identifier: NY45710
2026-03-27 10:49:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55e1c178-7256-522c-a1ef-c7ba89be420c with identifier: NY45710 to the API
2026-03-27 10:49:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:37:28Z',
 'fuel_type': 'diesel',
 'id': '55e1c178-7256-522c-a1ef-c7ba89be420c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY45710',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 110885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-03',
 'seller_name': None,
 'title': 'Audi Q2 35 TDI quattro advanced',
 'transmission': 'automatic',
 'trim': 'quattro advanced',
 'year': 2022}
2026-03-27 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY45710%27 HTTP/1.1" 200 None
2026-03-27 10:49:54 [auto1.de] INFO: Saving data for NY45710: {'auction_closing_time': 1774715848.0, 'created_time': 1774035460.117756, 'last_price_update_time': 1774608594.024703}
2026-03-27 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY45710') HTTP/1.1" 204 0
2026-03-27 10:49:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016b3e90>
2026-03-27 10:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98406f2b-f0be-567c-993e-31d972116fd2/98406f2b-f0be-567c-993e-31d972116fd2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ff3%252F4bf3e1eb38a1b9cc7dc32003f2ba5e57%252Fpa%252FZK76499_b9f08f98700370d8959cefcd7ab6ee40.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_b9f08f98700370d8959cefcd7ab6ee40.jpg saved to cache
2026-03-27 10:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98406f2b-f0be-567c-993e-31d972116fd2
2026-03-27 10:49:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98406f2b-f0be-567c-993e-31d972116fd2, skipping ID generation
2026-03-27 10:49:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98406f2b-f0be-567c-993e-31d972116fd2 with scrape type 1
2026-03-27 10:49:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98406f2b-f0be-567c-993e-31d972116fd2 sending to next pipeline
2026-03-27 10:49:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98406f2b-f0be-567c-993e-31d972116fd2, identifier: ZK76499
2026-03-27 10:49:54 [auto1.de] INFO: Found listing with ID: ZE10872
2026-03-27 10:49:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98406f2b-f0be-567c-993e-31d972116fd2 with identifier: ZK76499
2026-03-27 10:49:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98406f2b-f0be-567c-993e-31d972116fd2 with identifier: ZK76499
2026-03-27 10:49:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98406f2b-f0be-567c-993e-31d972116fd2 with identifier: ZK76499 to the API
2026-03-27 10:49:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_b9f08f98700370d8959cefcd7ab6ee40.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:53:28Z',
 'fuel_type': 'diesel',
 'id': '98406f2b-f0be-567c-993e-31d972116fd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK76499',
 'listing': 'auction',
 'location': 'DE, Chemnitz',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 142280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98406f2b-f0be-567c-993e-31d972116fd2/98406f2b-f0be-567c-993e-31d972116fd2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_1b561861ddb92467e64df8e78542fec3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98406f2b-f0be-567c-993e-31d972116fd2/98406f2b-f0be-567c-993e-31d972116fd2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3034681,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_b9f08f98700370d8959cefcd7ab6ee40.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98406f2b-f0be-567c-993e-31d972116fd2/98406f2b-f0be-567c-993e-31d972116fd2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_d09ba126798a710844277c0d425a10fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98406f2b-f0be-567c-993e-31d972116fd2/98406f2b-f0be-567c-993e-31d972116fd2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3120493,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_bd3d7617327252c66255dbb843acc086.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98406f2b-f0be-567c-993e-31d972116fd2/98406f2b-f0be-567c-993e-31d972116fd2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2764683,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_be445fe5cae66192ddf11c4c9dc13d64.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98406f2b-f0be-567c-993e-31d972116fd2/98406f2b-f0be-567c-993e-31d972116fd2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_40d2f35d2846a83905880a93783b2c04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98406f2b-f0be-567c-993e-31d972116fd2/98406f2b-f0be-567c-993e-31d972116fd2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2687669,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_f32e02a3f714d0bb6153c83483113286.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98406f2b-f0be-567c-993e-31d972116fd2/98406f2b-f0be-567c-993e-31d972116fd2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2557566,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_f387786936792de22e5bae8bf0690919.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98406f2b-f0be-567c-993e-31d972116fd2/98406f2b-f0be-567c-993e-31d972116fd2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_33e0bd24c90a1f41c0a91f0ecec6a960.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98406f2b-f0be-567c-993e-31d972116fd2/98406f2b-f0be-567c-993e-31d972116fd2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2991908,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/f3/4bf3e1eb38a1b9cc7dc32003f2ba5e57/pa/ZK76499_d67a395a8fc7df6f71111de3d70182ed.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda CR-V 1.6 DTEC Executive 4WD',
 'transmission': 'automatic',
 'trim': 'Executive 4WD',
 'year': 2015}
2026-03-27 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK76499%27 HTTP/1.1" 200 None
2026-03-27 10:49:54 [auto1.de] INFO: Saving data for ZK76499: {'created_time': 1774608594.654458, 'last_price_update_time': 1774608594.654471, 'auction_closing_time': 1774716808.0}
2026-03-27 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK76499') HTTP/1.1" 204 0
2026-03-27 10:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP39068> (referer: https://www.auto1.com/v1/car-details-view/BP39068/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_9f503a3a5b845cc34c8f52d47b3bc576.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_b5939ef986cda815b9f0d3348ddc791c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_b47ec73e17efc000c2580774bdff056f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:54 [auto1.de] INFO: Channel: 24h | Page: 49 | totalHits: 10582 | hits on page: 40
2026-03-27 10:49:54 [auto1.de] INFO: Found listing with ID: ZE10872
2026-03-27 10:49:54 [auto1.de] INFO: Found listing with ID: ZV16812
2026-03-27 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV16812%27 HTTP/1.1" 200 None
2026-03-27 10:49:54 [auto1.de] INFO: Scrape type for ZV16812: 2
2026-03-27 10:49:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6edd53f7-01e8-545c-81f6-f90a66a24b4d with identifier: ZV16812
2026-03-27 10:49:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6edd53f7-01e8-545c-81f6-f90a66a24b4d with scrape type 2
2026-03-27 10:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6edd53f7-01e8-545c-81f6-f90a66a24b4d with scrape type 2
2026-03-27 10:49:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6edd53f7-01e8-545c-81f6-f90a66a24b4d, identifier: ZV16812
2026-03-27 10:49:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6edd53f7-01e8-545c-81f6-f90a66a24b4d with identifier: ZV16812
2026-03-27 10:49:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6edd53f7-01e8-545c-81f6-f90a66a24b4d with identifier: ZV16812
2026-03-27 10:49:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6edd53f7-01e8-545c-81f6-f90a66a24b4d with identifier: ZV16812 to the API
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:23:57Z',
 'fuel_type': 'petrol',
 'id': '6edd53f7-01e8-545c-81f6-f90a66a24b4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV16812',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 143767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-07',
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV16812%27 HTTP/1.1" 200 None
2026-03-27 10:49:55 [auto1.de] INFO: Saving data for ZV16812: {'auction_closing_time': 1774715037.0, 'created_time': 1773945887.9383, 'last_price_update_time': 1774608595.295863}
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV16812') HTTP/1.1" 204 0
2026-03-27 10:49:55 [auto1.de] INFO: Found listing with ID: CF89653
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF89653%27 HTTP/1.1" 200 None
2026-03-27 10:49:55 [auto1.de] INFO: Scrape type for CF89653: 2
2026-03-27 10:49:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 002da1e5-5e02-52ba-8992-d13c635d9cd1 with identifier: CF89653
2026-03-27 10:49:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 002da1e5-5e02-52ba-8992-d13c635d9cd1 with scrape type 2
2026-03-27 10:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 002da1e5-5e02-52ba-8992-d13c635d9cd1 with scrape type 2
2026-03-27 10:49:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 002da1e5-5e02-52ba-8992-d13c635d9cd1, identifier: CF89653
2026-03-27 10:49:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 002da1e5-5e02-52ba-8992-d13c635d9cd1 with identifier: CF89653
2026-03-27 10:49:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 002da1e5-5e02-52ba-8992-d13c635d9cd1 with identifier: CF89653
2026-03-27 10:49:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 002da1e5-5e02-52ba-8992-d13c635d9cd1 with identifier: CF89653 to the API
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:56:53Z',
 'fuel_type': 'diesel',
 'id': '002da1e5-5e02-52ba-8992-d13c635d9cd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF89653',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 144065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-09',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF89653%27 HTTP/1.1" 200 None
2026-03-27 10:49:55 [auto1.de] INFO: Saving data for CF89653: {'auction_closing_time': 1774717013.0, 'created_time': 1774035057.384842, 'last_price_update_time': 1774608595.890081}
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF89653') HTTP/1.1" 204 0
2026-03-27 10:49:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f56b8c1-1690-5501-80f2-acef6636981e with identifier: BP39068
2026-03-27 10:49:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f56b8c1-1690-5501-80f2-acef6636981e with scrape type 1
2026-03-27 10:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f56b8c1-1690-5501-80f2-acef6636981e
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Faf%252F7aafeb79141b29fe137c400c210271cf%252Fpa%252FBP39068_fec60a8ddf18b517edd465bffea96d0f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_fec60a8ddf18b517edd465bffea96d0f.jpg already downloaded
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Faf%252F7aafeb79141b29fe137c400c210271cf%252Fpa%252FBP39068_efbf80bc348e22e005fb5c60e43237b7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_efbf80bc348e22e005fb5c60e43237b7.jpg already downloaded
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Faf%252F7aafeb79141b29fe137c400c210271cf%252Fpa%252FBP39068_481ac57d59251ca0dfa03443d59a2787.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_481ac57d59251ca0dfa03443d59a2787.jpg already downloaded
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Faf%252F7aafeb79141b29fe137c400c210271cf%252Fpa%252FBP39068_3495a460acede0dc2661565e295f420f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_3495a460acede0dc2661565e295f420f.jpg already downloaded
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Faf%252F7aafeb79141b29fe137c400c210271cf%252Fpa%252FBP39068_a18c7411951ebcd1497c256e7d3523cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_a18c7411951ebcd1497c256e7d3523cf.jpg already downloaded
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Faf%252F7aafeb79141b29fe137c400c210271cf%252Fpa%252FBP39068_8021261c3853f574249fb7e51c828dc8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_8021261c3853f574249fb7e51c828dc8.jpg already downloaded
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Faf%252F7aafeb79141b29fe137c400c210271cf%252Fpa%252FBP39068_c1bc3c87c9c76e37ce049454f7dbbde3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_c1bc3c87c9c76e37ce049454f7dbbde3.jpg already downloaded
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Faf%252F7aafeb79141b29fe137c400c210271cf%252Fpa%252FBP39068_5570459c4abc7c992bedde6447196e79.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_5570459c4abc7c992bedde6447196e79.jpg already downloaded
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Faf%252F7aafeb79141b29fe137c400c210271cf%252Fpa%252FBP39068_61eae279eaf7d6d674a76180b39827fe.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_61eae279eaf7d6d674a76180b39827fe.jpg already downloaded
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Faf%252F7aafeb79141b29fe137c400c210271cf%252Fpa%252FBP39068_70a50527565d6a322987ed14d8415134.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_70a50527565d6a322987ed14d8415134.jpg already downloaded
2026-03-27 10:49:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f56b8c1-1690-5501-80f2-acef6636981e, identifier: BP39068
2026-03-27 10:49:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500471510>
2026-03-27 10:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad/998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F2a%252F132a76305092f4948dfd44160c3efcd9%252Fpa%252FZV10923_9f503a3a5b845cc34c8f52d47b3bc576.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_9f503a3a5b845cc34c8f52d47b3bc576.jpg saved to cache
2026-03-27 10:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad
2026-03-27 10:49:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500449110>
2026-03-27 10:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad/998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F2a%252F132a76305092f4948dfd44160c3efcd9%252Fpa%252FZV10923_b5939ef986cda815b9f0d3348ddc791c.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_b5939ef986cda815b9f0d3348ddc791c.jpg saved to cache
2026-03-27 10:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad
2026-03-27 10:49:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002365d0>
2026-03-27 10:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad/998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F2a%252F132a76305092f4948dfd44160c3efcd9%252Fpa%252FZV10923_b47ec73e17efc000c2580774bdff056f.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_b47ec73e17efc000c2580774bdff056f.jpg saved to cache
2026-03-27 10:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad
2026-03-27 10:49:56 [auto1.de] INFO: Found listing with ID: HD43211
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD43211%27 HTTP/1.1" 200 None
2026-03-27 10:49:56 [auto1.de] INFO: Scrape type for HD43211: 2
2026-03-27 10:49:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3259a4b6-7924-535d-a451-d944153ac8f9 with identifier: HD43211
2026-03-27 10:49:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3259a4b6-7924-535d-a451-d944153ac8f9 with scrape type 2
2026-03-27 10:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3259a4b6-7924-535d-a451-d944153ac8f9 with scrape type 2
2026-03-27 10:49:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3259a4b6-7924-535d-a451-d944153ac8f9, identifier: HD43211
2026-03-27 10:49:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f56b8c1-1690-5501-80f2-acef6636981e with identifier: BP39068
2026-03-27 10:49:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f56b8c1-1690-5501-80f2-acef6636981e with identifier: BP39068
2026-03-27 10:49:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f56b8c1-1690-5501-80f2-acef6636981e with identifier: BP39068 to the API
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BP39068>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:51:29Z',
 'fuel_type': 'diesel',
 'id': '2f56b8c1-1690-5501-80f2-acef6636981e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP39068',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Nissan',
 'model': 'NP300 Pick-up',
 'odometer': 248615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_fec60a8ddf18b517edd465bffea96d0f.jpg',
                'https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_efbf80bc348e22e005fb5c60e43237b7.jpg',
                'https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_481ac57d59251ca0dfa03443d59a2787.jpg',
                'https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_3495a460acede0dc2661565e295f420f.jpg',
                'https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_a18c7411951ebcd1497c256e7d3523cf.jpg',
                'https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_8021261c3853f574249fb7e51c828dc8.jpg',
                'https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_c1bc3c87c9c76e37ce049454f7dbbde3.jpg',
                'https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_5570459c4abc7c992bedde6447196e79.jpg',
                'https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_61eae279eaf7d6d674a76180b39827fe.jpg',
                'https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_70a50527565d6a322987ed14d8415134.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f56b8c1-1690-5501-80f2-acef6636981e/2f56b8c1-1690-5501-80f2-acef6636981e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2603994,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_fec60a8ddf18b517edd465bffea96d0f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f56b8c1-1690-5501-80f2-acef6636981e/2f56b8c1-1690-5501-80f2-acef6636981e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2591997,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_efbf80bc348e22e005fb5c60e43237b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f56b8c1-1690-5501-80f2-acef6636981e/2f56b8c1-1690-5501-80f2-acef6636981e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2492690,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_481ac57d59251ca0dfa03443d59a2787.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f56b8c1-1690-5501-80f2-acef6636981e/2f56b8c1-1690-5501-80f2-acef6636981e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2385818,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_3495a460acede0dc2661565e295f420f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f56b8c1-1690-5501-80f2-acef6636981e/2f56b8c1-1690-5501-80f2-acef6636981e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_a18c7411951ebcd1497c256e7d3523cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f56b8c1-1690-5501-80f2-acef6636981e/2f56b8c1-1690-5501-80f2-acef6636981e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_8021261c3853f574249fb7e51c828dc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f56b8c1-1690-5501-80f2-acef6636981e/2f56b8c1-1690-5501-80f2-acef6636981e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_c1bc3c87c9c76e37ce049454f7dbbde3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f56b8c1-1690-5501-80f2-acef6636981e/2f56b8c1-1690-5501-80f2-acef6636981e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_5570459c4abc7c992bedde6447196e79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f56b8c1-1690-5501-80f2-acef6636981e/2f56b8c1-1690-5501-80f2-acef6636981e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2540195,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_61eae279eaf7d6d674a76180b39827fe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f56b8c1-1690-5501-80f2-acef6636981e/2f56b8c1-1690-5501-80f2-acef6636981e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2997604,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/af/7aafeb79141b29fe137c400c210271cf/pa/BP39068_70a50527565d6a322987ed14d8415134.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan NP300 Pick-up 2.3 dCi N-Connecta Double Cab 4x4',
 'transmission': 'manual',
 'trim': 'N-Connecta Double Cab 4x4',
 'year': 2017}
2026-03-27 10:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39068%27 HTTP/1.1" 200 None
2026-03-27 10:49:57 [auto1.de] INFO: Saving data for BP39068: {'created_time': 1774608597.100698, 'last_price_update_time': 1774608597.100709, 'auction_closing_time': 1774716689.0}
2026-03-27 10:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP39068') HTTP/1.1" 204 0
2026-03-27 10:49:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3259a4b6-7924-535d-a451-d944153ac8f9 with identifier: HD43211
2026-03-27 10:49:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3259a4b6-7924-535d-a451-d944153ac8f9 with identifier: HD43211
2026-03-27 10:49:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3259a4b6-7924-535d-a451-d944153ac8f9 with identifier: HD43211 to the API
2026-03-27 10:49:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:30:55Z',
 'fuel_type': 'petrol',
 'id': '3259a4b6-7924-535d-a451-d944153ac8f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD43211',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 170957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-12',
 'seller_name': None,
 'title': 'Hyundai Kona 1.6 TGDI Style 4WD',
 'transmission': 'automatic',
 'trim': 'Style 4WD',
 'year': 2019}
2026-03-27 10:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD43211%27 HTTP/1.1" 200 None
2026-03-27 10:49:57 [auto1.de] INFO: Saving data for HD43211: {'auction_closing_time': 1774715455.0, 'created_time': 1772545556.878691, 'last_price_update_time': 1774608597.490221}
2026-03-27 10:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD43211') HTTP/1.1" 204 0
2026-03-27 10:49:57 [auto1.de] INFO: Found listing with ID: VE44500
2026-03-27 10:49:57 [auto1.de] INFO: Found listing with ID: WX24181
2026-03-27 10:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX24181%27 HTTP/1.1" 200 None
2026-03-27 10:49:57 [auto1.de] INFO: Scrape type for WX24181: 2
2026-03-27 10:49:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dce4305-4e2e-592b-9d76-457ef84466cb with identifier: WX24181
2026-03-27 10:49:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dce4305-4e2e-592b-9d76-457ef84466cb with scrape type 2
2026-03-27 10:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3dce4305-4e2e-592b-9d76-457ef84466cb with scrape type 2
2026-03-27 10:49:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3dce4305-4e2e-592b-9d76-457ef84466cb, identifier: WX24181
2026-03-27 10:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN62296> (referer: https://www.auto1.com/v1/car-details-view/BN62296/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3dce4305-4e2e-592b-9d76-457ef84466cb with identifier: WX24181
2026-03-27 10:49:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3dce4305-4e2e-592b-9d76-457ef84466cb with identifier: WX24181
2026-03-27 10:49:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3dce4305-4e2e-592b-9d76-457ef84466cb with identifier: WX24181 to the API
2026-03-27 10:49:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:07:31Z',
 'fuel_type': 'diesel',
 'id': '3dce4305-4e2e-592b-9d76-457ef84466cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX24181',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 260478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-30',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D4 Black Edition',
 'transmission': 'automatic',
 'trim': 'Black Edition',
 'year': 2015}
2026-03-27 10:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX24181%27 HTTP/1.1" 200 None
2026-03-27 10:49:57 [auto1.de] INFO: Saving data for WX24181: {'auction_closing_time': 1774714051.0, 'created_time': 1773136167.446759, 'last_price_update_time': 1774608597.952316}
2026-03-27 10:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX24181') HTTP/1.1" 204 0
2026-03-27 10:49:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:57 [auto1.de] INFO: Found listing with ID: KS08572
2026-03-27 10:49:57 [auto1.de] INFO: Found listing with ID: VE61397
2026-03-27 10:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE61397%27 HTTP/1.1" 200 None
2026-03-27 10:49:57 [auto1.de] INFO: Scrape type for VE61397: 1
2026-03-27 10:49:58 [auto1.de] INFO: Found listing with ID: GJ83963
2026-03-27 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ83963%27 HTTP/1.1" 200 None
2026-03-27 10:49:58 [auto1.de] INFO: Scrape type for GJ83963: 1
2026-03-27 10:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JW24568> (referer: https://www.auto1.com/v1/car-details-view/JW24568/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b63c329-caa3-547b-975b-76f770a4a703 with identifier: BN62296
2026-03-27 10:49:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b63c329-caa3-547b-975b-76f770a4a703 with scrape type 1
2026-03-27 10:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b63c329-caa3-547b-975b-76f770a4a703
2026-03-27 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F80%252F8580c299293760a94999d3048d52256d%252Fpa%252FBN62296_0071bea627186288752df976c943bbc4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_0071bea627186288752df976c943bbc4.jpg not downloaded yet
2026-03-27 10:49:58 [auto1.de] INFO: Found listing with ID: ZT05209
2026-03-27 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT05209%27 HTTP/1.1" 200 None
2026-03-27 10:49:58 [auto1.de] INFO: Scrape type for ZT05209: 2
2026-03-27 10:49:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea43bf3f-14e4-5c4b-be29-baceb9ab1174 with identifier: ZT05209
2026-03-27 10:49:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea43bf3f-14e4-5c4b-be29-baceb9ab1174 with scrape type 2
2026-03-27 10:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea43bf3f-14e4-5c4b-be29-baceb9ab1174 with scrape type 2
2026-03-27 10:49:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea43bf3f-14e4-5c4b-be29-baceb9ab1174, identifier: ZT05209
2026-03-27 10:49:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea43bf3f-14e4-5c4b-be29-baceb9ab1174 with identifier: ZT05209
2026-03-27 10:49:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea43bf3f-14e4-5c4b-be29-baceb9ab1174 with identifier: ZT05209
2026-03-27 10:49:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea43bf3f-14e4-5c4b-be29-baceb9ab1174 with identifier: ZT05209 to the API
2026-03-27 10:49:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:00:16Z',
 'fuel_type': 'petrol',
 'id': 'ea43bf3f-14e4-5c4b-be29-baceb9ab1174',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT05209',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Aveo',
 'odometer': 154341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-19',
 'seller_name': None,
 'title': 'Chevrolet Aveo 1.4 LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2012}
2026-03-27 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT05209%27 HTTP/1.1" 200 None
2026-03-27 10:49:58 [auto1.de] INFO: Saving data for ZT05209: {'auction_closing_time': 1774713616.0, 'created_time': 1773946598.484195, 'last_price_update_time': 1774608598.602748}
2026-03-27 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT05209') HTTP/1.1" 204 0
2026-03-27 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F80%252F8580c299293760a94999d3048d52256d%252Fpa%252FBN62296_941793f5956456f019883d60c1ee93cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_941793f5956456f019883d60c1ee93cf.jpg not downloaded yet
2026-03-27 10:49:58 [auto1.de] INFO: Found listing with ID: SY84491
2026-03-27 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY84491%27 HTTP/1.1" 200 None
2026-03-27 10:49:58 [auto1.de] INFO: Scrape type for SY84491: 2
2026-03-27 10:49:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c606a5ed-6074-5be9-b0dd-3bdd335275ff with identifier: SY84491
2026-03-27 10:49:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c606a5ed-6074-5be9-b0dd-3bdd335275ff with scrape type 2
2026-03-27 10:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c606a5ed-6074-5be9-b0dd-3bdd335275ff with scrape type 2
2026-03-27 10:49:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c606a5ed-6074-5be9-b0dd-3bdd335275ff, identifier: SY84491
2026-03-27 10:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_a3cca8fc2cf3ffc002035455b806940b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c606a5ed-6074-5be9-b0dd-3bdd335275ff with identifier: SY84491
2026-03-27 10:49:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c606a5ed-6074-5be9-b0dd-3bdd335275ff with identifier: SY84491
2026-03-27 10:49:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c606a5ed-6074-5be9-b0dd-3bdd335275ff with identifier: SY84491 to the API
2026-03-27 10:49:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:49:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:39:00Z',
 'fuel_type': 'diesel',
 'id': 'c606a5ed-6074-5be9-b0dd-3bdd335275ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY84491',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 144335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-14',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 CRDi GT Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line 4WD',
 'year': 2016}
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY84491%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [auto1.de] INFO: Saving data for SY84491: {'auction_closing_time': 1774715940.0, 'created_time': 1773917401.929951, 'last_price_update_time': 1774608599.154605}
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY84491') HTTP/1.1" 204 0
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F80%252F8580c299293760a94999d3048d52256d%252Fpa%252FBN62296_e72632757be5c4529c8e8b1d363831cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_e72632757be5c4529c8e8b1d363831cf.jpg not downloaded yet
2026-03-27 10:49:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c51564e3-9f42-597c-815a-088caf230849 with identifier: JW24568
2026-03-27 10:49:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c51564e3-9f42-597c-815a-088caf230849 with scrape type 1
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c51564e3-9f42-597c-815a-088caf230849
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fb4%252Fcfb42a6947b53479da12d7a52071891d%252Fpa%252FJW24568_815d9d50ca014b340c861f05923b2829.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_815d9d50ca014b340c861f05923b2829.jpg not downloaded yet
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: ZU82600
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU82600%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [auto1.de] INFO: Scrape type for ZU82600: 0
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: XL56937
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL56937%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [auto1.de] INFO: Scrape type for XL56937: 0
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: AS68475
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS68475%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [auto1.de] INFO: Scrape type for AS68475: 0
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: EE25450
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE25450%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [auto1.de] INFO: Scrape type for EE25450: 0
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: ZN04335
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: WR57027
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR57027%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [auto1.de] INFO: Scrape type for WR57027: 0
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: RW32541
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW32541%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [auto1.de] INFO: Scrape type for RW32541: 0
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: JR60766
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: TM66386
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: MH24339
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: KS94316
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: JR21224
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: MB99639
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB99639%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [auto1.de] INFO: Scrape type for MB99639: 0
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: YF85970
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF85970%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [auto1.de] INFO: Scrape type for YF85970: 0
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: XA59954
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: DZ93039
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: KK39591
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK39591%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [auto1.de] INFO: Scrape type for KK39591: 0
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: NB74696
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: PA91230
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA91230%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [auto1.de] INFO: Scrape type for PA91230: 0
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: MK66887
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK66887%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [auto1.de] INFO: Scrape type for MK66887: 0
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: PS74193
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS74193%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [auto1.de] INFO: Scrape type for PS74193: 0
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: LR74805
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR74805%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [auto1.de] INFO: Scrape type for LR74805: 0
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: PR32105
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR32105%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [auto1.de] INFO: Scrape type for PR32105: 0
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: JZ77748
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ77748%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [auto1.de] INFO: Scrape type for JZ77748: 0
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: LJ18760
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: VS70073
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: BV72825
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: PC54286
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC54286%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [auto1.de] INFO: Scrape type for PC54286: 0
2026-03-27 10:49:59 [auto1.de] INFO: Found listing with ID: SD36670
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD36670%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [auto1.de] INFO: Scrape type for SD36670: 0
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F80%252F8580c299293760a94999d3048d52256d%252Fpa%252FBN62296_b3cf8093db1d8b761622a6f18be9684c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_b3cf8093db1d8b761622a6f18be9684c.jpg not downloaded yet
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fb4%252Fcfb42a6947b53479da12d7a52071891d%252Fpa%252FJW24568_2331ec1db728215345a164f313d3d3bc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_2331ec1db728215345a164f313d3d3bc.jpg not downloaded yet
2026-03-27 10:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DB09023> (referer: https://www.auto1.com/v1/car-details-view/DB09023/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500323c50>
2026-03-27 10:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad/998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F2a%252F132a76305092f4948dfd44160c3efcd9%252Fpa%252FZV10923_a3cca8fc2cf3ffc002035455b806940b.jpg') HTTP/1.1" 204 0
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_a3cca8fc2cf3ffc002035455b806940b.jpg saved to cache
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F80%252F8580c299293760a94999d3048d52256d%252Fpa%252FBN62296_abb840ae7d07183d8141052b05dd6ad3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_abb840ae7d07183d8141052b05dd6ad3.jpg not downloaded yet
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fb4%252Fcfb42a6947b53479da12d7a52071891d%252Fpa%252FJW24568_67d518a19b19e1e63ce226fbd55b8497.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_67d518a19b19e1e63ce226fbd55b8497.jpg not downloaded yet
2026-03-27 10:49:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_941793f5956456f019883d60c1ee93cf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F80%252F8580c299293760a94999d3048d52256d%252Fpa%252FBN62296_1c50bd8b63dcac12903b0a2e69f5671a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_1c50bd8b63dcac12903b0a2e69f5671a.jpg not downloaded yet
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fb4%252Fcfb42a6947b53479da12d7a52071891d%252Fpa%252FJW24568_8013dcbade7c26cb2b6295d9a1640494.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_8013dcbade7c26cb2b6295d9a1640494.jpg not downloaded yet
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F80%252F8580c299293760a94999d3048d52256d%252Fpa%252FBN62296_fe35f6fb9ab9701a86f8b0d249fc07ad.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_fe35f6fb9ab9701a86f8b0d249fc07ad.jpg not downloaded yet
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fb4%252Fcfb42a6947b53479da12d7a52071891d%252Fpa%252FJW24568_7be872bed9790f826317422c06d98125.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_7be872bed9790f826317422c06d98125.jpg not downloaded yet
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F80%252F8580c299293760a94999d3048d52256d%252Fpa%252FBN62296_bada6bcce9e1858951ccb1c95c9fb174.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_bada6bcce9e1858951ccb1c95c9fb174.jpg not downloaded yet
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fb4%252Fcfb42a6947b53479da12d7a52071891d%252Fpa%252FJW24568_733e0872c89b3a6275e30c79fba62d73.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_733e0872c89b3a6275e30c79fba62d73.jpg not downloaded yet
2026-03-27 10:49:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57346407-60b7-5b98-a189-9b9f67b88ff2 with identifier: DB09023
2026-03-27 10:49:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57346407-60b7-5b98-a189-9b9f67b88ff2 with scrape type 1
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 57346407-60b7-5b98-a189-9b9f67b88ff2
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe00710d486f2c5e50b6ec7cd583d0142%252Fpa%252FDB09023_473280900fc96c2da3c4fd78e78e5db4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e00710d486f2c5e50b6ec7cd583d0142/pa/DB09023_473280900fc96c2da3c4fd78e78e5db4.jpg already downloaded
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe00710d486f2c5e50b6ec7cd583d0142%252Fpa%252FDB09023_9808673955fd4a12911f626f1bd3580b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e00710d486f2c5e50b6ec7cd583d0142/pa/DB09023_9808673955fd4a12911f626f1bd3580b.jpg already downloaded
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe00710d486f2c5e50b6ec7cd583d0142%252Fpa%252FDB09023_ef2b480dc48da080f9024254e3e85513.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e00710d486f2c5e50b6ec7cd583d0142/pa/DB09023_ef2b480dc48da080f9024254e3e85513.jpg already downloaded
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe00710d486f2c5e50b6ec7cd583d0142%252Fpa%252FDB09023_0df51022d47154677a9eaf9102f88513.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e00710d486f2c5e50b6ec7cd583d0142/pa/DB09023_0df51022d47154677a9eaf9102f88513.jpg already downloaded
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe00710d486f2c5e50b6ec7cd583d0142%252Fpa%252FDB09023_8ec113ca86220ac0f0b5d8bad1d0d438.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e00710d486f2c5e50b6ec7cd583d0142/pa/DB09023_8ec113ca86220ac0f0b5d8bad1d0d438.jpg already downloaded
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe00710d486f2c5e50b6ec7cd583d0142%252Fpa%252FDB09023_2c58e4b91255f563822087e7b3eb98be.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e00710d486f2c5e50b6ec7cd583d0142/pa/DB09023_2c58e4b91255f563822087e7b3eb98be.jpg already downloaded
2026-03-27 10:50:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57346407-60b7-5b98-a189-9b9f67b88ff2, identifier: DB09023
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F80%252F8580c299293760a94999d3048d52256d%252Fpa%252FBN62296_12f7e4c3d0f6995181df2935ff98fadb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_12f7e4c3d0f6995181df2935ff98fadb.jpg not downloaded yet
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fb4%252Fcfb42a6947b53479da12d7a52071891d%252Fpa%252FJW24568_28afac24598b1096f53ef6ad76fcbde8.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_28afac24598b1096f53ef6ad76fcbde8.jpg not downloaded yet
2026-03-27 10:50:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57346407-60b7-5b98-a189-9b9f67b88ff2 with identifier: DB09023
2026-03-27 10:50:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57346407-60b7-5b98-a189-9b9f67b88ff2 with identifier: DB09023
2026-03-27 10:50:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57346407-60b7-5b98-a189-9b9f67b88ff2 with identifier: DB09023 to the API
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:50:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DB09023>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:46:39Z',
 'fuel_type': 'petrol',
 'id': '57346407-60b7-5b98-a189-9b9f67b88ff2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB09023',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 128234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imge0/07/e00710d486f2c5e50b6ec7cd583d0142/pa/DB09023_473280900fc96c2da3c4fd78e78e5db4.jpg',
                'https://img-pa.auto1.com/imge0/07/e00710d486f2c5e50b6ec7cd583d0142/pa/DB09023_9808673955fd4a12911f626f1bd3580b.jpg',
                'https://img-pa.auto1.com/imge0/07/e00710d486f2c5e50b6ec7cd583d0142/pa/DB09023_ef2b480dc48da080f9024254e3e85513.jpg',
                'https://img-pa.auto1.com/imge0/07/e00710d486f2c5e50b6ec7cd583d0142/pa/DB09023_0df51022d47154677a9eaf9102f88513.jpg',
                'https://img-pa.auto1.com/imge0/07/e00710d486f2c5e50b6ec7cd583d0142/pa/DB09023_8ec113ca86220ac0f0b5d8bad1d0d438.jpg',
                'https://img-pa.auto1.com/imge0/07/e00710d486f2c5e50b6ec7cd583d0142/pa/DB09023_2c58e4b91255f563822087e7b3eb98be.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57346407-60b7-5b98-a189-9b9f67b88ff2/57346407-60b7-5b98-a189-9b9f67b88ff2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/07/e00710d486f2c5e50b6ec7cd583d0142/pa/DB09023_473280900fc96c2da3c4fd78e78e5db4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57346407-60b7-5b98-a189-9b9f67b88ff2/57346407-60b7-5b98-a189-9b9f67b88ff2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/07/e00710d486f2c5e50b6ec7cd583d0142/pa/DB09023_9808673955fd4a12911f626f1bd3580b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57346407-60b7-5b98-a189-9b9f67b88ff2/57346407-60b7-5b98-a189-9b9f67b88ff2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/07/e00710d486f2c5e50b6ec7cd583d0142/pa/DB09023_ef2b480dc48da080f9024254e3e85513.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57346407-60b7-5b98-a189-9b9f67b88ff2/57346407-60b7-5b98-a189-9b9f67b88ff2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/07/e00710d486f2c5e50b6ec7cd583d0142/pa/DB09023_0df51022d47154677a9eaf9102f88513.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57346407-60b7-5b98-a189-9b9f67b88ff2/57346407-60b7-5b98-a189-9b9f67b88ff2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/07/e00710d486f2c5e50b6ec7cd583d0142/pa/DB09023_8ec113ca86220ac0f0b5d8bad1d0d438.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57346407-60b7-5b98-a189-9b9f67b88ff2/57346407-60b7-5b98-a189-9b9f67b88ff2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/07/e00710d486f2c5e50b6ec7cd583d0142/pa/DB09023_2c58e4b91255f563822087e7b3eb98be.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-09',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Ka 1.2 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09023%27 HTTP/1.1" 200 None
2026-03-27 10:50:00 [auto1.de] INFO: Saving data for DB09023: {'created_time': 1774608600.462799, 'last_price_update_time': 1774608600.462811, 'auction_closing_time': 1774716399.0}
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB09023') HTTP/1.1" 204 0
2026-03-27 10:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501682050>
2026-03-27 10:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b63c329-caa3-547b-975b-76f770a4a703/1b63c329-caa3-547b-975b-76f770a4a703_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F80%252F8580c299293760a94999d3048d52256d%252Fpa%252FBN62296_941793f5956456f019883d60c1ee93cf.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_941793f5956456f019883d60c1ee93cf.jpg saved to cache
2026-03-27 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b63c329-caa3-547b-975b-76f770a4a703
2026-03-27 10:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_b3cf8093db1d8b761622a6f18be9684c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_2331ec1db728215345a164f313d3d3bc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F80%252F8580c299293760a94999d3048d52256d%252Fpa%252FBN62296_307f3e1d88c721a9a7993f2c01d01e03.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_307f3e1d88c721a9a7993f2c01d01e03.jpg not downloaded yet
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fb4%252Fcfb42a6947b53479da12d7a52071891d%252Fpa%252FJW24568_6233e65b7812cac6239d0a91d5db92cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_6233e65b7812cac6239d0a91d5db92cf.jpg not downloaded yet
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fb4%252Fcfb42a6947b53479da12d7a52071891d%252Fpa%252FJW24568_c2ab1e4855b8e263647829bd9f9decc1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_c2ab1e4855b8e263647829bd9f9decc1.jpg not downloaded yet
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fb4%252Fcfb42a6947b53479da12d7a52071891d%252Fpa%252FJW24568_375b3121a3e9d2ac48f37d0adc1f18ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_375b3121a3e9d2ac48f37d0adc1f18ae.jpg not downloaded yet
2026-03-27 10:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_9caca97f67caec052a65d79c696997c0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018af750>
2026-03-27 10:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b63c329-caa3-547b-975b-76f770a4a703/1b63c329-caa3-547b-975b-76f770a4a703_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F80%252F8580c299293760a94999d3048d52256d%252Fpa%252FBN62296_b3cf8093db1d8b761622a6f18be9684c.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_b3cf8093db1d8b761622a6f18be9684c.jpg saved to cache
2026-03-27 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b63c329-caa3-547b-975b-76f770a4a703
2026-03-27 10:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500390050>
2026-03-27 10:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51564e3-9f42-597c-815a-088caf230849/c51564e3-9f42-597c-815a-088caf230849_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fb4%252Fcfb42a6947b53479da12d7a52071891d%252Fpa%252FJW24568_2331ec1db728215345a164f313d3d3bc.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_2331ec1db728215345a164f313d3d3bc.jpg saved to cache
2026-03-27 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c51564e3-9f42-597c-815a-088caf230849
2026-03-27 10:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_12f7e4c3d0f6995181df2935ff98fadb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003981d0>
2026-03-27 10:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad/998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F2a%252F132a76305092f4948dfd44160c3efcd9%252Fpa%252FZV10923_9caca97f67caec052a65d79c696997c0.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_9caca97f67caec052a65d79c696997c0.jpg saved to cache
2026-03-27 10:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad
2026-03-27 10:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019a7090>
2026-03-27 10:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b63c329-caa3-547b-975b-76f770a4a703/1b63c329-caa3-547b-975b-76f770a4a703_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F80%252F8580c299293760a94999d3048d52256d%252Fpa%252FBN62296_12f7e4c3d0f6995181df2935ff98fadb.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_12f7e4c3d0f6995181df2935ff98fadb.jpg saved to cache
2026-03-27 10:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b63c329-caa3-547b-975b-76f770a4a703
2026-03-27 10:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_375b3121a3e9d2ac48f37d0adc1f18ae.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003f5790>
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51564e3-9f42-597c-815a-088caf230849/c51564e3-9f42-597c-815a-088caf230849_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fb4%252Fcfb42a6947b53479da12d7a52071891d%252Fpa%252FJW24568_375b3121a3e9d2ac48f37d0adc1f18ae.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_375b3121a3e9d2ac48f37d0adc1f18ae.jpg saved to cache
2026-03-27 10:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c51564e3-9f42-597c-815a-088caf230849
2026-03-27 10:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_28afac24598b1096f53ef6ad76fcbde8.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_c2ab1e4855b8e263647829bd9f9decc1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_6233e65b7812cac6239d0a91d5db92cf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_307f3e1d88c721a9a7993f2c01d01e03.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017eded0>
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51564e3-9f42-597c-815a-088caf230849/c51564e3-9f42-597c-815a-088caf230849_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fb4%252Fcfb42a6947b53479da12d7a52071891d%252Fpa%252FJW24568_28afac24598b1096f53ef6ad76fcbde8.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_28afac24598b1096f53ef6ad76fcbde8.jpg saved to cache
2026-03-27 10:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c51564e3-9f42-597c-815a-088caf230849
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50198add0>
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51564e3-9f42-597c-815a-088caf230849/c51564e3-9f42-597c-815a-088caf230849_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fb4%252Fcfb42a6947b53479da12d7a52071891d%252Fpa%252FJW24568_c2ab1e4855b8e263647829bd9f9decc1.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_c2ab1e4855b8e263647829bd9f9decc1.jpg saved to cache
2026-03-27 10:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c51564e3-9f42-597c-815a-088caf230849
2026-03-27 10:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_bada6bcce9e1858951ccb1c95c9fb174.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_733e0872c89b3a6275e30c79fba62d73.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501873e10>
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51564e3-9f42-597c-815a-088caf230849/c51564e3-9f42-597c-815a-088caf230849_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fb4%252Fcfb42a6947b53479da12d7a52071891d%252Fpa%252FJW24568_6233e65b7812cac6239d0a91d5db92cf.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_6233e65b7812cac6239d0a91d5db92cf.jpg saved to cache
2026-03-27 10:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c51564e3-9f42-597c-815a-088caf230849
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001ddad0>
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b63c329-caa3-547b-975b-76f770a4a703/1b63c329-caa3-547b-975b-76f770a4a703_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F80%252F8580c299293760a94999d3048d52256d%252Fpa%252FBN62296_307f3e1d88c721a9a7993f2c01d01e03.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_307f3e1d88c721a9a7993f2c01d01e03.jpg saved to cache
2026-03-27 10:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b63c329-caa3-547b-975b-76f770a4a703
2026-03-27 10:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XX92411/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:50:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_7be872bed9790f826317422c06d98125.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP29257> (referer: https://www.auto1.com/v1/car-details-view/DP29257/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:50:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003f5110>
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b63c329-caa3-547b-975b-76f770a4a703/1b63c329-caa3-547b-975b-76f770a4a703_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F80%252F8580c299293760a94999d3048d52256d%252Fpa%252FBN62296_bada6bcce9e1858951ccb1c95c9fb174.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_bada6bcce9e1858951ccb1c95c9fb174.jpg saved to cache
2026-03-27 10:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b63c329-caa3-547b-975b-76f770a4a703
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50371d390>
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51564e3-9f42-597c-815a-088caf230849/c51564e3-9f42-597c-815a-088caf230849_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fb4%252Fcfb42a6947b53479da12d7a52071891d%252Fpa%252FJW24568_733e0872c89b3a6275e30c79fba62d73.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_733e0872c89b3a6275e30c79fba62d73.jpg saved to cache
2026-03-27 10:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c51564e3-9f42-597c-815a-088caf230849
2026-03-27 10:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_1c50bd8b63dcac12903b0a2e69f5671a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002c8a50>
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51564e3-9f42-597c-815a-088caf230849/c51564e3-9f42-597c-815a-088caf230849_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fb4%252Fcfb42a6947b53479da12d7a52071891d%252Fpa%252FJW24568_7be872bed9790f826317422c06d98125.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_7be872bed9790f826317422c06d98125.jpg saved to cache
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c51564e3-9f42-597c-815a-088caf230849
2026-03-27 10:50:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84c9788e-a100-5c3f-a035-b8bc1364dbcd with identifier: DP29257
2026-03-27 10:50:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84c9788e-a100-5c3f-a035-b8bc1364dbcd with scrape type 1
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 84c9788e-a100-5c3f-a035-b8bc1364dbcd
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F93%252Fd7933118c9b0c1c068bde386b24925dc%252Fpa%252FDP29257_1f596dd8ac448bd0c3be6a2e7ec4b169.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/93/d7933118c9b0c1c068bde386b24925dc/pa/DP29257_1f596dd8ac448bd0c3be6a2e7ec4b169.jpg not downloaded yet
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F93%252Fd7933118c9b0c1c068bde386b24925dc%252Fpa%252FDP29257_930ffbac079ff2fae6fa3b30123e3a22.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/93/d7933118c9b0c1c068bde386b24925dc/pa/DP29257_930ffbac079ff2fae6fa3b30123e3a22.jpg not downloaded yet
2026-03-27 10:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_67d518a19b19e1e63ce226fbd55b8497.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_fe35f6fb9ab9701a86f8b0d249fc07ad.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_abb840ae7d07183d8141052b05dd6ad3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F93%252Fd7933118c9b0c1c068bde386b24925dc%252Fpa%252FDP29257_48b06cec0415631d7b0c0d6e62489657.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/93/d7933118c9b0c1c068bde386b24925dc/pa/DP29257_48b06cec0415631d7b0c0d6e62489657.jpg not downloaded yet
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004528d0>
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b63c329-caa3-547b-975b-76f770a4a703/1b63c329-caa3-547b-975b-76f770a4a703_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F80%252F8580c299293760a94999d3048d52256d%252Fpa%252FBN62296_1c50bd8b63dcac12903b0a2e69f5671a.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_1c50bd8b63dcac12903b0a2e69f5671a.jpg saved to cache
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b63c329-caa3-547b-975b-76f770a4a703
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F93%252Fd7933118c9b0c1c068bde386b24925dc%252Fpa%252FDP29257_e85be460f981d0030960d436ca0f8d5a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/93/d7933118c9b0c1c068bde386b24925dc/pa/DP29257_e85be460f981d0030960d436ca0f8d5a.jpg not downloaded yet
2026-03-27 10:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY63966/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F93%252Fd7933118c9b0c1c068bde386b24925dc%252Fpa%252FDP29257_de277edc1244f5cb97d3faf0dbd76573.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/93/d7933118c9b0c1c068bde386b24925dc/pa/DP29257_de277edc1244f5cb97d3faf0dbd76573.jpg not downloaded yet
2026-03-27 10:50:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_8013dcbade7c26cb2b6295d9a1640494.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001cfd50>
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51564e3-9f42-597c-815a-088caf230849/c51564e3-9f42-597c-815a-088caf230849_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fb4%252Fcfb42a6947b53479da12d7a52071891d%252Fpa%252FJW24568_67d518a19b19e1e63ce226fbd55b8497.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_67d518a19b19e1e63ce226fbd55b8497.jpg saved to cache
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c51564e3-9f42-597c-815a-088caf230849
2026-03-27 10:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/93/d7933118c9b0c1c068bde386b24925dc/pa/DP29257_1f596dd8ac448bd0c3be6a2e7ec4b169.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_e72632757be5c4529c8e8b1d363831cf.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/93/d7933118c9b0c1c068bde386b24925dc/pa/DP29257_e85be460f981d0030960d436ca0f8d5a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50178f410>
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b63c329-caa3-547b-975b-76f770a4a703/1b63c329-caa3-547b-975b-76f770a4a703_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F80%252F8580c299293760a94999d3048d52256d%252Fpa%252FBN62296_fe35f6fb9ab9701a86f8b0d249fc07ad.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_fe35f6fb9ab9701a86f8b0d249fc07ad.jpg saved to cache
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b63c329-caa3-547b-975b-76f770a4a703
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500471d10>
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b63c329-caa3-547b-975b-76f770a4a703/1b63c329-caa3-547b-975b-76f770a4a703_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F80%252F8580c299293760a94999d3048d52256d%252Fpa%252FBN62296_abb840ae7d07183d8141052b05dd6ad3.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_abb840ae7d07183d8141052b05dd6ad3.jpg saved to cache
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b63c329-caa3-547b-975b-76f770a4a703
2026-03-27 10:50:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500375e90>
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51564e3-9f42-597c-815a-088caf230849/c51564e3-9f42-597c-815a-088caf230849_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fb4%252Fcfb42a6947b53479da12d7a52071891d%252Fpa%252FJW24568_8013dcbade7c26cb2b6295d9a1640494.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_8013dcbade7c26cb2b6295d9a1640494.jpg saved to cache
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c51564e3-9f42-597c-815a-088caf230849
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50032d9d0>
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84c9788e-a100-5c3f-a035-b8bc1364dbcd/84c9788e-a100-5c3f-a035-b8bc1364dbcd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F93%252Fd7933118c9b0c1c068bde386b24925dc%252Fpa%252FDP29257_1f596dd8ac448bd0c3be6a2e7ec4b169.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/93/d7933118c9b0c1c068bde386b24925dc/pa/DP29257_1f596dd8ac448bd0c3be6a2e7ec4b169.jpg saved to cache
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84c9788e-a100-5c3f-a035-b8bc1364dbcd
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500458850>
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b63c329-caa3-547b-975b-76f770a4a703/1b63c329-caa3-547b-975b-76f770a4a703_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F80%252F8580c299293760a94999d3048d52256d%252Fpa%252FBN62296_e72632757be5c4529c8e8b1d363831cf.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_e72632757be5c4529c8e8b1d363831cf.jpg saved to cache
2026-03-27 10:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b63c329-caa3-547b-975b-76f770a4a703
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002c9150>
2026-03-27 10:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84c9788e-a100-5c3f-a035-b8bc1364dbcd/84c9788e-a100-5c3f-a035-b8bc1364dbcd_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F93%252Fd7933118c9b0c1c068bde386b24925dc%252Fpa%252FDP29257_e85be460f981d0030960d436ca0f8d5a.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/93/d7933118c9b0c1c068bde386b24925dc/pa/DP29257_e85be460f981d0030960d436ca0f8d5a.jpg saved to cache
2026-03-27 10:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84c9788e-a100-5c3f-a035-b8bc1364dbcd
2026-03-27 10:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/93/d7933118c9b0c1c068bde386b24925dc/pa/DP29257_de277edc1244f5cb97d3faf0dbd76573.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_0071bea627186288752df976c943bbc4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/93/d7933118c9b0c1c068bde386b24925dc/pa/DP29257_930ffbac079ff2fae6fa3b30123e3a22.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/93/d7933118c9b0c1c068bde386b24925dc/pa/DP29257_48b06cec0415631d7b0c0d6e62489657.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_815d9d50ca014b340c861f05923b2829.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_37b77246f682e1ded218f999089a3839.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VT53198/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:50:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004c5090>
2026-03-27 10:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84c9788e-a100-5c3f-a035-b8bc1364dbcd/84c9788e-a100-5c3f-a035-b8bc1364dbcd_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F93%252Fd7933118c9b0c1c068bde386b24925dc%252Fpa%252FDP29257_de277edc1244f5cb97d3faf0dbd76573.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/93/d7933118c9b0c1c068bde386b24925dc/pa/DP29257_de277edc1244f5cb97d3faf0dbd76573.jpg saved to cache
2026-03-27 10:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84c9788e-a100-5c3f-a035-b8bc1364dbcd
2026-03-27 10:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK35927> (referer: https://www.auto1.com/v1/car-details-view/EK35927/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:50:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500387ed0>
2026-03-27 10:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b63c329-caa3-547b-975b-76f770a4a703/1b63c329-caa3-547b-975b-76f770a4a703_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F80%252F8580c299293760a94999d3048d52256d%252Fpa%252FBN62296_0071bea627186288752df976c943bbc4.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_0071bea627186288752df976c943bbc4.jpg saved to cache
2026-03-27 10:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b63c329-caa3-547b-975b-76f770a4a703
2026-03-27 10:50:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b63c329-caa3-547b-975b-76f770a4a703, skipping ID generation
2026-03-27 10:50:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b63c329-caa3-547b-975b-76f770a4a703 with scrape type 1
2026-03-27 10:50:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b63c329-caa3-547b-975b-76f770a4a703 sending to next pipeline
2026-03-27 10:50:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b63c329-caa3-547b-975b-76f770a4a703, identifier: BN62296
2026-03-27 10:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003758d0>
2026-03-27 10:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84c9788e-a100-5c3f-a035-b8bc1364dbcd/84c9788e-a100-5c3f-a035-b8bc1364dbcd_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F93%252Fd7933118c9b0c1c068bde386b24925dc%252Fpa%252FDP29257_930ffbac079ff2fae6fa3b30123e3a22.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/93/d7933118c9b0c1c068bde386b24925dc/pa/DP29257_930ffbac079ff2fae6fa3b30123e3a22.jpg saved to cache
2026-03-27 10:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84c9788e-a100-5c3f-a035-b8bc1364dbcd
2026-03-27 10:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001fc850>
2026-03-27 10:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84c9788e-a100-5c3f-a035-b8bc1364dbcd/84c9788e-a100-5c3f-a035-b8bc1364dbcd_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F93%252Fd7933118c9b0c1c068bde386b24925dc%252Fpa%252FDP29257_48b06cec0415631d7b0c0d6e62489657.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/93/d7933118c9b0c1c068bde386b24925dc/pa/DP29257_48b06cec0415631d7b0c0d6e62489657.jpg saved to cache
2026-03-27 10:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84c9788e-a100-5c3f-a035-b8bc1364dbcd
2026-03-27 10:50:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84c9788e-a100-5c3f-a035-b8bc1364dbcd, skipping ID generation
2026-03-27 10:50:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84c9788e-a100-5c3f-a035-b8bc1364dbcd with scrape type 1
2026-03-27 10:50:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84c9788e-a100-5c3f-a035-b8bc1364dbcd sending to next pipeline
2026-03-27 10:50:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84c9788e-a100-5c3f-a035-b8bc1364dbcd, identifier: DP29257
2026-03-27 10:50:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002c8a10>
2026-03-27 10:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51564e3-9f42-597c-815a-088caf230849/c51564e3-9f42-597c-815a-088caf230849_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fb4%252Fcfb42a6947b53479da12d7a52071891d%252Fpa%252FJW24568_815d9d50ca014b340c861f05923b2829.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_815d9d50ca014b340c861f05923b2829.jpg saved to cache
2026-03-27 10:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c51564e3-9f42-597c-815a-088caf230849
2026-03-27 10:50:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c51564e3-9f42-597c-815a-088caf230849, skipping ID generation
2026-03-27 10:50:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c51564e3-9f42-597c-815a-088caf230849 with scrape type 1
2026-03-27 10:50:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c51564e3-9f42-597c-815a-088caf230849 sending to next pipeline
2026-03-27 10:50:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c51564e3-9f42-597c-815a-088caf230849, identifier: JW24568
2026-03-27 10:50:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b63c329-caa3-547b-975b-76f770a4a703 with identifier: BN62296
2026-03-27 10:50:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b63c329-caa3-547b-975b-76f770a4a703 with identifier: BN62296
2026-03-27 10:50:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b63c329-caa3-547b-975b-76f770a4a703 with identifier: BN62296 to the API
2026-03-27 10:50:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:50:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:50:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_0071bea627186288752df976c943bbc4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:45:04Z',
 'fuel_type': 'petrol',
 'id': '1b63c329-caa3-547b-975b-76f770a4a703',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN62296',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 80783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b63c329-caa3-547b-975b-76f770a4a703/1b63c329-caa3-547b-975b-76f770a4a703_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_0071bea627186288752df976c943bbc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b63c329-caa3-547b-975b-76f770a4a703/1b63c329-caa3-547b-975b-76f770a4a703_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_941793f5956456f019883d60c1ee93cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b63c329-caa3-547b-975b-76f770a4a703/1b63c329-caa3-547b-975b-76f770a4a703_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_e72632757be5c4529c8e8b1d363831cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b63c329-caa3-547b-975b-76f770a4a703/1b63c329-caa3-547b-975b-76f770a4a703_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_b3cf8093db1d8b761622a6f18be9684c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b63c329-caa3-547b-975b-76f770a4a703/1b63c329-caa3-547b-975b-76f770a4a703_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_abb840ae7d07183d8141052b05dd6ad3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b63c329-caa3-547b-975b-76f770a4a703/1b63c329-caa3-547b-975b-76f770a4a703_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_1c50bd8b63dcac12903b0a2e69f5671a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b63c329-caa3-547b-975b-76f770a4a703/1b63c329-caa3-547b-975b-76f770a4a703_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_fe35f6fb9ab9701a86f8b0d249fc07ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b63c329-caa3-547b-975b-76f770a4a703/1b63c329-caa3-547b-975b-76f770a4a703_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_bada6bcce9e1858951ccb1c95c9fb174.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b63c329-caa3-547b-975b-76f770a4a703/1b63c329-caa3-547b-975b-76f770a4a703_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_12f7e4c3d0f6995181df2935ff98fadb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b63c329-caa3-547b-975b-76f770a4a703/1b63c329-caa3-547b-975b-76f770a4a703_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/80/8580c299293760a94999d3048d52256d/pa/BN62296_307f3e1d88c721a9a7993f2c01d01e03.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Clubman John Cooper Works ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2022}
2026-03-27 10:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN62296%27 HTTP/1.1" 200 None
2026-03-27 10:50:04 [auto1.de] INFO: Saving data for BN62296: {'created_time': 1774608604.307859, 'last_price_update_time': 1774608604.30787, 'auction_closing_time': 1774716304.0}
2026-03-27 10:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN62296') HTTP/1.1" 204 0
2026-03-27 10:50:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84c9788e-a100-5c3f-a035-b8bc1364dbcd with identifier: DP29257
2026-03-27 10:50:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84c9788e-a100-5c3f-a035-b8bc1364dbcd with identifier: DP29257
2026-03-27 10:50:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84c9788e-a100-5c3f-a035-b8bc1364dbcd with identifier: DP29257 to the API
2026-03-27 10:50:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:50:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:50:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd7/93/d7933118c9b0c1c068bde386b24925dc/pa/DP29257_48b06cec0415631d7b0c0d6e62489657.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:50:10Z',
 'fuel_type': 'diesel',
 'id': '84c9788e-a100-5c3f-a035-b8bc1364dbcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP29257',
 'listing': 'auction',
 'location': 'DE, Kaarst',
 'make': 'BMW',
 'model': '3er',
 'odometer': 182968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84c9788e-a100-5c3f-a035-b8bc1364dbcd/84c9788e-a100-5c3f-a035-b8bc1364dbcd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/93/d7933118c9b0c1c068bde386b24925dc/pa/DP29257_1f596dd8ac448bd0c3be6a2e7ec4b169.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84c9788e-a100-5c3f-a035-b8bc1364dbcd/84c9788e-a100-5c3f-a035-b8bc1364dbcd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/93/d7933118c9b0c1c068bde386b24925dc/pa/DP29257_930ffbac079ff2fae6fa3b30123e3a22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84c9788e-a100-5c3f-a035-b8bc1364dbcd/84c9788e-a100-5c3f-a035-b8bc1364dbcd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/93/d7933118c9b0c1c068bde386b24925dc/pa/DP29257_48b06cec0415631d7b0c0d6e62489657.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84c9788e-a100-5c3f-a035-b8bc1364dbcd/84c9788e-a100-5c3f-a035-b8bc1364dbcd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/93/d7933118c9b0c1c068bde386b24925dc/pa/DP29257_e85be460f981d0030960d436ca0f8d5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84c9788e-a100-5c3f-a035-b8bc1364dbcd/84c9788e-a100-5c3f-a035-b8bc1364dbcd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/93/d7933118c9b0c1c068bde386b24925dc/pa/DP29257_de277edc1244f5cb97d3faf0dbd76573.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-11-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-27 10:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP29257%27 HTTP/1.1" 200 None
2026-03-27 10:50:05 [auto1.de] INFO: Saving data for DP29257: {'created_time': 1774608605.37909, 'last_price_update_time': 1774608605.379101, 'auction_closing_time': 1774716610.0}
2026-03-27 10:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP29257') HTTP/1.1" 204 0
2026-03-27 10:50:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c51564e3-9f42-597c-815a-088caf230849 with identifier: JW24568
2026-03-27 10:50:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c51564e3-9f42-597c-815a-088caf230849 with identifier: JW24568
2026-03-27 10:50:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c51564e3-9f42-597c-815a-088caf230849 with identifier: JW24568 to the API
2026-03-27 10:50:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:50:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:50:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_815d9d50ca014b340c861f05923b2829.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:26:31Z',
 'fuel_type': 'petrol',
 'id': 'c51564e3-9f42-597c-815a-088caf230849',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW24568',
 'listing': 'auction',
 'location': 'DE, Zweibrücken',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 111058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c51564e3-9f42-597c-815a-088caf230849/c51564e3-9f42-597c-815a-088caf230849_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2593841,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_815d9d50ca014b340c861f05923b2829.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c51564e3-9f42-597c-815a-088caf230849/c51564e3-9f42-597c-815a-088caf230849_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78072,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_2331ec1db728215345a164f313d3d3bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c51564e3-9f42-597c-815a-088caf230849/c51564e3-9f42-597c-815a-088caf230849_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_67d518a19b19e1e63ce226fbd55b8497.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c51564e3-9f42-597c-815a-088caf230849/c51564e3-9f42-597c-815a-088caf230849_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2137278,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_8013dcbade7c26cb2b6295d9a1640494.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c51564e3-9f42-597c-815a-088caf230849/c51564e3-9f42-597c-815a-088caf230849_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2296009,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_7be872bed9790f826317422c06d98125.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c51564e3-9f42-597c-815a-088caf230849/c51564e3-9f42-597c-815a-088caf230849_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_733e0872c89b3a6275e30c79fba62d73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c51564e3-9f42-597c-815a-088caf230849/c51564e3-9f42-597c-815a-088caf230849_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2244853,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_28afac24598b1096f53ef6ad76fcbde8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c51564e3-9f42-597c-815a-088caf230849/c51564e3-9f42-597c-815a-088caf230849_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_6233e65b7812cac6239d0a91d5db92cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c51564e3-9f42-597c-815a-088caf230849/c51564e3-9f42-597c-815a-088caf230849_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_c2ab1e4855b8e263647829bd9f9decc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c51564e3-9f42-597c-815a-088caf230849/c51564e3-9f42-597c-815a-088caf230849_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2447923,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/b4/cfb42a6947b53479da12d7a52071891d/pa/JW24568_375b3121a3e9d2ac48f37d0adc1f18ae.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-03-27 10:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW24568%27 HTTP/1.1" 200 None
2026-03-27 10:50:05 [auto1.de] INFO: Saving data for JW24568: {'created_time': 1774608605.819046, 'last_price_update_time': 1774608605.819057, 'auction_closing_time': 1774715191.0}
2026-03-27 10:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW24568') HTTP/1.1" 204 0
2026-03-27 10:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_e78c4b842221b9262436b13c52fb31bc.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_61624e8d41516a7646cdf0deaa3ab141.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:50:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5002caed0>
2026-03-27 10:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad/998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F2a%252F132a76305092f4948dfd44160c3efcd9%252Fpa%252FZV10923_37b77246f682e1ded218f999089a3839.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_37b77246f682e1ded218f999089a3839.jpg saved to cache
2026-03-27 10:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad
2026-03-27 10:50:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5 with identifier: EK35927
2026-03-27 10:50:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5 with scrape type 1
2026-03-27 10:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5
2026-03-27 10:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F09%252F7309ce32f4077ac60a7793ab38867434%252Fpa%252FEK35927_ea7a457cf4900ba20bf837ee2b4775d0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/09/7309ce32f4077ac60a7793ab38867434/pa/EK35927_ea7a457cf4900ba20bf837ee2b4775d0.jpg not downloaded yet
2026-03-27 10:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F09%252F7309ce32f4077ac60a7793ab38867434%252Fpa%252FEK35927_2d401b759afa3932537d6c1f4bcf3259.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/09/7309ce32f4077ac60a7793ab38867434/pa/EK35927_2d401b759afa3932537d6c1f4bcf3259.jpg not downloaded yet
2026-03-27 10:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F09%252F7309ce32f4077ac60a7793ab38867434%252Fpa%252FEK35927_173dc599fe1a66fd2991bf6994d43ad6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/09/7309ce32f4077ac60a7793ab38867434/pa/EK35927_173dc599fe1a66fd2991bf6994d43ad6.jpg not downloaded yet
2026-03-27 10:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50373e8d0>
2026-03-27 10:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0f9732-f4a7-5a17-a2d0-4ab1561931e0/5a0f9732-f4a7-5a17-a2d0-4ab1561931e0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F52%252F4352441487033681dc4d35ff2c59ac12%252Fpa%252FNV35825_e78c4b842221b9262436b13c52fb31bc.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_e78c4b842221b9262436b13c52fb31bc.jpg saved to cache
2026-03-27 10:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0
2026-03-27 10:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001fd0d0>
2026-03-27 10:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0f9732-f4a7-5a17-a2d0-4ab1561931e0/5a0f9732-f4a7-5a17-a2d0-4ab1561931e0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F52%252F4352441487033681dc4d35ff2c59ac12%252Fpa%252FNV35825_61624e8d41516a7646cdf0deaa3ab141.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_61624e8d41516a7646cdf0deaa3ab141.jpg saved to cache
2026-03-27 10:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0
2026-03-27 10:50:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0, skipping ID generation
2026-03-27 10:50:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0 with scrape type 1
2026-03-27 10:50:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0 sending to next pipeline
2026-03-27 10:50:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0, identifier: NV35825
2026-03-27 10:50:06 [auto1.de] INFO: Channel: 24h | Page: 50 | totalHits: 10583 | hits on page: 40
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F09%252F7309ce32f4077ac60a7793ab38867434%252Fpa%252FEK35927_4929c3c4a2694effa8437e28ae74aeaa.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/09/7309ce32f4077ac60a7793ab38867434/pa/EK35927_4929c3c4a2694effa8437e28ae74aeaa.jpg not downloaded yet
2026-03-27 10:50:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0 with identifier: NV35825
2026-03-27 10:50:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0 with identifier: NV35825
2026-03-27 10:50:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0 with identifier: NV35825 to the API
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:50:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_61624e8d41516a7646cdf0deaa3ab141.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:15:51Z',
 'fuel_type': 'diesel',
 'id': '5a0f9732-f4a7-5a17-a2d0-4ab1561931e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV35825',
 'listing': 'auction',
 'location': 'DE, Kitzingen',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 58701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0f9732-f4a7-5a17-a2d0-4ab1561931e0/5a0f9732-f4a7-5a17-a2d0-4ab1561931e0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_5ea0bdd6cc204d0ca53c26f51dd3c36c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0f9732-f4a7-5a17-a2d0-4ab1561931e0/5a0f9732-f4a7-5a17-a2d0-4ab1561931e0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_57cfe13afd8aa10ca657da156b4514a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0f9732-f4a7-5a17-a2d0-4ab1561931e0/5a0f9732-f4a7-5a17-a2d0-4ab1561931e0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_b64d13b12f4e2195b37c25864a7a1861.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0f9732-f4a7-5a17-a2d0-4ab1561931e0/5a0f9732-f4a7-5a17-a2d0-4ab1561931e0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_a474d3518497047967cd489fb1050311.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0f9732-f4a7-5a17-a2d0-4ab1561931e0/5a0f9732-f4a7-5a17-a2d0-4ab1561931e0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_813695275b74d5140b8dba349ea4113b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0f9732-f4a7-5a17-a2d0-4ab1561931e0/5a0f9732-f4a7-5a17-a2d0-4ab1561931e0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_b8f17a9c8c09eb6c6c424832c312cbc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0f9732-f4a7-5a17-a2d0-4ab1561931e0/5a0f9732-f4a7-5a17-a2d0-4ab1561931e0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_90a93966188a46070f4e94fbf330bd8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0f9732-f4a7-5a17-a2d0-4ab1561931e0/5a0f9732-f4a7-5a17-a2d0-4ab1561931e0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_61624e8d41516a7646cdf0deaa3ab141.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0f9732-f4a7-5a17-a2d0-4ab1561931e0/5a0f9732-f4a7-5a17-a2d0-4ab1561931e0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_eb33904a71a4221681ec70c3e974cddf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0f9732-f4a7-5a17-a2d0-4ab1561931e0/5a0f9732-f4a7-5a17-a2d0-4ab1561931e0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/52/4352441487033681dc4d35ff2c59ac12/pa/NV35825_e78c4b842221b9262436b13c52fb31bc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2019}
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV35825%27 HTTP/1.1" 200 None
2026-03-27 10:50:06 [auto1.de] INFO: Saving data for NV35825: {'created_time': 1774608606.832805, 'last_price_update_time': 1774608606.832818, 'auction_closing_time': 1774714551.0}
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV35825') HTTP/1.1" 204 0
2026-03-27 10:50:06 [scrapy.extensions.logstats] INFO: Crawled 488 pages (at 60 pages/min), scraped 869 items (at 69 items/min)
2026-03-27 10:50:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 10:50:06 [auto1.de] INFO: Found listing with ID: SD36670
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD36670%27 HTTP/1.1" 200 None
2026-03-27 10:50:06 [auto1.de] INFO: Scrape type for SD36670: 0
2026-03-27 10:50:06 [auto1.de] INFO: Found listing with ID: TZ67975
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ67975%27 HTTP/1.1" 200 None
2026-03-27 10:50:06 [auto1.de] INFO: Scrape type for TZ67975: 0
2026-03-27 10:50:06 [auto1.de] INFO: Found listing with ID: UM48488
2026-03-27 10:50:06 [auto1.de] INFO: Found listing with ID: FV46397
2026-03-27 10:50:06 [auto1.de] INFO: Found listing with ID: VA13792
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA13792%27 HTTP/1.1" 200 None
2026-03-27 10:50:06 [auto1.de] INFO: Scrape type for VA13792: 0
2026-03-27 10:50:06 [auto1.de] INFO: Found listing with ID: UZ08427
2026-03-27 10:50:06 [auto1.de] INFO: Found listing with ID: SK99321
2026-03-27 10:50:06 [auto1.de] INFO: Found listing with ID: SG91001
2026-03-27 10:50:06 [auto1.de] INFO: Found listing with ID: HX49915
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX49915%27 HTTP/1.1" 200 None
2026-03-27 10:50:06 [auto1.de] INFO: Scrape type for HX49915: 0
2026-03-27 10:50:06 [auto1.de] INFO: Found listing with ID: GA34239
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA34239%27 HTTP/1.1" 200 None
2026-03-27 10:50:06 [auto1.de] INFO: Scrape type for GA34239: 0
2026-03-27 10:50:06 [auto1.de] INFO: Found listing with ID: BP51481
2026-03-27 10:50:06 [auto1.de] INFO: Found listing with ID: GR15033
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR15033%27 HTTP/1.1" 200 None
2026-03-27 10:50:06 [auto1.de] INFO: Scrape type for GR15033: 0
2026-03-27 10:50:06 [auto1.de] INFO: Found listing with ID: XN11461
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN11461%27 HTTP/1.1" 200 None
2026-03-27 10:50:06 [auto1.de] INFO: Scrape type for XN11461: 0
2026-03-27 10:50:06 [auto1.de] INFO: Found listing with ID: MX26895
2026-03-27 10:50:06 [auto1.de] INFO: Found listing with ID: HU88385
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU88385%27 HTTP/1.1" 200 None
2026-03-27 10:50:06 [auto1.de] INFO: Scrape type for HU88385: 0
2026-03-27 10:50:06 [auto1.de] INFO: Found listing with ID: LD63966
2026-03-27 10:50:06 [auto1.de] INFO: Found listing with ID: RN43410
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN43410%27 HTTP/1.1" 200 None
2026-03-27 10:50:06 [auto1.de] INFO: Scrape type for RN43410: 0
2026-03-27 10:50:06 [auto1.de] INFO: Found listing with ID: UR77332
2026-03-27 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77332%27 HTTP/1.1" 200 None
2026-03-27 10:50:07 [auto1.de] INFO: Scrape type for UR77332: 0
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: LJ04369
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ04369%27 HTTP/1.1" 200 None
2026-03-27 10:50:07 [auto1.de] INFO: Scrape type for LJ04369: 0
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: PV47280
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV47280%27 HTTP/1.1" 200 None
2026-03-27 10:50:07 [auto1.de] INFO: Scrape type for PV47280: 0
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: ME64315
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: HJ54097
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: SZ94185
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ94185%27 HTTP/1.1" 200 None
2026-03-27 10:50:07 [auto1.de] INFO: Scrape type for SZ94185: 0
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: YD94034
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD94034%27 HTTP/1.1" 200 None
2026-03-27 10:50:07 [auto1.de] INFO: Scrape type for YD94034: 0
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: SG58590
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG58590%27 HTTP/1.1" 200 None
2026-03-27 10:50:07 [auto1.de] INFO: Scrape type for SG58590: 0
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: SW86673
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW86673%27 HTTP/1.1" 200 None
2026-03-27 10:50:07 [auto1.de] INFO: Scrape type for SW86673: 0
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: PU13127
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: BX34768
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: SA81936
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: CJ06587
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ06587%27 HTTP/1.1" 200 None
2026-03-27 10:50:07 [auto1.de] INFO: Scrape type for CJ06587: 0
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: JT81466
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT81466%27 HTTP/1.1" 200 None
2026-03-27 10:50:07 [auto1.de] INFO: Scrape type for JT81466: 0
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: UY61545
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY61545%27 HTTP/1.1" 200 None
2026-03-27 10:50:07 [auto1.de] INFO: Scrape type for UY61545: 0
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: LV52918
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: DE56554
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE56554%27 HTTP/1.1" 200 None
2026-03-27 10:50:07 [auto1.de] INFO: Scrape type for DE56554: 0
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: YE15667
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE15667%27 HTTP/1.1" 200 None
2026-03-27 10:50:07 [auto1.de] INFO: Scrape type for YE15667: 0
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: CP43977
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: MR29539
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: TT64948
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: FN00007
2026-03-27 10:50:07 [auto1.de] INFO: Found listing with ID: MD24285
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F09%252F7309ce32f4077ac60a7793ab38867434%252Fpa%252FEK35927_c93c8c64f62355b6aac12822f426fe2d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/09/7309ce32f4077ac60a7793ab38867434/pa/EK35927_c93c8c64f62355b6aac12822f426fe2d.jpg not downloaded yet
2026-03-27 10:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_3d55a37fc1c7d9614e100c5c13947f9f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500396190>
2026-03-27 10:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad/998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F2a%252F132a76305092f4948dfd44160c3efcd9%252Fpa%252FZV10923_3d55a37fc1c7d9614e100c5c13947f9f.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_3d55a37fc1c7d9614e100c5c13947f9f.jpg saved to cache
2026-03-27 10:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad
2026-03-27 10:50:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad, skipping ID generation
2026-03-27 10:50:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad with scrape type 1
2026-03-27 10:50:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad sending to next pipeline
2026-03-27 10:50:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad, identifier: ZV10923
2026-03-27 10:50:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad with identifier: ZV10923
2026-03-27 10:50:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad with identifier: ZV10923
2026-03-27 10:50:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad with identifier: ZV10923 to the API
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:50:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:50:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_3d55a37fc1c7d9614e100c5c13947f9f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:31:09Z',
 'fuel_type': 'petrol',
 'id': '998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV10923',
 'listing': 'auction',
 'location': 'DE, Fürth',
 'make': 'Fiat',
 'model': '500',
 'odometer': 25746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad/998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_37b77246f682e1ded218f999089a3839.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad/998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2806711,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_3d55a37fc1c7d9614e100c5c13947f9f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad/998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_7febd926e0d27c55158d72ccd5310615.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad/998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_7e88425b019e1ee760b9f125196b4445.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad/998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_a3cca8fc2cf3ffc002035455b806940b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad/998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2787997,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_b5939ef986cda815b9f0d3348ddc791c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad/998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2730404,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_9f503a3a5b845cc34c8f52d47b3bc576.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad/998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2829612,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_9caca97f67caec052a65d79c696997c0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad/998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2691295,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_b47ec73e17efc000c2580774bdff056f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad/998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/2a/132a76305092f4948dfd44160c3efcd9/pa/ZV10923_d62741caff560f4bb5fcc49bd757a79d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-05',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Collezione',
 'transmission': 'manual',
 'trim': 'Collezione',
 'year': 2018}
2026-03-27 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV10923%27 HTTP/1.1" 200 None
2026-03-27 10:50:08 [auto1.de] INFO: Saving data for ZV10923: {'created_time': 1774608608.022005, 'last_price_update_time': 1774608608.022035, 'auction_closing_time': 1774715469.0}
2026-03-27 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV10923') HTTP/1.1" 204 0
2026-03-27 10:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/09/7309ce32f4077ac60a7793ab38867434/pa/EK35927_c93c8c64f62355b6aac12822f426fe2d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/09/7309ce32f4077ac60a7793ab38867434/pa/EK35927_4929c3c4a2694effa8437e28ae74aeaa.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501749810>
2026-03-27 10:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88f5dc3d-7c0f-5c73-b99d-0c418ac358e5/88f5dc3d-7c0f-5c73-b99d-0c418ac358e5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F09%252F7309ce32f4077ac60a7793ab38867434%252Fpa%252FEK35927_c93c8c64f62355b6aac12822f426fe2d.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/09/7309ce32f4077ac60a7793ab38867434/pa/EK35927_c93c8c64f62355b6aac12822f426fe2d.jpg saved to cache
2026-03-27 10:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5
2026-03-27 10:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501844490>
2026-03-27 10:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88f5dc3d-7c0f-5c73-b99d-0c418ac358e5/88f5dc3d-7c0f-5c73-b99d-0c418ac358e5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F09%252F7309ce32f4077ac60a7793ab38867434%252Fpa%252FEK35927_4929c3c4a2694effa8437e28ae74aeaa.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/09/7309ce32f4077ac60a7793ab38867434/pa/EK35927_4929c3c4a2694effa8437e28ae74aeaa.jpg saved to cache
2026-03-27 10:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5
2026-03-27 10:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XX92411> (referer: https://www.auto1.com/v1/car-details-view/XX92411/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:50:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/09/7309ce32f4077ac60a7793ab38867434/pa/EK35927_173dc599fe1a66fd2991bf6994d43ad6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e621235e-95f2-5302-a01d-6bf9f14bb7f8 with identifier: XX92411
2026-03-27 10:50:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e621235e-95f2-5302-a01d-6bf9f14bb7f8 with scrape type 1
2026-03-27 10:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e621235e-95f2-5302-a01d-6bf9f14bb7f8
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F37%252F65372c8a75989e201128a7c72b22fab9%252Fpa%252FXX92411_c9e415d1f3784d48d3627b79274dedf3.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_c9e415d1f3784d48d3627b79274dedf3.jpg not downloaded yet
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F37%252F65372c8a75989e201128a7c72b22fab9%252Fpa%252FXX92411_fb58ef7423114753a39aeb37d478b4a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_fb58ef7423114753a39aeb37d478b4a2.jpg not downloaded yet
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F37%252F65372c8a75989e201128a7c72b22fab9%252Fpa%252FXX92411_ef1367c85105db13c45e8d4a9b06d7b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_ef1367c85105db13c45e8d4a9b06d7b2.jpg not downloaded yet
2026-03-27 10:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/09/7309ce32f4077ac60a7793ab38867434/pa/EK35927_2d401b759afa3932537d6c1f4bcf3259.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F37%252F65372c8a75989e201128a7c72b22fab9%252Fpa%252FXX92411_fc1d3346e6d0c911d03746dd0f427e46.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_fc1d3346e6d0c911d03746dd0f427e46.jpg not downloaded yet
2026-03-27 10:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501809550>
2026-03-27 10:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88f5dc3d-7c0f-5c73-b99d-0c418ac358e5/88f5dc3d-7c0f-5c73-b99d-0c418ac358e5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F09%252F7309ce32f4077ac60a7793ab38867434%252Fpa%252FEK35927_173dc599fe1a66fd2991bf6994d43ad6.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/09/7309ce32f4077ac60a7793ab38867434/pa/EK35927_173dc599fe1a66fd2991bf6994d43ad6.jpg saved to cache
2026-03-27 10:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F37%252F65372c8a75989e201128a7c72b22fab9%252Fpa%252FXX92411_b9914031241f2db52e36ce2517333fe5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_b9914031241f2db52e36ce2517333fe5.jpg not downloaded yet
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F37%252F65372c8a75989e201128a7c72b22fab9%252Fpa%252FXX92411_5935cda6794f95c30a3abe4907fd5038.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_5935cda6794f95c30a3abe4907fd5038.jpg not downloaded yet
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F37%252F65372c8a75989e201128a7c72b22fab9%252Fpa%252FXX92411_5e677ec625749afc8c8fbbb540dc1b06.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_5e677ec625749afc8c8fbbb540dc1b06.jpg not downloaded yet
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F37%252F65372c8a75989e201128a7c72b22fab9%252Fpa%252FXX92411_325d6a034535d8d4e068eede598a47a9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_325d6a034535d8d4e068eede598a47a9.jpg not downloaded yet
2026-03-27 10:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016aa3d0>
2026-03-27 10:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88f5dc3d-7c0f-5c73-b99d-0c418ac358e5/88f5dc3d-7c0f-5c73-b99d-0c418ac358e5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F09%252F7309ce32f4077ac60a7793ab38867434%252Fpa%252FEK35927_2d401b759afa3932537d6c1f4bcf3259.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/09/7309ce32f4077ac60a7793ab38867434/pa/EK35927_2d401b759afa3932537d6c1f4bcf3259.jpg saved to cache
2026-03-27 10:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F37%252F65372c8a75989e201128a7c72b22fab9%252Fpa%252FXX92411_082dc2fdc6a888874c28a9eaf055bba2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_082dc2fdc6a888874c28a9eaf055bba2.jpg not downloaded yet
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F37%252F65372c8a75989e201128a7c72b22fab9%252Fpa%252FXX92411_c5a9a75c1fe5a925779d424f6b9f96e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_c5a9a75c1fe5a925779d424f6b9f96e2.jpg not downloaded yet
2026-03-27 10:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_ef1367c85105db13c45e8d4a9b06d7b2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503a16c90>
2026-03-27 10:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e621235e-95f2-5302-a01d-6bf9f14bb7f8/e621235e-95f2-5302-a01d-6bf9f14bb7f8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F37%252F65372c8a75989e201128a7c72b22fab9%252Fpa%252FXX92411_ef1367c85105db13c45e8d4a9b06d7b2.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_ef1367c85105db13c45e8d4a9b06d7b2.jpg saved to cache
2026-03-27 10:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e621235e-95f2-5302-a01d-6bf9f14bb7f8
2026-03-27 10:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_c5a9a75c1fe5a925779d424f6b9f96e2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500571ad0>
2026-03-27 10:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e621235e-95f2-5302-a01d-6bf9f14bb7f8/e621235e-95f2-5302-a01d-6bf9f14bb7f8_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F37%252F65372c8a75989e201128a7c72b22fab9%252Fpa%252FXX92411_c5a9a75c1fe5a925779d424f6b9f96e2.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_c5a9a75c1fe5a925779d424f6b9f96e2.jpg saved to cache
2026-03-27 10:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e621235e-95f2-5302-a01d-6bf9f14bb7f8
2026-03-27 10:50:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_082dc2fdc6a888874c28a9eaf055bba2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_325d6a034535d8d4e068eede598a47a9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500394890>
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e621235e-95f2-5302-a01d-6bf9f14bb7f8/e621235e-95f2-5302-a01d-6bf9f14bb7f8_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F37%252F65372c8a75989e201128a7c72b22fab9%252Fpa%252FXX92411_082dc2fdc6a888874c28a9eaf055bba2.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_082dc2fdc6a888874c28a9eaf055bba2.jpg saved to cache
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e621235e-95f2-5302-a01d-6bf9f14bb7f8
2026-03-27 10:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_5e677ec625749afc8c8fbbb540dc1b06.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50186cf50>
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e621235e-95f2-5302-a01d-6bf9f14bb7f8/e621235e-95f2-5302-a01d-6bf9f14bb7f8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F37%252F65372c8a75989e201128a7c72b22fab9%252Fpa%252FXX92411_325d6a034535d8d4e068eede598a47a9.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_325d6a034535d8d4e068eede598a47a9.jpg saved to cache
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e621235e-95f2-5302-a01d-6bf9f14bb7f8
2026-03-27 10:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_5935cda6794f95c30a3abe4907fd5038.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50180a550>
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e621235e-95f2-5302-a01d-6bf9f14bb7f8/e621235e-95f2-5302-a01d-6bf9f14bb7f8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F37%252F65372c8a75989e201128a7c72b22fab9%252Fpa%252FXX92411_5e677ec625749afc8c8fbbb540dc1b06.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_5e677ec625749afc8c8fbbb540dc1b06.jpg saved to cache
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e621235e-95f2-5302-a01d-6bf9f14bb7f8
2026-03-27 10:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_b9914031241f2db52e36ce2517333fe5.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501682990>
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e621235e-95f2-5302-a01d-6bf9f14bb7f8/e621235e-95f2-5302-a01d-6bf9f14bb7f8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F37%252F65372c8a75989e201128a7c72b22fab9%252Fpa%252FXX92411_5935cda6794f95c30a3abe4907fd5038.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_5935cda6794f95c30a3abe4907fd5038.jpg saved to cache
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e621235e-95f2-5302-a01d-6bf9f14bb7f8
2026-03-27 10:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_fc1d3346e6d0c911d03746dd0f427e46.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017d7ad0>
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e621235e-95f2-5302-a01d-6bf9f14bb7f8/e621235e-95f2-5302-a01d-6bf9f14bb7f8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F37%252F65372c8a75989e201128a7c72b22fab9%252Fpa%252FXX92411_b9914031241f2db52e36ce2517333fe5.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_b9914031241f2db52e36ce2517333fe5.jpg saved to cache
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e621235e-95f2-5302-a01d-6bf9f14bb7f8
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500403d10>
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e621235e-95f2-5302-a01d-6bf9f14bb7f8/e621235e-95f2-5302-a01d-6bf9f14bb7f8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F37%252F65372c8a75989e201128a7c72b22fab9%252Fpa%252FXX92411_fc1d3346e6d0c911d03746dd0f427e46.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_fc1d3346e6d0c911d03746dd0f427e46.jpg saved to cache
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e621235e-95f2-5302-a01d-6bf9f14bb7f8
2026-03-27 10:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_fb58ef7423114753a39aeb37d478b4a2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP24575> (referer: https://www.auto1.com/v1/car-details-view/BP24575/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:50:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_c9e415d1f3784d48d3627b79274dedf3.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/09/7309ce32f4077ac60a7793ab38867434/pa/EK35927_ea7a457cf4900ba20bf837ee2b4775d0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50174b250>
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e621235e-95f2-5302-a01d-6bf9f14bb7f8/e621235e-95f2-5302-a01d-6bf9f14bb7f8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F37%252F65372c8a75989e201128a7c72b22fab9%252Fpa%252FXX92411_fb58ef7423114753a39aeb37d478b4a2.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_fb58ef7423114753a39aeb37d478b4a2.jpg saved to cache
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e621235e-95f2-5302-a01d-6bf9f14bb7f8
2026-03-27 10:50:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3f1334e-fde6-59cd-b2cc-f9f257cfa26d with identifier: BP24575
2026-03-27 10:50:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3f1334e-fde6-59cd-b2cc-f9f257cfa26d with scrape type 1
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3f1334e-fde6-59cd-b2cc-f9f257cfa26d
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F71%252F2971381a479a7ff8ea59255d1f35bb33%252Fpa%252FBP24575_2fec3726cf38162f3b6794c6d59b26bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_2fec3726cf38162f3b6794c6d59b26bf.jpg already downloaded
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F71%252F2971381a479a7ff8ea59255d1f35bb33%252Fpa%252FBP24575_7096309618b861131466c37c5641eb88.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_7096309618b861131466c37c5641eb88.jpg already downloaded
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F71%252F2971381a479a7ff8ea59255d1f35bb33%252Fpa%252FBP24575_d4f1bc6a772452a45f6b95c07585e48b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_d4f1bc6a772452a45f6b95c07585e48b.jpg already downloaded
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F71%252F2971381a479a7ff8ea59255d1f35bb33%252Fpa%252FBP24575_cd51497477f705cfb877ea23d64c369f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_cd51497477f705cfb877ea23d64c369f.jpg already downloaded
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F71%252F2971381a479a7ff8ea59255d1f35bb33%252Fpa%252FBP24575_e2cf796d5380af040165ebb7a4336bf6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_e2cf796d5380af040165ebb7a4336bf6.jpg already downloaded
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F71%252F2971381a479a7ff8ea59255d1f35bb33%252Fpa%252FBP24575_2d1204c4fb85438752fa974426b80939.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_2d1204c4fb85438752fa974426b80939.jpg already downloaded
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F71%252F2971381a479a7ff8ea59255d1f35bb33%252Fpa%252FBP24575_0a8835fe7957183a8adae48fec86142c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_0a8835fe7957183a8adae48fec86142c.jpg already downloaded
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F71%252F2971381a479a7ff8ea59255d1f35bb33%252Fpa%252FBP24575_507d452ab2486537fa99032816a9dc32.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_507d452ab2486537fa99032816a9dc32.jpg already downloaded
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F71%252F2971381a479a7ff8ea59255d1f35bb33%252Fpa%252FBP24575_47ae45eaa999bc68bc3d0cd209660945.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_47ae45eaa999bc68bc3d0cd209660945.jpg already downloaded
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F71%252F2971381a479a7ff8ea59255d1f35bb33%252Fpa%252FBP24575_ddc495a69e24feb15ce0437bdf52fc31.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_ddc495a69e24feb15ce0437bdf52fc31.jpg already downloaded
2026-03-27 10:50:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3f1334e-fde6-59cd-b2cc-f9f257cfa26d, identifier: BP24575
2026-03-27 10:50:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3f1334e-fde6-59cd-b2cc-f9f257cfa26d with identifier: BP24575
2026-03-27 10:50:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3f1334e-fde6-59cd-b2cc-f9f257cfa26d with identifier: BP24575
2026-03-27 10:50:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3f1334e-fde6-59cd-b2cc-f9f257cfa26d with identifier: BP24575 to the API
2026-03-27 10:50:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:50:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:50:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BP24575>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:30:04Z',
 'fuel_type': 'diesel',
 'id': 'c3f1334e-fde6-59cd-b2cc-f9f257cfa26d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP24575',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 176105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_2fec3726cf38162f3b6794c6d59b26bf.jpg',
                'https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_7096309618b861131466c37c5641eb88.jpg',
                'https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_d4f1bc6a772452a45f6b95c07585e48b.jpg',
                'https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_cd51497477f705cfb877ea23d64c369f.jpg',
                'https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_e2cf796d5380af040165ebb7a4336bf6.jpg',
                'https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_2d1204c4fb85438752fa974426b80939.jpg',
                'https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_0a8835fe7957183a8adae48fec86142c.jpg',
                'https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_507d452ab2486537fa99032816a9dc32.jpg',
                'https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_47ae45eaa999bc68bc3d0cd209660945.jpg',
                'https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_ddc495a69e24feb15ce0437bdf52fc31.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f1334e-fde6-59cd-b2cc-f9f257cfa26d/c3f1334e-fde6-59cd-b2cc-f9f257cfa26d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_2fec3726cf38162f3b6794c6d59b26bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f1334e-fde6-59cd-b2cc-f9f257cfa26d/c3f1334e-fde6-59cd-b2cc-f9f257cfa26d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_7096309618b861131466c37c5641eb88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f1334e-fde6-59cd-b2cc-f9f257cfa26d/c3f1334e-fde6-59cd-b2cc-f9f257cfa26d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_d4f1bc6a772452a45f6b95c07585e48b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f1334e-fde6-59cd-b2cc-f9f257cfa26d/c3f1334e-fde6-59cd-b2cc-f9f257cfa26d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_cd51497477f705cfb877ea23d64c369f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f1334e-fde6-59cd-b2cc-f9f257cfa26d/c3f1334e-fde6-59cd-b2cc-f9f257cfa26d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_e2cf796d5380af040165ebb7a4336bf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f1334e-fde6-59cd-b2cc-f9f257cfa26d/c3f1334e-fde6-59cd-b2cc-f9f257cfa26d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_2d1204c4fb85438752fa974426b80939.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f1334e-fde6-59cd-b2cc-f9f257cfa26d/c3f1334e-fde6-59cd-b2cc-f9f257cfa26d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_0a8835fe7957183a8adae48fec86142c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f1334e-fde6-59cd-b2cc-f9f257cfa26d/c3f1334e-fde6-59cd-b2cc-f9f257cfa26d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_507d452ab2486537fa99032816a9dc32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f1334e-fde6-59cd-b2cc-f9f257cfa26d/c3f1334e-fde6-59cd-b2cc-f9f257cfa26d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_47ae45eaa999bc68bc3d0cd209660945.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f1334e-fde6-59cd-b2cc-f9f257cfa26d/c3f1334e-fde6-59cd-b2cc-f9f257cfa26d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/71/2971381a479a7ff8ea59255d1f35bb33/pa/BP24575_ddc495a69e24feb15ce0437bdf52fc31.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper D ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2015}
2026-03-27 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP24575%27 HTTP/1.1" 200 None
2026-03-27 10:50:11 [auto1.de] INFO: Saving data for BP24575: {'created_time': 1774608611.421232, 'last_price_update_time': 1774608611.421244, 'auction_closing_time': 1774715404.0}
2026-03-27 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP24575') HTTP/1.1" 204 0
2026-03-27 10:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018977d0>
2026-03-27 10:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e621235e-95f2-5302-a01d-6bf9f14bb7f8/e621235e-95f2-5302-a01d-6bf9f14bb7f8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F37%252F65372c8a75989e201128a7c72b22fab9%252Fpa%252FXX92411_c9e415d1f3784d48d3627b79274dedf3.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_c9e415d1f3784d48d3627b79274dedf3.jpg saved to cache
2026-03-27 10:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e621235e-95f2-5302-a01d-6bf9f14bb7f8
2026-03-27 10:50:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e621235e-95f2-5302-a01d-6bf9f14bb7f8, skipping ID generation
2026-03-27 10:50:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e621235e-95f2-5302-a01d-6bf9f14bb7f8 with scrape type 1
2026-03-27 10:50:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e621235e-95f2-5302-a01d-6bf9f14bb7f8 sending to next pipeline
2026-03-27 10:50:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e621235e-95f2-5302-a01d-6bf9f14bb7f8, identifier: XX92411
2026-03-27 10:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500375f10>
2026-03-27 10:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88f5dc3d-7c0f-5c73-b99d-0c418ac358e5/88f5dc3d-7c0f-5c73-b99d-0c418ac358e5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F09%252F7309ce32f4077ac60a7793ab38867434%252Fpa%252FEK35927_ea7a457cf4900ba20bf837ee2b4775d0.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/09/7309ce32f4077ac60a7793ab38867434/pa/EK35927_ea7a457cf4900ba20bf837ee2b4775d0.jpg saved to cache
2026-03-27 10:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5
2026-03-27 10:50:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5, skipping ID generation
2026-03-27 10:50:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5 with scrape type 1
2026-03-27 10:50:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5 sending to next pipeline
2026-03-27 10:50:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5, identifier: EK35927
2026-03-27 10:50:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e621235e-95f2-5302-a01d-6bf9f14bb7f8 with identifier: XX92411
2026-03-27 10:50:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e621235e-95f2-5302-a01d-6bf9f14bb7f8 with identifier: XX92411
2026-03-27 10:50:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e621235e-95f2-5302-a01d-6bf9f14bb7f8 with identifier: XX92411 to the API
2026-03-27 10:50:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:50:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:50:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_c9e415d1f3784d48d3627b79274dedf3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:38:30Z',
 'fuel_type': 'diesel',
 'id': 'e621235e-95f2-5302-a01d-6bf9f14bb7f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX92411',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 13504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e621235e-95f2-5302-a01d-6bf9f14bb7f8/e621235e-95f2-5302-a01d-6bf9f14bb7f8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_c9e415d1f3784d48d3627b79274dedf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e621235e-95f2-5302-a01d-6bf9f14bb7f8/e621235e-95f2-5302-a01d-6bf9f14bb7f8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_fb58ef7423114753a39aeb37d478b4a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e621235e-95f2-5302-a01d-6bf9f14bb7f8/e621235e-95f2-5302-a01d-6bf9f14bb7f8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_ef1367c85105db13c45e8d4a9b06d7b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e621235e-95f2-5302-a01d-6bf9f14bb7f8/e621235e-95f2-5302-a01d-6bf9f14bb7f8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_fc1d3346e6d0c911d03746dd0f427e46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e621235e-95f2-5302-a01d-6bf9f14bb7f8/e621235e-95f2-5302-a01d-6bf9f14bb7f8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_b9914031241f2db52e36ce2517333fe5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e621235e-95f2-5302-a01d-6bf9f14bb7f8/e621235e-95f2-5302-a01d-6bf9f14bb7f8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_5935cda6794f95c30a3abe4907fd5038.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e621235e-95f2-5302-a01d-6bf9f14bb7f8/e621235e-95f2-5302-a01d-6bf9f14bb7f8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_5e677ec625749afc8c8fbbb540dc1b06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e621235e-95f2-5302-a01d-6bf9f14bb7f8/e621235e-95f2-5302-a01d-6bf9f14bb7f8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_325d6a034535d8d4e068eede598a47a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e621235e-95f2-5302-a01d-6bf9f14bb7f8/e621235e-95f2-5302-a01d-6bf9f14bb7f8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_082dc2fdc6a888874c28a9eaf055bba2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e621235e-95f2-5302-a01d-6bf9f14bb7f8/e621235e-95f2-5302-a01d-6bf9f14bb7f8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/37/65372c8a75989e201128a7c72b22fab9/pa/XX92411_c5a9a75c1fe5a925779d424f6b9f96e2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-12-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 110 CDI PRO',
 'transmission': 'automatic',
 'trim': 'PRO',
 'year': 2024}
2026-03-27 10:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX92411%27 HTTP/1.1" 200 None
2026-03-27 10:50:12 [auto1.de] INFO: Saving data for XX92411: {'created_time': 1774608612.086118, 'last_price_update_time': 1774608612.08613, 'auction_closing_time': 1774715910.0}
2026-03-27 10:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX92411') HTTP/1.1" 204 0
2026-03-27 10:50:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5 with identifier: EK35927
2026-03-27 10:50:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5 with identifier: EK35927
2026-03-27 10:50:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5 with identifier: EK35927 to the API
2026-03-27 10:50:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:50:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:50:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/09/7309ce32f4077ac60a7793ab38867434/pa/EK35927_ea7a457cf4900ba20bf837ee2b4775d0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:13:00Z',
 'fuel_type': 'petrol',
 'id': '88f5dc3d-7c0f-5c73-b99d-0c418ac358e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK35927',
 'listing': 'auction',
 'location': 'DE, Tradein',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 139354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88f5dc3d-7c0f-5c73-b99d-0c418ac358e5/88f5dc3d-7c0f-5c73-b99d-0c418ac358e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/09/7309ce32f4077ac60a7793ab38867434/pa/EK35927_ea7a457cf4900ba20bf837ee2b4775d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88f5dc3d-7c0f-5c73-b99d-0c418ac358e5/88f5dc3d-7c0f-5c73-b99d-0c418ac358e5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/09/7309ce32f4077ac60a7793ab38867434/pa/EK35927_2d401b759afa3932537d6c1f4bcf3259.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88f5dc3d-7c0f-5c73-b99d-0c418ac358e5/88f5dc3d-7c0f-5c73-b99d-0c418ac358e5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/09/7309ce32f4077ac60a7793ab38867434/pa/EK35927_173dc599fe1a66fd2991bf6994d43ad6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88f5dc3d-7c0f-5c73-b99d-0c418ac358e5/88f5dc3d-7c0f-5c73-b99d-0c418ac358e5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/09/7309ce32f4077ac60a7793ab38867434/pa/EK35927_4929c3c4a2694effa8437e28ae74aeaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88f5dc3d-7c0f-5c73-b99d-0c418ac358e5/88f5dc3d-7c0f-5c73-b99d-0c418ac358e5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/09/7309ce32f4077ac60a7793ab38867434/pa/EK35927_c93c8c64f62355b6aac12822f426fe2d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Best of',
 'transmission': 'manual',
 'trim': 'Best of',
 'year': 2008}
2026-03-27 10:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK35927%27 HTTP/1.1" 200 None
2026-03-27 10:50:12 [auto1.de] INFO: Saving data for EK35927: {'created_time': 1774608612.503727, 'last_price_update_time': 1774608612.503758, 'auction_closing_time': 1774714380.0}
2026-03-27 10:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK35927') HTTP/1.1" 204 0
2026-03-27 10:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY63966> (referer: https://www.auto1.com/v1/car-details-view/XY63966/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:50:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:50:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6b974a3-1396-528e-8784-73a9c50fee01 with identifier: XY63966
2026-03-27 10:50:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6b974a3-1396-528e-8784-73a9c50fee01 with scrape type 1
2026-03-27 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6b974a3-1396-528e-8784-73a9c50fee01
2026-03-27 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe2%252F31e2b2cf94f8f0dbc5d7a2a8391f03c5%252Fpa%252FXY63966_853e89c1141719a028c5a3da63627b55.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_853e89c1141719a028c5a3da63627b55.jpg already downloaded
2026-03-27 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe2%252F31e2b2cf94f8f0dbc5d7a2a8391f03c5%252Fpa%252FXY63966_9fb8b580d77f3c88fc2ab4d6c34ce6eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_9fb8b580d77f3c88fc2ab4d6c34ce6eb.jpg already downloaded
2026-03-27 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe2%252F31e2b2cf94f8f0dbc5d7a2a8391f03c5%252Fpa%252FXY63966_c0a1fedfe2d8fefd3db06794a68811ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_c0a1fedfe2d8fefd3db06794a68811ea.jpg already downloaded
2026-03-27 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe2%252F31e2b2cf94f8f0dbc5d7a2a8391f03c5%252Fpa%252FXY63966_554b82551c0886aa4e215bd02fad5c31.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_554b82551c0886aa4e215bd02fad5c31.jpg already downloaded
2026-03-27 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe2%252F31e2b2cf94f8f0dbc5d7a2a8391f03c5%252Fpa%252FXY63966_9ac4d3fbaae4f727298c2f7afd52ff37.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_9ac4d3fbaae4f727298c2f7afd52ff37.jpg already downloaded
2026-03-27 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe2%252F31e2b2cf94f8f0dbc5d7a2a8391f03c5%252Fpa%252FXY63966_e5a2e896e1ec08f726f11fbe07510e99.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_e5a2e896e1ec08f726f11fbe07510e99.jpg already downloaded
2026-03-27 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe2%252F31e2b2cf94f8f0dbc5d7a2a8391f03c5%252Fpa%252FXY63966_edbd199bbc61cf8ef3d56f75c4aab3ee.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_edbd199bbc61cf8ef3d56f75c4aab3ee.jpg already downloaded
2026-03-27 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe2%252F31e2b2cf94f8f0dbc5d7a2a8391f03c5%252Fpa%252FXY63966_c391e61754a1edfde9927b25aee166e4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_c391e61754a1edfde9927b25aee166e4.jpg already downloaded
2026-03-27 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe2%252F31e2b2cf94f8f0dbc5d7a2a8391f03c5%252Fpa%252FXY63966_a62b56f9af60f7c011f308d14d41537c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_a62b56f9af60f7c011f308d14d41537c.jpg already downloaded
2026-03-27 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe2%252F31e2b2cf94f8f0dbc5d7a2a8391f03c5%252Fpa%252FXY63966_3a443466932b0f5ef2ebc1c80287694b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_3a443466932b0f5ef2ebc1c80287694b.jpg already downloaded
2026-03-27 10:50:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6b974a3-1396-528e-8784-73a9c50fee01, identifier: XY63966
2026-03-27 10:50:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6b974a3-1396-528e-8784-73a9c50fee01 with identifier: XY63966
2026-03-27 10:50:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6b974a3-1396-528e-8784-73a9c50fee01 with identifier: XY63966
2026-03-27 10:50:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6b974a3-1396-528e-8784-73a9c50fee01 with identifier: XY63966 to the API
2026-03-27 10:50:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:50:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:50:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XY63966>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:06:26Z',
 'fuel_type': 'petrol',
 'id': 'd6b974a3-1396-528e-8784-73a9c50fee01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY63966',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 115376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_853e89c1141719a028c5a3da63627b55.jpg',
                'https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_9fb8b580d77f3c88fc2ab4d6c34ce6eb.jpg',
                'https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_c0a1fedfe2d8fefd3db06794a68811ea.jpg',
                'https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_554b82551c0886aa4e215bd02fad5c31.jpg',
                'https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_9ac4d3fbaae4f727298c2f7afd52ff37.jpg',
                'https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_e5a2e896e1ec08f726f11fbe07510e99.jpg',
                'https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_edbd199bbc61cf8ef3d56f75c4aab3ee.jpg',
                'https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_c391e61754a1edfde9927b25aee166e4.jpg',
                'https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_a62b56f9af60f7c011f308d14d41537c.jpg',
                'https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_3a443466932b0f5ef2ebc1c80287694b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b974a3-1396-528e-8784-73a9c50fee01/d6b974a3-1396-528e-8784-73a9c50fee01_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_853e89c1141719a028c5a3da63627b55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b974a3-1396-528e-8784-73a9c50fee01/d6b974a3-1396-528e-8784-73a9c50fee01_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_9fb8b580d77f3c88fc2ab4d6c34ce6eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b974a3-1396-528e-8784-73a9c50fee01/d6b974a3-1396-528e-8784-73a9c50fee01_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_c0a1fedfe2d8fefd3db06794a68811ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b974a3-1396-528e-8784-73a9c50fee01/d6b974a3-1396-528e-8784-73a9c50fee01_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_554b82551c0886aa4e215bd02fad5c31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b974a3-1396-528e-8784-73a9c50fee01/d6b974a3-1396-528e-8784-73a9c50fee01_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_9ac4d3fbaae4f727298c2f7afd52ff37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b974a3-1396-528e-8784-73a9c50fee01/d6b974a3-1396-528e-8784-73a9c50fee01_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_e5a2e896e1ec08f726f11fbe07510e99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b974a3-1396-528e-8784-73a9c50fee01/d6b974a3-1396-528e-8784-73a9c50fee01_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_edbd199bbc61cf8ef3d56f75c4aab3ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b974a3-1396-528e-8784-73a9c50fee01/d6b974a3-1396-528e-8784-73a9c50fee01_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_c391e61754a1edfde9927b25aee166e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b974a3-1396-528e-8784-73a9c50fee01/d6b974a3-1396-528e-8784-73a9c50fee01_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_a62b56f9af60f7c011f308d14d41537c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b974a3-1396-528e-8784-73a9c50fee01/d6b974a3-1396-528e-8784-73a9c50fee01_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e2/31e2b2cf94f8f0dbc5d7a2a8391f03c5/pa/XY63966_3a443466932b0f5ef2ebc1c80287694b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 1.4 TSI ACT Xcellence',
 'transmission': 'automatic',
 'trim': 'Xcellence',
 'year': 2018}
2026-03-27 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY63966%27 HTTP/1.1" 200 None
2026-03-27 10:50:30 [auto1.de] INFO: Saving data for XY63966: {'created_time': 1774608630.410285, 'last_price_update_time': 1774608630.410296, 'auction_closing_time': 1774713986.0}
2026-03-27 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY63966') HTTP/1.1" 204 0
2026-03-27 10:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD22353/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:50:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE61397/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:50:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN31316> (referer: https://www.auto1.com/v1/car-details-view/MN31316/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:50:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:50:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c51cc63-c702-51ba-b09b-335dc906c6b2 with identifier: MN31316
2026-03-27 10:50:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c51cc63-c702-51ba-b09b-335dc906c6b2 with scrape type 1
2026-03-27 10:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4c51cc63-c702-51ba-b09b-335dc906c6b2
2026-03-27 10:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fad%252Fb6adccd51e66d53ece6ca4434d85a185%252Fpa%252FMN31316_a951573bb8c4f73305c8e650f65b1993.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ad/b6adccd51e66d53ece6ca4434d85a185/pa/MN31316_a951573bb8c4f73305c8e650f65b1993.jpg not downloaded yet
2026-03-27 10:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fad%252Fb6adccd51e66d53ece6ca4434d85a185%252Fpa%252FMN31316_4bd2cc06d922565797a6f7a8e175209e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ad/b6adccd51e66d53ece6ca4434d85a185/pa/MN31316_4bd2cc06d922565797a6f7a8e175209e.jpg not downloaded yet
2026-03-27 10:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fad%252Fb6adccd51e66d53ece6ca4434d85a185%252Fpa%252FMN31316_3fc0f9ea6d64d334bf37b827bc6b74b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ad/b6adccd51e66d53ece6ca4434d85a185/pa/MN31316_3fc0f9ea6d64d334bf37b827bc6b74b0.jpg not downloaded yet
2026-03-27 10:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fad%252Fb6adccd51e66d53ece6ca4434d85a185%252Fpa%252FMN31316_5b5a92a295a2340156ad076fab66b07e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ad/b6adccd51e66d53ece6ca4434d85a185/pa/MN31316_5b5a92a295a2340156ad076fab66b07e.jpg not downloaded yet
2026-03-27 10:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fad%252Fb6adccd51e66d53ece6ca4434d85a185%252Fpa%252FMN31316_dedba4ca0315a70c07f5cdc9ab9e2456.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ad/b6adccd51e66d53ece6ca4434d85a185/pa/MN31316_dedba4ca0315a70c07f5cdc9ab9e2456.jpg not downloaded yet
2026-03-27 10:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VD78060> (referer: https://www.auto1.com/v1/car-details-view/VD78060/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:50:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:50:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85ed6daa-f18b-5a89-9a7f-552adeed03ea with identifier: VD78060
2026-03-27 10:50:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85ed6daa-f18b-5a89-9a7f-552adeed03ea with scrape type 1
2026-03-27 10:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 85ed6daa-f18b-5a89-9a7f-552adeed03ea
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F2c%252F7e2c9b3e276d99f8c1c09442392d997c%252Fpa%252FVD78060_1c7a998d0b6497ff9ad8ff3fd5ecd2c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/2c/7e2c9b3e276d99f8c1c09442392d997c/pa/VD78060_1c7a998d0b6497ff9ad8ff3fd5ecd2c0.jpg already downloaded
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F2c%252F7e2c9b3e276d99f8c1c09442392d997c%252Fpa%252FVD78060_f68c0b2f16cfdf3733f570749f54d0e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/2c/7e2c9b3e276d99f8c1c09442392d997c/pa/VD78060_f68c0b2f16cfdf3733f570749f54d0e1.jpg already downloaded
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F2c%252F7e2c9b3e276d99f8c1c09442392d997c%252Fpa%252FVD78060_e1df1552a4b5e48d706ae1f4ad80404b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/2c/7e2c9b3e276d99f8c1c09442392d997c/pa/VD78060_e1df1552a4b5e48d706ae1f4ad80404b.jpg already downloaded
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F2c%252F7e2c9b3e276d99f8c1c09442392d997c%252Fpa%252FVD78060_a539efa56093df22f02ae33e895a7a0f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/2c/7e2c9b3e276d99f8c1c09442392d997c/pa/VD78060_a539efa56093df22f02ae33e895a7a0f.jpg already downloaded
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F2c%252F7e2c9b3e276d99f8c1c09442392d997c%252Fpa%252FVD78060_e65bffb484ae79a70591207dddb1afc2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/2c/7e2c9b3e276d99f8c1c09442392d997c/pa/VD78060_e65bffb484ae79a70591207dddb1afc2.jpg already downloaded
2026-03-27 10:50:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85ed6daa-f18b-5a89-9a7f-552adeed03ea, identifier: VD78060
2026-03-27 10:50:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85ed6daa-f18b-5a89-9a7f-552adeed03ea with identifier: VD78060
2026-03-27 10:50:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85ed6daa-f18b-5a89-9a7f-552adeed03ea with identifier: VD78060
2026-03-27 10:50:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85ed6daa-f18b-5a89-9a7f-552adeed03ea with identifier: VD78060 to the API
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:50:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VD78060>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 58,
 'expiration_date': '2026-03-28T16:39:19Z',
 'fuel_type': 'petrol',
 'id': '85ed6daa-f18b-5a89-9a7f-552adeed03ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD78060',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 119111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img7e/2c/7e2c9b3e276d99f8c1c09442392d997c/pa/VD78060_1c7a998d0b6497ff9ad8ff3fd5ecd2c0.jpg',
                'https://img-pa.auto1.com/img7e/2c/7e2c9b3e276d99f8c1c09442392d997c/pa/VD78060_f68c0b2f16cfdf3733f570749f54d0e1.jpg',
                'https://img-pa.auto1.com/img7e/2c/7e2c9b3e276d99f8c1c09442392d997c/pa/VD78060_e1df1552a4b5e48d706ae1f4ad80404b.jpg',
                'https://img-pa.auto1.com/img7e/2c/7e2c9b3e276d99f8c1c09442392d997c/pa/VD78060_a539efa56093df22f02ae33e895a7a0f.jpg',
                'https://img-pa.auto1.com/img7e/2c/7e2c9b3e276d99f8c1c09442392d997c/pa/VD78060_e65bffb484ae79a70591207dddb1afc2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85ed6daa-f18b-5a89-9a7f-552adeed03ea/85ed6daa-f18b-5a89-9a7f-552adeed03ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/2c/7e2c9b3e276d99f8c1c09442392d997c/pa/VD78060_1c7a998d0b6497ff9ad8ff3fd5ecd2c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85ed6daa-f18b-5a89-9a7f-552adeed03ea/85ed6daa-f18b-5a89-9a7f-552adeed03ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/2c/7e2c9b3e276d99f8c1c09442392d997c/pa/VD78060_f68c0b2f16cfdf3733f570749f54d0e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85ed6daa-f18b-5a89-9a7f-552adeed03ea/85ed6daa-f18b-5a89-9a7f-552adeed03ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/2c/7e2c9b3e276d99f8c1c09442392d997c/pa/VD78060_e1df1552a4b5e48d706ae1f4ad80404b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85ed6daa-f18b-5a89-9a7f-552adeed03ea/85ed6daa-f18b-5a89-9a7f-552adeed03ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/2c/7e2c9b3e276d99f8c1c09442392d997c/pa/VD78060_a539efa56093df22f02ae33e895a7a0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85ed6daa-f18b-5a89-9a7f-552adeed03ea/85ed6daa-f18b-5a89-9a7f-552adeed03ea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/2c/7e2c9b3e276d99f8c1c09442392d997c/pa/VD78060_e65bffb484ae79a70591207dddb1afc2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-12-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2009}
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD78060%27 HTTP/1.1" 200 None
2026-03-27 10:50:51 [auto1.de] INFO: Saving data for VD78060: {'created_time': 1774608651.713168, 'last_price_update_time': 1774608651.713179, 'auction_closing_time': 1774715959.0}
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VD78060') HTTP/1.1" 204 0
2026-03-27 10:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ad/b6adccd51e66d53ece6ca4434d85a185/pa/MN31316_dedba4ca0315a70c07f5cdc9ab9e2456.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ad/b6adccd51e66d53ece6ca4434d85a185/pa/MN31316_5b5a92a295a2340156ad076fab66b07e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500571510>
2026-03-27 10:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c51cc63-c702-51ba-b09b-335dc906c6b2/4c51cc63-c702-51ba-b09b-335dc906c6b2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fad%252Fb6adccd51e66d53ece6ca4434d85a185%252Fpa%252FMN31316_dedba4ca0315a70c07f5cdc9ab9e2456.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ad/b6adccd51e66d53ece6ca4434d85a185/pa/MN31316_dedba4ca0315a70c07f5cdc9ab9e2456.jpg saved to cache
2026-03-27 10:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c51cc63-c702-51ba-b09b-335dc906c6b2
2026-03-27 10:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ad/b6adccd51e66d53ece6ca4434d85a185/pa/MN31316_3fc0f9ea6d64d334bf37b827bc6b74b0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501698dd0>
2026-03-27 10:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c51cc63-c702-51ba-b09b-335dc906c6b2/4c51cc63-c702-51ba-b09b-335dc906c6b2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fad%252Fb6adccd51e66d53ece6ca4434d85a185%252Fpa%252FMN31316_5b5a92a295a2340156ad076fab66b07e.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ad/b6adccd51e66d53ece6ca4434d85a185/pa/MN31316_5b5a92a295a2340156ad076fab66b07e.jpg saved to cache
2026-03-27 10:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c51cc63-c702-51ba-b09b-335dc906c6b2
2026-03-27 10:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ad/b6adccd51e66d53ece6ca4434d85a185/pa/MN31316_4bd2cc06d922565797a6f7a8e175209e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50174a290>
2026-03-27 10:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c51cc63-c702-51ba-b09b-335dc906c6b2/4c51cc63-c702-51ba-b09b-335dc906c6b2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fad%252Fb6adccd51e66d53ece6ca4434d85a185%252Fpa%252FMN31316_3fc0f9ea6d64d334bf37b827bc6b74b0.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ad/b6adccd51e66d53ece6ca4434d85a185/pa/MN31316_3fc0f9ea6d64d334bf37b827bc6b74b0.jpg saved to cache
2026-03-27 10:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c51cc63-c702-51ba-b09b-335dc906c6b2
2026-03-27 10:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/ad/b6adccd51e66d53ece6ca4434d85a185/pa/MN31316_a951573bb8c4f73305c8e650f65b1993.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50186ea90>
2026-03-27 10:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c51cc63-c702-51ba-b09b-335dc906c6b2/4c51cc63-c702-51ba-b09b-335dc906c6b2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fad%252Fb6adccd51e66d53ece6ca4434d85a185%252Fpa%252FMN31316_4bd2cc06d922565797a6f7a8e175209e.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ad/b6adccd51e66d53ece6ca4434d85a185/pa/MN31316_4bd2cc06d922565797a6f7a8e175209e.jpg saved to cache
2026-03-27 10:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c51cc63-c702-51ba-b09b-335dc906c6b2
2026-03-27 10:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501808d10>
2026-03-27 10:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c51cc63-c702-51ba-b09b-335dc906c6b2/4c51cc63-c702-51ba-b09b-335dc906c6b2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fad%252Fb6adccd51e66d53ece6ca4434d85a185%252Fpa%252FMN31316_a951573bb8c4f73305c8e650f65b1993.jpg') HTTP/1.1" 204 0
2026-03-27 10:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/ad/b6adccd51e66d53ece6ca4434d85a185/pa/MN31316_a951573bb8c4f73305c8e650f65b1993.jpg saved to cache
2026-03-27 10:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c51cc63-c702-51ba-b09b-335dc906c6b2
2026-03-27 10:50:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c51cc63-c702-51ba-b09b-335dc906c6b2, skipping ID generation
2026-03-27 10:50:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c51cc63-c702-51ba-b09b-335dc906c6b2 with scrape type 1
2026-03-27 10:50:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c51cc63-c702-51ba-b09b-335dc906c6b2 sending to next pipeline
2026-03-27 10:50:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c51cc63-c702-51ba-b09b-335dc906c6b2, identifier: MN31316
2026-03-27 10:50:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c51cc63-c702-51ba-b09b-335dc906c6b2 with identifier: MN31316
2026-03-27 10:50:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c51cc63-c702-51ba-b09b-335dc906c6b2 with identifier: MN31316
2026-03-27 10:50:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c51cc63-c702-51ba-b09b-335dc906c6b2 with identifier: MN31316 to the API
2026-03-27 10:50:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:50:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:50:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb6/ad/b6adccd51e66d53ece6ca4434d85a185/pa/MN31316_a951573bb8c4f73305c8e650f65b1993.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:11:50Z',
 'fuel_type': 'diesel',
 'id': '4c51cc63-c702-51ba-b09b-335dc906c6b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN31316',
 'listing': 'auction',
 'location': 'DE, Erfurt',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 212907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c51cc63-c702-51ba-b09b-335dc906c6b2/4c51cc63-c702-51ba-b09b-335dc906c6b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/ad/b6adccd51e66d53ece6ca4434d85a185/pa/MN31316_a951573bb8c4f73305c8e650f65b1993.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c51cc63-c702-51ba-b09b-335dc906c6b2/4c51cc63-c702-51ba-b09b-335dc906c6b2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/ad/b6adccd51e66d53ece6ca4434d85a185/pa/MN31316_4bd2cc06d922565797a6f7a8e175209e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c51cc63-c702-51ba-b09b-335dc906c6b2/4c51cc63-c702-51ba-b09b-335dc906c6b2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/ad/b6adccd51e66d53ece6ca4434d85a185/pa/MN31316_3fc0f9ea6d64d334bf37b827bc6b74b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c51cc63-c702-51ba-b09b-335dc906c6b2/4c51cc63-c702-51ba-b09b-335dc906c6b2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/ad/b6adccd51e66d53ece6ca4434d85a185/pa/MN31316_5b5a92a295a2340156ad076fab66b07e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c51cc63-c702-51ba-b09b-335dc906c6b2/4c51cc63-c702-51ba-b09b-335dc906c6b2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/ad/b6adccd51e66d53ece6ca4434d85a185/pa/MN31316_dedba4ca0315a70c07f5cdc9ab9e2456.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2008}
2026-03-27 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN31316%27 HTTP/1.1" 200 None
2026-03-27 10:50:52 [auto1.de] INFO: Saving data for MN31316: {'created_time': 1774608652.815334, 'last_price_update_time': 1774608652.815347, 'auction_closing_time': 1774714310.0}
2026-03-27 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN31316') HTTP/1.1" 204 0
2026-03-27 10:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XW49468/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:51:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SK60410> (referer: https://www.auto1.com/v1/car-details-view/SK60410/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:51:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:51:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dddee70d-734a-5a90-beda-406fde31c029 with identifier: SK60410
2026-03-27 10:51:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dddee70d-734a-5a90-beda-406fde31c029 with scrape type 1
2026-03-27 10:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dddee70d-734a-5a90-beda-406fde31c029
2026-03-27 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff0%252Fd6f02d1961abd75e68693eb413781863%252Fpa%252FSK60410_a09283b47186ef48ea9173cca26b2965.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_a09283b47186ef48ea9173cca26b2965.jpg not downloaded yet
2026-03-27 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff0%252Fd6f02d1961abd75e68693eb413781863%252Fpa%252FSK60410_7919e6667645f9fb5c60b95044fbd876.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_7919e6667645f9fb5c60b95044fbd876.jpg not downloaded yet
2026-03-27 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff0%252Fd6f02d1961abd75e68693eb413781863%252Fpa%252FSK60410_5346440c9298d54daf6f87c8e051a0e9.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_5346440c9298d54daf6f87c8e051a0e9.jpg not downloaded yet
2026-03-27 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff0%252Fd6f02d1961abd75e68693eb413781863%252Fpa%252FSK60410_e9d38e659a46b1d15c1d6859bce114eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_e9d38e659a46b1d15c1d6859bce114eb.jpg not downloaded yet
2026-03-27 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff0%252Fd6f02d1961abd75e68693eb413781863%252Fpa%252FSK60410_de385ae0e116647d549be75305e9c0df.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_de385ae0e116647d549be75305e9c0df.jpg not downloaded yet
2026-03-27 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff0%252Fd6f02d1961abd75e68693eb413781863%252Fpa%252FSK60410_49022af80876a1d3a2eb21f6777e99ff.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_49022af80876a1d3a2eb21f6777e99ff.jpg not downloaded yet
2026-03-27 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff0%252Fd6f02d1961abd75e68693eb413781863%252Fpa%252FSK60410_5bbecf776b2941b5864d8af3e3af3b44.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_5bbecf776b2941b5864d8af3e3af3b44.jpg not downloaded yet
2026-03-27 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff0%252Fd6f02d1961abd75e68693eb413781863%252Fpa%252FSK60410_bdf6199a271d2baa5d330adb666971da.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_bdf6199a271d2baa5d330adb666971da.jpg not downloaded yet
2026-03-27 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff0%252Fd6f02d1961abd75e68693eb413781863%252Fpa%252FSK60410_4fcc38cdc899484c94bdd0cc34ef052e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_4fcc38cdc899484c94bdd0cc34ef052e.jpg not downloaded yet
2026-03-27 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff0%252Fd6f02d1961abd75e68693eb413781863%252Fpa%252FSK60410_e50537ad2e2c125de5a87b7b73b75085.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_e50537ad2e2c125de5a87b7b73b75085.jpg not downloaded yet
2026-03-27 10:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_a09283b47186ef48ea9173cca26b2965.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50165d5d0>
2026-03-27 10:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddee70d-734a-5a90-beda-406fde31c029/dddee70d-734a-5a90-beda-406fde31c029_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff0%252Fd6f02d1961abd75e68693eb413781863%252Fpa%252FSK60410_a09283b47186ef48ea9173cca26b2965.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_a09283b47186ef48ea9173cca26b2965.jpg saved to cache
2026-03-27 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dddee70d-734a-5a90-beda-406fde31c029
2026-03-27 10:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_7919e6667645f9fb5c60b95044fbd876.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_e50537ad2e2c125de5a87b7b73b75085.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500571110>
2026-03-27 10:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddee70d-734a-5a90-beda-406fde31c029/dddee70d-734a-5a90-beda-406fde31c029_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff0%252Fd6f02d1961abd75e68693eb413781863%252Fpa%252FSK60410_7919e6667645f9fb5c60b95044fbd876.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_7919e6667645f9fb5c60b95044fbd876.jpg saved to cache
2026-03-27 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dddee70d-734a-5a90-beda-406fde31c029
2026-03-27 10:51:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50165c7d0>
2026-03-27 10:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddee70d-734a-5a90-beda-406fde31c029/dddee70d-734a-5a90-beda-406fde31c029_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff0%252Fd6f02d1961abd75e68693eb413781863%252Fpa%252FSK60410_e50537ad2e2c125de5a87b7b73b75085.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_e50537ad2e2c125de5a87b7b73b75085.jpg saved to cache
2026-03-27 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dddee70d-734a-5a90-beda-406fde31c029
2026-03-27 10:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VT53198> (referer: https://www.auto1.com/v1/car-details-view/VT53198/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:51:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:51:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b6e3121-8dbd-5e1c-a140-0b9930acfd48 with identifier: VT53198
2026-03-27 10:51:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b6e3121-8dbd-5e1c-a140-0b9930acfd48 with scrape type 1
2026-03-27 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b6e3121-8dbd-5e1c-a140-0b9930acfd48
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fb0%252Fb4b009ee1b4a2f0bad2fc23065b9e58d%252Fpa%252FVT53198_895a16eab1626daa5350c465ac116a13.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_895a16eab1626daa5350c465ac116a13.jpg already downloaded
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fb0%252Fb4b009ee1b4a2f0bad2fc23065b9e58d%252Fpa%252FVT53198_60d3af69acac98ff1d917942f4869224.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_60d3af69acac98ff1d917942f4869224.jpg already downloaded
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fb0%252Fb4b009ee1b4a2f0bad2fc23065b9e58d%252Fpa%252FVT53198_b0f923ea6336ea678277bba4d599e22c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_b0f923ea6336ea678277bba4d599e22c.jpg already downloaded
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fb0%252Fb4b009ee1b4a2f0bad2fc23065b9e58d%252Fpa%252FVT53198_0d18e58c727836b1b20a559b88bcadea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_0d18e58c727836b1b20a559b88bcadea.jpg already downloaded
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fb0%252Fb4b009ee1b4a2f0bad2fc23065b9e58d%252Fpa%252FVT53198_496a3f24332b308cbbc804f76a41a74d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_496a3f24332b308cbbc804f76a41a74d.jpg already downloaded
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fb0%252Fb4b009ee1b4a2f0bad2fc23065b9e58d%252Fpa%252FVT53198_8e507152322f01a44d3b07e202e7818c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_8e507152322f01a44d3b07e202e7818c.jpg already downloaded
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fb0%252Fb4b009ee1b4a2f0bad2fc23065b9e58d%252Fpa%252FVT53198_30fef85a08afc2b8112a88eaa30bd9ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_30fef85a08afc2b8112a88eaa30bd9ea.jpg already downloaded
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fb0%252Fb4b009ee1b4a2f0bad2fc23065b9e58d%252Fpa%252FVT53198_bcf3743b3a09b1eeea4f1f215692f7c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_bcf3743b3a09b1eeea4f1f215692f7c2.jpg already downloaded
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fb0%252Fb4b009ee1b4a2f0bad2fc23065b9e58d%252Fpa%252FVT53198_73f95d0a624d9804783859ec8c4dfb24.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_73f95d0a624d9804783859ec8c4dfb24.jpg already downloaded
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fb0%252Fb4b009ee1b4a2f0bad2fc23065b9e58d%252Fpa%252FVT53198_2029f1b3be3df345c4e221a7335e35b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_2029f1b3be3df345c4e221a7335e35b2.jpg already downloaded
2026-03-27 10:51:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b6e3121-8dbd-5e1c-a140-0b9930acfd48, identifier: VT53198
2026-03-27 10:51:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b6e3121-8dbd-5e1c-a140-0b9930acfd48 with identifier: VT53198
2026-03-27 10:51:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b6e3121-8dbd-5e1c-a140-0b9930acfd48 with identifier: VT53198
2026-03-27 10:51:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b6e3121-8dbd-5e1c-a140-0b9930acfd48 with identifier: VT53198 to the API
2026-03-27 10:51:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:51:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:51:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VT53198>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:51:03Z',
 'fuel_type': 'diesel',
 'id': '5b6e3121-8dbd-5e1c-a140-0b9930acfd48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT53198',
 'listing': 'auction',
 'location': 'DE, Kandel',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 159952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_895a16eab1626daa5350c465ac116a13.jpg',
                'https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_60d3af69acac98ff1d917942f4869224.jpg',
                'https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_b0f923ea6336ea678277bba4d599e22c.jpg',
                'https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_0d18e58c727836b1b20a559b88bcadea.jpg',
                'https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_496a3f24332b308cbbc804f76a41a74d.jpg',
                'https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_8e507152322f01a44d3b07e202e7818c.jpg',
                'https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_30fef85a08afc2b8112a88eaa30bd9ea.jpg',
                'https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_bcf3743b3a09b1eeea4f1f215692f7c2.jpg',
                'https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_73f95d0a624d9804783859ec8c4dfb24.jpg',
                'https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_2029f1b3be3df345c4e221a7335e35b2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b6e3121-8dbd-5e1c-a140-0b9930acfd48/5b6e3121-8dbd-5e1c-a140-0b9930acfd48_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_895a16eab1626daa5350c465ac116a13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b6e3121-8dbd-5e1c-a140-0b9930acfd48/5b6e3121-8dbd-5e1c-a140-0b9930acfd48_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_60d3af69acac98ff1d917942f4869224.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b6e3121-8dbd-5e1c-a140-0b9930acfd48/5b6e3121-8dbd-5e1c-a140-0b9930acfd48_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_b0f923ea6336ea678277bba4d599e22c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b6e3121-8dbd-5e1c-a140-0b9930acfd48/5b6e3121-8dbd-5e1c-a140-0b9930acfd48_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_0d18e58c727836b1b20a559b88bcadea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b6e3121-8dbd-5e1c-a140-0b9930acfd48/5b6e3121-8dbd-5e1c-a140-0b9930acfd48_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_496a3f24332b308cbbc804f76a41a74d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b6e3121-8dbd-5e1c-a140-0b9930acfd48/5b6e3121-8dbd-5e1c-a140-0b9930acfd48_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_8e507152322f01a44d3b07e202e7818c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b6e3121-8dbd-5e1c-a140-0b9930acfd48/5b6e3121-8dbd-5e1c-a140-0b9930acfd48_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_30fef85a08afc2b8112a88eaa30bd9ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b6e3121-8dbd-5e1c-a140-0b9930acfd48/5b6e3121-8dbd-5e1c-a140-0b9930acfd48_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_bcf3743b3a09b1eeea4f1f215692f7c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b6e3121-8dbd-5e1c-a140-0b9930acfd48/5b6e3121-8dbd-5e1c-a140-0b9930acfd48_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_73f95d0a624d9804783859ec8c4dfb24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b6e3121-8dbd-5e1c-a140-0b9930acfd48/5b6e3121-8dbd-5e1c-a140-0b9930acfd48_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/b0/b4b009ee1b4a2f0bad2fc23065b9e58d/pa/VT53198_2029f1b3be3df345c4e221a7335e35b2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-27 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT53198%27 HTTP/1.1" 200 None
2026-03-27 10:51:06 [auto1.de] INFO: Saving data for VT53198: {'created_time': 1774608666.337759, 'last_price_update_time': 1774608666.33777, 'auction_closing_time': 1774716663.0}
2026-03-27 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT53198') HTTP/1.1" 204 0
2026-03-27 10:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_bdf6199a271d2baa5d330adb666971da.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_5bbecf776b2941b5864d8af3e3af3b44.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501847590>
2026-03-27 10:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddee70d-734a-5a90-beda-406fde31c029/dddee70d-734a-5a90-beda-406fde31c029_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff0%252Fd6f02d1961abd75e68693eb413781863%252Fpa%252FSK60410_bdf6199a271d2baa5d330adb666971da.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_bdf6199a271d2baa5d330adb666971da.jpg saved to cache
2026-03-27 10:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dddee70d-734a-5a90-beda-406fde31c029
2026-03-27 10:51:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50169b690>
2026-03-27 10:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddee70d-734a-5a90-beda-406fde31c029/dddee70d-734a-5a90-beda-406fde31c029_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff0%252Fd6f02d1961abd75e68693eb413781863%252Fpa%252FSK60410_5bbecf776b2941b5864d8af3e3af3b44.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_5bbecf776b2941b5864d8af3e3af3b44.jpg saved to cache
2026-03-27 10:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dddee70d-734a-5a90-beda-406fde31c029
2026-03-27 10:51:06 [scrapy.extensions.logstats] INFO: Crawled 498 pages (at 10 pages/min), scraped 877 items (at 8 items/min)
2026-03-27 10:51:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 10:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_4fcc38cdc899484c94bdd0cc34ef052e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_49022af80876a1d3a2eb21f6777e99ff.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017c6a90>
2026-03-27 10:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddee70d-734a-5a90-beda-406fde31c029/dddee70d-734a-5a90-beda-406fde31c029_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff0%252Fd6f02d1961abd75e68693eb413781863%252Fpa%252FSK60410_4fcc38cdc899484c94bdd0cc34ef052e.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_4fcc38cdc899484c94bdd0cc34ef052e.jpg saved to cache
2026-03-27 10:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dddee70d-734a-5a90-beda-406fde31c029
2026-03-27 10:51:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50186cfd0>
2026-03-27 10:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddee70d-734a-5a90-beda-406fde31c029/dddee70d-734a-5a90-beda-406fde31c029_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff0%252Fd6f02d1961abd75e68693eb413781863%252Fpa%252FSK60410_49022af80876a1d3a2eb21f6777e99ff.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_49022af80876a1d3a2eb21f6777e99ff.jpg saved to cache
2026-03-27 10:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dddee70d-734a-5a90-beda-406fde31c029
2026-03-27 10:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_e9d38e659a46b1d15c1d6859bce114eb.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_de385ae0e116647d549be75305e9c0df.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500376f50>
2026-03-27 10:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddee70d-734a-5a90-beda-406fde31c029/dddee70d-734a-5a90-beda-406fde31c029_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff0%252Fd6f02d1961abd75e68693eb413781863%252Fpa%252FSK60410_e9d38e659a46b1d15c1d6859bce114eb.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_e9d38e659a46b1d15c1d6859bce114eb.jpg saved to cache
2026-03-27 10:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dddee70d-734a-5a90-beda-406fde31c029
2026-03-27 10:51:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501630890>
2026-03-27 10:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddee70d-734a-5a90-beda-406fde31c029/dddee70d-734a-5a90-beda-406fde31c029_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff0%252Fd6f02d1961abd75e68693eb413781863%252Fpa%252FSK60410_de385ae0e116647d549be75305e9c0df.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_de385ae0e116647d549be75305e9c0df.jpg saved to cache
2026-03-27 10:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dddee70d-734a-5a90-beda-406fde31c029
2026-03-27 10:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_5346440c9298d54daf6f87c8e051a0e9.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015cf750>
2026-03-27 10:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dddee70d-734a-5a90-beda-406fde31c029/dddee70d-734a-5a90-beda-406fde31c029_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff0%252Fd6f02d1961abd75e68693eb413781863%252Fpa%252FSK60410_5346440c9298d54daf6f87c8e051a0e9.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_5346440c9298d54daf6f87c8e051a0e9.jpg saved to cache
2026-03-27 10:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dddee70d-734a-5a90-beda-406fde31c029
2026-03-27 10:51:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dddee70d-734a-5a90-beda-406fde31c029, skipping ID generation
2026-03-27 10:51:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dddee70d-734a-5a90-beda-406fde31c029 with scrape type 1
2026-03-27 10:51:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dddee70d-734a-5a90-beda-406fde31c029 sending to next pipeline
2026-03-27 10:51:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dddee70d-734a-5a90-beda-406fde31c029, identifier: SK60410
2026-03-27 10:51:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dddee70d-734a-5a90-beda-406fde31c029 with identifier: SK60410
2026-03-27 10:51:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dddee70d-734a-5a90-beda-406fde31c029 with identifier: SK60410
2026-03-27 10:51:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dddee70d-734a-5a90-beda-406fde31c029 with identifier: SK60410 to the API
2026-03-27 10:51:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:51:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:51:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_5346440c9298d54daf6f87c8e051a0e9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:59:31Z',
 'fuel_type': 'diesel',
 'id': 'dddee70d-734a-5a90-beda-406fde31c029',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK60410',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'BMW',
 'model': '5er',
 'odometer': 205170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddee70d-734a-5a90-beda-406fde31c029/dddee70d-734a-5a90-beda-406fde31c029_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2898124,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_a09283b47186ef48ea9173cca26b2965.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddee70d-734a-5a90-beda-406fde31c029/dddee70d-734a-5a90-beda-406fde31c029_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3052683,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_7919e6667645f9fb5c60b95044fbd876.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddee70d-734a-5a90-beda-406fde31c029/dddee70d-734a-5a90-beda-406fde31c029_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3036763,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_5346440c9298d54daf6f87c8e051a0e9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddee70d-734a-5a90-beda-406fde31c029/dddee70d-734a-5a90-beda-406fde31c029_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3144984,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_e9d38e659a46b1d15c1d6859bce114eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddee70d-734a-5a90-beda-406fde31c029/dddee70d-734a-5a90-beda-406fde31c029_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3086585,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_de385ae0e116647d549be75305e9c0df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddee70d-734a-5a90-beda-406fde31c029/dddee70d-734a-5a90-beda-406fde31c029_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2990547,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_49022af80876a1d3a2eb21f6777e99ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddee70d-734a-5a90-beda-406fde31c029/dddee70d-734a-5a90-beda-406fde31c029_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3046494,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_5bbecf776b2941b5864d8af3e3af3b44.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddee70d-734a-5a90-beda-406fde31c029/dddee70d-734a-5a90-beda-406fde31c029_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2868175,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_bdf6199a271d2baa5d330adb666971da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddee70d-734a-5a90-beda-406fde31c029/dddee70d-734a-5a90-beda-406fde31c029_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2914604,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_4fcc38cdc899484c94bdd0cc34ef052e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dddee70d-734a-5a90-beda-406fde31c029/dddee70d-734a-5a90-beda-406fde31c029_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3070594,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/f0/d6f02d1961abd75e68693eb413781863/pa/SK60410_e50537ad2e2c125de5a87b7b73b75085.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 525d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-27 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK60410%27 HTTP/1.1" 200 None
2026-03-27 10:51:08 [auto1.de] INFO: Saving data for SK60410: {'created_time': 1774608668.356028, 'last_price_update_time': 1774608668.356042, 'auction_closing_time': 1774717171.0}
2026-03-27 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK60410') HTTP/1.1" 204 0
2026-03-27 10:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU61840/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:51:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ74086/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:51:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB12842/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:51:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GJ83963/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:51:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD22353> (referer: https://www.auto1.com/v1/car-details-view/FD22353/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:51:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:51:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c535e8c-19b9-514e-b8dc-66192d92671e with identifier: FD22353
2026-03-27 10:51:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c535e8c-19b9-514e-b8dc-66192d92671e with scrape type 1
2026-03-27 10:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c535e8c-19b9-514e-b8dc-66192d92671e
2026-03-27 10:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F75%252F7c755210e6d063a8edf3c4c00363c38d%252Fpa%252FFD22353_746f5998cbb7e808f971666a2db02ab0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_746f5998cbb7e808f971666a2db02ab0.jpg already downloaded
2026-03-27 10:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F75%252F7c755210e6d063a8edf3c4c00363c38d%252Fpa%252FFD22353_596d0e73f8b3ca4c493b8cc8954b9a6a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_596d0e73f8b3ca4c493b8cc8954b9a6a.jpg already downloaded
2026-03-27 10:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F75%252F7c755210e6d063a8edf3c4c00363c38d%252Fpa%252FFD22353_be7ede5972ce049c50ea14f93ae76d02.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_be7ede5972ce049c50ea14f93ae76d02.jpg already downloaded
2026-03-27 10:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F75%252F7c755210e6d063a8edf3c4c00363c38d%252Fpa%252FFD22353_9ed72c3e6808b50816ebb38d3e5ce561.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_9ed72c3e6808b50816ebb38d3e5ce561.jpg already downloaded
2026-03-27 10:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F75%252F7c755210e6d063a8edf3c4c00363c38d%252Fpa%252FFD22353_5de0c5a21ee5d23a591630e893a1caae.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_5de0c5a21ee5d23a591630e893a1caae.jpg already downloaded
2026-03-27 10:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F75%252F7c755210e6d063a8edf3c4c00363c38d%252Fpa%252FFD22353_7a5863c242a87bacc25407fe837b16ff.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_7a5863c242a87bacc25407fe837b16ff.jpg already downloaded
2026-03-27 10:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F75%252F7c755210e6d063a8edf3c4c00363c38d%252Fpa%252FFD22353_296d9ef7ebaafb48fd512fad1495fcd2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_296d9ef7ebaafb48fd512fad1495fcd2.jpg already downloaded
2026-03-27 10:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F75%252F7c755210e6d063a8edf3c4c00363c38d%252Fpa%252FFD22353_2dd2fb4c99d701b343f4def4991f1f45.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_2dd2fb4c99d701b343f4def4991f1f45.jpg already downloaded
2026-03-27 10:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F75%252F7c755210e6d063a8edf3c4c00363c38d%252Fpa%252FFD22353_516a1d9097f4d462c81078bc8005b84a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_516a1d9097f4d462c81078bc8005b84a.jpg already downloaded
2026-03-27 10:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F75%252F7c755210e6d063a8edf3c4c00363c38d%252Fpa%252FFD22353_d7b7fbbf44e59cadc4c26ff19c70d2a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_d7b7fbbf44e59cadc4c26ff19c70d2a1.jpg already downloaded
2026-03-27 10:51:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c535e8c-19b9-514e-b8dc-66192d92671e, identifier: FD22353
2026-03-27 10:51:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c535e8c-19b9-514e-b8dc-66192d92671e with identifier: FD22353
2026-03-27 10:51:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c535e8c-19b9-514e-b8dc-66192d92671e with identifier: FD22353
2026-03-27 10:51:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c535e8c-19b9-514e-b8dc-66192d92671e with identifier: FD22353 to the API
2026-03-27 10:51:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:51:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:51:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FD22353>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:25:17Z',
 'fuel_type': 'petrol',
 'id': '2c535e8c-19b9-514e-b8dc-66192d92671e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD22353',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 92812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_746f5998cbb7e808f971666a2db02ab0.jpg',
                'https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_596d0e73f8b3ca4c493b8cc8954b9a6a.jpg',
                'https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_be7ede5972ce049c50ea14f93ae76d02.jpg',
                'https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_9ed72c3e6808b50816ebb38d3e5ce561.jpg',
                'https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_5de0c5a21ee5d23a591630e893a1caae.jpg',
                'https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_7a5863c242a87bacc25407fe837b16ff.jpg',
                'https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_296d9ef7ebaafb48fd512fad1495fcd2.jpg',
                'https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_2dd2fb4c99d701b343f4def4991f1f45.jpg',
                'https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_516a1d9097f4d462c81078bc8005b84a.jpg',
                'https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_d7b7fbbf44e59cadc4c26ff19c70d2a1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c535e8c-19b9-514e-b8dc-66192d92671e/2c535e8c-19b9-514e-b8dc-66192d92671e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_746f5998cbb7e808f971666a2db02ab0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c535e8c-19b9-514e-b8dc-66192d92671e/2c535e8c-19b9-514e-b8dc-66192d92671e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_596d0e73f8b3ca4c493b8cc8954b9a6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c535e8c-19b9-514e-b8dc-66192d92671e/2c535e8c-19b9-514e-b8dc-66192d92671e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_be7ede5972ce049c50ea14f93ae76d02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c535e8c-19b9-514e-b8dc-66192d92671e/2c535e8c-19b9-514e-b8dc-66192d92671e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_9ed72c3e6808b50816ebb38d3e5ce561.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c535e8c-19b9-514e-b8dc-66192d92671e/2c535e8c-19b9-514e-b8dc-66192d92671e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_5de0c5a21ee5d23a591630e893a1caae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c535e8c-19b9-514e-b8dc-66192d92671e/2c535e8c-19b9-514e-b8dc-66192d92671e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_7a5863c242a87bacc25407fe837b16ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c535e8c-19b9-514e-b8dc-66192d92671e/2c535e8c-19b9-514e-b8dc-66192d92671e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_296d9ef7ebaafb48fd512fad1495fcd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c535e8c-19b9-514e-b8dc-66192d92671e/2c535e8c-19b9-514e-b8dc-66192d92671e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_2dd2fb4c99d701b343f4def4991f1f45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c535e8c-19b9-514e-b8dc-66192d92671e/2c535e8c-19b9-514e-b8dc-66192d92671e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2577623,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_516a1d9097f4d462c81078bc8005b84a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c535e8c-19b9-514e-b8dc-66192d92671e/2c535e8c-19b9-514e-b8dc-66192d92671e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/75/7c755210e6d063a8edf3c4c00363c38d/pa/FD22353_d7b7fbbf44e59cadc4c26ff19c70d2a1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-27 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD22353%27 HTTP/1.1" 200 None
2026-03-27 10:51:21 [auto1.de] INFO: Saving data for FD22353: {'created_time': 1774608681.637625, 'last_price_update_time': 1774608681.637637, 'auction_closing_time': 1774715117.0}
2026-03-27 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD22353') HTTP/1.1" 204 0
2026-03-27 10:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE61397> (referer: https://www.auto1.com/v1/car-details-view/VE61397/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:51:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:51:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ef57936-0030-5867-9342-add26f09c19f with identifier: VE61397
2026-03-27 10:51:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ef57936-0030-5867-9342-add26f09c19f with scrape type 1
2026-03-27 10:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9ef57936-0030-5867-9342-add26f09c19f
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F93%252Fbb93ee488d3dad391737745210f66c28%252Fpa%252FVE61397_b108e5acb02121fe220d04b334b98823.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_b108e5acb02121fe220d04b334b98823.jpg already downloaded
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F93%252Fbb93ee488d3dad391737745210f66c28%252Fpa%252FVE61397_c18aabd5977ad05b9f738eeab3f97b5a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_c18aabd5977ad05b9f738eeab3f97b5a.jpg already downloaded
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F93%252Fbb93ee488d3dad391737745210f66c28%252Fpa%252FVE61397_f7cc1ffcead31964c52366d58213cb88.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_f7cc1ffcead31964c52366d58213cb88.jpg already downloaded
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F93%252Fbb93ee488d3dad391737745210f66c28%252Fpa%252FVE61397_10eb22ca361a088028afbb4259634198.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_10eb22ca361a088028afbb4259634198.jpg already downloaded
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F93%252Fbb93ee488d3dad391737745210f66c28%252Fpa%252FVE61397_8d73dc3a2725122d75b23b2d25531220.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_8d73dc3a2725122d75b23b2d25531220.jpg already downloaded
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F93%252Fbb93ee488d3dad391737745210f66c28%252Fpa%252FVE61397_5b873e6ffde5f455626b9636ad6b5f2d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_5b873e6ffde5f455626b9636ad6b5f2d.jpg already downloaded
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F93%252Fbb93ee488d3dad391737745210f66c28%252Fpa%252FVE61397_0bfe3fc0a896fa24ecc1fb5e038bd3e0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_0bfe3fc0a896fa24ecc1fb5e038bd3e0.jpg already downloaded
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F93%252Fbb93ee488d3dad391737745210f66c28%252Fpa%252FVE61397_e16057abccd42dc4f89af34e83f9e00a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_e16057abccd42dc4f89af34e83f9e00a.jpg already downloaded
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F93%252Fbb93ee488d3dad391737745210f66c28%252Fpa%252FVE61397_06515e26ee3da1cc3f5bc0631a80fa85.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_06515e26ee3da1cc3f5bc0631a80fa85.jpg already downloaded
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F93%252Fbb93ee488d3dad391737745210f66c28%252Fpa%252FVE61397_3f28fd4c7876db499ee93f73c9cd0641.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_3f28fd4c7876db499ee93f73c9cd0641.jpg already downloaded
2026-03-27 10:51:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ef57936-0030-5867-9342-add26f09c19f, identifier: VE61397
2026-03-27 10:51:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ef57936-0030-5867-9342-add26f09c19f with identifier: VE61397
2026-03-27 10:51:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ef57936-0030-5867-9342-add26f09c19f with identifier: VE61397
2026-03-27 10:51:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ef57936-0030-5867-9342-add26f09c19f with identifier: VE61397 to the API
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:51:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:51:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VE61397>
{'auction_title': '',
 'c_o_2_emission_value': 228,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:39:35Z',
 'fuel_type': 'petrol',
 'id': '9ef57936-0030-5867-9342-add26f09c19f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE61397',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 64126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_b108e5acb02121fe220d04b334b98823.jpg',
                'https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_c18aabd5977ad05b9f738eeab3f97b5a.jpg',
                'https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_f7cc1ffcead31964c52366d58213cb88.jpg',
                'https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_10eb22ca361a088028afbb4259634198.jpg',
                'https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_8d73dc3a2725122d75b23b2d25531220.jpg',
                'https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_5b873e6ffde5f455626b9636ad6b5f2d.jpg',
                'https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_0bfe3fc0a896fa24ecc1fb5e038bd3e0.jpg',
                'https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_e16057abccd42dc4f89af34e83f9e00a.jpg',
                'https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_06515e26ee3da1cc3f5bc0631a80fa85.jpg',
                'https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_3f28fd4c7876db499ee93f73c9cd0641.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef57936-0030-5867-9342-add26f09c19f/9ef57936-0030-5867-9342-add26f09c19f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_b108e5acb02121fe220d04b334b98823.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef57936-0030-5867-9342-add26f09c19f/9ef57936-0030-5867-9342-add26f09c19f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_c18aabd5977ad05b9f738eeab3f97b5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef57936-0030-5867-9342-add26f09c19f/9ef57936-0030-5867-9342-add26f09c19f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_f7cc1ffcead31964c52366d58213cb88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef57936-0030-5867-9342-add26f09c19f/9ef57936-0030-5867-9342-add26f09c19f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_10eb22ca361a088028afbb4259634198.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef57936-0030-5867-9342-add26f09c19f/9ef57936-0030-5867-9342-add26f09c19f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_8d73dc3a2725122d75b23b2d25531220.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef57936-0030-5867-9342-add26f09c19f/9ef57936-0030-5867-9342-add26f09c19f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_5b873e6ffde5f455626b9636ad6b5f2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef57936-0030-5867-9342-add26f09c19f/9ef57936-0030-5867-9342-add26f09c19f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_0bfe3fc0a896fa24ecc1fb5e038bd3e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef57936-0030-5867-9342-add26f09c19f/9ef57936-0030-5867-9342-add26f09c19f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_e16057abccd42dc4f89af34e83f9e00a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef57936-0030-5867-9342-add26f09c19f/9ef57936-0030-5867-9342-add26f09c19f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_06515e26ee3da1cc3f5bc0631a80fa85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef57936-0030-5867-9342-add26f09c19f/9ef57936-0030-5867-9342-add26f09c19f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/93/bb93ee488d3dad391737745210f66c28/pa/VE61397_3f28fd4c7876db499ee93f73c9cd0641.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2021}
2026-03-27 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE61397%27 HTTP/1.1" 200 None
2026-03-27 10:51:32 [auto1.de] INFO: Saving data for VE61397: {'created_time': 1774608692.028047, 'last_price_update_time': 1774608692.028057, 'auction_closing_time': 1774715975.0}
2026-03-27 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE61397') HTTP/1.1" 204 0
2026-03-27 10:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU61840> (referer: https://www.auto1.com/v1/car-details-view/SU61840/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:51:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:51:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d29eef2-1aad-5d60-81dd-311508dc3855 with identifier: SU61840
2026-03-27 10:51:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d29eef2-1aad-5d60-81dd-311508dc3855 with scrape type 1
2026-03-27 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3d29eef2-1aad-5d60-81dd-311508dc3855
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F55%252F4a554f6fd710e6cce41121277d7e8429%252Fpa%252FSU61840_f66b7d3afebbbdbc06c5537a550fa416.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_f66b7d3afebbbdbc06c5537a550fa416.jpg not downloaded yet
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F55%252F4a554f6fd710e6cce41121277d7e8429%252Fpa%252FSU61840_81209432c7b1f7416a689d509ace1102.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_81209432c7b1f7416a689d509ace1102.jpg not downloaded yet
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F55%252F4a554f6fd710e6cce41121277d7e8429%252Fpa%252FSU61840_dc44f7211d7572cff3a97b6e6e3bca30.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_dc44f7211d7572cff3a97b6e6e3bca30.jpg not downloaded yet
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F55%252F4a554f6fd710e6cce41121277d7e8429%252Fpa%252FSU61840_603475dc879e861fac9617a03ef86ab7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_603475dc879e861fac9617a03ef86ab7.jpg not downloaded yet
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F55%252F4a554f6fd710e6cce41121277d7e8429%252Fpa%252FSU61840_e44b7c2b6f3b700a93bd3248895eb352.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_e44b7c2b6f3b700a93bd3248895eb352.jpg not downloaded yet
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F55%252F4a554f6fd710e6cce41121277d7e8429%252Fpa%252FSU61840_c933ead2d240d4875b4f8d80774f4456.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_c933ead2d240d4875b4f8d80774f4456.jpg not downloaded yet
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F55%252F4a554f6fd710e6cce41121277d7e8429%252Fpa%252FSU61840_4ea8f8c0c7e39b9163b17bf5841de72b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_4ea8f8c0c7e39b9163b17bf5841de72b.jpg not downloaded yet
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F55%252F4a554f6fd710e6cce41121277d7e8429%252Fpa%252FSU61840_1f805d155687dd3462661ff72ebb36f2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_1f805d155687dd3462661ff72ebb36f2.jpg not downloaded yet
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F55%252F4a554f6fd710e6cce41121277d7e8429%252Fpa%252FSU61840_92ae10f0bd32b26b5a701f6ca7a87c90.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_92ae10f0bd32b26b5a701f6ca7a87c90.jpg not downloaded yet
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F55%252F4a554f6fd710e6cce41121277d7e8429%252Fpa%252FSU61840_2ffd1490c7db050eb71ace2b00e83c64.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_2ffd1490c7db050eb71ace2b00e83c64.jpg not downloaded yet
2026-03-27 10:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_dc44f7211d7572cff3a97b6e6e3bca30.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_c933ead2d240d4875b4f8d80774f4456.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb503adaad0>
2026-03-27 10:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d29eef2-1aad-5d60-81dd-311508dc3855/3d29eef2-1aad-5d60-81dd-311508dc3855_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F55%252F4a554f6fd710e6cce41121277d7e8429%252Fpa%252FSU61840_dc44f7211d7572cff3a97b6e6e3bca30.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_dc44f7211d7572cff3a97b6e6e3bca30.jpg saved to cache
2026-03-27 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3d29eef2-1aad-5d60-81dd-311508dc3855
2026-03-27 10:51:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50186cdd0>
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d29eef2-1aad-5d60-81dd-311508dc3855/3d29eef2-1aad-5d60-81dd-311508dc3855_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F55%252F4a554f6fd710e6cce41121277d7e8429%252Fpa%252FSU61840_c933ead2d240d4875b4f8d80774f4456.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_c933ead2d240d4875b4f8d80774f4456.jpg saved to cache
2026-03-27 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3d29eef2-1aad-5d60-81dd-311508dc3855
2026-03-27 10:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_81209432c7b1f7416a689d509ace1102.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_603475dc879e861fac9617a03ef86ab7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_e44b7c2b6f3b700a93bd3248895eb352.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_2ffd1490c7db050eb71ace2b00e83c64.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_92ae10f0bd32b26b5a701f6ca7a87c90.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500323350>
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d29eef2-1aad-5d60-81dd-311508dc3855/3d29eef2-1aad-5d60-81dd-311508dc3855_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F55%252F4a554f6fd710e6cce41121277d7e8429%252Fpa%252FSU61840_81209432c7b1f7416a689d509ace1102.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_81209432c7b1f7416a689d509ace1102.jpg saved to cache
2026-03-27 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3d29eef2-1aad-5d60-81dd-311508dc3855
2026-03-27 10:51:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500323690>
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d29eef2-1aad-5d60-81dd-311508dc3855/3d29eef2-1aad-5d60-81dd-311508dc3855_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F55%252F4a554f6fd710e6cce41121277d7e8429%252Fpa%252FSU61840_603475dc879e861fac9617a03ef86ab7.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_603475dc879e861fac9617a03ef86ab7.jpg saved to cache
2026-03-27 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3d29eef2-1aad-5d60-81dd-311508dc3855
2026-03-27 10:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_f66b7d3afebbbdbc06c5537a550fa416.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017d6ed0>
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d29eef2-1aad-5d60-81dd-311508dc3855/3d29eef2-1aad-5d60-81dd-311508dc3855_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F55%252F4a554f6fd710e6cce41121277d7e8429%252Fpa%252FSU61840_e44b7c2b6f3b700a93bd3248895eb352.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_e44b7c2b6f3b700a93bd3248895eb352.jpg saved to cache
2026-03-27 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3d29eef2-1aad-5d60-81dd-311508dc3855
2026-03-27 10:51:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501846d50>
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d29eef2-1aad-5d60-81dd-311508dc3855/3d29eef2-1aad-5d60-81dd-311508dc3855_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F55%252F4a554f6fd710e6cce41121277d7e8429%252Fpa%252FSU61840_2ffd1490c7db050eb71ace2b00e83c64.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_2ffd1490c7db050eb71ace2b00e83c64.jpg saved to cache
2026-03-27 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3d29eef2-1aad-5d60-81dd-311508dc3855
2026-03-27 10:51:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501895f90>
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d29eef2-1aad-5d60-81dd-311508dc3855/3d29eef2-1aad-5d60-81dd-311508dc3855_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F55%252F4a554f6fd710e6cce41121277d7e8429%252Fpa%252FSU61840_92ae10f0bd32b26b5a701f6ca7a87c90.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_92ae10f0bd32b26b5a701f6ca7a87c90.jpg saved to cache
2026-03-27 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3d29eef2-1aad-5d60-81dd-311508dc3855
2026-03-27 10:51:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500361310>
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d29eef2-1aad-5d60-81dd-311508dc3855/3d29eef2-1aad-5d60-81dd-311508dc3855_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F55%252F4a554f6fd710e6cce41121277d7e8429%252Fpa%252FSU61840_f66b7d3afebbbdbc06c5537a550fa416.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_f66b7d3afebbbdbc06c5537a550fa416.jpg saved to cache
2026-03-27 10:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d29eef2-1aad-5d60-81dd-311508dc3855
2026-03-27 10:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_1f805d155687dd3462661ff72ebb36f2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001fc850>
2026-03-27 10:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d29eef2-1aad-5d60-81dd-311508dc3855/3d29eef2-1aad-5d60-81dd-311508dc3855_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F55%252F4a554f6fd710e6cce41121277d7e8429%252Fpa%252FSU61840_1f805d155687dd3462661ff72ebb36f2.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_1f805d155687dd3462661ff72ebb36f2.jpg saved to cache
2026-03-27 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3d29eef2-1aad-5d60-81dd-311508dc3855
2026-03-27 10:51:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_4ea8f8c0c7e39b9163b17bf5841de72b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500557310>
2026-03-27 10:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d29eef2-1aad-5d60-81dd-311508dc3855/3d29eef2-1aad-5d60-81dd-311508dc3855_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F55%252F4a554f6fd710e6cce41121277d7e8429%252Fpa%252FSU61840_4ea8f8c0c7e39b9163b17bf5841de72b.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_4ea8f8c0c7e39b9163b17bf5841de72b.jpg saved to cache
2026-03-27 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3d29eef2-1aad-5d60-81dd-311508dc3855
2026-03-27 10:51:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d29eef2-1aad-5d60-81dd-311508dc3855, skipping ID generation
2026-03-27 10:51:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d29eef2-1aad-5d60-81dd-311508dc3855 with scrape type 1
2026-03-27 10:51:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d29eef2-1aad-5d60-81dd-311508dc3855 sending to next pipeline
2026-03-27 10:51:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d29eef2-1aad-5d60-81dd-311508dc3855, identifier: SU61840
2026-03-27 10:51:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d29eef2-1aad-5d60-81dd-311508dc3855 with identifier: SU61840
2026-03-27 10:51:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d29eef2-1aad-5d60-81dd-311508dc3855 with identifier: SU61840
2026-03-27 10:51:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d29eef2-1aad-5d60-81dd-311508dc3855 with identifier: SU61840 to the API
2026-03-27 10:51:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:51:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:51:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_4ea8f8c0c7e39b9163b17bf5841de72b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:34:22Z',
 'fuel_type': 'petrol',
 'id': '3d29eef2-1aad-5d60-81dd-311508dc3855',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU61840',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 49133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d29eef2-1aad-5d60-81dd-311508dc3855/3d29eef2-1aad-5d60-81dd-311508dc3855_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2477166,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_f66b7d3afebbbdbc06c5537a550fa416.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d29eef2-1aad-5d60-81dd-311508dc3855/3d29eef2-1aad-5d60-81dd-311508dc3855_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2521032,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_81209432c7b1f7416a689d509ace1102.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d29eef2-1aad-5d60-81dd-311508dc3855/3d29eef2-1aad-5d60-81dd-311508dc3855_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2712106,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_dc44f7211d7572cff3a97b6e6e3bca30.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d29eef2-1aad-5d60-81dd-311508dc3855/3d29eef2-1aad-5d60-81dd-311508dc3855_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2551152,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_603475dc879e861fac9617a03ef86ab7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d29eef2-1aad-5d60-81dd-311508dc3855/3d29eef2-1aad-5d60-81dd-311508dc3855_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2814095,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_e44b7c2b6f3b700a93bd3248895eb352.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d29eef2-1aad-5d60-81dd-311508dc3855/3d29eef2-1aad-5d60-81dd-311508dc3855_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2772925,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_c933ead2d240d4875b4f8d80774f4456.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d29eef2-1aad-5d60-81dd-311508dc3855/3d29eef2-1aad-5d60-81dd-311508dc3855_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2397480,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_4ea8f8c0c7e39b9163b17bf5841de72b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d29eef2-1aad-5d60-81dd-311508dc3855/3d29eef2-1aad-5d60-81dd-311508dc3855_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2595307,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_1f805d155687dd3462661ff72ebb36f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d29eef2-1aad-5d60-81dd-311508dc3855/3d29eef2-1aad-5d60-81dd-311508dc3855_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2514668,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_92ae10f0bd32b26b5a701f6ca7a87c90.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d29eef2-1aad-5d60-81dd-311508dc3855/3d29eef2-1aad-5d60-81dd-311508dc3855_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2771765,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/55/4a554f6fd710e6cce41121277d7e8429/pa/SU61840_2ffd1490c7db050eb71ace2b00e83c64.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-07',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Ka 1.2 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-27 10:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU61840%27 HTTP/1.1" 200 None
2026-03-27 10:51:36 [auto1.de] INFO: Saving data for SU61840: {'created_time': 1774608696.133629, 'last_price_update_time': 1774608696.133639, 'auction_closing_time': 1774715662.0}
2026-03-27 10:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU61840') HTTP/1.1" 204 0
2026-03-27 10:51:42 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.860(s), this was the 1st time calling it.
2026-03-27 10:51:42 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.9049515583267524 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-27 10:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ74086> (referer: https://www.auto1.com/v1/car-details-view/UZ74086/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:51:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:51:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225 with identifier: UZ74086
2026-03-27 10:51:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225 with scrape type 1
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F28%252F15283714e0645693ad11c9f073be9c62%252Fpa%252FUZ74086_e836c148fde4343640cb3dde1b208147.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_e836c148fde4343640cb3dde1b208147.jpg not downloaded yet
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F28%252F15283714e0645693ad11c9f073be9c62%252Fpa%252FUZ74086_d03d4a8d918a69be34829990e66f6f4f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_d03d4a8d918a69be34829990e66f6f4f.jpg not downloaded yet
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F28%252F15283714e0645693ad11c9f073be9c62%252Fpa%252FUZ74086_9f23c38eb7af36559514ead6bfa41a71.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_9f23c38eb7af36559514ead6bfa41a71.jpg not downloaded yet
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F28%252F15283714e0645693ad11c9f073be9c62%252Fpa%252FUZ74086_5b7355de9bb8d874a9a62bc8f12ea13e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_5b7355de9bb8d874a9a62bc8f12ea13e.jpg not downloaded yet
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F28%252F15283714e0645693ad11c9f073be9c62%252Fpa%252FUZ74086_a8c57e212239d7e00544054b26a6e59b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_a8c57e212239d7e00544054b26a6e59b.jpg not downloaded yet
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F28%252F15283714e0645693ad11c9f073be9c62%252Fpa%252FUZ74086_76fbfd541088925ba04973bda58f6381.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_76fbfd541088925ba04973bda58f6381.jpg not downloaded yet
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F28%252F15283714e0645693ad11c9f073be9c62%252Fpa%252FUZ74086_9582101810dba461e0fd080d3006d6d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_9582101810dba461e0fd080d3006d6d4.jpg not downloaded yet
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F28%252F15283714e0645693ad11c9f073be9c62%252Fpa%252FUZ74086_09eefd8d17f21ae937fdd38df0790417.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_09eefd8d17f21ae937fdd38df0790417.jpg not downloaded yet
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F28%252F15283714e0645693ad11c9f073be9c62%252Fpa%252FUZ74086_4f99cd4d5a8c914255bc197b95bd4904.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_4f99cd4d5a8c914255bc197b95bd4904.jpg not downloaded yet
2026-03-27 10:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_d03d4a8d918a69be34829990e66f6f4f.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_9f23c38eb7af36559514ead6bfa41a71.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_e836c148fde4343640cb3dde1b208147.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F28%252F15283714e0645693ad11c9f073be9c62%252Fpa%252FUZ74086_8ea01ea7c92c3f6e46ca632e766e40f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_8ea01ea7c92c3f6e46ca632e766e40f0.jpg not downloaded yet
2026-03-27 10:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_5b7355de9bb8d874a9a62bc8f12ea13e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_76fbfd541088925ba04973bda58f6381.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_a8c57e212239d7e00544054b26a6e59b.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_8ea01ea7c92c3f6e46ca632e766e40f0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_09eefd8d17f21ae937fdd38df0790417.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501743210>
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c171c7a-9b8d-585a-b1b9-d8f0b3f05225/5c171c7a-9b8d-585a-b1b9-d8f0b3f05225_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F28%252F15283714e0645693ad11c9f073be9c62%252Fpa%252FUZ74086_d03d4a8d918a69be34829990e66f6f4f.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_d03d4a8d918a69be34829990e66f6f4f.jpg saved to cache
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500556310>
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c171c7a-9b8d-585a-b1b9-d8f0b3f05225/5c171c7a-9b8d-585a-b1b9-d8f0b3f05225_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F28%252F15283714e0645693ad11c9f073be9c62%252Fpa%252FUZ74086_9f23c38eb7af36559514ead6bfa41a71.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_9f23c38eb7af36559514ead6bfa41a71.jpg saved to cache
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501751710>
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c171c7a-9b8d-585a-b1b9-d8f0b3f05225/5c171c7a-9b8d-585a-b1b9-d8f0b3f05225_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F28%252F15283714e0645693ad11c9f073be9c62%252Fpa%252FUZ74086_e836c148fde4343640cb3dde1b208147.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_e836c148fde4343640cb3dde1b208147.jpg saved to cache
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225
2026-03-27 10:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_4f99cd4d5a8c914255bc197b95bd4904.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015e10d0>
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c171c7a-9b8d-585a-b1b9-d8f0b3f05225/5c171c7a-9b8d-585a-b1b9-d8f0b3f05225_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F28%252F15283714e0645693ad11c9f073be9c62%252Fpa%252FUZ74086_5b7355de9bb8d874a9a62bc8f12ea13e.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_5b7355de9bb8d874a9a62bc8f12ea13e.jpg saved to cache
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500237010>
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c171c7a-9b8d-585a-b1b9-d8f0b3f05225/5c171c7a-9b8d-585a-b1b9-d8f0b3f05225_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F28%252F15283714e0645693ad11c9f073be9c62%252Fpa%252FUZ74086_76fbfd541088925ba04973bda58f6381.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_76fbfd541088925ba04973bda58f6381.jpg saved to cache
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500376490>
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c171c7a-9b8d-585a-b1b9-d8f0b3f05225/5c171c7a-9b8d-585a-b1b9-d8f0b3f05225_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F28%252F15283714e0645693ad11c9f073be9c62%252Fpa%252FUZ74086_a8c57e212239d7e00544054b26a6e59b.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_a8c57e212239d7e00544054b26a6e59b.jpg saved to cache
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50191cb50>
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c171c7a-9b8d-585a-b1b9-d8f0b3f05225/5c171c7a-9b8d-585a-b1b9-d8f0b3f05225_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F28%252F15283714e0645693ad11c9f073be9c62%252Fpa%252FUZ74086_8ea01ea7c92c3f6e46ca632e766e40f0.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_8ea01ea7c92c3f6e46ca632e766e40f0.jpg saved to cache
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501680710>
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c171c7a-9b8d-585a-b1b9-d8f0b3f05225/5c171c7a-9b8d-585a-b1b9-d8f0b3f05225_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F28%252F15283714e0645693ad11c9f073be9c62%252Fpa%252FUZ74086_09eefd8d17f21ae937fdd38df0790417.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_09eefd8d17f21ae937fdd38df0790417.jpg saved to cache
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019598d0>
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c171c7a-9b8d-585a-b1b9-d8f0b3f05225/5c171c7a-9b8d-585a-b1b9-d8f0b3f05225_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F28%252F15283714e0645693ad11c9f073be9c62%252Fpa%252FUZ74086_4f99cd4d5a8c914255bc197b95bd4904.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_4f99cd4d5a8c914255bc197b95bd4904.jpg saved to cache
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225
2026-03-27 10:51:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_9582101810dba461e0fd080d3006d6d4.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501959910>
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c171c7a-9b8d-585a-b1b9-d8f0b3f05225/5c171c7a-9b8d-585a-b1b9-d8f0b3f05225_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F28%252F15283714e0645693ad11c9f073be9c62%252Fpa%252FUZ74086_9582101810dba461e0fd080d3006d6d4.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_9582101810dba461e0fd080d3006d6d4.jpg saved to cache
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225
2026-03-27 10:51:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225, skipping ID generation
2026-03-27 10:51:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225 with scrape type 1
2026-03-27 10:51:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225 sending to next pipeline
2026-03-27 10:51:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225, identifier: UZ74086
2026-03-27 10:51:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225 with identifier: UZ74086
2026-03-27 10:51:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225 with identifier: UZ74086
2026-03-27 10:51:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225 with identifier: UZ74086 to the API
2026-03-27 10:51:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:51:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:51:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_9582101810dba461e0fd080d3006d6d4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:30:30Z',
 'fuel_type': 'petrol',
 'id': '5c171c7a-9b8d-585a-b1b9-d8f0b3f05225',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ74086',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 161040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c171c7a-9b8d-585a-b1b9-d8f0b3f05225/5c171c7a-9b8d-585a-b1b9-d8f0b3f05225_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_e836c148fde4343640cb3dde1b208147.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c171c7a-9b8d-585a-b1b9-d8f0b3f05225/5c171c7a-9b8d-585a-b1b9-d8f0b3f05225_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_d03d4a8d918a69be34829990e66f6f4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c171c7a-9b8d-585a-b1b9-d8f0b3f05225/5c171c7a-9b8d-585a-b1b9-d8f0b3f05225_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_9f23c38eb7af36559514ead6bfa41a71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c171c7a-9b8d-585a-b1b9-d8f0b3f05225/5c171c7a-9b8d-585a-b1b9-d8f0b3f05225_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_5b7355de9bb8d874a9a62bc8f12ea13e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c171c7a-9b8d-585a-b1b9-d8f0b3f05225/5c171c7a-9b8d-585a-b1b9-d8f0b3f05225_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_a8c57e212239d7e00544054b26a6e59b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c171c7a-9b8d-585a-b1b9-d8f0b3f05225/5c171c7a-9b8d-585a-b1b9-d8f0b3f05225_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_76fbfd541088925ba04973bda58f6381.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c171c7a-9b8d-585a-b1b9-d8f0b3f05225/5c171c7a-9b8d-585a-b1b9-d8f0b3f05225_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_9582101810dba461e0fd080d3006d6d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c171c7a-9b8d-585a-b1b9-d8f0b3f05225/5c171c7a-9b8d-585a-b1b9-d8f0b3f05225_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_09eefd8d17f21ae937fdd38df0790417.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c171c7a-9b8d-585a-b1b9-d8f0b3f05225/5c171c7a-9b8d-585a-b1b9-d8f0b3f05225_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_4f99cd4d5a8c914255bc197b95bd4904.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c171c7a-9b8d-585a-b1b9-d8f0b3f05225/5c171c7a-9b8d-585a-b1b9-d8f0b3f05225_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/28/15283714e0645693ad11c9f073be9c62/pa/UZ74086_8ea01ea7c92c3f6e46ca632e766e40f0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'GTI BlueMotion Tech',
 'year': 2014}
2026-03-27 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ74086%27 HTTP/1.1" 200 None
2026-03-27 10:51:47 [auto1.de] INFO: Saving data for UZ74086: {'created_time': 1774608707.351521, 'last_price_update_time': 1774608707.351532, 'auction_closing_time': 1774715430.0}
2026-03-27 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ74086') HTTP/1.1" 204 0
2026-03-27 10:51:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CJ75930/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:51:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:51:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-27 10:51:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GY83216/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:51:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CJ75930> (referer: https://www.auto1.com/v1/car-details-view/CJ75930/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:51:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XW49468> (referer: https://www.auto1.com/v1/car-details-view/XW49468/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:51:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ed6a0c4-c637-5a98-9456-c360b66a475a with identifier: CJ75930
2026-03-27 10:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed6a0c4-c637-5a98-9456-c360b66a475a with scrape type 1
2026-03-27 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ed6a0c4-c637-5a98-9456-c360b66a475a
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F2d%252Fdd2d48034d13144c22c49378ed8fcbb8%252Fpa%252FCJ75930_c178ce265ab99e2ddad8165e9187242e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_c178ce265ab99e2ddad8165e9187242e.jpg not downloaded yet
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F2d%252Fdd2d48034d13144c22c49378ed8fcbb8%252Fpa%252FCJ75930_8eb552877bf45321bea435ed4070ebf2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_8eb552877bf45321bea435ed4070ebf2.jpg not downloaded yet
2026-03-27 10:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB12842> (referer: https://www.auto1.com/v1/car-details-view/CB12842/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F2d%252Fdd2d48034d13144c22c49378ed8fcbb8%252Fpa%252FCJ75930_0aa6c77a83a94d8d3415bf7d4019b88d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_0aa6c77a83a94d8d3415bf7d4019b88d.jpg not downloaded yet
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F2d%252Fdd2d48034d13144c22c49378ed8fcbb8%252Fpa%252FCJ75930_5f1f51d4326a67dc5480ddfb7e641834.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_5f1f51d4326a67dc5480ddfb7e641834.jpg not downloaded yet
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F2d%252Fdd2d48034d13144c22c49378ed8fcbb8%252Fpa%252FCJ75930_2029cc476a1bc61ab82daa522808de7d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_2029cc476a1bc61ab82daa522808de7d.jpg not downloaded yet
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F2d%252Fdd2d48034d13144c22c49378ed8fcbb8%252Fpa%252FCJ75930_22e1ed903d95398cc2f070f64f2a0e06.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_22e1ed903d95398cc2f070f64f2a0e06.jpg not downloaded yet
2026-03-27 10:51:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8df1793-d5eb-5d40-91af-bfe9d057e714 with identifier: XW49468
2026-03-27 10:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8df1793-d5eb-5d40-91af-bfe9d057e714 with scrape type 1
2026-03-27 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8df1793-d5eb-5d40-91af-bfe9d057e714
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58dc7badbb0d5fcdfcf3887a5c81e1%252Fpa%252FXW49468_116b258a4dcf62cf96eb845c0ff26a6c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_116b258a4dcf62cf96eb845c0ff26a6c.jpg not downloaded yet
2026-03-27 10:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_c178ce265ab99e2ddad8165e9187242e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F2d%252Fdd2d48034d13144c22c49378ed8fcbb8%252Fpa%252FCJ75930_3faa6aecbe624b79e2c11acc37b408b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_3faa6aecbe624b79e2c11acc37b408b2.jpg not downloaded yet
2026-03-27 10:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_8eb552877bf45321bea435ed4070ebf2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58dc7badbb0d5fcdfcf3887a5c81e1%252Fpa%252FXW49468_be4b2b0e16ff4dcdb3dd75857622f5f7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_be4b2b0e16ff4dcdb3dd75857622f5f7.jpg not downloaded yet
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F2d%252Fdd2d48034d13144c22c49378ed8fcbb8%252Fpa%252FCJ75930_71f955e324e9bc5a1eeb27da0cb57c1c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_71f955e324e9bc5a1eeb27da0cb57c1c.jpg not downloaded yet
2026-03-27 10:51:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a03ca11-e6e7-514f-a307-38831f84618b with identifier: CB12842
2026-03-27 10:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a03ca11-e6e7-514f-a307-38831f84618b with scrape type 1
2026-03-27 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 9a03ca11-e6e7-514f-a307-38831f84618b
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F36%252Ff93667c9285394a31136ae8f945d8db0%252Fpa%252FCB12842_65e18bf8456a95e57facd2da6004527c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/36/f93667c9285394a31136ae8f945d8db0/pa/CB12842_65e18bf8456a95e57facd2da6004527c.jpg already downloaded
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F36%252Ff93667c9285394a31136ae8f945d8db0%252Fpa%252FCB12842_70c9818dca2ec94bb36ccd258a2675db.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/36/f93667c9285394a31136ae8f945d8db0/pa/CB12842_70c9818dca2ec94bb36ccd258a2675db.jpg already downloaded
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F36%252Ff93667c9285394a31136ae8f945d8db0%252Fpa%252FCB12842_b19b651a401ef2ae2b7e016b538440c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/36/f93667c9285394a31136ae8f945d8db0/pa/CB12842_b19b651a401ef2ae2b7e016b538440c2.jpg already downloaded
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F36%252Ff93667c9285394a31136ae8f945d8db0%252Fpa%252FCB12842_724705c1c80a43ac6873089e85b5237e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/36/f93667c9285394a31136ae8f945d8db0/pa/CB12842_724705c1c80a43ac6873089e85b5237e.jpg already downloaded
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F36%252Ff93667c9285394a31136ae8f945d8db0%252Fpa%252FCB12842_60052adb0242140746e4e58a5a9ae21f.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/36/f93667c9285394a31136ae8f945d8db0/pa/CB12842_60052adb0242140746e4e58a5a9ae21f.jpg already downloaded
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F36%252Ff93667c9285394a31136ae8f945d8db0%252Fpa%252FCB12842_65ea4ceb8e9bc330134b62734c9ae9c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/36/f93667c9285394a31136ae8f945d8db0/pa/CB12842_65ea4ceb8e9bc330134b62734c9ae9c5.jpg already downloaded
2026-03-27 10:51:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a03ca11-e6e7-514f-a307-38831f84618b, identifier: CB12842
2026-03-27 10:51:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_0aa6c77a83a94d8d3415bf7d4019b88d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58dc7badbb0d5fcdfcf3887a5c81e1%252Fpa%252FXW49468_fbcced5ae6054cde81cab281c4e32bea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_fbcced5ae6054cde81cab281c4e32bea.jpg not downloaded yet
2026-03-27 10:51:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a03ca11-e6e7-514f-a307-38831f84618b with identifier: CB12842
2026-03-27 10:51:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a03ca11-e6e7-514f-a307-38831f84618b with identifier: CB12842
2026-03-27 10:51:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a03ca11-e6e7-514f-a307-38831f84618b with identifier: CB12842 to the API
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:51:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:51:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CB12842>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:47:47Z',
 'fuel_type': 'petrol',
 'id': '9a03ca11-e6e7-514f-a307-38831f84618b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB12842',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 187814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgf9/36/f93667c9285394a31136ae8f945d8db0/pa/CB12842_65e18bf8456a95e57facd2da6004527c.jpg',
                'https://img-pa.auto1.com/imgf9/36/f93667c9285394a31136ae8f945d8db0/pa/CB12842_70c9818dca2ec94bb36ccd258a2675db.jpg',
                'https://img-pa.auto1.com/imgf9/36/f93667c9285394a31136ae8f945d8db0/pa/CB12842_b19b651a401ef2ae2b7e016b538440c2.jpg',
                'https://img-pa.auto1.com/imgf9/36/f93667c9285394a31136ae8f945d8db0/pa/CB12842_724705c1c80a43ac6873089e85b5237e.jpg',
                'https://img-pa.auto1.com/imgf9/36/f93667c9285394a31136ae8f945d8db0/pa/CB12842_60052adb0242140746e4e58a5a9ae21f.jpg',
                'https://img-pa.auto1.com/imgf9/36/f93667c9285394a31136ae8f945d8db0/pa/CB12842_65ea4ceb8e9bc330134b62734c9ae9c5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a03ca11-e6e7-514f-a307-38831f84618b/9a03ca11-e6e7-514f-a307-38831f84618b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/36/f93667c9285394a31136ae8f945d8db0/pa/CB12842_65e18bf8456a95e57facd2da6004527c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a03ca11-e6e7-514f-a307-38831f84618b/9a03ca11-e6e7-514f-a307-38831f84618b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/36/f93667c9285394a31136ae8f945d8db0/pa/CB12842_70c9818dca2ec94bb36ccd258a2675db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a03ca11-e6e7-514f-a307-38831f84618b/9a03ca11-e6e7-514f-a307-38831f84618b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/36/f93667c9285394a31136ae8f945d8db0/pa/CB12842_b19b651a401ef2ae2b7e016b538440c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a03ca11-e6e7-514f-a307-38831f84618b/9a03ca11-e6e7-514f-a307-38831f84618b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/36/f93667c9285394a31136ae8f945d8db0/pa/CB12842_724705c1c80a43ac6873089e85b5237e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a03ca11-e6e7-514f-a307-38831f84618b/9a03ca11-e6e7-514f-a307-38831f84618b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/36/f93667c9285394a31136ae8f945d8db0/pa/CB12842_60052adb0242140746e4e58a5a9ae21f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a03ca11-e6e7-514f-a307-38831f84618b/9a03ca11-e6e7-514f-a307-38831f84618b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/36/f93667c9285394a31136ae8f945d8db0/pa/CB12842_65ea4ceb8e9bc330134b62734c9ae9c5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-03-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB12842%27 HTTP/1.1" 200 None
2026-03-27 10:51:54 [auto1.de] INFO: Saving data for CB12842: {'created_time': 1774608714.080222, 'last_price_update_time': 1774608714.080234, 'auction_closing_time': 1774716467.0}
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CB12842') HTTP/1.1" 204 0
2026-03-27 10:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_5f1f51d4326a67dc5480ddfb7e641834.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_2029cc476a1bc61ab82daa522808de7d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F2d%252Fdd2d48034d13144c22c49378ed8fcbb8%252Fpa%252FCJ75930_51157bd355fcf8728373e966bbf3c4dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_51157bd355fcf8728373e966bbf3c4dd.jpg not downloaded yet
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015d7910>
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed6a0c4-c637-5a98-9456-c360b66a475a/8ed6a0c4-c637-5a98-9456-c360b66a475a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F2d%252Fdd2d48034d13144c22c49378ed8fcbb8%252Fpa%252FCJ75930_c178ce265ab99e2ddad8165e9187242e.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_c178ce265ab99e2ddad8165e9187242e.jpg saved to cache
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ed6a0c4-c637-5a98-9456-c360b66a475a
2026-03-27 10:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_22e1ed903d95398cc2f070f64f2a0e06.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58dc7badbb0d5fcdfcf3887a5c81e1%252Fpa%252FXW49468_a5f11d8fcf51d744be53008194520f41.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_a5f11d8fcf51d744be53008194520f41.jpg not downloaded yet
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c05d0>
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed6a0c4-c637-5a98-9456-c360b66a475a/8ed6a0c4-c637-5a98-9456-c360b66a475a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F2d%252Fdd2d48034d13144c22c49378ed8fcbb8%252Fpa%252FCJ75930_8eb552877bf45321bea435ed4070ebf2.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_8eb552877bf45321bea435ed4070ebf2.jpg saved to cache
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ed6a0c4-c637-5a98-9456-c360b66a475a
2026-03-27 10:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_116b258a4dcf62cf96eb845c0ff26a6c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F2d%252Fdd2d48034d13144c22c49378ed8fcbb8%252Fpa%252FCJ75930_f5859e0176b05fce3a6ee3e5e7d922e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_f5859e0176b05fce3a6ee3e5e7d922e1.jpg not downloaded yet
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001bd0d0>
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed6a0c4-c637-5a98-9456-c360b66a475a/8ed6a0c4-c637-5a98-9456-c360b66a475a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F2d%252Fdd2d48034d13144c22c49378ed8fcbb8%252Fpa%252FCJ75930_0aa6c77a83a94d8d3415bf7d4019b88d.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_0aa6c77a83a94d8d3415bf7d4019b88d.jpg saved to cache
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ed6a0c4-c637-5a98-9456-c360b66a475a
2026-03-27 10:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_3faa6aecbe624b79e2c11acc37b408b2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58dc7badbb0d5fcdfcf3887a5c81e1%252Fpa%252FXW49468_84dc29b82994deec1bcd5635a9e66187.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_84dc29b82994deec1bcd5635a9e66187.jpg not downloaded yet
2026-03-27 10:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GY83216> (referer: https://www.auto1.com/v1/car-details-view/GY83216/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501750950>
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed6a0c4-c637-5a98-9456-c360b66a475a/8ed6a0c4-c637-5a98-9456-c360b66a475a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F2d%252Fdd2d48034d13144c22c49378ed8fcbb8%252Fpa%252FCJ75930_5f1f51d4326a67dc5480ddfb7e641834.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_5f1f51d4326a67dc5480ddfb7e641834.jpg saved to cache
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ed6a0c4-c637-5a98-9456-c360b66a475a
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003869d0>
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed6a0c4-c637-5a98-9456-c360b66a475a/8ed6a0c4-c637-5a98-9456-c360b66a475a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F2d%252Fdd2d48034d13144c22c49378ed8fcbb8%252Fpa%252FCJ75930_2029cc476a1bc61ab82daa522808de7d.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_2029cc476a1bc61ab82daa522808de7d.jpg saved to cache
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ed6a0c4-c637-5a98-9456-c360b66a475a
2026-03-27 10:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_71f955e324e9bc5a1eeb27da0cb57c1c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58dc7badbb0d5fcdfcf3887a5c81e1%252Fpa%252FXW49468_199b5e4758e9abaa480f5aaeaea06e39.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_199b5e4758e9abaa480f5aaeaea06e39.jpg not downloaded yet
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501697510>
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed6a0c4-c637-5a98-9456-c360b66a475a/8ed6a0c4-c637-5a98-9456-c360b66a475a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F2d%252Fdd2d48034d13144c22c49378ed8fcbb8%252Fpa%252FCJ75930_22e1ed903d95398cc2f070f64f2a0e06.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_22e1ed903d95398cc2f070f64f2a0e06.jpg saved to cache
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ed6a0c4-c637-5a98-9456-c360b66a475a
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015cc850>
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8df1793-d5eb-5d40-91af-bfe9d057e714/e8df1793-d5eb-5d40-91af-bfe9d057e714_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58dc7badbb0d5fcdfcf3887a5c81e1%252Fpa%252FXW49468_116b258a4dcf62cf96eb845c0ff26a6c.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_116b258a4dcf62cf96eb845c0ff26a6c.jpg saved to cache
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8df1793-d5eb-5d40-91af-bfe9d057e714
2026-03-27 10:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_be4b2b0e16ff4dcdb3dd75857622f5f7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58dc7badbb0d5fcdfcf3887a5c81e1%252Fpa%252FXW49468_93629b27eeb2bf56bb10f2f618cbad36.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_93629b27eeb2bf56bb10f2f618cbad36.jpg not downloaded yet
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501958590>
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed6a0c4-c637-5a98-9456-c360b66a475a/8ed6a0c4-c637-5a98-9456-c360b66a475a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F2d%252Fdd2d48034d13144c22c49378ed8fcbb8%252Fpa%252FCJ75930_3faa6aecbe624b79e2c11acc37b408b2.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_3faa6aecbe624b79e2c11acc37b408b2.jpg saved to cache
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ed6a0c4-c637-5a98-9456-c360b66a475a
2026-03-27 10:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_51157bd355fcf8728373e966bbf3c4dd.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 334798d0-b753-539d-a913-692ee571232b with identifier: GY83216
2026-03-27 10:51:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 334798d0-b753-539d-a913-692ee571232b with scrape type 1
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 334798d0-b753-539d-a913-692ee571232b
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fa3%252F6aa3d8bc95cf5a9c367324baec8a9756%252Fpa%252FGY83216_852f167886459a974dd07b8032a7da43.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_852f167886459a974dd07b8032a7da43.jpg already downloaded
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fa3%252F6aa3d8bc95cf5a9c367324baec8a9756%252Fpa%252FGY83216_886cc768b5433409148232ba1d1c3c87.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_886cc768b5433409148232ba1d1c3c87.jpg already downloaded
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fa3%252F6aa3d8bc95cf5a9c367324baec8a9756%252Fpa%252FGY83216_1f8903ddb70514ad5a75ba7e6c53df01.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_1f8903ddb70514ad5a75ba7e6c53df01.jpg already downloaded
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fa3%252F6aa3d8bc95cf5a9c367324baec8a9756%252Fpa%252FGY83216_b0736d11c6d2129e46244a73579ce883.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_b0736d11c6d2129e46244a73579ce883.jpg already downloaded
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fa3%252F6aa3d8bc95cf5a9c367324baec8a9756%252Fpa%252FGY83216_db907bc3829f96bea56796f93f8b58b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_db907bc3829f96bea56796f93f8b58b6.jpg already downloaded
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fa3%252F6aa3d8bc95cf5a9c367324baec8a9756%252Fpa%252FGY83216_333fb6359e750c4a0cd1a6955846df32.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_333fb6359e750c4a0cd1a6955846df32.jpg already downloaded
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fa3%252F6aa3d8bc95cf5a9c367324baec8a9756%252Fpa%252FGY83216_6533ee68aabdc6924b97a63d1906ceef.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_6533ee68aabdc6924b97a63d1906ceef.jpg already downloaded
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fa3%252F6aa3d8bc95cf5a9c367324baec8a9756%252Fpa%252FGY83216_94a1b0838c710df4dd229ca8d8751e39.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_94a1b0838c710df4dd229ca8d8751e39.jpg already downloaded
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fa3%252F6aa3d8bc95cf5a9c367324baec8a9756%252Fpa%252FGY83216_e5c342a9ebd997d7be0dd4fcf5c024eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_e5c342a9ebd997d7be0dd4fcf5c024eb.jpg already downloaded
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fa3%252F6aa3d8bc95cf5a9c367324baec8a9756%252Fpa%252FGY83216_65890a77747030e4c8d95818c44327c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_65890a77747030e4c8d95818c44327c2.jpg already downloaded
2026-03-27 10:51:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 334798d0-b753-539d-a913-692ee571232b, identifier: GY83216
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58dc7badbb0d5fcdfcf3887a5c81e1%252Fpa%252FXW49468_54497a2d4ec846efcb4c47f54e19a0ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_54497a2d4ec846efcb4c47f54e19a0ea.jpg not downloaded yet
2026-03-27 10:51:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 334798d0-b753-539d-a913-692ee571232b with identifier: GY83216
2026-03-27 10:51:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 334798d0-b753-539d-a913-692ee571232b with identifier: GY83216
2026-03-27 10:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 334798d0-b753-539d-a913-692ee571232b with identifier: GY83216 to the API
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:51:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GY83216>
{'auction_title': '',
 'c_o_2_emission_value': 221,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:06:29Z',
 'fuel_type': 'diesel',
 'id': '334798d0-b753-539d-a913-692ee571232b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY83216',
 'listing': 'auction',
 'location': 'DE, Leipzig',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 34078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_852f167886459a974dd07b8032a7da43.jpg',
                'https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_886cc768b5433409148232ba1d1c3c87.jpg',
                'https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_1f8903ddb70514ad5a75ba7e6c53df01.jpg',
                'https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_b0736d11c6d2129e46244a73579ce883.jpg',
                'https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_db907bc3829f96bea56796f93f8b58b6.jpg',
                'https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_333fb6359e750c4a0cd1a6955846df32.jpg',
                'https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_6533ee68aabdc6924b97a63d1906ceef.jpg',
                'https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_94a1b0838c710df4dd229ca8d8751e39.jpg',
                'https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_e5c342a9ebd997d7be0dd4fcf5c024eb.jpg',
                'https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_65890a77747030e4c8d95818c44327c2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334798d0-b753-539d-a913-692ee571232b/334798d0-b753-539d-a913-692ee571232b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_852f167886459a974dd07b8032a7da43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334798d0-b753-539d-a913-692ee571232b/334798d0-b753-539d-a913-692ee571232b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_886cc768b5433409148232ba1d1c3c87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334798d0-b753-539d-a913-692ee571232b/334798d0-b753-539d-a913-692ee571232b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_1f8903ddb70514ad5a75ba7e6c53df01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334798d0-b753-539d-a913-692ee571232b/334798d0-b753-539d-a913-692ee571232b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_b0736d11c6d2129e46244a73579ce883.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334798d0-b753-539d-a913-692ee571232b/334798d0-b753-539d-a913-692ee571232b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_db907bc3829f96bea56796f93f8b58b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334798d0-b753-539d-a913-692ee571232b/334798d0-b753-539d-a913-692ee571232b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_333fb6359e750c4a0cd1a6955846df32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334798d0-b753-539d-a913-692ee571232b/334798d0-b753-539d-a913-692ee571232b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_6533ee68aabdc6924b97a63d1906ceef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334798d0-b753-539d-a913-692ee571232b/334798d0-b753-539d-a913-692ee571232b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_94a1b0838c710df4dd229ca8d8751e39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334798d0-b753-539d-a913-692ee571232b/334798d0-b753-539d-a913-692ee571232b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_e5c342a9ebd997d7be0dd4fcf5c024eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334798d0-b753-539d-a913-692ee571232b/334798d0-b753-539d-a913-692ee571232b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/a3/6aa3d8bc95cf5a9c367324baec8a9756/pa/GY83216_65890a77747030e4c8d95818c44327c2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Fiat Ducato 2.2 M-Jet L2H2 RS: 3450 mm',
 'transmission': 'manual',
 'trim': 'L2H2 RS: 3450 mm',
 'year': 2023}
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY83216%27 HTTP/1.1" 200 None
2026-03-27 10:51:55 [auto1.de] INFO: Saving data for GY83216: {'created_time': 1774608715.265914, 'last_price_update_time': 1774608715.265926, 'auction_closing_time': 1774713989.0}
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY83216') HTTP/1.1" 204 0
2026-03-27 10:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_fbcced5ae6054cde81cab281c4e32bea.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50175f150>
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed6a0c4-c637-5a98-9456-c360b66a475a/8ed6a0c4-c637-5a98-9456-c360b66a475a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F2d%252Fdd2d48034d13144c22c49378ed8fcbb8%252Fpa%252FCJ75930_71f955e324e9bc5a1eeb27da0cb57c1c.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_71f955e324e9bc5a1eeb27da0cb57c1c.jpg saved to cache
2026-03-27 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ed6a0c4-c637-5a98-9456-c360b66a475a
2026-03-27 10:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_a5f11d8fcf51d744be53008194520f41.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_84dc29b82994deec1bcd5635a9e66187.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_f5859e0176b05fce3a6ee3e5e7d922e1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58dc7badbb0d5fcdfcf3887a5c81e1%252Fpa%252FXW49468_2b3e4354d48518b6e3bed8e616ce8a6e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_2b3e4354d48518b6e3bed8e616ce8a6e.jpg not downloaded yet
2026-03-27 10:51:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_199b5e4758e9abaa480f5aaeaea06e39.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50178f7d0>
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8df1793-d5eb-5d40-91af-bfe9d057e714/e8df1793-d5eb-5d40-91af-bfe9d057e714_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58dc7badbb0d5fcdfcf3887a5c81e1%252Fpa%252FXW49468_be4b2b0e16ff4dcdb3dd75857622f5f7.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_be4b2b0e16ff4dcdb3dd75857622f5f7.jpg saved to cache
2026-03-27 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8df1793-d5eb-5d40-91af-bfe9d057e714
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501786110>
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed6a0c4-c637-5a98-9456-c360b66a475a/8ed6a0c4-c637-5a98-9456-c360b66a475a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F2d%252Fdd2d48034d13144c22c49378ed8fcbb8%252Fpa%252FCJ75930_51157bd355fcf8728373e966bbf3c4dd.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_51157bd355fcf8728373e966bbf3c4dd.jpg saved to cache
2026-03-27 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ed6a0c4-c637-5a98-9456-c360b66a475a
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58dc7badbb0d5fcdfcf3887a5c81e1%252Fpa%252FXW49468_3162e7eac5d8b12b5aac35130645e4f2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_3162e7eac5d8b12b5aac35130645e4f2.jpg not downloaded yet
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5015d6250>
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8df1793-d5eb-5d40-91af-bfe9d057e714/e8df1793-d5eb-5d40-91af-bfe9d057e714_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58dc7badbb0d5fcdfcf3887a5c81e1%252Fpa%252FXW49468_fbcced5ae6054cde81cab281c4e32bea.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_fbcced5ae6054cde81cab281c4e32bea.jpg saved to cache
2026-03-27 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8df1793-d5eb-5d40-91af-bfe9d057e714
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501655410>
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8df1793-d5eb-5d40-91af-bfe9d057e714/e8df1793-d5eb-5d40-91af-bfe9d057e714_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58dc7badbb0d5fcdfcf3887a5c81e1%252Fpa%252FXW49468_a5f11d8fcf51d744be53008194520f41.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_a5f11d8fcf51d744be53008194520f41.jpg saved to cache
2026-03-27 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8df1793-d5eb-5d40-91af-bfe9d057e714
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500315350>
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8df1793-d5eb-5d40-91af-bfe9d057e714/e8df1793-d5eb-5d40-91af-bfe9d057e714_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58dc7badbb0d5fcdfcf3887a5c81e1%252Fpa%252FXW49468_84dc29b82994deec1bcd5635a9e66187.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_84dc29b82994deec1bcd5635a9e66187.jpg saved to cache
2026-03-27 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8df1793-d5eb-5d40-91af-bfe9d057e714
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501844b10>
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed6a0c4-c637-5a98-9456-c360b66a475a/8ed6a0c4-c637-5a98-9456-c360b66a475a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F2d%252Fdd2d48034d13144c22c49378ed8fcbb8%252Fpa%252FCJ75930_f5859e0176b05fce3a6ee3e5e7d922e1.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_f5859e0176b05fce3a6ee3e5e7d922e1.jpg saved to cache
2026-03-27 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ed6a0c4-c637-5a98-9456-c360b66a475a
2026-03-27 10:51:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ed6a0c4-c637-5a98-9456-c360b66a475a, skipping ID generation
2026-03-27 10:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed6a0c4-c637-5a98-9456-c360b66a475a with scrape type 1
2026-03-27 10:51:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ed6a0c4-c637-5a98-9456-c360b66a475a sending to next pipeline
2026-03-27 10:51:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ed6a0c4-c637-5a98-9456-c360b66a475a, identifier: CJ75930
2026-03-27 10:51:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ed6a0c4-c637-5a98-9456-c360b66a475a with identifier: CJ75930
2026-03-27 10:51:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ed6a0c4-c637-5a98-9456-c360b66a475a with identifier: CJ75930
2026-03-27 10:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ed6a0c4-c637-5a98-9456-c360b66a475a with identifier: CJ75930 to the API
2026-03-27 10:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:51:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_f5859e0176b05fce3a6ee3e5e7d922e1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 114,
 'expiration_date': '2026-03-28T16:28:31Z',
 'fuel_type': 'petrol',
 'id': '8ed6a0c4-c637-5a98-9456-c360b66a475a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ75930',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 106016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed6a0c4-c637-5a98-9456-c360b66a475a/8ed6a0c4-c637-5a98-9456-c360b66a475a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_c178ce265ab99e2ddad8165e9187242e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed6a0c4-c637-5a98-9456-c360b66a475a/8ed6a0c4-c637-5a98-9456-c360b66a475a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_8eb552877bf45321bea435ed4070ebf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed6a0c4-c637-5a98-9456-c360b66a475a/8ed6a0c4-c637-5a98-9456-c360b66a475a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_0aa6c77a83a94d8d3415bf7d4019b88d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed6a0c4-c637-5a98-9456-c360b66a475a/8ed6a0c4-c637-5a98-9456-c360b66a475a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_5f1f51d4326a67dc5480ddfb7e641834.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed6a0c4-c637-5a98-9456-c360b66a475a/8ed6a0c4-c637-5a98-9456-c360b66a475a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_2029cc476a1bc61ab82daa522808de7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed6a0c4-c637-5a98-9456-c360b66a475a/8ed6a0c4-c637-5a98-9456-c360b66a475a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_22e1ed903d95398cc2f070f64f2a0e06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed6a0c4-c637-5a98-9456-c360b66a475a/8ed6a0c4-c637-5a98-9456-c360b66a475a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_3faa6aecbe624b79e2c11acc37b408b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed6a0c4-c637-5a98-9456-c360b66a475a/8ed6a0c4-c637-5a98-9456-c360b66a475a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_71f955e324e9bc5a1eeb27da0cb57c1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed6a0c4-c637-5a98-9456-c360b66a475a/8ed6a0c4-c637-5a98-9456-c360b66a475a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_51157bd355fcf8728373e966bbf3c4dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed6a0c4-c637-5a98-9456-c360b66a475a/8ed6a0c4-c637-5a98-9456-c360b66a475a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/2d/dd2d48034d13144c22c49378ed8fcbb8/pa/CJ75930_f5859e0176b05fce3a6ee3e5e7d922e1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2019}
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ75930%27 HTTP/1.1" 200 None
2026-03-27 10:51:56 [auto1.de] INFO: Saving data for CJ75930: {'created_time': 1774608716.167094, 'last_price_update_time': 1774608716.167105, 'auction_closing_time': 1774715311.0}
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ75930') HTTP/1.1" 204 0
2026-03-27 10:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_93629b27eeb2bf56bb10f2f618cbad36.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016411d0>
2026-03-27 10:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8df1793-d5eb-5d40-91af-bfe9d057e714/e8df1793-d5eb-5d40-91af-bfe9d057e714_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58dc7badbb0d5fcdfcf3887a5c81e1%252Fpa%252FXW49468_199b5e4758e9abaa480f5aaeaea06e39.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_199b5e4758e9abaa480f5aaeaea06e39.jpg saved to cache
2026-03-27 10:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8df1793-d5eb-5d40-91af-bfe9d057e714
2026-03-27 10:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_2b3e4354d48518b6e3bed8e616ce8a6e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_54497a2d4ec846efcb4c47f54e19a0ea.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_3162e7eac5d8b12b5aac35130645e4f2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50045c850>
2026-03-27 10:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8df1793-d5eb-5d40-91af-bfe9d057e714/e8df1793-d5eb-5d40-91af-bfe9d057e714_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58dc7badbb0d5fcdfcf3887a5c81e1%252Fpa%252FXW49468_93629b27eeb2bf56bb10f2f618cbad36.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_93629b27eeb2bf56bb10f2f618cbad36.jpg saved to cache
2026-03-27 10:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8df1793-d5eb-5d40-91af-bfe9d057e714
2026-03-27 10:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5018aa390>
2026-03-27 10:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8df1793-d5eb-5d40-91af-bfe9d057e714/e8df1793-d5eb-5d40-91af-bfe9d057e714_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58dc7badbb0d5fcdfcf3887a5c81e1%252Fpa%252FXW49468_2b3e4354d48518b6e3bed8e616ce8a6e.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_2b3e4354d48518b6e3bed8e616ce8a6e.jpg saved to cache
2026-03-27 10:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8df1793-d5eb-5d40-91af-bfe9d057e714
2026-03-27 10:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50191f510>
2026-03-27 10:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8df1793-d5eb-5d40-91af-bfe9d057e714/e8df1793-d5eb-5d40-91af-bfe9d057e714_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58dc7badbb0d5fcdfcf3887a5c81e1%252Fpa%252FXW49468_54497a2d4ec846efcb4c47f54e19a0ea.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_54497a2d4ec846efcb4c47f54e19a0ea.jpg saved to cache
2026-03-27 10:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8df1793-d5eb-5d40-91af-bfe9d057e714
2026-03-27 10:51:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:51:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5017c5010>
2026-03-27 10:51:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:51:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8df1793-d5eb-5d40-91af-bfe9d057e714/e8df1793-d5eb-5d40-91af-bfe9d057e714_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F58%252F0b58dc7badbb0d5fcdfcf3887a5c81e1%252Fpa%252FXW49468_3162e7eac5d8b12b5aac35130645e4f2.jpg') HTTP/1.1" 204 0
2026-03-27 10:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_3162e7eac5d8b12b5aac35130645e4f2.jpg saved to cache
2026-03-27 10:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8df1793-d5eb-5d40-91af-bfe9d057e714
2026-03-27 10:51:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8df1793-d5eb-5d40-91af-bfe9d057e714, skipping ID generation
2026-03-27 10:51:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8df1793-d5eb-5d40-91af-bfe9d057e714 with scrape type 1
2026-03-27 10:51:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8df1793-d5eb-5d40-91af-bfe9d057e714 sending to next pipeline
2026-03-27 10:51:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8df1793-d5eb-5d40-91af-bfe9d057e714, identifier: XW49468
2026-03-27 10:51:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8df1793-d5eb-5d40-91af-bfe9d057e714 with identifier: XW49468
2026-03-27 10:51:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8df1793-d5eb-5d40-91af-bfe9d057e714 with identifier: XW49468
2026-03-27 10:51:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8df1793-d5eb-5d40-91af-bfe9d057e714 with identifier: XW49468 to the API
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:51:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_3162e7eac5d8b12b5aac35130645e4f2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:48:29Z',
 'fuel_type': 'petrol',
 'id': 'e8df1793-d5eb-5d40-91af-bfe9d057e714',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW49468',
 'listing': 'auction',
 'location': 'DE, Frankfurt',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 96990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8df1793-d5eb-5d40-91af-bfe9d057e714/e8df1793-d5eb-5d40-91af-bfe9d057e714_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_116b258a4dcf62cf96eb845c0ff26a6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8df1793-d5eb-5d40-91af-bfe9d057e714/e8df1793-d5eb-5d40-91af-bfe9d057e714_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_be4b2b0e16ff4dcdb3dd75857622f5f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8df1793-d5eb-5d40-91af-bfe9d057e714/e8df1793-d5eb-5d40-91af-bfe9d057e714_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_fbcced5ae6054cde81cab281c4e32bea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8df1793-d5eb-5d40-91af-bfe9d057e714/e8df1793-d5eb-5d40-91af-bfe9d057e714_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_a5f11d8fcf51d744be53008194520f41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8df1793-d5eb-5d40-91af-bfe9d057e714/e8df1793-d5eb-5d40-91af-bfe9d057e714_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_84dc29b82994deec1bcd5635a9e66187.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8df1793-d5eb-5d40-91af-bfe9d057e714/e8df1793-d5eb-5d40-91af-bfe9d057e714_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_199b5e4758e9abaa480f5aaeaea06e39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8df1793-d5eb-5d40-91af-bfe9d057e714/e8df1793-d5eb-5d40-91af-bfe9d057e714_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_93629b27eeb2bf56bb10f2f618cbad36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8df1793-d5eb-5d40-91af-bfe9d057e714/e8df1793-d5eb-5d40-91af-bfe9d057e714_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_54497a2d4ec846efcb4c47f54e19a0ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8df1793-d5eb-5d40-91af-bfe9d057e714/e8df1793-d5eb-5d40-91af-bfe9d057e714_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_2b3e4354d48518b6e3bed8e616ce8a6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8df1793-d5eb-5d40-91af-bfe9d057e714/e8df1793-d5eb-5d40-91af-bfe9d057e714_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/58/0b58dc7badbb0d5fcdfcf3887a5c81e1/pa/XW49468_3162e7eac5d8b12b5aac35130645e4f2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2015}
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW49468%27 HTTP/1.1" 200 None
2026-03-27 10:51:56 [auto1.de] INFO: Saving data for XW49468: {'created_time': 1774608716.974683, 'last_price_update_time': 1774608716.974694, 'auction_closing_time': 1774716509.0}
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW49468') HTTP/1.1" 204 0
2026-03-27 10:52:04 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.176(s), this was the 1st time calling it.
2026-03-27 10:52:04 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.186534556568287 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-27 10:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GJ83963> (referer: https://www.auto1.com/v1/car-details-view/GJ83963/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:52:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfab1721-fc06-5443-a90c-b5a9e8789030 with identifier: GJ83963
2026-03-27 10:52:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfab1721-fc06-5443-a90c-b5a9e8789030 with scrape type 1
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cfab1721-fc06-5443-a90c-b5a9e8789030
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fa9%252Feca94e92cd147d1ec03559a623d73554%252Fpa%252FGJ83963_35fa7eb662e45fe2d8270f3aa5b2f663.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_35fa7eb662e45fe2d8270f3aa5b2f663.jpg not downloaded yet
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fa9%252Feca94e92cd147d1ec03559a623d73554%252Fpa%252FGJ83963_4b9522f939db421958f71c107e6532a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_4b9522f939db421958f71c107e6532a7.jpg not downloaded yet
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fa9%252Feca94e92cd147d1ec03559a623d73554%252Fpa%252FGJ83963_350e00f72c4cf54749660eae0dc5bf32.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_350e00f72c4cf54749660eae0dc5bf32.jpg not downloaded yet
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fa9%252Feca94e92cd147d1ec03559a623d73554%252Fpa%252FGJ83963_2c2cdb65903814c5c01191df7ccc5c79.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_2c2cdb65903814c5c01191df7ccc5c79.jpg not downloaded yet
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fa9%252Feca94e92cd147d1ec03559a623d73554%252Fpa%252FGJ83963_a7c37e28e76786d4c46134e4aa4e7a2a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_a7c37e28e76786d4c46134e4aa4e7a2a.jpg not downloaded yet
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fa9%252Feca94e92cd147d1ec03559a623d73554%252Fpa%252FGJ83963_fd75b7da69a28ba2812d40cde1f15c75.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_fd75b7da69a28ba2812d40cde1f15c75.jpg not downloaded yet
2026-03-27 10:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_35fa7eb662e45fe2d8270f3aa5b2f663.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fa9%252Feca94e92cd147d1ec03559a623d73554%252Fpa%252FGJ83963_1b872f7ca4b7559082f2415d2aec66f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_1b872f7ca4b7559082f2415d2aec66f6.jpg not downloaded yet
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fa9%252Feca94e92cd147d1ec03559a623d73554%252Fpa%252FGJ83963_0ec8ab1dfb2a5d313eee898578d7fe3a.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_0ec8ab1dfb2a5d313eee898578d7fe3a.jpg not downloaded yet
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fa9%252Feca94e92cd147d1ec03559a623d73554%252Fpa%252FGJ83963_509d2c6b9412c321a5c95c11824a94ba.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_509d2c6b9412c321a5c95c11824a94ba.jpg not downloaded yet
2026-03-27 10:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_350e00f72c4cf54749660eae0dc5bf32.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_2c2cdb65903814c5c01191df7ccc5c79.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fa9%252Feca94e92cd147d1ec03559a623d73554%252Fpa%252FGJ83963_d1ae41849f079ad5e1882de377ca2ed1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_d1ae41849f079ad5e1882de377ca2ed1.jpg not downloaded yet
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501872310>
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfab1721-fc06-5443-a90c-b5a9e8789030/cfab1721-fc06-5443-a90c-b5a9e8789030_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fa9%252Feca94e92cd147d1ec03559a623d73554%252Fpa%252FGJ83963_35fa7eb662e45fe2d8270f3aa5b2f663.jpg') HTTP/1.1" 204 0
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_35fa7eb662e45fe2d8270f3aa5b2f663.jpg saved to cache
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cfab1721-fc06-5443-a90c-b5a9e8789030
2026-03-27 10:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_a7c37e28e76786d4c46134e4aa4e7a2a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_4b9522f939db421958f71c107e6532a7.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_1b872f7ca4b7559082f2415d2aec66f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_509d2c6b9412c321a5c95c11824a94ba.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_d1ae41849f079ad5e1882de377ca2ed1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50032ead0>
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfab1721-fc06-5443-a90c-b5a9e8789030/cfab1721-fc06-5443-a90c-b5a9e8789030_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fa9%252Feca94e92cd147d1ec03559a623d73554%252Fpa%252FGJ83963_350e00f72c4cf54749660eae0dc5bf32.jpg') HTTP/1.1" 204 0
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_350e00f72c4cf54749660eae0dc5bf32.jpg saved to cache
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cfab1721-fc06-5443-a90c-b5a9e8789030
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c2b50>
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfab1721-fc06-5443-a90c-b5a9e8789030/cfab1721-fc06-5443-a90c-b5a9e8789030_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fa9%252Feca94e92cd147d1ec03559a623d73554%252Fpa%252FGJ83963_2c2cdb65903814c5c01191df7ccc5c79.jpg') HTTP/1.1" 204 0
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_2c2cdb65903814c5c01191df7ccc5c79.jpg saved to cache
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cfab1721-fc06-5443-a90c-b5a9e8789030
2026-03-27 10:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_0ec8ab1dfb2a5d313eee898578d7fe3a.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:52:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_fd75b7da69a28ba2812d40cde1f15c75.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001ce010>
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfab1721-fc06-5443-a90c-b5a9e8789030/cfab1721-fc06-5443-a90c-b5a9e8789030_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fa9%252Feca94e92cd147d1ec03559a623d73554%252Fpa%252FGJ83963_a7c37e28e76786d4c46134e4aa4e7a2a.jpg') HTTP/1.1" 204 0
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_a7c37e28e76786d4c46134e4aa4e7a2a.jpg saved to cache
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cfab1721-fc06-5443-a90c-b5a9e8789030
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001cd350>
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfab1721-fc06-5443-a90c-b5a9e8789030/cfab1721-fc06-5443-a90c-b5a9e8789030_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fa9%252Feca94e92cd147d1ec03559a623d73554%252Fpa%252FGJ83963_4b9522f939db421958f71c107e6532a7.jpg') HTTP/1.1" 204 0
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_4b9522f939db421958f71c107e6532a7.jpg saved to cache
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cfab1721-fc06-5443-a90c-b5a9e8789030
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003876d0>
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfab1721-fc06-5443-a90c-b5a9e8789030/cfab1721-fc06-5443-a90c-b5a9e8789030_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fa9%252Feca94e92cd147d1ec03559a623d73554%252Fpa%252FGJ83963_1b872f7ca4b7559082f2415d2aec66f6.jpg') HTTP/1.1" 204 0
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_1b872f7ca4b7559082f2415d2aec66f6.jpg saved to cache
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cfab1721-fc06-5443-a90c-b5a9e8789030
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50261c090>
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfab1721-fc06-5443-a90c-b5a9e8789030/cfab1721-fc06-5443-a90c-b5a9e8789030_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fa9%252Feca94e92cd147d1ec03559a623d73554%252Fpa%252FGJ83963_509d2c6b9412c321a5c95c11824a94ba.jpg') HTTP/1.1" 204 0
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_509d2c6b9412c321a5c95c11824a94ba.jpg saved to cache
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cfab1721-fc06-5443-a90c-b5a9e8789030
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004de210>
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfab1721-fc06-5443-a90c-b5a9e8789030/cfab1721-fc06-5443-a90c-b5a9e8789030_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fa9%252Feca94e92cd147d1ec03559a623d73554%252Fpa%252FGJ83963_d1ae41849f079ad5e1882de377ca2ed1.jpg') HTTP/1.1" 204 0
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_d1ae41849f079ad5e1882de377ca2ed1.jpg saved to cache
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cfab1721-fc06-5443-a90c-b5a9e8789030
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501633290>
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfab1721-fc06-5443-a90c-b5a9e8789030/cfab1721-fc06-5443-a90c-b5a9e8789030_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fa9%252Feca94e92cd147d1ec03559a623d73554%252Fpa%252FGJ83963_0ec8ab1dfb2a5d313eee898578d7fe3a.jpg') HTTP/1.1" 204 0
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_0ec8ab1dfb2a5d313eee898578d7fe3a.jpg saved to cache
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cfab1721-fc06-5443-a90c-b5a9e8789030
2026-03-27 10:52:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019a4d90>
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:52:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfab1721-fc06-5443-a90c-b5a9e8789030/cfab1721-fc06-5443-a90c-b5a9e8789030_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fa9%252Feca94e92cd147d1ec03559a623d73554%252Fpa%252FGJ83963_fd75b7da69a28ba2812d40cde1f15c75.jpg') HTTP/1.1" 204 0
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_fd75b7da69a28ba2812d40cde1f15c75.jpg saved to cache
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cfab1721-fc06-5443-a90c-b5a9e8789030
2026-03-27 10:52:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cfab1721-fc06-5443-a90c-b5a9e8789030, skipping ID generation
2026-03-27 10:52:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfab1721-fc06-5443-a90c-b5a9e8789030 with scrape type 1
2026-03-27 10:52:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cfab1721-fc06-5443-a90c-b5a9e8789030 sending to next pipeline
2026-03-27 10:52:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfab1721-fc06-5443-a90c-b5a9e8789030, identifier: GJ83963
2026-03-27 10:52:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfab1721-fc06-5443-a90c-b5a9e8789030 with identifier: GJ83963
2026-03-27 10:52:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfab1721-fc06-5443-a90c-b5a9e8789030 with identifier: GJ83963
2026-03-27 10:52:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfab1721-fc06-5443-a90c-b5a9e8789030 with identifier: GJ83963 to the API
2026-03-27 10:52:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:52:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:52:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_fd75b7da69a28ba2812d40cde1f15c75.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:19:09Z',
 'fuel_type': 'petrol',
 'id': 'cfab1721-fc06-5443-a90c-b5a9e8789030',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ83963',
 'listing': 'auction',
 'location': 'Köln',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 205188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfab1721-fc06-5443-a90c-b5a9e8789030/cfab1721-fc06-5443-a90c-b5a9e8789030_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_35fa7eb662e45fe2d8270f3aa5b2f663.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfab1721-fc06-5443-a90c-b5a9e8789030/cfab1721-fc06-5443-a90c-b5a9e8789030_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_4b9522f939db421958f71c107e6532a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfab1721-fc06-5443-a90c-b5a9e8789030/cfab1721-fc06-5443-a90c-b5a9e8789030_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_350e00f72c4cf54749660eae0dc5bf32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfab1721-fc06-5443-a90c-b5a9e8789030/cfab1721-fc06-5443-a90c-b5a9e8789030_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_2c2cdb65903814c5c01191df7ccc5c79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfab1721-fc06-5443-a90c-b5a9e8789030/cfab1721-fc06-5443-a90c-b5a9e8789030_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_a7c37e28e76786d4c46134e4aa4e7a2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfab1721-fc06-5443-a90c-b5a9e8789030/cfab1721-fc06-5443-a90c-b5a9e8789030_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2823260,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_fd75b7da69a28ba2812d40cde1f15c75.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfab1721-fc06-5443-a90c-b5a9e8789030/cfab1721-fc06-5443-a90c-b5a9e8789030_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_1b872f7ca4b7559082f2415d2aec66f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfab1721-fc06-5443-a90c-b5a9e8789030/cfab1721-fc06-5443-a90c-b5a9e8789030_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_0ec8ab1dfb2a5d313eee898578d7fe3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfab1721-fc06-5443-a90c-b5a9e8789030/cfab1721-fc06-5443-a90c-b5a9e8789030_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_509d2c6b9412c321a5c95c11824a94ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfab1721-fc06-5443-a90c-b5a9e8789030/cfab1721-fc06-5443-a90c-b5a9e8789030_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/a9/eca94e92cd147d1ec03559a623d73554/pa/GJ83963_d1ae41849f079ad5e1882de377ca2ed1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Premium 4WD',
 'transmission': 'automatic',
 'trim': 'Premium 4WD',
 'year': 2018}
2026-03-27 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ83963%27 HTTP/1.1" 200 None
2026-03-27 10:52:08 [auto1.de] INFO: Saving data for GJ83963: {'created_time': 1774608728.563734, 'last_price_update_time': 1774608728.563745, 'auction_closing_time': 1774714749.0}
2026-03-27 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ83963') HTTP/1.1" 204 0
2026-03-27 10:52:08 [scrapy.extensions.logstats] INFO: Crawled 513 pages (at 15 pages/min), scraped 887 items (at 10 items/min)
2026-03-27 10:52:08 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 10:52:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-27 10:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY44920> (referer: https://www.auto1.com/v1/car-details-view/CY44920/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 051cef2e-b623-5c8c-9616-1169f7535060 with identifier: CY44920
2026-03-27 10:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 051cef2e-b623-5c8c-9616-1169f7535060 with scrape type 1
2026-03-27 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 051cef2e-b623-5c8c-9616-1169f7535060
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fcd%252F54cdaa459c81bf4397fb7d4806417b27%252Fpa%252FCY44920_5aa035da5641e28ac4b1b54ba67021e0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_5aa035da5641e28ac4b1b54ba67021e0.jpg already downloaded
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fcd%252F54cdaa459c81bf4397fb7d4806417b27%252Fpa%252FCY44920_2b4f6ce89e4d2be56b008295622eca2c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_2b4f6ce89e4d2be56b008295622eca2c.jpg already downloaded
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fcd%252F54cdaa459c81bf4397fb7d4806417b27%252Fpa%252FCY44920_04fb30d2a5f704bec90b307c8afe83b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_04fb30d2a5f704bec90b307c8afe83b1.jpg already downloaded
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fcd%252F54cdaa459c81bf4397fb7d4806417b27%252Fpa%252FCY44920_c0ab04b12598984f6d0d91fc268ceb13.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_c0ab04b12598984f6d0d91fc268ceb13.jpg already downloaded
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fcd%252F54cdaa459c81bf4397fb7d4806417b27%252Fpa%252FCY44920_d7284eda06583dd459e1ca9c5f1187bc.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_d7284eda06583dd459e1ca9c5f1187bc.jpg already downloaded
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fcd%252F54cdaa459c81bf4397fb7d4806417b27%252Fpa%252FCY44920_092157a6c05f82c963165bd53216f236.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_092157a6c05f82c963165bd53216f236.jpg already downloaded
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fcd%252F54cdaa459c81bf4397fb7d4806417b27%252Fpa%252FCY44920_b0da6290bd3b0b6c623d27b75c976c34.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_b0da6290bd3b0b6c623d27b75c976c34.jpg already downloaded
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fcd%252F54cdaa459c81bf4397fb7d4806417b27%252Fpa%252FCY44920_bc76c24e8332edf1b670d6af8374af03.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_bc76c24e8332edf1b670d6af8374af03.jpg already downloaded
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fcd%252F54cdaa459c81bf4397fb7d4806417b27%252Fpa%252FCY44920_35aeaa2b50b1277609b1ec0fdca1d14b.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_35aeaa2b50b1277609b1ec0fdca1d14b.jpg already downloaded
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fcd%252F54cdaa459c81bf4397fb7d4806417b27%252Fpa%252FCY44920_0367de65bf2fa50f914d31d9ff753ecd.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_0367de65bf2fa50f914d31d9ff753ecd.jpg already downloaded
2026-03-27 10:52:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 051cef2e-b623-5c8c-9616-1169f7535060, identifier: CY44920
2026-03-27 10:52:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 051cef2e-b623-5c8c-9616-1169f7535060 with identifier: CY44920
2026-03-27 10:52:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 051cef2e-b623-5c8c-9616-1169f7535060 with identifier: CY44920
2026-03-27 10:52:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 051cef2e-b623-5c8c-9616-1169f7535060 with identifier: CY44920 to the API
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:52:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CY44920>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:50:04Z',
 'fuel_type': 'diesel',
 'id': '051cef2e-b623-5c8c-9616-1169f7535060',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY44920',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 172904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_5aa035da5641e28ac4b1b54ba67021e0.jpg',
                'https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_2b4f6ce89e4d2be56b008295622eca2c.jpg',
                'https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_04fb30d2a5f704bec90b307c8afe83b1.jpg',
                'https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_c0ab04b12598984f6d0d91fc268ceb13.jpg',
                'https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_d7284eda06583dd459e1ca9c5f1187bc.jpg',
                'https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_092157a6c05f82c963165bd53216f236.jpg',
                'https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_b0da6290bd3b0b6c623d27b75c976c34.jpg',
                'https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_bc76c24e8332edf1b670d6af8374af03.jpg',
                'https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_35aeaa2b50b1277609b1ec0fdca1d14b.jpg',
                'https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_0367de65bf2fa50f914d31d9ff753ecd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051cef2e-b623-5c8c-9616-1169f7535060/051cef2e-b623-5c8c-9616-1169f7535060_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_5aa035da5641e28ac4b1b54ba67021e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051cef2e-b623-5c8c-9616-1169f7535060/051cef2e-b623-5c8c-9616-1169f7535060_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_2b4f6ce89e4d2be56b008295622eca2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051cef2e-b623-5c8c-9616-1169f7535060/051cef2e-b623-5c8c-9616-1169f7535060_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_04fb30d2a5f704bec90b307c8afe83b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051cef2e-b623-5c8c-9616-1169f7535060/051cef2e-b623-5c8c-9616-1169f7535060_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_c0ab04b12598984f6d0d91fc268ceb13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051cef2e-b623-5c8c-9616-1169f7535060/051cef2e-b623-5c8c-9616-1169f7535060_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_d7284eda06583dd459e1ca9c5f1187bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051cef2e-b623-5c8c-9616-1169f7535060/051cef2e-b623-5c8c-9616-1169f7535060_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_092157a6c05f82c963165bd53216f236.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051cef2e-b623-5c8c-9616-1169f7535060/051cef2e-b623-5c8c-9616-1169f7535060_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_b0da6290bd3b0b6c623d27b75c976c34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051cef2e-b623-5c8c-9616-1169f7535060/051cef2e-b623-5c8c-9616-1169f7535060_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_bc76c24e8332edf1b670d6af8374af03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051cef2e-b623-5c8c-9616-1169f7535060/051cef2e-b623-5c8c-9616-1169f7535060_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_35aeaa2b50b1277609b1ec0fdca1d14b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051cef2e-b623-5c8c-9616-1169f7535060/051cef2e-b623-5c8c-9616-1169f7535060_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/cd/54cdaa459c81bf4397fb7d4806417b27/pa/CY44920_0367de65bf2fa50f914d31d9ff753ecd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V90 2.0 D4 Inscription',
 'transmission': 'automatic',
 'trim': 'Inscription',
 'year': 2018}
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY44920%27 HTTP/1.1" 200 None
2026-03-27 10:52:13 [auto1.de] INFO: Saving data for CY44920: {'created_time': 1774608733.908771, 'last_price_update_time': 1774608733.908784, 'auction_closing_time': 1774716604.0}
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY44920') HTTP/1.1" 204 0
2026-03-27 10:53:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.237(s), this was the 1st time calling it.
2026-03-27 10:53:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.422385178158397 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-27 10:53:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-27 10:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT27249/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:06 [scrapy.extensions.logstats] INFO: Crawled 515 pages (at 2 pages/min), scraped 888 items (at 1 items/min)
2026-03-27 10:53:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 10:53:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT27249> (referer: https://www.auto1.com/v1/car-details-view/UT27249/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b59a7cea-af21-5908-bdc4-bd25df04a4db with identifier: UT27249
2026-03-27 10:53:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b59a7cea-af21-5908-bdc4-bd25df04a4db with scrape type 1
2026-03-27 10:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b59a7cea-af21-5908-bdc4-bd25df04a4db
2026-03-27 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fee%252F66ee1c57e10e2d6e4d09d66b640abe3a%252Fpa%252FUT27249_7d1359515c864b3006781104b8c70b8d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_7d1359515c864b3006781104b8c70b8d.jpg not downloaded yet
2026-03-27 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fee%252F66ee1c57e10e2d6e4d09d66b640abe3a%252Fpa%252FUT27249_d4fa5f366380cf4ae39f95a3f2f52838.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_d4fa5f366380cf4ae39f95a3f2f52838.jpg not downloaded yet
2026-03-27 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fee%252F66ee1c57e10e2d6e4d09d66b640abe3a%252Fpa%252FUT27249_cec02dbee7ac02bf812666f1a0ed4b66.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_cec02dbee7ac02bf812666f1a0ed4b66.jpg not downloaded yet
2026-03-27 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fee%252F66ee1c57e10e2d6e4d09d66b640abe3a%252Fpa%252FUT27249_13733087ca6ecdb059014809ae512d2e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_13733087ca6ecdb059014809ae512d2e.jpg not downloaded yet
2026-03-27 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fee%252F66ee1c57e10e2d6e4d09d66b640abe3a%252Fpa%252FUT27249_26acf4d66fb5ba544abdbb1e3abd9d4e.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:53:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_26acf4d66fb5ba544abdbb1e3abd9d4e.jpg not downloaded yet
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fee%252F66ee1c57e10e2d6e4d09d66b640abe3a%252Fpa%252FUT27249_d57b084194e62d2559c5d23a5268b070.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_d57b084194e62d2559c5d23a5268b070.jpg not downloaded yet
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fee%252F66ee1c57e10e2d6e4d09d66b640abe3a%252Fpa%252FUT27249_aaf94f75fe426c1fa250ba4839e38ab2.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_aaf94f75fe426c1fa250ba4839e38ab2.jpg not downloaded yet
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fee%252F66ee1c57e10e2d6e4d09d66b640abe3a%252Fpa%252FUT27249_d4638c945ff6d85ddb9e0ec3d6c5a902.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_d4638c945ff6d85ddb9e0ec3d6c5a902.jpg not downloaded yet
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fee%252F66ee1c57e10e2d6e4d09d66b640abe3a%252Fpa%252FUT27249_b5f89d46bd8b7d3d10a17448b5906da0.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_b5f89d46bd8b7d3d10a17448b5906da0.jpg not downloaded yet
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fee%252F66ee1c57e10e2d6e4d09d66b640abe3a%252Fpa%252FUT27249_9912691aca8e706820fb86cc45b12817.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_9912691aca8e706820fb86cc45b12817.jpg not downloaded yet
2026-03-27 10:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_cec02dbee7ac02bf812666f1a0ed4b66.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_b5f89d46bd8b7d3d10a17448b5906da0.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_9912691aca8e706820fb86cc45b12817.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500500b50>
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b59a7cea-af21-5908-bdc4-bd25df04a4db/b59a7cea-af21-5908-bdc4-bd25df04a4db_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fee%252F66ee1c57e10e2d6e4d09d66b640abe3a%252Fpa%252FUT27249_cec02dbee7ac02bf812666f1a0ed4b66.jpg') HTTP/1.1" 204 0
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_cec02dbee7ac02bf812666f1a0ed4b66.jpg saved to cache
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b59a7cea-af21-5908-bdc4-bd25df04a4db
2026-03-27 10:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_d4fa5f366380cf4ae39f95a3f2f52838.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_13733087ca6ecdb059014809ae512d2e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501699490>
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b59a7cea-af21-5908-bdc4-bd25df04a4db/b59a7cea-af21-5908-bdc4-bd25df04a4db_image_8.jpg HTTP/1.1" 201 0
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fee%252F66ee1c57e10e2d6e4d09d66b640abe3a%252Fpa%252FUT27249_b5f89d46bd8b7d3d10a17448b5906da0.jpg') HTTP/1.1" 204 0
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_b5f89d46bd8b7d3d10a17448b5906da0.jpg saved to cache
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b59a7cea-af21-5908-bdc4-bd25df04a4db
2026-03-27 10:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_aaf94f75fe426c1fa250ba4839e38ab2.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004c6590>
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b59a7cea-af21-5908-bdc4-bd25df04a4db/b59a7cea-af21-5908-bdc4-bd25df04a4db_image_9.jpg HTTP/1.1" 201 0
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fee%252F66ee1c57e10e2d6e4d09d66b640abe3a%252Fpa%252FUT27249_9912691aca8e706820fb86cc45b12817.jpg') HTTP/1.1" 204 0
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_9912691aca8e706820fb86cc45b12817.jpg saved to cache
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b59a7cea-af21-5908-bdc4-bd25df04a4db
2026-03-27 10:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_d4638c945ff6d85ddb9e0ec3d6c5a902.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_d57b084194e62d2559c5d23a5268b070.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_7d1359515c864b3006781104b8c70b8d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501631e10>
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b59a7cea-af21-5908-bdc4-bd25df04a4db/b59a7cea-af21-5908-bdc4-bd25df04a4db_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fee%252F66ee1c57e10e2d6e4d09d66b640abe3a%252Fpa%252FUT27249_d4fa5f366380cf4ae39f95a3f2f52838.jpg') HTTP/1.1" 204 0
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_d4fa5f366380cf4ae39f95a3f2f52838.jpg saved to cache
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b59a7cea-af21-5908-bdc4-bd25df04a4db
2026-03-27 10:53:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_26acf4d66fb5ba544abdbb1e3abd9d4e.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5003f5050>
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b59a7cea-af21-5908-bdc4-bd25df04a4db/b59a7cea-af21-5908-bdc4-bd25df04a4db_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fee%252F66ee1c57e10e2d6e4d09d66b640abe3a%252Fpa%252FUT27249_13733087ca6ecdb059014809ae512d2e.jpg') HTTP/1.1" 204 0
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_13733087ca6ecdb059014809ae512d2e.jpg saved to cache
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b59a7cea-af21-5908-bdc4-bd25df04a4db
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c3250>
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b59a7cea-af21-5908-bdc4-bd25df04a4db/b59a7cea-af21-5908-bdc4-bd25df04a4db_image_6.jpg HTTP/1.1" 201 0
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fee%252F66ee1c57e10e2d6e4d09d66b640abe3a%252Fpa%252FUT27249_aaf94f75fe426c1fa250ba4839e38ab2.jpg') HTTP/1.1" 204 0
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_aaf94f75fe426c1fa250ba4839e38ab2.jpg saved to cache
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b59a7cea-af21-5908-bdc4-bd25df04a4db
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500314850>
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b59a7cea-af21-5908-bdc4-bd25df04a4db/b59a7cea-af21-5908-bdc4-bd25df04a4db_image_7.jpg HTTP/1.1" 201 0
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fee%252F66ee1c57e10e2d6e4d09d66b640abe3a%252Fpa%252FUT27249_d4638c945ff6d85ddb9e0ec3d6c5a902.jpg') HTTP/1.1" 204 0
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_d4638c945ff6d85ddb9e0ec3d6c5a902.jpg saved to cache
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b59a7cea-af21-5908-bdc4-bd25df04a4db
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb50186d390>
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b59a7cea-af21-5908-bdc4-bd25df04a4db/b59a7cea-af21-5908-bdc4-bd25df04a4db_image_5.jpg HTTP/1.1" 201 0
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fee%252F66ee1c57e10e2d6e4d09d66b640abe3a%252Fpa%252FUT27249_d57b084194e62d2559c5d23a5268b070.jpg') HTTP/1.1" 204 0
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_d57b084194e62d2559c5d23a5268b070.jpg saved to cache
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b59a7cea-af21-5908-bdc4-bd25df04a4db
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5016c3810>
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b59a7cea-af21-5908-bdc4-bd25df04a4db/b59a7cea-af21-5908-bdc4-bd25df04a4db_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fee%252F66ee1c57e10e2d6e4d09d66b640abe3a%252Fpa%252FUT27249_7d1359515c864b3006781104b8c70b8d.jpg') HTTP/1.1" 204 0
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_7d1359515c864b3006781104b8c70b8d.jpg saved to cache
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b59a7cea-af21-5908-bdc4-bd25df04a4db
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5001de290>
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:53:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b59a7cea-af21-5908-bdc4-bd25df04a4db/b59a7cea-af21-5908-bdc4-bd25df04a4db_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fee%252F66ee1c57e10e2d6e4d09d66b640abe3a%252Fpa%252FUT27249_26acf4d66fb5ba544abdbb1e3abd9d4e.jpg') HTTP/1.1" 204 0
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_26acf4d66fb5ba544abdbb1e3abd9d4e.jpg saved to cache
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b59a7cea-af21-5908-bdc4-bd25df04a4db
2026-03-27 10:53:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b59a7cea-af21-5908-bdc4-bd25df04a4db, skipping ID generation
2026-03-27 10:53:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b59a7cea-af21-5908-bdc4-bd25df04a4db with scrape type 1
2026-03-27 10:53:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b59a7cea-af21-5908-bdc4-bd25df04a4db sending to next pipeline
2026-03-27 10:53:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b59a7cea-af21-5908-bdc4-bd25df04a4db, identifier: UT27249
2026-03-27 10:53:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b59a7cea-af21-5908-bdc4-bd25df04a4db with identifier: UT27249
2026-03-27 10:53:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b59a7cea-af21-5908-bdc4-bd25df04a4db with identifier: UT27249
2026-03-27 10:53:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b59a7cea-af21-5908-bdc4-bd25df04a4db with identifier: UT27249 to the API
2026-03-27 10:53:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:53:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:53:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_26acf4d66fb5ba544abdbb1e3abd9d4e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:58:12Z',
 'fuel_type': 'petrol',
 'id': 'b59a7cea-af21-5908-bdc4-bd25df04a4db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT27249',
 'listing': 'auction',
 'location': 'DE, Köln',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 122874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59a7cea-af21-5908-bdc4-bd25df04a4db/b59a7cea-af21-5908-bdc4-bd25df04a4db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_7d1359515c864b3006781104b8c70b8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59a7cea-af21-5908-bdc4-bd25df04a4db/b59a7cea-af21-5908-bdc4-bd25df04a4db_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_d4fa5f366380cf4ae39f95a3f2f52838.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59a7cea-af21-5908-bdc4-bd25df04a4db/b59a7cea-af21-5908-bdc4-bd25df04a4db_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_cec02dbee7ac02bf812666f1a0ed4b66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59a7cea-af21-5908-bdc4-bd25df04a4db/b59a7cea-af21-5908-bdc4-bd25df04a4db_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_13733087ca6ecdb059014809ae512d2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59a7cea-af21-5908-bdc4-bd25df04a4db/b59a7cea-af21-5908-bdc4-bd25df04a4db_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_26acf4d66fb5ba544abdbb1e3abd9d4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59a7cea-af21-5908-bdc4-bd25df04a4db/b59a7cea-af21-5908-bdc4-bd25df04a4db_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_d57b084194e62d2559c5d23a5268b070.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59a7cea-af21-5908-bdc4-bd25df04a4db/b59a7cea-af21-5908-bdc4-bd25df04a4db_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_aaf94f75fe426c1fa250ba4839e38ab2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59a7cea-af21-5908-bdc4-bd25df04a4db/b59a7cea-af21-5908-bdc4-bd25df04a4db_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_d4638c945ff6d85ddb9e0ec3d6c5a902.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59a7cea-af21-5908-bdc4-bd25df04a4db/b59a7cea-af21-5908-bdc4-bd25df04a4db_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_b5f89d46bd8b7d3d10a17448b5906da0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b59a7cea-af21-5908-bdc4-bd25df04a4db/b59a7cea-af21-5908-bdc4-bd25df04a4db_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/ee/66ee1c57e10e2d6e4d09d66b640abe3a/pa/UT27249_9912691aca8e706820fb86cc45b12817.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2015}
2026-03-27 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT27249%27 HTTP/1.1" 200 None
2026-03-27 10:53:09 [auto1.de] INFO: Saving data for UT27249: {'created_time': 1774608789.086783, 'last_price_update_time': 1774608789.086794, 'auction_closing_time': 1774717092.0}
2026-03-27 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT27249') HTTP/1.1" 204 0
2026-03-27 10:53:12 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.700(s), this was the 1st time calling it.
2026-03-27 10:53:12 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.69972615074797 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-27 10:53:16 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.996(s), this was the 1st time calling it.
2026-03-27 10:53:16 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.240088696757859 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-27 10:53:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-27 10:53:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:20 [auto1.de] INFO: Channel: 24h | Page: 51 | totalHits: 10598 | hits on page: 40
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: SW86673
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW86673%27 HTTP/1.1" 200 None
2026-03-27 10:53:20 [auto1.de] INFO: Scrape type for SW86673: 0
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: PU13127
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: BX34768
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: SA81936
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: CJ06587
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ06587%27 HTTP/1.1" 200 None
2026-03-27 10:53:20 [auto1.de] INFO: Scrape type for CJ06587: 0
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: JT81466
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT81466%27 HTTP/1.1" 200 None
2026-03-27 10:53:20 [auto1.de] INFO: Scrape type for JT81466: 0
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: UY61545
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY61545%27 HTTP/1.1" 200 None
2026-03-27 10:53:20 [auto1.de] INFO: Scrape type for UY61545: 0
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: LV52918
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: DE56554
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE56554%27 HTTP/1.1" 200 None
2026-03-27 10:53:20 [auto1.de] INFO: Scrape type for DE56554: 0
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: YE15667
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE15667%27 HTTP/1.1" 200 None
2026-03-27 10:53:20 [auto1.de] INFO: Scrape type for YE15667: 0
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: CP43977
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: MR29539
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: TT64948
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: FN00007
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: MD24285
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: PZ15198
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ15198%27 HTTP/1.1" 200 None
2026-03-27 10:53:20 [auto1.de] INFO: Scrape type for PZ15198: 0
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: CS43081
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS43081%27 HTTP/1.1" 200 None
2026-03-27 10:53:20 [auto1.de] INFO: Scrape type for CS43081: 0
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: VK35465
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK35465%27 HTTP/1.1" 200 None
2026-03-27 10:53:20 [auto1.de] INFO: Scrape type for VK35465: 0
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: XB83488
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB83488%27 HTTP/1.1" 200 None
2026-03-27 10:53:20 [auto1.de] INFO: Scrape type for XB83488: 0
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: PB97983
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: GX91022
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX91022%27 HTTP/1.1" 200 None
2026-03-27 10:53:20 [auto1.de] INFO: Scrape type for GX91022: 0
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: TJ47343
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: EW59604
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: PW82810
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW82810%27 HTTP/1.1" 200 None
2026-03-27 10:53:20 [auto1.de] INFO: Scrape type for PW82810: 0
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: UF12983
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF12983%27 HTTP/1.1" 200 None
2026-03-27 10:53:20 [auto1.de] INFO: Scrape type for UF12983: 0
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: CU83309
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU83309%27 HTTP/1.1" 200 None
2026-03-27 10:53:20 [auto1.de] INFO: Scrape type for CU83309: 0
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: BS12588
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS12588%27 HTTP/1.1" 200 None
2026-03-27 10:53:20 [auto1.de] INFO: Scrape type for BS12588: 0
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: KX53011
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: HU83387
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU83387%27 HTTP/1.1" 200 None
2026-03-27 10:53:20 [auto1.de] INFO: Scrape type for HU83387: 0
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: PC88965
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: DB01962
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: AX06709
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: PZ75208
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: YE66561
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE66561%27 HTTP/1.1" 200 None
2026-03-27 10:53:20 [auto1.de] INFO: Scrape type for YE66561: 0
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: PP34384
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP34384%27 HTTP/1.1" 200 None
2026-03-27 10:53:20 [auto1.de] INFO: Scrape type for PP34384: 0
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: XK86433
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: YF34973
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF34973%27 HTTP/1.1" 200 None
2026-03-27 10:53:20 [auto1.de] INFO: Scrape type for YF34973: 0
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: KM41790
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM41790%27 HTTP/1.1" 200 None
2026-03-27 10:53:20 [auto1.de] INFO: Scrape type for KM41790: 0
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: YB74722
2026-03-27 10:53:20 [auto1.de] INFO: Found listing with ID: WH24454
2026-03-27 10:53:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-27 10:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML66978/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:22 [auto1.de] INFO: Channel: 24h | Page: 52 | totalHits: 10598 | hits on page: 40
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: EJ40923
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: LF15045
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF15045%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for LF15045: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: NY54284
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: GG72977
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG72977%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for GG72977: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: FS85079
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS85079%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for FS85079: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: XP07522
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: YH30461
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH30461%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for YH30461: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: TT10154
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT10154%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for TT10154: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: WS38719
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS38719%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for WS38719: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: AZ12620
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ12620%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for AZ12620: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: FX92929
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: MM64196
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM64196%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for MM64196: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: SS53200
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: LH98636
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: UM45865
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM45865%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for UM45865: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: AC56018
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: TB15479
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB15479%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for TB15479: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: XT50939
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT50939%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for XT50939: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: BV96832
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: RJ03862
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: ZU04688
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: YM50991
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM50991%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for YM50991: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: LW43153
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW43153%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for LW43153: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: EL74738
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: BA39633
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: XP92221
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP92221%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for XP92221: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: DX03120
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: LX87284
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: SL35659
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL35659%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for SL35659: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: UR30493
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR30493%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for UR30493: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: JM39243
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: YL76472
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL76472%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for YL76472: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: YB86536
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB86536%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for YB86536: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: HD30169
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD30169%27 HTTP/1.1" 200 None
2026-03-27 10:53:22 [auto1.de] INFO: Scrape type for HD30169: 0
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: XU99482
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: FL30108
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: RS30445
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: AR77656
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: RF79085
2026-03-27 10:53:22 [auto1.de] INFO: Found listing with ID: YS74184
2026-03-27 10:53:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:23 [auto1.de] INFO: Channel: 24h | Page: 53 | totalHits: 10599 | hits on page: 40
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: YS74184
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: YK97708
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: XD31530
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD31530%27 HTTP/1.1" 200 None
2026-03-27 10:53:23 [auto1.de] INFO: Scrape type for XD31530: 0
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: HV99123
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: FC70862
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: NC06801
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: UN58886
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: BE14691
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE14691%27 HTTP/1.1" 200 None
2026-03-27 10:53:23 [auto1.de] INFO: Scrape type for BE14691: 0
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: VV06990
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: FP09616
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: SR89138
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR89138%27 HTTP/1.1" 200 None
2026-03-27 10:53:23 [auto1.de] INFO: Scrape type for SR89138: 0
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: YT56915
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: KS07911
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS07911%27 HTTP/1.1" 200 None
2026-03-27 10:53:23 [auto1.de] INFO: Scrape type for KS07911: 0
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: XS21978
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: MF41784
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: SN40806
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN40806%27 HTTP/1.1" 200 None
2026-03-27 10:53:23 [auto1.de] INFO: Scrape type for SN40806: 0
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: HE65946
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE65946%27 HTTP/1.1" 200 None
2026-03-27 10:53:23 [auto1.de] INFO: Scrape type for HE65946: 0
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: AW08292
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: EC44311
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: CW13893
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: NT54414
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT54414%27 HTTP/1.1" 200 None
2026-03-27 10:53:23 [auto1.de] INFO: Scrape type for NT54414: 0
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: LL09458
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: AF40281
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF40281%27 HTTP/1.1" 200 None
2026-03-27 10:53:23 [auto1.de] INFO: Scrape type for AF40281: 0
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: VL77051
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL77051%27 HTTP/1.1" 200 None
2026-03-27 10:53:23 [auto1.de] INFO: Scrape type for VL77051: 0
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: PV26171
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV26171%27 HTTP/1.1" 200 None
2026-03-27 10:53:23 [auto1.de] INFO: Scrape type for PV26171: 0
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: HW97387
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW97387%27 HTTP/1.1" 200 None
2026-03-27 10:53:23 [auto1.de] INFO: Scrape type for HW97387: 0
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: WY19584
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: RL23601
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: HG38928
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: BW06665
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW06665%27 HTTP/1.1" 200 None
2026-03-27 10:53:23 [auto1.de] INFO: Scrape type for BW06665: 0
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: KP41876
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: FB95771
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB95771%27 HTTP/1.1" 200 None
2026-03-27 10:53:23 [auto1.de] INFO: Scrape type for FB95771: 0
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: WS31989
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS31989%27 HTTP/1.1" 200 None
2026-03-27 10:53:23 [auto1.de] INFO: Scrape type for WS31989: 0
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: RW72462
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: PU85783
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU85783%27 HTTP/1.1" 200 None
2026-03-27 10:53:23 [auto1.de] INFO: Scrape type for PU85783: 0
2026-03-27 10:53:23 [auto1.de] INFO: Found listing with ID: MN47186
2026-03-27 10:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN47186%27 HTTP/1.1" 200 None
2026-03-27 10:53:24 [auto1.de] INFO: Scrape type for MN47186: 0
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: PR91039
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: UG24808
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG24808%27 HTTP/1.1" 200 None
2026-03-27 10:53:24 [auto1.de] INFO: Scrape type for UG24808: 0
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: WN39089
2026-03-27 10:53:24 [auto1.de] INFO: Found listing with ID: WL40040
2026-03-27 10:53:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:27 [auto1.de] INFO: Channel: 24h | Page: 54 | totalHits: 10600 | hits on page: 40
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: WL40040
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: YT66272
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT66272%27 HTTP/1.1" 200 None
2026-03-27 10:53:27 [auto1.de] INFO: Scrape type for YT66272: 0
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: CB40051
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: KD39094
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: XT19157
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT19157%27 HTTP/1.1" 200 None
2026-03-27 10:53:27 [auto1.de] INFO: Scrape type for XT19157: 0
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: BP72129
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP72129%27 HTTP/1.1" 200 None
2026-03-27 10:53:27 [auto1.de] INFO: Scrape type for BP72129: 0
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: SK57616
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: YF32306
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: NY16569
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY16569%27 HTTP/1.1" 200 None
2026-03-27 10:53:27 [auto1.de] INFO: Scrape type for NY16569: 0
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: BD66077
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: LS56228
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS56228%27 HTTP/1.1" 200 None
2026-03-27 10:53:27 [auto1.de] INFO: Scrape type for LS56228: 0
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: SP97012
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP97012%27 HTTP/1.1" 200 None
2026-03-27 10:53:27 [auto1.de] INFO: Scrape type for SP97012: 0
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: HL50945
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: DP85983
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: RX47602
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX47602%27 HTTP/1.1" 200 None
2026-03-27 10:53:27 [auto1.de] INFO: Scrape type for RX47602: 0
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: KC05152
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: LN11604
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: TM05155
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM05155%27 HTTP/1.1" 200 None
2026-03-27 10:53:27 [auto1.de] INFO: Scrape type for TM05155: 0
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: RL83266
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83266%27 HTTP/1.1" 200 None
2026-03-27 10:53:27 [auto1.de] INFO: Scrape type for RL83266: 0
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: LC81158
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC81158%27 HTTP/1.1" 200 None
2026-03-27 10:53:27 [auto1.de] INFO: Scrape type for LC81158: 0
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: JD13909
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: VS07108
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: AR17356
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR17356%27 HTTP/1.1" 200 None
2026-03-27 10:53:27 [auto1.de] INFO: Scrape type for AR17356: 0
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: BZ42521
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ42521%27 HTTP/1.1" 200 None
2026-03-27 10:53:27 [auto1.de] INFO: Scrape type for BZ42521: 0
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: KF20598
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF20598%27 HTTP/1.1" 200 None
2026-03-27 10:53:27 [auto1.de] INFO: Scrape type for KF20598: 0
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: TH73061
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH73061%27 HTTP/1.1" 200 None
2026-03-27 10:53:27 [auto1.de] INFO: Scrape type for TH73061: 0
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: ZR92554
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR92554%27 HTTP/1.1" 200 None
2026-03-27 10:53:27 [auto1.de] INFO: Scrape type for ZR92554: 0
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: ND58698
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: DJ56711
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ56711%27 HTTP/1.1" 200 None
2026-03-27 10:53:27 [auto1.de] INFO: Scrape type for DJ56711: 0
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: GP51980
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: LT54057
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: GR72963
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR72963%27 HTTP/1.1" 200 None
2026-03-27 10:53:27 [auto1.de] INFO: Scrape type for GR72963: 0
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: XX95177
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX95177%27 HTTP/1.1" 200 None
2026-03-27 10:53:27 [auto1.de] INFO: Scrape type for XX95177: 0
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: HF35410
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: FX25662
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: ZF80187
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: LC07612
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: RP33469
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP33469%27 HTTP/1.1" 200 None
2026-03-27 10:53:27 [auto1.de] INFO: Scrape type for RP33469: 0
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: DV01319
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01319%27 HTTP/1.1" 200 None
2026-03-27 10:53:27 [auto1.de] INFO: Scrape type for DV01319: 0
2026-03-27 10:53:27 [auto1.de] INFO: Found listing with ID: MT08770
2026-03-27 10:53:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:29 [auto1.de] INFO: Channel: 24h | Page: 55 | totalHits: 10600 | hits on page: 40
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: HY91019
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY91019%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for HY91019: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: VC98877
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: UA95146
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: DJ54071
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: GZ60410
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: CG78657
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG78657%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for CG78657: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: GR47170
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: WW55447
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: EJ74150
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: ZT89563
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT89563%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for ZT89563: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: TR76591
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR76591%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for TR76591: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: KX83133
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX83133%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for KX83133: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: BP04527
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: GW17934
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW17934%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for GW17934: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: XA78994
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: CA34591
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: TT68659
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: NC43616
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC43616%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for NC43616: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: NV85283
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV85283%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for NV85283: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: KL31519
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL31519%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for KL31519: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: WD80617
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD80617%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for WD80617: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: DW77262
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: BG86685
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: GH20850
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH20850%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for GH20850: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: NG74955
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: MP93113
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: DW76497
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW76497%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for DW76497: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: DE62797
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE62797%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for DE62797: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: KH31418
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH31418%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for KH31418: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: TL07964
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL07964%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for TL07964: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: ZK07522
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: JH61376
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH61376%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for JH61376: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: UT62888
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT62888%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for UT62888: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: SF55933
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: HL95475
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL95475%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for HL95475: 0
2026-03-27 10:53:29 [auto1.de] INFO: Found listing with ID: NM17989
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM17989%27 HTTP/1.1" 200 None
2026-03-27 10:53:29 [auto1.de] INFO: Scrape type for NM17989: 2
2026-03-27 10:53:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af9bfb36-af42-5ba7-94e9-8e765d2cf2ef with identifier: NM17989
2026-03-27 10:53:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af9bfb36-af42-5ba7-94e9-8e765d2cf2ef with scrape type 2
2026-03-27 10:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af9bfb36-af42-5ba7-94e9-8e765d2cf2ef with scrape type 2
2026-03-27 10:53:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af9bfb36-af42-5ba7-94e9-8e765d2cf2ef, identifier: NM17989
2026-03-27 10:53:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af9bfb36-af42-5ba7-94e9-8e765d2cf2ef with identifier: NM17989
2026-03-27 10:53:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af9bfb36-af42-5ba7-94e9-8e765d2cf2ef with identifier: NM17989
2026-03-27 10:53:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af9bfb36-af42-5ba7-94e9-8e765d2cf2ef with identifier: NM17989 to the API
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:53:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-27T16:29:40Z',
 'fuel_type': 'diesel',
 'id': 'af9bfb36-af42-5ba7-94e9-8e765d2cf2ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM17989',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 46475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-23',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 110 CDI FWD lang',
 'transmission': 'automatic',
 'trim': 'FWD lang',
 'year': 2020}
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM17989%27 HTTP/1.1" 200 None
2026-03-27 10:53:30 [auto1.de] INFO: Saving data for NM17989: {'auction_closing_time': 1774628980.0, 'created_time': 1774293672.149276, 'last_price_update_time': 1774608810.71157}
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM17989') HTTP/1.1" 204 0
2026-03-27 10:53:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: ZU61192
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU61192%27 HTTP/1.1" 200 None
2026-03-27 10:53:30 [auto1.de] INFO: Scrape type for ZU61192: 0
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: PE44862
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE44862%27 HTTP/1.1" 200 None
2026-03-27 10:53:30 [auto1.de] INFO: Scrape type for PE44862: 0
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: EA70059
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA70059%27 HTTP/1.1" 200 None
2026-03-27 10:53:30 [auto1.de] INFO: Scrape type for EA70059: 0
2026-03-27 10:53:30 [auto1.de] INFO: Found listing with ID: RU77143
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU77143%27 HTTP/1.1" 200 None
2026-03-27 10:53:30 [auto1.de] INFO: Scrape type for RU77143: 0
2026-03-27 10:53:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:31 [auto1.de] INFO: Channel: 24h | Page: 56 | totalHits: 10600 | hits on page: 40
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: EM77424
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: BT78007
2026-03-27 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT78007%27 HTTP/1.1" 200 None
2026-03-27 10:53:31 [auto1.de] INFO: Scrape type for BT78007: 0
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: FT39707
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: SV32169
2026-03-27 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV32169%27 HTTP/1.1" 200 None
2026-03-27 10:53:31 [auto1.de] INFO: Scrape type for SV32169: 0
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: RB89503
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: DF56561
2026-03-27 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF56561%27 HTTP/1.1" 200 None
2026-03-27 10:53:31 [auto1.de] INFO: Scrape type for DF56561: 0
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: DW82351
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: LG11243
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: ZN63740
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: EE47451
2026-03-27 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE47451%27 HTTP/1.1" 200 None
2026-03-27 10:53:31 [auto1.de] INFO: Scrape type for EE47451: 0
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: CM68518
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: HE99483
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: ZL38204
2026-03-27 10:53:31 [auto1.de] INFO: Found listing with ID: RT79554
2026-03-27 10:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT79554%27 HTTP/1.1" 200 None
2026-03-27 10:53:32 [auto1.de] INFO: Scrape type for RT79554: 0
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: CH69099
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: CN91045
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN91045%27 HTTP/1.1" 200 None
2026-03-27 10:53:32 [auto1.de] INFO: Scrape type for CN91045: 0
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: CF22867
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF22867%27 HTTP/1.1" 200 None
2026-03-27 10:53:32 [auto1.de] INFO: Scrape type for CF22867: 0
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: CA82513
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA82513%27 HTTP/1.1" 200 None
2026-03-27 10:53:32 [auto1.de] INFO: Scrape type for CA82513: 0
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: CF68220
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: MH82983
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH82983%27 HTTP/1.1" 200 None
2026-03-27 10:53:32 [auto1.de] INFO: Scrape type for MH82983: 0
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: FE82761
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE82761%27 HTTP/1.1" 200 None
2026-03-27 10:53:32 [auto1.de] INFO: Scrape type for FE82761: 0
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: ED89448
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: UH34905
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: SN43229
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN43229%27 HTTP/1.1" 200 None
2026-03-27 10:53:32 [auto1.de] INFO: Scrape type for SN43229: 0
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: KG98772
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG98772%27 HTTP/1.1" 200 None
2026-03-27 10:53:32 [auto1.de] INFO: Scrape type for KG98772: 0
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: YF68653
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: WJ35504
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ35504%27 HTTP/1.1" 200 None
2026-03-27 10:53:32 [auto1.de] INFO: Scrape type for WJ35504: 0
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: WS51511
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS51511%27 HTTP/1.1" 200 None
2026-03-27 10:53:32 [auto1.de] INFO: Scrape type for WS51511: 0
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: HA84095
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA84095%27 HTTP/1.1" 200 None
2026-03-27 10:53:32 [auto1.de] INFO: Scrape type for HA84095: 0
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: NW08152
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW08152%27 HTTP/1.1" 200 None
2026-03-27 10:53:32 [auto1.de] INFO: Scrape type for NW08152: 0
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: ED78349
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED78349%27 HTTP/1.1" 200 None
2026-03-27 10:53:32 [auto1.de] INFO: Scrape type for ED78349: 0
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: LG14715
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG14715%27 HTTP/1.1" 200 None
2026-03-27 10:53:32 [auto1.de] INFO: Scrape type for LG14715: 0
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: ZS85810
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85810%27 HTTP/1.1" 200 None
2026-03-27 10:53:32 [auto1.de] INFO: Scrape type for ZS85810: 0
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: LU22691
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: ER86835
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: FT64336
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64336%27 HTTP/1.1" 200 None
2026-03-27 10:53:32 [auto1.de] INFO: Scrape type for FT64336: 0
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: RB35490
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: AP00177
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP00177%27 HTTP/1.1" 200 None
2026-03-27 10:53:32 [auto1.de] INFO: Scrape type for AP00177: 0
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: KZ11902
2026-03-27 10:53:32 [auto1.de] INFO: Found listing with ID: HW63647
2026-03-27 10:53:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:33 [auto1.de] INFO: Channel: 24h | Page: 57 | totalHits: 10600 | hits on page: 40
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: BZ95639
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ95639%27 HTTP/1.1" 200 None
2026-03-27 10:53:33 [auto1.de] INFO: Scrape type for BZ95639: 0
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: UU35907
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: CU13937
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: JC65940
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: AC60710
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: GL86487
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: NX37466
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX37466%27 HTTP/1.1" 200 None
2026-03-27 10:53:33 [auto1.de] INFO: Scrape type for NX37466: 0
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: JT80939
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: SC46764
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC46764%27 HTTP/1.1" 200 None
2026-03-27 10:53:33 [auto1.de] INFO: Scrape type for SC46764: 0
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: SD59172
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: LT87510
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: DC51823
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC51823%27 HTTP/1.1" 200 None
2026-03-27 10:53:33 [auto1.de] INFO: Scrape type for DC51823: 0
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: HS66299
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS66299%27 HTTP/1.1" 200 None
2026-03-27 10:53:33 [auto1.de] INFO: Scrape type for HS66299: 0
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: PV13799
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV13799%27 HTTP/1.1" 200 None
2026-03-27 10:53:33 [auto1.de] INFO: Scrape type for PV13799: 0
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: FZ02715
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: RE68011
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: EF04397
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: VB40940
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: EX19537
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: YN95759
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: AM33807
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM33807%27 HTTP/1.1" 200 None
2026-03-27 10:53:33 [auto1.de] INFO: Scrape type for AM33807: 0
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: GM93561
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93561%27 HTTP/1.1" 200 None
2026-03-27 10:53:33 [auto1.de] INFO: Scrape type for GM93561: 0
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: FR19321
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: FM78793
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: GA19207
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: KJ36924
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: MK32752
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: GJ61824
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: FC40686
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: TX33214
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX33214%27 HTTP/1.1" 200 None
2026-03-27 10:53:33 [auto1.de] INFO: Scrape type for TX33214: 0
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: EJ47615
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47615%27 HTTP/1.1" 200 None
2026-03-27 10:53:33 [auto1.de] INFO: Scrape type for EJ47615: 0
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: MD27320
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD27320%27 HTTP/1.1" 200 None
2026-03-27 10:53:33 [auto1.de] INFO: Scrape type for MD27320: 0
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: XL96433
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: PR65982
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR65982%27 HTTP/1.1" 200 None
2026-03-27 10:53:33 [auto1.de] INFO: Scrape type for PR65982: 0
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: AZ34844
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ34844%27 HTTP/1.1" 200 None
2026-03-27 10:53:33 [auto1.de] INFO: Scrape type for AZ34844: 0
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: JM60205
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: GF55006
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: AN12831
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN12831%27 HTTP/1.1" 200 None
2026-03-27 10:53:33 [auto1.de] INFO: Scrape type for AN12831: 0
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: YR79281
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR79281%27 HTTP/1.1" 200 None
2026-03-27 10:53:33 [auto1.de] INFO: Scrape type for YR79281: 0
2026-03-27 10:53:33 [auto1.de] INFO: Found listing with ID: SU92551
2026-03-27 10:53:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML66978> (referer: https://www.auto1.com/v1/car-details-view/ML66978/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91a352f7-e34b-593f-9e75-838c9a9b8db1 with identifier: ML66978
2026-03-27 10:53:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91a352f7-e34b-593f-9e75-838c9a9b8db1 with scrape type 1
2026-03-27 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 91a352f7-e34b-593f-9e75-838c9a9b8db1
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F35%252F3335fc424b1ca455e0815d3414190599%252Fpa%252FML66978_7a2b0b3bfc93ee016617ff3805f3eb7d.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/35/3335fc424b1ca455e0815d3414190599/pa/ML66978_7a2b0b3bfc93ee016617ff3805f3eb7d.jpg not downloaded yet
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F35%252F3335fc424b1ca455e0815d3414190599%252Fpa%252FML66978_edb994bc77eb681b80b1f25d4734414c.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/35/3335fc424b1ca455e0815d3414190599/pa/ML66978_edb994bc77eb681b80b1f25d4734414c.jpg not downloaded yet
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F35%252F3335fc424b1ca455e0815d3414190599%252Fpa%252FML66978_dcf9d68e007e94b97ee8f365138609ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/35/3335fc424b1ca455e0815d3414190599/pa/ML66978_dcf9d68e007e94b97ee8f365138609ac.jpg not downloaded yet
2026-03-27 10:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F35%252F3335fc424b1ca455e0815d3414190599%252Fpa%252FML66978_499358a31736f6d41b449f1e9ea640e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/35/3335fc424b1ca455e0815d3414190599/pa/ML66978_499358a31736f6d41b449f1e9ea640e1.jpg not downloaded yet
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F35%252F3335fc424b1ca455e0815d3414190599%252Fpa%252FML66978_a48a0dc0a735f57599ad56af222ec947.jpg%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/35/3335fc424b1ca455e0815d3414190599/pa/ML66978_a48a0dc0a735f57599ad56af222ec947.jpg not downloaded yet
2026-03-27 10:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/35/3335fc424b1ca455e0815d3414190599/pa/ML66978_7a2b0b3bfc93ee016617ff3805f3eb7d.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:53:34 [auto1.de] INFO: Channel: 24h | Page: 58 | totalHits: 10601 | hits on page: 40
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: SU92551
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: LS85848
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS85848%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for LS85848: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: TG14213
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: AS40376
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS40376%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for AS40376: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: TU30729
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU30729%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for TU30729: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: HU56318
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: RE74325
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE74325%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for RE74325: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: MP75232
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP75232%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for MP75232: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: XY02302
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: UG51054
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: UR01748
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: DF13757
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: NV71867
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: PW82256
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: SV44842
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: RB81388
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: EC82787
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC82787%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for EC82787: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: FE14338
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: KM55226
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: UM20037
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM20037%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for UM20037: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: PF70156
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF70156%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for PF70156: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: ME65704
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: BF56330
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: UU13663
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: NB32533
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB32533%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for NB32533: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: VD76950
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD76950%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for VD76950: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: AA97264
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: LJ65322
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ65322%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for LJ65322: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: XP11073
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP11073%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for XP11073: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: XF49404
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF49404%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for XF49404: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: TB50006
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB50006%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for TB50006: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: DW79441
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW79441%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for DW79441: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: AP31336
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP31336%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for AP31336: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: ES39418
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES39418%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for ES39418: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: RT12397
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT12397%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for RT12397: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: BM18767
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM18767%27 HTTP/1.1" 200 None
2026-03-27 10:53:34 [auto1.de] INFO: Scrape type for BM18767: 0
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: DL24394
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: LU41152
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: LC19229
2026-03-27 10:53:34 [auto1.de] INFO: Found listing with ID: AN50976
2026-03-27 10:53:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/35/3335fc424b1ca455e0815d3414190599/pa/ML66978_499358a31736f6d41b449f1e9ea640e1.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/35/3335fc424b1ca455e0815d3414190599/pa/ML66978_dcf9d68e007e94b97ee8f365138609ac.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/35/3335fc424b1ca455e0815d3414190599/pa/ML66978_edb994bc77eb681b80b1f25d4734414c.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:53:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/35/3335fc424b1ca455e0815d3414190599/pa/ML66978_a48a0dc0a735f57599ad56af222ec947.jpg> (referer: https://www.auto1.com/)
2026-03-27 10:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5004c5550>
2026-03-27 10:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91a352f7-e34b-593f-9e75-838c9a9b8db1/91a352f7-e34b-593f-9e75-838c9a9b8db1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F35%252F3335fc424b1ca455e0815d3414190599%252Fpa%252FML66978_7a2b0b3bfc93ee016617ff3805f3eb7d.jpg') HTTP/1.1" 204 0
2026-03-27 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/35/3335fc424b1ca455e0815d3414190599/pa/ML66978_7a2b0b3bfc93ee016617ff3805f3eb7d.jpg saved to cache
2026-03-27 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91a352f7-e34b-593f-9e75-838c9a9b8db1
2026-03-27 10:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb5019a5610>
2026-03-27 10:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91a352f7-e34b-593f-9e75-838c9a9b8db1/91a352f7-e34b-593f-9e75-838c9a9b8db1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F35%252F3335fc424b1ca455e0815d3414190599%252Fpa%252FML66978_499358a31736f6d41b449f1e9ea640e1.jpg') HTTP/1.1" 204 0
2026-03-27 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/35/3335fc424b1ca455e0815d3414190599/pa/ML66978_499358a31736f6d41b449f1e9ea640e1.jpg saved to cache
2026-03-27 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91a352f7-e34b-593f-9e75-838c9a9b8db1
2026-03-27 10:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501871ad0>
2026-03-27 10:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91a352f7-e34b-593f-9e75-838c9a9b8db1/91a352f7-e34b-593f-9e75-838c9a9b8db1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F35%252F3335fc424b1ca455e0815d3414190599%252Fpa%252FML66978_dcf9d68e007e94b97ee8f365138609ac.jpg') HTTP/1.1" 204 0
2026-03-27 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/35/3335fc424b1ca455e0815d3414190599/pa/ML66978_dcf9d68e007e94b97ee8f365138609ac.jpg saved to cache
2026-03-27 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91a352f7-e34b-593f-9e75-838c9a9b8db1
2026-03-27 10:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb501698350>
2026-03-27 10:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91a352f7-e34b-593f-9e75-838c9a9b8db1/91a352f7-e34b-593f-9e75-838c9a9b8db1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F35%252F3335fc424b1ca455e0815d3414190599%252Fpa%252FML66978_edb994bc77eb681b80b1f25d4734414c.jpg') HTTP/1.1" 204 0
2026-03-27 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/35/3335fc424b1ca455e0815d3414190599/pa/ML66978_edb994bc77eb681b80b1f25d4734414c.jpg saved to cache
2026-03-27 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91a352f7-e34b-593f-9e75-838c9a9b8db1
2026-03-27 10:53:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 10:53:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb500232610>
2026-03-27 10:53:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 10:53:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91a352f7-e34b-593f-9e75-838c9a9b8db1/91a352f7-e34b-593f-9e75-838c9a9b8db1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F35%252F3335fc424b1ca455e0815d3414190599%252Fpa%252FML66978_a48a0dc0a735f57599ad56af222ec947.jpg') HTTP/1.1" 204 0
2026-03-27 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/35/3335fc424b1ca455e0815d3414190599/pa/ML66978_a48a0dc0a735f57599ad56af222ec947.jpg saved to cache
2026-03-27 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 91a352f7-e34b-593f-9e75-838c9a9b8db1
2026-03-27 10:53:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91a352f7-e34b-593f-9e75-838c9a9b8db1, skipping ID generation
2026-03-27 10:53:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91a352f7-e34b-593f-9e75-838c9a9b8db1 with scrape type 1
2026-03-27 10:53:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91a352f7-e34b-593f-9e75-838c9a9b8db1 sending to next pipeline
2026-03-27 10:53:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91a352f7-e34b-593f-9e75-838c9a9b8db1, identifier: ML66978
2026-03-27 10:53:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91a352f7-e34b-593f-9e75-838c9a9b8db1 with identifier: ML66978
2026-03-27 10:53:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91a352f7-e34b-593f-9e75-838c9a9b8db1 with identifier: ML66978
2026-03-27 10:53:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91a352f7-e34b-593f-9e75-838c9a9b8db1 with identifier: ML66978 to the API
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:53:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img33/35/3335fc424b1ca455e0815d3414190599/pa/ML66978_a48a0dc0a735f57599ad56af222ec947.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:55:47Z',
 'fuel_type': 'diesel',
 'id': '91a352f7-e34b-593f-9e75-838c9a9b8db1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML66978',
 'listing': 'auction',
 'location': 'DE, Reutlingen',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 278476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91a352f7-e34b-593f-9e75-838c9a9b8db1/91a352f7-e34b-593f-9e75-838c9a9b8db1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/35/3335fc424b1ca455e0815d3414190599/pa/ML66978_7a2b0b3bfc93ee016617ff3805f3eb7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91a352f7-e34b-593f-9e75-838c9a9b8db1/91a352f7-e34b-593f-9e75-838c9a9b8db1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/35/3335fc424b1ca455e0815d3414190599/pa/ML66978_edb994bc77eb681b80b1f25d4734414c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91a352f7-e34b-593f-9e75-838c9a9b8db1/91a352f7-e34b-593f-9e75-838c9a9b8db1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/35/3335fc424b1ca455e0815d3414190599/pa/ML66978_dcf9d68e007e94b97ee8f365138609ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91a352f7-e34b-593f-9e75-838c9a9b8db1/91a352f7-e34b-593f-9e75-838c9a9b8db1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/35/3335fc424b1ca455e0815d3414190599/pa/ML66978_499358a31736f6d41b449f1e9ea640e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91a352f7-e34b-593f-9e75-838c9a9b8db1/91a352f7-e34b-593f-9e75-838c9a9b8db1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/35/3335fc424b1ca455e0815d3414190599/pa/ML66978_a48a0dc0a735f57599ad56af222ec947.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 109 CDI Lang',
 'transmission': 'manual',
 'trim': 'Lang',
 'year': 2012}
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML66978%27 HTTP/1.1" 200 None
2026-03-27 10:53:35 [auto1.de] INFO: Saving data for ML66978: {'created_time': 1774608815.685424, 'last_price_update_time': 1774608815.685436, 'auction_closing_time': 1774716947.0}
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML66978') HTTP/1.1" 204 0
2026-03-27 10:53:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:36 [auto1.de] INFO: Channel: 24h | Page: 59 | totalHits: 10601 | hits on page: 40
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: JD37809
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: CT52786
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT52786%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for CT52786: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: HE75386
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE75386%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for HE75386: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: CY30248
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY30248%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for CY30248: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: XZ96898
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ96898%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for XZ96898: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: JA01983
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: DP30254
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: PE01581
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE01581%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for PE01581: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: DK17127
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: KC84563
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC84563%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for KC84563: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: AN39214
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: NP82575
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP82575%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for NP82575: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: KZ45391
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: CA25135
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: NS70849
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: YT48506
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: LM65356
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: FD43857
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: YP78886
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: FA74860
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA74860%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for FA74860: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: LJ32377
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ32377%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for LJ32377: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: ZV83127
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: HS10985
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: SG43675
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG43675%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for SG43675: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: LZ61913
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: YT82208
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT82208%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for YT82208: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: XV81276
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV81276%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for XV81276: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: EM14245
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM14245%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for EM14245: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: KM31933
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: DK13262
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK13262%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for DK13262: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: JC94959
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: KL21870
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: DU90887
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU90887%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for DU90887: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: YU83796
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: VK16260
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: VW23219
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW23219%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for VW23219: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: AK10320
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK10320%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for AK10320: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: PA97380
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: KU90890
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU90890%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for KU90890: 0
2026-03-27 10:53:36 [auto1.de] INFO: Found listing with ID: KY36378
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY36378%27 HTTP/1.1" 200 None
2026-03-27 10:53:36 [auto1.de] INFO: Scrape type for KY36378: 0
2026-03-27 10:53:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:38 [auto1.de] INFO: Channel: 24h | Page: 60 | totalHits: 10602 | hits on page: 40
2026-03-27 10:53:38 [auto1.de] INFO: Found listing with ID: KY36378
2026-03-27 10:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY36378%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for KY36378: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: LC01777
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: RH56837
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: YD12708
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: WB51072
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB51072%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for WB51072: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: WX33301
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX33301%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for WX33301: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: LC73374
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC73374%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for LC73374: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: WG52283
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: ED90812
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: GL77539
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL77539%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for GL77539: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: HC53321
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: RA83567
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: XH97398
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: LW31172
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: XP10633
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: AD58563
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD58563%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for AD58563: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: JR09584
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR09584%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for JR09584: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: XT97994
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT97994%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for XT97994: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: VF30543
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: JA10385
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA10385%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for JA10385: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: ZH02957
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: NW48345
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW48345%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for NW48345: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: YV13376
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV13376%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for YV13376: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: AT96377
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: LK23707
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK23707%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for LK23707: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: LE07247
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: DX26542
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX26542%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for DX26542: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: GD02743
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: FX70988
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: NY38671
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: ZF79650
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: XM74841
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM74841%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for XM74841: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: SC11687
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC11687%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for SC11687: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: WH62381
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH62381%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for WH62381: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: XW64211
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW64211%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for XW64211: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: WK11079
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: AF80328
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: NT22490
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: NJ21212
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ21212%27 HTTP/1.1" 200 None
2026-03-27 10:53:39 [auto1.de] INFO: Scrape type for NJ21212: 0
2026-03-27 10:53:39 [auto1.de] INFO: Found listing with ID: RF82570
2026-03-27 10:53:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:40 [auto1.de] INFO: Channel: 24h | Page: 61 | totalHits: 10602 | hits on page: 40
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: FT52767
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: MF71867
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF71867%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for MF71867: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: RR20427
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR20427%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for RR20427: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: KX24664
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: XL03429
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL03429%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for XL03429: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: UU29980
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: YE43560
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: HN73886
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: SJ02901
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02901%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for SJ02901: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: VT29365
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: ME72449
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: AH42647
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH42647%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for AH42647: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: KJ57811
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: UE53576
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE53576%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for UE53576: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: FY37174
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY37174%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for FY37174: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: CX91527
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: BP26414
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP26414%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for BP26414: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: XC43362
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: AH10770
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH10770%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for AH10770: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: RE55721
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE55721%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for RE55721: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: WX65526
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX65526%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for WX65526: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: HB96099
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: YR53250
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: UT79910
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: HX17640
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX17640%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for HX17640: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: MS18045
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS18045%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for MS18045: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: BC91318
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: FT93387
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: VF93957
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF93957%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for VF93957: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: GW92568
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW92568%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for GW92568: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: FA31090
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: VU57107
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: CM51070
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: TP09714
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP09714%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for TP09714: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: UW93574
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: WH94807
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: LF70646
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF70646%27 HTTP/1.1" 200 None
2026-03-27 10:53:40 [auto1.de] INFO: Scrape type for LF70646: 0
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: BP88986
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: UH53806
2026-03-27 10:53:40 [auto1.de] INFO: Found listing with ID: VR14158
2026-03-27 10:53:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:41 [auto1.de] INFO: Channel: 24h | Page: 62 | totalHits: 10602 | hits on page: 40
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: NS67917
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: KV43188
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV43188%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for KV43188: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: PB81090
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB81090%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for PB81090: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: BP81382
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: ZU52424
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU52424%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for ZU52424: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: DF39026
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF39026%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for DF39026: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: MN91513
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: WH32763
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH32763%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for WH32763: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: TT42996
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: XH00472
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: AJ87809
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: ME62571
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME62571%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for ME62571: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: LY18860
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: PD25871
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD25871%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for PD25871: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: NN70157
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: XY85080
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY85080%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for XY85080: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: UT80766
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT80766%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for UT80766: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: KD57874
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: HH63715
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH63715%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for HH63715: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: XS00144
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS00144%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for XS00144: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: ZF01795
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF01795%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for ZF01795: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: HE15634
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE15634%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for HE15634: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: MR26269
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR26269%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for MR26269: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: HC04393
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC04393%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for HC04393: 0
2026-03-27 10:53:41 [auto1.de] INFO: Found listing with ID: JE38755
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE38755%27 HTTP/1.1" 200 None
2026-03-27 10:53:41 [auto1.de] INFO: Scrape type for JE38755: 2
2026-03-27 10:53:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e04e88b4-c7a2-597b-8d25-dec1c5371018 with identifier: JE38755
2026-03-27 10:53:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e04e88b4-c7a2-597b-8d25-dec1c5371018 with scrape type 2
2026-03-27 10:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e04e88b4-c7a2-597b-8d25-dec1c5371018 with scrape type 2
2026-03-27 10:53:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e04e88b4-c7a2-597b-8d25-dec1c5371018, identifier: JE38755
2026-03-27 10:53:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e04e88b4-c7a2-597b-8d25-dec1c5371018 with identifier: JE38755
2026-03-27 10:53:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e04e88b4-c7a2-597b-8d25-dec1c5371018 with identifier: JE38755
2026-03-27 10:53:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e04e88b4-c7a2-597b-8d25-dec1c5371018 with identifier: JE38755 to the API
2026-03-27 10:53:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:53:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:16:42Z',
 'fuel_type': 'petrol',
 'id': 'e04e88b4-c7a2-597b-8d25-dec1c5371018',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE38755',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 74672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-06',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2015}
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE38755%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Saving data for JE38755: {'auction_closing_time': 1774628202.0, 'created_time': 1773773895.473856, 'last_price_update_time': 1774608823.478254}
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE38755') HTTP/1.1" 204 0
2026-03-27 10:53:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: KK41609
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: FU56159
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: SW90946
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW90946%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for SW90946: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: LV91095
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV91095%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for LV91095: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: LK47364
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK47364%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for LK47364: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: LL88453
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: WC03431
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: ML73813
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: DB54386
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: GJ44071
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ44071%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for GJ44071: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: PN20097
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN20097%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for PN20097: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: ND18616
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND18616%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for ND18616: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: KM40135
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM40135%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for KM40135: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: BF31155
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF31155%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for BF31155: 0
2026-03-27 10:53:43 [auto1.de] INFO: Found listing with ID: NN20456
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN20456%27 HTTP/1.1" 200 None
2026-03-27 10:53:43 [auto1.de] INFO: Scrape type for NN20456: 0
2026-03-27 10:53:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:44 [auto1.de] INFO: Channel: 24h | Page: 63 | totalHits: 10602 | hits on page: 40
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: WX25953
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: HJ90196
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: LH84474
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH84474%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for LH84474: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: HV52048
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: FU38421
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: WW07339
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: RL91910
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: VN40893
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: BN05561
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN05561%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for BN05561: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: SD15170
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD15170%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for SD15170: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: VC94305
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: CD20105
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD20105%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for CD20105: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: YG08011
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG08011%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for YG08011: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: HN89991
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: KW34435
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: WG72441
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: AH66368
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: UV63326
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV63326%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for UV63326: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: RT74882
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: VG28956
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG28956%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for VG28956: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: LR75634
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR75634%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for LR75634: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: UP22850
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP22850%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for UP22850: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: PX08100
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: NS95449
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS95449%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for NS95449: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: EZ91283
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: LS02070
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: UW98982
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW98982%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for UW98982: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: PY40149
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: MU24847
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU24847%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for MU24847: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: DP27677
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP27677%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for DP27677: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: FL24570
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL24570%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for FL24570: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: CS85382
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS85382%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for CS85382: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: EW53480
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: AW14620
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: PV43751
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: JZ03470
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: FM76670
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM76670%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for FM76670: 0
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: MH26074
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: WZ70999
2026-03-27 10:53:44 [auto1.de] INFO: Found listing with ID: ZK41607
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK41607%27 HTTP/1.1" 200 None
2026-03-27 10:53:44 [auto1.de] INFO: Scrape type for ZK41607: 0
2026-03-27 10:53:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:46 [auto1.de] INFO: Channel: 24h | Page: 64 | totalHits: 10603 | hits on page: 40
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: ZK41607
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK41607%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for ZK41607: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: LE59540
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: JW26700
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW26700%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for JW26700: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: VC25915
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: SS89837
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: GA63896
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: MR11894
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR11894%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for MR11894: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: KT50615
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: RS45157
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS45157%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for RS45157: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: SJ85849
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ85849%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for SJ85849: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: MM64069
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM64069%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for MM64069: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: LZ29816
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: DN70998
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: DW25667
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW25667%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for DW25667: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: UM42416
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: VK33233
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK33233%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for VK33233: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: PM53589
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: DB31408
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: MS04579
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS04579%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for MS04579: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: PH15914
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: EA72382
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA72382%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for EA72382: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: NZ33655
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: ZF95436
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF95436%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for ZF95436: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: RX38122
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX38122%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for RX38122: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: RP65815
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP65815%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for RP65815: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: LB51000
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB51000%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for LB51000: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: JA21059
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA21059%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for JA21059: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: EZ23867
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: BJ18418
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ18418%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for BJ18418: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: MH25393
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH25393%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for MH25393: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: FT62764
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT62764%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for FT62764: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: PY07477
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: ZM05379
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: NC84547
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC84547%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for NC84547: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: KC92153
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC92153%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for KC92153: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: FS98205
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: FJ42259
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ42259%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for FJ42259: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: DH11465
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH11465%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for DH11465: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: DW94229
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW94229%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for DW94229: 0
2026-03-27 10:53:46 [auto1.de] INFO: Found listing with ID: WR86078
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR86078%27 HTTP/1.1" 200 None
2026-03-27 10:53:46 [auto1.de] INFO: Scrape type for WR86078: 0
2026-03-27 10:53:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:47 [auto1.de] INFO: Channel: 24h | Page: 65 | totalHits: 10603 | hits on page: 40
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: BD50281
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: MG02116
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: EX80316
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: YJ88627
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ88627%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for YJ88627: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: YP66786
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: YM49351
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: PD02193
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: EN59108
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: FY00951
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY00951%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for FY00951: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: TS97270
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS97270%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for TS97270: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: DX98666
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: WB94414
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: KF80227
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF80227%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for KF80227: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: KU94473
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU94473%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for KU94473: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: TA96658
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: VL31529
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL31529%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for VL31529: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: XU12244
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU12244%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for XU12244: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: DC86459
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: VU63720
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: CZ43316
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: GR87963
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: EL27695
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL27695%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for EL27695: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: GZ76371
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ76371%27 HTTP/1.1" 200 None
2026-03-27 10:53:47 [auto1.de] INFO: Scrape type for GZ76371: 0
2026-03-27 10:53:47 [auto1.de] INFO: Found listing with ID: MR49496
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR49496%27 HTTP/1.1" 200 None
2026-03-27 10:53:48 [auto1.de] INFO: Scrape type for MR49496: 0
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: MN62141
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: BY79192
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY79192%27 HTTP/1.1" 200 None
2026-03-27 10:53:48 [auto1.de] INFO: Scrape type for BY79192: 0
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: ZY13733
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY13733%27 HTTP/1.1" 200 None
2026-03-27 10:53:48 [auto1.de] INFO: Scrape type for ZY13733: 0
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: PK76037
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: XD99934
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: VL48750
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: JV77194
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: CX40237
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: SW58559
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: GC23441
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: TM13225
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: SU30794
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: YS11001
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS11001%27 HTTP/1.1" 200 None
2026-03-27 10:53:48 [auto1.de] INFO: Scrape type for YS11001: 0
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: VM08251
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM08251%27 HTTP/1.1" 200 None
2026-03-27 10:53:48 [auto1.de] INFO: Scrape type for VM08251: 0
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: HJ41200
2026-03-27 10:53:48 [auto1.de] INFO: Found listing with ID: LY72043
2026-03-27 10:53:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:49 [auto1.de] INFO: Channel: 24h | Page: 66 | totalHits: 10603 | hits on page: 40
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: RN72483
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN72483%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for RN72483: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: MA95154
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: XA47901
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: LF42462
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF42462%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for LF42462: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: DN24455
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN24455%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for DN24455: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: RX33159
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX33159%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for RX33159: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: FM24966
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: TR03247
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: KS17982
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS17982%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for KS17982: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: EP91734
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: CV35288
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: SE89354
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE89354%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for SE89354: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: JJ25259
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ25259%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for JJ25259: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: DD35024
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: YP87015
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP87015%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for YP87015: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: RH83429
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: SC29196
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC29196%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for SC29196: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: YU63408
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: HM06155
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: LS62630
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS62630%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for LS62630: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: TS73841
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS73841%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for TS73841: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: VE04349
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE04349%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for VE04349: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: YV18372
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV18372%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for YV18372: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: VG12821
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: NW77024
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: SB88077
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: BX73975
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: LS40625
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: GB18110
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: MF28588
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF28588%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for MF28588: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: NX62125
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: XH85131
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH85131%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for XH85131: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: CY03369
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY03369%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for CY03369: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: ZS59678
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: SU52289
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU52289%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for SU52289: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: KD11093
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD11093%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for KD11093: 0
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: XM97106
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: AX44497
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: NC92529
2026-03-27 10:53:49 [auto1.de] INFO: Found listing with ID: YZ92306
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ92306%27 HTTP/1.1" 200 None
2026-03-27 10:53:49 [auto1.de] INFO: Scrape type for YZ92306: 0
2026-03-27 10:53:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:53:57 [auto1.de] INFO: Channel: 24h | Page: 67 | totalHits: 10603 | hits on page: 40
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: HH67266
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH67266%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for HH67266: 0
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: VS95794
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS95794%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for VS95794: 0
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: AG42517
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG42517%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for AG42517: 0
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: BV43542
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: ED87662
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED87662%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for ED87662: 0
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: PP57494
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: DF25786
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF25786%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for DF25786: 0
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: FJ74023
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: HG90812
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: KS19016
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: HJ07036
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ07036%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for HJ07036: 0
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: WD51171
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: TG60096
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: MX10037
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX10037%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for MX10037: 0
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: DL76971
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: TU94835
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU94835%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for TU94835: 0
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: RG71859
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG71859%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for RG71859: 0
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: HS46985
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: BW69940
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: GP39306
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP39306%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for GP39306: 0
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: YY00897
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: ZR98905
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR98905%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for ZR98905: 0
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: YT14311
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT14311%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for YT14311: 0
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: LB33247
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: WC00237
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC00237%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for WC00237: 0
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: YT79798
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT79798%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for YT79798: 0
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: CZ05672
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ05672%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for CZ05672: 0
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: PT02757
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: WA93069
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: RA28898
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: PB95910
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB95910%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for PB95910: 0
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: UC67587
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC67587%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for UC67587: 0
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: VL76600
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL76600%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for VL76600: 0
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: KR15967
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR15967%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for KR15967: 0
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: FK23500
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK23500%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for FK23500: 0
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: JH84206
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: DU63733
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU63733%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for DU63733: 0
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: EG89523
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: MT37929
2026-03-27 10:53:57 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN40502%27 HTTP/1.1" 200 None
2026-03-27 10:53:57 [auto1.de] INFO: Scrape type for ZN40502: 0
2026-03-27 10:53:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:00 [auto1.de] INFO: Channel: 24h | Page: 68 | totalHits: 10603 | hits on page: 40
2026-03-27 10:54:00 [auto1.de] INFO: Found listing with ID: EU60788
2026-03-27 10:54:00 [auto1.de] INFO: Found listing with ID: WT17427
2026-03-27 10:54:00 [auto1.de] INFO: Found listing with ID: JP65265
2026-03-27 10:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP65265%27 HTTP/1.1" 200 None
2026-03-27 10:54:01 [auto1.de] INFO: Scrape type for JP65265: 0
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: AY72100
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: EL37075
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL37075%27 HTTP/1.1" 200 None
2026-03-27 10:54:01 [auto1.de] INFO: Scrape type for EL37075: 0
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: DK59088
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: UY74553
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: SW71463
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW71463%27 HTTP/1.1" 200 None
2026-03-27 10:54:01 [auto1.de] INFO: Scrape type for SW71463: 0
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: DE48609
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: BD44577
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: PX90608
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX90608%27 HTTP/1.1" 200 None
2026-03-27 10:54:01 [auto1.de] INFO: Scrape type for PX90608: 0
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: PB20656
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: SW98857
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: RN29221
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: BU57910
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU57910%27 HTTP/1.1" 200 None
2026-03-27 10:54:01 [auto1.de] INFO: Scrape type for BU57910: 0
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: RJ12896
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ12896%27 HTTP/1.1" 200 None
2026-03-27 10:54:01 [auto1.de] INFO: Scrape type for RJ12896: 0
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: TL58821
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL58821%27 HTTP/1.1" 200 None
2026-03-27 10:54:01 [auto1.de] INFO: Scrape type for TL58821: 0
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: MS52892
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS52892%27 HTTP/1.1" 200 None
2026-03-27 10:54:01 [auto1.de] INFO: Scrape type for MS52892: 0
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: KK20323
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: BA53965
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA53965%27 HTTP/1.1" 200 None
2026-03-27 10:54:01 [auto1.de] INFO: Scrape type for BA53965: 0
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: XE00063
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: HU31000
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: JS22549
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: KV36658
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: AG92900
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: YZ97980
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ97980%27 HTTP/1.1" 200 None
2026-03-27 10:54:01 [auto1.de] INFO: Scrape type for YZ97980: 0
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: JP71642
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: AX75874
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: CN37277
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: TX40951
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: JD86545
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD86545%27 HTTP/1.1" 200 None
2026-03-27 10:54:01 [auto1.de] INFO: Scrape type for JD86545: 0
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: AF95896
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: KF61768
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: XJ37654
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: PE56791
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE56791%27 HTTP/1.1" 200 None
2026-03-27 10:54:01 [auto1.de] INFO: Scrape type for PE56791: 0
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: XY98739
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: ZH03742
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: UV59286
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: GW56930
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW56930%27 HTTP/1.1" 200 None
2026-03-27 10:54:01 [auto1.de] INFO: Scrape type for GW56930: 0
2026-03-27 10:54:01 [auto1.de] INFO: Found listing with ID: NP12620
2026-03-27 10:54:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:03 [auto1.de] INFO: Channel: 24h | Page: 69 | totalHits: 10604 | hits on page: 40
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: NP12620
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: VE64648
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE64648%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for VE64648: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: YL65079
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: AN60739
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN60739%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for AN60739: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: HG55526
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: KG59936
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: BE48760
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: HW40680
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: GE01801
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: ME04916
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME04916%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for ME04916: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: NT23375
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT23375%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for NT23375: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: BN03285
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: GN02679
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: YZ96811
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: TK89986
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: UH79601
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH79601%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for UH79601: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: CS71066
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS71066%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for CS71066: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: LK49002
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK49002%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for LK49002: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: SC39007
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC39007%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for SC39007: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: ZC80172
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: DW10415
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW10415%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for DW10415: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: GV90609
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: VK57644
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: KS96797
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: CX40454
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX40454%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for CX40454: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: NX12512
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: FB63580
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB63580%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for FB63580: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: FU38588
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: MA30458
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA30458%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for MA30458: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: GS35122
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: NV71643
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV71643%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for NV71643: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: VM18539
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: TD86732
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD86732%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for TD86732: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: UF26861
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF26861%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for UF26861: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: FW21931
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW21931%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for FW21931: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: XV43778
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV43778%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for XV43778: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: ZH98222
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH98222%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for ZH98222: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: SU97431
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: SN70569
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN70569%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for SN70569: 0
2026-03-27 10:54:03 [auto1.de] INFO: Found listing with ID: MX60968
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX60968%27 HTTP/1.1" 200 None
2026-03-27 10:54:03 [auto1.de] INFO: Scrape type for MX60968: 0
2026-03-27 10:54:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:04 [auto1.de] INFO: Channel: 24h | Page: 70 | totalHits: 10604 | hits on page: 40
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: RP49857
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: PY54306
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY54306%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for PY54306: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: UW26081
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: RK40199
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK40199%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for RK40199: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: XE97830
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE97830%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for XE97830: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: NU37498
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU37498%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for NU37498: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: WP82108
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: AA51381
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: FH53275
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH53275%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for FH53275: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: AT81603
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: NY43975
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY43975%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for NY43975: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: MC31762
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC31762%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for MC31762: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: UG90469
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG90469%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for UG90469: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: GC15327
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: FZ56361
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ56361%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for FZ56361: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: MD38661
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD38661%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for MD38661: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: AP83370
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: CS22386
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: CW37812
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW37812%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for CW37812: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: PL18680
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL18680%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for PL18680: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: BC71264
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: ML88986
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: AB54193
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: PX31120
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: GT12052
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: HH88396
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: BX69347
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX69347%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for BX69347: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: XA77724
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA77724%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for XA77724: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: TS91087
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS91087%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for TS91087: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: XA90478
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: KJ04555
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ04555%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for KJ04555: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: DZ59899
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: BJ01016
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: LL49213
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL49213%27 HTTP/1.1" 200 None
2026-03-27 10:54:04 [auto1.de] INFO: Scrape type for LL49213: 0
2026-03-27 10:54:04 [auto1.de] INFO: Found listing with ID: RP83269
2026-03-27 10:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP83269%27 HTTP/1.1" 200 None
2026-03-27 10:54:05 [auto1.de] INFO: Scrape type for RP83269: 0
2026-03-27 10:54:05 [auto1.de] INFO: Found listing with ID: XD52073
2026-03-27 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD52073%27 HTTP/1.1" 200 None
2026-03-27 10:54:05 [auto1.de] INFO: Scrape type for XD52073: 0
2026-03-27 10:54:05 [auto1.de] INFO: Found listing with ID: WT57470
2026-03-27 10:54:05 [auto1.de] INFO: Found listing with ID: CJ78227
2026-03-27 10:54:05 [auto1.de] INFO: Found listing with ID: TC30897
2026-03-27 10:54:05 [auto1.de] INFO: Found listing with ID: EX48924
2026-03-27 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX48924%27 HTTP/1.1" 200 None
2026-03-27 10:54:05 [auto1.de] INFO: Scrape type for EX48924: 0
2026-03-27 10:54:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:06 [scrapy.extensions.logstats] INFO: Crawled 538 pages (at 23 pages/min), scraped 892 items (at 4 items/min)
2026-03-27 10:54:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 10:54:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:09 [auto1.de] INFO: Channel: 24h | Page: 71 | totalHits: 10604 | hits on page: 40
2026-03-27 10:54:09 [auto1.de] INFO: Found listing with ID: HV42647
2026-03-27 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV42647%27 HTTP/1.1" 200 None
2026-03-27 10:54:09 [auto1.de] INFO: Scrape type for HV42647: 0
2026-03-27 10:54:09 [auto1.de] INFO: Found listing with ID: NK01451
2026-03-27 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK01451%27 HTTP/1.1" 200 None
2026-03-27 10:54:09 [auto1.de] INFO: Scrape type for NK01451: 0
2026-03-27 10:54:09 [auto1.de] INFO: Found listing with ID: BG60568
2026-03-27 10:54:09 [auto1.de] INFO: Found listing with ID: AM11662
2026-03-27 10:54:09 [auto1.de] INFO: Found listing with ID: AV28159
2026-03-27 10:54:09 [auto1.de] INFO: Found listing with ID: PC37120
2026-03-27 10:54:09 [auto1.de] INFO: Found listing with ID: HD23680
2026-03-27 10:54:09 [auto1.de] INFO: Found listing with ID: CC36364
2026-03-27 10:54:09 [auto1.de] INFO: Found listing with ID: DL87338
2026-03-27 10:54:09 [auto1.de] INFO: Found listing with ID: MA24981
2026-03-27 10:54:09 [auto1.de] INFO: Found listing with ID: JM85963
2026-03-27 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM85963%27 HTTP/1.1" 200 None
2026-03-27 10:54:09 [auto1.de] INFO: Scrape type for JM85963: 0
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: UC54364
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: GE71520
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE71520%27 HTTP/1.1" 200 None
2026-03-27 10:54:10 [auto1.de] INFO: Scrape type for GE71520: 0
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: XM84350
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: NC94445
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: UN63322
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: AT57881
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT57881%27 HTTP/1.1" 200 None
2026-03-27 10:54:10 [auto1.de] INFO: Scrape type for AT57881: 0
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: XY53001
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY53001%27 HTTP/1.1" 200 None
2026-03-27 10:54:10 [auto1.de] INFO: Scrape type for XY53001: 0
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: GK45349
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK45349%27 HTTP/1.1" 200 None
2026-03-27 10:54:10 [auto1.de] INFO: Scrape type for GK45349: 0
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: SA48353
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: GZ39772
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ39772%27 HTTP/1.1" 200 None
2026-03-27 10:54:10 [auto1.de] INFO: Scrape type for GZ39772: 0
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: JE29517
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: JR47796
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: PA46364
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: CL13866
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: YE85695
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE85695%27 HTTP/1.1" 200 None
2026-03-27 10:54:10 [auto1.de] INFO: Scrape type for YE85695: 0
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: SF11618
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: TE88755
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: UB40384
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB40384%27 HTTP/1.1" 200 None
2026-03-27 10:54:10 [auto1.de] INFO: Scrape type for UB40384: 0
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: UK26793
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK26793%27 HTTP/1.1" 200 None
2026-03-27 10:54:10 [auto1.de] INFO: Scrape type for UK26793: 0
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: WW97819
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: XM76659
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: RY51274
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY51274%27 HTTP/1.1" 200 None
2026-03-27 10:54:10 [auto1.de] INFO: Scrape type for RY51274: 0
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: HV78876
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: NG91703
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG91703%27 HTTP/1.1" 200 None
2026-03-27 10:54:10 [auto1.de] INFO: Scrape type for NG91703: 0
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: CC98432
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: JE86051
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: LW90861
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW90861%27 HTTP/1.1" 200 None
2026-03-27 10:54:10 [auto1.de] INFO: Scrape type for LW90861: 0
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: FE77599
2026-03-27 10:54:10 [auto1.de] INFO: Found listing with ID: ZU14135
2026-03-27 10:54:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:46 [auto1.de] INFO: Channel: 24h | Page: 72 | totalHits: 10606 | hits on page: 40
2026-03-27 10:54:46 [auto1.de] INFO: Found listing with ID: FE77599
2026-03-27 10:54:46 [auto1.de] INFO: Found listing with ID: ZU14135
2026-03-27 10:54:46 [auto1.de] INFO: Found listing with ID: ZR53559
2026-03-27 10:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR53559%27 HTTP/1.1" 200 None
2026-03-27 10:54:46 [auto1.de] INFO: Scrape type for ZR53559: 0
2026-03-27 10:54:46 [auto1.de] INFO: Found listing with ID: VA89984
2026-03-27 10:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA89984%27 HTTP/1.1" 200 None
2026-03-27 10:54:46 [auto1.de] INFO: Scrape type for VA89984: 2
2026-03-27 10:54:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae16a075-9806-50a4-af1d-ae7c37809f87 with identifier: VA89984
2026-03-27 10:54:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae16a075-9806-50a4-af1d-ae7c37809f87 with scrape type 2
2026-03-27 10:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae16a075-9806-50a4-af1d-ae7c37809f87 with scrape type 2
2026-03-27 10:54:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae16a075-9806-50a4-af1d-ae7c37809f87, identifier: VA89984
2026-03-27 10:54:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae16a075-9806-50a4-af1d-ae7c37809f87 with identifier: VA89984
2026-03-27 10:54:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae16a075-9806-50a4-af1d-ae7c37809f87 with identifier: VA89984
2026-03-27 10:54:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae16a075-9806-50a4-af1d-ae7c37809f87 with identifier: VA89984 to the API
2026-03-27 10:54:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:54:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:14:14Z',
 'fuel_type': 'petrol',
 'id': 'ae16a075-9806-50a4-af1d-ae7c37809f87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA89984',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 105569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-25',
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2018}
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA89984%27 HTTP/1.1" 200 None
2026-03-27 10:54:47 [auto1.de] INFO: Saving data for VA89984: {'auction_closing_time': 1774628054.0, 'created_time': 1773775702.317763, 'last_price_update_time': 1774608887.133392}
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VA89984') HTTP/1.1" 204 0
2026-03-27 10:54:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: CJ05951
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ05951%27 HTTP/1.1" 200 None
2026-03-27 10:54:47 [auto1.de] INFO: Scrape type for CJ05951: 0
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: BV43774
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV43774%27 HTTP/1.1" 200 None
2026-03-27 10:54:47 [auto1.de] INFO: Scrape type for BV43774: 0
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: KK35526
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: KA93370
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: WW00125
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: BS35535
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: MH95241
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: SY11471
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: KG98578
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: ZW11631
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: ZV99384
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: NL67563
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL67563%27 HTTP/1.1" 200 None
2026-03-27 10:54:47 [auto1.de] INFO: Scrape type for NL67563: 0
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: ZN07940
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN07940%27 HTTP/1.1" 200 None
2026-03-27 10:54:47 [auto1.de] INFO: Scrape type for ZN07940: 0
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: JJ67232
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: HP60079
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: VV12952
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: BH27116
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: RE78828
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: WF84421
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF84421%27 HTTP/1.1" 200 None
2026-03-27 10:54:47 [auto1.de] INFO: Scrape type for WF84421: 0
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: XH73530
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH73530%27 HTTP/1.1" 200 None
2026-03-27 10:54:47 [auto1.de] INFO: Scrape type for XH73530: 0
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: AX02207
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: FU89824
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: XD56236
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: JY95651
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY95651%27 HTTP/1.1" 200 None
2026-03-27 10:54:47 [auto1.de] INFO: Scrape type for JY95651: 0
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: KN16725
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: LB52395
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: SV33389
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV33389%27 HTTP/1.1" 200 None
2026-03-27 10:54:47 [auto1.de] INFO: Scrape type for SV33389: 0
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: AS80209
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS80209%27 HTTP/1.1" 200 None
2026-03-27 10:54:47 [auto1.de] INFO: Scrape type for AS80209: 0
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: RM34833
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM34833%27 HTTP/1.1" 200 None
2026-03-27 10:54:47 [auto1.de] INFO: Scrape type for RM34833: 0
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: PY12047
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: XE03188
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE03188%27 HTTP/1.1" 200 None
2026-03-27 10:54:47 [auto1.de] INFO: Scrape type for XE03188: 0
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: ZZ21826
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: AD63692
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: HR99158
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: DL00356
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL00356%27 HTTP/1.1" 200 None
2026-03-27 10:54:47 [auto1.de] INFO: Scrape type for DL00356: 0
2026-03-27 10:54:47 [auto1.de] INFO: Found listing with ID: KG90894
2026-03-27 10:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:49 [auto1.de] INFO: Channel: 24h | Page: 73 | totalHits: 10606 | hits on page: 40
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: GT82056
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: XU45940
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU45940%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for XU45940: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: ZD20410
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD20410%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for ZD20410: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: FU07672
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU07672%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for FU07672: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: KG17192
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG17192%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for KG17192: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: MT39473
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: VS12896
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: UN09274
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN09274%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for UN09274: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: HV97019
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: XP45109
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP45109%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for XP45109: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: GG60327
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG60327%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for GG60327: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: NJ00528
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: WU50689
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: WU35652
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU35652%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for WU35652: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: XF29574
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: WA34292
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA34292%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for WA34292: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: YT94890
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT94890%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for YT94890: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: US80699
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: WF46078
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF46078%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for WF46078: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: SU27774
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: ZX81946
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: EW68209
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW68209%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for EW68209: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: VD60509
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: EC56413
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC56413%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for EC56413: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: KD43899
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: HC76504
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: TR77666
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR77666%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for TR77666: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: ZG41092
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG41092%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for ZG41092: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: UC16251
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: PW71854
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW71854%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for PW71854: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: EH50010
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH50010%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for EH50010: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: BE71150
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: HL85444
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL85444%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for HL85444: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: RP69572
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: PG02615
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG02615%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for PG02615: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: PA67996
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA67996%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for PA67996: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: LZ73182
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ73182%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for LZ73182: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: SC67475
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC67475%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for SC67475: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: PB76196
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB76196%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for PB76196: 0
2026-03-27 10:54:49 [auto1.de] INFO: Found listing with ID: ZK29969
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK29969%27 HTTP/1.1" 200 None
2026-03-27 10:54:49 [auto1.de] INFO: Scrape type for ZK29969: 0
2026-03-27 10:54:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:52 [auto1.de] INFO: Channel: 24h | Page: 74 | totalHits: 10606 | hits on page: 40
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: UB87978
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB87978%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for UB87978: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: CF35953
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: FV33642
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV33642%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for FV33642: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: NT40509
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT40509%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for NT40509: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: PS42902
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: ZF36983
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF36983%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for ZF36983: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: UH95210
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH95210%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for UH95210: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: UU93742
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: TC53143
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC53143%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for TC53143: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: VE17795
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE17795%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for VE17795: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: XS52546
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS52546%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for XS52546: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: ZE38295
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE38295%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for ZE38295: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: TD36384
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: HL66127
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: JV39568
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: MF57943
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: CW81112
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW81112%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for CW81112: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: CV38870
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV38870%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for CV38870: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: BC57844
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC57844%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for BC57844: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: YJ10280
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ10280%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for YJ10280: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: DU54196
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU54196%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for DU54196: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: BZ50840
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ50840%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for BZ50840: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: SN40522
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN40522%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for SN40522: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: WF25588
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF25588%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for WF25588: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: TE12513
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE12513%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for TE12513: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: VT95404
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: NC51826
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC51826%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for NC51826: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: AK59090
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: JT42607
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT42607%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for JT42607: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: JL74315
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: EW00282
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW00282%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for EW00282: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: NZ13249
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: MY96813
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY96813%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for MY96813: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: LL66986
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL66986%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for LL66986: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: XE66890
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: SF05653
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF05653%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for SF05653: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: XR34915
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR34915%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for XR34915: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: NZ32797
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ32797%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for NZ32797: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: GA76856
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA76856%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for GA76856: 0
2026-03-27 10:54:52 [auto1.de] INFO: Found listing with ID: XX08056
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX08056%27 HTTP/1.1" 200 None
2026-03-27 10:54:52 [auto1.de] INFO: Scrape type for XX08056: 0
2026-03-27 10:54:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:53 [auto1.de] INFO: Channel: 24h | Page: 75 | totalHits: 10606 | hits on page: 40
2026-03-27 10:54:53 [auto1.de] INFO: Found listing with ID: GG55770
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG55770%27 HTTP/1.1" 200 None
2026-03-27 10:54:53 [auto1.de] INFO: Scrape type for GG55770: 0
2026-03-27 10:54:53 [auto1.de] INFO: Found listing with ID: VK88134
2026-03-27 10:54:53 [auto1.de] INFO: Found listing with ID: BC75049
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC75049%27 HTTP/1.1" 200 None
2026-03-27 10:54:53 [auto1.de] INFO: Scrape type for BC75049: 0
2026-03-27 10:54:53 [auto1.de] INFO: Found listing with ID: MU80081
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU80081%27 HTTP/1.1" 200 None
2026-03-27 10:54:53 [auto1.de] INFO: Scrape type for MU80081: 0
2026-03-27 10:54:53 [auto1.de] INFO: Found listing with ID: MG28733
2026-03-27 10:54:53 [auto1.de] INFO: Found listing with ID: WM29598
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM29598%27 HTTP/1.1" 200 None
2026-03-27 10:54:53 [auto1.de] INFO: Scrape type for WM29598: 0
2026-03-27 10:54:53 [auto1.de] INFO: Found listing with ID: BP97847
2026-03-27 10:54:53 [auto1.de] INFO: Found listing with ID: PF05113
2026-03-27 10:54:53 [auto1.de] INFO: Found listing with ID: WB68702
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB68702%27 HTTP/1.1" 200 None
2026-03-27 10:54:53 [auto1.de] INFO: Scrape type for WB68702: 0
2026-03-27 10:54:53 [auto1.de] INFO: Found listing with ID: SF57435
2026-03-27 10:54:53 [auto1.de] INFO: Found listing with ID: PP65062
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP65062%27 HTTP/1.1" 200 None
2026-03-27 10:54:53 [auto1.de] INFO: Scrape type for PP65062: 0
2026-03-27 10:54:53 [auto1.de] INFO: Found listing with ID: WX26579
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX26579%27 HTTP/1.1" 200 None
2026-03-27 10:54:53 [auto1.de] INFO: Scrape type for WX26579: 0
2026-03-27 10:54:53 [auto1.de] INFO: Found listing with ID: FG68231
2026-03-27 10:54:53 [auto1.de] INFO: Found listing with ID: HZ65828
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ65828%27 HTTP/1.1" 200 None
2026-03-27 10:54:53 [auto1.de] INFO: Scrape type for HZ65828: 0
2026-03-27 10:54:53 [auto1.de] INFO: Found listing with ID: DH93175
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH93175%27 HTTP/1.1" 200 None
2026-03-27 10:54:53 [auto1.de] INFO: Scrape type for DH93175: 0
2026-03-27 10:54:53 [auto1.de] INFO: Found listing with ID: VJ09038
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ09038%27 HTTP/1.1" 200 None
2026-03-27 10:54:53 [auto1.de] INFO: Scrape type for VJ09038: 0
2026-03-27 10:54:53 [auto1.de] INFO: Found listing with ID: NS16825
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS16825%27 HTTP/1.1" 200 None
2026-03-27 10:54:53 [auto1.de] INFO: Scrape type for NS16825: 0
2026-03-27 10:54:53 [auto1.de] INFO: Found listing with ID: XC02401
2026-03-27 10:54:53 [auto1.de] INFO: Found listing with ID: RP11152
2026-03-27 10:54:53 [auto1.de] INFO: Found listing with ID: ZP20731
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP20731%27 HTTP/1.1" 200 None
2026-03-27 10:54:53 [auto1.de] INFO: Scrape type for ZP20731: 0
2026-03-27 10:54:53 [auto1.de] INFO: Found listing with ID: BP63027
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP63027%27 HTTP/1.1" 200 None
2026-03-27 10:54:53 [auto1.de] INFO: Scrape type for BP63027: 2
2026-03-27 10:54:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 382b5afa-080c-5aa8-9688-c978a899f54c with identifier: BP63027
2026-03-27 10:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 382b5afa-080c-5aa8-9688-c978a899f54c with scrape type 2
2026-03-27 10:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 382b5afa-080c-5aa8-9688-c978a899f54c with scrape type 2
2026-03-27 10:54:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 382b5afa-080c-5aa8-9688-c978a899f54c, identifier: BP63027
2026-03-27 10:54:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 382b5afa-080c-5aa8-9688-c978a899f54c with identifier: BP63027
2026-03-27 10:54:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 382b5afa-080c-5aa8-9688-c978a899f54c with identifier: BP63027
2026-03-27 10:54:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 382b5afa-080c-5aa8-9688-c978a899f54c with identifier: BP63027 to the API
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:54:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-27T16:51:27Z',
 'fuel_type': 'diesel',
 'id': '382b5afa-080c-5aa8-9688-c978a899f54c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP63027',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Life',
 'odometer': 61641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-07',
 'seller_name': None,
 'title': 'Opel Zafira Life 2.0 CDTI M Tourer L2',
 'transmission': 'automatic',
 'trim': 'M Tourer L2',
 'year': 2022}
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP63027%27 HTTP/1.1" 200 None
2026-03-27 10:54:54 [auto1.de] INFO: Saving data for BP63027: {'auction_closing_time': 1774630287.0, 'created_time': 1774424130.655856, 'last_price_update_time': 1774608894.534923}
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP63027') HTTP/1.1" 204 0
2026-03-27 10:54:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:54 [auto1.de] INFO: Found listing with ID: BE04791
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE04791%27 HTTP/1.1" 200 None
2026-03-27 10:54:54 [auto1.de] INFO: Scrape type for BE04791: 0
2026-03-27 10:54:54 [auto1.de] INFO: Found listing with ID: CT61733
2026-03-27 10:54:54 [auto1.de] INFO: Found listing with ID: AV46184
2026-03-27 10:54:54 [auto1.de] INFO: Found listing with ID: WU11463
2026-03-27 10:54:54 [auto1.de] INFO: Found listing with ID: FX77489
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX77489%27 HTTP/1.1" 200 None
2026-03-27 10:54:54 [auto1.de] INFO: Scrape type for FX77489: 0
2026-03-27 10:54:54 [auto1.de] INFO: Found listing with ID: YH04536
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH04536%27 HTTP/1.1" 200 None
2026-03-27 10:54:54 [auto1.de] INFO: Scrape type for YH04536: 0
2026-03-27 10:54:54 [auto1.de] INFO: Found listing with ID: TD00729
2026-03-27 10:54:54 [auto1.de] INFO: Found listing with ID: ZX49680
2026-03-27 10:54:54 [auto1.de] INFO: Found listing with ID: AM43166
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM43166%27 HTTP/1.1" 200 None
2026-03-27 10:54:54 [auto1.de] INFO: Scrape type for AM43166: 0
2026-03-27 10:54:54 [auto1.de] INFO: Found listing with ID: GV05627
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV05627%27 HTTP/1.1" 200 None
2026-03-27 10:54:54 [auto1.de] INFO: Scrape type for GV05627: 0
2026-03-27 10:54:54 [auto1.de] INFO: Found listing with ID: HL68502
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL68502%27 HTTP/1.1" 200 None
2026-03-27 10:54:54 [auto1.de] INFO: Scrape type for HL68502: 0
2026-03-27 10:54:54 [auto1.de] INFO: Found listing with ID: RT76696
2026-03-27 10:54:54 [auto1.de] INFO: Found listing with ID: NH59879
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH59879%27 HTTP/1.1" 200 None
2026-03-27 10:54:54 [auto1.de] INFO: Scrape type for NH59879: 0
2026-03-27 10:54:54 [auto1.de] INFO: Found listing with ID: AA11983
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA11983%27 HTTP/1.1" 200 None
2026-03-27 10:54:54 [auto1.de] INFO: Scrape type for AA11983: 0
2026-03-27 10:54:54 [auto1.de] INFO: Found listing with ID: NB75703
2026-03-27 10:54:54 [auto1.de] INFO: Found listing with ID: ZV79161
2026-03-27 10:54:54 [auto1.de] INFO: Found listing with ID: JD91962
2026-03-27 10:54:54 [auto1.de] INFO: Found listing with ID: GG08526
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG08526%27 HTTP/1.1" 200 None
2026-03-27 10:54:54 [auto1.de] INFO: Scrape type for GG08526: 0
2026-03-27 10:54:54 [auto1.de] INFO: Found listing with ID: CY08035
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY08035%27 HTTP/1.1" 200 None
2026-03-27 10:54:54 [auto1.de] INFO: Scrape type for CY08035: 0
2026-03-27 10:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:55 [auto1.de] INFO: Channel: 24h | Page: 76 | totalHits: 10606 | hits on page: 40
2026-03-27 10:54:55 [auto1.de] INFO: Found listing with ID: WU48136
2026-03-27 10:54:55 [auto1.de] INFO: Found listing with ID: KE62238
2026-03-27 10:54:55 [auto1.de] INFO: Found listing with ID: WD61316
2026-03-27 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD61316%27 HTTP/1.1" 200 None
2026-03-27 10:54:55 [auto1.de] INFO: Scrape type for WD61316: 0
2026-03-27 10:54:55 [auto1.de] INFO: Found listing with ID: AF45716
2026-03-27 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF45716%27 HTTP/1.1" 200 None
2026-03-27 10:54:55 [auto1.de] INFO: Scrape type for AF45716: 0
2026-03-27 10:54:55 [auto1.de] INFO: Found listing with ID: JJ89633
2026-03-27 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ89633%27 HTTP/1.1" 200 None
2026-03-27 10:54:55 [auto1.de] INFO: Scrape type for JJ89633: 0
2026-03-27 10:54:55 [auto1.de] INFO: Found listing with ID: AF02059
2026-03-27 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF02059%27 HTTP/1.1" 200 None
2026-03-27 10:54:55 [auto1.de] INFO: Scrape type for AF02059: 0
2026-03-27 10:54:55 [auto1.de] INFO: Found listing with ID: UD17683
2026-03-27 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17683%27 HTTP/1.1" 200 None
2026-03-27 10:54:55 [auto1.de] INFO: Scrape type for UD17683: 0
2026-03-27 10:54:55 [auto1.de] INFO: Found listing with ID: RA78002
2026-03-27 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA78002%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for RA78002: 0
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: CP08433
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: LL58658
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: NF12246
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF12246%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for NF12246: 0
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: KH17356
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH17356%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for KH17356: 0
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: WD01270
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD01270%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for WD01270: 0
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: GR85769
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: SP67624
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: BD76265
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD76265%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for BD76265: 0
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: WD55827
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD55827%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for WD55827: 0
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: LA58021
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA58021%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for LA58021: 0
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: CA68070
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA68070%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for CA68070: 0
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: PJ80384
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: LJ92359
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: RK37113
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: ZG99162
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG99162%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for ZG99162: 0
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: NL64340
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL64340%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for NL64340: 0
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: AY79287
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY79287%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for AY79287: 0
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: LV79824
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: DL96803
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: FN85250
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN85250%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for FN85250: 0
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: JD23265
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD23265%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for JD23265: 0
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: WH06924
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH06924%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for WH06924: 0
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: GP69437
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP69437%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for GP69437: 0
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: UN87828
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: NV07015
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: EZ19901
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ19901%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for EZ19901: 0
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: AW04202
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW04202%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for AW04202: 0
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: KA23374
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: GF71655
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: FU98344
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU98344%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for FU98344: 0
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: KP56505
2026-03-27 10:54:56 [auto1.de] INFO: Found listing with ID: WE43939
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE43939%27 HTTP/1.1" 200 None
2026-03-27 10:54:56 [auto1.de] INFO: Scrape type for WE43939: 0
2026-03-27 10:54:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:54:57 [auto1.de] INFO: Channel: 24h | Page: 77 | totalHits: 10606 | hits on page: 40
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: JJ00785
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ00785%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for JJ00785: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: GJ45514
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: RW58482
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: JZ88566
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ88566%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for JZ88566: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: WT62339
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT62339%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for WT62339: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: NS04442
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS04442%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for NS04442: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: FY01239
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY01239%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for FY01239: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: UC27013
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC27013%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for UC27013: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: CT23259
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT23259%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for CT23259: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: ZW02435
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW02435%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for ZW02435: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: BK38735
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK38735%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for BK38735: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: LC01994
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC01994%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for LC01994: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: LN72061
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN72061%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for LN72061: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: VN56016
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN56016%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for VN56016: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: JS73501
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS73501%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for JS73501: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: PS15350
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: UM55631
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM55631%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for UM55631: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: GW25108
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: JP09068
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: FE25594
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: TG18023
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: PB37453
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: AW12746
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: YF90999
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF90999%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for YF90999: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: KL74101
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL74101%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for KL74101: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: TX27115
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: UH63993
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH63993%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for UH63993: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: RM36813
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: JK05015
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: HJ31046
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: PE88762
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: YU02845
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: UE39017
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE39017%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for UE39017: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: DB10875
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB10875%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for DB10875: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: EN45788
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN45788%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for EN45788: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: PX22927
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX22927%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for PX22927: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: WP05993
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP05993%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for WP05993: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: TU46947
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: MK30505
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK30505%27 HTTP/1.1" 200 None
2026-03-27 10:54:57 [auto1.de] INFO: Scrape type for MK30505: 0
2026-03-27 10:54:57 [auto1.de] INFO: Found listing with ID: JA57202
2026-03-27 10:54:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:06 [scrapy.extensions.logstats] INFO: Crawled 545 pages (at 7 pages/min), scraped 894 items (at 2 items/min)
2026-03-27 10:55:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 10:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:11 [auto1.de] INFO: Channel: 24h | Page: 78 | totalHits: 10607 | hits on page: 40
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: JA57202
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: TA55344
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: LP31665
2026-03-27 10:55:11 [auto1.de] INFO: Found listing with ID: GG82433
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG82433%27 HTTP/1.1" 200 None
2026-03-27 10:55:11 [auto1.de] INFO: Scrape type for GG82433: 2
2026-03-27 10:55:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c37bc24-afa5-5762-a653-7e911a775a3e with identifier: GG82433
2026-03-27 10:55:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c37bc24-afa5-5762-a653-7e911a775a3e with scrape type 2
2026-03-27 10:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c37bc24-afa5-5762-a653-7e911a775a3e with scrape type 2
2026-03-27 10:55:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c37bc24-afa5-5762-a653-7e911a775a3e, identifier: GG82433
2026-03-27 10:55:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c37bc24-afa5-5762-a653-7e911a775a3e with identifier: GG82433
2026-03-27 10:55:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c37bc24-afa5-5762-a653-7e911a775a3e with identifier: GG82433
2026-03-27 10:55:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c37bc24-afa5-5762-a653-7e911a775a3e with identifier: GG82433 to the API
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:55:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:10:32Z',
 'fuel_type': 'petrol',
 'id': '4c37bc24-afa5-5762-a653-7e911a775a3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG82433',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 63556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-25',
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TSI Xcellence 4Drive',
 'transmission': 'automatic',
 'trim': 'Xcellence 4Drive',
 'year': 2019}
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG82433%27 HTTP/1.1" 200 None
2026-03-27 10:55:11 [auto1.de] INFO: Saving data for GG82433: {'auction_closing_time': 1774627832.0, 'created_time': 1773775570.087029, 'last_price_update_time': 1774608911.933871}
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG82433') HTTP/1.1" 204 0
2026-03-27 10:55:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: VP63344
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: JZ87403
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ87403%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for JZ87403: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: VY52982
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: YN46054
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN46054%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for YN46054: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: AK06166
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: UU08337
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU08337%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for UU08337: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: FP18966
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP18966%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for FP18966: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: GL43025
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL43025%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for GL43025: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: CN80835
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN80835%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for CN80835: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: EU09282
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU09282%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for EU09282: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: VL10469
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: FF06799
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF06799%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for FF06799: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: CW00084
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW00084%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for CW00084: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: AS45906
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: KZ13921
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ13921%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for KZ13921: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: BP08791
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP08791%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for BP08791: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: CT54176
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT54176%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for CT54176: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: PA85037
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: CY11153
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY11153%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for CY11153: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: CW66506
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW66506%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for CW66506: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: JU05593
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: WV76032
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV76032%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for WV76032: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: KE65935
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE65935%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for KE65935: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: NC53350
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: XW74990
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW74990%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for XW74990: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: HS33780
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS33780%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for HS33780: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: XZ96479
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ96479%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for XZ96479: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: RM28884
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM28884%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for RM28884: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: RB12464
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB12464%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for RB12464: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: JX47081
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: YJ97695
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ97695%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for YJ97695: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: XM44045
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: RX47334
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX47334%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for RX47334: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: NC69837
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: FC39269
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC39269%27 HTTP/1.1" 200 None
2026-03-27 10:55:12 [auto1.de] INFO: Scrape type for FC39269: 0
2026-03-27 10:55:12 [auto1.de] INFO: Found listing with ID: HV03375
2026-03-27 10:55:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:14 [auto1.de] INFO: Channel: 24h | Page: 79 | totalHits: 10607 | hits on page: 40
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: ND93415
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND93415%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for ND93415: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: NY96268
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: CK76126
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: VX68221
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX68221%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for VX68221: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: HP69948
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: GY65359
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY65359%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for GY65359: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: VE89968
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE89968%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for VE89968: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: DK27317
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK27317%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for DK27317: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: BD44154
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD44154%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for BD44154: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: VF08088
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF08088%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for VF08088: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: AL65001
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL65001%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for AL65001: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: PD14492
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: BG13362
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: UV62356
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: HK93024
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: LM09625
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: XR06922
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: UR69038
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR69038%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for UR69038: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: XH30445
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH30445%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for XH30445: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: YS42401
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: EF17850
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF17850%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for EF17850: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: DY22446
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY22446%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for DY22446: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: MS92452
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS92452%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for MS92452: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: XR77658
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR77658%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for XR77658: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: NW88180
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW88180%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for NW88180: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: NA24630
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA24630%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for NA24630: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: LE29079
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE29079%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for LE29079: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: EB61889
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: XZ40842
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: BS08057
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: DH10709
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: LH78507
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: NT96701
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT96701%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for NT96701: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: GJ43799
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ43799%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for GJ43799: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: XZ18734
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ18734%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for XZ18734: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: SN71189
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN71189%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for SN71189: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: GX30612
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX30612%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for GX30612: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: UH98030
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: JZ28158
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ28158%27 HTTP/1.1" 200 None
2026-03-27 10:55:14 [auto1.de] INFO: Scrape type for JZ28158: 0
2026-03-27 10:55:14 [auto1.de] INFO: Found listing with ID: DR41029
2026-03-27 10:55:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:20 [auto1.de] INFO: Channel: 24h | Page: 80 | totalHits: 10607 | hits on page: 40
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: TA29979
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: CB70018
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB70018%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for CB70018: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: GW29634
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: KX20208
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX20208%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for KX20208: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: BB99757
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: XS76137
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: LN11625
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: NE18994
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE18994%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for NE18994: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: DP19065
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP19065%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for DP19065: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: ET63606
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET63606%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for ET63606: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: DL07796
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: GS63097
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS63097%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for GS63097: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: XA47491
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA47491%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for XA47491: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: SN63221
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN63221%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for SN63221: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: KF09771
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: VX77411
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX77411%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for VX77411: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: BA08307
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA08307%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for BA08307: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: KP51039
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP51039%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for KP51039: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: UP49597
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: UL90641
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: BM72646
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM72646%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for BM72646: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: JW50887
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: CA47661
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA47661%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for CA47661: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: WJ34554
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: VL19259
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: HW48310
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: ZA98162
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA98162%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for ZA98162: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: GF58377
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF58377%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for GF58377: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: FJ58055
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: SP08042
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP08042%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for SP08042: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: FD89715
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD89715%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for FD89715: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: XU85928
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU85928%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for XU85928: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: NB97562
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB97562%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for NB97562: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: DE90025
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: HH17639
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: CN68552
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN68552%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for CN68552: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: US88233
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: ZX30565
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX30565%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for ZX30565: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: JZ81394
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ81394%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for JZ81394: 0
2026-03-27 10:55:20 [auto1.de] INFO: Found listing with ID: HY64229
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY64229%27 HTTP/1.1" 200 None
2026-03-27 10:55:20 [auto1.de] INFO: Scrape type for HY64229: 0
2026-03-27 10:55:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:22 [auto1.de] INFO: Channel: 24h | Page: 81 | totalHits: 10607 | hits on page: 40
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: UW78189
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: TF24039
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF24039%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for TF24039: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: PV23969
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: FS70562
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: UP64202
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: KK88906
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK88906%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for KK88906: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: EL83398
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: LW41921
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: JC86986
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: GR60102
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: FF33829
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF33829%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for FF33829: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: BR35600
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: ZX35425
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX35425%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for ZX35425: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: GK32978
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: LW97378
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW97378%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for LW97378: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: CL53186
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL53186%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for CL53186: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: MB60596
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB60596%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for MB60596: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: VD85153
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD85153%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for VD85153: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: DE21080
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: EB35688
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB35688%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for EB35688: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: NV67877
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV67877%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for NV67877: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: KU29056
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU29056%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for KU29056: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: MP12786
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP12786%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for MP12786: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: KH11075
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: JP35340
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP35340%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for JP35340: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: WA83866
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: UP60859
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: BB12781
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB12781%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for BB12781: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: MM67286
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: UW75870
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW75870%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for UW75870: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: GG54264
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG54264%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for GG54264: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: ZW75307
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: SS89558
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89558%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for SS89558: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: KM15369
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM15369%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for KM15369: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: UW30611
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW30611%27 HTTP/1.1" 200 None
2026-03-27 10:55:22 [auto1.de] INFO: Scrape type for UW30611: 0
2026-03-27 10:55:22 [auto1.de] INFO: Found listing with ID: UC37330
2026-03-27 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC37330%27 HTTP/1.1" 200 None
2026-03-27 10:55:23 [auto1.de] INFO: Scrape type for UC37330: 0
2026-03-27 10:55:23 [auto1.de] INFO: Found listing with ID: PF74105
2026-03-27 10:55:23 [auto1.de] INFO: Found listing with ID: PL06364
2026-03-27 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL06364%27 HTTP/1.1" 200 None
2026-03-27 10:55:23 [auto1.de] INFO: Scrape type for PL06364: 0
2026-03-27 10:55:23 [auto1.de] INFO: Found listing with ID: DB06170
2026-03-27 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB06170%27 HTTP/1.1" 200 None
2026-03-27 10:55:23 [auto1.de] INFO: Scrape type for DB06170: 0
2026-03-27 10:55:23 [auto1.de] INFO: Found listing with ID: JM01437
2026-03-27 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM01437%27 HTTP/1.1" 200 None
2026-03-27 10:55:23 [auto1.de] INFO: Scrape type for JM01437: 0
2026-03-27 10:55:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:26 [auto1.de] INFO: Channel: 24h | Page: 82 | totalHits: 10607 | hits on page: 40
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: VM51267
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: KP46159
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: BN99234
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: KB02253
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB02253%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for KB02253: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: SL85430
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL85430%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for SL85430: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: VZ02719
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: UH34281
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: MG42268
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: ZY51313
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: XS71103
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS71103%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for XS71103: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: PK12624
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK12624%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for PK12624: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: PY30467
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: DL85923
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: HV77843
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV77843%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for HV77843: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: EC31076
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC31076%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for EC31076: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: JN35186
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN35186%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for JN35186: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: BY14465
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY14465%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for BY14465: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: HJ19382
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ19382%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for HJ19382: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: UL37196
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: YT47833
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT47833%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for YT47833: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: ZU43867
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU43867%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for ZU43867: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: LB43526
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB43526%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for LB43526: 0
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: NM47140
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: NV12597
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: UZ83781
2026-03-27 10:55:26 [auto1.de] INFO: Found listing with ID: UZ71144
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ71144%27 HTTP/1.1" 200 None
2026-03-27 10:55:26 [auto1.de] INFO: Scrape type for UZ71144: 2
2026-03-27 10:55:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea0d1d43-0efa-5753-a5fc-f0382af0500e with identifier: UZ71144
2026-03-27 10:55:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea0d1d43-0efa-5753-a5fc-f0382af0500e with scrape type 2
2026-03-27 10:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea0d1d43-0efa-5753-a5fc-f0382af0500e with scrape type 2
2026-03-27 10:55:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea0d1d43-0efa-5753-a5fc-f0382af0500e, identifier: UZ71144
2026-03-27 10:55:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea0d1d43-0efa-5753-a5fc-f0382af0500e with identifier: UZ71144
2026-03-27 10:55:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea0d1d43-0efa-5753-a5fc-f0382af0500e with identifier: UZ71144
2026-03-27 10:55:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea0d1d43-0efa-5753-a5fc-f0382af0500e with identifier: UZ71144 to the API
2026-03-27 10:55:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:55:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:55:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:04:38Z',
 'fuel_type': 'diesel',
 'id': 'ea0d1d43-0efa-5753-a5fc-f0382af0500e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ71144',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 224687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-30',
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Vision",
 'transmission': 'manual',
 'trim': 'Vision',
 'year': 2012}
2026-03-27 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ71144%27 HTTP/1.1" 200 None
2026-03-27 10:55:27 [auto1.de] INFO: Saving data for UZ71144: {'auction_closing_time': 1774627478.0, 'created_time': 1773831472.727446, 'last_price_update_time': 1774608927.586513}
2026-03-27 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ71144') HTTP/1.1" 204 0
2026-03-27 10:55:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:27 [auto1.de] INFO: Found listing with ID: XK78841
2026-03-27 10:55:27 [auto1.de] INFO: Found listing with ID: BT98780
2026-03-27 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT98780%27 HTTP/1.1" 200 None
2026-03-27 10:55:27 [auto1.de] INFO: Scrape type for BT98780: 0
2026-03-27 10:55:27 [auto1.de] INFO: Found listing with ID: HP91668
2026-03-27 10:55:27 [auto1.de] INFO: Found listing with ID: VH10251
2026-03-27 10:55:27 [auto1.de] INFO: Found listing with ID: VN21885
2026-03-27 10:55:27 [auto1.de] INFO: Found listing with ID: RU16238
2026-03-27 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU16238%27 HTTP/1.1" 200 None
2026-03-27 10:55:27 [auto1.de] INFO: Scrape type for RU16238: 0
2026-03-27 10:55:27 [auto1.de] INFO: Found listing with ID: LG76747
2026-03-27 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG76747%27 HTTP/1.1" 200 None
2026-03-27 10:55:27 [auto1.de] INFO: Scrape type for LG76747: 0
2026-03-27 10:55:27 [auto1.de] INFO: Found listing with ID: SN96710
2026-03-27 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN96710%27 HTTP/1.1" 200 None
2026-03-27 10:55:27 [auto1.de] INFO: Scrape type for SN96710: 0
2026-03-27 10:55:27 [auto1.de] INFO: Found listing with ID: MW52698
2026-03-27 10:55:27 [auto1.de] INFO: Found listing with ID: XW80989
2026-03-27 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW80989%27 HTTP/1.1" 200 None
2026-03-27 10:55:27 [auto1.de] INFO: Scrape type for XW80989: 0
2026-03-27 10:55:27 [auto1.de] INFO: Found listing with ID: DP51933
2026-03-27 10:55:27 [auto1.de] INFO: Found listing with ID: NE71450
2026-03-27 10:55:27 [auto1.de] INFO: Found listing with ID: DN68550
2026-03-27 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN68550%27 HTTP/1.1" 200 None
2026-03-27 10:55:27 [auto1.de] INFO: Scrape type for DN68550: 0
2026-03-27 10:55:27 [auto1.de] INFO: Found listing with ID: YZ27957
2026-03-27 10:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:28 [auto1.de] INFO: Channel: 24h | Page: 83 | totalHits: 10608 | hits on page: 40
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: YZ27957
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: MP81414
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP81414%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for MP81414: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: SL19665
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: CK18909
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: PM54102
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: VH89882
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: RP66796
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: ER58682
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER58682%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for ER58682: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: AP83246
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: EE99492
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE99492%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for EE99492: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: JS30913
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS30913%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for JS30913: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: RK40243
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: VX80468
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX80468%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for VX80468: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: FK92289
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK92289%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for FK92289: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: GG45079
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: NA10756
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: VR98222
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR98222%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for VR98222: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: JU00246
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: XS81837
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS81837%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for XS81837: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: KZ72468
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: NM87427
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM87427%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for NM87427: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: WR71249
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: BH50029
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: FT76728
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT76728%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for FT76728: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: BN72510
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: XJ45397
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: NH88126
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: EJ76475
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: WM96321
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM96321%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for WM96321: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: LT23486
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT23486%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for LT23486: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: HU45094
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: UY63030
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY63030%27 HTTP/1.1" 200 None
2026-03-27 10:55:28 [auto1.de] INFO: Scrape type for UY63030: 0
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: HH92077
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: BJ03544
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: FY34771
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: BZ84414
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: SW03993
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: TD14056
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: AJ85429
2026-03-27 10:55:28 [auto1.de] INFO: Found listing with ID: BS13662
2026-03-27 10:55:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:29 [auto1.de] INFO: Channel: 24h | Page: 84 | totalHits: 10608 | hits on page: 40
2026-03-27 10:55:29 [auto1.de] INFO: Found listing with ID: WP39257
2026-03-27 10:55:29 [auto1.de] INFO: Found listing with ID: DC14061
2026-03-27 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC14061%27 HTTP/1.1" 200 None
2026-03-27 10:55:29 [auto1.de] INFO: Scrape type for DC14061: 0
2026-03-27 10:55:29 [auto1.de] INFO: Found listing with ID: DT89706
2026-03-27 10:55:29 [auto1.de] INFO: Found listing with ID: WG55926
2026-03-27 10:55:29 [auto1.de] INFO: Found listing with ID: SH18397
2026-03-27 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH18397%27 HTTP/1.1" 200 None
2026-03-27 10:55:29 [auto1.de] INFO: Scrape type for SH18397: 0
2026-03-27 10:55:29 [auto1.de] INFO: Found listing with ID: EZ14910
2026-03-27 10:55:29 [auto1.de] INFO: Found listing with ID: GM32610
2026-03-27 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM32610%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for GM32610: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: VG72700
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: UU48969
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU48969%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for UU48969: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: DS93671
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: GK69346
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK69346%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for GK69346: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: PH69268
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH69268%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for PH69268: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: PN40620
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: UT50255
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT50255%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for UT50255: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: CT53281
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT53281%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for CT53281: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: XG53445
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: NH41771
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH41771%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for NH41771: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: RT49576
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT49576%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for RT49576: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: RT03172
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: HR49435
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: TW05114
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: KT37297
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT37297%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for KT37297: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: JH74007
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH74007%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for JH74007: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: JE92990
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: VZ67143
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ67143%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for VZ67143: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: PG37499
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG37499%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for PG37499: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: LC46131
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC46131%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for LC46131: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: TH25711
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: BS13684
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS13684%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for BS13684: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: LY01980
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: ZT12374
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: BW18198
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW18198%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for BW18198: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: JL28573
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL28573%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for JL28573: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: WW69027
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW69027%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for WW69027: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: AY57867
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY57867%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for AY57867: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: RW07911
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW07911%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for RW07911: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: AD64899
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD64899%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for AD64899: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: HX41929
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX41929%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for HX41929: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: CF83908
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF83908%27 HTTP/1.1" 200 None
2026-03-27 10:55:30 [auto1.de] INFO: Scrape type for CF83908: 0
2026-03-27 10:55:30 [auto1.de] INFO: Found listing with ID: MJ74950
2026-03-27 10:55:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:34 [auto1.de] INFO: Channel: 24h | Page: 85 | totalHits: 10608 | hits on page: 40
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: GN89276
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: CA74097
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: RG17194
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: DC85616
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC85616%27 HTTP/1.1" 200 None
2026-03-27 10:55:34 [auto1.de] INFO: Scrape type for DC85616: 0
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: FV21228
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV21228%27 HTTP/1.1" 200 None
2026-03-27 10:55:34 [auto1.de] INFO: Scrape type for FV21228: 0
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: MH03153
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: UH30780
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH30780%27 HTTP/1.1" 200 None
2026-03-27 10:55:34 [auto1.de] INFO: Scrape type for UH30780: 0
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: FH63171
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH63171%27 HTTP/1.1" 200 None
2026-03-27 10:55:34 [auto1.de] INFO: Scrape type for FH63171: 0
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: DK32557
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: HD75435
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD75435%27 HTTP/1.1" 200 None
2026-03-27 10:55:34 [auto1.de] INFO: Scrape type for HD75435: 0
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: FP44284
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: LM68672
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: JU02065
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: EZ97284
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: ZA82143
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: TC05555
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC05555%27 HTTP/1.1" 200 None
2026-03-27 10:55:34 [auto1.de] INFO: Scrape type for TC05555: 0
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: HH04688
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH04688%27 HTTP/1.1" 200 None
2026-03-27 10:55:34 [auto1.de] INFO: Scrape type for HH04688: 0
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: CH65115
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH65115%27 HTTP/1.1" 200 None
2026-03-27 10:55:34 [auto1.de] INFO: Scrape type for CH65115: 0
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: JK59865
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: VW33777
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW33777%27 HTTP/1.1" 200 None
2026-03-27 10:55:34 [auto1.de] INFO: Scrape type for VW33777: 0
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: TD64872
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD64872%27 HTTP/1.1" 200 None
2026-03-27 10:55:34 [auto1.de] INFO: Scrape type for TD64872: 0
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: JW60141
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: WF95671
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF95671%27 HTTP/1.1" 200 None
2026-03-27 10:55:34 [auto1.de] INFO: Scrape type for WF95671: 0
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: XY56978
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY56978%27 HTTP/1.1" 200 None
2026-03-27 10:55:34 [auto1.de] INFO: Scrape type for XY56978: 0
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: XN63500
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN63500%27 HTTP/1.1" 200 None
2026-03-27 10:55:34 [auto1.de] INFO: Scrape type for XN63500: 0
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: UE16674
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE16674%27 HTTP/1.1" 200 None
2026-03-27 10:55:34 [auto1.de] INFO: Scrape type for UE16674: 0
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: BZ98792
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ98792%27 HTTP/1.1" 200 None
2026-03-27 10:55:34 [auto1.de] INFO: Scrape type for BZ98792: 0
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: GZ87312
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: DK08351
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK08351%27 HTTP/1.1" 200 None
2026-03-27 10:55:34 [auto1.de] INFO: Scrape type for DK08351: 0
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: PV22215
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: ST72008
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: LS52090
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: UF78071
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF78071%27 HTTP/1.1" 200 None
2026-03-27 10:55:34 [auto1.de] INFO: Scrape type for UF78071: 0
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: JR94106
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: YT76473
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT76473%27 HTTP/1.1" 200 None
2026-03-27 10:55:34 [auto1.de] INFO: Scrape type for YT76473: 0
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: GE94573
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: MJ50234
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ50234%27 HTTP/1.1" 200 None
2026-03-27 10:55:34 [auto1.de] INFO: Scrape type for MJ50234: 0
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: TE22896
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE22896%27 HTTP/1.1" 200 None
2026-03-27 10:55:34 [auto1.de] INFO: Scrape type for TE22896: 0
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: AZ18369
2026-03-27 10:55:34 [auto1.de] INFO: Found listing with ID: UA53606
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA53606%27 HTTP/1.1" 200 None
2026-03-27 10:55:34 [auto1.de] INFO: Scrape type for UA53606: 0
2026-03-27 10:55:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:36 [auto1.de] INFO: Channel: 24h | Page: 86 | totalHits: 10608 | hits on page: 40
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: XW12257
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW12257%27 HTTP/1.1" 200 None
2026-03-27 10:55:36 [auto1.de] INFO: Scrape type for XW12257: 0
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: TE29693
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE29693%27 HTTP/1.1" 200 None
2026-03-27 10:55:36 [auto1.de] INFO: Scrape type for TE29693: 0
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: AN64049
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN64049%27 HTTP/1.1" 200 None
2026-03-27 10:55:36 [auto1.de] INFO: Scrape type for AN64049: 0
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: VA39531
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA39531%27 HTTP/1.1" 200 None
2026-03-27 10:55:36 [auto1.de] INFO: Scrape type for VA39531: 0
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: HH81200
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: FC24298
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: LH53286
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: RK41317
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: FL42778
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL42778%27 HTTP/1.1" 200 None
2026-03-27 10:55:36 [auto1.de] INFO: Scrape type for FL42778: 0
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: NA97113
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: VZ74394
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ74394%27 HTTP/1.1" 200 None
2026-03-27 10:55:36 [auto1.de] INFO: Scrape type for VZ74394: 0
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: GH78103
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: ZN11233
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN11233%27 HTTP/1.1" 200 None
2026-03-27 10:55:36 [auto1.de] INFO: Scrape type for ZN11233: 0
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: YF83058
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: XM80704
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: MR91997
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR91997%27 HTTP/1.1" 200 None
2026-03-27 10:55:36 [auto1.de] INFO: Scrape type for MR91997: 0
2026-03-27 10:55:36 [auto1.de] INFO: Found listing with ID: HN30434
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN30434%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for HN30434: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: CC28628
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC28628%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for CC28628: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: TM93918
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: KJ62910
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ62910%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for KJ62910: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: CD38469
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: KK55590
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: TH96479
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH96479%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for TH96479: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: GU24584
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU24584%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for GU24584: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: NU16694
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: VT10952
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: RV28657
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV28657%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for RV28657: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: GT95785
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: MC75281
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC75281%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for MC75281: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: PC84380
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: SH57495
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: VS18201
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: NU12300
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU12300%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for NU12300: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: RT59975
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT59975%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for RT59975: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: TV93253
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV93253%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for TV93253: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: VU31960
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU31960%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for VU31960: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: FD35505
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: HS70377
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS70377%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for HS70377: 0
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: UJ62660
2026-03-27 10:55:37 [auto1.de] INFO: Found listing with ID: DE17947
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE17947%27 HTTP/1.1" 200 None
2026-03-27 10:55:37 [auto1.de] INFO: Scrape type for DE17947: 0
2026-03-27 10:55:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:38 [auto1.de] INFO: Channel: 24h | Page: 87 | totalHits: 10609 | hits on page: 40
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: DE17947
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE17947%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for DE17947: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: RT19739
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: KX72487
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX72487%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for KX72487: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: HJ74961
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: VH09784
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH09784%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for VH09784: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: HP55634
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP55634%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for HP55634: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: YM05661
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM05661%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for YM05661: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: XX85563
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX85563%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for XX85563: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: EJ36871
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: NH92657
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH92657%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for NH92657: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: NX06422
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX06422%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for NX06422: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: CA37510
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: PX20258
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: KM05428
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM05428%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for KM05428: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: RF30152
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: JM79727
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM79727%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for JM79727: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: YS92779
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS92779%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for YS92779: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: TA53494
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: BZ20648
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: UZ92171
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ92171%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for UZ92171: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: FH49394
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: AU78717
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU78717%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for AU78717: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: PB69477
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB69477%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for PB69477: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: KM15379
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM15379%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for KM15379: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: SX71911
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: EZ87293
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: CP02009
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: RP29809
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP29809%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for RP29809: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: XW94362
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: WT89497
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT89497%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for WT89497: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: JJ50911
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ50911%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for JJ50911: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: LE20823
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE20823%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for LE20823: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: GJ64200
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: RS75435
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS75435%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for RS75435: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: HC38984
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC38984%27 HTTP/1.1" 200 None
2026-03-27 10:55:38 [auto1.de] INFO: Scrape type for HC38984: 0
2026-03-27 10:55:38 [auto1.de] INFO: Found listing with ID: US36140
2026-03-27 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US36140%27 HTTP/1.1" 200 None
2026-03-27 10:55:39 [auto1.de] INFO: Scrape type for US36140: 0
2026-03-27 10:55:39 [auto1.de] INFO: Found listing with ID: NJ80920
2026-03-27 10:55:39 [auto1.de] INFO: Found listing with ID: FE77695
2026-03-27 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE77695%27 HTTP/1.1" 200 None
2026-03-27 10:55:39 [auto1.de] INFO: Scrape type for FE77695: 0
2026-03-27 10:55:39 [auto1.de] INFO: Found listing with ID: FR35172
2026-03-27 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR35172%27 HTTP/1.1" 200 None
2026-03-27 10:55:39 [auto1.de] INFO: Scrape type for FR35172: 0
2026-03-27 10:55:39 [auto1.de] INFO: Found listing with ID: SG67731
2026-03-27 10:55:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:40 [auto1.de] INFO: Channel: 24h | Page: 88 | totalHits: 10610 | hits on page: 40
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: SG67731
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: LU60211
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: CY36598
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY36598%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for CY36598: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: YV86532
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV86532%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for YV86532: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: SB08616
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: UK40619
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: SD21155
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: FS10993
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS10993%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for FS10993: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: SX08307
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: MK57941
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: MS62719
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS62719%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for MS62719: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: CX66529
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX66529%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for CX66529: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: VZ15910
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ15910%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for VZ15910: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: VJ83495
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: XA31743
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: ZR85378
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: DB03998
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: KP55286
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: HH23923
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH23923%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for HH23923: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: LW67845
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: HN93513
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: VK27409
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: YD08284
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD08284%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for YD08284: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: FG36016
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG36016%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for FG36016: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: DE61416
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: LE56250
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE56250%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for LE56250: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: PR07624
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR07624%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for PR07624: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: XR86863
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR86863%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for XR86863: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: ZP60201
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP60201%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for ZP60201: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: PP99150
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: EG52009
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG52009%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for EG52009: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: GF27594
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: TT76680
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: KX39833
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX39833%27 HTTP/1.1" 200 None
2026-03-27 10:55:40 [auto1.de] INFO: Scrape type for KX39833: 0
2026-03-27 10:55:40 [auto1.de] INFO: Found listing with ID: RU30790
2026-03-27 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU30790%27 HTTP/1.1" 200 None
2026-03-27 10:55:41 [auto1.de] INFO: Scrape type for RU30790: 0
2026-03-27 10:55:41 [auto1.de] INFO: Found listing with ID: TD83761
2026-03-27 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD83761%27 HTTP/1.1" 200 None
2026-03-27 10:55:41 [auto1.de] INFO: Scrape type for TD83761: 0
2026-03-27 10:55:41 [auto1.de] INFO: Found listing with ID: VV40094
2026-03-27 10:55:41 [auto1.de] INFO: Found listing with ID: FK93420
2026-03-27 10:55:41 [auto1.de] INFO: Found listing with ID: XG52732
2026-03-27 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG52732%27 HTTP/1.1" 200 None
2026-03-27 10:55:41 [auto1.de] INFO: Scrape type for XG52732: 0
2026-03-27 10:55:41 [auto1.de] INFO: Found listing with ID: SU06848
2026-03-27 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU06848%27 HTTP/1.1" 200 None
2026-03-27 10:55:41 [auto1.de] INFO: Scrape type for SU06848: 0
2026-03-27 10:55:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:42 [auto1.de] INFO: Channel: 24h | Page: 89 | totalHits: 10610 | hits on page: 40
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: EY58894
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: XA86799
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: YU64534
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: LT62829
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT62829%27 HTTP/1.1" 200 None
2026-03-27 10:55:42 [auto1.de] INFO: Scrape type for LT62829: 0
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: SV14192
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: JC97573
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC97573%27 HTTP/1.1" 200 None
2026-03-27 10:55:42 [auto1.de] INFO: Scrape type for JC97573: 0
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: VH37983
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH37983%27 HTTP/1.1" 200 None
2026-03-27 10:55:42 [auto1.de] INFO: Scrape type for VH37983: 0
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: BB82002
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: DT42327
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: GJ48427
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ48427%27 HTTP/1.1" 200 None
2026-03-27 10:55:42 [auto1.de] INFO: Scrape type for GJ48427: 0
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: UB38135
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB38135%27 HTTP/1.1" 200 None
2026-03-27 10:55:42 [auto1.de] INFO: Scrape type for UB38135: 0
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: RP40821
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: CW38827
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW38827%27 HTTP/1.1" 200 None
2026-03-27 10:55:42 [auto1.de] INFO: Scrape type for CW38827: 0
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: YL83790
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: JY72572
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: KX36775
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX36775%27 HTTP/1.1" 200 None
2026-03-27 10:55:42 [auto1.de] INFO: Scrape type for KX36775: 0
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: EZ29207
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: KL17270
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL17270%27 HTTP/1.1" 200 None
2026-03-27 10:55:42 [auto1.de] INFO: Scrape type for KL17270: 0
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: XV69460
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: CT69735
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT69735%27 HTTP/1.1" 200 None
2026-03-27 10:55:42 [auto1.de] INFO: Scrape type for CT69735: 0
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: KU77644
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: PE12481
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: FJ33812
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: XE20875
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE20875%27 HTTP/1.1" 200 None
2026-03-27 10:55:42 [auto1.de] INFO: Scrape type for XE20875: 0
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: PT35689
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: GL98026
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL98026%27 HTTP/1.1" 200 None
2026-03-27 10:55:42 [auto1.de] INFO: Scrape type for GL98026: 0
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: DD53059
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: MJ25721
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ25721%27 HTTP/1.1" 200 None
2026-03-27 10:55:42 [auto1.de] INFO: Scrape type for MJ25721: 0
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: XV72544
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: PE93085
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: AW77677
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: MY91371
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY91371%27 HTTP/1.1" 200 None
2026-03-27 10:55:42 [auto1.de] INFO: Scrape type for MY91371: 0
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: FB21783
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: SN87429
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN87429%27 HTTP/1.1" 200 None
2026-03-27 10:55:42 [auto1.de] INFO: Scrape type for SN87429: 0
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: BJ20331
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ20331%27 HTTP/1.1" 200 None
2026-03-27 10:55:42 [auto1.de] INFO: Scrape type for BJ20331: 0
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: HG52162
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: GE17394
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE17394%27 HTTP/1.1" 200 None
2026-03-27 10:55:42 [auto1.de] INFO: Scrape type for GE17394: 0
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: JU40409
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: ES43903
2026-03-27 10:55:42 [auto1.de] INFO: Found listing with ID: XU29979
2026-03-27 10:55:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:43 [auto1.de] INFO: Channel: 24h | Page: 90 | totalHits: 10610 | hits on page: 40
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: LN43848
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: BY57485
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY57485%27 HTTP/1.1" 200 None
2026-03-27 10:55:43 [auto1.de] INFO: Scrape type for BY57485: 0
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: MW80491
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: MV25141
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: CE86831
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: BD30878
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD30878%27 HTTP/1.1" 200 None
2026-03-27 10:55:43 [auto1.de] INFO: Scrape type for BD30878: 0
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: GL51026
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL51026%27 HTTP/1.1" 200 None
2026-03-27 10:55:43 [auto1.de] INFO: Scrape type for GL51026: 0
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: WH88293
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH88293%27 HTTP/1.1" 200 None
2026-03-27 10:55:43 [auto1.de] INFO: Scrape type for WH88293: 0
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: NU50542
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU50542%27 HTTP/1.1" 200 None
2026-03-27 10:55:43 [auto1.de] INFO: Scrape type for NU50542: 0
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: CD66904
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: VB29019
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: CW02202
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW02202%27 HTTP/1.1" 200 None
2026-03-27 10:55:43 [auto1.de] INFO: Scrape type for CW02202: 0
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: LM70179
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM70179%27 HTTP/1.1" 200 None
2026-03-27 10:55:43 [auto1.de] INFO: Scrape type for LM70179: 0
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: HF92770
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: EF20977
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: ET24153
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: XJ15035
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: WM94615
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM94615%27 HTTP/1.1" 200 None
2026-03-27 10:55:43 [auto1.de] INFO: Scrape type for WM94615: 0
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: GE49775
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE49775%27 HTTP/1.1" 200 None
2026-03-27 10:55:43 [auto1.de] INFO: Scrape type for GE49775: 0
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: TS14604
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: LG10256
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: WR08965
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: UL15630
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: DY50654
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: DM75800
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM75800%27 HTTP/1.1" 200 None
2026-03-27 10:55:43 [auto1.de] INFO: Scrape type for DM75800: 0
2026-03-27 10:55:43 [auto1.de] INFO: Found listing with ID: RZ14311
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ14311%27 HTTP/1.1" 200 None
2026-03-27 10:55:43 [auto1.de] INFO: Scrape type for RZ14311: 2
2026-03-27 10:55:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca3d5718-933b-5fe6-9bc3-2b748e4b0093 with identifier: RZ14311
2026-03-27 10:55:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca3d5718-933b-5fe6-9bc3-2b748e4b0093 with scrape type 2
2026-03-27 10:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca3d5718-933b-5fe6-9bc3-2b748e4b0093 with scrape type 2
2026-03-27 10:55:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca3d5718-933b-5fe6-9bc3-2b748e4b0093, identifier: RZ14311
2026-03-27 10:55:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca3d5718-933b-5fe6-9bc3-2b748e4b0093 with identifier: RZ14311
2026-03-27 10:55:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca3d5718-933b-5fe6-9bc3-2b748e4b0093 with identifier: RZ14311
2026-03-27 10:55:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca3d5718-933b-5fe6-9bc3-2b748e4b0093 with identifier: RZ14311 to the API
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:55:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:08:51Z',
 'fuel_type': 'diesel',
 'id': 'ca3d5718-933b-5fe6-9bc3-2b748e4b0093',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ14311',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Kombi',
 'odometer': 484880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-18',
 'seller_name': None,
 'title': 'Volkswagen T5 Kombi 2.0 TDI lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2015}
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ14311%27 HTTP/1.1" 200 None
2026-03-27 10:55:44 [auto1.de] INFO: Saving data for RZ14311: {'auction_closing_time': 1774627731.0, 'created_time': 1773224131.491213, 'last_price_update_time': 1774608944.708418}
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ14311') HTTP/1.1" 204 0
2026-03-27 10:55:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:44 [auto1.de] INFO: Found listing with ID: YS25721
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS25721%27 HTTP/1.1" 200 None
2026-03-27 10:55:44 [auto1.de] INFO: Scrape type for YS25721: 0
2026-03-27 10:55:44 [auto1.de] INFO: Found listing with ID: SX58365
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX58365%27 HTTP/1.1" 200 None
2026-03-27 10:55:44 [auto1.de] INFO: Scrape type for SX58365: 0
2026-03-27 10:55:44 [auto1.de] INFO: Found listing with ID: SW02532
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW02532%27 HTTP/1.1" 200 None
2026-03-27 10:55:44 [auto1.de] INFO: Scrape type for SW02532: 0
2026-03-27 10:55:44 [auto1.de] INFO: Found listing with ID: SR56375
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR56375%27 HTTP/1.1" 200 None
2026-03-27 10:55:44 [auto1.de] INFO: Scrape type for SR56375: 0
2026-03-27 10:55:44 [auto1.de] INFO: Found listing with ID: SS40431
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS40431%27 HTTP/1.1" 200 None
2026-03-27 10:55:44 [auto1.de] INFO: Scrape type for SS40431: 0
2026-03-27 10:55:44 [auto1.de] INFO: Found listing with ID: LP13779
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP13779%27 HTTP/1.1" 200 None
2026-03-27 10:55:44 [auto1.de] INFO: Scrape type for LP13779: 0
2026-03-27 10:55:44 [auto1.de] INFO: Found listing with ID: PU27308
2026-03-27 10:55:44 [auto1.de] INFO: Found listing with ID: JT68679
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT68679%27 HTTP/1.1" 200 None
2026-03-27 10:55:44 [auto1.de] INFO: Scrape type for JT68679: 0
2026-03-27 10:55:44 [auto1.de] INFO: Found listing with ID: UU45926
2026-03-27 10:55:44 [auto1.de] INFO: Found listing with ID: XZ50534
2026-03-27 10:55:44 [auto1.de] INFO: Found listing with ID: HK08818
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK08818%27 HTTP/1.1" 200 None
2026-03-27 10:55:44 [auto1.de] INFO: Scrape type for HK08818: 0
2026-03-27 10:55:44 [auto1.de] INFO: Found listing with ID: GZ10091
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ10091%27 HTTP/1.1" 200 None
2026-03-27 10:55:44 [auto1.de] INFO: Scrape type for GZ10091: 0
2026-03-27 10:55:44 [auto1.de] INFO: Found listing with ID: KB41878
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB41878%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for KB41878: 0
2026-03-27 10:55:45 [auto1.de] INFO: Found listing with ID: XH94103
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH94103%27 HTTP/1.1" 200 None
2026-03-27 10:55:45 [auto1.de] INFO: Scrape type for XH94103: 0
2026-03-27 10:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:46 [auto1.de] INFO: Channel: 24h | Page: 91 | totalHits: 10610 | hits on page: 40
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: TP43988
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP43988%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for TP43988: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: RT32909
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: ZL07849
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: JW06785
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: GB62942
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB62942%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for GB62942: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: VH13590
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: LR13635
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: BF07223
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: XZ07034
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: LD96580
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD96580%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for LD96580: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: NF53472
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF53472%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for NF53472: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: WF14643
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF14643%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for WF14643: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: UF29141
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: PF91020
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: LU81602
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU81602%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for LU81602: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: TR50455
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR50455%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for TR50455: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: WS70576
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: DX28979
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX28979%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for DX28979: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: JJ72378
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ72378%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for JJ72378: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: TS72146
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS72146%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for TS72146: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: BZ13551
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: FY91209
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91209%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for FY91209: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: WR85565
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR85565%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for WR85565: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: ZL86875
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL86875%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for ZL86875: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: NE29157
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE29157%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for NE29157: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: DL36324
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: DK33868
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: NP60172
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP60172%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for NP60172: 0
2026-03-27 10:55:46 [auto1.de] INFO: Found listing with ID: NL79092
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL79092%27 HTTP/1.1" 200 None
2026-03-27 10:55:46 [auto1.de] INFO: Scrape type for NL79092: 2
2026-03-27 10:55:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 327269be-7fa3-5dd5-8f07-4df4ac8d8d23 with identifier: NL79092
2026-03-27 10:55:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 327269be-7fa3-5dd5-8f07-4df4ac8d8d23 with scrape type 2
2026-03-27 10:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 327269be-7fa3-5dd5-8f07-4df4ac8d8d23 with scrape type 2
2026-03-27 10:55:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 327269be-7fa3-5dd5-8f07-4df4ac8d8d23, identifier: NL79092
2026-03-27 10:55:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 327269be-7fa3-5dd5-8f07-4df4ac8d8d23 with identifier: NL79092
2026-03-27 10:55:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 327269be-7fa3-5dd5-8f07-4df4ac8d8d23 with identifier: NL79092
2026-03-27 10:55:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 327269be-7fa3-5dd5-8f07-4df4ac8d8d23 with identifier: NL79092 to the API
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:55:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:55:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-27T16:04:45Z',
 'fuel_type': 'petrol',
 'id': '327269be-7fa3-5dd5-8f07-4df4ac8d8d23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL79092',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 85803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-27',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL79092%27 HTTP/1.1" 200 None
2026-03-27 10:55:47 [auto1.de] INFO: Saving data for NL79092: {'auction_closing_time': 1774627485.0, 'created_time': 1773306300.124557, 'last_price_update_time': 1774608947.026325}
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL79092') HTTP/1.1" 204 0
2026-03-27 10:55:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: PZ85127
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: ZU35260
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: KJ21272
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: SA61100
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: PX70527
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX70527%27 HTTP/1.1" 200 None
2026-03-27 10:55:47 [auto1.de] INFO: Scrape type for PX70527: 0
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: GY70112
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: PM48725
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: RH52660
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH52660%27 HTTP/1.1" 200 None
2026-03-27 10:55:47 [auto1.de] INFO: Scrape type for RH52660: 0
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: HC45326
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC45326%27 HTTP/1.1" 200 None
2026-03-27 10:55:47 [auto1.de] INFO: Scrape type for HC45326: 0
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: GP28595
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP28595%27 HTTP/1.1" 200 None
2026-03-27 10:55:47 [auto1.de] INFO: Scrape type for GP28595: 0
2026-03-27 10:55:47 [auto1.de] INFO: Found listing with ID: LU02094
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU02094%27 HTTP/1.1" 200 None
2026-03-27 10:55:47 [auto1.de] INFO: Scrape type for LU02094: 0
2026-03-27 10:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:48 [auto1.de] INFO: Channel: 24h | Page: 92 | totalHits: 10610 | hits on page: 40
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: JL42140
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL42140%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for JL42140: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: NG39570
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: JF05808
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF05808%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for JF05808: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: HS50383
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS50383%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for HS50383: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: CY33592
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: ZX76617
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX76617%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for ZX76617: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: RT10387
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT10387%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for RT10387: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: FN85811
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN85811%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for FN85811: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: WR65399
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR65399%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for WR65399: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: XP62941
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP62941%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for XP62941: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: UZ78249
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: SC34211
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: ME08351
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME08351%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for ME08351: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: AE27507
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE27507%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for AE27507: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: RK36338
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK36338%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for RK36338: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: UE71906
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: WP33305
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: VE41227
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: MU10500
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU10500%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for MU10500: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: HF62089
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF62089%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for HF62089: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: TW27373
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW27373%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for TW27373: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: HD53184
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD53184%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for HD53184: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: RX22945
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX22945%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for RX22945: 0
2026-03-27 10:55:48 [auto1.de] INFO: Found listing with ID: CP46186
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP46186%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Scrape type for CP46186: 2
2026-03-27 10:55:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7021150-b9e7-5875-9700-da99a7eda542 with identifier: CP46186
2026-03-27 10:55:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7021150-b9e7-5875-9700-da99a7eda542 with scrape type 2
2026-03-27 10:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7021150-b9e7-5875-9700-da99a7eda542 with scrape type 2
2026-03-27 10:55:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7021150-b9e7-5875-9700-da99a7eda542, identifier: CP46186
2026-03-27 10:55:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7021150-b9e7-5875-9700-da99a7eda542 with identifier: CP46186
2026-03-27 10:55:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7021150-b9e7-5875-9700-da99a7eda542 with identifier: CP46186
2026-03-27 10:55:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7021150-b9e7-5875-9700-da99a7eda542 with identifier: CP46186 to the API
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:55:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:58:55Z',
 'fuel_type': 'diesel',
 'id': 'b7021150-b9e7-5875-9700-da99a7eda542',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP46186',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 100034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-06',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP46186%27 HTTP/1.1" 200 None
2026-03-27 10:55:48 [auto1.de] INFO: Saving data for CP46186: {'auction_closing_time': 1774630735.0, 'created_time': 1773383816.941631, 'last_price_update_time': 1774608948.989887}
2026-03-27 10:55:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP46186') HTTP/1.1" 204 0
2026-03-27 10:55:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:49 [auto1.de] INFO: Found listing with ID: FT74133
2026-03-27 10:55:49 [auto1.de] INFO: Found listing with ID: WJ75594
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ75594%27 HTTP/1.1" 200 None
2026-03-27 10:55:49 [auto1.de] INFO: Scrape type for WJ75594: 0
2026-03-27 10:55:49 [auto1.de] INFO: Found listing with ID: MM40978
2026-03-27 10:55:49 [auto1.de] INFO: Found listing with ID: TR81218
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR81218%27 HTTP/1.1" 200 None
2026-03-27 10:55:49 [auto1.de] INFO: Scrape type for TR81218: 0
2026-03-27 10:55:49 [auto1.de] INFO: Found listing with ID: JV02966
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV02966%27 HTTP/1.1" 200 None
2026-03-27 10:55:49 [auto1.de] INFO: Scrape type for JV02966: 0
2026-03-27 10:55:49 [auto1.de] INFO: Found listing with ID: KA31515
2026-03-27 10:55:49 [auto1.de] INFO: Found listing with ID: NS68918
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS68918%27 HTTP/1.1" 200 None
2026-03-27 10:55:49 [auto1.de] INFO: Scrape type for NS68918: 0
2026-03-27 10:55:49 [auto1.de] INFO: Found listing with ID: KF01282
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF01282%27 HTTP/1.1" 200 None
2026-03-27 10:55:49 [auto1.de] INFO: Scrape type for KF01282: 0
2026-03-27 10:55:49 [auto1.de] INFO: Found listing with ID: VL29200
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL29200%27 HTTP/1.1" 200 None
2026-03-27 10:55:49 [auto1.de] INFO: Scrape type for VL29200: 0
2026-03-27 10:55:49 [auto1.de] INFO: Found listing with ID: JN99222
2026-03-27 10:55:49 [auto1.de] INFO: Found listing with ID: YE13468
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE13468%27 HTTP/1.1" 200 None
2026-03-27 10:55:49 [auto1.de] INFO: Scrape type for YE13468: 0
2026-03-27 10:55:49 [auto1.de] INFO: Found listing with ID: RG64089
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG64089%27 HTTP/1.1" 200 None
2026-03-27 10:55:49 [auto1.de] INFO: Scrape type for RG64089: 0
2026-03-27 10:55:49 [auto1.de] INFO: Found listing with ID: ZR88631
2026-03-27 10:55:49 [auto1.de] INFO: Found listing with ID: VG76144
2026-03-27 10:55:49 [auto1.de] INFO: Found listing with ID: SP71936
2026-03-27 10:55:49 [auto1.de] INFO: Found listing with ID: AJ07817
2026-03-27 10:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:50 [auto1.de] INFO: Channel: 24h | Page: 93 | totalHits: 10610 | hits on page: 40
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: KD09526
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: WB48893
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: KS41685
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS41685%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for KS41685: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: LD74655
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: XN23462
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN23462%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for XN23462: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: WW69328
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: EW37624
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: XB82791
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB82791%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for XB82791: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: CX89908
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX89908%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for CX89908: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: MC16369
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: FP76124
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP76124%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for FP76124: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: EA51834
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA51834%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for EA51834: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: KZ67688
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: GZ14972
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ14972%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for GZ14972: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: KX50009
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX50009%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for KX50009: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: FC82550
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC82550%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for FC82550: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: TK97766
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK97766%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for TK97766: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: LV55762
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55762%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for LV55762: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: WK00710
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: GK36833
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK36833%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for GK36833: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: KE58425
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: LW40462
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: EB82059
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: CZ24918
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ24918%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for CZ24918: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: SG45173
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: DR25105
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: HH83846
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: KY77386
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY77386%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for KY77386: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: BV18724
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV18724%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for BV18724: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: FL34122
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL34122%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for FL34122: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: LC23112
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: YV33202
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV33202%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for YV33202: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: HP04846
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: VW14529
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW14529%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for VW14529: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: EU16436
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU16436%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for EU16436: 0
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: XM78612
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: HL37424
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: SV40404
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: LT67236
2026-03-27 10:55:50 [auto1.de] INFO: Found listing with ID: GC35405
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC35405%27 HTTP/1.1" 200 None
2026-03-27 10:55:50 [auto1.de] INFO: Scrape type for GC35405: 0
2026-03-27 10:55:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:51 [auto1.de] INFO: Channel: 24h | Page: 94 | totalHits: 10610 | hits on page: 40
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: PC42250
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC42250%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for PC42250: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: YA96721
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: JW69458
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: GT39794
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: LB77088
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB77088%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for LB77088: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: CW58984
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW58984%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for CW58984: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: LC10044
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: LW16241
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: NP02044
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: CA83659
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: WP19217
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP19217%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for WP19217: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: DL24086
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: LR55805
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: CR26660
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: JY21076
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY21076%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for JY21076: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: FD98026
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: TD00489
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: LT89325
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: TU60505
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: ZS42305
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS42305%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for ZS42305: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: ZX24460
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: XN03179
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN03179%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for XN03179: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: ZS93402
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS93402%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for ZS93402: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: SP79690
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP79690%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for SP79690: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: MV74977
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV74977%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for MV74977: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: AT89439
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT89439%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for AT89439: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: VH66319
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH66319%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for VH66319: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: ZM28041
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM28041%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for ZM28041: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: RW72684
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW72684%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for RW72684: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: HV23751
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: UP47374
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP47374%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for UP47374: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: JD69912
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: LA56471
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA56471%27 HTTP/1.1" 200 None
2026-03-27 10:55:51 [auto1.de] INFO: Scrape type for LA56471: 0
2026-03-27 10:55:51 [auto1.de] INFO: Found listing with ID: LA42525
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA42525%27 HTTP/1.1" 200 None
2026-03-27 10:55:52 [auto1.de] INFO: Scrape type for LA42525: 0
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: XT31458
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT31458%27 HTTP/1.1" 200 None
2026-03-27 10:55:52 [auto1.de] INFO: Scrape type for XT31458: 0
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: XN13180
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN13180%27 HTTP/1.1" 200 None
2026-03-27 10:55:52 [auto1.de] INFO: Scrape type for XN13180: 0
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: JG32595
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: CS67228
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS67228%27 HTTP/1.1" 200 None
2026-03-27 10:55:52 [auto1.de] INFO: Scrape type for CS67228: 0
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: FT79731
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT79731%27 HTTP/1.1" 200 None
2026-03-27 10:55:52 [auto1.de] INFO: Scrape type for FT79731: 0
2026-03-27 10:55:52 [auto1.de] INFO: Found listing with ID: UJ67578
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ67578%27 HTTP/1.1" 200 None
2026-03-27 10:55:52 [auto1.de] INFO: Scrape type for UJ67578: 0
2026-03-27 10:55:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:53 [auto1.de] INFO: Channel: 24h | Page: 95 | totalHits: 10611 | hits on page: 40
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: UJ67578
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ67578%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for UJ67578: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: JX93926
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX93926%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for JX93926: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: SA54039
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA54039%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for SA54039: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: HC90704
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: LT86298
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT86298%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for LT86298: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: JR21052
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR21052%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for JR21052: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: ND90480
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: WE02156
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE02156%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for WE02156: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: ZC73485
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: EJ03111
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ03111%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for EJ03111: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: RD07943
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: BB60777
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB60777%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for BB60777: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: FE00822
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: LB18006
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: YW60751
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW60751%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for YW60751: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: EG62319
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG62319%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for EG62319: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: NM38216
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: FK66572
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK66572%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for FK66572: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: DP65043
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: SF52194
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF52194%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for SF52194: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: FP09706
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP09706%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for FP09706: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: JS17929
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: AX70348
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: DS28927
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: MZ87966
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: DG13652
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG13652%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for DG13652: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: TV32684
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV32684%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for TV32684: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: PH13713
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH13713%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for PH13713: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: SK87000
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: YF63409
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: JF93651
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF93651%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for JF93651: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: CG98534
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG98534%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for CG98534: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: WN08657
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN08657%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for WN08657: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: MM42561
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: VF27221
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: UN02057
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN02057%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for UN02057: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: BC87695
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: RS85257
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: AJ86686
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ86686%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for AJ86686: 0
2026-03-27 10:55:53 [auto1.de] INFO: Found listing with ID: TL57176
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL57176%27 HTTP/1.1" 200 None
2026-03-27 10:55:53 [auto1.de] INFO: Scrape type for TL57176: 0
2026-03-27 10:55:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:54 [auto1.de] INFO: Channel: 24h | Page: 96 | totalHits: 10611 | hits on page: 40
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: PJ24227
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: CF86336
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: MV92075
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92075%27 HTTP/1.1" 200 None
2026-03-27 10:55:54 [auto1.de] INFO: Scrape type for MV92075: 0
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: GS55217
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS55217%27 HTTP/1.1" 200 None
2026-03-27 10:55:54 [auto1.de] INFO: Scrape type for GS55217: 0
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: DP83839
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP83839%27 HTTP/1.1" 200 None
2026-03-27 10:55:54 [auto1.de] INFO: Scrape type for DP83839: 0
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: PB76080
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: GM94647
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM94647%27 HTTP/1.1" 200 None
2026-03-27 10:55:54 [auto1.de] INFO: Scrape type for GM94647: 0
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: RN54961
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: MJ40039
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: VH72223
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH72223%27 HTTP/1.1" 200 None
2026-03-27 10:55:54 [auto1.de] INFO: Scrape type for VH72223: 0
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: FE09717
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE09717%27 HTTP/1.1" 200 None
2026-03-27 10:55:54 [auto1.de] INFO: Scrape type for FE09717: 0
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: AF05877
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF05877%27 HTTP/1.1" 200 None
2026-03-27 10:55:54 [auto1.de] INFO: Scrape type for AF05877: 0
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: UH83431
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: AF34629
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: ZC11343
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC11343%27 HTTP/1.1" 200 None
2026-03-27 10:55:54 [auto1.de] INFO: Scrape type for ZC11343: 0
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: BD98911
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: RY65536
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: ZR59772
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR59772%27 HTTP/1.1" 200 None
2026-03-27 10:55:54 [auto1.de] INFO: Scrape type for ZR59772: 0
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: RB95028
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB95028%27 HTTP/1.1" 200 None
2026-03-27 10:55:54 [auto1.de] INFO: Scrape type for RB95028: 0
2026-03-27 10:55:54 [auto1.de] INFO: Found listing with ID: PX60465
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX60465%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for PX60465: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: DF85076
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF85076%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for DF85076: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: DN14078
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: ZF37712
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF37712%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for ZF37712: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: VC14600
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: MD51854
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD51854%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for MD51854: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: CD24326
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD24326%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for CD24326: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: UN26673
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN26673%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for UN26673: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: AC23286
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC23286%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for AC23286: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: RL19876
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: RY31078
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY31078%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for RY31078: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: GF50389
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: GR51738
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: SU91626
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU91626%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for SU91626: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: JB75617
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: WL37593
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL37593%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for WL37593: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: VW16070
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW16070%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for VW16070: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: LF22482
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF22482%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for LF22482: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: PF58362
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF58362%27 HTTP/1.1" 200 None
2026-03-27 10:55:55 [auto1.de] INFO: Scrape type for PF58362: 0
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: JJ69636
2026-03-27 10:55:55 [auto1.de] INFO: Found listing with ID: UN85261
2026-03-27 10:55:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:55:58 [auto1.de] INFO: Channel: 24h | Page: 97 | totalHits: 10612 | hits on page: 40
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: UN85261
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: GZ48275
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ48275%27 HTTP/1.1" 200 None
2026-03-27 10:55:58 [auto1.de] INFO: Scrape type for GZ48275: 0
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: BR69412
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: WA11944
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: TX92372
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: UD72248
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: HG99428
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: JK54144
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: CB34821
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB34821%27 HTTP/1.1" 200 None
2026-03-27 10:55:58 [auto1.de] INFO: Scrape type for CB34821: 0
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: YW93482
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW93482%27 HTTP/1.1" 200 None
2026-03-27 10:55:58 [auto1.de] INFO: Scrape type for YW93482: 0
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: UZ08397
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ08397%27 HTTP/1.1" 200 None
2026-03-27 10:55:58 [auto1.de] INFO: Scrape type for UZ08397: 0
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: XB91426
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: AV64350
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV64350%27 HTTP/1.1" 200 None
2026-03-27 10:55:58 [auto1.de] INFO: Scrape type for AV64350: 0
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: FT25652
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: EH05548
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH05548%27 HTTP/1.1" 200 None
2026-03-27 10:55:58 [auto1.de] INFO: Scrape type for EH05548: 0
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: VA45757
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA45757%27 HTTP/1.1" 200 None
2026-03-27 10:55:58 [auto1.de] INFO: Scrape type for VA45757: 0
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: SF40238
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: XT10731
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: XJ35206
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ35206%27 HTTP/1.1" 200 None
2026-03-27 10:55:58 [auto1.de] INFO: Scrape type for XJ35206: 0
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: LX91307
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: YT12471
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT12471%27 HTTP/1.1" 200 None
2026-03-27 10:55:58 [auto1.de] INFO: Scrape type for YT12471: 0
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: LS25990
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: GG55912
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: VT79224
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: KR27506
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: MP72809
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: PC02777
2026-03-27 10:55:58 [auto1.de] INFO: Found listing with ID: YG65894
2026-03-27 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG65894%27 HTTP/1.1" 200 None
2026-03-27 10:55:59 [auto1.de] INFO: Scrape type for YG65894: 0
2026-03-27 10:55:59 [auto1.de] INFO: Found listing with ID: EZ32213
2026-03-27 10:55:59 [auto1.de] INFO: Found listing with ID: LK97780
2026-03-27 10:55:59 [auto1.de] INFO: Found listing with ID: ZE55341
2026-03-27 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE55341%27 HTTP/1.1" 200 None
2026-03-27 10:55:59 [auto1.de] INFO: Scrape type for ZE55341: 0
2026-03-27 10:55:59 [auto1.de] INFO: Found listing with ID: DB67096
2026-03-27 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB67096%27 HTTP/1.1" 200 None
2026-03-27 10:55:59 [auto1.de] INFO: Scrape type for DB67096: 0
2026-03-27 10:55:59 [auto1.de] INFO: Found listing with ID: AF76763
2026-03-27 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF76763%27 HTTP/1.1" 200 None
2026-03-27 10:55:59 [auto1.de] INFO: Scrape type for AF76763: 0
2026-03-27 10:55:59 [auto1.de] INFO: Found listing with ID: PA64301
2026-03-27 10:55:59 [auto1.de] INFO: Found listing with ID: CC62895
2026-03-27 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC62895%27 HTTP/1.1" 200 None
2026-03-27 10:55:59 [auto1.de] INFO: Scrape type for CC62895: 0
2026-03-27 10:55:59 [auto1.de] INFO: Found listing with ID: ZJ50870
2026-03-27 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ50870%27 HTTP/1.1" 200 None
2026-03-27 10:55:59 [auto1.de] INFO: Scrape type for ZJ50870: 0
2026-03-27 10:55:59 [auto1.de] INFO: Found listing with ID: SX42326
2026-03-27 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:55:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX42326%27 HTTP/1.1" 200 None
2026-03-27 10:55:59 [auto1.de] INFO: Scrape type for SX42326: 0
2026-03-27 10:55:59 [auto1.de] INFO: Found listing with ID: MY20439
2026-03-27 10:55:59 [auto1.de] INFO: Found listing with ID: LR09206
2026-03-27 10:55:59 [auto1.de] INFO: Found listing with ID: TX14113
2026-03-27 10:55:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:00 [auto1.de] INFO: Channel: 24h | Page: 98 | totalHits: 10612 | hits on page: 40
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: VV39146
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: PY78932
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: FA30463
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA30463%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for FA30463: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: MG58953
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG58953%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for MG58953: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: WE17641
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE17641%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for WE17641: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: SC14784
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC14784%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for SC14784: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: KK91301
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK91301%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for KK91301: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: MC30685
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC30685%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for MC30685: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: VA67850
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA67850%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for VA67850: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: CS22727
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: UN03775
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN03775%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for UN03775: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: LF50472
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: UW28786
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: BY81005
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: LH15693
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH15693%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for LH15693: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: LT28781
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT28781%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for LT28781: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: TL45380
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: JU90963
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU90963%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for JU90963: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: PD39203
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD39203%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for PD39203: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: ZM65799
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM65799%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for ZM65799: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: EX94695
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX94695%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for EX94695: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: RA32966
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA32966%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for RA32966: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: RT31572
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT31572%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for RT31572: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: YM41627
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM41627%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for YM41627: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: HS18111
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS18111%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for HS18111: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: BV83779
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV83779%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for BV83779: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: UY83192
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY83192%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for UY83192: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: RU14902
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU14902%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for RU14902: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: JN14565
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: AV44518
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV44518%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for AV44518: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: WM77148
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: KK79364
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK79364%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for KK79364: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: LR25618
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR25618%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for LR25618: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: SD22522
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD22522%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for SD22522: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: DA75370
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: XH14540
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: DL58213
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL58213%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for DL58213: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: BV23508
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: PM35721
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM35721%27 HTTP/1.1" 200 None
2026-03-27 10:56:00 [auto1.de] INFO: Scrape type for PM35721: 0
2026-03-27 10:56:00 [auto1.de] INFO: Found listing with ID: VA30007
2026-03-27 10:56:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:01 [auto1.de] INFO: Channel: 24h | Page: 99 | totalHits: 10612 | hits on page: 40
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: AX05143
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: DF79170
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF79170%27 HTTP/1.1" 200 None
2026-03-27 10:56:01 [auto1.de] INFO: Scrape type for DF79170: 0
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: HY81815
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: UW85251
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: VP32594
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP32594%27 HTTP/1.1" 200 None
2026-03-27 10:56:01 [auto1.de] INFO: Scrape type for VP32594: 0
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: SL14548
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL14548%27 HTTP/1.1" 200 None
2026-03-27 10:56:01 [auto1.de] INFO: Scrape type for SL14548: 0
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: MK96538
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK96538%27 HTTP/1.1" 200 None
2026-03-27 10:56:01 [auto1.de] INFO: Scrape type for MK96538: 0
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: KW39556
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW39556%27 HTTP/1.1" 200 None
2026-03-27 10:56:01 [auto1.de] INFO: Scrape type for KW39556: 0
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: ZB43592
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: KL49615
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: LU77113
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: SJ63843
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ63843%27 HTTP/1.1" 200 None
2026-03-27 10:56:01 [auto1.de] INFO: Scrape type for SJ63843: 0
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: LY36951
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: HK32751
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK32751%27 HTTP/1.1" 200 None
2026-03-27 10:56:01 [auto1.de] INFO: Scrape type for HK32751: 0
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: WL63965
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: JV13466
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: XA64266
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: UU63359
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: MF18301
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: SL64623
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: KP66478
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: MK32086
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: ZS98527
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS98527%27 HTTP/1.1" 200 None
2026-03-27 10:56:01 [auto1.de] INFO: Scrape type for ZS98527: 0
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: US44067
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US44067%27 HTTP/1.1" 200 None
2026-03-27 10:56:01 [auto1.de] INFO: Scrape type for US44067: 0
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: UJ61618
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ61618%27 HTTP/1.1" 200 None
2026-03-27 10:56:01 [auto1.de] INFO: Scrape type for UJ61618: 0
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: RD59857
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD59857%27 HTTP/1.1" 200 None
2026-03-27 10:56:01 [auto1.de] INFO: Scrape type for RD59857: 0
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: RK01073
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: FA60427
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA60427%27 HTTP/1.1" 200 None
2026-03-27 10:56:01 [auto1.de] INFO: Scrape type for FA60427: 0
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: RN93387
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: AP69664
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP69664%27 HTTP/1.1" 200 None
2026-03-27 10:56:01 [auto1.de] INFO: Scrape type for AP69664: 0
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: ZT65198
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: FW94459
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: HD76685
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD76685%27 HTTP/1.1" 200 None
2026-03-27 10:56:01 [auto1.de] INFO: Scrape type for HD76685: 0
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: DD53809
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: GZ91789
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: RU36508
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU36508%27 HTTP/1.1" 200 None
2026-03-27 10:56:01 [auto1.de] INFO: Scrape type for RU36508: 0
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: VH36335
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: WR52929
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR52929%27 HTTP/1.1" 200 None
2026-03-27 10:56:01 [auto1.de] INFO: Scrape type for WR52929: 0
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: PH10965
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH10965%27 HTTP/1.1" 200 None
2026-03-27 10:56:01 [auto1.de] INFO: Scrape type for PH10965: 0
2026-03-27 10:56:01 [auto1.de] INFO: Found listing with ID: YK76722
2026-03-27 10:56:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:04 [auto1.de] INFO: Channel: 24h | Page: 100 | totalHits: 10612 | hits on page: 40
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: DP90284
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: DY66816
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY66816%27 HTTP/1.1" 200 None
2026-03-27 10:56:04 [auto1.de] INFO: Scrape type for DY66816: 0
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: TK31423
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: FG34327
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG34327%27 HTTP/1.1" 200 None
2026-03-27 10:56:04 [auto1.de] INFO: Scrape type for FG34327: 0
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: SB18455
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: DG64932
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: SL62735
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL62735%27 HTTP/1.1" 200 None
2026-03-27 10:56:04 [auto1.de] INFO: Scrape type for SL62735: 0
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: TK01358
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK01358%27 HTTP/1.1" 200 None
2026-03-27 10:56:04 [auto1.de] INFO: Scrape type for TK01358: 0
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: WV99125
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV99125%27 HTTP/1.1" 200 None
2026-03-27 10:56:04 [auto1.de] INFO: Scrape type for WV99125: 0
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: DE69503
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE69503%27 HTTP/1.1" 200 None
2026-03-27 10:56:04 [auto1.de] INFO: Scrape type for DE69503: 0
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: YF52750
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF52750%27 HTTP/1.1" 200 None
2026-03-27 10:56:04 [auto1.de] INFO: Scrape type for YF52750: 0
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: ZA03295
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA03295%27 HTTP/1.1" 200 None
2026-03-27 10:56:04 [auto1.de] INFO: Scrape type for ZA03295: 0
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: PT38806
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT38806%27 HTTP/1.1" 200 None
2026-03-27 10:56:04 [auto1.de] INFO: Scrape type for PT38806: 0
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: TD89084
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: RU39744
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU39744%27 HTTP/1.1" 200 None
2026-03-27 10:56:04 [auto1.de] INFO: Scrape type for RU39744: 0
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: CG10227
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: DV22671
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV22671%27 HTTP/1.1" 200 None
2026-03-27 10:56:04 [auto1.de] INFO: Scrape type for DV22671: 0
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: XB15869
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB15869%27 HTTP/1.1" 200 None
2026-03-27 10:56:04 [auto1.de] INFO: Scrape type for XB15869: 0
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: JY81419
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: RY13097
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY13097%27 HTTP/1.1" 200 None
2026-03-27 10:56:04 [auto1.de] INFO: Scrape type for RY13097: 0
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: SP61181
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP61181%27 HTTP/1.1" 200 None
2026-03-27 10:56:04 [auto1.de] INFO: Scrape type for SP61181: 0
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: ZF31779
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: RX71725
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX71725%27 HTTP/1.1" 200 None
2026-03-27 10:56:04 [auto1.de] INFO: Scrape type for RX71725: 0
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: RS99660
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: PN08038
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN08038%27 HTTP/1.1" 200 None
2026-03-27 10:56:04 [auto1.de] INFO: Scrape type for PN08038: 0
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: WT98226
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT98226%27 HTTP/1.1" 200 None
2026-03-27 10:56:04 [auto1.de] INFO: Scrape type for WT98226: 0
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: GE10245
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE10245%27 HTTP/1.1" 200 None
2026-03-27 10:56:04 [auto1.de] INFO: Scrape type for GE10245: 0
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: YP63801
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP63801%27 HTTP/1.1" 200 None
2026-03-27 10:56:04 [auto1.de] INFO: Scrape type for YP63801: 0
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: YS82849
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS82849%27 HTTP/1.1" 200 None
2026-03-27 10:56:04 [auto1.de] INFO: Scrape type for YS82849: 0
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: NP13175
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: KE84614
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: YL58691
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: XC28848
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: AF58203
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF58203%27 HTTP/1.1" 200 None
2026-03-27 10:56:04 [auto1.de] INFO: Scrape type for AF58203: 0
2026-03-27 10:56:04 [auto1.de] INFO: Found listing with ID: VJ93745
2026-03-27 10:56:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ93745%27 HTTP/1.1" 200 None
2026-03-27 10:56:05 [auto1.de] INFO: Scrape type for VJ93745: 0
2026-03-27 10:56:05 [auto1.de] INFO: Found listing with ID: SB26210
2026-03-27 10:56:05 [auto1.de] INFO: Found listing with ID: YH51203
2026-03-27 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH51203%27 HTTP/1.1" 200 None
2026-03-27 10:56:05 [auto1.de] INFO: Scrape type for YH51203: 0
2026-03-27 10:56:05 [auto1.de] INFO: Found listing with ID: KJ32312
2026-03-27 10:56:05 [auto1.de] INFO: Found listing with ID: KN86570
2026-03-27 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN86570%27 HTTP/1.1" 200 None
2026-03-27 10:56:05 [auto1.de] INFO: Scrape type for KN86570: 0
2026-03-27 10:56:05 [auto1.de] INFO: Found listing with ID: ZN33524
2026-03-27 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN33524%27 HTTP/1.1" 200 None
2026-03-27 10:56:05 [auto1.de] INFO: Scrape type for ZN33524: 0
2026-03-27 10:56:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:06 [auto1.de] INFO: Channel: 24h | Page: 101 | totalHits: 10612 | hits on page: 40
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: WZ62947
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: XB67892
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB67892%27 HTTP/1.1" 200 None
2026-03-27 10:56:06 [auto1.de] INFO: Scrape type for XB67892: 0
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: LN73232
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN73232%27 HTTP/1.1" 200 None
2026-03-27 10:56:06 [auto1.de] INFO: Scrape type for LN73232: 0
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: XH65764
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: XH17587
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH17587%27 HTTP/1.1" 200 None
2026-03-27 10:56:06 [auto1.de] INFO: Scrape type for XH17587: 0
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: RD87783
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD87783%27 HTTP/1.1" 200 None
2026-03-27 10:56:06 [auto1.de] INFO: Scrape type for RD87783: 0
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: RV54211
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: VV41845
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: UL81798
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL81798%27 HTTP/1.1" 200 None
2026-03-27 10:56:06 [auto1.de] INFO: Scrape type for UL81798: 0
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: VC48066
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: SD77911
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: LB09989
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: SS47444
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: VS41929
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: PF21402
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF21402%27 HTTP/1.1" 200 None
2026-03-27 10:56:06 [auto1.de] INFO: Scrape type for PF21402: 0
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: NK11674
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK11674%27 HTTP/1.1" 200 None
2026-03-27 10:56:06 [auto1.de] INFO: Scrape type for NK11674: 0
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: HK56220
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: JB65350
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: US16012
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: LM34765
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: UN20797
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN20797%27 HTTP/1.1" 200 None
2026-03-27 10:56:06 [auto1.de] INFO: Scrape type for UN20797: 0
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: TN32839
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN32839%27 HTTP/1.1" 200 None
2026-03-27 10:56:06 [auto1.de] INFO: Scrape type for TN32839: 0
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: BA95862
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA95862%27 HTTP/1.1" 200 None
2026-03-27 10:56:06 [auto1.de] INFO: Scrape type for BA95862: 0
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: JL97889
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: VC10379
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: AZ88481
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ88481%27 HTTP/1.1" 200 None
2026-03-27 10:56:06 [auto1.de] INFO: Scrape type for AZ88481: 0
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: BE00022
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE00022%27 HTTP/1.1" 200 None
2026-03-27 10:56:06 [auto1.de] INFO: Scrape type for BE00022: 0
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: XT48956
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: DC48587
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: MP50807
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP50807%27 HTTP/1.1" 200 None
2026-03-27 10:56:06 [auto1.de] INFO: Scrape type for MP50807: 0
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: JP66704
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: RX82529
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX82529%27 HTTP/1.1" 200 None
2026-03-27 10:56:06 [auto1.de] INFO: Scrape type for RX82529: 0
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: BJ62941
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: MP85459
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP85459%27 HTTP/1.1" 200 None
2026-03-27 10:56:06 [auto1.de] INFO: Scrape type for MP85459: 0
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: HX10510
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX10510%27 HTTP/1.1" 200 None
2026-03-27 10:56:06 [auto1.de] INFO: Scrape type for HX10510: 0
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: SC69057
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC69057%27 HTTP/1.1" 200 None
2026-03-27 10:56:06 [auto1.de] INFO: Scrape type for SC69057: 0
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: TD14857
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: CC84922
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC84922%27 HTTP/1.1" 200 None
2026-03-27 10:56:06 [auto1.de] INFO: Scrape type for CC84922: 0
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: BF67305
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF67305%27 HTTP/1.1" 200 None
2026-03-27 10:56:06 [auto1.de] INFO: Scrape type for BF67305: 0
2026-03-27 10:56:06 [auto1.de] INFO: Found listing with ID: EN14758
2026-03-27 10:56:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:06 [scrapy.extensions.logstats] INFO: Crawled 569 pages (at 24 pages/min), scraped 899 items (at 5 items/min)
2026-03-27 10:56:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 10:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:14 [auto1.de] INFO: Channel: 24h | Page: 102 | totalHits: 10616 | hits on page: 40
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: TD14857
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: CC84922
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC84922%27 HTTP/1.1" 200 None
2026-03-27 10:56:14 [auto1.de] INFO: Scrape type for CC84922: 0
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: BF67305
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF67305%27 HTTP/1.1" 200 None
2026-03-27 10:56:14 [auto1.de] INFO: Scrape type for BF67305: 0
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: EN14758
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: EV47698
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: DC40385
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: RL08857
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: RU20200
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: MA62044
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: DS40784
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS40784%27 HTTP/1.1" 200 None
2026-03-27 10:56:14 [auto1.de] INFO: Scrape type for DS40784: 0
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: WL25764
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: HG60353
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG60353%27 HTTP/1.1" 200 None
2026-03-27 10:56:14 [auto1.de] INFO: Scrape type for HG60353: 0
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: SA61025
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: MK52280
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK52280%27 HTTP/1.1" 200 None
2026-03-27 10:56:14 [auto1.de] INFO: Scrape type for MK52280: 0
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: MW79572
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: XA59462
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: SC92395
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: CN04574
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: YD41840
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: AS63846
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS63846%27 HTTP/1.1" 200 None
2026-03-27 10:56:14 [auto1.de] INFO: Scrape type for AS63846: 0
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: CM42971
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: YN88329
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: GP48651
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP48651%27 HTTP/1.1" 200 None
2026-03-27 10:56:14 [auto1.de] INFO: Scrape type for GP48651: 0
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: TK74975
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK74975%27 HTTP/1.1" 200 None
2026-03-27 10:56:14 [auto1.de] INFO: Scrape type for TK74975: 0
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: VY35567
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY35567%27 HTTP/1.1" 200 None
2026-03-27 10:56:14 [auto1.de] INFO: Scrape type for VY35567: 0
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: PM10590
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM10590%27 HTTP/1.1" 200 None
2026-03-27 10:56:14 [auto1.de] INFO: Scrape type for PM10590: 0
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: HS45664
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: YT61577
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: UG35230
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: XC35709
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: WK49047
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: PM61322
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM61322%27 HTTP/1.1" 200 None
2026-03-27 10:56:14 [auto1.de] INFO: Scrape type for PM61322: 0
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: ZN74052
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN74052%27 HTTP/1.1" 200 None
2026-03-27 10:56:14 [auto1.de] INFO: Scrape type for ZN74052: 0
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: WV66360
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV66360%27 HTTP/1.1" 200 None
2026-03-27 10:56:14 [auto1.de] INFO: Scrape type for WV66360: 0
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: TM46597
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM46597%27 HTTP/1.1" 200 None
2026-03-27 10:56:14 [auto1.de] INFO: Scrape type for TM46597: 0
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: YR45696
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: PR75210
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: ZH86268
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: EJ11673
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ11673%27 HTTP/1.1" 200 None
2026-03-27 10:56:14 [auto1.de] INFO: Scrape type for EJ11673: 0
2026-03-27 10:56:14 [auto1.de] INFO: Found listing with ID: JS18572
2026-03-27 10:56:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:16 [auto1.de] INFO: Channel: 24h | Page: 103 | totalHits: 10616 | hits on page: 40
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: KB43616
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: KH18492
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH18492%27 HTTP/1.1" 200 None
2026-03-27 10:56:16 [auto1.de] INFO: Scrape type for KH18492: 0
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: CK03122
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK03122%27 HTTP/1.1" 200 None
2026-03-27 10:56:16 [auto1.de] INFO: Scrape type for CK03122: 0
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: CB57025
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: CR24268
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: AW32080
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW32080%27 HTTP/1.1" 200 None
2026-03-27 10:56:16 [auto1.de] INFO: Scrape type for AW32080: 0
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: BK82151
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: YG98793
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG98793%27 HTTP/1.1" 200 None
2026-03-27 10:56:16 [auto1.de] INFO: Scrape type for YG98793: 0
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: DL83760
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: PH55867
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: UJ91538
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ91538%27 HTTP/1.1" 200 None
2026-03-27 10:56:16 [auto1.de] INFO: Scrape type for UJ91538: 0
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: RN76659
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: PG90972
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG90972%27 HTTP/1.1" 200 None
2026-03-27 10:56:16 [auto1.de] INFO: Scrape type for PG90972: 0
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: VX85374
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX85374%27 HTTP/1.1" 200 None
2026-03-27 10:56:16 [auto1.de] INFO: Scrape type for VX85374: 0
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: VR85495
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR85495%27 HTTP/1.1" 200 None
2026-03-27 10:56:16 [auto1.de] INFO: Scrape type for VR85495: 0
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: VJ89653
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ89653%27 HTTP/1.1" 200 None
2026-03-27 10:56:16 [auto1.de] INFO: Scrape type for VJ89653: 0
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: JT67196
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: SS03319
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS03319%27 HTTP/1.1" 200 None
2026-03-27 10:56:16 [auto1.de] INFO: Scrape type for SS03319: 0
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: VA69580
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA69580%27 HTTP/1.1" 200 None
2026-03-27 10:56:16 [auto1.de] INFO: Scrape type for VA69580: 0
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: CL49552
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL49552%27 HTTP/1.1" 200 None
2026-03-27 10:56:16 [auto1.de] INFO: Scrape type for CL49552: 0
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: YG51105
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG51105%27 HTTP/1.1" 200 None
2026-03-27 10:56:16 [auto1.de] INFO: Scrape type for YG51105: 0
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: KR30389
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: TD56842
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: FH96221
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: LJ59261
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ59261%27 HTTP/1.1" 200 None
2026-03-27 10:56:16 [auto1.de] INFO: Scrape type for LJ59261: 0
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: NE09834
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE09834%27 HTTP/1.1" 200 None
2026-03-27 10:56:16 [auto1.de] INFO: Scrape type for NE09834: 0
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: MU08811
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: PG24106
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: TF26845
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF26845%27 HTTP/1.1" 200 None
2026-03-27 10:56:16 [auto1.de] INFO: Scrape type for TF26845: 0
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: AL49500
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL49500%27 HTTP/1.1" 200 None
2026-03-27 10:56:16 [auto1.de] INFO: Scrape type for AL49500: 0
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: HE72355
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE72355%27 HTTP/1.1" 200 None
2026-03-27 10:56:16 [auto1.de] INFO: Scrape type for HE72355: 0
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: LP81758
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: SP32768
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: JB57903
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: EM16254
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM16254%27 HTTP/1.1" 200 None
2026-03-27 10:56:16 [auto1.de] INFO: Scrape type for EM16254: 0
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: HR29759
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: PE82086
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE82086%27 HTTP/1.1" 200 None
2026-03-27 10:56:16 [auto1.de] INFO: Scrape type for PE82086: 0
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: XX09000
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: RA13957
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA13957%27 HTTP/1.1" 200 None
2026-03-27 10:56:16 [auto1.de] INFO: Scrape type for RA13957: 0
2026-03-27 10:56:16 [auto1.de] INFO: Found listing with ID: BY66745
2026-03-27 10:56:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:20 [auto1.de] INFO: Channel: 24h | Page: 104 | totalHits: 10616 | hits on page: 40
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: CR26579
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR26579%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for CR26579: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: RZ82466
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ82466%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for RZ82466: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: KX40917
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: ZC45709
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: XV11651
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV11651%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for XV11651: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: LW52263
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: BW22563
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: MT13851
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT13851%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for MT13851: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: PM62830
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM62830%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for PM62830: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: AE50962
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: SK17684
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK17684%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for SK17684: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: DM70532
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70532%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for DM70532: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: GS24649
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS24649%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for GS24649: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: KZ06018
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ06018%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for KZ06018: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: SK33918
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: XK62781
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: SJ64041
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ64041%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for SJ64041: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: GY77163
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY77163%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for GY77163: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: WR22975
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: DD03238
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: RL59137
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL59137%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for RL59137: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: FP89516
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP89516%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for FP89516: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: KU80170
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU80170%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for KU80170: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: KU48323
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU48323%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for KU48323: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: FT33295
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT33295%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for FT33295: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: CT48596
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: PP69489
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: SX57791
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX57791%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for SX57791: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: DU40633
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: EG33141
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: BW90089
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW90089%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for BW90089: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: RP81387
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: PF96203
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF96203%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for PF96203: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: FX96074
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX96074%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for FX96074: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: GE82925
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: DD23364
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD23364%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for DD23364: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: TP88372
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: VH83950
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH83950%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for VH83950: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: RV71441
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV71441%27 HTTP/1.1" 200 None
2026-03-27 10:56:20 [auto1.de] INFO: Scrape type for RV71441: 0
2026-03-27 10:56:20 [auto1.de] INFO: Found listing with ID: DH94169
2026-03-27 10:56:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:21 [auto1.de] INFO: Channel: 24h | Page: 105 | totalHits: 10616 | hits on page: 40
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: ZN72098
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: CA90460
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: PK00537
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: VC19862
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: ZJ94991
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ94991%27 HTTP/1.1" 200 None
2026-03-27 10:56:21 [auto1.de] INFO: Scrape type for ZJ94991: 0
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: TA51797
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA51797%27 HTTP/1.1" 200 None
2026-03-27 10:56:21 [auto1.de] INFO: Scrape type for TA51797: 0
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: SA53556
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: JB49732
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB49732%27 HTTP/1.1" 200 None
2026-03-27 10:56:21 [auto1.de] INFO: Scrape type for JB49732: 0
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: VK99504
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK99504%27 HTTP/1.1" 200 None
2026-03-27 10:56:21 [auto1.de] INFO: Scrape type for VK99504: 0
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: NB15408
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: ZM18653
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM18653%27 HTTP/1.1" 200 None
2026-03-27 10:56:21 [auto1.de] INFO: Scrape type for ZM18653: 0
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: WD57497
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: EM73701
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: EL01882
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL01882%27 HTTP/1.1" 200 None
2026-03-27 10:56:21 [auto1.de] INFO: Scrape type for EL01882: 0
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: MR31095
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: TD39885
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: VZ64604
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: VT56580
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: SX62483
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX62483%27 HTTP/1.1" 200 None
2026-03-27 10:56:21 [auto1.de] INFO: Scrape type for SX62483: 0
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: VH89235
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH89235%27 HTTP/1.1" 200 None
2026-03-27 10:56:21 [auto1.de] INFO: Scrape type for VH89235: 0
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: XJ79433
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ79433%27 HTTP/1.1" 200 None
2026-03-27 10:56:21 [auto1.de] INFO: Scrape type for XJ79433: 0
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: NY45531
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: SF95135
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF95135%27 HTTP/1.1" 200 None
2026-03-27 10:56:21 [auto1.de] INFO: Scrape type for SF95135: 0
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: XS67739
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: HN86226
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN86226%27 HTTP/1.1" 200 None
2026-03-27 10:56:21 [auto1.de] INFO: Scrape type for HN86226: 0
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: LF99231
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF99231%27 HTTP/1.1" 200 None
2026-03-27 10:56:21 [auto1.de] INFO: Scrape type for LF99231: 0
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: LW15180
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: WC76278
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC76278%27 HTTP/1.1" 200 None
2026-03-27 10:56:21 [auto1.de] INFO: Scrape type for WC76278: 0
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: UM76934
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM76934%27 HTTP/1.1" 200 None
2026-03-27 10:56:21 [auto1.de] INFO: Scrape type for UM76934: 0
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: LR81962
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR81962%27 HTTP/1.1" 200 None
2026-03-27 10:56:21 [auto1.de] INFO: Scrape type for LR81962: 0
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: PY46778
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY46778%27 HTTP/1.1" 200 None
2026-03-27 10:56:21 [auto1.de] INFO: Scrape type for PY46778: 0
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: SL45224
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL45224%27 HTTP/1.1" 200 None
2026-03-27 10:56:21 [auto1.de] INFO: Scrape type for SL45224: 0
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: FD77261
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: LX19863
2026-03-27 10:56:21 [auto1.de] INFO: Found listing with ID: UH58426
2026-03-27 10:56:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH58426%27 HTTP/1.1" 200 None
2026-03-27 10:56:22 [auto1.de] INFO: Scrape type for UH58426: 0
2026-03-27 10:56:22 [auto1.de] INFO: Found listing with ID: SJ01249
2026-03-27 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ01249%27 HTTP/1.1" 200 None
2026-03-27 10:56:22 [auto1.de] INFO: Scrape type for SJ01249: 0
2026-03-27 10:56:22 [auto1.de] INFO: Found listing with ID: ZX04970
2026-03-27 10:56:22 [auto1.de] INFO: Found listing with ID: BY01569
2026-03-27 10:56:22 [auto1.de] INFO: Found listing with ID: XV80159
2026-03-27 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV80159%27 HTTP/1.1" 200 None
2026-03-27 10:56:22 [auto1.de] INFO: Scrape type for XV80159: 0
2026-03-27 10:56:22 [auto1.de] INFO: Found listing with ID: EC98631
2026-03-27 10:56:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:23 [auto1.de] INFO: Channel: 24h | Page: 106 | totalHits: 10616 | hits on page: 40
2026-03-27 10:56:23 [auto1.de] INFO: Found listing with ID: GU42707
2026-03-27 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU42707%27 HTTP/1.1" 200 None
2026-03-27 10:56:23 [auto1.de] INFO: Scrape type for GU42707: 0
2026-03-27 10:56:23 [auto1.de] INFO: Found listing with ID: XL21584
2026-03-27 10:56:23 [auto1.de] INFO: Found listing with ID: KU34355
2026-03-27 10:56:23 [auto1.de] INFO: Found listing with ID: UA33739
2026-03-27 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA33739%27 HTTP/1.1" 200 None
2026-03-27 10:56:23 [auto1.de] INFO: Scrape type for UA33739: 0
2026-03-27 10:56:23 [auto1.de] INFO: Found listing with ID: BD52113
2026-03-27 10:56:23 [auto1.de] INFO: Found listing with ID: TY80313
2026-03-27 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY80313%27 HTTP/1.1" 200 None
2026-03-27 10:56:23 [auto1.de] INFO: Scrape type for TY80313: 0
2026-03-27 10:56:23 [auto1.de] INFO: Found listing with ID: DV30882
2026-03-27 10:56:23 [auto1.de] INFO: Found listing with ID: ZY59187
2026-03-27 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY59187%27 HTTP/1.1" 200 None
2026-03-27 10:56:23 [auto1.de] INFO: Scrape type for ZY59187: 0
2026-03-27 10:56:23 [auto1.de] INFO: Found listing with ID: SC88489
2026-03-27 10:56:23 [auto1.de] INFO: Found listing with ID: JU71873
2026-03-27 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU71873%27 HTTP/1.1" 200 None
2026-03-27 10:56:23 [auto1.de] INFO: Scrape type for JU71873: 0
2026-03-27 10:56:23 [auto1.de] INFO: Found listing with ID: LN90671
2026-03-27 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN90671%27 HTTP/1.1" 200 None
2026-03-27 10:56:23 [auto1.de] INFO: Scrape type for LN90671: 2
2026-03-27 10:56:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3106ec92-6744-5c77-81bc-c31bb9aff2de with identifier: LN90671
2026-03-27 10:56:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3106ec92-6744-5c77-81bc-c31bb9aff2de with scrape type 2
2026-03-27 10:56:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3106ec92-6744-5c77-81bc-c31bb9aff2de with scrape type 2
2026-03-27 10:56:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3106ec92-6744-5c77-81bc-c31bb9aff2de, identifier: LN90671
2026-03-27 10:56:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3106ec92-6744-5c77-81bc-c31bb9aff2de with identifier: LN90671
2026-03-27 10:56:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3106ec92-6744-5c77-81bc-c31bb9aff2de with identifier: LN90671
2026-03-27 10:56:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3106ec92-6744-5c77-81bc-c31bb9aff2de with identifier: LN90671 to the API
2026-03-27 10:56:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:56:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:56:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-27T16:28:16Z',
 'fuel_type': 'diesel',
 'id': '3106ec92-6744-5c77-81bc-c31bb9aff2de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN90671',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 110629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-27 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN90671%27 HTTP/1.1" 200 None
2026-03-27 10:56:23 [auto1.de] INFO: Saving data for LN90671: {'auction_closing_time': 1774628896.0, 'created_time': 1774424132.059265, 'last_price_update_time': 1774608983.992701}
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN90671') HTTP/1.1" 204 0
2026-03-27 10:56:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: LS73551
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: WU62760
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU62760%27 HTTP/1.1" 200 None
2026-03-27 10:56:24 [auto1.de] INFO: Scrape type for WU62760: 0
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: XE48983
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE48983%27 HTTP/1.1" 200 None
2026-03-27 10:56:24 [auto1.de] INFO: Scrape type for XE48983: 0
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: CX96201
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX96201%27 HTTP/1.1" 200 None
2026-03-27 10:56:24 [auto1.de] INFO: Scrape type for CX96201: 0
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: EY31164
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY31164%27 HTTP/1.1" 200 None
2026-03-27 10:56:24 [auto1.de] INFO: Scrape type for EY31164: 0
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: BA71155
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: BS18924
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS18924%27 HTTP/1.1" 200 None
2026-03-27 10:56:24 [auto1.de] INFO: Scrape type for BS18924: 0
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: BS30478
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS30478%27 HTTP/1.1" 200 None
2026-03-27 10:56:24 [auto1.de] INFO: Scrape type for BS30478: 0
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: RF93136
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF93136%27 HTTP/1.1" 200 None
2026-03-27 10:56:24 [auto1.de] INFO: Scrape type for RF93136: 0
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: GS07550
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS07550%27 HTTP/1.1" 200 None
2026-03-27 10:56:24 [auto1.de] INFO: Scrape type for GS07550: 0
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: CL19450
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL19450%27 HTTP/1.1" 200 None
2026-03-27 10:56:24 [auto1.de] INFO: Scrape type for CL19450: 0
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: WH52152
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH52152%27 HTTP/1.1" 200 None
2026-03-27 10:56:24 [auto1.de] INFO: Scrape type for WH52152: 0
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: CY80853
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: FD71544
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: PD98711
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD98711%27 HTTP/1.1" 200 None
2026-03-27 10:56:24 [auto1.de] INFO: Scrape type for PD98711: 0
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: RU37876
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: RY60901
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: ND88059
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND88059%27 HTTP/1.1" 200 None
2026-03-27 10:56:24 [auto1.de] INFO: Scrape type for ND88059: 0
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: KA05188
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA05188%27 HTTP/1.1" 200 None
2026-03-27 10:56:24 [auto1.de] INFO: Scrape type for KA05188: 0
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: HF65480
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: EM35134
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM35134%27 HTTP/1.1" 200 None
2026-03-27 10:56:24 [auto1.de] INFO: Scrape type for EM35134: 0
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: EU54911
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: JL52757
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL52757%27 HTTP/1.1" 200 None
2026-03-27 10:56:24 [auto1.de] INFO: Scrape type for JL52757: 0
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: AW57612
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: JJ41566
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: RS30233
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: ZU35501
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU35501%27 HTTP/1.1" 200 None
2026-03-27 10:56:24 [auto1.de] INFO: Scrape type for ZU35501: 0
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: UG79449
2026-03-27 10:56:24 [auto1.de] INFO: Found listing with ID: RC73620
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC73620%27 HTTP/1.1" 200 None
2026-03-27 10:56:24 [auto1.de] INFO: Scrape type for RC73620: 0
2026-03-27 10:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:26 [auto1.de] INFO: Channel: 24h | Page: 107 | totalHits: 10617 | hits on page: 40
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: RC73620
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC73620%27 HTTP/1.1" 200 None
2026-03-27 10:56:26 [auto1.de] INFO: Scrape type for RC73620: 0
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: FZ44341
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ44341%27 HTTP/1.1" 200 None
2026-03-27 10:56:26 [auto1.de] INFO: Scrape type for FZ44341: 0
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: SL30101
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: TY90085
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: NA05551
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: TT17310
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: LM64010
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: CV85999
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: WX73478
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: XT11627
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: VH78331
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78331%27 HTTP/1.1" 200 None
2026-03-27 10:56:26 [auto1.de] INFO: Scrape type for VH78331: 0
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: XY75153
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: ZJ77365
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: ZE11257
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE11257%27 HTTP/1.1" 200 None
2026-03-27 10:56:26 [auto1.de] INFO: Scrape type for ZE11257: 0
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: RY43567
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: WH24270
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH24270%27 HTTP/1.1" 200 None
2026-03-27 10:56:26 [auto1.de] INFO: Scrape type for WH24270: 2
2026-03-27 10:56:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a72f51a-fba2-5b49-8440-9fc2ea8a1241 with identifier: WH24270
2026-03-27 10:56:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a72f51a-fba2-5b49-8440-9fc2ea8a1241 with scrape type 2
2026-03-27 10:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a72f51a-fba2-5b49-8440-9fc2ea8a1241 with scrape type 2
2026-03-27 10:56:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a72f51a-fba2-5b49-8440-9fc2ea8a1241, identifier: WH24270
2026-03-27 10:56:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a72f51a-fba2-5b49-8440-9fc2ea8a1241 with identifier: WH24270
2026-03-27 10:56:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a72f51a-fba2-5b49-8440-9fc2ea8a1241 with identifier: WH24270
2026-03-27 10:56:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a72f51a-fba2-5b49-8440-9fc2ea8a1241 with identifier: WH24270 to the API
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:56:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-27T16:56:23Z',
 'fuel_type': 'petrol',
 'id': '3a72f51a-fba2-5b49-8440-9fc2ea8a1241',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH24270',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 159558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-22',
 'seller_name': None,
 'title': 'Hyundai i40 1.6 5 Star Edition',
 'transmission': 'manual',
 'trim': '5 Star Edition',
 'year': 2014}
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH24270%27 HTTP/1.1" 200 None
2026-03-27 10:56:26 [auto1.de] INFO: Saving data for WH24270: {'auction_closing_time': 1774630583.0, 'created_time': 1773831206.519208, 'last_price_update_time': 1774608986.746391}
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WH24270') HTTP/1.1" 204 0
2026-03-27 10:56:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: AP12446
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: SE51657
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE51657%27 HTTP/1.1" 200 None
2026-03-27 10:56:26 [auto1.de] INFO: Scrape type for SE51657: 0
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: BC32553
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC32553%27 HTTP/1.1" 200 None
2026-03-27 10:56:26 [auto1.de] INFO: Scrape type for BC32553: 0
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: XZ20082
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ20082%27 HTTP/1.1" 200 None
2026-03-27 10:56:26 [auto1.de] INFO: Scrape type for XZ20082: 0
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: AF31278
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: CU41994
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: AB54939
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB54939%27 HTTP/1.1" 200 None
2026-03-27 10:56:26 [auto1.de] INFO: Scrape type for AB54939: 0
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: YY19012
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: WK50134
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: VC25421
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC25421%27 HTTP/1.1" 200 None
2026-03-27 10:56:26 [auto1.de] INFO: Scrape type for VC25421: 0
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: AF05413
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: NH48302
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: GV04450
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV04450%27 HTTP/1.1" 200 None
2026-03-27 10:56:26 [auto1.de] INFO: Scrape type for GV04450: 0
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: ET42367
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: HR52949
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR52949%27 HTTP/1.1" 200 None
2026-03-27 10:56:26 [auto1.de] INFO: Scrape type for HR52949: 0
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: TR18149
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR18149%27 HTTP/1.1" 200 None
2026-03-27 10:56:26 [auto1.de] INFO: Scrape type for TR18149: 0
2026-03-27 10:56:26 [auto1.de] INFO: Found listing with ID: TU13190
2026-03-27 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU13190%27 HTTP/1.1" 200 None
2026-03-27 10:56:27 [auto1.de] INFO: Scrape type for TU13190: 0
2026-03-27 10:56:27 [auto1.de] INFO: Found listing with ID: ZX15203
2026-03-27 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX15203%27 HTTP/1.1" 200 None
2026-03-27 10:56:27 [auto1.de] INFO: Scrape type for ZX15203: 0
2026-03-27 10:56:27 [auto1.de] INFO: Found listing with ID: NB79280
2026-03-27 10:56:27 [auto1.de] INFO: Found listing with ID: HP20518
2026-03-27 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP20518%27 HTTP/1.1" 200 None
2026-03-27 10:56:27 [auto1.de] INFO: Scrape type for HP20518: 0
2026-03-27 10:56:27 [auto1.de] INFO: Found listing with ID: TT92421
2026-03-27 10:56:27 [auto1.de] INFO: Found listing with ID: DV16657
2026-03-27 10:56:27 [auto1.de] INFO: Found listing with ID: LK21823
2026-03-27 10:56:27 [auto1.de] INFO: Found listing with ID: TZ04033
2026-03-27 10:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:28 [auto1.de] INFO: Channel: 24h | Page: 108 | totalHits: 10617 | hits on page: 40
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: TH95550
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: EJ26253
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: FA12964
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: KG05257
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: NJ15905
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: EF06566
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF06566%27 HTTP/1.1" 200 None
2026-03-27 10:56:28 [auto1.de] INFO: Scrape type for EF06566: 0
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: LB19367
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB19367%27 HTTP/1.1" 200 None
2026-03-27 10:56:28 [auto1.de] INFO: Scrape type for LB19367: 0
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: NZ20734
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ20734%27 HTTP/1.1" 200 None
2026-03-27 10:56:28 [auto1.de] INFO: Scrape type for NZ20734: 0
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: CU91826
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: SG96859
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: YG27675
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: JW33556
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW33556%27 HTTP/1.1" 200 None
2026-03-27 10:56:28 [auto1.de] INFO: Scrape type for JW33556: 0
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: BE42770
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: YL30393
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL30393%27 HTTP/1.1" 200 None
2026-03-27 10:56:28 [auto1.de] INFO: Scrape type for YL30393: 0
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: RS35479
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS35479%27 HTTP/1.1" 200 None
2026-03-27 10:56:28 [auto1.de] INFO: Scrape type for RS35479: 0
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: TG09191
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: UR67543
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: CP09804
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: FY00774
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: WJ62953
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ62953%27 HTTP/1.1" 200 None
2026-03-27 10:56:28 [auto1.de] INFO: Scrape type for WJ62953: 0
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: KH44896
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: ZX12399
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX12399%27 HTTP/1.1" 200 None
2026-03-27 10:56:28 [auto1.de] INFO: Scrape type for ZX12399: 0
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: WZ42371
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ42371%27 HTTP/1.1" 200 None
2026-03-27 10:56:28 [auto1.de] INFO: Scrape type for WZ42371: 0
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: HH37576
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH37576%27 HTTP/1.1" 200 None
2026-03-27 10:56:28 [auto1.de] INFO: Scrape type for HH37576: 0
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: BR62242
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR62242%27 HTTP/1.1" 200 None
2026-03-27 10:56:28 [auto1.de] INFO: Scrape type for BR62242: 0
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: UV13467
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV13467%27 HTTP/1.1" 200 None
2026-03-27 10:56:28 [auto1.de] INFO: Scrape type for UV13467: 0
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: YG27171
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: YA12310
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA12310%27 HTTP/1.1" 200 None
2026-03-27 10:56:28 [auto1.de] INFO: Scrape type for YA12310: 0
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: KT31788
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: ES32816
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: SZ79532
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ79532%27 HTTP/1.1" 200 None
2026-03-27 10:56:28 [auto1.de] INFO: Scrape type for SZ79532: 0
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: PF85631
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: BD69992
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD69992%27 HTTP/1.1" 200 None
2026-03-27 10:56:28 [auto1.de] INFO: Scrape type for BD69992: 0
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: BG47316
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG47316%27 HTTP/1.1" 200 None
2026-03-27 10:56:28 [auto1.de] INFO: Scrape type for BG47316: 0
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: RB22775
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: MX24097
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX24097%27 HTTP/1.1" 200 None
2026-03-27 10:56:28 [auto1.de] INFO: Scrape type for MX24097: 0
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: YK99793
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: XW91244
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW91244%27 HTTP/1.1" 200 None
2026-03-27 10:56:28 [auto1.de] INFO: Scrape type for XW91244: 0
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: VY06306
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY06306%27 HTTP/1.1" 200 None
2026-03-27 10:56:28 [auto1.de] INFO: Scrape type for VY06306: 0
2026-03-27 10:56:28 [auto1.de] INFO: Found listing with ID: MW86699
2026-03-27 10:56:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:29 [auto1.de] INFO: Channel: 24h | Page: 109 | totalHits: 10617 | hits on page: 40
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: JP78451
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP78451%27 HTTP/1.1" 200 None
2026-03-27 10:56:29 [auto1.de] INFO: Scrape type for JP78451: 0
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: AL03330
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: JA10787
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA10787%27 HTTP/1.1" 200 None
2026-03-27 10:56:29 [auto1.de] INFO: Scrape type for JA10787: 0
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: JR80478
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: FR49421
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: VP49829
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: GX28379
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX28379%27 HTTP/1.1" 200 None
2026-03-27 10:56:29 [auto1.de] INFO: Scrape type for GX28379: 0
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: ZW87373
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW87373%27 HTTP/1.1" 200 None
2026-03-27 10:56:29 [auto1.de] INFO: Scrape type for ZW87373: 0
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: KJ03468
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: KF35020
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF35020%27 HTTP/1.1" 200 None
2026-03-27 10:56:29 [auto1.de] INFO: Scrape type for KF35020: 0
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: LR04011
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: VZ90380
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: KR63483
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: DN55210
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN55210%27 HTTP/1.1" 200 None
2026-03-27 10:56:29 [auto1.de] INFO: Scrape type for DN55210: 0
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: RJ23692
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: VP44882
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: MX11677
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX11677%27 HTTP/1.1" 200 None
2026-03-27 10:56:29 [auto1.de] INFO: Scrape type for MX11677: 0
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: TR96772
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: HF94002
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: MS18756
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS18756%27 HTTP/1.1" 200 None
2026-03-27 10:56:29 [auto1.de] INFO: Scrape type for MS18756: 0
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: VP81164
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP81164%27 HTTP/1.1" 200 None
2026-03-27 10:56:29 [auto1.de] INFO: Scrape type for VP81164: 0
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: CH49236
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH49236%27 HTTP/1.1" 200 None
2026-03-27 10:56:29 [auto1.de] INFO: Scrape type for CH49236: 0
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: CJ03121
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ03121%27 HTTP/1.1" 200 None
2026-03-27 10:56:29 [auto1.de] INFO: Scrape type for CJ03121: 0
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: ZT91493
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT91493%27 HTTP/1.1" 200 None
2026-03-27 10:56:29 [auto1.de] INFO: Scrape type for ZT91493: 0
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: CL04690
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL04690%27 HTTP/1.1" 200 None
2026-03-27 10:56:29 [auto1.de] INFO: Scrape type for CL04690: 0
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: RL82017
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: LE17323
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: VP95925
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP95925%27 HTTP/1.1" 200 None
2026-03-27 10:56:29 [auto1.de] INFO: Scrape type for VP95925: 0
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: JU51054
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU51054%27 HTTP/1.1" 200 None
2026-03-27 10:56:29 [auto1.de] INFO: Scrape type for JU51054: 0
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: KW13573
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: KX05344
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX05344%27 HTTP/1.1" 200 None
2026-03-27 10:56:29 [auto1.de] INFO: Scrape type for KX05344: 0
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: YG95815
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: WV35399
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV35399%27 HTTP/1.1" 200 None
2026-03-27 10:56:29 [auto1.de] INFO: Scrape type for WV35399: 0
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: ZA48754
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: DD64809
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: XJ94036
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ94036%27 HTTP/1.1" 200 None
2026-03-27 10:56:29 [auto1.de] INFO: Scrape type for XJ94036: 0
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: WL60087
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: BV07882
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: RP55300
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP55300%27 HTTP/1.1" 200 None
2026-03-27 10:56:29 [auto1.de] INFO: Scrape type for RP55300: 0
2026-03-27 10:56:29 [auto1.de] INFO: Found listing with ID: MP71247
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP71247%27 HTTP/1.1" 200 None
2026-03-27 10:56:29 [auto1.de] INFO: Scrape type for MP71247: 0
2026-03-27 10:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:30 [auto1.de] INFO: Channel: 24h | Page: 110 | totalHits: 10617 | hits on page: 40
2026-03-27 10:56:30 [auto1.de] INFO: Found listing with ID: XR74072
2026-03-27 10:56:30 [auto1.de] INFO: Found listing with ID: DR46257
2026-03-27 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR46257%27 HTTP/1.1" 200 None
2026-03-27 10:56:30 [auto1.de] INFO: Scrape type for DR46257: 0
2026-03-27 10:56:30 [auto1.de] INFO: Found listing with ID: FN87515
2026-03-27 10:56:30 [auto1.de] INFO: Found listing with ID: PS69268
2026-03-27 10:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS69268%27 HTTP/1.1" 200 None
2026-03-27 10:56:31 [auto1.de] INFO: Scrape type for PS69268: 0
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: UJ13570
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ13570%27 HTTP/1.1" 200 None
2026-03-27 10:56:31 [auto1.de] INFO: Scrape type for UJ13570: 0
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: NA68427
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA68427%27 HTTP/1.1" 200 None
2026-03-27 10:56:31 [auto1.de] INFO: Scrape type for NA68427: 0
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: NB36369
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: TG18980
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: GA97720
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA97720%27 HTTP/1.1" 200 None
2026-03-27 10:56:31 [auto1.de] INFO: Scrape type for GA97720: 0
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: UX41831
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: XP46744
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: HU69919
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU69919%27 HTTP/1.1" 200 None
2026-03-27 10:56:31 [auto1.de] INFO: Scrape type for HU69919: 0
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: WG93037
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG93037%27 HTTP/1.1" 200 None
2026-03-27 10:56:31 [auto1.de] INFO: Scrape type for WG93037: 0
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: ZK64597
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: AD00479
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: JT31602
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: PA49455
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: WP32637
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: FB62548
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB62548%27 HTTP/1.1" 200 None
2026-03-27 10:56:31 [auto1.de] INFO: Scrape type for FB62548: 0
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: DE25074
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE25074%27 HTTP/1.1" 200 None
2026-03-27 10:56:31 [auto1.de] INFO: Scrape type for DE25074: 0
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: ZU66278
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU66278%27 HTTP/1.1" 200 None
2026-03-27 10:56:31 [auto1.de] INFO: Scrape type for ZU66278: 0
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: BX93358
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX93358%27 HTTP/1.1" 200 None
2026-03-27 10:56:31 [auto1.de] INFO: Scrape type for BX93358: 0
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: HX25760
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX25760%27 HTTP/1.1" 200 None
2026-03-27 10:56:31 [auto1.de] INFO: Scrape type for HX25760: 0
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: BH79030
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: XW73625
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW73625%27 HTTP/1.1" 200 None
2026-03-27 10:56:31 [auto1.de] INFO: Scrape type for XW73625: 0
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: BE61644
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE61644%27 HTTP/1.1" 200 None
2026-03-27 10:56:31 [auto1.de] INFO: Scrape type for BE61644: 0
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: BE84221
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE84221%27 HTTP/1.1" 200 None
2026-03-27 10:56:31 [auto1.de] INFO: Scrape type for BE84221: 0
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: GN20551
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN20551%27 HTTP/1.1" 200 None
2026-03-27 10:56:31 [auto1.de] INFO: Scrape type for GN20551: 0
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: VD55079
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD55079%27 HTTP/1.1" 200 None
2026-03-27 10:56:31 [auto1.de] INFO: Scrape type for VD55079: 0
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: FD10319
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD10319%27 HTTP/1.1" 200 None
2026-03-27 10:56:31 [auto1.de] INFO: Scrape type for FD10319: 0
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: PV86472
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: AV36949
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV36949%27 HTTP/1.1" 200 None
2026-03-27 10:56:31 [auto1.de] INFO: Scrape type for AV36949: 0
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: VG80520
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: HZ20849
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: AV59132
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: FD77628
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: TW63650
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW63650%27 HTTP/1.1" 200 None
2026-03-27 10:56:31 [auto1.de] INFO: Scrape type for TW63650: 0
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: DB98628
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: WG34535
2026-03-27 10:56:31 [auto1.de] INFO: Found listing with ID: EG37222
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG37222%27 HTTP/1.1" 200 None
2026-03-27 10:56:31 [auto1.de] INFO: Scrape type for EG37222: 0
2026-03-27 10:56:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:32 [auto1.de] INFO: Channel: 24h | Page: 111 | totalHits: 10617 | hits on page: 40
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: BE31678
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE31678%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for BE31678: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: GJ42826
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ42826%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for GJ42826: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: UJ65232
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ65232%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for UJ65232: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: SY47720
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY47720%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for SY47720: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: BH72065
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH72065%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for BH72065: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: AH65951
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: NJ97251
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: TV42528
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: DV16479
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: DL39221
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL39221%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for DL39221: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: VV51818
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV51818%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for VV51818: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: BJ16226
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ16226%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for BJ16226: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: TA25179
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA25179%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for TA25179: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: NG71684
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG71684%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for NG71684: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: KF94492
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: XH96014
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH96014%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for XH96014: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: HD03620
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD03620%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for HD03620: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: YF37634
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF37634%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for YF37634: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: RW82237
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: JN01808
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: DN18269
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: KB71899
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB71899%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for KB71899: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: VE85769
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE85769%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for VE85769: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: WX19864
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX19864%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for WX19864: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: BV34042
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV34042%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for BV34042: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: TF12551
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: UJ05143
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: HY91641
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY91641%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for HY91641: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: YN56792
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN56792%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for YN56792: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: ZT70228
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: ZC99377
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC99377%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for ZC99377: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: VC16092
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC16092%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for VC16092: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: GF20039
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF20039%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for GF20039: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: ES20413
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES20413%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for ES20413: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: HX09713
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX09713%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for HX09713: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: BY53674
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: DR53843
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR53843%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for DR53843: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: CR32781
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR32781%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for CR32781: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: JE43996
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE43996%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for JE43996: 0
2026-03-27 10:56:32 [auto1.de] INFO: Found listing with ID: GM71398
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM71398%27 HTTP/1.1" 200 None
2026-03-27 10:56:32 [auto1.de] INFO: Scrape type for GM71398: 0
2026-03-27 10:56:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:33 [auto1.de] INFO: Channel: 24h | Page: 112 | totalHits: 10617 | hits on page: 40
2026-03-27 10:56:33 [auto1.de] INFO: Found listing with ID: XE17582
2026-03-27 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE17582%27 HTTP/1.1" 200 None
2026-03-27 10:56:33 [auto1.de] INFO: Scrape type for XE17582: 0
2026-03-27 10:56:33 [auto1.de] INFO: Found listing with ID: CL77716
2026-03-27 10:56:33 [auto1.de] INFO: Found listing with ID: LL46180
2026-03-27 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL46180%27 HTTP/1.1" 200 None
2026-03-27 10:56:33 [auto1.de] INFO: Scrape type for LL46180: 0
2026-03-27 10:56:33 [auto1.de] INFO: Found listing with ID: JX39487
2026-03-27 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX39487%27 HTTP/1.1" 200 None
2026-03-27 10:56:33 [auto1.de] INFO: Scrape type for JX39487: 0
2026-03-27 10:56:33 [auto1.de] INFO: Found listing with ID: FC72279
2026-03-27 10:56:33 [auto1.de] INFO: Found listing with ID: RZ45087
2026-03-27 10:56:33 [auto1.de] INFO: Found listing with ID: WL34020
2026-03-27 10:56:33 [auto1.de] INFO: Found listing with ID: NB01116
2026-03-27 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB01116%27 HTTP/1.1" 200 None
2026-03-27 10:56:33 [auto1.de] INFO: Scrape type for NB01116: 0
2026-03-27 10:56:33 [auto1.de] INFO: Found listing with ID: SW57264
2026-03-27 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW57264%27 HTTP/1.1" 200 None
2026-03-27 10:56:33 [auto1.de] INFO: Scrape type for SW57264: 0
2026-03-27 10:56:33 [auto1.de] INFO: Found listing with ID: GK62232
2026-03-27 10:56:33 [auto1.de] INFO: Found listing with ID: JB09111
2026-03-27 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB09111%27 HTTP/1.1" 200 None
2026-03-27 10:56:33 [auto1.de] INFO: Scrape type for JB09111: 0
2026-03-27 10:56:33 [auto1.de] INFO: Found listing with ID: NY69120
2026-03-27 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY69120%27 HTTP/1.1" 200 None
2026-03-27 10:56:33 [auto1.de] INFO: Scrape type for NY69120: 0
2026-03-27 10:56:33 [auto1.de] INFO: Found listing with ID: EE94897
2026-03-27 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE94897%27 HTTP/1.1" 200 None
2026-03-27 10:56:33 [auto1.de] INFO: Scrape type for EE94897: 0
2026-03-27 10:56:33 [auto1.de] INFO: Found listing with ID: AG19353
2026-03-27 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG19353%27 HTTP/1.1" 200 None
2026-03-27 10:56:33 [auto1.de] INFO: Scrape type for AG19353: 0
2026-03-27 10:56:33 [auto1.de] INFO: Found listing with ID: JM30411
2026-03-27 10:56:33 [auto1.de] INFO: Found listing with ID: RW79290
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW79290%27 HTTP/1.1" 200 None
2026-03-27 10:56:34 [auto1.de] INFO: Scrape type for RW79290: 0
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: YR17987
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: UK33318
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: ZC19539
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: PP05974
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: SN29778
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: FY53654
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY53654%27 HTTP/1.1" 200 None
2026-03-27 10:56:34 [auto1.de] INFO: Scrape type for FY53654: 0
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: YY13791
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: EX72075
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: UG79939
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG79939%27 HTTP/1.1" 200 None
2026-03-27 10:56:34 [auto1.de] INFO: Scrape type for UG79939: 0
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: JS64304
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS64304%27 HTTP/1.1" 200 None
2026-03-27 10:56:34 [auto1.de] INFO: Scrape type for JS64304: 0
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: UA49331
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: VD67383
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: JU72191
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU72191%27 HTTP/1.1" 200 None
2026-03-27 10:56:34 [auto1.de] INFO: Scrape type for JU72191: 0
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: FX38179
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: RA48340
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA48340%27 HTTP/1.1" 200 None
2026-03-27 10:56:34 [auto1.de] INFO: Scrape type for RA48340: 0
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: TJ80177
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ80177%27 HTTP/1.1" 200 None
2026-03-27 10:56:34 [auto1.de] INFO: Scrape type for TJ80177: 0
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: AD99636
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: WT95105
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: YN05095
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN05095%27 HTTP/1.1" 200 None
2026-03-27 10:56:34 [auto1.de] INFO: Scrape type for YN05095: 0
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: ZC12806
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC12806%27 HTTP/1.1" 200 None
2026-03-27 10:56:34 [auto1.de] INFO: Scrape type for ZC12806: 0
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: YE96502
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE96502%27 HTTP/1.1" 200 None
2026-03-27 10:56:34 [auto1.de] INFO: Scrape type for YE96502: 0
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: LK91672
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: KN21474
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN21474%27 HTTP/1.1" 200 None
2026-03-27 10:56:34 [auto1.de] INFO: Scrape type for KN21474: 0
2026-03-27 10:56:34 [auto1.de] INFO: Found listing with ID: SG28912
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28912%27 HTTP/1.1" 200 None
2026-03-27 10:56:34 [auto1.de] INFO: Scrape type for SG28912: 0
2026-03-27 10:56:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:40 [auto1.de] INFO: Channel: 24h | Page: 113 | totalHits: 10618 | hits on page: 40
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: SG28912
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28912%27 HTTP/1.1" 200 None
2026-03-27 10:56:40 [auto1.de] INFO: Scrape type for SG28912: 0
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: CV85765
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: CN22310
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: MM41381
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: KD91632
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: DW40061
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: NK69314
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: KG64303
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: JK78478
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK78478%27 HTTP/1.1" 200 None
2026-03-27 10:56:40 [auto1.de] INFO: Scrape type for JK78478: 0
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: VS91117
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: ES63389
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: JF05347
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: YX64853
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: JT09686
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: HE60226
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: HU03787
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: DR78688
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: KF94036
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: UN95806
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN95806%27 HTTP/1.1" 200 None
2026-03-27 10:56:40 [auto1.de] INFO: Scrape type for UN95806: 0
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: RW07323
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW07323%27 HTTP/1.1" 200 None
2026-03-27 10:56:40 [auto1.de] INFO: Scrape type for RW07323: 0
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: UV04779
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: AP13517
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP13517%27 HTTP/1.1" 200 None
2026-03-27 10:56:40 [auto1.de] INFO: Scrape type for AP13517: 0
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: PV24261
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV24261%27 HTTP/1.1" 200 None
2026-03-27 10:56:40 [auto1.de] INFO: Scrape type for PV24261: 0
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: WK72065
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK72065%27 HTTP/1.1" 200 None
2026-03-27 10:56:40 [auto1.de] INFO: Scrape type for WK72065: 0
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: DR31322
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: YC00540
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00540%27 HTTP/1.1" 200 None
2026-03-27 10:56:40 [auto1.de] INFO: Scrape type for YC00540: 0
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: KA01913
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA01913%27 HTTP/1.1" 200 None
2026-03-27 10:56:40 [auto1.de] INFO: Scrape type for KA01913: 0
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: WZ89922
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: AL34825
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: BP13198
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: VW77341
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW77341%27 HTTP/1.1" 200 None
2026-03-27 10:56:40 [auto1.de] INFO: Scrape type for VW77341: 0
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: HX51661
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX51661%27 HTTP/1.1" 200 None
2026-03-27 10:56:40 [auto1.de] INFO: Scrape type for HX51661: 0
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: FT12781
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT12781%27 HTTP/1.1" 200 None
2026-03-27 10:56:40 [auto1.de] INFO: Scrape type for FT12781: 0
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: CV04289
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: XW75197
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: RX16022
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX16022%27 HTTP/1.1" 200 None
2026-03-27 10:56:40 [auto1.de] INFO: Scrape type for RX16022: 0
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: WX30683
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX30683%27 HTTP/1.1" 200 None
2026-03-27 10:56:40 [auto1.de] INFO: Scrape type for WX30683: 0
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: RZ67048
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ67048%27 HTTP/1.1" 200 None
2026-03-27 10:56:40 [auto1.de] INFO: Scrape type for RZ67048: 0
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: JC54567
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC54567%27 HTTP/1.1" 200 None
2026-03-27 10:56:40 [auto1.de] INFO: Scrape type for JC54567: 0
2026-03-27 10:56:40 [auto1.de] INFO: Found listing with ID: GM14403
2026-03-27 10:56:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:42 [auto1.de] INFO: Channel: 24h | Page: 114 | totalHits: 10618 | hits on page: 40
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: BV45977
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: ES90262
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: VX44094
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX44094%27 HTTP/1.1" 200 None
2026-03-27 10:56:42 [auto1.de] INFO: Scrape type for VX44094: 0
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: GS25653
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: GU38218
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU38218%27 HTTP/1.1" 200 None
2026-03-27 10:56:42 [auto1.de] INFO: Scrape type for GU38218: 0
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: CT19621
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: KT67254
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: UD97315
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: TS90843
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS90843%27 HTTP/1.1" 200 None
2026-03-27 10:56:42 [auto1.de] INFO: Scrape type for TS90843: 0
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: EF37274
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: LZ37842
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ37842%27 HTTP/1.1" 200 None
2026-03-27 10:56:42 [auto1.de] INFO: Scrape type for LZ37842: 0
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: VF92951
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: KW73679
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: GF83151
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF83151%27 HTTP/1.1" 200 None
2026-03-27 10:56:42 [auto1.de] INFO: Scrape type for GF83151: 0
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: MS74297
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS74297%27 HTTP/1.1" 200 None
2026-03-27 10:56:42 [auto1.de] INFO: Scrape type for MS74297: 0
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: UM65045
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: FM68959
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM68959%27 HTTP/1.1" 200 None
2026-03-27 10:56:42 [auto1.de] INFO: Scrape type for FM68959: 0
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: UP04235
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP04235%27 HTTP/1.1" 200 None
2026-03-27 10:56:42 [auto1.de] INFO: Scrape type for UP04235: 0
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: DG66548
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG66548%27 HTTP/1.1" 200 None
2026-03-27 10:56:42 [auto1.de] INFO: Scrape type for DG66548: 0
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: YL21525
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL21525%27 HTTP/1.1" 200 None
2026-03-27 10:56:42 [auto1.de] INFO: Scrape type for YL21525: 0
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: SE74775
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: HX35257
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX35257%27 HTTP/1.1" 200 None
2026-03-27 10:56:42 [auto1.de] INFO: Scrape type for HX35257: 0
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: GJ17420
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ17420%27 HTTP/1.1" 200 None
2026-03-27 10:56:42 [auto1.de] INFO: Scrape type for GJ17420: 0
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: GE45288
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE45288%27 HTTP/1.1" 200 None
2026-03-27 10:56:42 [auto1.de] INFO: Scrape type for GE45288: 0
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: GD02495
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: BH77652
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH77652%27 HTTP/1.1" 200 None
2026-03-27 10:56:42 [auto1.de] INFO: Scrape type for BH77652: 0
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: EG23428
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: EY99757
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: PC83497
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC83497%27 HTTP/1.1" 200 None
2026-03-27 10:56:42 [auto1.de] INFO: Scrape type for PC83497: 0
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: UC67308
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC67308%27 HTTP/1.1" 200 None
2026-03-27 10:56:42 [auto1.de] INFO: Scrape type for UC67308: 0
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: FD73392
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD73392%27 HTTP/1.1" 200 None
2026-03-27 10:56:42 [auto1.de] INFO: Scrape type for FD73392: 0
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: LB62140
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB62140%27 HTTP/1.1" 200 None
2026-03-27 10:56:42 [auto1.de] INFO: Scrape type for LB62140: 0
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: KA96977
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: ND32607
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: SL68511
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL68511%27 HTTP/1.1" 200 None
2026-03-27 10:56:42 [auto1.de] INFO: Scrape type for SL68511: 0
2026-03-27 10:56:42 [auto1.de] INFO: Found listing with ID: FR24268
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR24268%27 HTTP/1.1" 200 None
2026-03-27 10:56:42 [auto1.de] INFO: Scrape type for FR24268: 2
2026-03-27 10:56:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abb061b7-ae2a-556f-8cad-8ae83c63b63d with identifier: FR24268
2026-03-27 10:56:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abb061b7-ae2a-556f-8cad-8ae83c63b63d with scrape type 2
2026-03-27 10:56:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abb061b7-ae2a-556f-8cad-8ae83c63b63d with scrape type 2
2026-03-27 10:56:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abb061b7-ae2a-556f-8cad-8ae83c63b63d, identifier: FR24268
2026-03-27 10:56:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abb061b7-ae2a-556f-8cad-8ae83c63b63d with identifier: FR24268
2026-03-27 10:56:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abb061b7-ae2a-556f-8cad-8ae83c63b63d with identifier: FR24268
2026-03-27 10:56:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abb061b7-ae2a-556f-8cad-8ae83c63b63d with identifier: FR24268 to the API
2026-03-27 10:56:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:56:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:56:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-27T16:33:22Z',
 'fuel_type': 'hybrid',
 'id': 'abb061b7-ae2a-556f-8cad-8ae83c63b63d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR24268',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 20732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-29',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300e T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2023}
2026-03-27 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR24268%27 HTTP/1.1" 200 None
2026-03-27 10:56:43 [auto1.de] INFO: Saving data for FR24268: {'auction_closing_time': 1774629202.0, 'created_time': 1774424142.471602, 'last_price_update_time': 1774609003.381873}
2026-03-27 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR24268') HTTP/1.1" 204 0
2026-03-27 10:56:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:43 [auto1.de] INFO: Found listing with ID: GG24255
2026-03-27 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG24255%27 HTTP/1.1" 200 None
2026-03-27 10:56:43 [auto1.de] INFO: Scrape type for GG24255: 0
2026-03-27 10:56:43 [auto1.de] INFO: Found listing with ID: RD24777
2026-03-27 10:56:43 [auto1.de] INFO: Found listing with ID: MM34283
2026-03-27 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM34283%27 HTTP/1.1" 200 None
2026-03-27 10:56:43 [auto1.de] INFO: Scrape type for MM34283: 0
2026-03-27 10:56:43 [auto1.de] INFO: Found listing with ID: CC70846
2026-03-27 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC70846%27 HTTP/1.1" 200 None
2026-03-27 10:56:43 [auto1.de] INFO: Scrape type for CC70846: 0
2026-03-27 10:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:44 [auto1.de] INFO: Channel: 24h | Page: 115 | totalHits: 10618 | hits on page: 40
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: BM72660
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM72660%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for BM72660: 0
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: PB37282
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB37282%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for PB37282: 0
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: WL29620
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: ZF15605
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF15605%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for ZF15605: 0
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: UK82813
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK82813%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for UK82813: 0
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: FK98396
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK98396%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for FK98396: 0
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: ZR95094
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR95094%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for ZR95094: 0
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: FP63780
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP63780%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for FP63780: 0
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: FV50908
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: VG50922
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG50922%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for VG50922: 0
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: BU33854
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU33854%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for BU33854: 0
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: FG17963
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: XK53444
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK53444%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for XK53444: 0
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: PS14610
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS14610%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for PS14610: 0
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: YU07668
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU07668%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for YU07668: 0
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: ZN92027
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN92027%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for ZN92027: 0
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: RW72092
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: TL19983
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: BM83002
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM83002%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for BM83002: 0
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: VT99201
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: LC22080
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC22080%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for LC22080: 0
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: BY41560
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY41560%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for BY41560: 0
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: BV91761
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV91761%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for BV91761: 0
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: BS54687
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: XW55257
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: SZ17598
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: DR48053
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: XP97772
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: RS25965
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: TE51742
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE51742%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for TE51742: 0
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: HZ27782
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: LW98251
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: AS86297
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: MC08207
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: GH70383
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH70383%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for GH70383: 0
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: CC31467
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: JR79964
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR79964%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for JR79964: 0
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: DM27402
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27402%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for DM27402: 0
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: ZH99212
2026-03-27 10:56:44 [auto1.de] INFO: Found listing with ID: SR07530
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR07530%27 HTTP/1.1" 200 None
2026-03-27 10:56:44 [auto1.de] INFO: Scrape type for SR07530: 0
2026-03-27 10:56:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:45 [auto1.de] INFO: Channel: 24h | Page: 116 | totalHits: 10618 | hits on page: 40
2026-03-27 10:56:45 [auto1.de] INFO: Found listing with ID: CS95663
2026-03-27 10:56:45 [auto1.de] INFO: Found listing with ID: KU76096
2026-03-27 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU76096%27 HTTP/1.1" 200 None
2026-03-27 10:56:45 [auto1.de] INFO: Scrape type for KU76096: 0
2026-03-27 10:56:45 [auto1.de] INFO: Found listing with ID: KK74048
2026-03-27 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK74048%27 HTTP/1.1" 200 None
2026-03-27 10:56:45 [auto1.de] INFO: Scrape type for KK74048: 0
2026-03-27 10:56:45 [auto1.de] INFO: Found listing with ID: FM34812
2026-03-27 10:56:45 [auto1.de] INFO: Found listing with ID: AZ98687
2026-03-27 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ98687%27 HTTP/1.1" 200 None
2026-03-27 10:56:45 [auto1.de] INFO: Scrape type for AZ98687: 0
2026-03-27 10:56:45 [auto1.de] INFO: Found listing with ID: RR62010
2026-03-27 10:56:45 [auto1.de] INFO: Found listing with ID: DS79921
2026-03-27 10:56:45 [auto1.de] INFO: Found listing with ID: JX05743
2026-03-27 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX05743%27 HTTP/1.1" 200 None
2026-03-27 10:56:45 [auto1.de] INFO: Scrape type for JX05743: 0
2026-03-27 10:56:45 [auto1.de] INFO: Found listing with ID: NW61921
2026-03-27 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW61921%27 HTTP/1.1" 200 None
2026-03-27 10:56:45 [auto1.de] INFO: Scrape type for NW61921: 0
2026-03-27 10:56:45 [auto1.de] INFO: Found listing with ID: JN73492
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN73492%27 HTTP/1.1" 200 None
2026-03-27 10:56:46 [auto1.de] INFO: Scrape type for JN73492: 0
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: HZ13557
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ13557%27 HTTP/1.1" 200 None
2026-03-27 10:56:46 [auto1.de] INFO: Scrape type for HZ13557: 0
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: YY27100
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: GG58124
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: RX10275
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX10275%27 HTTP/1.1" 200 None
2026-03-27 10:56:46 [auto1.de] INFO: Scrape type for RX10275: 0
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: SU53309
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: BZ25882
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ25882%27 HTTP/1.1" 200 None
2026-03-27 10:56:46 [auto1.de] INFO: Scrape type for BZ25882: 0
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: JW40764
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: LH57585
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH57585%27 HTTP/1.1" 200 None
2026-03-27 10:56:46 [auto1.de] INFO: Scrape type for LH57585: 0
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: NM07920
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: AF72986
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF72986%27 HTTP/1.1" 200 None
2026-03-27 10:56:46 [auto1.de] INFO: Scrape type for AF72986: 0
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: TB76582
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: PN91954
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN91954%27 HTTP/1.1" 200 None
2026-03-27 10:56:46 [auto1.de] INFO: Scrape type for PN91954: 0
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: LX13795
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX13795%27 HTTP/1.1" 200 None
2026-03-27 10:56:46 [auto1.de] INFO: Scrape type for LX13795: 0
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: EB21377
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB21377%27 HTTP/1.1" 200 None
2026-03-27 10:56:46 [auto1.de] INFO: Scrape type for EB21377: 0
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: WV50385
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: VF58468
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: EL21875
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL21875%27 HTTP/1.1" 200 None
2026-03-27 10:56:46 [auto1.de] INFO: Scrape type for EL21875: 0
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: AD89648
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD89648%27 HTTP/1.1" 200 None
2026-03-27 10:56:46 [auto1.de] INFO: Scrape type for AD89648: 0
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: CL50469
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL50469%27 HTTP/1.1" 200 None
2026-03-27 10:56:46 [auto1.de] INFO: Scrape type for CL50469: 0
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: CS62800
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS62800%27 HTTP/1.1" 200 None
2026-03-27 10:56:46 [auto1.de] INFO: Scrape type for CS62800: 0
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: VX30414
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: JB77026
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB77026%27 HTTP/1.1" 200 None
2026-03-27 10:56:46 [auto1.de] INFO: Scrape type for JB77026: 0
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: RH70764
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: JW61268
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW61268%27 HTTP/1.1" 200 None
2026-03-27 10:56:46 [auto1.de] INFO: Scrape type for JW61268: 0
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: GR83523
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR83523%27 HTTP/1.1" 200 None
2026-03-27 10:56:46 [auto1.de] INFO: Scrape type for GR83523: 0
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: CF23775
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF23775%27 HTTP/1.1" 200 None
2026-03-27 10:56:46 [auto1.de] INFO: Scrape type for CF23775: 0
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: RG32051
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: UR62816
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR62816%27 HTTP/1.1" 200 None
2026-03-27 10:56:46 [auto1.de] INFO: Scrape type for UR62816: 0
2026-03-27 10:56:46 [auto1.de] INFO: Found listing with ID: DZ60663
2026-03-27 10:56:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:47 [auto1.de] INFO: Channel: 24h | Page: 117 | totalHits: 10618 | hits on page: 40
2026-03-27 10:56:47 [auto1.de] INFO: Found listing with ID: JK90168
2026-03-27 10:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK90168%27 HTTP/1.1" 200 None
2026-03-27 10:56:47 [auto1.de] INFO: Scrape type for JK90168: 2
2026-03-27 10:56:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a79ee45a-2774-58de-a0ea-31f9c153bdd9 with identifier: JK90168
2026-03-27 10:56:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a79ee45a-2774-58de-a0ea-31f9c153bdd9 with scrape type 2
2026-03-27 10:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a79ee45a-2774-58de-a0ea-31f9c153bdd9 with scrape type 2
2026-03-27 10:56:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a79ee45a-2774-58de-a0ea-31f9c153bdd9, identifier: JK90168
2026-03-27 10:56:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a79ee45a-2774-58de-a0ea-31f9c153bdd9 with identifier: JK90168
2026-03-27 10:56:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a79ee45a-2774-58de-a0ea-31f9c153bdd9 with identifier: JK90168
2026-03-27 10:56:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a79ee45a-2774-58de-a0ea-31f9c153bdd9 with identifier: JK90168 to the API
2026-03-27 10:56:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:56:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:56:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:37:16Z',
 'fuel_type': 'diesel',
 'id': 'a79ee45a-2774-58de-a0ea-31f9c153bdd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK90168',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 207533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-27 10:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK90168%27 HTTP/1.1" 200 None
2026-03-27 10:56:47 [auto1.de] INFO: Saving data for JK90168: {'auction_closing_time': 1774629436.0, 'created_time': 1773830271.779663, 'last_price_update_time': 1774609007.853249}
2026-03-27 10:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK90168') HTTP/1.1" 204 0
2026-03-27 10:56:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:47 [auto1.de] INFO: Found listing with ID: VU23200
2026-03-27 10:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU23200%27 HTTP/1.1" 200 None
2026-03-27 10:56:47 [auto1.de] INFO: Scrape type for VU23200: 0
2026-03-27 10:56:47 [auto1.de] INFO: Found listing with ID: HY48738
2026-03-27 10:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY48738%27 HTTP/1.1" 200 None
2026-03-27 10:56:48 [auto1.de] INFO: Scrape type for HY48738: 0
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: UN81742
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: SP65722
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: RL02084
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: SW30333
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW30333%27 HTTP/1.1" 200 None
2026-03-27 10:56:48 [auto1.de] INFO: Scrape type for SW30333: 0
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: YN03957
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: DT42363
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT42363%27 HTTP/1.1" 200 None
2026-03-27 10:56:48 [auto1.de] INFO: Scrape type for DT42363: 0
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: CB00446
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: ZA73263
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA73263%27 HTTP/1.1" 200 None
2026-03-27 10:56:48 [auto1.de] INFO: Scrape type for ZA73263: 0
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: MY02609
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY02609%27 HTTP/1.1" 200 None
2026-03-27 10:56:48 [auto1.de] INFO: Scrape type for MY02609: 0
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: KL79977
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL79977%27 HTTP/1.1" 200 None
2026-03-27 10:56:48 [auto1.de] INFO: Scrape type for KL79977: 0
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: EK84177
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: BC48090
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC48090%27 HTTP/1.1" 200 None
2026-03-27 10:56:48 [auto1.de] INFO: Scrape type for BC48090: 0
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: GL08454
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: NJ32517
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: VN46123
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN46123%27 HTTP/1.1" 200 None
2026-03-27 10:56:48 [auto1.de] INFO: Scrape type for VN46123: 0
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: SU78317
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU78317%27 HTTP/1.1" 200 None
2026-03-27 10:56:48 [auto1.de] INFO: Scrape type for SU78317: 0
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: LD10656
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD10656%27 HTTP/1.1" 200 None
2026-03-27 10:56:48 [auto1.de] INFO: Scrape type for LD10656: 0
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: PK27483
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK27483%27 HTTP/1.1" 200 None
2026-03-27 10:56:48 [auto1.de] INFO: Scrape type for PK27483: 0
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: NS28302
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: SA90137
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: VC92798
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: XL53719
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL53719%27 HTTP/1.1" 200 None
2026-03-27 10:56:48 [auto1.de] INFO: Scrape type for XL53719: 0
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: RJ02288
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ02288%27 HTTP/1.1" 200 None
2026-03-27 10:56:48 [auto1.de] INFO: Scrape type for RJ02288: 0
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: YX50554
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX50554%27 HTTP/1.1" 200 None
2026-03-27 10:56:48 [auto1.de] INFO: Scrape type for YX50554: 0
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: LY44491
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: JV32870
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: JZ59846
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: TR42945
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR42945%27 HTTP/1.1" 200 None
2026-03-27 10:56:48 [auto1.de] INFO: Scrape type for TR42945: 0
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: ET75266
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: TC16779
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC16779%27 HTTP/1.1" 200 None
2026-03-27 10:56:48 [auto1.de] INFO: Scrape type for TC16779: 0
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: ZF09358
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF09358%27 HTTP/1.1" 200 None
2026-03-27 10:56:48 [auto1.de] INFO: Scrape type for ZF09358: 0
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: YS83554
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: XC77974
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: SY14600
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: MM98410
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: LF00427
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF00427%27 HTTP/1.1" 200 None
2026-03-27 10:56:48 [auto1.de] INFO: Scrape type for LF00427: 0
2026-03-27 10:56:48 [auto1.de] INFO: Found listing with ID: AT55034
2026-03-27 10:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:49 [auto1.de] INFO: Channel: 24h | Page: 118 | totalHits: 10618 | hits on page: 40
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: LH02136
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH02136%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for LH02136: 0
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: PW87460
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW87460%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for PW87460: 0
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: HH84290
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH84290%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for HH84290: 0
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: NY16629
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: DA63905
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA63905%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for DA63905: 0
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: VR30275
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR30275%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for VR30275: 0
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: PZ57242
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ57242%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for PZ57242: 0
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: NK94072
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK94072%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for NK94072: 0
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: WW75764
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW75764%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for WW75764: 0
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: UL25580
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: TV25506
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV25506%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for TV25506: 0
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: AK82908
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK82908%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for AK82908: 0
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: EJ87927
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ87927%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for EJ87927: 0
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: DN67284
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: JP52122
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: BX09216
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: PF14762
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF14762%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for PF14762: 0
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: EZ01332
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: HC12239
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: ES78783
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES78783%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for ES78783: 0
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: FY31029
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: FK20948
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: AN16579
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: FU26438
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: ZV14288
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: WR44415
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: CM46139
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: PK49409
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK49409%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for PK49409: 0
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: AL53534
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL53534%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for AL53534: 0
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: GJ54117
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ54117%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for GJ54117: 0
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: JF38647
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: AP70373
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP70373%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for AP70373: 0
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: BK48500
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: YA30730
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: BH90512
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: CL57591
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL57591%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for CL57591: 0
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: UE81207
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE81207%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for UE81207: 0
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: TB55378
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB55378%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for TB55378: 0
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: GG80957
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG80957%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for GG80957: 0
2026-03-27 10:56:49 [auto1.de] INFO: Found listing with ID: LS78763
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS78763%27 HTTP/1.1" 200 None
2026-03-27 10:56:49 [auto1.de] INFO: Scrape type for LS78763: 0
2026-03-27 10:56:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:50 [auto1.de] INFO: Channel: 24h | Page: 119 | totalHits: 10618 | hits on page: 40
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: BT59614
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: TC03935
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC03935%27 HTTP/1.1" 200 None
2026-03-27 10:56:50 [auto1.de] INFO: Scrape type for TC03935: 0
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: TD37503
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD37503%27 HTTP/1.1" 200 None
2026-03-27 10:56:50 [auto1.de] INFO: Scrape type for TD37503: 0
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: PD00491
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: PA10623
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: RY67208
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY67208%27 HTTP/1.1" 200 None
2026-03-27 10:56:50 [auto1.de] INFO: Scrape type for RY67208: 0
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: ND85219
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: KS12062
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: UA60453
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA60453%27 HTTP/1.1" 200 None
2026-03-27 10:56:50 [auto1.de] INFO: Scrape type for UA60453: 0
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: LB61549
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: TY52919
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: GK30038
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK30038%27 HTTP/1.1" 200 None
2026-03-27 10:56:50 [auto1.de] INFO: Scrape type for GK30038: 0
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: ZS61944
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: NJ70051
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: BK00548
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: PJ28903
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: KJ51588
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ51588%27 HTTP/1.1" 200 None
2026-03-27 10:56:50 [auto1.de] INFO: Scrape type for KJ51588: 0
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: DL48053
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL48053%27 HTTP/1.1" 200 None
2026-03-27 10:56:50 [auto1.de] INFO: Scrape type for DL48053: 0
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: DZ51927
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: NP48335
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: LU87802
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: FD74109
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: SP65010
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: BU12505
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: LA57205
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA57205%27 HTTP/1.1" 200 None
2026-03-27 10:56:50 [auto1.de] INFO: Scrape type for LA57205: 0
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: SB33889
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB33889%27 HTTP/1.1" 200 None
2026-03-27 10:56:50 [auto1.de] INFO: Scrape type for SB33889: 0
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: AG20717
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG20717%27 HTTP/1.1" 200 None
2026-03-27 10:56:50 [auto1.de] INFO: Scrape type for AG20717: 0
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: WU98918
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: DY62455
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY62455%27 HTTP/1.1" 200 None
2026-03-27 10:56:50 [auto1.de] INFO: Scrape type for DY62455: 0
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: VV73959
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: NC61383
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC61383%27 HTTP/1.1" 200 None
2026-03-27 10:56:50 [auto1.de] INFO: Scrape type for NC61383: 0
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: DM27876
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: PM90514
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM90514%27 HTTP/1.1" 200 None
2026-03-27 10:56:50 [auto1.de] INFO: Scrape type for PM90514: 0
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: HC41617
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: ZX49243
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX49243%27 HTTP/1.1" 200 None
2026-03-27 10:56:50 [auto1.de] INFO: Scrape type for ZX49243: 0
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: FZ35057
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ35057%27 HTTP/1.1" 200 None
2026-03-27 10:56:50 [auto1.de] INFO: Scrape type for FZ35057: 0
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: PC62388
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: XJ22163
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ22163%27 HTTP/1.1" 200 None
2026-03-27 10:56:50 [auto1.de] INFO: Scrape type for XJ22163: 0
2026-03-27 10:56:50 [auto1.de] INFO: Found listing with ID: BU12170
2026-03-27 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU12170%27 HTTP/1.1" 200 None
2026-03-27 10:56:51 [auto1.de] INFO: Scrape type for BU12170: 0
2026-03-27 10:56:51 [auto1.de] INFO: Found listing with ID: AR53844
2026-03-27 10:56:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:52 [auto1.de] INFO: Channel: 24h | Page: 120 | totalHits: 10618 | hits on page: 40
2026-03-27 10:56:52 [auto1.de] INFO: Found listing with ID: LU32216
2026-03-27 10:56:52 [auto1.de] INFO: Found listing with ID: RK75566
2026-03-27 10:56:52 [auto1.de] INFO: Found listing with ID: EX64798
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX64798%27 HTTP/1.1" 200 None
2026-03-27 10:56:52 [auto1.de] INFO: Scrape type for EX64798: 0
2026-03-27 10:56:52 [auto1.de] INFO: Found listing with ID: LN75717
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN75717%27 HTTP/1.1" 200 None
2026-03-27 10:56:52 [auto1.de] INFO: Scrape type for LN75717: 0
2026-03-27 10:56:52 [auto1.de] INFO: Found listing with ID: CL99107
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL99107%27 HTTP/1.1" 200 None
2026-03-27 10:56:52 [auto1.de] INFO: Scrape type for CL99107: 0
2026-03-27 10:56:52 [auto1.de] INFO: Found listing with ID: BK49695
2026-03-27 10:56:52 [auto1.de] INFO: Found listing with ID: DL52557
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL52557%27 HTTP/1.1" 200 None
2026-03-27 10:56:52 [auto1.de] INFO: Scrape type for DL52557: 0
2026-03-27 10:56:52 [auto1.de] INFO: Found listing with ID: KV40147
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV40147%27 HTTP/1.1" 200 None
2026-03-27 10:56:52 [auto1.de] INFO: Scrape type for KV40147: 0
2026-03-27 10:56:52 [auto1.de] INFO: Found listing with ID: SV70858
2026-03-27 10:56:52 [auto1.de] INFO: Found listing with ID: UN52342
2026-03-27 10:56:52 [auto1.de] INFO: Found listing with ID: KV09163
2026-03-27 10:56:52 [auto1.de] INFO: Found listing with ID: NP20797
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP20797%27 HTTP/1.1" 200 None
2026-03-27 10:56:52 [auto1.de] INFO: Scrape type for NP20797: 0
2026-03-27 10:56:52 [auto1.de] INFO: Found listing with ID: XE20861
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE20861%27 HTTP/1.1" 200 None
2026-03-27 10:56:52 [auto1.de] INFO: Scrape type for XE20861: 0
2026-03-27 10:56:52 [auto1.de] INFO: Found listing with ID: YF97500
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF97500%27 HTTP/1.1" 200 None
2026-03-27 10:56:52 [auto1.de] INFO: Scrape type for YF97500: 0
2026-03-27 10:56:52 [auto1.de] INFO: Found listing with ID: RE74937
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE74937%27 HTTP/1.1" 200 None
2026-03-27 10:56:52 [auto1.de] INFO: Scrape type for RE74937: 0
2026-03-27 10:56:52 [auto1.de] INFO: Found listing with ID: XX78799
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX78799%27 HTTP/1.1" 200 None
2026-03-27 10:56:52 [auto1.de] INFO: Scrape type for XX78799: 0
2026-03-27 10:56:52 [auto1.de] INFO: Found listing with ID: WH09433
2026-03-27 10:56:52 [auto1.de] INFO: Found listing with ID: EV87086
2026-03-27 10:56:52 [auto1.de] INFO: Found listing with ID: DD41075
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD41075%27 HTTP/1.1" 200 None
2026-03-27 10:56:52 [auto1.de] INFO: Scrape type for DD41075: 2
2026-03-27 10:56:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ef04ec1-5713-54a0-9b17-81dc641cb3a7 with identifier: DD41075
2026-03-27 10:56:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ef04ec1-5713-54a0-9b17-81dc641cb3a7 with scrape type 2
2026-03-27 10:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ef04ec1-5713-54a0-9b17-81dc641cb3a7 with scrape type 2
2026-03-27 10:56:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ef04ec1-5713-54a0-9b17-81dc641cb3a7, identifier: DD41075
2026-03-27 10:56:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ef04ec1-5713-54a0-9b17-81dc641cb3a7 with identifier: DD41075
2026-03-27 10:56:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ef04ec1-5713-54a0-9b17-81dc641cb3a7 with identifier: DD41075
2026-03-27 10:56:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ef04ec1-5713-54a0-9b17-81dc641cb3a7 with identifier: DD41075 to the API
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:56:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:29:03Z',
 'fuel_type': 'petrol',
 'id': '5ef04ec1-5713-54a0-9b17-81dc641cb3a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD41075',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 134009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-06',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.4 Turbo Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD41075%27 HTTP/1.1" 200 None
2026-03-27 10:56:52 [auto1.de] INFO: Saving data for DD41075: {'auction_closing_time': 1774628943.0, 'created_time': 1773132738.163623, 'last_price_update_time': 1774609012.975062}
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD41075') HTTP/1.1" 204 0
2026-03-27 10:56:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:53 [auto1.de] INFO: Found listing with ID: WT87490
2026-03-27 10:56:53 [auto1.de] INFO: Found listing with ID: FD74208
2026-03-27 10:56:53 [auto1.de] INFO: Found listing with ID: HR39540
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR39540%27 HTTP/1.1" 200 None
2026-03-27 10:56:53 [auto1.de] INFO: Scrape type for HR39540: 0
2026-03-27 10:56:53 [auto1.de] INFO: Found listing with ID: JF45279
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF45279%27 HTTP/1.1" 200 None
2026-03-27 10:56:53 [auto1.de] INFO: Scrape type for JF45279: 0
2026-03-27 10:56:53 [auto1.de] INFO: Found listing with ID: YA96951
2026-03-27 10:56:53 [auto1.de] INFO: Found listing with ID: RK34860
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK34860%27 HTTP/1.1" 200 None
2026-03-27 10:56:53 [auto1.de] INFO: Scrape type for RK34860: 0
2026-03-27 10:56:53 [auto1.de] INFO: Found listing with ID: XS40942
2026-03-27 10:56:53 [auto1.de] INFO: Found listing with ID: VD18185
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD18185%27 HTTP/1.1" 200 None
2026-03-27 10:56:53 [auto1.de] INFO: Scrape type for VD18185: 2
2026-03-27 10:56:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfa19310-6d1e-5bea-9a80-743a159c982d with identifier: VD18185
2026-03-27 10:56:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfa19310-6d1e-5bea-9a80-743a159c982d with scrape type 2
2026-03-27 10:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfa19310-6d1e-5bea-9a80-743a159c982d with scrape type 2
2026-03-27 10:56:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfa19310-6d1e-5bea-9a80-743a159c982d, identifier: VD18185
2026-03-27 10:56:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfa19310-6d1e-5bea-9a80-743a159c982d with identifier: VD18185
2026-03-27 10:56:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfa19310-6d1e-5bea-9a80-743a159c982d with identifier: VD18185
2026-03-27 10:56:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfa19310-6d1e-5bea-9a80-743a159c982d with identifier: VD18185 to the API
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:56:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:23:50Z',
 'fuel_type': 'petrol',
 'id': 'cfa19310-6d1e-5bea-9a80-743a159c982d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD18185',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 104031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-28',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2010}
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD18185%27 HTTP/1.1" 200 None
2026-03-27 10:56:53 [auto1.de] INFO: Saving data for VD18185: {'auction_closing_time': 1774628630.0, 'created_time': 1774424145.972359, 'last_price_update_time': 1774609013.596752}
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VD18185') HTTP/1.1" 204 0
2026-03-27 10:56:53 [auto1.de] INFO: Found listing with ID: RU45291
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU45291%27 HTTP/1.1" 200 None
2026-03-27 10:56:53 [auto1.de] INFO: Scrape type for RU45291: 0
2026-03-27 10:56:53 [auto1.de] INFO: Found listing with ID: NG85198
2026-03-27 10:56:53 [auto1.de] INFO: Found listing with ID: SA38471
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA38471%27 HTTP/1.1" 200 None
2026-03-27 10:56:53 [auto1.de] INFO: Scrape type for SA38471: 0
2026-03-27 10:56:53 [auto1.de] INFO: Found listing with ID: GP74205
2026-03-27 10:56:53 [auto1.de] INFO: Found listing with ID: TK44057
2026-03-27 10:56:53 [auto1.de] INFO: Found listing with ID: NS90051
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS90051%27 HTTP/1.1" 200 None
2026-03-27 10:56:53 [auto1.de] INFO: Scrape type for NS90051: 0
2026-03-27 10:56:53 [auto1.de] INFO: Found listing with ID: UZ22488
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ22488%27 HTTP/1.1" 200 None
2026-03-27 10:56:53 [auto1.de] INFO: Scrape type for UZ22488: 0
2026-03-27 10:56:53 [auto1.de] INFO: Found listing with ID: AT13824
2026-03-27 10:56:53 [auto1.de] INFO: Found listing with ID: VT96946
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT96946%27 HTTP/1.1" 200 None
2026-03-27 10:56:53 [auto1.de] INFO: Scrape type for VT96946: 0
2026-03-27 10:56:53 [auto1.de] INFO: Found listing with ID: TX29096
2026-03-27 10:56:53 [auto1.de] INFO: Found listing with ID: YB47144
2026-03-27 10:56:53 [auto1.de] INFO: Found listing with ID: HZ35623
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35623%27 HTTP/1.1" 200 None
2026-03-27 10:56:53 [auto1.de] INFO: Scrape type for HZ35623: 0
2026-03-27 10:56:53 [auto1.de] INFO: Found listing with ID: FP43907
2026-03-27 10:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:54 [auto1.de] INFO: Channel: 24h | Page: 121 | totalHits: 10618 | hits on page: 40
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: AC62471
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: FC08101
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: KD44846
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: MK52879
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: XF35654
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF35654%27 HTTP/1.1" 200 None
2026-03-27 10:56:54 [auto1.de] INFO: Scrape type for XF35654: 0
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: EM09093
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM09093%27 HTTP/1.1" 200 None
2026-03-27 10:56:54 [auto1.de] INFO: Scrape type for EM09093: 0
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: CP28896
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: JD16678
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: BK52975
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK52975%27 HTTP/1.1" 200 None
2026-03-27 10:56:54 [auto1.de] INFO: Scrape type for BK52975: 0
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: VG95526
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG95526%27 HTTP/1.1" 200 None
2026-03-27 10:56:54 [auto1.de] INFO: Scrape type for VG95526: 0
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: TW48266
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW48266%27 HTTP/1.1" 200 None
2026-03-27 10:56:54 [auto1.de] INFO: Scrape type for TW48266: 0
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: LL62028
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: AT18561
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: KU60138
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: PB12749
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: AG44550
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG44550%27 HTTP/1.1" 200 None
2026-03-27 10:56:54 [auto1.de] INFO: Scrape type for AG44550: 0
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: DY53680
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY53680%27 HTTP/1.1" 200 None
2026-03-27 10:56:54 [auto1.de] INFO: Scrape type for DY53680: 0
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: LP42404
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP42404%27 HTTP/1.1" 200 None
2026-03-27 10:56:54 [auto1.de] INFO: Scrape type for LP42404: 0
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: BJ65767
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: AX52249
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: JM14799
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM14799%27 HTTP/1.1" 200 None
2026-03-27 10:56:54 [auto1.de] INFO: Scrape type for JM14799: 0
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: XE13119
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE13119%27 HTTP/1.1" 200 None
2026-03-27 10:56:54 [auto1.de] INFO: Scrape type for XE13119: 0
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: SH94739
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: RZ65813
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ65813%27 HTTP/1.1" 200 None
2026-03-27 10:56:54 [auto1.de] INFO: Scrape type for RZ65813: 0
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: RE36292
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: YJ74621
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ74621%27 HTTP/1.1" 200 None
2026-03-27 10:56:54 [auto1.de] INFO: Scrape type for YJ74621: 0
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: FT98608
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT98608%27 HTTP/1.1" 200 None
2026-03-27 10:56:54 [auto1.de] INFO: Scrape type for FT98608: 0
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: GB35925
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: GB55666
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: CC55438
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: VL85345
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: HH32152
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH32152%27 HTTP/1.1" 200 None
2026-03-27 10:56:54 [auto1.de] INFO: Scrape type for HH32152: 0
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: AK97541
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: CW48443
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW48443%27 HTTP/1.1" 200 None
2026-03-27 10:56:54 [auto1.de] INFO: Scrape type for CW48443: 0
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: MY93423
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY93423%27 HTTP/1.1" 200 None
2026-03-27 10:56:54 [auto1.de] INFO: Scrape type for MY93423: 0
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: BT88026
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT88026%27 HTTP/1.1" 200 None
2026-03-27 10:56:54 [auto1.de] INFO: Scrape type for BT88026: 0
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: BT20350
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: WA51646
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA51646%27 HTTP/1.1" 200 None
2026-03-27 10:56:54 [auto1.de] INFO: Scrape type for WA51646: 0
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: SC80674
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC80674%27 HTTP/1.1" 200 None
2026-03-27 10:56:54 [auto1.de] INFO: Scrape type for SC80674: 0
2026-03-27 10:56:54 [auto1.de] INFO: Found listing with ID: DD14977
2026-03-27 10:56:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:55 [auto1.de] INFO: Channel: 24h | Page: 122 | totalHits: 10618 | hits on page: 40
2026-03-27 10:56:55 [auto1.de] INFO: Found listing with ID: VK27516
2026-03-27 10:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK27516%27 HTTP/1.1" 200 None
2026-03-27 10:56:55 [auto1.de] INFO: Scrape type for VK27516: 0
2026-03-27 10:56:55 [auto1.de] INFO: Found listing with ID: NZ42181
2026-03-27 10:56:55 [auto1.de] INFO: Found listing with ID: LC00841
2026-03-27 10:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC00841%27 HTTP/1.1" 200 None
2026-03-27 10:56:55 [auto1.de] INFO: Scrape type for LC00841: 0
2026-03-27 10:56:55 [auto1.de] INFO: Found listing with ID: LH00123
2026-03-27 10:56:55 [auto1.de] INFO: Found listing with ID: KW20728
2026-03-27 10:56:55 [auto1.de] INFO: Found listing with ID: VN84329
2026-03-27 10:56:55 [auto1.de] INFO: Found listing with ID: DD79201
2026-03-27 10:56:55 [auto1.de] INFO: Found listing with ID: HU68643
2026-03-27 10:56:55 [auto1.de] INFO: Found listing with ID: RE71424
2026-03-27 10:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE71424%27 HTTP/1.1" 200 None
2026-03-27 10:56:55 [auto1.de] INFO: Scrape type for RE71424: 0
2026-03-27 10:56:55 [auto1.de] INFO: Found listing with ID: DK90123
2026-03-27 10:56:55 [auto1.de] INFO: Found listing with ID: EG83317
2026-03-27 10:56:55 [auto1.de] INFO: Found listing with ID: SU75801
2026-03-27 10:56:55 [auto1.de] INFO: Found listing with ID: LN37721
2026-03-27 10:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN37721%27 HTTP/1.1" 200 None
2026-03-27 10:56:55 [auto1.de] INFO: Scrape type for LN37721: 0
2026-03-27 10:56:55 [auto1.de] INFO: Found listing with ID: WD13175
2026-03-27 10:56:55 [auto1.de] INFO: Found listing with ID: PB92284
2026-03-27 10:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB92284%27 HTTP/1.1" 200 None
2026-03-27 10:56:55 [auto1.de] INFO: Scrape type for PB92284: 0
2026-03-27 10:56:55 [auto1.de] INFO: Found listing with ID: AS97650
2026-03-27 10:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS97650%27 HTTP/1.1" 200 None
2026-03-27 10:56:55 [auto1.de] INFO: Scrape type for AS97650: 0
2026-03-27 10:56:55 [auto1.de] INFO: Found listing with ID: RJ65711
2026-03-27 10:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ65711%27 HTTP/1.1" 200 None
2026-03-27 10:56:56 [auto1.de] INFO: Scrape type for RJ65711: 0
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: VZ49069
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: HH26503
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: VZ69122
2026-03-27 10:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ69122%27 HTTP/1.1" 200 None
2026-03-27 10:56:56 [auto1.de] INFO: Scrape type for VZ69122: 0
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: RR06501
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: GG32216
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: UA55919
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: XK43796
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: AU05759
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: JD69388
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: UC51546
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: SU13954
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: FM20316
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: EC94378
2026-03-27 10:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC94378%27 HTTP/1.1" 200 None
2026-03-27 10:56:56 [auto1.de] INFO: Scrape type for EC94378: 0
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: PW66424
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: YH29601
2026-03-27 10:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH29601%27 HTTP/1.1" 200 None
2026-03-27 10:56:56 [auto1.de] INFO: Scrape type for YH29601: 0
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: HZ87755
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: BN35753
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: UF14922
2026-03-27 10:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF14922%27 HTTP/1.1" 200 None
2026-03-27 10:56:56 [auto1.de] INFO: Scrape type for UF14922: 0
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: FK98108
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: YF69717
2026-03-27 10:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF69717%27 HTTP/1.1" 200 None
2026-03-27 10:56:56 [auto1.de] INFO: Scrape type for YF69717: 0
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: BG27502
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: PR73222
2026-03-27 10:56:56 [auto1.de] INFO: Found listing with ID: GN12649
2026-03-27 10:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN12649%27 HTTP/1.1" 200 None
2026-03-27 10:56:56 [auto1.de] INFO: Scrape type for GN12649: 0
2026-03-27 10:56:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:56:57 [auto1.de] INFO: Channel: 24h | Page: 123 | totalHits: 10618 | hits on page: 40
2026-03-27 10:56:57 [auto1.de] INFO: Found listing with ID: RE00725
2026-03-27 10:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE00725%27 HTTP/1.1" 200 None
2026-03-27 10:56:57 [auto1.de] INFO: Scrape type for RE00725: 0
2026-03-27 10:56:57 [auto1.de] INFO: Found listing with ID: KD88399
2026-03-27 10:56:57 [auto1.de] INFO: Found listing with ID: LZ81605
2026-03-27 10:56:57 [auto1.de] INFO: Found listing with ID: ND37325
2026-03-27 10:56:57 [auto1.de] INFO: Found listing with ID: JE85586
2026-03-27 10:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE85586%27 HTTP/1.1" 200 None
2026-03-27 10:56:57 [auto1.de] INFO: Scrape type for JE85586: 0
2026-03-27 10:56:57 [auto1.de] INFO: Found listing with ID: KX87155
2026-03-27 10:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX87155%27 HTTP/1.1" 200 None
2026-03-27 10:56:57 [auto1.de] INFO: Scrape type for KX87155: 0
2026-03-27 10:56:57 [auto1.de] INFO: Found listing with ID: GM22494
2026-03-27 10:56:57 [auto1.de] INFO: Found listing with ID: ZR68100
2026-03-27 10:56:57 [auto1.de] INFO: Found listing with ID: JH57349
2026-03-27 10:56:57 [auto1.de] INFO: Found listing with ID: VD54257
2026-03-27 10:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD54257%27 HTTP/1.1" 200 None
2026-03-27 10:56:57 [auto1.de] INFO: Scrape type for VD54257: 0
2026-03-27 10:56:57 [auto1.de] INFO: Found listing with ID: BW05751
2026-03-27 10:56:57 [auto1.de] INFO: Found listing with ID: PC47475
2026-03-27 10:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC47475%27 HTTP/1.1" 200 None
2026-03-27 10:56:57 [auto1.de] INFO: Scrape type for PC47475: 0
2026-03-27 10:56:57 [auto1.de] INFO: Found listing with ID: PL37483
2026-03-27 10:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL37483%27 HTTP/1.1" 200 None
2026-03-27 10:56:57 [auto1.de] INFO: Scrape type for PL37483: 0
2026-03-27 10:56:57 [auto1.de] INFO: Found listing with ID: RV72867
2026-03-27 10:56:57 [auto1.de] INFO: Found listing with ID: JY16460
2026-03-27 10:56:57 [auto1.de] INFO: Found listing with ID: MG02873
2026-03-27 10:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG02873%27 HTTP/1.1" 200 None
2026-03-27 10:56:57 [auto1.de] INFO: Scrape type for MG02873: 0
2026-03-27 10:56:57 [auto1.de] INFO: Found listing with ID: JM29526
2026-03-27 10:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM29526%27 HTTP/1.1" 200 None
2026-03-27 10:56:57 [auto1.de] INFO: Scrape type for JM29526: 2
2026-03-27 10:56:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fd37bee-0b0d-51ef-b01d-573b7107f2c2 with identifier: JM29526
2026-03-27 10:56:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fd37bee-0b0d-51ef-b01d-573b7107f2c2 with scrape type 2
2026-03-27 10:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fd37bee-0b0d-51ef-b01d-573b7107f2c2 with scrape type 2
2026-03-27 10:56:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fd37bee-0b0d-51ef-b01d-573b7107f2c2, identifier: JM29526
2026-03-27 10:56:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fd37bee-0b0d-51ef-b01d-573b7107f2c2 with identifier: JM29526
2026-03-27 10:56:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fd37bee-0b0d-51ef-b01d-573b7107f2c2 with identifier: JM29526
2026-03-27 10:56:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fd37bee-0b0d-51ef-b01d-573b7107f2c2 with identifier: JM29526 to the API
2026-03-27 10:56:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:56:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:56:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-27T16:30:20Z',
 'fuel_type': 'petrol',
 'id': '1fd37bee-0b0d-51ef-b01d-573b7107f2c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM29526',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 121879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-01-01',
 'seller_name': None,
 'title': 'Toyota Yaris 1.3 VVT-i Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2008}
2026-03-27 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM29526%27 HTTP/1.1" 200 None
2026-03-27 10:56:58 [auto1.de] INFO: Saving data for JM29526: {'auction_closing_time': 1774629020.0, 'created_time': 1773830247.390089, 'last_price_update_time': 1774609018.743512}
2026-03-27 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM29526') HTTP/1.1" 204 0
2026-03-27 10:56:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:56:58 [auto1.de] INFO: Found listing with ID: JG98331
2026-03-27 10:56:58 [auto1.de] INFO: Found listing with ID: EP32297
2026-03-27 10:56:58 [auto1.de] INFO: Found listing with ID: JB42175
2026-03-27 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB42175%27 HTTP/1.1" 200 None
2026-03-27 10:56:58 [auto1.de] INFO: Scrape type for JB42175: 0
2026-03-27 10:56:58 [auto1.de] INFO: Found listing with ID: CH37782
2026-03-27 10:56:58 [auto1.de] INFO: Found listing with ID: VJ14955
2026-03-27 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ14955%27 HTTP/1.1" 200 None
2026-03-27 10:56:58 [auto1.de] INFO: Scrape type for VJ14955: 0
2026-03-27 10:56:58 [auto1.de] INFO: Found listing with ID: LJ09333
2026-03-27 10:56:58 [auto1.de] INFO: Found listing with ID: BF84298
2026-03-27 10:56:58 [auto1.de] INFO: Found listing with ID: JB95370
2026-03-27 10:56:58 [auto1.de] INFO: Found listing with ID: GX87864
2026-03-27 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX87864%27 HTTP/1.1" 200 None
2026-03-27 10:56:58 [auto1.de] INFO: Scrape type for GX87864: 0
2026-03-27 10:56:58 [auto1.de] INFO: Found listing with ID: WJ35456
2026-03-27 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ35456%27 HTTP/1.1" 200 None
2026-03-27 10:56:58 [auto1.de] INFO: Scrape type for WJ35456: 0
2026-03-27 10:56:58 [auto1.de] INFO: Found listing with ID: VL69924
2026-03-27 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL69924%27 HTTP/1.1" 200 None
2026-03-27 10:56:58 [auto1.de] INFO: Scrape type for VL69924: 0
2026-03-27 10:56:58 [auto1.de] INFO: Found listing with ID: HE16433
2026-03-27 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE16433%27 HTTP/1.1" 200 None
2026-03-27 10:56:58 [auto1.de] INFO: Scrape type for HE16433: 0
2026-03-27 10:56:58 [auto1.de] INFO: Found listing with ID: KG91640
2026-03-27 10:56:58 [auto1.de] INFO: Found listing with ID: DH73043
2026-03-27 10:56:58 [auto1.de] INFO: Found listing with ID: ZZ68403
2026-03-27 10:56:58 [auto1.de] INFO: Found listing with ID: DP90714
2026-03-27 10:56:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP90714%27 HTTP/1.1" 200 None
2026-03-27 10:56:59 [auto1.de] INFO: Scrape type for DP90714: 0
2026-03-27 10:56:59 [auto1.de] INFO: Found listing with ID: JL65516
2026-03-27 10:56:59 [auto1.de] INFO: Found listing with ID: BE73867
2026-03-27 10:56:59 [auto1.de] INFO: Found listing with ID: KD35022
2026-03-27 10:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD35022%27 HTTP/1.1" 200 None
2026-03-27 10:56:59 [auto1.de] INFO: Scrape type for KD35022: 0
2026-03-27 10:56:59 [auto1.de] INFO: Found listing with ID: NR70794
2026-03-27 10:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR70794%27 HTTP/1.1" 200 None
2026-03-27 10:56:59 [auto1.de] INFO: Scrape type for NR70794: 0
2026-03-27 10:56:59 [auto1.de] INFO: Found listing with ID: BY78150
2026-03-27 10:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY78150%27 HTTP/1.1" 200 None
2026-03-27 10:56:59 [auto1.de] INFO: Scrape type for BY78150: 0
2026-03-27 10:56:59 [auto1.de] INFO: Found listing with ID: ZA57423
2026-03-27 10:56:59 [auto1.de] INFO: Found listing with ID: SC80606
2026-03-27 10:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:00 [auto1.de] INFO: Channel: 24h | Page: 124 | totalHits: 10618 | hits on page: 40
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: XS81054
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: YX52841
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX52841%27 HTTP/1.1" 200 None
2026-03-27 10:57:00 [auto1.de] INFO: Scrape type for YX52841: 0
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: CY91689
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: PT76912
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: LC41774
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC41774%27 HTTP/1.1" 200 None
2026-03-27 10:57:00 [auto1.de] INFO: Scrape type for LC41774: 0
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: RS00302
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS00302%27 HTTP/1.1" 200 None
2026-03-27 10:57:00 [auto1.de] INFO: Scrape type for RS00302: 0
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: FL70928
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL70928%27 HTTP/1.1" 200 None
2026-03-27 10:57:00 [auto1.de] INFO: Scrape type for FL70928: 0
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: VF90818
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF90818%27 HTTP/1.1" 200 None
2026-03-27 10:57:00 [auto1.de] INFO: Scrape type for VF90818: 0
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: GT42047
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: UA27287
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA27287%27 HTTP/1.1" 200 None
2026-03-27 10:57:00 [auto1.de] INFO: Scrape type for UA27287: 0
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: RU06451
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: YN95671
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: EK46666
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK46666%27 HTTP/1.1" 200 None
2026-03-27 10:57:00 [auto1.de] INFO: Scrape type for EK46666: 0
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: MK42970
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK42970%27 HTTP/1.1" 200 None
2026-03-27 10:57:00 [auto1.de] INFO: Scrape type for MK42970: 0
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: FF38346
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: MS10711
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: XW43121
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW43121%27 HTTP/1.1" 200 None
2026-03-27 10:57:00 [auto1.de] INFO: Scrape type for XW43121: 0
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: CB59188
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB59188%27 HTTP/1.1" 200 None
2026-03-27 10:57:00 [auto1.de] INFO: Scrape type for CB59188: 0
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: VY77073
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY77073%27 HTTP/1.1" 200 None
2026-03-27 10:57:00 [auto1.de] INFO: Scrape type for VY77073: 0
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: GB55517
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: MA84823
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: GZ46428
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: ZH47187
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH47187%27 HTTP/1.1" 200 None
2026-03-27 10:57:00 [auto1.de] INFO: Scrape type for ZH47187: 0
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: RE05344
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: PV96474
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV96474%27 HTTP/1.1" 200 None
2026-03-27 10:57:00 [auto1.de] INFO: Scrape type for PV96474: 0
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: XY66672
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY66672%27 HTTP/1.1" 200 None
2026-03-27 10:57:00 [auto1.de] INFO: Scrape type for XY66672: 0
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: ZG66499
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: YR12178
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: RX04560
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: PW87912
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW87912%27 HTTP/1.1" 200 None
2026-03-27 10:57:00 [auto1.de] INFO: Scrape type for PW87912: 0
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: LE88532
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE88532%27 HTTP/1.1" 200 None
2026-03-27 10:57:00 [auto1.de] INFO: Scrape type for LE88532: 0
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: EZ76361
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ76361%27 HTTP/1.1" 200 None
2026-03-27 10:57:00 [auto1.de] INFO: Scrape type for EZ76361: 0
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: UM54862
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM54862%27 HTTP/1.1" 200 None
2026-03-27 10:57:00 [auto1.de] INFO: Scrape type for UM54862: 0
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: LM54060
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: GX57450
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX57450%27 HTTP/1.1" 200 None
2026-03-27 10:57:00 [auto1.de] INFO: Scrape type for GX57450: 0
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: UC69607
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC69607%27 HTTP/1.1" 200 None
2026-03-27 10:57:00 [auto1.de] INFO: Scrape type for UC69607: 0
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: UZ16181
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: CM85827
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM85827%27 HTTP/1.1" 200 None
2026-03-27 10:57:00 [auto1.de] INFO: Scrape type for CM85827: 0
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: HX61505
2026-03-27 10:57:00 [auto1.de] INFO: Found listing with ID: PF96796
2026-03-27 10:57:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:01 [auto1.de] INFO: Channel: 24h | Page: 125 | totalHits: 10618 | hits on page: 40
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: FA28026
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: SY54244
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: FC56838
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: NZ09394
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: GU26871
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: UD44631
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: VX61126
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX61126%27 HTTP/1.1" 200 None
2026-03-27 10:57:01 [auto1.de] INFO: Scrape type for VX61126: 0
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: NT47334
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47334%27 HTTP/1.1" 200 None
2026-03-27 10:57:01 [auto1.de] INFO: Scrape type for NT47334: 0
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: XS36937
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS36937%27 HTTP/1.1" 200 None
2026-03-27 10:57:01 [auto1.de] INFO: Scrape type for XS36937: 0
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: NF06054
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF06054%27 HTTP/1.1" 200 None
2026-03-27 10:57:01 [auto1.de] INFO: Scrape type for NF06054: 0
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: VS61751
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS61751%27 HTTP/1.1" 200 None
2026-03-27 10:57:01 [auto1.de] INFO: Scrape type for VS61751: 0
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: RL57383
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: XX53475
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX53475%27 HTTP/1.1" 200 None
2026-03-27 10:57:01 [auto1.de] INFO: Scrape type for XX53475: 0
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: LU87387
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: AY28505
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: CZ93275
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ93275%27 HTTP/1.1" 200 None
2026-03-27 10:57:01 [auto1.de] INFO: Scrape type for CZ93275: 0
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: JT12808
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: AJ15335
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ15335%27 HTTP/1.1" 200 None
2026-03-27 10:57:01 [auto1.de] INFO: Scrape type for AJ15335: 0
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: UM96054
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM96054%27 HTTP/1.1" 200 None
2026-03-27 10:57:01 [auto1.de] INFO: Scrape type for UM96054: 0
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: CN59781
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: PS78942
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: RE90038
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE90038%27 HTTP/1.1" 200 None
2026-03-27 10:57:01 [auto1.de] INFO: Scrape type for RE90038: 0
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: JA70507
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: UV70266
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV70266%27 HTTP/1.1" 200 None
2026-03-27 10:57:01 [auto1.de] INFO: Scrape type for UV70266: 0
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: PS89246
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: DS45291
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: YT32498
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT32498%27 HTTP/1.1" 200 None
2026-03-27 10:57:01 [auto1.de] INFO: Scrape type for YT32498: 0
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: JE14755
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE14755%27 HTTP/1.1" 200 None
2026-03-27 10:57:01 [auto1.de] INFO: Scrape type for JE14755: 0
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: PM11705
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: MV92470
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92470%27 HTTP/1.1" 200 None
2026-03-27 10:57:01 [auto1.de] INFO: Scrape type for MV92470: 0
2026-03-27 10:57:01 [auto1.de] INFO: Found listing with ID: BU11433
2026-03-27 10:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU11433%27 HTTP/1.1" 200 None
2026-03-27 10:57:02 [auto1.de] INFO: Scrape type for BU11433: 0
2026-03-27 10:57:02 [auto1.de] INFO: Found listing with ID: NY36854
2026-03-27 10:57:02 [auto1.de] INFO: Found listing with ID: JL60461
2026-03-27 10:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL60461%27 HTTP/1.1" 200 None
2026-03-27 10:57:02 [auto1.de] INFO: Scrape type for JL60461: 0
2026-03-27 10:57:02 [auto1.de] INFO: Found listing with ID: MC21805
2026-03-27 10:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC21805%27 HTTP/1.1" 200 None
2026-03-27 10:57:02 [auto1.de] INFO: Scrape type for MC21805: 0
2026-03-27 10:57:02 [auto1.de] INFO: Found listing with ID: TL05421
2026-03-27 10:57:02 [auto1.de] INFO: Found listing with ID: DF27439
2026-03-27 10:57:02 [auto1.de] INFO: Found listing with ID: PU73316
2026-03-27 10:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU73316%27 HTTP/1.1" 200 None
2026-03-27 10:57:02 [auto1.de] INFO: Scrape type for PU73316: 0
2026-03-27 10:57:02 [auto1.de] INFO: Found listing with ID: HM05656
2026-03-27 10:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM05656%27 HTTP/1.1" 200 None
2026-03-27 10:57:02 [auto1.de] INFO: Scrape type for HM05656: 0
2026-03-27 10:57:02 [auto1.de] INFO: Found listing with ID: XL28930
2026-03-27 10:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL28930%27 HTTP/1.1" 200 None
2026-03-27 10:57:02 [auto1.de] INFO: Scrape type for XL28930: 0
2026-03-27 10:57:02 [auto1.de] INFO: Found listing with ID: KN88175
2026-03-27 10:57:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:03 [auto1.de] INFO: Channel: 24h | Page: 126 | totalHits: 10618 | hits on page: 40
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: AB82349
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB82349%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for AB82349: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: AR85090
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: SK99128
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK99128%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for SK99128: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: RC95645
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC95645%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for RC95645: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: ZP84126
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP84126%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for ZP84126: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: ZZ70410
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: KP50687
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: XS50208
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50208%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for XS50208: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: VF88904
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: VF10193
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: SF44435
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF44435%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for SF44435: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: WP06272
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP06272%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for WP06272: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: JX30335
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: NY47734
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY47734%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for NY47734: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: LZ19661
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: WS21373
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: NR20309
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR20309%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for NR20309: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: DN95746
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN95746%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for DN95746: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: MR37320
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR37320%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for MR37320: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: XR37747
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR37747%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for XR37747: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: JJ18730
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ18730%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for JJ18730: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: SV49639
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV49639%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for SV49639: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: MS15340
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS15340%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for MS15340: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: HB05476
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB05476%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for HB05476: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: JM96313
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM96313%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for JM96313: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: KJ27126
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: EX39495
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: WR22738
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: CC88338
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: EG60860
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG60860%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for EG60860: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: BK74871
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK74871%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for BK74871: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: XM71416
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: DB12378
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB12378%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for DB12378: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: ZE00456
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE00456%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for ZE00456: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: ZT91138
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: TP52390
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP52390%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for TP52390: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: SZ88186
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ88186%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for SZ88186: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: SA11397
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA11397%27 HTTP/1.1" 200 None
2026-03-27 10:57:03 [auto1.de] INFO: Scrape type for SA11397: 0
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: KS00518
2026-03-27 10:57:03 [auto1.de] INFO: Found listing with ID: YL84618
2026-03-27 10:57:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:04 [auto1.de] INFO: Channel: 24h | Page: 127 | totalHits: 10618 | hits on page: 40
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: PU96006
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU96006%27 HTTP/1.1" 200 None
2026-03-27 10:57:04 [auto1.de] INFO: Scrape type for PU96006: 0
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: FJ76970
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: VA46995
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA46995%27 HTTP/1.1" 200 None
2026-03-27 10:57:04 [auto1.de] INFO: Scrape type for VA46995: 0
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: WX92371
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX92371%27 HTTP/1.1" 200 None
2026-03-27 10:57:04 [auto1.de] INFO: Scrape type for WX92371: 0
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: DK15420
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: XS27147
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS27147%27 HTTP/1.1" 200 None
2026-03-27 10:57:04 [auto1.de] INFO: Scrape type for XS27147: 0
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: NA81558
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: MM77489
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: PR94578
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: KC00860
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: RX19676
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX19676%27 HTTP/1.1" 200 None
2026-03-27 10:57:04 [auto1.de] INFO: Scrape type for RX19676: 0
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: NF69216
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF69216%27 HTTP/1.1" 200 None
2026-03-27 10:57:04 [auto1.de] INFO: Scrape type for NF69216: 0
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: CS82090
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: SK62932
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK62932%27 HTTP/1.1" 200 None
2026-03-27 10:57:04 [auto1.de] INFO: Scrape type for SK62932: 0
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: RB55254
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: UH59685
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH59685%27 HTTP/1.1" 200 None
2026-03-27 10:57:04 [auto1.de] INFO: Scrape type for UH59685: 0
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: LS81640
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS81640%27 HTTP/1.1" 200 None
2026-03-27 10:57:04 [auto1.de] INFO: Scrape type for LS81640: 0
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: YY00170
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY00170%27 HTTP/1.1" 200 None
2026-03-27 10:57:04 [auto1.de] INFO: Scrape type for YY00170: 0
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: PP35153
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP35153%27 HTTP/1.1" 200 None
2026-03-27 10:57:04 [auto1.de] INFO: Scrape type for PP35153: 0
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: YG60561
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: YZ28815
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ28815%27 HTTP/1.1" 200 None
2026-03-27 10:57:04 [auto1.de] INFO: Scrape type for YZ28815: 0
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: FD13282
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD13282%27 HTTP/1.1" 200 None
2026-03-27 10:57:04 [auto1.de] INFO: Scrape type for FD13282: 0
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: CU35296
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU35296%27 HTTP/1.1" 200 None
2026-03-27 10:57:04 [auto1.de] INFO: Scrape type for CU35296: 0
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: NU87000
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: GK88230
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: YX39486
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX39486%27 HTTP/1.1" 200 None
2026-03-27 10:57:04 [auto1.de] INFO: Scrape type for YX39486: 0
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: ZU12280
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU12280%27 HTTP/1.1" 200 None
2026-03-27 10:57:04 [auto1.de] INFO: Scrape type for ZU12280: 0
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: YR13244
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: JT14864
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: CB42474
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: KP08574
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: TJ08431
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: DL48307
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: RC52936
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC52936%27 HTTP/1.1" 200 None
2026-03-27 10:57:04 [auto1.de] INFO: Scrape type for RC52936: 0
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: AJ11776
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: JA02894
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: LX10413
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX10413%27 HTTP/1.1" 200 None
2026-03-27 10:57:04 [auto1.de] INFO: Scrape type for LX10413: 0
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: NV66174
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: WG53526
2026-03-27 10:57:04 [auto1.de] INFO: Found listing with ID: MF78675
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF78675%27 HTTP/1.1" 200 None
2026-03-27 10:57:04 [auto1.de] INFO: Scrape type for MF78675: 0
2026-03-27 10:57:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:05 [auto1.de] INFO: Channel: 24h | Page: 128 | totalHits: 10619 | hits on page: 40
2026-03-27 10:57:05 [auto1.de] INFO: Found listing with ID: MF78675
2026-03-27 10:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF78675%27 HTTP/1.1" 200 None
2026-03-27 10:57:05 [auto1.de] INFO: Scrape type for MF78675: 0
2026-03-27 10:57:05 [auto1.de] INFO: Found listing with ID: XS65767
2026-03-27 10:57:05 [auto1.de] INFO: Found listing with ID: FN83221
2026-03-27 10:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN83221%27 HTTP/1.1" 200 None
2026-03-27 10:57:05 [auto1.de] INFO: Scrape type for FN83221: 0
2026-03-27 10:57:05 [auto1.de] INFO: Found listing with ID: DB02068
2026-03-27 10:57:05 [auto1.de] INFO: Found listing with ID: JM94296
2026-03-27 10:57:05 [auto1.de] INFO: Found listing with ID: DD53443
2026-03-27 10:57:05 [auto1.de] INFO: Found listing with ID: EL20809
2026-03-27 10:57:05 [auto1.de] INFO: Found listing with ID: VR19710
2026-03-27 10:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR19710%27 HTTP/1.1" 200 None
2026-03-27 10:57:05 [auto1.de] INFO: Scrape type for VR19710: 0
2026-03-27 10:57:05 [auto1.de] INFO: Found listing with ID: KT16474
2026-03-27 10:57:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT16474%27 HTTP/1.1" 200 None
2026-03-27 10:57:06 [auto1.de] INFO: Scrape type for KT16474: 0
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: SR67538
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: WY54467
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY54467%27 HTTP/1.1" 200 None
2026-03-27 10:57:06 [auto1.de] INFO: Scrape type for WY54467: 0
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: MN64369
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: JG22521
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG22521%27 HTTP/1.1" 200 None
2026-03-27 10:57:06 [auto1.de] INFO: Scrape type for JG22521: 0
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: CW02492
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW02492%27 HTTP/1.1" 200 None
2026-03-27 10:57:06 [auto1.de] INFO: Scrape type for CW02492: 0
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: KA78171
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: UZ60931
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: FB23073
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: MK13186
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: KH64272
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH64272%27 HTTP/1.1" 200 None
2026-03-27 10:57:06 [auto1.de] INFO: Scrape type for KH64272: 0
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: YF88736
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF88736%27 HTTP/1.1" 200 None
2026-03-27 10:57:06 [auto1.de] INFO: Scrape type for YF88736: 0
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: JT25631
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: TC09665
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC09665%27 HTTP/1.1" 200 None
2026-03-27 10:57:06 [auto1.de] INFO: Scrape type for TC09665: 0
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: YE38551
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: AC78646
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC78646%27 HTTP/1.1" 200 None
2026-03-27 10:57:06 [auto1.de] INFO: Scrape type for AC78646: 0
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: SV38598
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: DT00140
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00140%27 HTTP/1.1" 200 None
2026-03-27 10:57:06 [auto1.de] INFO: Scrape type for DT00140: 0
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: DV44550
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: LS45558
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS45558%27 HTTP/1.1" 200 None
2026-03-27 10:57:06 [auto1.de] INFO: Scrape type for LS45558: 0
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: XW98427
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW98427%27 HTTP/1.1" 200 None
2026-03-27 10:57:06 [auto1.de] INFO: Scrape type for XW98427: 0
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: NF90345
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: PA05830
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA05830%27 HTTP/1.1" 200 None
2026-03-27 10:57:06 [auto1.de] INFO: Scrape type for PA05830: 0
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: VK81470
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK81470%27 HTTP/1.1" 200 None
2026-03-27 10:57:06 [auto1.de] INFO: Scrape type for VK81470: 0
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: VH72276
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: SS34696
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: GN50341
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: HF95625
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF95625%27 HTTP/1.1" 200 None
2026-03-27 10:57:06 [auto1.de] INFO: Scrape type for HF95625: 0
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: RP15985
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: EY50037
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: GW73936
2026-03-27 10:57:06 [auto1.de] INFO: Found listing with ID: UA31862
2026-03-27 10:57:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:06 [scrapy.extensions.logstats] INFO: Crawled 596 pages (at 27 pages/min), scraped 906 items (at 7 items/min)
2026-03-27 10:57:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 10:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:07 [auto1.de] INFO: Channel: 24h | Page: 129 | totalHits: 10619 | hits on page: 40
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: TP35873
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: YP80343
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: DT65148
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT65148%27 HTTP/1.1" 200 None
2026-03-27 10:57:07 [auto1.de] INFO: Scrape type for DT65148: 0
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: GR50767
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR50767%27 HTTP/1.1" 200 None
2026-03-27 10:57:07 [auto1.de] INFO: Scrape type for GR50767: 0
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: XU78449
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU78449%27 HTTP/1.1" 200 None
2026-03-27 10:57:07 [auto1.de] INFO: Scrape type for XU78449: 0
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: PB88478
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: EW51447
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW51447%27 HTTP/1.1" 200 None
2026-03-27 10:57:07 [auto1.de] INFO: Scrape type for EW51447: 0
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: UE74557
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE74557%27 HTTP/1.1" 200 None
2026-03-27 10:57:07 [auto1.de] INFO: Scrape type for UE74557: 0
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: XX87217
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: TL28504
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: WA53567
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: YX71503
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: TH64703
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: CW94912
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW94912%27 HTTP/1.1" 200 None
2026-03-27 10:57:07 [auto1.de] INFO: Scrape type for CW94912: 0
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: PH91659
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH91659%27 HTTP/1.1" 200 None
2026-03-27 10:57:07 [auto1.de] INFO: Scrape type for PH91659: 0
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: DL11207
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL11207%27 HTTP/1.1" 200 None
2026-03-27 10:57:07 [auto1.de] INFO: Scrape type for DL11207: 0
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: US98158
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: ZS42490
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS42490%27 HTTP/1.1" 200 None
2026-03-27 10:57:07 [auto1.de] INFO: Scrape type for ZS42490: 0
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: KS95343
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: DS13004
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS13004%27 HTTP/1.1" 200 None
2026-03-27 10:57:07 [auto1.de] INFO: Scrape type for DS13004: 0
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: YG64486
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG64486%27 HTTP/1.1" 200 None
2026-03-27 10:57:07 [auto1.de] INFO: Scrape type for YG64486: 0
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: DM43280
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: AK65293
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: VM29679
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM29679%27 HTTP/1.1" 200 None
2026-03-27 10:57:07 [auto1.de] INFO: Scrape type for VM29679: 0
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: KS45394
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS45394%27 HTTP/1.1" 200 None
2026-03-27 10:57:07 [auto1.de] INFO: Scrape type for KS45394: 0
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: CE06320
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: ZR46884
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: ZS46534
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: VM56295
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: VN30253
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN30253%27 HTTP/1.1" 200 None
2026-03-27 10:57:07 [auto1.de] INFO: Scrape type for VN30253: 0
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: CW66270
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW66270%27 HTTP/1.1" 200 None
2026-03-27 10:57:07 [auto1.de] INFO: Scrape type for CW66270: 0
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: MK76692
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK76692%27 HTTP/1.1" 200 None
2026-03-27 10:57:07 [auto1.de] INFO: Scrape type for MK76692: 0
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: EL87499
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL87499%27 HTTP/1.1" 200 None
2026-03-27 10:57:07 [auto1.de] INFO: Scrape type for EL87499: 0
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: NR21254
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: NA57032
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA57032%27 HTTP/1.1" 200 None
2026-03-27 10:57:07 [auto1.de] INFO: Scrape type for NA57032: 0
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: XE21854
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE21854%27 HTTP/1.1" 200 None
2026-03-27 10:57:07 [auto1.de] INFO: Scrape type for XE21854: 0
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: ZH66047
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH66047%27 HTTP/1.1" 200 None
2026-03-27 10:57:07 [auto1.de] INFO: Scrape type for ZH66047: 0
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: SM94755
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: DD19418
2026-03-27 10:57:07 [auto1.de] INFO: Found listing with ID: GR07934
2026-03-27 10:57:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:08 [auto1.de] INFO: Channel: 24h | Page: 130 | totalHits: 10619 | hits on page: 40
2026-03-27 10:57:08 [auto1.de] INFO: Found listing with ID: YT16103
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16103%27 HTTP/1.1" 200 None
2026-03-27 10:57:09 [auto1.de] INFO: Scrape type for YT16103: 0
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: WP16305
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP16305%27 HTTP/1.1" 200 None
2026-03-27 10:57:09 [auto1.de] INFO: Scrape type for WP16305: 0
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: KA83204
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: LV57105
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: PC47555
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC47555%27 HTTP/1.1" 200 None
2026-03-27 10:57:09 [auto1.de] INFO: Scrape type for PC47555: 0
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: UD83708
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: FW71930
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: CA15258
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: VW00524
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW00524%27 HTTP/1.1" 200 None
2026-03-27 10:57:09 [auto1.de] INFO: Scrape type for VW00524: 0
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: GV92310
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: TA71788
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: MC82373
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC82373%27 HTTP/1.1" 200 None
2026-03-27 10:57:09 [auto1.de] INFO: Scrape type for MC82373: 0
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: RT14045
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT14045%27 HTTP/1.1" 200 None
2026-03-27 10:57:09 [auto1.de] INFO: Scrape type for RT14045: 0
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: GF01666
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: CE24177
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE24177%27 HTTP/1.1" 200 None
2026-03-27 10:57:09 [auto1.de] INFO: Scrape type for CE24177: 0
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: PZ06712
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ06712%27 HTTP/1.1" 200 None
2026-03-27 10:57:09 [auto1.de] INFO: Scrape type for PZ06712: 0
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: BK75790
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK75790%27 HTTP/1.1" 200 None
2026-03-27 10:57:09 [auto1.de] INFO: Scrape type for BK75790: 0
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: TX55902
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX55902%27 HTTP/1.1" 200 None
2026-03-27 10:57:09 [auto1.de] INFO: Scrape type for TX55902: 0
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: TS84249
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS84249%27 HTTP/1.1" 200 None
2026-03-27 10:57:09 [auto1.de] INFO: Scrape type for TS84249: 0
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: VT28358
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: US56828
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: LU81393
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU81393%27 HTTP/1.1" 200 None
2026-03-27 10:57:09 [auto1.de] INFO: Scrape type for LU81393: 0
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: CE41474
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE41474%27 HTTP/1.1" 200 None
2026-03-27 10:57:09 [auto1.de] INFO: Scrape type for CE41474: 0
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: GT13246
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT13246%27 HTTP/1.1" 200 None
2026-03-27 10:57:09 [auto1.de] INFO: Scrape type for GT13246: 0
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: MH30608
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: RC77177
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: NJ52204
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: EM89370
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: NY37542
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: MY00361
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY00361%27 HTTP/1.1" 200 None
2026-03-27 10:57:09 [auto1.de] INFO: Scrape type for MY00361: 0
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: UR23354
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: DT51004
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: YD09450
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD09450%27 HTTP/1.1" 200 None
2026-03-27 10:57:09 [auto1.de] INFO: Scrape type for YD09450: 0
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: CR93470
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: PH74270
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH74270%27 HTTP/1.1" 200 None
2026-03-27 10:57:09 [auto1.de] INFO: Scrape type for PH74270: 0
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: WM78978
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: LC82989
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: PV10962
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: EV18023
2026-03-27 10:57:09 [auto1.de] INFO: Found listing with ID: TW00393
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW00393%27 HTTP/1.1" 200 None
2026-03-27 10:57:09 [auto1.de] INFO: Scrape type for TW00393: 0
2026-03-27 10:57:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:12 [auto1.de] INFO: Channel: 24h | Page: 131 | totalHits: 10619 | hits on page: 40
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: NN10939
2026-03-27 10:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN10939%27 HTTP/1.1" 200 None
2026-03-27 10:57:12 [auto1.de] INFO: Scrape type for NN10939: 0
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: PN06461
2026-03-27 10:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN06461%27 HTTP/1.1" 200 None
2026-03-27 10:57:12 [auto1.de] INFO: Scrape type for PN06461: 0
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: GE10648
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: TD10276
2026-03-27 10:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD10276%27 HTTP/1.1" 200 None
2026-03-27 10:57:12 [auto1.de] INFO: Scrape type for TD10276: 0
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: GR79404
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: XZ84287
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: VZ80726
2026-03-27 10:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ80726%27 HTTP/1.1" 200 None
2026-03-27 10:57:12 [auto1.de] INFO: Scrape type for VZ80726: 0
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: KZ96576
2026-03-27 10:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ96576%27 HTTP/1.1" 200 None
2026-03-27 10:57:12 [auto1.de] INFO: Scrape type for KZ96576: 0
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: AD32766
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: SN64642
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: WV67912
2026-03-27 10:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV67912%27 HTTP/1.1" 200 None
2026-03-27 10:57:12 [auto1.de] INFO: Scrape type for WV67912: 0
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: VG94776
2026-03-27 10:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG94776%27 HTTP/1.1" 200 None
2026-03-27 10:57:12 [auto1.de] INFO: Scrape type for VG94776: 0
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: KY82766
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: YA77480
2026-03-27 10:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA77480%27 HTTP/1.1" 200 None
2026-03-27 10:57:12 [auto1.de] INFO: Scrape type for YA77480: 0
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: VK17893
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: DV49614
2026-03-27 10:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV49614%27 HTTP/1.1" 200 None
2026-03-27 10:57:12 [auto1.de] INFO: Scrape type for DV49614: 0
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: TW50865
2026-03-27 10:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW50865%27 HTTP/1.1" 200 None
2026-03-27 10:57:12 [auto1.de] INFO: Scrape type for TW50865: 0
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: UN09381
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: VA23337
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: ZG92530
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: LS15583
2026-03-27 10:57:12 [auto1.de] INFO: Found listing with ID: UF86507
2026-03-27 10:57:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF86507%27 HTTP/1.1" 200 None
2026-03-27 10:57:13 [auto1.de] INFO: Scrape type for UF86507: 0
2026-03-27 10:57:13 [auto1.de] INFO: Found listing with ID: BM71069
2026-03-27 10:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM71069%27 HTTP/1.1" 200 None
2026-03-27 10:57:13 [auto1.de] INFO: Scrape type for BM71069: 0
2026-03-27 10:57:13 [auto1.de] INFO: Found listing with ID: BY18801
2026-03-27 10:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18801%27 HTTP/1.1" 200 None
2026-03-27 10:57:13 [auto1.de] INFO: Scrape type for BY18801: 2
2026-03-27 10:57:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83262893-39aa-5016-874c-6a0f4df2ac5a with identifier: BY18801
2026-03-27 10:57:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83262893-39aa-5016-874c-6a0f4df2ac5a with scrape type 2
2026-03-27 10:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83262893-39aa-5016-874c-6a0f4df2ac5a with scrape type 2
2026-03-27 10:57:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83262893-39aa-5016-874c-6a0f4df2ac5a, identifier: BY18801
2026-03-27 10:57:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83262893-39aa-5016-874c-6a0f4df2ac5a with identifier: BY18801
2026-03-27 10:57:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83262893-39aa-5016-874c-6a0f4df2ac5a with identifier: BY18801
2026-03-27 10:57:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83262893-39aa-5016-874c-6a0f4df2ac5a with identifier: BY18801 to the API
2026-03-27 10:57:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:57:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-27T16:14:50Z',
 'fuel_type': 'diesel',
 'id': '83262893-39aa-5016-874c-6a0f4df2ac5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY18801',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Connect',
 'odometer': 126451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seller_name': None,
 'title': 'Ford Transit Connect 1.5 EcoBlue TDCi Kasten Trend lang',
 'transmission': 'manual',
 'trim': 'Kasten Trend lang',
 'year': 2019}
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18801%27 HTTP/1.1" 200 None
2026-03-27 10:57:14 [auto1.de] INFO: Saving data for BY18801: {'auction_closing_time': 1774628090.0, 'created_time': 1773775352.655526, 'last_price_update_time': 1774609034.195954}
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY18801') HTTP/1.1" 204 0
2026-03-27 10:57:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:14 [auto1.de] INFO: Found listing with ID: BR45216
2026-03-27 10:57:14 [auto1.de] INFO: Found listing with ID: NF90581
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF90581%27 HTTP/1.1" 200 None
2026-03-27 10:57:14 [auto1.de] INFO: Scrape type for NF90581: 0
2026-03-27 10:57:14 [auto1.de] INFO: Found listing with ID: KZ90725
2026-03-27 10:57:14 [auto1.de] INFO: Found listing with ID: LY07442
2026-03-27 10:57:14 [auto1.de] INFO: Found listing with ID: WB03440
2026-03-27 10:57:14 [auto1.de] INFO: Found listing with ID: TM84077
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM84077%27 HTTP/1.1" 200 None
2026-03-27 10:57:14 [auto1.de] INFO: Scrape type for TM84077: 0
2026-03-27 10:57:14 [auto1.de] INFO: Found listing with ID: BF71090
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF71090%27 HTTP/1.1" 200 None
2026-03-27 10:57:14 [auto1.de] INFO: Scrape type for BF71090: 0
2026-03-27 10:57:14 [auto1.de] INFO: Found listing with ID: GV75599
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV75599%27 HTTP/1.1" 200 None
2026-03-27 10:57:14 [auto1.de] INFO: Scrape type for GV75599: 0
2026-03-27 10:57:14 [auto1.de] INFO: Found listing with ID: SS53525
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS53525%27 HTTP/1.1" 200 None
2026-03-27 10:57:14 [auto1.de] INFO: Scrape type for SS53525: 0
2026-03-27 10:57:14 [auto1.de] INFO: Found listing with ID: EV57019
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV57019%27 HTTP/1.1" 200 None
2026-03-27 10:57:14 [auto1.de] INFO: Scrape type for EV57019: 0
2026-03-27 10:57:14 [auto1.de] INFO: Found listing with ID: CP51565
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP51565%27 HTTP/1.1" 200 None
2026-03-27 10:57:14 [auto1.de] INFO: Scrape type for CP51565: 0
2026-03-27 10:57:14 [auto1.de] INFO: Found listing with ID: PP60696
2026-03-27 10:57:14 [auto1.de] INFO: Found listing with ID: FJ72421
2026-03-27 10:57:14 [auto1.de] INFO: Found listing with ID: JP07657
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP07657%27 HTTP/1.1" 200 None
2026-03-27 10:57:14 [auto1.de] INFO: Scrape type for JP07657: 0
2026-03-27 10:57:14 [auto1.de] INFO: Found listing with ID: ZF52516
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF52516%27 HTTP/1.1" 200 None
2026-03-27 10:57:14 [auto1.de] INFO: Scrape type for ZF52516: 0
2026-03-27 10:57:14 [auto1.de] INFO: Found listing with ID: AM57263
2026-03-27 10:57:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:19 [auto1.de] INFO: Channel: 24h | Page: 132 | totalHits: 10619 | hits on page: 40
2026-03-27 10:57:19 [auto1.de] INFO: Found listing with ID: MU42832
2026-03-27 10:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU42832%27 HTTP/1.1" 200 None
2026-03-27 10:57:20 [auto1.de] INFO: Scrape type for MU42832: 0
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: JD92059
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: MC27583
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: UE20946
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: UY94864
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY94864%27 HTTP/1.1" 200 None
2026-03-27 10:57:20 [auto1.de] INFO: Scrape type for UY94864: 0
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: FF65657
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: WB38416
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB38416%27 HTTP/1.1" 200 None
2026-03-27 10:57:20 [auto1.de] INFO: Scrape type for WB38416: 0
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: ZV97129
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV97129%27 HTTP/1.1" 200 None
2026-03-27 10:57:20 [auto1.de] INFO: Scrape type for ZV97129: 0
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: RC71799
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC71799%27 HTTP/1.1" 200 None
2026-03-27 10:57:20 [auto1.de] INFO: Scrape type for RC71799: 0
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: PC11757
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: WC34570
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: CN81534
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN81534%27 HTTP/1.1" 200 None
2026-03-27 10:57:20 [auto1.de] INFO: Scrape type for CN81534: 0
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: DM53620
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: CJ47476
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ47476%27 HTTP/1.1" 200 None
2026-03-27 10:57:20 [auto1.de] INFO: Scrape type for CJ47476: 0
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: NB19149
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: ND35935
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: KE96769
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE96769%27 HTTP/1.1" 200 None
2026-03-27 10:57:20 [auto1.de] INFO: Scrape type for KE96769: 0
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: ST36704
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: GD20981
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD20981%27 HTTP/1.1" 200 None
2026-03-27 10:57:20 [auto1.de] INFO: Scrape type for GD20981: 0
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: KS49041
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: GY36191
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY36191%27 HTTP/1.1" 200 None
2026-03-27 10:57:20 [auto1.de] INFO: Scrape type for GY36191: 0
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: AX98840
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX98840%27 HTTP/1.1" 200 None
2026-03-27 10:57:20 [auto1.de] INFO: Scrape type for AX98840: 0
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: GH09079
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH09079%27 HTTP/1.1" 200 None
2026-03-27 10:57:20 [auto1.de] INFO: Scrape type for GH09079: 0
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: WL01890
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: FH24252
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: CV90861
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: DY58878
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY58878%27 HTTP/1.1" 200 None
2026-03-27 10:57:20 [auto1.de] INFO: Scrape type for DY58878: 0
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: ZZ39888
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ39888%27 HTTP/1.1" 200 None
2026-03-27 10:57:20 [auto1.de] INFO: Scrape type for ZZ39888: 0
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: TH58497
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH58497%27 HTTP/1.1" 200 None
2026-03-27 10:57:20 [auto1.de] INFO: Scrape type for TH58497: 0
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: ER30681
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER30681%27 HTTP/1.1" 200 None
2026-03-27 10:57:20 [auto1.de] INFO: Scrape type for ER30681: 0
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: TL75240
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: TS09948
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS09948%27 HTTP/1.1" 200 None
2026-03-27 10:57:20 [auto1.de] INFO: Scrape type for TS09948: 0
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: XF01324
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: TH04354
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: UN47464
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: JJ12232
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ12232%27 HTTP/1.1" 200 None
2026-03-27 10:57:20 [auto1.de] INFO: Scrape type for JJ12232: 0
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: UY48646
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY48646%27 HTTP/1.1" 200 None
2026-03-27 10:57:20 [auto1.de] INFO: Scrape type for UY48646: 0
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: UX06727
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: NJ45071
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ45071%27 HTTP/1.1" 200 None
2026-03-27 10:57:20 [auto1.de] INFO: Scrape type for NJ45071: 0
2026-03-27 10:57:20 [auto1.de] INFO: Found listing with ID: YM33158
2026-03-27 10:57:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:21 [auto1.de] INFO: Channel: 24h | Page: 133 | totalHits: 10619 | hits on page: 40
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: WX81960
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX81960%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for WX81960: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: NE88394
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE88394%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for NE88394: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: DX08468
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX08468%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for DX08468: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: WG82326
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: ZP97267
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP97267%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for ZP97267: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: FH51774
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH51774%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for FH51774: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: BB62931
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: SA60451
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA60451%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for SA60451: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: VG22858
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG22858%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for VG22858: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: UX22346
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: HA89318
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA89318%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for HA89318: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: FW04904
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW04904%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for FW04904: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: CL69426
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: JZ88133
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ88133%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for JZ88133: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: ET53588
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET53588%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for ET53588: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: KW21361
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: YC46871
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC46871%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for YC46871: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: EY69917
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: WD56041
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: SC15486
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC15486%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for SC15486: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: ZK43312
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: CR96910
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: YH01782
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH01782%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for YH01782: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: LL77007
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL77007%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for LL77007: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: FG10184
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: CH66916
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH66916%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for CH66916: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: VX98591
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: XY65669
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: UV74950
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV74950%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for UV74950: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: UU82281
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: BK85524
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: FK01435
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: RY30617
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY30617%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for RY30617: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: DU95569
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: FX79800
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX79800%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for FX79800: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: NB64458
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: ND00067
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND00067%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for ND00067: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: EW75184
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW75184%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for EW75184: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: XU56057
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU56057%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for XU56057: 0
2026-03-27 10:57:21 [auto1.de] INFO: Found listing with ID: HV43954
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV43954%27 HTTP/1.1" 200 None
2026-03-27 10:57:21 [auto1.de] INFO: Scrape type for HV43954: 0
2026-03-27 10:57:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:28 [auto1.de] INFO: Channel: 24h | Page: 134 | totalHits: 10619 | hits on page: 40
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: AC43250
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC43250%27 HTTP/1.1" 200 None
2026-03-27 10:57:28 [auto1.de] INFO: Scrape type for AC43250: 0
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: KW54654
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: RM09243
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM09243%27 HTTP/1.1" 200 None
2026-03-27 10:57:28 [auto1.de] INFO: Scrape type for RM09243: 0
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: DX70553
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: FL68688
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: YH14948
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH14948%27 HTTP/1.1" 200 None
2026-03-27 10:57:28 [auto1.de] INFO: Scrape type for YH14948: 0
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: VU02651
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU02651%27 HTTP/1.1" 200 None
2026-03-27 10:57:28 [auto1.de] INFO: Scrape type for VU02651: 0
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: WA18225
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA18225%27 HTTP/1.1" 200 None
2026-03-27 10:57:28 [auto1.de] INFO: Scrape type for WA18225: 0
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: HM56678
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: KL40189
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL40189%27 HTTP/1.1" 200 None
2026-03-27 10:57:28 [auto1.de] INFO: Scrape type for KL40189: 0
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: JY59533
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: JJ76956
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ76956%27 HTTP/1.1" 200 None
2026-03-27 10:57:28 [auto1.de] INFO: Scrape type for JJ76956: 0
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: KT42001
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: UM76329
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM76329%27 HTTP/1.1" 200 None
2026-03-27 10:57:28 [auto1.de] INFO: Scrape type for UM76329: 0
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: NW01608
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: WN03807
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN03807%27 HTTP/1.1" 200 None
2026-03-27 10:57:28 [auto1.de] INFO: Scrape type for WN03807: 0
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: UY94475
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY94475%27 HTTP/1.1" 200 None
2026-03-27 10:57:28 [auto1.de] INFO: Scrape type for UY94475: 0
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: FD42571
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: XP88597
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: CR90100
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: HY95420
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY95420%27 HTTP/1.1" 200 None
2026-03-27 10:57:28 [auto1.de] INFO: Scrape type for HY95420: 2
2026-03-27 10:57:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95cb0fb1-c139-54b5-9ca2-a256b21a8e99 with identifier: HY95420
2026-03-27 10:57:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95cb0fb1-c139-54b5-9ca2-a256b21a8e99 with scrape type 2
2026-03-27 10:57:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95cb0fb1-c139-54b5-9ca2-a256b21a8e99 with scrape type 2
2026-03-27 10:57:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95cb0fb1-c139-54b5-9ca2-a256b21a8e99, identifier: HY95420
2026-03-27 10:57:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95cb0fb1-c139-54b5-9ca2-a256b21a8e99 with identifier: HY95420
2026-03-27 10:57:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95cb0fb1-c139-54b5-9ca2-a256b21a8e99 with identifier: HY95420
2026-03-27 10:57:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95cb0fb1-c139-54b5-9ca2-a256b21a8e99 with identifier: HY95420 to the API
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:57:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:12:54Z',
 'fuel_type': 'petrol',
 'id': '95cb0fb1-c139-54b5-9ca2-a256b21a8e99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY95420',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 130672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-22',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY95420%27 HTTP/1.1" 200 None
2026-03-27 10:57:28 [auto1.de] INFO: Saving data for HY95420: {'auction_closing_time': 1774627974.0, 'created_time': 1774424145.576938, 'last_price_update_time': 1774609048.781858}
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY95420') HTTP/1.1" 204 0
2026-03-27 10:57:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: ZA81194
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA81194%27 HTTP/1.1" 200 None
2026-03-27 10:57:28 [auto1.de] INFO: Scrape type for ZA81194: 0
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: JM68743
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM68743%27 HTTP/1.1" 200 None
2026-03-27 10:57:28 [auto1.de] INFO: Scrape type for JM68743: 0
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: RE64912
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: DG38505
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: HE70736
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE70736%27 HTTP/1.1" 200 None
2026-03-27 10:57:28 [auto1.de] INFO: Scrape type for HE70736: 0
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: BJ62056
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: PY86398
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY86398%27 HTTP/1.1" 200 None
2026-03-27 10:57:28 [auto1.de] INFO: Scrape type for PY86398: 0
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: HH46084
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: ZN42603
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN42603%27 HTTP/1.1" 200 None
2026-03-27 10:57:28 [auto1.de] INFO: Scrape type for ZN42603: 0
2026-03-27 10:57:28 [auto1.de] INFO: Found listing with ID: BK72669
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK72669%27 HTTP/1.1" 200 None
2026-03-27 10:57:29 [auto1.de] INFO: Scrape type for BK72669: 0
2026-03-27 10:57:29 [auto1.de] INFO: Found listing with ID: SB57558
2026-03-27 10:57:29 [auto1.de] INFO: Found listing with ID: DB03654
2026-03-27 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB03654%27 HTTP/1.1" 200 None
2026-03-27 10:57:29 [auto1.de] INFO: Scrape type for DB03654: 0
2026-03-27 10:57:29 [auto1.de] INFO: Found listing with ID: TP68313
2026-03-27 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP68313%27 HTTP/1.1" 200 None
2026-03-27 10:57:29 [auto1.de] INFO: Scrape type for TP68313: 0
2026-03-27 10:57:29 [auto1.de] INFO: Found listing with ID: YU79688
2026-03-27 10:57:29 [auto1.de] INFO: Found listing with ID: TW16812
2026-03-27 10:57:29 [auto1.de] INFO: Found listing with ID: US30386
2026-03-27 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US30386%27 HTTP/1.1" 200 None
2026-03-27 10:57:29 [auto1.de] INFO: Scrape type for US30386: 0
2026-03-27 10:57:29 [auto1.de] INFO: Found listing with ID: YC48203
2026-03-27 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC48203%27 HTTP/1.1" 200 None
2026-03-27 10:57:29 [auto1.de] INFO: Scrape type for YC48203: 0
2026-03-27 10:57:29 [auto1.de] INFO: Found listing with ID: UD38277
2026-03-27 10:57:29 [auto1.de] INFO: Found listing with ID: UV91231
2026-03-27 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV91231%27 HTTP/1.1" 200 None
2026-03-27 10:57:29 [auto1.de] INFO: Scrape type for UV91231: 0
2026-03-27 10:57:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:30 [auto1.de] INFO: Channel: 24h | Page: 135 | totalHits: 10620 | hits on page: 40
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: UV91231
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV91231%27 HTTP/1.1" 200 None
2026-03-27 10:57:30 [auto1.de] INFO: Scrape type for UV91231: 0
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: MH95521
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: KP93453
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP93453%27 HTTP/1.1" 200 None
2026-03-27 10:57:30 [auto1.de] INFO: Scrape type for KP93453: 0
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: LT64510
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: UM70587
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM70587%27 HTTP/1.1" 200 None
2026-03-27 10:57:30 [auto1.de] INFO: Scrape type for UM70587: 0
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: TM51786
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: DE00247
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: HC23327
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: XN24576
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN24576%27 HTTP/1.1" 200 None
2026-03-27 10:57:30 [auto1.de] INFO: Scrape type for XN24576: 0
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: TE00128
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: AJ12624
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: RX73377
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX73377%27 HTTP/1.1" 200 None
2026-03-27 10:57:30 [auto1.de] INFO: Scrape type for RX73377: 0
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: ME37510
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: AV36611
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: JU56361
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: HY25182
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: GB84908
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB84908%27 HTTP/1.1" 200 None
2026-03-27 10:57:30 [auto1.de] INFO: Scrape type for GB84908: 0
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: LL58580
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: JZ57355
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: GK17867
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK17867%27 HTTP/1.1" 200 None
2026-03-27 10:57:30 [auto1.de] INFO: Scrape type for GK17867: 0
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: PP04784
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP04784%27 HTTP/1.1" 200 None
2026-03-27 10:57:30 [auto1.de] INFO: Scrape type for PP04784: 0
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: DP32451
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: ZT09373
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: ZR29667
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: WP68659
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP68659%27 HTTP/1.1" 200 None
2026-03-27 10:57:30 [auto1.de] INFO: Scrape type for WP68659: 0
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: ET02524
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET02524%27 HTTP/1.1" 200 None
2026-03-27 10:57:30 [auto1.de] INFO: Scrape type for ET02524: 0
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: RC17718
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: XT96782
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: JN60731
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN60731%27 HTTP/1.1" 200 None
2026-03-27 10:57:30 [auto1.de] INFO: Scrape type for JN60731: 0
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: XE63092
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: HW30039
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW30039%27 HTTP/1.1" 200 None
2026-03-27 10:57:30 [auto1.de] INFO: Scrape type for HW30039: 0
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: AU19422
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: VL59137
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL59137%27 HTTP/1.1" 200 None
2026-03-27 10:57:30 [auto1.de] INFO: Scrape type for VL59137: 0
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: BN17260
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN17260%27 HTTP/1.1" 200 None
2026-03-27 10:57:30 [auto1.de] INFO: Scrape type for BN17260: 0
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: GB19740
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: TF56080
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF56080%27 HTTP/1.1" 200 None
2026-03-27 10:57:30 [auto1.de] INFO: Scrape type for TF56080: 0
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: CN49074
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: BA46324
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA46324%27 HTTP/1.1" 200 None
2026-03-27 10:57:30 [auto1.de] INFO: Scrape type for BA46324: 0
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: HL77152
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77152%27 HTTP/1.1" 200 None
2026-03-27 10:57:30 [auto1.de] INFO: Scrape type for HL77152: 0
2026-03-27 10:57:30 [auto1.de] INFO: Found listing with ID: BH54798
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH54798%27 HTTP/1.1" 200 None
2026-03-27 10:57:30 [auto1.de] INFO: Scrape type for BH54798: 0
2026-03-27 10:57:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:31 [auto1.de] INFO: Channel: 24h | Page: 136 | totalHits: 10620 | hits on page: 40
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: LR89229
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR89229%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for LR89229: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: LR33805
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR33805%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for LR33805: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: YB11592
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: SZ29379
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ29379%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for SZ29379: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: XV66059
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: RB98965
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: HC87215
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: UX34233
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX34233%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for UX34233: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: WC50601
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: LS17715
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS17715%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for LS17715: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: DB79259
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB79259%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for DB79259: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: DH62820
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH62820%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for DH62820: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: KE22848
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: XH29629
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH29629%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for XH29629: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: FW12178
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: PR18701
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR18701%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for PR18701: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: MG11664
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG11664%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for MG11664: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: XK45819
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: GB40015
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB40015%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for GB40015: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: RL13206
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL13206%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for RL13206: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: FB64910
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: RV11848
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: CU73818
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: WK69880
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK69880%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for WK69880: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: ML46855
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML46855%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for ML46855: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: MW50067
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW50067%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for MW50067: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: ZH11790
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH11790%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for ZH11790: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: CU51755
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU51755%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for CU51755: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: HE37410
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE37410%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for HE37410: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: NU57672
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: GW32993
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW32993%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for GW32993: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: TG31378
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG31378%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for TG31378: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: JP66680
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP66680%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for JP66680: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: CB60323
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: WP53621
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP53621%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for WP53621: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: PJ59933
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ59933%27 HTTP/1.1" 200 None
2026-03-27 10:57:31 [auto1.de] INFO: Scrape type for PJ59933: 0
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: AA02702
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: ZT59384
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: TC76143
2026-03-27 10:57:31 [auto1.de] INFO: Found listing with ID: LS25336
2026-03-27 10:57:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:32 [auto1.de] INFO: Channel: 24h | Page: 137 | totalHits: 10620 | hits on page: 40
2026-03-27 10:57:32 [auto1.de] INFO: Found listing with ID: GN33962
2026-03-27 10:57:32 [auto1.de] INFO: Found listing with ID: RG13558
2026-03-27 10:57:32 [auto1.de] INFO: Found listing with ID: DP86097
2026-03-27 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP86097%27 HTTP/1.1" 200 None
2026-03-27 10:57:32 [auto1.de] INFO: Scrape type for DP86097: 0
2026-03-27 10:57:32 [auto1.de] INFO: Found listing with ID: MN62628
2026-03-27 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN62628%27 HTTP/1.1" 200 None
2026-03-27 10:57:32 [auto1.de] INFO: Scrape type for MN62628: 0
2026-03-27 10:57:32 [auto1.de] INFO: Found listing with ID: ZE34717
2026-03-27 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE34717%27 HTTP/1.1" 200 None
2026-03-27 10:57:32 [auto1.de] INFO: Scrape type for ZE34717: 0
2026-03-27 10:57:32 [auto1.de] INFO: Found listing with ID: EG28758
2026-03-27 10:57:32 [auto1.de] INFO: Found listing with ID: KX24759
2026-03-27 10:57:32 [auto1.de] INFO: Found listing with ID: GC11554
2026-03-27 10:57:32 [auto1.de] INFO: Found listing with ID: TB35174
2026-03-27 10:57:32 [auto1.de] INFO: Found listing with ID: BP68912
2026-03-27 10:57:32 [auto1.de] INFO: Found listing with ID: UZ20743
2026-03-27 10:57:32 [auto1.de] INFO: Found listing with ID: NC35073
2026-03-27 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC35073%27 HTTP/1.1" 200 None
2026-03-27 10:57:32 [auto1.de] INFO: Scrape type for NC35073: 0
2026-03-27 10:57:32 [auto1.de] INFO: Found listing with ID: YR67686
2026-03-27 10:57:32 [auto1.de] INFO: Found listing with ID: BN04520
2026-03-27 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN04520%27 HTTP/1.1" 200 None
2026-03-27 10:57:32 [auto1.de] INFO: Scrape type for BN04520: 0
2026-03-27 10:57:32 [auto1.de] INFO: Found listing with ID: PD38264
2026-03-27 10:57:32 [auto1.de] INFO: Found listing with ID: HT70874
2026-03-27 10:57:32 [auto1.de] INFO: Found listing with ID: CM50859
2026-03-27 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM50859%27 HTTP/1.1" 200 None
2026-03-27 10:57:32 [auto1.de] INFO: Scrape type for CM50859: 0
2026-03-27 10:57:32 [auto1.de] INFO: Found listing with ID: HV92794
2026-03-27 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV92794%27 HTTP/1.1" 200 None
2026-03-27 10:57:32 [auto1.de] INFO: Scrape type for HV92794: 0
2026-03-27 10:57:32 [auto1.de] INFO: Found listing with ID: BW91385
2026-03-27 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW91385%27 HTTP/1.1" 200 None
2026-03-27 10:57:32 [auto1.de] INFO: Scrape type for BW91385: 0
2026-03-27 10:57:32 [auto1.de] INFO: Found listing with ID: VF29678
2026-03-27 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF29678%27 HTTP/1.1" 200 None
2026-03-27 10:57:32 [auto1.de] INFO: Scrape type for VF29678: 0
2026-03-27 10:57:32 [auto1.de] INFO: Found listing with ID: RD82198
2026-03-27 10:57:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD82198%27 HTTP/1.1" 200 None
2026-03-27 10:57:33 [auto1.de] INFO: Scrape type for RD82198: 0
2026-03-27 10:57:33 [auto1.de] INFO: Found listing with ID: CL91899
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL91899%27 HTTP/1.1" 200 None
2026-03-27 10:57:33 [auto1.de] INFO: Scrape type for CL91899: 0
2026-03-27 10:57:33 [auto1.de] INFO: Found listing with ID: NM74138
2026-03-27 10:57:33 [auto1.de] INFO: Found listing with ID: XC72019
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC72019%27 HTTP/1.1" 200 None
2026-03-27 10:57:33 [auto1.de] INFO: Scrape type for XC72019: 0
2026-03-27 10:57:33 [auto1.de] INFO: Found listing with ID: HE50023
2026-03-27 10:57:33 [auto1.de] INFO: Found listing with ID: HU58633
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU58633%27 HTTP/1.1" 200 None
2026-03-27 10:57:33 [auto1.de] INFO: Scrape type for HU58633: 0
2026-03-27 10:57:33 [auto1.de] INFO: Found listing with ID: CB03549
2026-03-27 10:57:33 [auto1.de] INFO: Found listing with ID: YR22562
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR22562%27 HTTP/1.1" 200 None
2026-03-27 10:57:33 [auto1.de] INFO: Scrape type for YR22562: 0
2026-03-27 10:57:33 [auto1.de] INFO: Found listing with ID: ZM52158
2026-03-27 10:57:33 [auto1.de] INFO: Found listing with ID: DB47248
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB47248%27 HTTP/1.1" 200 None
2026-03-27 10:57:33 [auto1.de] INFO: Scrape type for DB47248: 0
2026-03-27 10:57:33 [auto1.de] INFO: Found listing with ID: AD61123
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD61123%27 HTTP/1.1" 200 None
2026-03-27 10:57:33 [auto1.de] INFO: Scrape type for AD61123: 0
2026-03-27 10:57:33 [auto1.de] INFO: Found listing with ID: RE97546
2026-03-27 10:57:33 [auto1.de] INFO: Found listing with ID: UY74069
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY74069%27 HTTP/1.1" 200 None
2026-03-27 10:57:33 [auto1.de] INFO: Scrape type for UY74069: 0
2026-03-27 10:57:33 [auto1.de] INFO: Found listing with ID: BS21339
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS21339%27 HTTP/1.1" 200 None
2026-03-27 10:57:33 [auto1.de] INFO: Scrape type for BS21339: 0
2026-03-27 10:57:33 [auto1.de] INFO: Found listing with ID: VT62851
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT62851%27 HTTP/1.1" 200 None
2026-03-27 10:57:33 [auto1.de] INFO: Scrape type for VT62851: 0
2026-03-27 10:57:33 [auto1.de] INFO: Found listing with ID: UF15161
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF15161%27 HTTP/1.1" 200 None
2026-03-27 10:57:33 [auto1.de] INFO: Scrape type for UF15161: 0
2026-03-27 10:57:33 [auto1.de] INFO: Found listing with ID: BK98649
2026-03-27 10:57:33 [auto1.de] INFO: Found listing with ID: FE98948
2026-03-27 10:57:33 [auto1.de] INFO: Found listing with ID: BL76191
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL76191%27 HTTP/1.1" 200 None
2026-03-27 10:57:33 [auto1.de] INFO: Scrape type for BL76191: 0
2026-03-27 10:57:33 [auto1.de] INFO: Found listing with ID: KN35431
2026-03-27 10:57:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:34 [auto1.de] INFO: Channel: 24h | Page: 138 | totalHits: 10620 | hits on page: 40
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: PR12884
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR12884%27 HTTP/1.1" 200 None
2026-03-27 10:57:34 [auto1.de] INFO: Scrape type for PR12884: 0
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: CG56804
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG56804%27 HTTP/1.1" 200 None
2026-03-27 10:57:34 [auto1.de] INFO: Scrape type for CG56804: 0
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: CP21456
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: GU21129
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU21129%27 HTTP/1.1" 200 None
2026-03-27 10:57:34 [auto1.de] INFO: Scrape type for GU21129: 0
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: DS18768
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: KH43150
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH43150%27 HTTP/1.1" 200 None
2026-03-27 10:57:34 [auto1.de] INFO: Scrape type for KH43150: 0
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: TA51177
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA51177%27 HTTP/1.1" 200 None
2026-03-27 10:57:34 [auto1.de] INFO: Scrape type for TA51177: 0
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: GC53073
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC53073%27 HTTP/1.1" 200 None
2026-03-27 10:57:34 [auto1.de] INFO: Scrape type for GC53073: 0
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: MT32670
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT32670%27 HTTP/1.1" 200 None
2026-03-27 10:57:34 [auto1.de] INFO: Scrape type for MT32670: 0
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: MV81221
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV81221%27 HTTP/1.1" 200 None
2026-03-27 10:57:34 [auto1.de] INFO: Scrape type for MV81221: 0
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: YL92048
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: HD85457
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: BX01019
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX01019%27 HTTP/1.1" 200 None
2026-03-27 10:57:34 [auto1.de] INFO: Scrape type for BX01019: 0
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: AB71807
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB71807%27 HTTP/1.1" 200 None
2026-03-27 10:57:34 [auto1.de] INFO: Scrape type for AB71807: 0
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: HN95943
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN95943%27 HTTP/1.1" 200 None
2026-03-27 10:57:34 [auto1.de] INFO: Scrape type for HN95943: 0
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: RM36299
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: LN55732
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: HX68002
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX68002%27 HTTP/1.1" 200 None
2026-03-27 10:57:34 [auto1.de] INFO: Scrape type for HX68002: 0
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: YZ92189
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: ZW96978
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: ST79736
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST79736%27 HTTP/1.1" 200 None
2026-03-27 10:57:34 [auto1.de] INFO: Scrape type for ST79736: 0
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: UB06797
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB06797%27 HTTP/1.1" 200 None
2026-03-27 10:57:34 [auto1.de] INFO: Scrape type for UB06797: 0
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: JF89335
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: NP57126
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP57126%27 HTTP/1.1" 200 None
2026-03-27 10:57:34 [auto1.de] INFO: Scrape type for NP57126: 0
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: SV97177
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV97177%27 HTTP/1.1" 200 None
2026-03-27 10:57:34 [auto1.de] INFO: Scrape type for SV97177: 0
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: TC11139
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: NX49590
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: NX05955
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX05955%27 HTTP/1.1" 200 None
2026-03-27 10:57:34 [auto1.de] INFO: Scrape type for NX05955: 0
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: KW02770
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: JA95391
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: MM26769
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: ZU63901
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU63901%27 HTTP/1.1" 200 None
2026-03-27 10:57:34 [auto1.de] INFO: Scrape type for ZU63901: 0
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: XN97050
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN97050%27 HTTP/1.1" 200 None
2026-03-27 10:57:34 [auto1.de] INFO: Scrape type for XN97050: 0
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: XK43305
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK43305%27 HTTP/1.1" 200 None
2026-03-27 10:57:34 [auto1.de] INFO: Scrape type for XK43305: 0
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: KV44298
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV44298%27 HTTP/1.1" 200 None
2026-03-27 10:57:34 [auto1.de] INFO: Scrape type for KV44298: 0
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: YE23414
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: ZZ49819
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: SK78109
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: BT66227
2026-03-27 10:57:34 [auto1.de] INFO: Found listing with ID: LK69228
2026-03-27 10:57:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:35 [auto1.de] INFO: Channel: 24h | Page: 139 | totalHits: 10620 | hits on page: 40
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: HB99974
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: SN35212
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: NX84743
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: MR54336
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR54336%27 HTTP/1.1" 200 None
2026-03-27 10:57:35 [auto1.de] INFO: Scrape type for MR54336: 0
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: VN46065
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: SD48131
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD48131%27 HTTP/1.1" 200 None
2026-03-27 10:57:35 [auto1.de] INFO: Scrape type for SD48131: 0
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: NR80587
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR80587%27 HTTP/1.1" 200 None
2026-03-27 10:57:35 [auto1.de] INFO: Scrape type for NR80587: 0
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: LC36947
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC36947%27 HTTP/1.1" 200 None
2026-03-27 10:57:35 [auto1.de] INFO: Scrape type for LC36947: 0
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: CX13675
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX13675%27 HTTP/1.1" 200 None
2026-03-27 10:57:35 [auto1.de] INFO: Scrape type for CX13675: 0
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: VS58629
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS58629%27 HTTP/1.1" 200 None
2026-03-27 10:57:35 [auto1.de] INFO: Scrape type for VS58629: 0
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: JC51889
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: SH15635
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: VC66912
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: TM56515
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: PR12496
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR12496%27 HTTP/1.1" 200 None
2026-03-27 10:57:35 [auto1.de] INFO: Scrape type for PR12496: 0
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: DG73763
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG73763%27 HTTP/1.1" 200 None
2026-03-27 10:57:35 [auto1.de] INFO: Scrape type for DG73763: 0
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: WA27160
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: NF62451
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: DF46066
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF46066%27 HTTP/1.1" 200 None
2026-03-27 10:57:35 [auto1.de] INFO: Scrape type for DF46066: 0
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: JV58210
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV58210%27 HTTP/1.1" 200 None
2026-03-27 10:57:35 [auto1.de] INFO: Scrape type for JV58210: 0
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: DP83508
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP83508%27 HTTP/1.1" 200 None
2026-03-27 10:57:35 [auto1.de] INFO: Scrape type for DP83508: 0
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: VJ08081
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: TS77331
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: CY68154
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY68154%27 HTTP/1.1" 200 None
2026-03-27 10:57:35 [auto1.de] INFO: Scrape type for CY68154: 0
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: KC84817
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC84817%27 HTTP/1.1" 200 None
2026-03-27 10:57:35 [auto1.de] INFO: Scrape type for KC84817: 0
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: PG04042
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG04042%27 HTTP/1.1" 200 None
2026-03-27 10:57:35 [auto1.de] INFO: Scrape type for PG04042: 0
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: UB37420
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB37420%27 HTTP/1.1" 200 None
2026-03-27 10:57:35 [auto1.de] INFO: Scrape type for UB37420: 0
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: EY95977
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: CP67844
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: BN04464
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: DW90423
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: PS83792
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS83792%27 HTTP/1.1" 200 None
2026-03-27 10:57:35 [auto1.de] INFO: Scrape type for PS83792: 0
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: FZ21407
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ21407%27 HTTP/1.1" 200 None
2026-03-27 10:57:35 [auto1.de] INFO: Scrape type for FZ21407: 0
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: ZP94489
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: AL79898
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL79898%27 HTTP/1.1" 200 None
2026-03-27 10:57:35 [auto1.de] INFO: Scrape type for AL79898: 0
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: CW96220
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: WY46685
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: DS74769
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: JF44958
2026-03-27 10:57:35 [auto1.de] INFO: Found listing with ID: SY15259
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY15259%27 HTTP/1.1" 200 None
2026-03-27 10:57:35 [auto1.de] INFO: Scrape type for SY15259: 0
2026-03-27 10:57:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:36 [auto1.de] INFO: Channel: 24h | Page: 140 | totalHits: 10621 | hits on page: 40
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: SY15259
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY15259%27 HTTP/1.1" 200 None
2026-03-27 10:57:36 [auto1.de] INFO: Scrape type for SY15259: 0
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: GG07111
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: NV48400
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV48400%27 HTTP/1.1" 200 None
2026-03-27 10:57:36 [auto1.de] INFO: Scrape type for NV48400: 0
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: SJ64601
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ64601%27 HTTP/1.1" 200 None
2026-03-27 10:57:36 [auto1.de] INFO: Scrape type for SJ64601: 0
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: NS01283
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: ML79860
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: TN06340
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: EC42355
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: BS50452
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: JD73338
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD73338%27 HTTP/1.1" 200 None
2026-03-27 10:57:36 [auto1.de] INFO: Scrape type for JD73338: 0
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: JF93037
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: RL32447
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: UD93265
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD93265%27 HTTP/1.1" 200 None
2026-03-27 10:57:36 [auto1.de] INFO: Scrape type for UD93265: 0
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: KH68440
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: UH76939
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH76939%27 HTTP/1.1" 200 None
2026-03-27 10:57:36 [auto1.de] INFO: Scrape type for UH76939: 0
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: LC48893
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: ZB54489
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB54489%27 HTTP/1.1" 200 None
2026-03-27 10:57:36 [auto1.de] INFO: Scrape type for ZB54489: 0
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: AU07521
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU07521%27 HTTP/1.1" 200 None
2026-03-27 10:57:36 [auto1.de] INFO: Scrape type for AU07521: 0
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: NX98463
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: NP40069
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP40069%27 HTTP/1.1" 200 None
2026-03-27 10:57:36 [auto1.de] INFO: Scrape type for NP40069: 0
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: EN53778
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN53778%27 HTTP/1.1" 200 None
2026-03-27 10:57:36 [auto1.de] INFO: Scrape type for EN53778: 0
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: DC75837
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: YR16927
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR16927%27 HTTP/1.1" 200 None
2026-03-27 10:57:36 [auto1.de] INFO: Scrape type for YR16927: 0
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: KD74504
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: EN76399
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN76399%27 HTTP/1.1" 200 None
2026-03-27 10:57:36 [auto1.de] INFO: Scrape type for EN76399: 0
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: EB80315
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB80315%27 HTTP/1.1" 200 None
2026-03-27 10:57:36 [auto1.de] INFO: Scrape type for EB80315: 0
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: HY86490
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY86490%27 HTTP/1.1" 200 None
2026-03-27 10:57:36 [auto1.de] INFO: Scrape type for HY86490: 0
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: DL80467
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL80467%27 HTTP/1.1" 200 None
2026-03-27 10:57:36 [auto1.de] INFO: Scrape type for DL80467: 0
2026-03-27 10:57:36 [auto1.de] INFO: Found listing with ID: MD28081
2026-03-27 10:57:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD28081%27 HTTP/1.1" 200 None
2026-03-27 10:57:37 [auto1.de] INFO: Scrape type for MD28081: 0
2026-03-27 10:57:37 [auto1.de] INFO: Found listing with ID: ED14712
2026-03-27 10:57:37 [auto1.de] INFO: Found listing with ID: KB53133
2026-03-27 10:57:37 [auto1.de] INFO: Found listing with ID: TB48945
2026-03-27 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB48945%27 HTTP/1.1" 200 None
2026-03-27 10:57:37 [auto1.de] INFO: Scrape type for TB48945: 0
2026-03-27 10:57:37 [auto1.de] INFO: Found listing with ID: HZ36583
2026-03-27 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ36583%27 HTTP/1.1" 200 None
2026-03-27 10:57:37 [auto1.de] INFO: Scrape type for HZ36583: 0
2026-03-27 10:57:37 [auto1.de] INFO: Found listing with ID: CZ59156
2026-03-27 10:57:37 [auto1.de] INFO: Found listing with ID: ZF59355
2026-03-27 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF59355%27 HTTP/1.1" 200 None
2026-03-27 10:57:37 [auto1.de] INFO: Scrape type for ZF59355: 0
2026-03-27 10:57:37 [auto1.de] INFO: Found listing with ID: EA50597
2026-03-27 10:57:37 [auto1.de] INFO: Found listing with ID: GC08040
2026-03-27 10:57:37 [auto1.de] INFO: Found listing with ID: AK76136
2026-03-27 10:57:37 [auto1.de] INFO: Found listing with ID: MK06365
2026-03-27 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK06365%27 HTTP/1.1" 200 None
2026-03-27 10:57:37 [auto1.de] INFO: Scrape type for MK06365: 0
2026-03-27 10:57:37 [auto1.de] INFO: Found listing with ID: VN58412
2026-03-27 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN58412%27 HTTP/1.1" 200 None
2026-03-27 10:57:37 [auto1.de] INFO: Scrape type for VN58412: 0
2026-03-27 10:57:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:38 [auto1.de] INFO: Channel: 24h | Page: 141 | totalHits: 10621 | hits on page: 40
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: XL61450
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: WP25478
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP25478%27 HTTP/1.1" 200 None
2026-03-27 10:57:38 [auto1.de] INFO: Scrape type for WP25478: 0
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: TP89237
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: WM33738
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM33738%27 HTTP/1.1" 200 None
2026-03-27 10:57:38 [auto1.de] INFO: Scrape type for WM33738: 0
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: ZP20879
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP20879%27 HTTP/1.1" 200 None
2026-03-27 10:57:38 [auto1.de] INFO: Scrape type for ZP20879: 0
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: FT09783
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: NZ71829
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ71829%27 HTTP/1.1" 200 None
2026-03-27 10:57:38 [auto1.de] INFO: Scrape type for NZ71829: 0
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: AH41759
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: MV84683
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: YU90808
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: ZP64735
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: NF21329
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: FF57158
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF57158%27 HTTP/1.1" 200 None
2026-03-27 10:57:38 [auto1.de] INFO: Scrape type for FF57158: 0
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: GZ67786
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ67786%27 HTTP/1.1" 200 None
2026-03-27 10:57:38 [auto1.de] INFO: Scrape type for GZ67786: 0
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: TZ87798
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: MR24892
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR24892%27 HTTP/1.1" 200 None
2026-03-27 10:57:38 [auto1.de] INFO: Scrape type for MR24892: 0
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: TE34583
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE34583%27 HTTP/1.1" 200 None
2026-03-27 10:57:38 [auto1.de] INFO: Scrape type for TE34583: 0
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: YB72786
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB72786%27 HTTP/1.1" 200 None
2026-03-27 10:57:38 [auto1.de] INFO: Scrape type for YB72786: 0
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: PJ27093
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: VE08810
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE08810%27 HTTP/1.1" 200 None
2026-03-27 10:57:38 [auto1.de] INFO: Scrape type for VE08810: 0
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: FZ97744
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: TP64554
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP64554%27 HTTP/1.1" 200 None
2026-03-27 10:57:38 [auto1.de] INFO: Scrape type for TP64554: 0
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: PT12721
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT12721%27 HTTP/1.1" 200 None
2026-03-27 10:57:38 [auto1.de] INFO: Scrape type for PT12721: 0
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: LE52779
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE52779%27 HTTP/1.1" 200 None
2026-03-27 10:57:38 [auto1.de] INFO: Scrape type for LE52779: 0
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: FT73137
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: AB18320
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: VE76243
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE76243%27 HTTP/1.1" 200 None
2026-03-27 10:57:38 [auto1.de] INFO: Scrape type for VE76243: 0
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: UE09477
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE09477%27 HTTP/1.1" 200 None
2026-03-27 10:57:38 [auto1.de] INFO: Scrape type for UE09477: 0
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: JK08938
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK08938%27 HTTP/1.1" 200 None
2026-03-27 10:57:38 [auto1.de] INFO: Scrape type for JK08938: 0
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: LV13893
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV13893%27 HTTP/1.1" 200 None
2026-03-27 10:57:38 [auto1.de] INFO: Scrape type for LV13893: 0
2026-03-27 10:57:38 [auto1.de] INFO: Found listing with ID: AL17067
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL17067%27 HTTP/1.1" 200 None
2026-03-27 10:57:38 [auto1.de] INFO: Scrape type for AL17067: 2
2026-03-27 10:57:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5393b9fc-2b1a-54db-b174-1eb75d777d86 with identifier: AL17067
2026-03-27 10:57:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5393b9fc-2b1a-54db-b174-1eb75d777d86 with scrape type 2
2026-03-27 10:57:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5393b9fc-2b1a-54db-b174-1eb75d777d86 with scrape type 2
2026-03-27 10:57:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5393b9fc-2b1a-54db-b174-1eb75d777d86, identifier: AL17067
2026-03-27 10:57:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5393b9fc-2b1a-54db-b174-1eb75d777d86 with identifier: AL17067
2026-03-27 10:57:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5393b9fc-2b1a-54db-b174-1eb75d777d86 with identifier: AL17067
2026-03-27 10:57:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5393b9fc-2b1a-54db-b174-1eb75d777d86 with identifier: AL17067 to the API
2026-03-27 10:57:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:57:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:57:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:33:46Z',
 'fuel_type': 'diesel',
 'id': '5393b9fc-2b1a-54db-b174-1eb75d777d86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL17067',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 226929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-13',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D3 Summum 2WD',
 'transmission': 'manual',
 'trim': 'Summum 2WD',
 'year': 2016}
2026-03-27 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL17067%27 HTTP/1.1" 200 None
2026-03-27 10:57:39 [auto1.de] INFO: Saving data for AL17067: {'auction_closing_time': 1774629226.0, 'created_time': 1773774182.059497, 'last_price_update_time': 1774609059.951521}
2026-03-27 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL17067') HTTP/1.1" 204 0
2026-03-27 10:57:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:40 [auto1.de] INFO: Found listing with ID: AH35551
2026-03-27 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH35551%27 HTTP/1.1" 200 None
2026-03-27 10:57:40 [auto1.de] INFO: Scrape type for AH35551: 0
2026-03-27 10:57:40 [auto1.de] INFO: Found listing with ID: RE14454
2026-03-27 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE14454%27 HTTP/1.1" 200 None
2026-03-27 10:57:40 [auto1.de] INFO: Scrape type for RE14454: 0
2026-03-27 10:57:40 [auto1.de] INFO: Found listing with ID: XP15110
2026-03-27 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP15110%27 HTTP/1.1" 200 None
2026-03-27 10:57:40 [auto1.de] INFO: Scrape type for XP15110: 0
2026-03-27 10:57:40 [auto1.de] INFO: Found listing with ID: TS18866
2026-03-27 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS18866%27 HTTP/1.1" 200 None
2026-03-27 10:57:40 [auto1.de] INFO: Scrape type for TS18866: 0
2026-03-27 10:57:40 [auto1.de] INFO: Found listing with ID: TW29404
2026-03-27 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW29404%27 HTTP/1.1" 200 None
2026-03-27 10:57:40 [auto1.de] INFO: Scrape type for TW29404: 0
2026-03-27 10:57:40 [auto1.de] INFO: Found listing with ID: FF47276
2026-03-27 10:57:40 [auto1.de] INFO: Found listing with ID: KF34969
2026-03-27 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF34969%27 HTTP/1.1" 200 None
2026-03-27 10:57:40 [auto1.de] INFO: Scrape type for KF34969: 0
2026-03-27 10:57:40 [auto1.de] INFO: Found listing with ID: WZ73407
2026-03-27 10:57:40 [auto1.de] INFO: Found listing with ID: UX81688
2026-03-27 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX81688%27 HTTP/1.1" 200 None
2026-03-27 10:57:40 [auto1.de] INFO: Scrape type for UX81688: 0
2026-03-27 10:57:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:41 [auto1.de] INFO: Channel: 24h | Page: 142 | totalHits: 10621 | hits on page: 40
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: EL91919
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: GA83394
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA83394%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for GA83394: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: HB55504
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB55504%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for HB55504: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: GT72696
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: FL38962
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL38962%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for FL38962: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: LD01626
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD01626%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for LD01626: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: XT77229
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: KE28324
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE28324%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for KE28324: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: TU13960
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU13960%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for TU13960: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: PH00246
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: AD85372
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: CJ89630
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ89630%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for CJ89630: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: ZB28652
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB28652%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for ZB28652: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: FW67106
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: TR08832
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR08832%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for TR08832: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: RJ38519
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ38519%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for RJ38519: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: FR82494
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: SV83384
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: VB81192
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB81192%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for VB81192: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: XR23222
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: ZD81952
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: SP79691
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP79691%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for SP79691: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: CK82561
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK82561%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for CK82561: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: NC10753
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC10753%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for NC10753: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: AA21269
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA21269%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for AA21269: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: DR99675
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR99675%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for DR99675: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: KZ84912
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ84912%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for KZ84912: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: YC07614
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: AN57238
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN57238%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for AN57238: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: ZP05972
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: BV90927
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV90927%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for BV90927: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: HX49125
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX49125%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for HX49125: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: NV35238
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV35238%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for NV35238: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: WT43265
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: PL22285
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL22285%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for PL22285: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: UY11294
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: TC91223
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: CD78722
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD78722%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for CD78722: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: KF51408
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF51408%27 HTTP/1.1" 200 None
2026-03-27 10:57:41 [auto1.de] INFO: Scrape type for KF51408: 0
2026-03-27 10:57:41 [auto1.de] INFO: Found listing with ID: PF70269
2026-03-27 10:57:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:42 [auto1.de] INFO: Channel: 24h | Page: 143 | totalHits: 10621 | hits on page: 40
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: YP19637
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP19637%27 HTTP/1.1" 200 None
2026-03-27 10:57:42 [auto1.de] INFO: Scrape type for YP19637: 0
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: SG73532
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: RY10355
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY10355%27 HTTP/1.1" 200 None
2026-03-27 10:57:42 [auto1.de] INFO: Scrape type for RY10355: 0
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: GW05981
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW05981%27 HTTP/1.1" 200 None
2026-03-27 10:57:42 [auto1.de] INFO: Scrape type for GW05981: 0
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: ZB62380
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB62380%27 HTTP/1.1" 200 None
2026-03-27 10:57:42 [auto1.de] INFO: Scrape type for ZB62380: 0
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: VJ67162
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ67162%27 HTTP/1.1" 200 None
2026-03-27 10:57:42 [auto1.de] INFO: Scrape type for VJ67162: 0
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: NG64881
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG64881%27 HTTP/1.1" 200 None
2026-03-27 10:57:42 [auto1.de] INFO: Scrape type for NG64881: 0
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: XC12317
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: LG34778
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: SP10962
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP10962%27 HTTP/1.1" 200 None
2026-03-27 10:57:42 [auto1.de] INFO: Scrape type for SP10962: 0
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: JR52924
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR52924%27 HTTP/1.1" 200 None
2026-03-27 10:57:42 [auto1.de] INFO: Scrape type for JR52924: 0
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: PE04478
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE04478%27 HTTP/1.1" 200 None
2026-03-27 10:57:42 [auto1.de] INFO: Scrape type for PE04478: 0
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: GU34646
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU34646%27 HTTP/1.1" 200 None
2026-03-27 10:57:42 [auto1.de] INFO: Scrape type for GU34646: 0
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: LU79813
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU79813%27 HTTP/1.1" 200 None
2026-03-27 10:57:42 [auto1.de] INFO: Scrape type for LU79813: 0
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: PV07453
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV07453%27 HTTP/1.1" 200 None
2026-03-27 10:57:42 [auto1.de] INFO: Scrape type for PV07453: 0
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: RT55405
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: KY88001
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: EP09152
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP09152%27 HTTP/1.1" 200 None
2026-03-27 10:57:42 [auto1.de] INFO: Scrape type for EP09152: 0
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: VP80711
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP80711%27 HTTP/1.1" 200 None
2026-03-27 10:57:42 [auto1.de] INFO: Scrape type for VP80711: 0
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: HX20102
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX20102%27 HTTP/1.1" 200 None
2026-03-27 10:57:42 [auto1.de] INFO: Scrape type for HX20102: 0
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: DN50713
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: XH67268
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH67268%27 HTTP/1.1" 200 None
2026-03-27 10:57:42 [auto1.de] INFO: Scrape type for XH67268: 0
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: RH56856
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH56856%27 HTTP/1.1" 200 None
2026-03-27 10:57:42 [auto1.de] INFO: Scrape type for RH56856: 0
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: JG94045
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: MP29574
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP29574%27 HTTP/1.1" 200 None
2026-03-27 10:57:42 [auto1.de] INFO: Scrape type for MP29574: 0
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: KP40091
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: ZS20777
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: MJ05239
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ05239%27 HTTP/1.1" 200 None
2026-03-27 10:57:42 [auto1.de] INFO: Scrape type for MJ05239: 0
2026-03-27 10:57:42 [auto1.de] INFO: Found listing with ID: EY91378
2026-03-27 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY91378%27 HTTP/1.1" 200 None
2026-03-27 10:57:43 [auto1.de] INFO: Scrape type for EY91378: 0
2026-03-27 10:57:43 [auto1.de] INFO: Found listing with ID: ZY01103
2026-03-27 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY01103%27 HTTP/1.1" 200 None
2026-03-27 10:57:43 [auto1.de] INFO: Scrape type for ZY01103: 0
2026-03-27 10:57:43 [auto1.de] INFO: Found listing with ID: CC77808
2026-03-27 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC77808%27 HTTP/1.1" 200 None
2026-03-27 10:57:43 [auto1.de] INFO: Scrape type for CC77808: 0
2026-03-27 10:57:43 [auto1.de] INFO: Found listing with ID: AA51268
2026-03-27 10:57:43 [auto1.de] INFO: Found listing with ID: TU83793
2026-03-27 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU83793%27 HTTP/1.1" 200 None
2026-03-27 10:57:43 [auto1.de] INFO: Scrape type for TU83793: 0
2026-03-27 10:57:43 [auto1.de] INFO: Found listing with ID: BK73994
2026-03-27 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK73994%27 HTTP/1.1" 200 None
2026-03-27 10:57:43 [auto1.de] INFO: Scrape type for BK73994: 0
2026-03-27 10:57:43 [auto1.de] INFO: Found listing with ID: YD84326
2026-03-27 10:57:43 [auto1.de] INFO: Found listing with ID: RM29704
2026-03-27 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM29704%27 HTTP/1.1" 200 None
2026-03-27 10:57:43 [auto1.de] INFO: Scrape type for RM29704: 0
2026-03-27 10:57:43 [auto1.de] INFO: Found listing with ID: VV35001
2026-03-27 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV35001%27 HTTP/1.1" 200 None
2026-03-27 10:57:43 [auto1.de] INFO: Scrape type for VV35001: 0
2026-03-27 10:57:43 [auto1.de] INFO: Found listing with ID: CU82641
2026-03-27 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU82641%27 HTTP/1.1" 200 None
2026-03-27 10:57:43 [auto1.de] INFO: Scrape type for CU82641: 0
2026-03-27 10:57:43 [auto1.de] INFO: Found listing with ID: NA98474
2026-03-27 10:57:43 [auto1.de] INFO: Found listing with ID: NL55322
2026-03-27 10:57:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:44 [auto1.de] INFO: Channel: 24h | Page: 144 | totalHits: 10621 | hits on page: 40
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: WG42712
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG42712%27 HTTP/1.1" 200 None
2026-03-27 10:57:44 [auto1.de] INFO: Scrape type for WG42712: 0
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: WD62968
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD62968%27 HTTP/1.1" 200 None
2026-03-27 10:57:44 [auto1.de] INFO: Scrape type for WD62968: 0
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: ME75055
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: JT38047
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT38047%27 HTTP/1.1" 200 None
2026-03-27 10:57:44 [auto1.de] INFO: Scrape type for JT38047: 0
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: XU25249
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU25249%27 HTTP/1.1" 200 None
2026-03-27 10:57:44 [auto1.de] INFO: Scrape type for XU25249: 0
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: YR65508
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: SW54282
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW54282%27 HTTP/1.1" 200 None
2026-03-27 10:57:44 [auto1.de] INFO: Scrape type for SW54282: 0
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: JZ86765
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ86765%27 HTTP/1.1" 200 None
2026-03-27 10:57:44 [auto1.de] INFO: Scrape type for JZ86765: 0
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: LH55149
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH55149%27 HTTP/1.1" 200 None
2026-03-27 10:57:44 [auto1.de] INFO: Scrape type for LH55149: 0
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: EA46191
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: NT94381
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: CS95133
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: VF04675
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF04675%27 HTTP/1.1" 200 None
2026-03-27 10:57:44 [auto1.de] INFO: Scrape type for VF04675: 0
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: FH63073
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: ZD07127
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: WS95832
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: CR20682
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR20682%27 HTTP/1.1" 200 None
2026-03-27 10:57:44 [auto1.de] INFO: Scrape type for CR20682: 0
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: SD24929
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD24929%27 HTTP/1.1" 200 None
2026-03-27 10:57:44 [auto1.de] INFO: Scrape type for SD24929: 0
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: SH25844
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH25844%27 HTTP/1.1" 200 None
2026-03-27 10:57:44 [auto1.de] INFO: Scrape type for SH25844: 0
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: VW19119
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: DF78416
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF78416%27 HTTP/1.1" 200 None
2026-03-27 10:57:44 [auto1.de] INFO: Scrape type for DF78416: 0
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: VT89208
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: HB39069
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: GS12438
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: VK33407
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: WE84338
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: LH79634
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: XS15243
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS15243%27 HTTP/1.1" 200 None
2026-03-27 10:57:44 [auto1.de] INFO: Scrape type for XS15243: 0
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: GG09705
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: RJ57220
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: CJ93593
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: YP24650
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP24650%27 HTTP/1.1" 200 None
2026-03-27 10:57:44 [auto1.de] INFO: Scrape type for YP24650: 0
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: PX72797
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX72797%27 HTTP/1.1" 200 None
2026-03-27 10:57:44 [auto1.de] INFO: Scrape type for PX72797: 0
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: KV91783
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: KF03787
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF03787%27 HTTP/1.1" 200 None
2026-03-27 10:57:44 [auto1.de] INFO: Scrape type for KF03787: 0
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: FX70736
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX70736%27 HTTP/1.1" 200 None
2026-03-27 10:57:44 [auto1.de] INFO: Scrape type for FX70736: 0
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: WP34180
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP34180%27 HTTP/1.1" 200 None
2026-03-27 10:57:44 [auto1.de] INFO: Scrape type for WP34180: 0
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: AT93996
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT93996%27 HTTP/1.1" 200 None
2026-03-27 10:57:44 [auto1.de] INFO: Scrape type for AT93996: 0
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: JM32956
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM32956%27 HTTP/1.1" 200 None
2026-03-27 10:57:44 [auto1.de] INFO: Scrape type for JM32956: 0
2026-03-27 10:57:44 [auto1.de] INFO: Found listing with ID: YF17855
2026-03-27 10:57:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:45 [auto1.de] INFO: Channel: 24h | Page: 145 | totalHits: 10622 | hits on page: 40
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: YF17855
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: US29975
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US29975%27 HTTP/1.1" 200 None
2026-03-27 10:57:45 [auto1.de] INFO: Scrape type for US29975: 0
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: TX74544
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX74544%27 HTTP/1.1" 200 None
2026-03-27 10:57:45 [auto1.de] INFO: Scrape type for TX74544: 0
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: MT29038
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT29038%27 HTTP/1.1" 200 None
2026-03-27 10:57:45 [auto1.de] INFO: Scrape type for MT29038: 0
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: KA13570
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: EW55752
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: RR91926
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR91926%27 HTTP/1.1" 200 None
2026-03-27 10:57:45 [auto1.de] INFO: Scrape type for RR91926: 0
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: FN32397
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: GP35635
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP35635%27 HTTP/1.1" 200 None
2026-03-27 10:57:45 [auto1.de] INFO: Scrape type for GP35635: 0
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: XA58573
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: AS95642
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: WC43161
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC43161%27 HTTP/1.1" 200 None
2026-03-27 10:57:45 [auto1.de] INFO: Scrape type for WC43161: 0
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: FC70073
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC70073%27 HTTP/1.1" 200 None
2026-03-27 10:57:45 [auto1.de] INFO: Scrape type for FC70073: 0
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: PA93267
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA93267%27 HTTP/1.1" 200 None
2026-03-27 10:57:45 [auto1.de] INFO: Scrape type for PA93267: 0
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: LL10892
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL10892%27 HTTP/1.1" 200 None
2026-03-27 10:57:45 [auto1.de] INFO: Scrape type for LL10892: 0
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: PB41592
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB41592%27 HTTP/1.1" 200 None
2026-03-27 10:57:45 [auto1.de] INFO: Scrape type for PB41592: 0
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: SB47402
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: TJ17702
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ17702%27 HTTP/1.1" 200 None
2026-03-27 10:57:45 [auto1.de] INFO: Scrape type for TJ17702: 0
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: UU71497
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU71497%27 HTTP/1.1" 200 None
2026-03-27 10:57:45 [auto1.de] INFO: Scrape type for UU71497: 0
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: CA94630
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA94630%27 HTTP/1.1" 200 None
2026-03-27 10:57:45 [auto1.de] INFO: Scrape type for CA94630: 0
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: VW86065
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: UX96397
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX96397%27 HTTP/1.1" 200 None
2026-03-27 10:57:45 [auto1.de] INFO: Scrape type for UX96397: 0
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: PP17491
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP17491%27 HTTP/1.1" 200 None
2026-03-27 10:57:45 [auto1.de] INFO: Scrape type for PP17491: 0
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: VM73254
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM73254%27 HTTP/1.1" 200 None
2026-03-27 10:57:45 [auto1.de] INFO: Scrape type for VM73254: 0
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: NY78602
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY78602%27 HTTP/1.1" 200 None
2026-03-27 10:57:45 [auto1.de] INFO: Scrape type for NY78602: 0
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: LU10384
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: VG17915
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: SR89713
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: ZN00220
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: YF34625
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: LM34580
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: CA52910
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: WG43761
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: CU14282
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: UN40728
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: MN70772
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: TN82564
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN82564%27 HTTP/1.1" 200 None
2026-03-27 10:57:45 [auto1.de] INFO: Scrape type for TN82564: 0
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: EA44859
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: NZ41454
2026-03-27 10:57:45 [auto1.de] INFO: Found listing with ID: GF09833
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF09833%27 HTTP/1.1" 200 None
2026-03-27 10:57:45 [auto1.de] INFO: Scrape type for GF09833: 0
2026-03-27 10:57:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:46 [auto1.de] INFO: Channel: 24h | Page: 146 | totalHits: 10622 | hits on page: 40
2026-03-27 10:57:46 [auto1.de] INFO: Found listing with ID: YF15540
2026-03-27 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF15540%27 HTTP/1.1" 200 None
2026-03-27 10:57:46 [auto1.de] INFO: Scrape type for YF15540: 0
2026-03-27 10:57:46 [auto1.de] INFO: Found listing with ID: LS92579
2026-03-27 10:57:46 [auto1.de] INFO: Found listing with ID: EV62209
2026-03-27 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV62209%27 HTTP/1.1" 200 None
2026-03-27 10:57:46 [auto1.de] INFO: Scrape type for EV62209: 0
2026-03-27 10:57:46 [auto1.de] INFO: Found listing with ID: PM30121
2026-03-27 10:57:46 [auto1.de] INFO: Found listing with ID: WG89224
2026-03-27 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG89224%27 HTTP/1.1" 200 None
2026-03-27 10:57:46 [auto1.de] INFO: Scrape type for WG89224: 0
2026-03-27 10:57:46 [auto1.de] INFO: Found listing with ID: EP59038
2026-03-27 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP59038%27 HTTP/1.1" 200 None
2026-03-27 10:57:46 [auto1.de] INFO: Scrape type for EP59038: 0
2026-03-27 10:57:46 [auto1.de] INFO: Found listing with ID: MV80796
2026-03-27 10:57:46 [auto1.de] INFO: Found listing with ID: NW23822
2026-03-27 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW23822%27 HTTP/1.1" 200 None
2026-03-27 10:57:46 [auto1.de] INFO: Scrape type for NW23822: 0
2026-03-27 10:57:46 [auto1.de] INFO: Found listing with ID: UT55299
2026-03-27 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT55299%27 HTTP/1.1" 200 None
2026-03-27 10:57:46 [auto1.de] INFO: Scrape type for UT55299: 0
2026-03-27 10:57:46 [auto1.de] INFO: Found listing with ID: SN69565
2026-03-27 10:57:46 [auto1.de] INFO: Found listing with ID: EC58729
2026-03-27 10:57:46 [auto1.de] INFO: Found listing with ID: MT34659
2026-03-27 10:57:46 [auto1.de] INFO: Found listing with ID: CH63331
2026-03-27 10:57:46 [auto1.de] INFO: Found listing with ID: XN53400
2026-03-27 10:57:46 [auto1.de] INFO: Found listing with ID: DU13995
2026-03-27 10:57:46 [auto1.de] INFO: Found listing with ID: LE65557
2026-03-27 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE65557%27 HTTP/1.1" 200 None
2026-03-27 10:57:46 [auto1.de] INFO: Scrape type for LE65557: 0
2026-03-27 10:57:46 [auto1.de] INFO: Found listing with ID: MA40694
2026-03-27 10:57:46 [auto1.de] INFO: Found listing with ID: RX80315
2026-03-27 10:57:46 [auto1.de] INFO: Found listing with ID: VV56220
2026-03-27 10:57:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV56220%27 HTTP/1.1" 200 None
2026-03-27 10:57:47 [auto1.de] INFO: Scrape type for VV56220: 0
2026-03-27 10:57:47 [auto1.de] INFO: Found listing with ID: NV18768
2026-03-27 10:57:47 [auto1.de] INFO: Found listing with ID: AM83584
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM83584%27 HTTP/1.1" 200 None
2026-03-27 10:57:47 [auto1.de] INFO: Scrape type for AM83584: 0
2026-03-27 10:57:47 [auto1.de] INFO: Found listing with ID: FZ54460
2026-03-27 10:57:47 [auto1.de] INFO: Found listing with ID: RX96869
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX96869%27 HTTP/1.1" 200 None
2026-03-27 10:57:47 [auto1.de] INFO: Scrape type for RX96869: 0
2026-03-27 10:57:47 [auto1.de] INFO: Found listing with ID: FJ03790
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ03790%27 HTTP/1.1" 200 None
2026-03-27 10:57:47 [auto1.de] INFO: Scrape type for FJ03790: 0
2026-03-27 10:57:47 [auto1.de] INFO: Found listing with ID: XC96921
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC96921%27 HTTP/1.1" 200 None
2026-03-27 10:57:47 [auto1.de] INFO: Scrape type for XC96921: 0
2026-03-27 10:57:47 [auto1.de] INFO: Found listing with ID: LZ79063
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ79063%27 HTTP/1.1" 200 None
2026-03-27 10:57:47 [auto1.de] INFO: Scrape type for LZ79063: 0
2026-03-27 10:57:47 [auto1.de] INFO: Found listing with ID: XG22155
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG22155%27 HTTP/1.1" 200 None
2026-03-27 10:57:47 [auto1.de] INFO: Scrape type for XG22155: 0
2026-03-27 10:57:47 [auto1.de] INFO: Found listing with ID: MN03229
2026-03-27 10:57:47 [auto1.de] INFO: Found listing with ID: UE28528
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE28528%27 HTTP/1.1" 200 None
2026-03-27 10:57:47 [auto1.de] INFO: Scrape type for UE28528: 0
2026-03-27 10:57:47 [auto1.de] INFO: Found listing with ID: JP42070
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP42070%27 HTTP/1.1" 200 None
2026-03-27 10:57:47 [auto1.de] INFO: Scrape type for JP42070: 0
2026-03-27 10:57:47 [auto1.de] INFO: Found listing with ID: TX07305
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX07305%27 HTTP/1.1" 200 None
2026-03-27 10:57:47 [auto1.de] INFO: Scrape type for TX07305: 0
2026-03-27 10:57:47 [auto1.de] INFO: Found listing with ID: SP96872
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP96872%27 HTTP/1.1" 200 None
2026-03-27 10:57:47 [auto1.de] INFO: Scrape type for SP96872: 0
2026-03-27 10:57:47 [auto1.de] INFO: Found listing with ID: HB59808
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB59808%27 HTTP/1.1" 200 None
2026-03-27 10:57:47 [auto1.de] INFO: Scrape type for HB59808: 0
2026-03-27 10:57:47 [auto1.de] INFO: Found listing with ID: VK92736
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK92736%27 HTTP/1.1" 200 None
2026-03-27 10:57:47 [auto1.de] INFO: Scrape type for VK92736: 0
2026-03-27 10:57:47 [auto1.de] INFO: Found listing with ID: EX50371
2026-03-27 10:57:47 [auto1.de] INFO: Found listing with ID: JH81808
2026-03-27 10:57:47 [auto1.de] INFO: Found listing with ID: MW99242
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW99242%27 HTTP/1.1" 200 None
2026-03-27 10:57:47 [auto1.de] INFO: Scrape type for MW99242: 0
2026-03-27 10:57:47 [auto1.de] INFO: Found listing with ID: RE13510
2026-03-27 10:57:47 [auto1.de] INFO: Found listing with ID: KT12333
2026-03-27 10:57:47 [auto1.de] INFO: Found listing with ID: JK98125
2026-03-27 10:57:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:48 [auto1.de] INFO: Channel: 24h | Page: 147 | totalHits: 10623 | hits on page: 40
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: JK98125
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: ND84220
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: LP56741
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: ZG25746
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: GL06639
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL06639%27 HTTP/1.1" 200 None
2026-03-27 10:57:48 [auto1.de] INFO: Scrape type for GL06639: 0
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: AA89468
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: VJ91223
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ91223%27 HTTP/1.1" 200 None
2026-03-27 10:57:48 [auto1.de] INFO: Scrape type for VJ91223: 0
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: HR08840
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: HX46872
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX46872%27 HTTP/1.1" 200 None
2026-03-27 10:57:48 [auto1.de] INFO: Scrape type for HX46872: 0
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: NK36025
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: FK17584
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK17584%27 HTTP/1.1" 200 None
2026-03-27 10:57:48 [auto1.de] INFO: Scrape type for FK17584: 0
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: TN75370
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: KG16630
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG16630%27 HTTP/1.1" 200 None
2026-03-27 10:57:48 [auto1.de] INFO: Scrape type for KG16630: 0
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: DZ26668
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ26668%27 HTTP/1.1" 200 None
2026-03-27 10:57:48 [auto1.de] INFO: Scrape type for DZ26668: 0
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: AA38462
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA38462%27 HTTP/1.1" 200 None
2026-03-27 10:57:48 [auto1.de] INFO: Scrape type for AA38462: 0
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: ME72144
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: UY05499
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY05499%27 HTTP/1.1" 200 None
2026-03-27 10:57:48 [auto1.de] INFO: Scrape type for UY05499: 0
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: FM01284
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM01284%27 HTTP/1.1" 200 None
2026-03-27 10:57:48 [auto1.de] INFO: Scrape type for FM01284: 0
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: SD14498
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: SH08334
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: AP99471
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP99471%27 HTTP/1.1" 200 None
2026-03-27 10:57:48 [auto1.de] INFO: Scrape type for AP99471: 0
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: TS13333
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: BJ99536
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: FD48176
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: SY31526
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY31526%27 HTTP/1.1" 200 None
2026-03-27 10:57:48 [auto1.de] INFO: Scrape type for SY31526: 0
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: PD05251
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: NB51207
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: WY14478
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY14478%27 HTTP/1.1" 200 None
2026-03-27 10:57:48 [auto1.de] INFO: Scrape type for WY14478: 0
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: SF00674
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF00674%27 HTTP/1.1" 200 None
2026-03-27 10:57:48 [auto1.de] INFO: Scrape type for SF00674: 0
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: YY85891
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY85891%27 HTTP/1.1" 200 None
2026-03-27 10:57:48 [auto1.de] INFO: Scrape type for YY85891: 0
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: JJ86337
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: BF99828
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: GF36565
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: WE14198
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: FH08441
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: SH34728
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH34728%27 HTTP/1.1" 200 None
2026-03-27 10:57:48 [auto1.de] INFO: Scrape type for SH34728: 0
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: DR71954
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: JS67569
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: GL70534
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL70534%27 HTTP/1.1" 200 None
2026-03-27 10:57:48 [auto1.de] INFO: Scrape type for GL70534: 0
2026-03-27 10:57:48 [auto1.de] INFO: Found listing with ID: KA69379
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA69379%27 HTTP/1.1" 200 None
2026-03-27 10:57:48 [auto1.de] INFO: Scrape type for KA69379: 0
2026-03-27 10:57:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:49 [auto1.de] INFO: Channel: 24h | Page: 148 | totalHits: 10623 | hits on page: 40
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: YM15308
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: FJ28912
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: BF15182
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: FJ90232
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: WU59517
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU59517%27 HTTP/1.1" 200 None
2026-03-27 10:57:49 [auto1.de] INFO: Scrape type for WU59517: 0
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: KS68262
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: MF87973
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF87973%27 HTTP/1.1" 200 None
2026-03-27 10:57:49 [auto1.de] INFO: Scrape type for MF87973: 0
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: KU34267
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: LP17470
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: TM22078
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM22078%27 HTTP/1.1" 200 None
2026-03-27 10:57:49 [auto1.de] INFO: Scrape type for TM22078: 0
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: BP83751
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: DR55440
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: XJ41325
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ41325%27 HTTP/1.1" 200 None
2026-03-27 10:57:49 [auto1.de] INFO: Scrape type for XJ41325: 0
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: EZ66449
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: UL70925
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: JG51855
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG51855%27 HTTP/1.1" 200 None
2026-03-27 10:57:49 [auto1.de] INFO: Scrape type for JG51855: 0
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: VH46900
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: CH25964
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH25964%27 HTTP/1.1" 200 None
2026-03-27 10:57:49 [auto1.de] INFO: Scrape type for CH25964: 0
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: SD08227
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD08227%27 HTTP/1.1" 200 None
2026-03-27 10:57:49 [auto1.de] INFO: Scrape type for SD08227: 0
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: YC42355
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC42355%27 HTTP/1.1" 200 None
2026-03-27 10:57:49 [auto1.de] INFO: Scrape type for YC42355: 0
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: JR27484
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR27484%27 HTTP/1.1" 200 None
2026-03-27 10:57:49 [auto1.de] INFO: Scrape type for JR27484: 0
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: UG57897
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG57897%27 HTTP/1.1" 200 None
2026-03-27 10:57:49 [auto1.de] INFO: Scrape type for UG57897: 0
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: PP98476
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: VP79611
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP79611%27 HTTP/1.1" 200 None
2026-03-27 10:57:49 [auto1.de] INFO: Scrape type for VP79611: 0
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: DM73323
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: MU75641
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: WP89589
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP89589%27 HTTP/1.1" 200 None
2026-03-27 10:57:49 [auto1.de] INFO: Scrape type for WP89589: 0
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: RL43389
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL43389%27 HTTP/1.1" 200 None
2026-03-27 10:57:49 [auto1.de] INFO: Scrape type for RL43389: 0
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: SV07694
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: BZ06260
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: DE53161
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: FH12952
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: XU08667
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU08667%27 HTTP/1.1" 200 None
2026-03-27 10:57:49 [auto1.de] INFO: Scrape type for XU08667: 0
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: TC34691
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: NT99648
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT99648%27 HTTP/1.1" 200 None
2026-03-27 10:57:49 [auto1.de] INFO: Scrape type for NT99648: 0
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: WG73343
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG73343%27 HTTP/1.1" 200 None
2026-03-27 10:57:49 [auto1.de] INFO: Scrape type for WG73343: 0
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: KT88198
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: NM13557
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: RU20217
2026-03-27 10:57:49 [auto1.de] INFO: Found listing with ID: SX80762
2026-03-27 10:57:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:50 [auto1.de] INFO: Channel: 24h | Page: 149 | totalHits: 10623 | hits on page: 40
2026-03-27 10:57:50 [auto1.de] INFO: Found listing with ID: LB67403
2026-03-27 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB67403%27 HTTP/1.1" 200 None
2026-03-27 10:57:50 [auto1.de] INFO: Scrape type for LB67403: 0
2026-03-27 10:57:50 [auto1.de] INFO: Found listing with ID: AC08857
2026-03-27 10:57:50 [auto1.de] INFO: Found listing with ID: ZJ94268
2026-03-27 10:57:50 [auto1.de] INFO: Found listing with ID: UT71403
2026-03-27 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT71403%27 HTTP/1.1" 200 None
2026-03-27 10:57:50 [auto1.de] INFO: Scrape type for UT71403: 0
2026-03-27 10:57:50 [auto1.de] INFO: Found listing with ID: PW27553
2026-03-27 10:57:50 [auto1.de] INFO: Found listing with ID: MC26208
2026-03-27 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC26208%27 HTTP/1.1" 200 None
2026-03-27 10:57:50 [auto1.de] INFO: Scrape type for MC26208: 0
2026-03-27 10:57:50 [auto1.de] INFO: Found listing with ID: XV29391
2026-03-27 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV29391%27 HTTP/1.1" 200 None
2026-03-27 10:57:50 [auto1.de] INFO: Scrape type for XV29391: 0
2026-03-27 10:57:50 [auto1.de] INFO: Found listing with ID: WV72742
2026-03-27 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV72742%27 HTTP/1.1" 200 None
2026-03-27 10:57:50 [auto1.de] INFO: Scrape type for WV72742: 0
2026-03-27 10:57:50 [auto1.de] INFO: Found listing with ID: KW93098
2026-03-27 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW93098%27 HTTP/1.1" 200 None
2026-03-27 10:57:50 [auto1.de] INFO: Scrape type for KW93098: 0
2026-03-27 10:57:50 [auto1.de] INFO: Found listing with ID: KV90234
2026-03-27 10:57:50 [auto1.de] INFO: Found listing with ID: GG85995
2026-03-27 10:57:50 [auto1.de] INFO: Found listing with ID: DX27890
2026-03-27 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX27890%27 HTTP/1.1" 200 None
2026-03-27 10:57:50 [auto1.de] INFO: Scrape type for DX27890: 2
2026-03-27 10:57:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab78bc4b-b012-56e4-9a0c-44190b11f726 with identifier: DX27890
2026-03-27 10:57:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab78bc4b-b012-56e4-9a0c-44190b11f726 with scrape type 2
2026-03-27 10:57:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab78bc4b-b012-56e4-9a0c-44190b11f726 with scrape type 2
2026-03-27 10:57:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab78bc4b-b012-56e4-9a0c-44190b11f726, identifier: DX27890
2026-03-27 10:57:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab78bc4b-b012-56e4-9a0c-44190b11f726 with identifier: DX27890
2026-03-27 10:57:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab78bc4b-b012-56e4-9a0c-44190b11f726 with identifier: DX27890
2026-03-27 10:57:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab78bc4b-b012-56e4-9a0c-44190b11f726 with identifier: DX27890 to the API
2026-03-27 10:57:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:57:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:57:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:22:42Z',
 'fuel_type': 'petrol',
 'id': 'ab78bc4b-b012-56e4-9a0c-44190b11f726',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX27890',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 195890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-08',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-27 10:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX27890%27 HTTP/1.1" 200 None
2026-03-27 10:57:51 [auto1.de] INFO: Saving data for DX27890: {'auction_closing_time': 1774628562.0, 'created_time': 1772542676.590495, 'last_price_update_time': 1774609071.881517}
2026-03-27 10:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX27890') HTTP/1.1" 204 0
2026-03-27 10:57:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: BL06566
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: JH03969
2026-03-27 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH03969%27 HTTP/1.1" 200 None
2026-03-27 10:57:52 [auto1.de] INFO: Scrape type for JH03969: 0
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: HE06850
2026-03-27 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE06850%27 HTTP/1.1" 200 None
2026-03-27 10:57:52 [auto1.de] INFO: Scrape type for HE06850: 0
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: LD36602
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: CN66331
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: DP99201
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: PK97822
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: SB50693
2026-03-27 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB50693%27 HTTP/1.1" 200 None
2026-03-27 10:57:52 [auto1.de] INFO: Scrape type for SB50693: 0
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: BV38468
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: UK10359
2026-03-27 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK10359%27 HTTP/1.1" 200 None
2026-03-27 10:57:52 [auto1.de] INFO: Scrape type for UK10359: 0
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: HG78965
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: SG66334
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: RF93551
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: DH76315
2026-03-27 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH76315%27 HTTP/1.1" 200 None
2026-03-27 10:57:52 [auto1.de] INFO: Scrape type for DH76315: 0
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: YJ06008
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: XL57324
2026-03-27 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL57324%27 HTTP/1.1" 200 None
2026-03-27 10:57:52 [auto1.de] INFO: Scrape type for XL57324: 0
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: GR15178
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: PK44731
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: GC65720
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: KR79365
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: VU62303
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: WP32258
2026-03-27 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP32258%27 HTTP/1.1" 200 None
2026-03-27 10:57:52 [auto1.de] INFO: Scrape type for WP32258: 0
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: DH25431
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: MT15247
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: JG57844
2026-03-27 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG57844%27 HTTP/1.1" 200 None
2026-03-27 10:57:52 [auto1.de] INFO: Scrape type for JG57844: 0
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: FE86204
2026-03-27 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE86204%27 HTTP/1.1" 200 None
2026-03-27 10:57:52 [auto1.de] INFO: Scrape type for FE86204: 0
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: RT01188
2026-03-27 10:57:52 [auto1.de] INFO: Found listing with ID: RY89799
2026-03-27 10:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:57:53 [auto1.de] INFO: Channel: 24h | Page: 150 | totalHits: 10623 | hits on page: 40
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: VB04886
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: SE03748
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE03748%27 HTTP/1.1" 200 None
2026-03-27 10:57:53 [auto1.de] INFO: Scrape type for SE03748: 0
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: AT99674
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT99674%27 HTTP/1.1" 200 None
2026-03-27 10:57:53 [auto1.de] INFO: Scrape type for AT99674: 0
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: VC24078
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: FJ41734
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ41734%27 HTTP/1.1" 200 None
2026-03-27 10:57:53 [auto1.de] INFO: Scrape type for FJ41734: 0
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: VZ54866
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: KR74096
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR74096%27 HTTP/1.1" 200 None
2026-03-27 10:57:53 [auto1.de] INFO: Scrape type for KR74096: 0
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: KV82053
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: MT27523
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT27523%27 HTTP/1.1" 200 None
2026-03-27 10:57:53 [auto1.de] INFO: Scrape type for MT27523: 0
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: WX69164
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: BR38332
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: RL37734
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: BB62949
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB62949%27 HTTP/1.1" 200 None
2026-03-27 10:57:53 [auto1.de] INFO: Scrape type for BB62949: 0
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: VL42983
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: NZ53793
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: TP77311
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP77311%27 HTTP/1.1" 200 None
2026-03-27 10:57:53 [auto1.de] INFO: Scrape type for TP77311: 0
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: EH04045
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: RX79901
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX79901%27 HTTP/1.1" 200 None
2026-03-27 10:57:53 [auto1.de] INFO: Scrape type for RX79901: 0
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: HW55427
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW55427%27 HTTP/1.1" 200 None
2026-03-27 10:57:53 [auto1.de] INFO: Scrape type for HW55427: 0
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: WK20643
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: DP60615
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP60615%27 HTTP/1.1" 200 None
2026-03-27 10:57:53 [auto1.de] INFO: Scrape type for DP60615: 0
2026-03-27 10:57:53 [auto1.de] INFO: Found listing with ID: WY77446
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY77446%27 HTTP/1.1" 200 None
2026-03-27 10:57:53 [auto1.de] INFO: Scrape type for WY77446: 2
2026-03-27 10:57:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f9a284f-a0b4-5d09-950a-1a2d3639c21c with identifier: WY77446
2026-03-27 10:57:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f9a284f-a0b4-5d09-950a-1a2d3639c21c with scrape type 2
2026-03-27 10:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f9a284f-a0b4-5d09-950a-1a2d3639c21c with scrape type 2
2026-03-27 10:57:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f9a284f-a0b4-5d09-950a-1a2d3639c21c, identifier: WY77446
2026-03-27 10:57:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f9a284f-a0b4-5d09-950a-1a2d3639c21c with identifier: WY77446
2026-03-27 10:57:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f9a284f-a0b4-5d09-950a-1a2d3639c21c with identifier: WY77446
2026-03-27 10:57:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f9a284f-a0b4-5d09-950a-1a2d3639c21c with identifier: WY77446 to the API
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:57:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:57:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:47:27Z',
 'fuel_type': 'diesel',
 'id': '0f9a284f-a0b4-5d09-950a-1a2d3639c21c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY77446',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 163006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-20',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY77446%27 HTTP/1.1" 200 None
2026-03-27 10:57:54 [auto1.de] INFO: Saving data for WY77446: {'auction_closing_time': 1774630047.0, 'created_time': 1773342854.078515, 'last_price_update_time': 1774609074.059378}
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY77446') HTTP/1.1" 204 0
2026-03-27 10:57:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:57:54 [auto1.de] INFO: Found listing with ID: FH94786
2026-03-27 10:57:54 [auto1.de] INFO: Found listing with ID: ZD77831
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD77831%27 HTTP/1.1" 200 None
2026-03-27 10:57:54 [auto1.de] INFO: Scrape type for ZD77831: 0
2026-03-27 10:57:54 [auto1.de] INFO: Found listing with ID: TH33343
2026-03-27 10:57:54 [auto1.de] INFO: Found listing with ID: YX18251
2026-03-27 10:57:54 [auto1.de] INFO: Found listing with ID: AD45670
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD45670%27 HTTP/1.1" 200 None
2026-03-27 10:57:54 [auto1.de] INFO: Scrape type for AD45670: 0
2026-03-27 10:57:54 [auto1.de] INFO: Found listing with ID: FL47412
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL47412%27 HTTP/1.1" 200 None
2026-03-27 10:57:54 [auto1.de] INFO: Scrape type for FL47412: 0
2026-03-27 10:57:54 [auto1.de] INFO: Found listing with ID: AG57248
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG57248%27 HTTP/1.1" 200 None
2026-03-27 10:57:54 [auto1.de] INFO: Scrape type for AG57248: 0
2026-03-27 10:57:54 [auto1.de] INFO: Found listing with ID: MV76572
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV76572%27 HTTP/1.1" 200 None
2026-03-27 10:57:54 [auto1.de] INFO: Scrape type for MV76572: 0
2026-03-27 10:57:54 [auto1.de] INFO: Found listing with ID: SR56590
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR56590%27 HTTP/1.1" 200 None
2026-03-27 10:57:54 [auto1.de] INFO: Scrape type for SR56590: 0
2026-03-27 10:57:54 [auto1.de] INFO: Found listing with ID: WD56073
2026-03-27 10:57:54 [auto1.de] INFO: Found listing with ID: JC93229
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC93229%27 HTTP/1.1" 200 None
2026-03-27 10:57:54 [auto1.de] INFO: Scrape type for JC93229: 0
2026-03-27 10:57:54 [auto1.de] INFO: Found listing with ID: KF17998
2026-03-27 10:57:54 [auto1.de] INFO: Found listing with ID: ZJ08757
2026-03-27 10:57:54 [auto1.de] INFO: Found listing with ID: FD36365
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD36365%27 HTTP/1.1" 200 None
2026-03-27 10:57:54 [auto1.de] INFO: Scrape type for FD36365: 0
2026-03-27 10:57:54 [auto1.de] INFO: Found listing with ID: WV18755
2026-03-27 10:57:54 [auto1.de] INFO: Found listing with ID: EV41055
2026-03-27 10:57:54 [auto1.de] INFO: Found listing with ID: KR96778
2026-03-27 10:57:54 [auto1.de] INFO: Found listing with ID: NU10771
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU10771%27 HTTP/1.1" 200 None
2026-03-27 10:57:54 [auto1.de] INFO: Scrape type for NU10771: 0
2026-03-27 10:58:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:58:00 [auto1.de] INFO: Channel: 24h | Page: 151 | totalHits: 10624 | hits on page: 40
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: NU10771
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU10771%27 HTTP/1.1" 200 None
2026-03-27 10:58:00 [auto1.de] INFO: Scrape type for NU10771: 0
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: GM94362
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: LC26336
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC26336%27 HTTP/1.1" 200 None
2026-03-27 10:58:00 [auto1.de] INFO: Scrape type for LC26336: 0
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: NF54912
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF54912%27 HTTP/1.1" 200 None
2026-03-27 10:58:00 [auto1.de] INFO: Scrape type for NF54912: 0
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: JC71292
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC71292%27 HTTP/1.1" 200 None
2026-03-27 10:58:00 [auto1.de] INFO: Scrape type for JC71292: 0
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: TA17370
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: GV09238
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV09238%27 HTTP/1.1" 200 None
2026-03-27 10:58:00 [auto1.de] INFO: Scrape type for GV09238: 0
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: CS89362
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS89362%27 HTTP/1.1" 200 None
2026-03-27 10:58:00 [auto1.de] INFO: Scrape type for CS89362: 0
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: HF40608
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: TX62945
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX62945%27 HTTP/1.1" 200 None
2026-03-27 10:58:00 [auto1.de] INFO: Scrape type for TX62945: 0
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: KR13539
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR13539%27 HTTP/1.1" 200 None
2026-03-27 10:58:00 [auto1.de] INFO: Scrape type for KR13539: 0
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: DA94168
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA94168%27 HTTP/1.1" 200 None
2026-03-27 10:58:00 [auto1.de] INFO: Scrape type for DA94168: 0
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: CP53358
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP53358%27 HTTP/1.1" 200 None
2026-03-27 10:58:00 [auto1.de] INFO: Scrape type for CP53358: 0
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: HT15929
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: CK72706
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: AY92583
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY92583%27 HTTP/1.1" 200 None
2026-03-27 10:58:00 [auto1.de] INFO: Scrape type for AY92583: 0
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: AB52853
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB52853%27 HTTP/1.1" 200 None
2026-03-27 10:58:00 [auto1.de] INFO: Scrape type for AB52853: 0
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: DL80875
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL80875%27 HTTP/1.1" 200 None
2026-03-27 10:58:00 [auto1.de] INFO: Scrape type for DL80875: 0
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: JJ00405
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: GL26328
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL26328%27 HTTP/1.1" 200 None
2026-03-27 10:58:00 [auto1.de] INFO: Scrape type for GL26328: 0
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: CE25056
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE25056%27 HTTP/1.1" 200 None
2026-03-27 10:58:00 [auto1.de] INFO: Scrape type for CE25056: 0
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: UH39337
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: RW57073
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: AG51690
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG51690%27 HTTP/1.1" 200 None
2026-03-27 10:58:00 [auto1.de] INFO: Scrape type for AG51690: 0
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: NS06519
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS06519%27 HTTP/1.1" 200 None
2026-03-27 10:58:00 [auto1.de] INFO: Scrape type for NS06519: 0
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: AJ98197
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ98197%27 HTTP/1.1" 200 None
2026-03-27 10:58:00 [auto1.de] INFO: Scrape type for AJ98197: 0
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: YC74395
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: VG84212
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG84212%27 HTTP/1.1" 200 None
2026-03-27 10:58:00 [auto1.de] INFO: Scrape type for VG84212: 0
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: NH53039
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH53039%27 HTTP/1.1" 200 None
2026-03-27 10:58:00 [auto1.de] INFO: Scrape type for NH53039: 0
2026-03-27 10:58:00 [auto1.de] INFO: Found listing with ID: MZ57576
2026-03-27 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ57576%27 HTTP/1.1" 200 None
2026-03-27 10:58:01 [auto1.de] INFO: Scrape type for MZ57576: 0
2026-03-27 10:58:01 [auto1.de] INFO: Found listing with ID: TR39575
2026-03-27 10:58:01 [auto1.de] INFO: Found listing with ID: GH06629
2026-03-27 10:58:01 [auto1.de] INFO: Found listing with ID: KJ15454
2026-03-27 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ15454%27 HTTP/1.1" 200 None
2026-03-27 10:58:01 [auto1.de] INFO: Scrape type for KJ15454: 0
2026-03-27 10:58:01 [auto1.de] INFO: Found listing with ID: LY90714
2026-03-27 10:58:01 [auto1.de] INFO: Found listing with ID: VR66092
2026-03-27 10:58:01 [auto1.de] INFO: Found listing with ID: FJ62780
2026-03-27 10:58:01 [auto1.de] INFO: Found listing with ID: DF37743
2026-03-27 10:58:01 [auto1.de] INFO: Found listing with ID: ZF28173
2026-03-27 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF28173%27 HTTP/1.1" 200 None
2026-03-27 10:58:01 [auto1.de] INFO: Scrape type for ZF28173: 0
2026-03-27 10:58:01 [auto1.de] INFO: Found listing with ID: ME61701
2026-03-27 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME61701%27 HTTP/1.1" 200 None
2026-03-27 10:58:01 [auto1.de] INFO: Scrape type for ME61701: 0
2026-03-27 10:58:01 [auto1.de] INFO: Found listing with ID: XF39485
2026-03-27 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF39485%27 HTTP/1.1" 200 None
2026-03-27 10:58:01 [auto1.de] INFO: Scrape type for XF39485: 0
2026-03-27 10:58:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:58:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:58:02 [auto1.de] INFO: Channel: 24h | Page: 152 | totalHits: 10624 | hits on page: 40
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: EU09221
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: RT92200
2026-03-27 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT92200%27 HTTP/1.1" 200 None
2026-03-27 10:58:02 [auto1.de] INFO: Scrape type for RT92200: 0
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: MP73357
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: CT63766
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: ZZ04091
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: XV74427
2026-03-27 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV74427%27 HTTP/1.1" 200 None
2026-03-27 10:58:02 [auto1.de] INFO: Scrape type for XV74427: 0
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: LX71659
2026-03-27 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX71659%27 HTTP/1.1" 200 None
2026-03-27 10:58:02 [auto1.de] INFO: Scrape type for LX71659: 0
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: AT28488
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: EG42583
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: LZ64363
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: JK99996
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: BK32051
2026-03-27 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK32051%27 HTTP/1.1" 200 None
2026-03-27 10:58:02 [auto1.de] INFO: Scrape type for BK32051: 0
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: HN46656
2026-03-27 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN46656%27 HTTP/1.1" 200 None
2026-03-27 10:58:02 [auto1.de] INFO: Scrape type for HN46656: 0
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: AW59691
2026-03-27 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW59691%27 HTTP/1.1" 200 None
2026-03-27 10:58:02 [auto1.de] INFO: Scrape type for AW59691: 0
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: VM70947
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: HD11508
2026-03-27 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD11508%27 HTTP/1.1" 200 None
2026-03-27 10:58:02 [auto1.de] INFO: Scrape type for HD11508: 0
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: CK60135
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: VR97346
2026-03-27 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR97346%27 HTTP/1.1" 200 None
2026-03-27 10:58:02 [auto1.de] INFO: Scrape type for VR97346: 0
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: ZG11710
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: RX02406
2026-03-27 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX02406%27 HTTP/1.1" 200 None
2026-03-27 10:58:02 [auto1.de] INFO: Scrape type for RX02406: 0
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: TW53975
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: VF27943
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: NC80324
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: RL91217
2026-03-27 10:58:02 [auto1.de] INFO: Found listing with ID: NB86362
2026-03-27 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB86362%27 HTTP/1.1" 200 None
2026-03-27 10:58:02 [auto1.de] INFO: Scrape type for NB86362: 2
2026-03-27 10:58:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f818d18-dbd1-5ff0-8862-2e144f8bd12d with identifier: NB86362
2026-03-27 10:58:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f818d18-dbd1-5ff0-8862-2e144f8bd12d with scrape type 2
2026-03-27 10:58:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f818d18-dbd1-5ff0-8862-2e144f8bd12d with scrape type 2
2026-03-27 10:58:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f818d18-dbd1-5ff0-8862-2e144f8bd12d, identifier: NB86362
2026-03-27 10:58:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f818d18-dbd1-5ff0-8862-2e144f8bd12d with identifier: NB86362
2026-03-27 10:58:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f818d18-dbd1-5ff0-8862-2e144f8bd12d with identifier: NB86362
2026-03-27 10:58:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f818d18-dbd1-5ff0-8862-2e144f8bd12d with identifier: NB86362 to the API
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:58:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-27T16:10:44Z',
 'fuel_type': 'diesel',
 'id': '7f818d18-dbd1-5ff0-8862-2e144f8bd12d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB86362',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 229587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-15',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 d T 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic Avantgarde',
 'year': 2018}
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB86362%27 HTTP/1.1" 200 None
2026-03-27 10:58:03 [auto1.de] INFO: Saving data for NB86362: {'auction_closing_time': 1774627844.0, 'created_time': 1774424143.822838, 'last_price_update_time': 1774609083.360284}
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB86362') HTTP/1.1" 204 0
2026-03-27 10:58:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:58:03 [auto1.de] INFO: Found listing with ID: EF16593
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF16593%27 HTTP/1.1" 200 None
2026-03-27 10:58:03 [auto1.de] INFO: Scrape type for EF16593: 0
2026-03-27 10:58:03 [auto1.de] INFO: Found listing with ID: YK91002
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK91002%27 HTTP/1.1" 200 None
2026-03-27 10:58:03 [auto1.de] INFO: Scrape type for YK91002: 0
2026-03-27 10:58:03 [auto1.de] INFO: Found listing with ID: MY86649
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY86649%27 HTTP/1.1" 200 None
2026-03-27 10:58:03 [auto1.de] INFO: Scrape type for MY86649: 0
2026-03-27 10:58:03 [auto1.de] INFO: Found listing with ID: HT53845
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT53845%27 HTTP/1.1" 200 None
2026-03-27 10:58:03 [auto1.de] INFO: Scrape type for HT53845: 0
2026-03-27 10:58:03 [auto1.de] INFO: Found listing with ID: BH49655
2026-03-27 10:58:03 [auto1.de] INFO: Found listing with ID: SK50734
2026-03-27 10:58:03 [auto1.de] INFO: Found listing with ID: ZZ02833
2026-03-27 10:58:03 [auto1.de] INFO: Found listing with ID: GD09618
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD09618%27 HTTP/1.1" 200 None
2026-03-27 10:58:03 [auto1.de] INFO: Scrape type for GD09618: 0
2026-03-27 10:58:03 [auto1.de] INFO: Found listing with ID: CW35231
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW35231%27 HTTP/1.1" 200 None
2026-03-27 10:58:03 [auto1.de] INFO: Scrape type for CW35231: 0
2026-03-27 10:58:03 [auto1.de] INFO: Found listing with ID: VV25463
2026-03-27 10:58:03 [auto1.de] INFO: Found listing with ID: HY87386
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY87386%27 HTTP/1.1" 200 None
2026-03-27 10:58:03 [auto1.de] INFO: Scrape type for HY87386: 0
2026-03-27 10:58:03 [auto1.de] INFO: Found listing with ID: JH33807
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH33807%27 HTTP/1.1" 200 None
2026-03-27 10:58:03 [auto1.de] INFO: Scrape type for JH33807: 0
2026-03-27 10:58:03 [auto1.de] INFO: Found listing with ID: KG51970
2026-03-27 10:58:03 [auto1.de] INFO: Found listing with ID: MV64182
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV64182%27 HTTP/1.1" 200 None
2026-03-27 10:58:03 [auto1.de] INFO: Scrape type for MV64182: 0
2026-03-27 10:58:03 [auto1.de] INFO: Found listing with ID: SV54413
2026-03-27 10:58:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:58:04 [auto1.de] INFO: Channel: 24h | Page: 153 | totalHits: 10624 | hits on page: 40
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: SC28168
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: KV92241
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV92241%27 HTTP/1.1" 200 None
2026-03-27 10:58:04 [auto1.de] INFO: Scrape type for KV92241: 0
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: UL92999
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: AZ12624
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: TW11648
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: CU60081
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU60081%27 HTTP/1.1" 200 None
2026-03-27 10:58:04 [auto1.de] INFO: Scrape type for CU60081: 0
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: SM51987
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: TY25896
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY25896%27 HTTP/1.1" 200 None
2026-03-27 10:58:04 [auto1.de] INFO: Scrape type for TY25896: 0
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: FJ12691
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ12691%27 HTTP/1.1" 200 None
2026-03-27 10:58:04 [auto1.de] INFO: Scrape type for FJ12691: 0
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: HA27527
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA27527%27 HTTP/1.1" 200 None
2026-03-27 10:58:04 [auto1.de] INFO: Scrape type for HA27527: 0
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: JT36836
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: HM53441
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM53441%27 HTTP/1.1" 200 None
2026-03-27 10:58:04 [auto1.de] INFO: Scrape type for HM53441: 0
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: XN01413
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN01413%27 HTTP/1.1" 200 None
2026-03-27 10:58:04 [auto1.de] INFO: Scrape type for XN01413: 0
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: PX36804
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: CB84596
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB84596%27 HTTP/1.1" 200 None
2026-03-27 10:58:04 [auto1.de] INFO: Scrape type for CB84596: 0
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: SR06825
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR06825%27 HTTP/1.1" 200 None
2026-03-27 10:58:04 [auto1.de] INFO: Scrape type for SR06825: 0
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: FZ79276
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ79276%27 HTTP/1.1" 200 None
2026-03-27 10:58:04 [auto1.de] INFO: Scrape type for FZ79276: 0
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: KN24500
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: NN85060
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: RR48020
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR48020%27 HTTP/1.1" 200 None
2026-03-27 10:58:04 [auto1.de] INFO: Scrape type for RR48020: 0
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: FN32159
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: TY96424
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: KC52744
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC52744%27 HTTP/1.1" 200 None
2026-03-27 10:58:04 [auto1.de] INFO: Scrape type for KC52744: 0
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: ML82340
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: ZD44688
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD44688%27 HTTP/1.1" 200 None
2026-03-27 10:58:04 [auto1.de] INFO: Scrape type for ZD44688: 0
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: KA32583
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA32583%27 HTTP/1.1" 200 None
2026-03-27 10:58:04 [auto1.de] INFO: Scrape type for KA32583: 0
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: LX44936
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: KG10806
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: JY58234
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: LM84236
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM84236%27 HTTP/1.1" 200 None
2026-03-27 10:58:04 [auto1.de] INFO: Scrape type for LM84236: 0
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: GV28684
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: HT38824
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT38824%27 HTTP/1.1" 200 None
2026-03-27 10:58:04 [auto1.de] INFO: Scrape type for HT38824: 0
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: XY24138
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: UK22592
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: ZW43695
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW43695%27 HTTP/1.1" 200 None
2026-03-27 10:58:04 [auto1.de] INFO: Scrape type for ZW43695: 0
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: AV92070
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV92070%27 HTTP/1.1" 200 None
2026-03-27 10:58:04 [auto1.de] INFO: Scrape type for AV92070: 0
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: VR71281
2026-03-27 10:58:04 [auto1.de] INFO: Found listing with ID: GP42203
2026-03-27 10:58:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP42203%27 HTTP/1.1" 200 None
2026-03-27 10:58:05 [auto1.de] INFO: Scrape type for GP42203: 0
2026-03-27 10:58:05 [auto1.de] INFO: Found listing with ID: UF59044
2026-03-27 10:58:05 [auto1.de] INFO: Found listing with ID: UR35427
2026-03-27 10:58:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:58:06 [scrapy.extensions.logstats] INFO: Crawled 621 pages (at 25 pages/min), scraped 912 items (at 6 items/min)
2026-03-27 10:58:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 10:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:58:08 [auto1.de] INFO: Channel: 24h | Page: 154 | totalHits: 10624 | hits on page: 40
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: VU18540
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU18540%27 HTTP/1.1" 200 None
2026-03-27 10:58:08 [auto1.de] INFO: Scrape type for VU18540: 0
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: RS74296
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS74296%27 HTTP/1.1" 200 None
2026-03-27 10:58:08 [auto1.de] INFO: Scrape type for RS74296: 0
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: TP36932
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: PH88321
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: MG66726
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG66726%27 HTTP/1.1" 200 None
2026-03-27 10:58:08 [auto1.de] INFO: Scrape type for MG66726: 0
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: AN69467
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN69467%27 HTTP/1.1" 200 None
2026-03-27 10:58:08 [auto1.de] INFO: Scrape type for AN69467: 0
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: XM11846
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM11846%27 HTTP/1.1" 200 None
2026-03-27 10:58:08 [auto1.de] INFO: Scrape type for XM11846: 0
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: TZ15393
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ15393%27 HTTP/1.1" 200 None
2026-03-27 10:58:08 [auto1.de] INFO: Scrape type for TZ15393: 0
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: LF57012
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: NH37075
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: SS40295
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: TW14325
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW14325%27 HTTP/1.1" 200 None
2026-03-27 10:58:08 [auto1.de] INFO: Scrape type for TW14325: 0
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: AZ27432
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: MT86254
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: FN23082
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN23082%27 HTTP/1.1" 200 None
2026-03-27 10:58:08 [auto1.de] INFO: Scrape type for FN23082: 0
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: RY27380
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: FV34689
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV34689%27 HTTP/1.1" 200 None
2026-03-27 10:58:08 [auto1.de] INFO: Scrape type for FV34689: 0
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: BM74248
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM74248%27 HTTP/1.1" 200 None
2026-03-27 10:58:08 [auto1.de] INFO: Scrape type for BM74248: 0
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: HZ43600
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ43600%27 HTTP/1.1" 200 None
2026-03-27 10:58:08 [auto1.de] INFO: Scrape type for HZ43600: 0
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: KW02679
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: PY59919
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY59919%27 HTTP/1.1" 200 None
2026-03-27 10:58:08 [auto1.de] INFO: Scrape type for PY59919: 0
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: XR64222
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: HT55645
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT55645%27 HTTP/1.1" 200 None
2026-03-27 10:58:08 [auto1.de] INFO: Scrape type for HT55645: 0
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: WP00727
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: LJ19691
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: HV98245
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV98245%27 HTTP/1.1" 200 None
2026-03-27 10:58:08 [auto1.de] INFO: Scrape type for HV98245: 0
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: XE44885
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE44885%27 HTTP/1.1" 200 None
2026-03-27 10:58:08 [auto1.de] INFO: Scrape type for XE44885: 0
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: TL37084
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL37084%27 HTTP/1.1" 200 None
2026-03-27 10:58:08 [auto1.de] INFO: Scrape type for TL37084: 0
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: JC38309
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: PT11126
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: ZE87532
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: UE64486
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: PF00888
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF00888%27 HTTP/1.1" 200 None
2026-03-27 10:58:08 [auto1.de] INFO: Scrape type for PF00888: 0
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: WB57730
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: MP90537
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP90537%27 HTTP/1.1" 200 None
2026-03-27 10:58:08 [auto1.de] INFO: Scrape type for MP90537: 0
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: KX93717
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX93717%27 HTTP/1.1" 200 None
2026-03-27 10:58:08 [auto1.de] INFO: Scrape type for KX93717: 0
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: EU61165
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: NV63188
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: XL89060
2026-03-27 10:58:08 [auto1.de] INFO: Found listing with ID: WM92411
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM92411%27 HTTP/1.1" 200 None
2026-03-27 10:58:08 [auto1.de] INFO: Scrape type for WM92411: 0
2026-03-27 10:58:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:58:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:58:09 [auto1.de] INFO: Channel: 24h | Page: 155 | totalHits: 10624 | hits on page: 40
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: CH92359
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: TS98691
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS98691%27 HTTP/1.1" 200 None
2026-03-27 10:58:09 [auto1.de] INFO: Scrape type for TS98691: 0
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: FK65857
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: XH30741
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: DS36264
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS36264%27 HTTP/1.1" 200 None
2026-03-27 10:58:09 [auto1.de] INFO: Scrape type for DS36264: 0
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: PY20785
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: XT91085
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: AS81057
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS81057%27 HTTP/1.1" 200 None
2026-03-27 10:58:09 [auto1.de] INFO: Scrape type for AS81057: 0
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: BS29922
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: LX06278
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: EY81923
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: DH11736
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: XU07051
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU07051%27 HTTP/1.1" 200 None
2026-03-27 10:58:09 [auto1.de] INFO: Scrape type for XU07051: 0
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: ZT67074
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT67074%27 HTTP/1.1" 200 None
2026-03-27 10:58:09 [auto1.de] INFO: Scrape type for ZT67074: 0
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: GN34545
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: PL36428
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: DN56642
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: YC53250
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: ZC73277
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC73277%27 HTTP/1.1" 200 None
2026-03-27 10:58:09 [auto1.de] INFO: Scrape type for ZC73277: 0
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: JC07133
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC07133%27 HTTP/1.1" 200 None
2026-03-27 10:58:09 [auto1.de] INFO: Scrape type for JC07133: 0
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: GN29704
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN29704%27 HTTP/1.1" 200 None
2026-03-27 10:58:09 [auto1.de] INFO: Scrape type for GN29704: 0
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: SY24934
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: GB09367
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: TS72437
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS72437%27 HTTP/1.1" 200 None
2026-03-27 10:58:09 [auto1.de] INFO: Scrape type for TS72437: 0
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: AE37337
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: YV92261
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV92261%27 HTTP/1.1" 200 None
2026-03-27 10:58:09 [auto1.de] INFO: Scrape type for YV92261: 0
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: HU80433
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: VV75383
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV75383%27 HTTP/1.1" 200 None
2026-03-27 10:58:09 [auto1.de] INFO: Scrape type for VV75383: 0
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: HR34159
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: NU72474
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: UW04786
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: NR79068
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR79068%27 HTTP/1.1" 200 None
2026-03-27 10:58:09 [auto1.de] INFO: Scrape type for NR79068: 0
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: AE33479
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE33479%27 HTTP/1.1" 200 None
2026-03-27 10:58:09 [auto1.de] INFO: Scrape type for AE33479: 0
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: HP43696
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP43696%27 HTTP/1.1" 200 None
2026-03-27 10:58:09 [auto1.de] INFO: Scrape type for HP43696: 0
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: AH51648
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: NN39507
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: TS77277
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: GX09091
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX09091%27 HTTP/1.1" 200 None
2026-03-27 10:58:09 [auto1.de] INFO: Scrape type for GX09091: 0
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: LF06916
2026-03-27 10:58:09 [auto1.de] INFO: Found listing with ID: EM97228
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM97228%27 HTTP/1.1" 200 None
2026-03-27 10:58:09 [auto1.de] INFO: Scrape type for EM97228: 0
2026-03-27 10:58:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:58:10 [auto1.de] INFO: Channel: 24h | Page: 156 | totalHits: 10624 | hits on page: 40
2026-03-27 10:58:10 [auto1.de] INFO: Found listing with ID: AR80743
2026-03-27 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR80743%27 HTTP/1.1" 200 None
2026-03-27 10:58:10 [auto1.de] INFO: Scrape type for AR80743: 0
2026-03-27 10:58:10 [auto1.de] INFO: Found listing with ID: WZ57217
2026-03-27 10:58:10 [auto1.de] INFO: Found listing with ID: FA77948
2026-03-27 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA77948%27 HTTP/1.1" 200 None
2026-03-27 10:58:10 [auto1.de] INFO: Scrape type for FA77948: 0
2026-03-27 10:58:10 [auto1.de] INFO: Found listing with ID: FD54213
2026-03-27 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD54213%27 HTTP/1.1" 200 None
2026-03-27 10:58:10 [auto1.de] INFO: Scrape type for FD54213: 2
2026-03-27 10:58:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f0fd128-9a4b-5164-818f-ca54c1a5dd4c with identifier: FD54213
2026-03-27 10:58:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f0fd128-9a4b-5164-818f-ca54c1a5dd4c with scrape type 2
2026-03-27 10:58:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f0fd128-9a4b-5164-818f-ca54c1a5dd4c with scrape type 2
2026-03-27 10:58:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f0fd128-9a4b-5164-818f-ca54c1a5dd4c, identifier: FD54213
2026-03-27 10:58:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f0fd128-9a4b-5164-818f-ca54c1a5dd4c with identifier: FD54213
2026-03-27 10:58:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f0fd128-9a4b-5164-818f-ca54c1a5dd4c with identifier: FD54213
2026-03-27 10:58:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f0fd128-9a4b-5164-818f-ca54c1a5dd4c with identifier: FD54213 to the API
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:58:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-27T16:27:21Z',
 'fuel_type': 'petrol',
 'id': '8f0fd128-9a4b-5164-818f-ca54c1a5dd4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD54213',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 161551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-15',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T Kinetic',
 'transmission': 'automatic',
 'trim': 'Kinetic',
 'year': 2010}
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD54213%27 HTTP/1.1" 200 None
2026-03-27 10:58:11 [auto1.de] INFO: Saving data for FD54213: {'auction_closing_time': 1774628841.0, 'created_time': 1773229186.694577, 'last_price_update_time': 1774609091.611966}
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD54213') HTTP/1.1" 204 0
2026-03-27 10:58:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: RW46423
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: GJ35337
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ35337%27 HTTP/1.1" 200 None
2026-03-27 10:58:11 [auto1.de] INFO: Scrape type for GJ35337: 0
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: BZ91502
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: VU26038
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: AL89719
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: MD97257
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: AJ30359
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: FJ74613
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ74613%27 HTTP/1.1" 200 None
2026-03-27 10:58:11 [auto1.de] INFO: Scrape type for FJ74613: 0
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: FW93325
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW93325%27 HTTP/1.1" 200 None
2026-03-27 10:58:11 [auto1.de] INFO: Scrape type for FW93325: 0
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: ZB85688
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB85688%27 HTTP/1.1" 200 None
2026-03-27 10:58:11 [auto1.de] INFO: Scrape type for ZB85688: 0
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: CJ14653
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: LA01379
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA01379%27 HTTP/1.1" 200 None
2026-03-27 10:58:11 [auto1.de] INFO: Scrape type for LA01379: 0
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: EA35608
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: WU98118
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU98118%27 HTTP/1.1" 200 None
2026-03-27 10:58:11 [auto1.de] INFO: Scrape type for WU98118: 0
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: TZ63257
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ63257%27 HTTP/1.1" 200 None
2026-03-27 10:58:11 [auto1.de] INFO: Scrape type for TZ63257: 0
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: GA58316
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA58316%27 HTTP/1.1" 200 None
2026-03-27 10:58:11 [auto1.de] INFO: Scrape type for GA58316: 0
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: LT05765
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT05765%27 HTTP/1.1" 200 None
2026-03-27 10:58:11 [auto1.de] INFO: Scrape type for LT05765: 0
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: VR14324
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: TF67733
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF67733%27 HTTP/1.1" 200 None
2026-03-27 10:58:11 [auto1.de] INFO: Scrape type for TF67733: 0
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: JU85476
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU85476%27 HTTP/1.1" 200 None
2026-03-27 10:58:11 [auto1.de] INFO: Scrape type for JU85476: 0
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: KH60913
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: GG79095
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: NR88985
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR88985%27 HTTP/1.1" 200 None
2026-03-27 10:58:11 [auto1.de] INFO: Scrape type for NR88985: 0
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: NP69462
2026-03-27 10:58:11 [auto1.de] INFO: Found listing with ID: SD16829
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD16829%27 HTTP/1.1" 200 None
2026-03-27 10:58:11 [auto1.de] INFO: Scrape type for SD16829: 2
2026-03-27 10:58:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd95f98a-fd1a-5f17-b6a9-a915b666da37 with identifier: SD16829
2026-03-27 10:58:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd95f98a-fd1a-5f17-b6a9-a915b666da37 with scrape type 2
2026-03-27 10:58:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd95f98a-fd1a-5f17-b6a9-a915b666da37 with scrape type 2
2026-03-27 10:58:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd95f98a-fd1a-5f17-b6a9-a915b666da37, identifier: SD16829
2026-03-27 10:58:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd95f98a-fd1a-5f17-b6a9-a915b666da37 with identifier: SD16829
2026-03-27 10:58:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd95f98a-fd1a-5f17-b6a9-a915b666da37 with identifier: SD16829
2026-03-27 10:58:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd95f98a-fd1a-5f17-b6a9-a915b666da37 with identifier: SD16829 to the API
2026-03-27 10:58:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:58:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:58:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-27T16:12:24Z',
 'fuel_type': 'diesel',
 'id': 'cd95f98a-fd1a-5f17-b6a9-a915b666da37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD16829',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 231272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-27',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2020}
2026-03-27 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD16829%27 HTTP/1.1" 200 None
2026-03-27 10:58:12 [auto1.de] INFO: Saving data for SD16829: {'auction_closing_time': 1774627944.0, 'created_time': 1773687047.979033, 'last_price_update_time': 1774609092.391586}
2026-03-27 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD16829') HTTP/1.1" 204 0
2026-03-27 10:58:12 [auto1.de] INFO: Found listing with ID: VZ68210
2026-03-27 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ68210%27 HTTP/1.1" 200 None
2026-03-27 10:58:12 [auto1.de] INFO: Scrape type for VZ68210: 0
2026-03-27 10:58:12 [auto1.de] INFO: Found listing with ID: BM18721
2026-03-27 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM18721%27 HTTP/1.1" 200 None
2026-03-27 10:58:12 [auto1.de] INFO: Scrape type for BM18721: 0
2026-03-27 10:58:12 [auto1.de] INFO: Found listing with ID: ZY97327
2026-03-27 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY97327%27 HTTP/1.1" 200 None
2026-03-27 10:58:12 [auto1.de] INFO: Scrape type for ZY97327: 0
2026-03-27 10:58:12 [auto1.de] INFO: Found listing with ID: ZZ69358
2026-03-27 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ69358%27 HTTP/1.1" 200 None
2026-03-27 10:58:12 [auto1.de] INFO: Scrape type for ZZ69358: 0
2026-03-27 10:58:12 [auto1.de] INFO: Found listing with ID: SH68668
2026-03-27 10:58:12 [auto1.de] INFO: Found listing with ID: RP99262
2026-03-27 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP99262%27 HTTP/1.1" 200 None
2026-03-27 10:58:12 [auto1.de] INFO: Scrape type for RP99262: 0
2026-03-27 10:58:12 [auto1.de] INFO: Found listing with ID: PS41324
2026-03-27 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS41324%27 HTTP/1.1" 200 None
2026-03-27 10:58:12 [auto1.de] INFO: Scrape type for PS41324: 2
2026-03-27 10:58:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f72570d-01a0-5205-b2fb-dab63431c9a4 with identifier: PS41324
2026-03-27 10:58:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f72570d-01a0-5205-b2fb-dab63431c9a4 with scrape type 2
2026-03-27 10:58:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f72570d-01a0-5205-b2fb-dab63431c9a4 with scrape type 2
2026-03-27 10:58:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f72570d-01a0-5205-b2fb-dab63431c9a4, identifier: PS41324
2026-03-27 10:58:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f72570d-01a0-5205-b2fb-dab63431c9a4 with identifier: PS41324
2026-03-27 10:58:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f72570d-01a0-5205-b2fb-dab63431c9a4 with identifier: PS41324
2026-03-27 10:58:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f72570d-01a0-5205-b2fb-dab63431c9a4 with identifier: PS41324 to the API
2026-03-27 10:58:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:58:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:58:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 710,
 'expiration_date': '2026-03-27T16:37:09Z',
 'fuel_type': 'petrol',
 'id': '8f72570d-01a0-5205-b2fb-dab63431c9a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS41324',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 136416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-27',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 6.2 V8 Trailhawk',
 'transmission': 'automatic',
 'trim': 'Trailhawk',
 'year': 2018}
2026-03-27 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS41324%27 HTTP/1.1" 200 None
2026-03-27 10:58:13 [auto1.de] INFO: Saving data for PS41324: {'auction_closing_time': 1774629429.0, 'created_time': 1773775266.657383, 'last_price_update_time': 1774609093.049127}
2026-03-27 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS41324') HTTP/1.1" 204 0
2026-03-27 10:58:13 [auto1.de] INFO: Found listing with ID: XK23798
2026-03-27 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK23798%27 HTTP/1.1" 200 None
2026-03-27 10:58:13 [auto1.de] INFO: Scrape type for XK23798: 0
2026-03-27 10:58:13 [auto1.de] INFO: Found listing with ID: PB92040
2026-03-27 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB92040%27 HTTP/1.1" 200 None
2026-03-27 10:58:13 [auto1.de] INFO: Scrape type for PB92040: 0
2026-03-27 10:58:13 [auto1.de] INFO: Found listing with ID: DK74587
2026-03-27 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK74587%27 HTTP/1.1" 200 None
2026-03-27 10:58:13 [auto1.de] INFO: Scrape type for DK74587: 0
2026-03-27 10:58:13 [auto1.de] INFO: Found listing with ID: FR46938
2026-03-27 10:58:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:58:39 [auto1.de] INFO: Channel: 24h | Page: 157 | totalHits: 10625 | hits on page: 40
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: FR46938
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: VV84209
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV84209%27 HTTP/1.1" 200 None
2026-03-27 10:58:39 [auto1.de] INFO: Scrape type for VV84209: 0
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: SZ44736
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: LU59149
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: FP74638
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP74638%27 HTTP/1.1" 200 None
2026-03-27 10:58:39 [auto1.de] INFO: Scrape type for FP74638: 0
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: KM25194
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM25194%27 HTTP/1.1" 200 None
2026-03-27 10:58:39 [auto1.de] INFO: Scrape type for KM25194: 0
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: BS18146
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS18146%27 HTTP/1.1" 200 None
2026-03-27 10:58:39 [auto1.de] INFO: Scrape type for BS18146: 0
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: DM83543
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM83543%27 HTTP/1.1" 200 None
2026-03-27 10:58:39 [auto1.de] INFO: Scrape type for DM83543: 0
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: DM82978
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: CK74950
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK74950%27 HTTP/1.1" 200 None
2026-03-27 10:58:39 [auto1.de] INFO: Scrape type for CK74950: 0
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: RZ52182
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ52182%27 HTTP/1.1" 200 None
2026-03-27 10:58:39 [auto1.de] INFO: Scrape type for RZ52182: 0
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: TB06911
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: YL90349
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL90349%27 HTTP/1.1" 200 None
2026-03-27 10:58:39 [auto1.de] INFO: Scrape type for YL90349: 0
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: EZ42588
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: UL60469
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: KK63097
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK63097%27 HTTP/1.1" 200 None
2026-03-27 10:58:39 [auto1.de] INFO: Scrape type for KK63097: 0
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: KT69264
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: DK81331
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: FB02409
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB02409%27 HTTP/1.1" 200 None
2026-03-27 10:58:39 [auto1.de] INFO: Scrape type for FB02409: 0
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: AN22906
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN22906%27 HTTP/1.1" 200 None
2026-03-27 10:58:39 [auto1.de] INFO: Scrape type for AN22906: 0
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: JH43071
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH43071%27 HTTP/1.1" 200 None
2026-03-27 10:58:39 [auto1.de] INFO: Scrape type for JH43071: 0
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: VX70019
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX70019%27 HTTP/1.1" 200 None
2026-03-27 10:58:39 [auto1.de] INFO: Scrape type for VX70019: 0
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: XZ91818
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: AA55180
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA55180%27 HTTP/1.1" 200 None
2026-03-27 10:58:39 [auto1.de] INFO: Scrape type for AA55180: 0
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: VY63136
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: XZ80184
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ80184%27 HTTP/1.1" 200 None
2026-03-27 10:58:39 [auto1.de] INFO: Scrape type for XZ80184: 0
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: AU99703
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: KP49252
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: HS33411
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: BC34353
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC34353%27 HTTP/1.1" 200 None
2026-03-27 10:58:39 [auto1.de] INFO: Scrape type for BC34353: 0
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: NM88222
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM88222%27 HTTP/1.1" 200 None
2026-03-27 10:58:39 [auto1.de] INFO: Scrape type for NM88222: 0
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: CR80817
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: NS29449
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: XW62515
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: UY98848
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: RA23936
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: RP64077
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP64077%27 HTTP/1.1" 200 None
2026-03-27 10:58:39 [auto1.de] INFO: Scrape type for RP64077: 0
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: DC86384
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC86384%27 HTTP/1.1" 200 None
2026-03-27 10:58:39 [auto1.de] INFO: Scrape type for DC86384: 0
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: VM03652
2026-03-27 10:58:39 [auto1.de] INFO: Found listing with ID: CZ79831
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ79831%27 HTTP/1.1" 200 None
2026-03-27 10:58:39 [auto1.de] INFO: Scrape type for CZ79831: 0
2026-03-27 10:58:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:58:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:58:40 [auto1.de] INFO: Channel: 24h | Page: 158 | totalHits: 10625 | hits on page: 40
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: PG76455
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: BE06581
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: XK54927
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK54927%27 HTTP/1.1" 200 None
2026-03-27 10:58:40 [auto1.de] INFO: Scrape type for XK54927: 0
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: LC46015
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: DV69723
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: RU30920
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU30920%27 HTTP/1.1" 200 None
2026-03-27 10:58:40 [auto1.de] INFO: Scrape type for RU30920: 0
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: MZ98871
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ98871%27 HTTP/1.1" 200 None
2026-03-27 10:58:40 [auto1.de] INFO: Scrape type for MZ98871: 0
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: UE61425
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE61425%27 HTTP/1.1" 200 None
2026-03-27 10:58:40 [auto1.de] INFO: Scrape type for UE61425: 0
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: SW14494
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: AL43539
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: DF54059
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: DS97225
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS97225%27 HTTP/1.1" 200 None
2026-03-27 10:58:40 [auto1.de] INFO: Scrape type for DS97225: 0
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: AL63022
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL63022%27 HTTP/1.1" 200 None
2026-03-27 10:58:40 [auto1.de] INFO: Scrape type for AL63022: 0
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: DF48310
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: YK08772
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: YR20535
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: EE13934
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE13934%27 HTTP/1.1" 200 None
2026-03-27 10:58:40 [auto1.de] INFO: Scrape type for EE13934: 0
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: ZM31431
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: LK13966
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK13966%27 HTTP/1.1" 200 None
2026-03-27 10:58:40 [auto1.de] INFO: Scrape type for LK13966: 0
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: NF60730
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: LC00644
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC00644%27 HTTP/1.1" 200 None
2026-03-27 10:58:40 [auto1.de] INFO: Scrape type for LC00644: 0
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: GL96488
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL96488%27 HTTP/1.1" 200 None
2026-03-27 10:58:40 [auto1.de] INFO: Scrape type for GL96488: 0
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: YH17193
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH17193%27 HTTP/1.1" 200 None
2026-03-27 10:58:40 [auto1.de] INFO: Scrape type for YH17193: 0
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: ZK28683
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: GL31374
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL31374%27 HTTP/1.1" 200 None
2026-03-27 10:58:40 [auto1.de] INFO: Scrape type for GL31374: 0
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: GJ77546
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: VA97546
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: EN21542
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN21542%27 HTTP/1.1" 200 None
2026-03-27 10:58:40 [auto1.de] INFO: Scrape type for EN21542: 0
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: TW04232
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW04232%27 HTTP/1.1" 200 None
2026-03-27 10:58:40 [auto1.de] INFO: Scrape type for TW04232: 0
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: TN91877
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN91877%27 HTTP/1.1" 200 None
2026-03-27 10:58:40 [auto1.de] INFO: Scrape type for TN91877: 0
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: SW04854
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW04854%27 HTTP/1.1" 200 None
2026-03-27 10:58:40 [auto1.de] INFO: Scrape type for SW04854: 0
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: EW47494
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: DZ69774
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: ZC51541
2026-03-27 10:58:40 [auto1.de] INFO: Found listing with ID: SV63758
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV63758%27 HTTP/1.1" 200 None
2026-03-27 10:58:40 [auto1.de] INFO: Scrape type for SV63758: 2
2026-03-27 10:58:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1b172e6-79fa-5abe-b7b9-3ffb82722e3c with identifier: SV63758
2026-03-27 10:58:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1b172e6-79fa-5abe-b7b9-3ffb82722e3c with scrape type 2
2026-03-27 10:58:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1b172e6-79fa-5abe-b7b9-3ffb82722e3c with scrape type 2
2026-03-27 10:58:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1b172e6-79fa-5abe-b7b9-3ffb82722e3c, identifier: SV63758
2026-03-27 10:58:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1b172e6-79fa-5abe-b7b9-3ffb82722e3c with identifier: SV63758
2026-03-27 10:58:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1b172e6-79fa-5abe-b7b9-3ffb82722e3c with identifier: SV63758
2026-03-27 10:58:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1b172e6-79fa-5abe-b7b9-3ffb82722e3c with identifier: SV63758 to the API
2026-03-27 10:58:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:58:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:58:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:35:30Z',
 'fuel_type': 'petrol',
 'id': 'a1b172e6-79fa-5abe-b7b9-3ffb82722e3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV63758',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 152725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-29',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2011}
2026-03-27 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV63758%27 HTTP/1.1" 200 None
2026-03-27 10:58:41 [auto1.de] INFO: Saving data for SV63758: {'auction_closing_time': 1774629330.0, 'created_time': 1774337765.45353, 'last_price_update_time': 1774609121.569025}
2026-03-27 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV63758') HTTP/1.1" 204 0
2026-03-27 10:58:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:58:41 [auto1.de] INFO: Found listing with ID: LS49752
2026-03-27 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS49752%27 HTTP/1.1" 200 None
2026-03-27 10:58:41 [auto1.de] INFO: Scrape type for LS49752: 0
2026-03-27 10:58:41 [auto1.de] INFO: Found listing with ID: VS51720
2026-03-27 10:58:41 [auto1.de] INFO: Found listing with ID: WJ84209
2026-03-27 10:58:41 [auto1.de] INFO: Found listing with ID: CF81636
2026-03-27 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF81636%27 HTTP/1.1" 200 None
2026-03-27 10:58:41 [auto1.de] INFO: Scrape type for CF81636: 0
2026-03-27 10:58:41 [auto1.de] INFO: Found listing with ID: ZH98765
2026-03-27 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH98765%27 HTTP/1.1" 200 None
2026-03-27 10:58:41 [auto1.de] INFO: Scrape type for ZH98765: 0
2026-03-27 10:58:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:58:42 [auto1.de] INFO: Channel: 24h | Page: 159 | totalHits: 10625 | hits on page: 40
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: AV48521
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV48521%27 HTTP/1.1" 200 None
2026-03-27 10:58:42 [auto1.de] INFO: Scrape type for AV48521: 0
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: XG32148
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG32148%27 HTTP/1.1" 200 None
2026-03-27 10:58:42 [auto1.de] INFO: Scrape type for XG32148: 0
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: RE64709
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: LN12101
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN12101%27 HTTP/1.1" 200 None
2026-03-27 10:58:42 [auto1.de] INFO: Scrape type for LN12101: 0
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: WW66064
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW66064%27 HTTP/1.1" 200 None
2026-03-27 10:58:42 [auto1.de] INFO: Scrape type for WW66064: 0
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: UJ83654
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: VV77812
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV77812%27 HTTP/1.1" 200 None
2026-03-27 10:58:42 [auto1.de] INFO: Scrape type for VV77812: 0
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: XA43557
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA43557%27 HTTP/1.1" 200 None
2026-03-27 10:58:42 [auto1.de] INFO: Scrape type for XA43557: 0
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: XP80923
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: FV15309
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: FW03190
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: FU42762
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU42762%27 HTTP/1.1" 200 None
2026-03-27 10:58:42 [auto1.de] INFO: Scrape type for FU42762: 0
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: PY43658
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: VU26984
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: JE79565
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: PP42354
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: AT85547
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: CJ75099
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: WV31181
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: BZ32388
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: HZ59997
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ59997%27 HTTP/1.1" 200 None
2026-03-27 10:58:42 [auto1.de] INFO: Scrape type for HZ59997: 0
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: GX23013
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: FX43739
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX43739%27 HTTP/1.1" 200 None
2026-03-27 10:58:42 [auto1.de] INFO: Scrape type for FX43739: 0
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: PH19669
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: HY42291
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY42291%27 HTTP/1.1" 200 None
2026-03-27 10:58:42 [auto1.de] INFO: Scrape type for HY42291: 0
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: CC80699
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC80699%27 HTTP/1.1" 200 None
2026-03-27 10:58:42 [auto1.de] INFO: Scrape type for CC80699: 0
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: EG02570
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: MU03825
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU03825%27 HTTP/1.1" 200 None
2026-03-27 10:58:42 [auto1.de] INFO: Scrape type for MU03825: 0
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: DX58927
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: CS76410
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: FK25443
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: YH60342
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH60342%27 HTTP/1.1" 200 None
2026-03-27 10:58:42 [auto1.de] INFO: Scrape type for YH60342: 0
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: AB79624
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: WK06356
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: VJ74117
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: YP19468
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: UL33107
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL33107%27 HTTP/1.1" 200 None
2026-03-27 10:58:42 [auto1.de] INFO: Scrape type for UL33107: 0
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: BB20772
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB20772%27 HTTP/1.1" 200 None
2026-03-27 10:58:42 [auto1.de] INFO: Scrape type for BB20772: 0
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: CU91749
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU91749%27 HTTP/1.1" 200 None
2026-03-27 10:58:42 [auto1.de] INFO: Scrape type for CU91749: 0
2026-03-27 10:58:42 [auto1.de] INFO: Found listing with ID: ED62579
2026-03-27 10:58:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:58:44 [auto1.de] INFO: Channel: 24h | Page: 160 | totalHits: 10625 | hits on page: 40
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: DF29745
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: LD15011
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: KD27092
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: PM50129
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM50129%27 HTTP/1.1" 200 None
2026-03-27 10:58:44 [auto1.de] INFO: Scrape type for PM50129: 0
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: VP41401
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: FV09782
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: WE22661
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: EX42379
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: EP52094
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP52094%27 HTTP/1.1" 200 None
2026-03-27 10:58:44 [auto1.de] INFO: Scrape type for EP52094: 0
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: HL70337
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: JY80849
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY80849%27 HTTP/1.1" 200 None
2026-03-27 10:58:44 [auto1.de] INFO: Scrape type for JY80849: 0
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: VT98860
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT98860%27 HTTP/1.1" 200 None
2026-03-27 10:58:44 [auto1.de] INFO: Scrape type for VT98860: 0
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: AP94467
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP94467%27 HTTP/1.1" 200 None
2026-03-27 10:58:44 [auto1.de] INFO: Scrape type for AP94467: 0
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: YZ43910
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ43910%27 HTTP/1.1" 200 None
2026-03-27 10:58:44 [auto1.de] INFO: Scrape type for YZ43910: 0
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: GK78804
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: JB80786
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: AJ19988
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ19988%27 HTTP/1.1" 200 None
2026-03-27 10:58:44 [auto1.de] INFO: Scrape type for AJ19988: 0
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: SZ82893
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ82893%27 HTTP/1.1" 200 None
2026-03-27 10:58:44 [auto1.de] INFO: Scrape type for SZ82893: 0
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: HD49679
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD49679%27 HTTP/1.1" 200 None
2026-03-27 10:58:44 [auto1.de] INFO: Scrape type for HD49679: 0
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: SM08182
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: GV52472
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: GY17269
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY17269%27 HTTP/1.1" 200 None
2026-03-27 10:58:44 [auto1.de] INFO: Scrape type for GY17269: 0
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: WF04310
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF04310%27 HTTP/1.1" 200 None
2026-03-27 10:58:44 [auto1.de] INFO: Scrape type for WF04310: 0
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: TY59388
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: YX62865
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: DT89574
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: EP79440
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP79440%27 HTTP/1.1" 200 None
2026-03-27 10:58:44 [auto1.de] INFO: Scrape type for EP79440: 0
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: BP18681
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: LE51560
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE51560%27 HTTP/1.1" 200 None
2026-03-27 10:58:44 [auto1.de] INFO: Scrape type for LE51560: 0
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: SD07128
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: RM29810
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM29810%27 HTTP/1.1" 200 None
2026-03-27 10:58:44 [auto1.de] INFO: Scrape type for RM29810: 0
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: CC51739
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: TN69182
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN69182%27 HTTP/1.1" 200 None
2026-03-27 10:58:44 [auto1.de] INFO: Scrape type for TN69182: 0
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: CT29846
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: PU06584
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU06584%27 HTTP/1.1" 200 None
2026-03-27 10:58:44 [auto1.de] INFO: Scrape type for PU06584: 0
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: UH91278
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH91278%27 HTTP/1.1" 200 None
2026-03-27 10:58:44 [auto1.de] INFO: Scrape type for UH91278: 0
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: YY40384
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: RU00171
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU00171%27 HTTP/1.1" 200 None
2026-03-27 10:58:44 [auto1.de] INFO: Scrape type for RU00171: 0
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: VP65266
2026-03-27 10:58:44 [auto1.de] INFO: Found listing with ID: RD11154
2026-03-27 10:58:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:58:45 [auto1.de] INFO: Channel: 24h | Page: 161 | totalHits: 10625 | hits on page: 40
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: LV20570
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: ZE37210
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: KP26466
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP26466%27 HTTP/1.1" 200 None
2026-03-27 10:58:45 [auto1.de] INFO: Scrape type for KP26466: 0
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: WZ91552
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: RS08220
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: SR37454
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: MU43821
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU43821%27 HTTP/1.1" 200 None
2026-03-27 10:58:45 [auto1.de] INFO: Scrape type for MU43821: 0
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: VW53708
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: FU70567
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: EP25363
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP25363%27 HTTP/1.1" 200 None
2026-03-27 10:58:45 [auto1.de] INFO: Scrape type for EP25363: 0
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: BC57293
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: KD46198
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD46198%27 HTTP/1.1" 200 None
2026-03-27 10:58:45 [auto1.de] INFO: Scrape type for KD46198: 0
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: FM35846
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM35846%27 HTTP/1.1" 200 None
2026-03-27 10:58:45 [auto1.de] INFO: Scrape type for FM35846: 0
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: AU94356
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU94356%27 HTTP/1.1" 200 None
2026-03-27 10:58:45 [auto1.de] INFO: Scrape type for AU94356: 0
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: YG99324
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG99324%27 HTTP/1.1" 200 None
2026-03-27 10:58:45 [auto1.de] INFO: Scrape type for YG99324: 0
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: PE61804
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: WF25219
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: KF54525
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF54525%27 HTTP/1.1" 200 None
2026-03-27 10:58:45 [auto1.de] INFO: Scrape type for KF54525: 0
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: FV69098
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: GG42474
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG42474%27 HTTP/1.1" 200 None
2026-03-27 10:58:45 [auto1.de] INFO: Scrape type for GG42474: 0
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: UA36128
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: WZ39505
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: UD40582
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD40582%27 HTTP/1.1" 200 None
2026-03-27 10:58:45 [auto1.de] INFO: Scrape type for UD40582: 0
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: FH55013
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: DC87160
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC87160%27 HTTP/1.1" 200 None
2026-03-27 10:58:45 [auto1.de] INFO: Scrape type for DC87160: 0
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: TJ48727
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: XM69109
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: RV46978
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV46978%27 HTTP/1.1" 200 None
2026-03-27 10:58:45 [auto1.de] INFO: Scrape type for RV46978: 0
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: DG26223
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG26223%27 HTTP/1.1" 200 None
2026-03-27 10:58:45 [auto1.de] INFO: Scrape type for DG26223: 0
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: RT58544
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT58544%27 HTTP/1.1" 200 None
2026-03-27 10:58:45 [auto1.de] INFO: Scrape type for RT58544: 0
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: PL59793
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: FG90508
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG90508%27 HTTP/1.1" 200 None
2026-03-27 10:58:45 [auto1.de] INFO: Scrape type for FG90508: 0
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: SK92475
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: AN09987
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: FM58881
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM58881%27 HTTP/1.1" 200 None
2026-03-27 10:58:45 [auto1.de] INFO: Scrape type for FM58881: 0
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: VV42849
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: VL78199
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: JC12904
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: GL59238
2026-03-27 10:58:45 [auto1.de] INFO: Found listing with ID: UL88623
2026-03-27 10:58:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:58:46 [auto1.de] INFO: Channel: 24h | Page: 162 | totalHits: 10625 | hits on page: 40
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: PB59593
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB59593%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for PB59593: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: TJ40374
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ40374%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for TJ40374: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: GK14765
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: TP17331
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP17331%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for TP17331: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: VL41959
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL41959%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for VL41959: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: UE99004
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE99004%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for UE99004: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: MH07331
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH07331%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for MH07331: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: GS26791
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS26791%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for GS26791: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: JJ31380
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ31380%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for JJ31380: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: YY53618
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: BU78099
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU78099%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for BU78099: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: ZC69186
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: ZE45011
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE45011%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for ZE45011: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: JN87452
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN87452%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for JN87452: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: WK90166
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK90166%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for WK90166: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: FK34265
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK34265%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for FK34265: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: YR12754
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: BB16654
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB16654%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for BB16654: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: VC02899
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: SN07258
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN07258%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for SN07258: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: VC74515
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC74515%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for VC74515: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: AV68122
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: AU29574
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU29574%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for AU29574: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: LR83692
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: EW93148
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW93148%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for EW93148: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: KV09171
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: WS72402
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS72402%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for WS72402: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: UM56474
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM56474%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for UM56474: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: XC14713
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: TL89629
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: RJ65858
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: UX23501
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: LH77373
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH77373%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for LH77373: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: SF02157
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF02157%27 HTTP/1.1" 200 None
2026-03-27 10:58:46 [auto1.de] INFO: Scrape type for SF02157: 0
2026-03-27 10:58:46 [auto1.de] INFO: Found listing with ID: EW23969
2026-03-27 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW23969%27 HTTP/1.1" 200 None
2026-03-27 10:58:47 [auto1.de] INFO: Scrape type for EW23969: 0
2026-03-27 10:58:47 [auto1.de] INFO: Found listing with ID: EW45766
2026-03-27 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW45766%27 HTTP/1.1" 200 None
2026-03-27 10:58:47 [auto1.de] INFO: Scrape type for EW45766: 2
2026-03-27 10:58:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36c91051-4c07-5d17-8731-14f7c73a76a0 with identifier: EW45766
2026-03-27 10:58:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c91051-4c07-5d17-8731-14f7c73a76a0 with scrape type 2
2026-03-27 10:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36c91051-4c07-5d17-8731-14f7c73a76a0 with scrape type 2
2026-03-27 10:58:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36c91051-4c07-5d17-8731-14f7c73a76a0, identifier: EW45766
2026-03-27 10:58:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36c91051-4c07-5d17-8731-14f7c73a76a0 with identifier: EW45766
2026-03-27 10:58:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36c91051-4c07-5d17-8731-14f7c73a76a0 with identifier: EW45766
2026-03-27 10:58:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36c91051-4c07-5d17-8731-14f7c73a76a0 with identifier: EW45766 to the API
2026-03-27 10:58:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:58:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:58:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:40:53Z',
 'fuel_type': 'petrol',
 'id': '36c91051-4c07-5d17-8731-14f7c73a76a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW45766',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 162885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-27 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW45766%27 HTTP/1.1" 200 None
2026-03-27 10:58:47 [auto1.de] INFO: Saving data for EW45766: {'auction_closing_time': 1774629653.0, 'created_time': 1774424131.696567, 'last_price_update_time': 1774609127.714306}
2026-03-27 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW45766') HTTP/1.1" 204 0
2026-03-27 10:58:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:58:47 [auto1.de] INFO: Found listing with ID: VL98056
2026-03-27 10:58:47 [auto1.de] INFO: Found listing with ID: XM88485
2026-03-27 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM88485%27 HTTP/1.1" 200 None
2026-03-27 10:58:47 [auto1.de] INFO: Scrape type for XM88485: 0
2026-03-27 10:58:47 [auto1.de] INFO: Found listing with ID: SB61673
2026-03-27 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB61673%27 HTTP/1.1" 200 None
2026-03-27 10:58:47 [auto1.de] INFO: Scrape type for SB61673: 0
2026-03-27 10:58:47 [auto1.de] INFO: Found listing with ID: CZ50772
2026-03-27 10:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:58:48 [auto1.de] INFO: Channel: 24h | Page: 163 | totalHits: 10626 | hits on page: 40
2026-03-27 10:58:48 [auto1.de] INFO: Found listing with ID: CZ50772
2026-03-27 10:58:48 [auto1.de] INFO: Found listing with ID: BU66338
2026-03-27 10:58:48 [auto1.de] INFO: Found listing with ID: DS41181
2026-03-27 10:58:48 [auto1.de] INFO: Found listing with ID: RR66654
2026-03-27 10:58:48 [auto1.de] INFO: Found listing with ID: ZW65017
2026-03-27 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW65017%27 HTTP/1.1" 200 None
2026-03-27 10:58:48 [auto1.de] INFO: Scrape type for ZW65017: 0
2026-03-27 10:58:48 [auto1.de] INFO: Found listing with ID: PG39438
2026-03-27 10:58:48 [auto1.de] INFO: Found listing with ID: DB39205
2026-03-27 10:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB39205%27 HTTP/1.1" 200 None
2026-03-27 10:58:49 [auto1.de] INFO: Scrape type for DB39205: 0
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: KK09666
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: ZL92656
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL92656%27 HTTP/1.1" 200 None
2026-03-27 10:58:49 [auto1.de] INFO: Scrape type for ZL92656: 0
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: RD74576
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: GA84874
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA84874%27 HTTP/1.1" 200 None
2026-03-27 10:58:49 [auto1.de] INFO: Scrape type for GA84874: 0
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: AA62808
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA62808%27 HTTP/1.1" 200 None
2026-03-27 10:58:49 [auto1.de] INFO: Scrape type for AA62808: 0
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: HS47507
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: NK09595
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK09595%27 HTTP/1.1" 200 None
2026-03-27 10:58:49 [auto1.de] INFO: Scrape type for NK09595: 0
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: SS07432
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: LB13606
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB13606%27 HTTP/1.1" 200 None
2026-03-27 10:58:49 [auto1.de] INFO: Scrape type for LB13606: 0
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: UV49850
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: TP76478
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP76478%27 HTTP/1.1" 200 None
2026-03-27 10:58:49 [auto1.de] INFO: Scrape type for TP76478: 0
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: ZM68903
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM68903%27 HTTP/1.1" 200 None
2026-03-27 10:58:49 [auto1.de] INFO: Scrape type for ZM68903: 0
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: PP58013
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP58013%27 HTTP/1.1" 200 None
2026-03-27 10:58:49 [auto1.de] INFO: Scrape type for PP58013: 0
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: ZG32705
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: LB34489
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB34489%27 HTTP/1.1" 200 None
2026-03-27 10:58:49 [auto1.de] INFO: Scrape type for LB34489: 0
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: ZV46118
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: ES72865
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES72865%27 HTTP/1.1" 200 None
2026-03-27 10:58:49 [auto1.de] INFO: Scrape type for ES72865: 0
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: FE99413
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE99413%27 HTTP/1.1" 200 None
2026-03-27 10:58:49 [auto1.de] INFO: Scrape type for FE99413: 0
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: LG72403
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG72403%27 HTTP/1.1" 200 None
2026-03-27 10:58:49 [auto1.de] INFO: Scrape type for LG72403: 0
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: FN07032
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN07032%27 HTTP/1.1" 200 None
2026-03-27 10:58:49 [auto1.de] INFO: Scrape type for FN07032: 0
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: MP23640
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP23640%27 HTTP/1.1" 200 None
2026-03-27 10:58:49 [auto1.de] INFO: Scrape type for MP23640: 0
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: YG03414
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG03414%27 HTTP/1.1" 200 None
2026-03-27 10:58:49 [auto1.de] INFO: Scrape type for YG03414: 0
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: DA12198
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA12198%27 HTTP/1.1" 200 None
2026-03-27 10:58:49 [auto1.de] INFO: Scrape type for DA12198: 0
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: SE45637
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE45637%27 HTTP/1.1" 200 None
2026-03-27 10:58:49 [auto1.de] INFO: Scrape type for SE45637: 0
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: HU48157
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: ZS38379
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: EJ51089
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ51089%27 HTTP/1.1" 200 None
2026-03-27 10:58:49 [auto1.de] INFO: Scrape type for EJ51089: 0
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: ZL42149
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: ZW81877
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: TW96205
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW96205%27 HTTP/1.1" 200 None
2026-03-27 10:58:49 [auto1.de] INFO: Scrape type for TW96205: 0
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: LF18625
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: BL32113
2026-03-27 10:58:49 [auto1.de] INFO: Found listing with ID: JN43536
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN43536%27 HTTP/1.1" 200 None
2026-03-27 10:58:49 [auto1.de] INFO: Scrape type for JN43536: 0
2026-03-27 10:58:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:58:50 [auto1.de] INFO: Channel: 24h | Page: 164 | totalHits: 10626 | hits on page: 40
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: MP90599
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: LU14578
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: EY37211
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: YH42279
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH42279%27 HTTP/1.1" 200 None
2026-03-27 10:58:50 [auto1.de] INFO: Scrape type for YH42279: 0
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: UR96794
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR96794%27 HTTP/1.1" 200 None
2026-03-27 10:58:50 [auto1.de] INFO: Scrape type for UR96794: 0
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: PE33021
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: FE93114
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE93114%27 HTTP/1.1" 200 None
2026-03-27 10:58:50 [auto1.de] INFO: Scrape type for FE93114: 0
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: SM60062
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: HY62017
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: JJ95155
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: BZ21369
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: UH11751
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: WV63025
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: ME80175
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME80175%27 HTTP/1.1" 200 None
2026-03-27 10:58:50 [auto1.de] INFO: Scrape type for ME80175: 0
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: VZ82726
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: FU90686
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU90686%27 HTTP/1.1" 200 None
2026-03-27 10:58:50 [auto1.de] INFO: Scrape type for FU90686: 0
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: XA84499
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA84499%27 HTTP/1.1" 200 None
2026-03-27 10:58:50 [auto1.de] INFO: Scrape type for XA84499: 0
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: YT23335
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: AF65109
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: BT69542
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT69542%27 HTTP/1.1" 200 None
2026-03-27 10:58:50 [auto1.de] INFO: Scrape type for BT69542: 0
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: LC24669
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: YP20903
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: PG08771
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: FK56908
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK56908%27 HTTP/1.1" 200 None
2026-03-27 10:58:50 [auto1.de] INFO: Scrape type for FK56908: 0
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: XE29778
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: UC83831
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC83831%27 HTTP/1.1" 200 None
2026-03-27 10:58:50 [auto1.de] INFO: Scrape type for UC83831: 0
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: TP41556
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: PV97314
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: BM91170
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM91170%27 HTTP/1.1" 200 None
2026-03-27 10:58:50 [auto1.de] INFO: Scrape type for BM91170: 0
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: HS73222
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS73222%27 HTTP/1.1" 200 None
2026-03-27 10:58:50 [auto1.de] INFO: Scrape type for HS73222: 0
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: SM82808
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM82808%27 HTTP/1.1" 200 None
2026-03-27 10:58:50 [auto1.de] INFO: Scrape type for SM82808: 0
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: CD93996
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD93996%27 HTTP/1.1" 200 None
2026-03-27 10:58:50 [auto1.de] INFO: Scrape type for CD93996: 0
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: TB77095
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: PP27281
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP27281%27 HTTP/1.1" 200 None
2026-03-27 10:58:50 [auto1.de] INFO: Scrape type for PP27281: 0
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: YR03483
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: SY52709
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: GC12583
2026-03-27 10:58:50 [auto1.de] INFO: Found listing with ID: DH78360
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH78360%27 HTTP/1.1" 200 None
2026-03-27 10:58:50 [auto1.de] INFO: Scrape type for DH78360: 2
2026-03-27 10:58:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3de395e-748b-5ef3-857f-1520a50a5731 with identifier: DH78360
2026-03-27 10:58:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3de395e-748b-5ef3-857f-1520a50a5731 with scrape type 2
2026-03-27 10:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3de395e-748b-5ef3-857f-1520a50a5731 with scrape type 2
2026-03-27 10:58:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3de395e-748b-5ef3-857f-1520a50a5731, identifier: DH78360
2026-03-27 10:58:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3de395e-748b-5ef3-857f-1520a50a5731 with identifier: DH78360
2026-03-27 10:58:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3de395e-748b-5ef3-857f-1520a50a5731 with identifier: DH78360
2026-03-27 10:58:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3de395e-748b-5ef3-857f-1520a50a5731 with identifier: DH78360 to the API
2026-03-27 10:58:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:58:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:58:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:13:18Z',
 'fuel_type': 'petrol',
 'id': 'b3de395e-748b-5ef3-857f-1520a50a5731',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH78360',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 113352,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-26',
 'seller_name': None,
 'title': 'Suzuki SX4 1.4 BoosterJet Comfort+ 4x4',
 'transmission': 'automatic',
 'trim': 'Comfort+ 4x4',
 'year': 2018}
2026-03-27 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH78360%27 HTTP/1.1" 200 None
2026-03-27 10:58:51 [auto1.de] INFO: Saving data for DH78360: {'auction_closing_time': 1774627998.0, 'created_time': 1773776024.307045, 'last_price_update_time': 1774609131.460037}
2026-03-27 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DH78360') HTTP/1.1" 204 0
2026-03-27 10:58:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:58:51 [auto1.de] INFO: Found listing with ID: VX88052
2026-03-27 10:58:51 [auto1.de] INFO: Found listing with ID: KZ70438
2026-03-27 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ70438%27 HTTP/1.1" 200 None
2026-03-27 10:58:51 [auto1.de] INFO: Scrape type for KZ70438: 0
2026-03-27 10:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:58:53 [auto1.de] INFO: Channel: 24h | Page: 165 | totalHits: 10626 | hits on page: 40
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: EL83640
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: PG06608
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: PF56750
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: GH40750
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH40750%27 HTTP/1.1" 200 None
2026-03-27 10:58:53 [auto1.de] INFO: Scrape type for GH40750: 0
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: YF10797
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: VR15853
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR15853%27 HTTP/1.1" 200 None
2026-03-27 10:58:53 [auto1.de] INFO: Scrape type for VR15853: 0
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: AR44427
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: WP40343
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP40343%27 HTTP/1.1" 200 None
2026-03-27 10:58:53 [auto1.de] INFO: Scrape type for WP40343: 0
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: RJ04958
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: UL26956
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: ZB54650
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: KJ26847
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: CS72322
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: SL60140
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: MG35847
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: UY83334
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: GF37615
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF37615%27 HTTP/1.1" 200 None
2026-03-27 10:58:53 [auto1.de] INFO: Scrape type for GF37615: 0
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: EE27076
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE27076%27 HTTP/1.1" 200 None
2026-03-27 10:58:53 [auto1.de] INFO: Scrape type for EE27076: 0
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: EJ62801
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ62801%27 HTTP/1.1" 200 None
2026-03-27 10:58:53 [auto1.de] INFO: Scrape type for EJ62801: 0
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: RU02977
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU02977%27 HTTP/1.1" 200 None
2026-03-27 10:58:53 [auto1.de] INFO: Scrape type for RU02977: 0
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: EE36911
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE36911%27 HTTP/1.1" 200 None
2026-03-27 10:58:53 [auto1.de] INFO: Scrape type for EE36911: 0
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: YB09580
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: FT17472
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: JH99279
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH99279%27 HTTP/1.1" 200 None
2026-03-27 10:58:53 [auto1.de] INFO: Scrape type for JH99279: 0
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: EH94118
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH94118%27 HTTP/1.1" 200 None
2026-03-27 10:58:53 [auto1.de] INFO: Scrape type for EH94118: 0
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: RM06492
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM06492%27 HTTP/1.1" 200 None
2026-03-27 10:58:53 [auto1.de] INFO: Scrape type for RM06492: 0
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: MM30364
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: AE40482
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: ZF90785
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: UM15854
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM15854%27 HTTP/1.1" 200 None
2026-03-27 10:58:53 [auto1.de] INFO: Scrape type for UM15854: 0
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: XA03133
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: ZR67310
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: UB71619
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: RC86966
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC86966%27 HTTP/1.1" 200 None
2026-03-27 10:58:53 [auto1.de] INFO: Scrape type for RC86966: 0
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: ZM02354
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: MR13527
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: TF75057
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF75057%27 HTTP/1.1" 200 None
2026-03-27 10:58:53 [auto1.de] INFO: Scrape type for TF75057: 0
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: RW92714
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: KX74208
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX74208%27 HTTP/1.1" 200 None
2026-03-27 10:58:53 [auto1.de] INFO: Scrape type for KX74208: 0
2026-03-27 10:58:53 [auto1.de] INFO: Found listing with ID: CY39218
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY39218%27 HTTP/1.1" 200 None
2026-03-27 10:58:53 [auto1.de] INFO: Scrape type for CY39218: 0
2026-03-27 10:58:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:58:57 [auto1.de] INFO: Channel: 24h | Page: 166 | totalHits: 10626 | hits on page: 40
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: RK08384
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: HD36742
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: NZ80756
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ80756%27 HTTP/1.1" 200 None
2026-03-27 10:58:57 [auto1.de] INFO: Scrape type for NZ80756: 0
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: EN35005
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN35005%27 HTTP/1.1" 200 None
2026-03-27 10:58:57 [auto1.de] INFO: Scrape type for EN35005: 0
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: BU56411
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: HW40381
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: VB96858
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB96858%27 HTTP/1.1" 200 None
2026-03-27 10:58:57 [auto1.de] INFO: Scrape type for VB96858: 0
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: MY03728
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: DV08078
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV08078%27 HTTP/1.1" 200 None
2026-03-27 10:58:57 [auto1.de] INFO: Scrape type for DV08078: 0
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: GP81999
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP81999%27 HTTP/1.1" 200 None
2026-03-27 10:58:57 [auto1.de] INFO: Scrape type for GP81999: 0
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: GT73384
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT73384%27 HTTP/1.1" 200 None
2026-03-27 10:58:57 [auto1.de] INFO: Scrape type for GT73384: 0
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: UL30930
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: BU83638
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU83638%27 HTTP/1.1" 200 None
2026-03-27 10:58:57 [auto1.de] INFO: Scrape type for BU83638: 0
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: DW74206
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW74206%27 HTTP/1.1" 200 None
2026-03-27 10:58:57 [auto1.de] INFO: Scrape type for DW74206: 0
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: FF42934
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: NC32070
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: MX91312
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: EG75143
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: CW67580
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW67580%27 HTTP/1.1" 200 None
2026-03-27 10:58:57 [auto1.de] INFO: Scrape type for CW67580: 0
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: LX06150
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX06150%27 HTTP/1.1" 200 None
2026-03-27 10:58:57 [auto1.de] INFO: Scrape type for LX06150: 0
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: NJ40937
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: AG29353
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: DG59888
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: MW36187
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW36187%27 HTTP/1.1" 200 None
2026-03-27 10:58:57 [auto1.de] INFO: Scrape type for MW36187: 0
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: TF74280
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: UT06922
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: YE25997
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE25997%27 HTTP/1.1" 200 None
2026-03-27 10:58:57 [auto1.de] INFO: Scrape type for YE25997: 0
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: XV23695
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV23695%27 HTTP/1.1" 200 None
2026-03-27 10:58:57 [auto1.de] INFO: Scrape type for XV23695: 0
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: SS72230
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS72230%27 HTTP/1.1" 200 None
2026-03-27 10:58:57 [auto1.de] INFO: Scrape type for SS72230: 0
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: JW10834
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW10834%27 HTTP/1.1" 200 None
2026-03-27 10:58:57 [auto1.de] INFO: Scrape type for JW10834: 0
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: XE42566
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: XL55918
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: YF55244
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF55244%27 HTTP/1.1" 200 None
2026-03-27 10:58:57 [auto1.de] INFO: Scrape type for YF55244: 0
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: JH65872
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: NH36418
2026-03-27 10:58:57 [auto1.de] INFO: Found listing with ID: SA32858
2026-03-27 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA32858%27 HTTP/1.1" 200 None
2026-03-27 10:58:58 [auto1.de] INFO: Scrape type for SA32858: 0
2026-03-27 10:58:58 [auto1.de] INFO: Found listing with ID: YM31567
2026-03-27 10:58:58 [auto1.de] INFO: Found listing with ID: ES65821
2026-03-27 10:58:58 [auto1.de] INFO: Found listing with ID: XL38763
2026-03-27 10:58:58 [auto1.de] INFO: Found listing with ID: NC34503
2026-03-27 10:58:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:59:01 [auto1.de] INFO: Channel: 24h | Page: 167 | totalHits: 10626 | hits on page: 40
2026-03-27 10:59:01 [auto1.de] INFO: Found listing with ID: LV97746
2026-03-27 10:59:01 [auto1.de] INFO: Found listing with ID: RW19724
2026-03-27 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW19724%27 HTTP/1.1" 200 None
2026-03-27 10:59:01 [auto1.de] INFO: Scrape type for RW19724: 0
2026-03-27 10:59:01 [auto1.de] INFO: Found listing with ID: JZ56575
2026-03-27 10:59:01 [auto1.de] INFO: Found listing with ID: DM21844
2026-03-27 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM21844%27 HTTP/1.1" 200 None
2026-03-27 10:59:01 [auto1.de] INFO: Scrape type for DM21844: 0
2026-03-27 10:59:01 [auto1.de] INFO: Found listing with ID: MS56284
2026-03-27 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS56284%27 HTTP/1.1" 200 None
2026-03-27 10:59:01 [auto1.de] INFO: Scrape type for MS56284: 0
2026-03-27 10:59:01 [auto1.de] INFO: Found listing with ID: JW22409
2026-03-27 10:59:01 [auto1.de] INFO: Found listing with ID: ND31519
2026-03-27 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND31519%27 HTTP/1.1" 200 None
2026-03-27 10:59:01 [auto1.de] INFO: Scrape type for ND31519: 0
2026-03-27 10:59:01 [auto1.de] INFO: Found listing with ID: YP00940
2026-03-27 10:59:01 [auto1.de] INFO: Found listing with ID: CH35600
2026-03-27 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH35600%27 HTTP/1.1" 200 None
2026-03-27 10:59:01 [auto1.de] INFO: Scrape type for CH35600: 0
2026-03-27 10:59:01 [auto1.de] INFO: Found listing with ID: VH39568
2026-03-27 10:59:01 [auto1.de] INFO: Found listing with ID: RD09031
2026-03-27 10:59:01 [auto1.de] INFO: Found listing with ID: MP16607
2026-03-27 10:59:01 [auto1.de] INFO: Found listing with ID: AT70928
2026-03-27 10:59:01 [auto1.de] INFO: Found listing with ID: WX56329
2026-03-27 10:59:01 [auto1.de] INFO: Found listing with ID: JW37685
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW37685%27 HTTP/1.1" 200 None
2026-03-27 10:59:02 [auto1.de] INFO: Scrape type for JW37685: 0
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: SC00063
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: WC75235
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: MG33592
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG33592%27 HTTP/1.1" 200 None
2026-03-27 10:59:02 [auto1.de] INFO: Scrape type for MG33592: 0
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: DP39358
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP39358%27 HTTP/1.1" 200 None
2026-03-27 10:59:02 [auto1.de] INFO: Scrape type for DP39358: 0
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: HP46959
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: SZ66894
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: VU46856
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: CR08738
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR08738%27 HTTP/1.1" 200 None
2026-03-27 10:59:02 [auto1.de] INFO: Scrape type for CR08738: 0
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: KN60852
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN60852%27 HTTP/1.1" 200 None
2026-03-27 10:59:02 [auto1.de] INFO: Scrape type for KN60852: 0
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: MJ79028
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ79028%27 HTTP/1.1" 200 None
2026-03-27 10:59:02 [auto1.de] INFO: Scrape type for MJ79028: 0
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: CA38332
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA38332%27 HTTP/1.1" 200 None
2026-03-27 10:59:02 [auto1.de] INFO: Scrape type for CA38332: 0
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: ZY15054
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY15054%27 HTTP/1.1" 200 None
2026-03-27 10:59:02 [auto1.de] INFO: Scrape type for ZY15054: 0
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: KB01548
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: WZ31189
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: JE58161
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE58161%27 HTTP/1.1" 200 None
2026-03-27 10:59:02 [auto1.de] INFO: Scrape type for JE58161: 0
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: XN43654
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN43654%27 HTTP/1.1" 200 None
2026-03-27 10:59:02 [auto1.de] INFO: Scrape type for XN43654: 0
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: AF02191
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF02191%27 HTTP/1.1" 200 None
2026-03-27 10:59:02 [auto1.de] INFO: Scrape type for AF02191: 0
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: XE71423
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: VV80160
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: UP05296
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP05296%27 HTTP/1.1" 200 None
2026-03-27 10:59:02 [auto1.de] INFO: Scrape type for UP05296: 0
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: DS39411
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: SC98089
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: SG57857
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG57857%27 HTTP/1.1" 200 None
2026-03-27 10:59:02 [auto1.de] INFO: Scrape type for SG57857: 0
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: NN09397
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN09397%27 HTTP/1.1" 200 None
2026-03-27 10:59:02 [auto1.de] INFO: Scrape type for NN09397: 0
2026-03-27 10:59:02 [auto1.de] INFO: Found listing with ID: FV68576
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV68576%27 HTTP/1.1" 200 None
2026-03-27 10:59:02 [auto1.de] INFO: Scrape type for FV68576: 0
2026-03-27 10:59:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:59:06 [scrapy.extensions.logstats] INFO: Crawled 635 pages (at 14 pages/min), scraped 918 items (at 6 items/min)
2026-03-27 10:59:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 10:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:59:07 [auto1.de] INFO: Channel: 24h | Page: 168 | totalHits: 10626 | hits on page: 40
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: GG51992
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: SU19428
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: UA38092
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: PF34298
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF34298%27 HTTP/1.1" 200 None
2026-03-27 10:59:07 [auto1.de] INFO: Scrape type for PF34298: 0
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: BK55447
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: TS09067
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: XT03032
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT03032%27 HTTP/1.1" 200 None
2026-03-27 10:59:07 [auto1.de] INFO: Scrape type for XT03032: 0
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: MV36698
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV36698%27 HTTP/1.1" 200 None
2026-03-27 10:59:07 [auto1.de] INFO: Scrape type for MV36698: 0
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: BU22697
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU22697%27 HTTP/1.1" 200 None
2026-03-27 10:59:07 [auto1.de] INFO: Scrape type for BU22697: 0
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: XV41644
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV41644%27 HTTP/1.1" 200 None
2026-03-27 10:59:07 [auto1.de] INFO: Scrape type for XV41644: 0
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: KA97877
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: EN28184
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN28184%27 HTTP/1.1" 200 None
2026-03-27 10:59:07 [auto1.de] INFO: Scrape type for EN28184: 0
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: TM28399
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM28399%27 HTTP/1.1" 200 None
2026-03-27 10:59:07 [auto1.de] INFO: Scrape type for TM28399: 0
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: CM83282
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: FJ00184
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: AU11749
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: DM91304
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM91304%27 HTTP/1.1" 200 None
2026-03-27 10:59:07 [auto1.de] INFO: Scrape type for DM91304: 0
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: UT18742
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT18742%27 HTTP/1.1" 200 None
2026-03-27 10:59:07 [auto1.de] INFO: Scrape type for UT18742: 0
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: CR45674
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: SM33942
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM33942%27 HTTP/1.1" 200 None
2026-03-27 10:59:07 [auto1.de] INFO: Scrape type for SM33942: 0
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: UH63910
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH63910%27 HTTP/1.1" 200 None
2026-03-27 10:59:07 [auto1.de] INFO: Scrape type for UH63910: 0
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: JF53186
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF53186%27 HTTP/1.1" 200 None
2026-03-27 10:59:07 [auto1.de] INFO: Scrape type for JF53186: 0
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: ZN09383
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN09383%27 HTTP/1.1" 200 None
2026-03-27 10:59:07 [auto1.de] INFO: Scrape type for ZN09383: 0
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: MS55165
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS55165%27 HTTP/1.1" 200 None
2026-03-27 10:59:07 [auto1.de] INFO: Scrape type for MS55165: 0
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: ZN04529
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: VU91072
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: GE71174
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE71174%27 HTTP/1.1" 200 None
2026-03-27 10:59:07 [auto1.de] INFO: Scrape type for GE71174: 0
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: WK54006
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: ZB97634
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: ZD11825
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: LE94201
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE94201%27 HTTP/1.1" 200 None
2026-03-27 10:59:07 [auto1.de] INFO: Scrape type for LE94201: 0
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: XJ00342
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ00342%27 HTTP/1.1" 200 None
2026-03-27 10:59:07 [auto1.de] INFO: Scrape type for XJ00342: 0
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: KY30892
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: VA98415
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: DZ63993
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: XA87570
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA87570%27 HTTP/1.1" 200 None
2026-03-27 10:59:07 [auto1.de] INFO: Scrape type for XA87570: 0
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: YV88568
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV88568%27 HTTP/1.1" 200 None
2026-03-27 10:59:07 [auto1.de] INFO: Scrape type for YV88568: 0
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: VN69903
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN69903%27 HTTP/1.1" 200 None
2026-03-27 10:59:07 [auto1.de] INFO: Scrape type for VN69903: 0
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: YZ13111
2026-03-27 10:59:07 [auto1.de] INFO: Found listing with ID: BR47892
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR47892%27 HTTP/1.1" 200 None
2026-03-27 10:59:07 [auto1.de] INFO: Scrape type for BR47892: 0
2026-03-27 10:59:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:59:08 [auto1.de] INFO: Channel: 24h | Page: 169 | totalHits: 10626 | hits on page: 40
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: VJ37696
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ37696%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for VJ37696: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: VS28124
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS28124%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for VS28124: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: DY94514
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY94514%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for DY94514: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: KC71361
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC71361%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for KC71361: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: HA92471
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA92471%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for HA92471: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: HN26382
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: AD42447
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: TW42181
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: WC60331
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC60331%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for WC60331: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: VN94649
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN94649%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for VN94649: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: RL49502
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: LN31726
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: SC26693
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: ZJ19355
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: CZ95294
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: NZ83271
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: MG97845
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG97845%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for MG97845: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: NC54536
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: RY11817
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: UZ21895
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ21895%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for UZ21895: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: HU45030
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU45030%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for HU45030: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: KU59477
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU59477%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for KU59477: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: HY62611
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY62611%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for HY62611: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: GG43285
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG43285%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for GG43285: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: RN71628
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN71628%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for RN71628: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: AM47458
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM47458%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for AM47458: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: UC67043
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: NR78378
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: AN54197
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: CM07244
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM07244%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for CM07244: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: TJ05764
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ05764%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for TJ05764: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: HW32763
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW32763%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for HW32763: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: ZP00129
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: RD20860
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: WS06283
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: VH48705
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH48705%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for VH48705: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: VV35876
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV35876%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for VV35876: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: EE18812
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE18812%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for EE18812: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: KW33977
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW33977%27 HTTP/1.1" 200 None
2026-03-27 10:59:08 [auto1.de] INFO: Scrape type for KW33977: 0
2026-03-27 10:59:08 [auto1.de] INFO: Found listing with ID: VK29139
2026-03-27 10:59:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:59:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:59:09 [auto1.de] INFO: Channel: 24h | Page: 170 | totalHits: 10626 | hits on page: 40
2026-03-27 10:59:09 [auto1.de] INFO: Found listing with ID: ZE35145
2026-03-27 10:59:09 [auto1.de] INFO: Found listing with ID: ZZ69098
2026-03-27 10:59:09 [auto1.de] INFO: Found listing with ID: ME12043
2026-03-27 10:59:09 [auto1.de] INFO: Found listing with ID: TL04129
2026-03-27 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL04129%27 HTTP/1.1" 200 None
2026-03-27 10:59:09 [auto1.de] INFO: Scrape type for TL04129: 0
2026-03-27 10:59:09 [auto1.de] INFO: Found listing with ID: FH56090
2026-03-27 10:59:09 [auto1.de] INFO: Found listing with ID: PJ19117
2026-03-27 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ19117%27 HTTP/1.1" 200 None
2026-03-27 10:59:09 [auto1.de] INFO: Scrape type for PJ19117: 0
2026-03-27 10:59:09 [auto1.de] INFO: Found listing with ID: WW53505
2026-03-27 10:59:09 [auto1.de] INFO: Found listing with ID: LG37465
2026-03-27 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG37465%27 HTTP/1.1" 200 None
2026-03-27 10:59:09 [auto1.de] INFO: Scrape type for LG37465: 0
2026-03-27 10:59:09 [auto1.de] INFO: Found listing with ID: CS08298
2026-03-27 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS08298%27 HTTP/1.1" 200 None
2026-03-27 10:59:09 [auto1.de] INFO: Scrape type for CS08298: 0
2026-03-27 10:59:09 [auto1.de] INFO: Found listing with ID: MD90588
2026-03-27 10:59:09 [auto1.de] INFO: Found listing with ID: KD70063
2026-03-27 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD70063%27 HTTP/1.1" 200 None
2026-03-27 10:59:09 [auto1.de] INFO: Scrape type for KD70063: 0
2026-03-27 10:59:09 [auto1.de] INFO: Found listing with ID: UA29209
2026-03-27 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA29209%27 HTTP/1.1" 200 None
2026-03-27 10:59:09 [auto1.de] INFO: Scrape type for UA29209: 0
2026-03-27 10:59:09 [auto1.de] INFO: Found listing with ID: ZL98150
2026-03-27 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL98150%27 HTTP/1.1" 200 None
2026-03-27 10:59:09 [auto1.de] INFO: Scrape type for ZL98150: 0
2026-03-27 10:59:09 [auto1.de] INFO: Found listing with ID: DE92254
2026-03-27 10:59:09 [auto1.de] INFO: Found listing with ID: PN86666
2026-03-27 10:59:09 [auto1.de] INFO: Found listing with ID: SF33513
2026-03-27 10:59:09 [auto1.de] INFO: Found listing with ID: LG26005
2026-03-27 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG26005%27 HTTP/1.1" 200 None
2026-03-27 10:59:09 [auto1.de] INFO: Scrape type for LG26005: 0
2026-03-27 10:59:09 [auto1.de] INFO: Found listing with ID: FU46952
2026-03-27 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU46952%27 HTTP/1.1" 200 None
2026-03-27 10:59:09 [auto1.de] INFO: Scrape type for FU46952: 0
2026-03-27 10:59:09 [auto1.de] INFO: Found listing with ID: YA21535
2026-03-27 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA21535%27 HTTP/1.1" 200 None
2026-03-27 10:59:09 [auto1.de] INFO: Scrape type for YA21535: 0
2026-03-27 10:59:09 [auto1.de] INFO: Found listing with ID: RY31497
2026-03-27 10:59:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY31497%27 HTTP/1.1" 200 None
2026-03-27 10:59:10 [auto1.de] INFO: Scrape type for RY31497: 0
2026-03-27 10:59:10 [auto1.de] INFO: Found listing with ID: FB69161
2026-03-27 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB69161%27 HTTP/1.1" 200 None
2026-03-27 10:59:10 [auto1.de] INFO: Scrape type for FB69161: 0
2026-03-27 10:59:10 [auto1.de] INFO: Found listing with ID: ND41765
2026-03-27 10:59:10 [auto1.de] INFO: Found listing with ID: DE97344
2026-03-27 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE97344%27 HTTP/1.1" 200 None
2026-03-27 10:59:10 [auto1.de] INFO: Scrape type for DE97344: 0
2026-03-27 10:59:10 [auto1.de] INFO: Found listing with ID: ZE72511
2026-03-27 10:59:10 [auto1.de] INFO: Found listing with ID: RG32766
2026-03-27 10:59:10 [auto1.de] INFO: Found listing with ID: FY97594
2026-03-27 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY97594%27 HTTP/1.1" 200 None
2026-03-27 10:59:10 [auto1.de] INFO: Scrape type for FY97594: 0
2026-03-27 10:59:10 [auto1.de] INFO: Found listing with ID: JR64740
2026-03-27 10:59:10 [auto1.de] INFO: Found listing with ID: LG31381
2026-03-27 10:59:10 [auto1.de] INFO: Found listing with ID: RD14562
2026-03-27 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD14562%27 HTTP/1.1" 200 None
2026-03-27 10:59:10 [auto1.de] INFO: Scrape type for RD14562: 0
2026-03-27 10:59:10 [auto1.de] INFO: Found listing with ID: JD86845
2026-03-27 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD86845%27 HTTP/1.1" 200 None
2026-03-27 10:59:10 [auto1.de] INFO: Scrape type for JD86845: 0
2026-03-27 10:59:10 [auto1.de] INFO: Found listing with ID: LS75828
2026-03-27 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS75828%27 HTTP/1.1" 200 None
2026-03-27 10:59:10 [auto1.de] INFO: Scrape type for LS75828: 0
2026-03-27 10:59:10 [auto1.de] INFO: Found listing with ID: XA54005
2026-03-27 10:59:10 [auto1.de] INFO: Found listing with ID: LR13115
2026-03-27 10:59:10 [auto1.de] INFO: Found listing with ID: UY98455
2026-03-27 10:59:10 [auto1.de] INFO: Found listing with ID: ST40986
2026-03-27 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST40986%27 HTTP/1.1" 200 None
2026-03-27 10:59:10 [auto1.de] INFO: Scrape type for ST40986: 0
2026-03-27 10:59:10 [auto1.de] INFO: Found listing with ID: WT90781
2026-03-27 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT90781%27 HTTP/1.1" 200 None
2026-03-27 10:59:10 [auto1.de] INFO: Scrape type for WT90781: 0
2026-03-27 10:59:10 [auto1.de] INFO: Found listing with ID: VC64566
2026-03-27 10:59:10 [auto1.de] INFO: Found listing with ID: HG59536
2026-03-27 10:59:10 [auto1.de] INFO: Found listing with ID: BS27408
2026-03-27 10:59:10 [auto1.de] INFO: Found listing with ID: BH38420
2026-03-27 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH38420%27 HTTP/1.1" 200 None
2026-03-27 10:59:10 [auto1.de] INFO: Scrape type for BH38420: 0
2026-03-27 10:59:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:59:11 [auto1.de] INFO: Channel: 24h | Page: 171 | totalHits: 10626 | hits on page: 40
2026-03-27 10:59:11 [auto1.de] INFO: Found listing with ID: WH39660
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH39660%27 HTTP/1.1" 200 None
2026-03-27 10:59:11 [auto1.de] INFO: Scrape type for WH39660: 0
2026-03-27 10:59:11 [auto1.de] INFO: Found listing with ID: PZ04284
2026-03-27 10:59:11 [auto1.de] INFO: Found listing with ID: HM99036
2026-03-27 10:59:11 [auto1.de] INFO: Found listing with ID: KL65209
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL65209%27 HTTP/1.1" 200 None
2026-03-27 10:59:11 [auto1.de] INFO: Scrape type for KL65209: 0
2026-03-27 10:59:11 [auto1.de] INFO: Found listing with ID: LX84376
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX84376%27 HTTP/1.1" 200 None
2026-03-27 10:59:11 [auto1.de] INFO: Scrape type for LX84376: 0
2026-03-27 10:59:11 [auto1.de] INFO: Found listing with ID: KZ16739
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ16739%27 HTTP/1.1" 200 None
2026-03-27 10:59:11 [auto1.de] INFO: Scrape type for KZ16739: 0
2026-03-27 10:59:11 [auto1.de] INFO: Found listing with ID: NC87687
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC87687%27 HTTP/1.1" 200 None
2026-03-27 10:59:11 [auto1.de] INFO: Scrape type for NC87687: 0
2026-03-27 10:59:11 [auto1.de] INFO: Found listing with ID: YB70531
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB70531%27 HTTP/1.1" 200 None
2026-03-27 10:59:11 [auto1.de] INFO: Scrape type for YB70531: 0
2026-03-27 10:59:11 [auto1.de] INFO: Found listing with ID: WX48966
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX48966%27 HTTP/1.1" 200 None
2026-03-27 10:59:11 [auto1.de] INFO: Scrape type for WX48966: 0
2026-03-27 10:59:11 [auto1.de] INFO: Found listing with ID: FB15384
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB15384%27 HTTP/1.1" 200 None
2026-03-27 10:59:11 [auto1.de] INFO: Scrape type for FB15384: 0
2026-03-27 10:59:11 [auto1.de] INFO: Found listing with ID: RA40311
2026-03-27 10:59:11 [auto1.de] INFO: Found listing with ID: XE60710
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE60710%27 HTTP/1.1" 200 None
2026-03-27 10:59:11 [auto1.de] INFO: Scrape type for XE60710: 0
2026-03-27 10:59:11 [auto1.de] INFO: Found listing with ID: UT74710
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT74710%27 HTTP/1.1" 200 None
2026-03-27 10:59:11 [auto1.de] INFO: Scrape type for UT74710: 0
2026-03-27 10:59:11 [auto1.de] INFO: Found listing with ID: HM31508
2026-03-27 10:59:11 [auto1.de] INFO: Found listing with ID: YT74468
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT74468%27 HTTP/1.1" 200 None
2026-03-27 10:59:11 [auto1.de] INFO: Scrape type for YT74468: 0
2026-03-27 10:59:11 [auto1.de] INFO: Found listing with ID: VY08054
2026-03-27 10:59:11 [auto1.de] INFO: Found listing with ID: XT92767
2026-03-27 10:59:11 [auto1.de] INFO: Found listing with ID: UR83555
2026-03-27 10:59:11 [auto1.de] INFO: Found listing with ID: BN50703
2026-03-27 10:59:11 [auto1.de] INFO: Found listing with ID: AZ58179
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ58179%27 HTTP/1.1" 200 None
2026-03-27 10:59:11 [auto1.de] INFO: Scrape type for AZ58179: 2
2026-03-27 10:59:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 651c600e-c7eb-5e62-8cd0-dee7ea664438 with identifier: AZ58179
2026-03-27 10:59:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 651c600e-c7eb-5e62-8cd0-dee7ea664438 with scrape type 2
2026-03-27 10:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 651c600e-c7eb-5e62-8cd0-dee7ea664438 with scrape type 2
2026-03-27 10:59:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 651c600e-c7eb-5e62-8cd0-dee7ea664438, identifier: AZ58179
2026-03-27 10:59:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 651c600e-c7eb-5e62-8cd0-dee7ea664438 with identifier: AZ58179
2026-03-27 10:59:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 651c600e-c7eb-5e62-8cd0-dee7ea664438 with identifier: AZ58179
2026-03-27 10:59:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 651c600e-c7eb-5e62-8cd0-dee7ea664438 with identifier: AZ58179 to the API
2026-03-27 10:59:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:59:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:59:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-27T16:16:15Z',
 'fuel_type': 'petrol',
 'id': '651c600e-c7eb-5e62-8cd0-dee7ea664438',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ58179',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 25861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-06',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Mild-Hybrid GT-Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT-Line 4WD',
 'year': 2023}
2026-03-27 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ58179%27 HTTP/1.1" 200 None
2026-03-27 10:59:12 [auto1.de] INFO: Saving data for AZ58179: {'auction_closing_time': 1774628175.0, 'created_time': 1774424133.375011, 'last_price_update_time': 1774609152.822403}
2026-03-27 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ58179') HTTP/1.1" 204 0
2026-03-27 10:59:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:59:12 [auto1.de] INFO: Found listing with ID: KN20653
2026-03-27 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN20653%27 HTTP/1.1" 200 None
2026-03-27 10:59:12 [auto1.de] INFO: Scrape type for KN20653: 0
2026-03-27 10:59:12 [auto1.de] INFO: Found listing with ID: WZ55342
2026-03-27 10:59:12 [auto1.de] INFO: Found listing with ID: BZ51273
2026-03-27 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ51273%27 HTTP/1.1" 200 None
2026-03-27 10:59:12 [auto1.de] INFO: Scrape type for BZ51273: 0
2026-03-27 10:59:12 [auto1.de] INFO: Found listing with ID: KT42918
2026-03-27 10:59:12 [auto1.de] INFO: Found listing with ID: GX87234
2026-03-27 10:59:12 [auto1.de] INFO: Found listing with ID: NH29659
2026-03-27 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH29659%27 HTTP/1.1" 200 None
2026-03-27 10:59:12 [auto1.de] INFO: Scrape type for NH29659: 0
2026-03-27 10:59:12 [auto1.de] INFO: Found listing with ID: UK45844
2026-03-27 10:59:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK45844%27 HTTP/1.1" 200 None
2026-03-27 10:59:13 [auto1.de] INFO: Scrape type for UK45844: 0
2026-03-27 10:59:13 [auto1.de] INFO: Found listing with ID: PJ17742
2026-03-27 10:59:13 [auto1.de] INFO: Found listing with ID: BZ91725
2026-03-27 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ91725%27 HTTP/1.1" 200 None
2026-03-27 10:59:13 [auto1.de] INFO: Scrape type for BZ91725: 0
2026-03-27 10:59:13 [auto1.de] INFO: Found listing with ID: GX85629
2026-03-27 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX85629%27 HTTP/1.1" 200 None
2026-03-27 10:59:13 [auto1.de] INFO: Scrape type for GX85629: 0
2026-03-27 10:59:13 [auto1.de] INFO: Found listing with ID: YE65319
2026-03-27 10:59:13 [auto1.de] INFO: Found listing with ID: FH78199
2026-03-27 10:59:13 [auto1.de] INFO: Found listing with ID: PD79431
2026-03-27 10:59:13 [auto1.de] INFO: Found listing with ID: XK74156
2026-03-27 10:59:13 [auto1.de] INFO: Found listing with ID: JP67472
2026-03-27 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP67472%27 HTTP/1.1" 200 None
2026-03-27 10:59:13 [auto1.de] INFO: Scrape type for JP67472: 0
2026-03-27 10:59:13 [auto1.de] INFO: Found listing with ID: CE63611
2026-03-27 10:59:13 [auto1.de] INFO: Found listing with ID: WS56575
2026-03-27 10:59:13 [auto1.de] INFO: Found listing with ID: GC71691
2026-03-27 10:59:13 [auto1.de] INFO: Found listing with ID: PK52215
2026-03-27 10:59:13 [auto1.de] INFO: Found listing with ID: EG84981
2026-03-27 10:59:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:59:15 [auto1.de] INFO: Channel: 24h | Page: 172 | totalHits: 10626 | hits on page: 40
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: HV49065
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV49065%27 HTTP/1.1" 200 None
2026-03-27 10:59:15 [auto1.de] INFO: Scrape type for HV49065: 0
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: GP85747
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP85747%27 HTTP/1.1" 200 None
2026-03-27 10:59:15 [auto1.de] INFO: Scrape type for GP85747: 0
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: TC07570
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC07570%27 HTTP/1.1" 200 None
2026-03-27 10:59:15 [auto1.de] INFO: Scrape type for TC07570: 0
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: VX66277
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX66277%27 HTTP/1.1" 200 None
2026-03-27 10:59:15 [auto1.de] INFO: Scrape type for VX66277: 0
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: TB85730
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: DR91116
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: RH04581
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: BK19960
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK19960%27 HTTP/1.1" 200 None
2026-03-27 10:59:15 [auto1.de] INFO: Scrape type for BK19960: 0
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: NZ46699
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: DH52741
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH52741%27 HTTP/1.1" 200 None
2026-03-27 10:59:15 [auto1.de] INFO: Scrape type for DH52741: 0
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: RV63861
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV63861%27 HTTP/1.1" 200 None
2026-03-27 10:59:15 [auto1.de] INFO: Scrape type for RV63861: 0
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: FN78597
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: XP49779
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP49779%27 HTTP/1.1" 200 None
2026-03-27 10:59:15 [auto1.de] INFO: Scrape type for XP49779: 0
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: WT07379
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT07379%27 HTTP/1.1" 200 None
2026-03-27 10:59:15 [auto1.de] INFO: Scrape type for WT07379: 0
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: YM52195
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: SY63784
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: CG44893
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: XE14279
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: WX35600
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX35600%27 HTTP/1.1" 200 None
2026-03-27 10:59:15 [auto1.de] INFO: Scrape type for WX35600: 0
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: SX67317
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: FA90244
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA90244%27 HTTP/1.1" 200 None
2026-03-27 10:59:15 [auto1.de] INFO: Scrape type for FA90244: 0
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: FV82403
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: UG55505
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG55505%27 HTTP/1.1" 200 None
2026-03-27 10:59:15 [auto1.de] INFO: Scrape type for UG55505: 0
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: FL25481
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL25481%27 HTTP/1.1" 200 None
2026-03-27 10:59:15 [auto1.de] INFO: Scrape type for FL25481: 0
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: VA71062
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: WK44607
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: XT70791
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: BU73961
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: ES83380
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES83380%27 HTTP/1.1" 200 None
2026-03-27 10:59:15 [auto1.de] INFO: Scrape type for ES83380: 0
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: BT97147
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: TK28110
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: XM94546
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM94546%27 HTTP/1.1" 200 None
2026-03-27 10:59:15 [auto1.de] INFO: Scrape type for XM94546: 0
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: SZ92529
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: XS85074
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: YX94406
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: DV48088
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV48088%27 HTTP/1.1" 200 None
2026-03-27 10:59:15 [auto1.de] INFO: Scrape type for DV48088: 0
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: LC58523
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: ZB28028
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB28028%27 HTTP/1.1" 200 None
2026-03-27 10:59:15 [auto1.de] INFO: Scrape type for ZB28028: 0
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: DS53999
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS53999%27 HTTP/1.1" 200 None
2026-03-27 10:59:15 [auto1.de] INFO: Scrape type for DS53999: 0
2026-03-27 10:59:15 [auto1.de] INFO: Found listing with ID: ZE97755
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE97755%27 HTTP/1.1" 200 None
2026-03-27 10:59:15 [auto1.de] INFO: Scrape type for ZE97755: 0
2026-03-27 10:59:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:59:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:59:19 [auto1.de] INFO: Channel: 24h | Page: 173 | totalHits: 10626 | hits on page: 40
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: NR85731
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: MU60404
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: MR23969
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR23969%27 HTTP/1.1" 200 None
2026-03-27 10:59:19 [auto1.de] INFO: Scrape type for MR23969: 0
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: ZZ22411
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: YU32339
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: MF03386
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: DL13353
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: GN42898
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: ZD85988
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD85988%27 HTTP/1.1" 200 None
2026-03-27 10:59:19 [auto1.de] INFO: Scrape type for ZD85988: 0
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: SL56049
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL56049%27 HTTP/1.1" 200 None
2026-03-27 10:59:19 [auto1.de] INFO: Scrape type for SL56049: 0
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: SG32034
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG32034%27 HTTP/1.1" 200 None
2026-03-27 10:59:19 [auto1.de] INFO: Scrape type for SG32034: 0
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: PH95596
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH95596%27 HTTP/1.1" 200 None
2026-03-27 10:59:19 [auto1.de] INFO: Scrape type for PH95596: 0
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: YN27958
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN27958%27 HTTP/1.1" 200 None
2026-03-27 10:59:19 [auto1.de] INFO: Scrape type for YN27958: 0
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: WM81264
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM81264%27 HTTP/1.1" 200 None
2026-03-27 10:59:19 [auto1.de] INFO: Scrape type for WM81264: 0
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: HA51828
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA51828%27 HTTP/1.1" 200 None
2026-03-27 10:59:19 [auto1.de] INFO: Scrape type for HA51828: 0
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: ZB84057
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB84057%27 HTTP/1.1" 200 None
2026-03-27 10:59:19 [auto1.de] INFO: Scrape type for ZB84057: 0
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: XP05146
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP05146%27 HTTP/1.1" 200 None
2026-03-27 10:59:19 [auto1.de] INFO: Scrape type for XP05146: 0
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: EX30912
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX30912%27 HTTP/1.1" 200 None
2026-03-27 10:59:19 [auto1.de] INFO: Scrape type for EX30912: 0
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: ME08770
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: HR86504
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: BM06383
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM06383%27 HTTP/1.1" 200 None
2026-03-27 10:59:19 [auto1.de] INFO: Scrape type for BM06383: 0
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: LR05492
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: RK40542
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK40542%27 HTTP/1.1" 200 None
2026-03-27 10:59:19 [auto1.de] INFO: Scrape type for RK40542: 0
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: MD90322
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: LL54952
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL54952%27 HTTP/1.1" 200 None
2026-03-27 10:59:19 [auto1.de] INFO: Scrape type for LL54952: 0
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: EM07308
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM07308%27 HTTP/1.1" 200 None
2026-03-27 10:59:19 [auto1.de] INFO: Scrape type for EM07308: 0
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: TP46996
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: JF86637
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: SY82090
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: XR02791
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: CS90187
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: TT57890
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: LU68586
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: FT42679
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT42679%27 HTTP/1.1" 200 None
2026-03-27 10:59:19 [auto1.de] INFO: Scrape type for FT42679: 0
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: PJ34004
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: ZT39805
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: JV99415
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV99415%27 HTTP/1.1" 200 None
2026-03-27 10:59:19 [auto1.de] INFO: Scrape type for JV99415: 0
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: BW61447
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: AZ67360
2026-03-27 10:59:19 [auto1.de] INFO: Found listing with ID: JS71219
2026-03-27 10:59:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:59:23 [auto1.de] INFO: Channel: 24h | Page: 174 | totalHits: 10627 | hits on page: 40
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: JS71219
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: ES68106
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES68106%27 HTTP/1.1" 200 None
2026-03-27 10:59:23 [auto1.de] INFO: Scrape type for ES68106: 0
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: BM31067
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM31067%27 HTTP/1.1" 200 None
2026-03-27 10:59:23 [auto1.de] INFO: Scrape type for BM31067: 0
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: XX51534
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX51534%27 HTTP/1.1" 200 None
2026-03-27 10:59:23 [auto1.de] INFO: Scrape type for XX51534: 0
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: ZE48308
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE48308%27 HTTP/1.1" 200 None
2026-03-27 10:59:23 [auto1.de] INFO: Scrape type for ZE48308: 0
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: EG65790
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG65790%27 HTTP/1.1" 200 None
2026-03-27 10:59:23 [auto1.de] INFO: Scrape type for EG65790: 0
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: SP64800
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP64800%27 HTTP/1.1" 200 None
2026-03-27 10:59:23 [auto1.de] INFO: Scrape type for SP64800: 0
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: ZG64364
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: LA33826
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: HM25979
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM25979%27 HTTP/1.1" 200 None
2026-03-27 10:59:23 [auto1.de] INFO: Scrape type for HM25979: 0
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: JX74637
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: FV97626
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV97626%27 HTTP/1.1" 200 None
2026-03-27 10:59:23 [auto1.de] INFO: Scrape type for FV97626: 0
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: PB67262
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: LF82683
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: TZ46793
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ46793%27 HTTP/1.1" 200 None
2026-03-27 10:59:23 [auto1.de] INFO: Scrape type for TZ46793: 0
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: JZ46683
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ46683%27 HTTP/1.1" 200 None
2026-03-27 10:59:23 [auto1.de] INFO: Scrape type for JZ46683: 0
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: GU23849
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: UT58628
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT58628%27 HTTP/1.1" 200 None
2026-03-27 10:59:23 [auto1.de] INFO: Scrape type for UT58628: 0
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: TL31198
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL31198%27 HTTP/1.1" 200 None
2026-03-27 10:59:23 [auto1.de] INFO: Scrape type for TL31198: 0
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: MJ41570
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ41570%27 HTTP/1.1" 200 None
2026-03-27 10:59:23 [auto1.de] INFO: Scrape type for MJ41570: 0
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: SH65641
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: XG65168
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: ER00491
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: VT05900
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: JB31232
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB31232%27 HTTP/1.1" 200 None
2026-03-27 10:59:23 [auto1.de] INFO: Scrape type for JB31232: 0
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: UY54796
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY54796%27 HTTP/1.1" 200 None
2026-03-27 10:59:23 [auto1.de] INFO: Scrape type for UY54796: 0
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: MJ83876
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ83876%27 HTTP/1.1" 200 None
2026-03-27 10:59:23 [auto1.de] INFO: Scrape type for MJ83876: 0
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: ZD23730
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD23730%27 HTTP/1.1" 200 None
2026-03-27 10:59:23 [auto1.de] INFO: Scrape type for ZD23730: 0
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: FL49521
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL49521%27 HTTP/1.1" 200 None
2026-03-27 10:59:23 [auto1.de] INFO: Scrape type for FL49521: 0
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: NV65753
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV65753%27 HTTP/1.1" 200 None
2026-03-27 10:59:23 [auto1.de] INFO: Scrape type for NV65753: 0
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: XC24065
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: XJ13626
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: WN98613
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN98613%27 HTTP/1.1" 200 None
2026-03-27 10:59:23 [auto1.de] INFO: Scrape type for WN98613: 0
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: SE42317
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: HX50499
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX50499%27 HTTP/1.1" 200 None
2026-03-27 10:59:23 [auto1.de] INFO: Scrape type for HX50499: 0
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: MX80513
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: DY48174
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: UC83372
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: EV23037
2026-03-27 10:59:23 [auto1.de] INFO: Found listing with ID: FW78001
2026-03-27 10:59:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:59:25 [auto1.de] INFO: Channel: 24h | Page: 175 | totalHits: 10628 | hits on page: 40
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: FW78001
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: VX72012
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: ZM93791
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM93791%27 HTTP/1.1" 200 None
2026-03-27 10:59:25 [auto1.de] INFO: Scrape type for ZM93791: 0
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: RD34206
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: TV37274
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV37274%27 HTTP/1.1" 200 None
2026-03-27 10:59:25 [auto1.de] INFO: Scrape type for TV37274: 0
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: WB34474
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: YW69752
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: EJ11431
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ11431%27 HTTP/1.1" 200 None
2026-03-27 10:59:25 [auto1.de] INFO: Scrape type for EJ11431: 0
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: XL27476
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: KY20716
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: CE62650
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE62650%27 HTTP/1.1" 200 None
2026-03-27 10:59:25 [auto1.de] INFO: Scrape type for CE62650: 0
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: BL84377
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL84377%27 HTTP/1.1" 200 None
2026-03-27 10:59:25 [auto1.de] INFO: Scrape type for BL84377: 0
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: HF35656
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF35656%27 HTTP/1.1" 200 None
2026-03-27 10:59:25 [auto1.de] INFO: Scrape type for HF35656: 0
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: EW54456
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: BN84650
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: JA61981
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA61981%27 HTTP/1.1" 200 None
2026-03-27 10:59:25 [auto1.de] INFO: Scrape type for JA61981: 0
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: SE81381
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: JY89366
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY89366%27 HTTP/1.1" 200 None
2026-03-27 10:59:25 [auto1.de] INFO: Scrape type for JY89366: 0
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: BP47263
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP47263%27 HTTP/1.1" 200 None
2026-03-27 10:59:25 [auto1.de] INFO: Scrape type for BP47263: 0
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: SC06159
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06159%27 HTTP/1.1" 200 None
2026-03-27 10:59:25 [auto1.de] INFO: Scrape type for SC06159: 0
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: NC83571
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC83571%27 HTTP/1.1" 200 None
2026-03-27 10:59:25 [auto1.de] INFO: Scrape type for NC83571: 0
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: UK43699
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK43699%27 HTTP/1.1" 200 None
2026-03-27 10:59:25 [auto1.de] INFO: Scrape type for UK43699: 0
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: EF86666
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: XZ97961
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ97961%27 HTTP/1.1" 200 None
2026-03-27 10:59:25 [auto1.de] INFO: Scrape type for XZ97961: 0
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: WL81842
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: HR60952
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR60952%27 HTTP/1.1" 200 None
2026-03-27 10:59:25 [auto1.de] INFO: Scrape type for HR60952: 0
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: RN02151
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN02151%27 HTTP/1.1" 200 None
2026-03-27 10:59:25 [auto1.de] INFO: Scrape type for RN02151: 0
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: PV40119
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: WL74765
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL74765%27 HTTP/1.1" 200 None
2026-03-27 10:59:25 [auto1.de] INFO: Scrape type for WL74765: 0
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: GB84856
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: SD31789
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: VS55791
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: WW83643
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: ZA24538
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: WZ84002
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ84002%27 HTTP/1.1" 200 None
2026-03-27 10:59:25 [auto1.de] INFO: Scrape type for WZ84002: 0
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: HZ84769
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ84769%27 HTTP/1.1" 200 None
2026-03-27 10:59:25 [auto1.de] INFO: Scrape type for HZ84769: 0
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: EN47002
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN47002%27 HTTP/1.1" 200 None
2026-03-27 10:59:25 [auto1.de] INFO: Scrape type for EN47002: 0
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: JN74580
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: UM02167
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM02167%27 HTTP/1.1" 200 None
2026-03-27 10:59:25 [auto1.de] INFO: Scrape type for UM02167: 0
2026-03-27 10:59:25 [auto1.de] INFO: Found listing with ID: XF83737
2026-03-27 10:59:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:59:29 [auto1.de] INFO: Channel: 24h | Page: 176 | totalHits: 10628 | hits on page: 40
2026-03-27 10:59:29 [auto1.de] INFO: Found listing with ID: XP98609
2026-03-27 10:59:29 [auto1.de] INFO: Found listing with ID: ZS26500
2026-03-27 10:59:29 [auto1.de] INFO: Found listing with ID: VK38709
2026-03-27 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK38709%27 HTTP/1.1" 200 None
2026-03-27 10:59:29 [auto1.de] INFO: Scrape type for VK38709: 0
2026-03-27 10:59:29 [auto1.de] INFO: Found listing with ID: GG51597
2026-03-27 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG51597%27 HTTP/1.1" 200 None
2026-03-27 10:59:29 [auto1.de] INFO: Scrape type for GG51597: 0
2026-03-27 10:59:29 [auto1.de] INFO: Found listing with ID: JM30050
2026-03-27 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM30050%27 HTTP/1.1" 200 None
2026-03-27 10:59:29 [auto1.de] INFO: Scrape type for JM30050: 2
2026-03-27 10:59:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01bbedf1-25fd-51a1-8832-906ee5179454 with identifier: JM30050
2026-03-27 10:59:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01bbedf1-25fd-51a1-8832-906ee5179454 with scrape type 2
2026-03-27 10:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01bbedf1-25fd-51a1-8832-906ee5179454 with scrape type 2
2026-03-27 10:59:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01bbedf1-25fd-51a1-8832-906ee5179454, identifier: JM30050
2026-03-27 10:59:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01bbedf1-25fd-51a1-8832-906ee5179454 with identifier: JM30050
2026-03-27 10:59:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01bbedf1-25fd-51a1-8832-906ee5179454 with identifier: JM30050
2026-03-27 10:59:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01bbedf1-25fd-51a1-8832-906ee5179454 with identifier: JM30050 to the API
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:59:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-27T16:42:55Z',
 'fuel_type': 'petrol',
 'id': '01bbedf1-25fd-51a1-8832-906ee5179454',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM30050',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 90398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-28',
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2019}
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM30050%27 HTTP/1.1" 200 None
2026-03-27 10:59:30 [auto1.de] INFO: Saving data for JM30050: {'auction_closing_time': 1774629775.0, 'created_time': 1773775712.492226, 'last_price_update_time': 1774609170.397621}
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM30050') HTTP/1.1" 204 0
2026-03-27 10:59:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: ZL97952
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL97952%27 HTTP/1.1" 200 None
2026-03-27 10:59:30 [auto1.de] INFO: Scrape type for ZL97952: 0
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: MS42171
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS42171%27 HTTP/1.1" 200 None
2026-03-27 10:59:30 [auto1.de] INFO: Scrape type for MS42171: 0
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: HY54013
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: BL96522
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: RL14403
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL14403%27 HTTP/1.1" 200 None
2026-03-27 10:59:30 [auto1.de] INFO: Scrape type for RL14403: 0
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: VC23274
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC23274%27 HTTP/1.1" 200 None
2026-03-27 10:59:30 [auto1.de] INFO: Scrape type for VC23274: 0
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: EW58649
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW58649%27 HTTP/1.1" 200 None
2026-03-27 10:59:30 [auto1.de] INFO: Scrape type for EW58649: 0
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: PW13353
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: TF55396
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: AW11286
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: RB36890
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: XG30345
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: FK60448
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: FU32442
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: XC99684
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC99684%27 HTTP/1.1" 200 None
2026-03-27 10:59:30 [auto1.de] INFO: Scrape type for XC99684: 0
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: KG77617
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG77617%27 HTTP/1.1" 200 None
2026-03-27 10:59:30 [auto1.de] INFO: Scrape type for KG77617: 0
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: BK50422
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK50422%27 HTTP/1.1" 200 None
2026-03-27 10:59:30 [auto1.de] INFO: Scrape type for BK50422: 0
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: VJ42576
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: RB12974
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB12974%27 HTTP/1.1" 200 None
2026-03-27 10:59:30 [auto1.de] INFO: Scrape type for RB12974: 0
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: VE82507
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: HM17727
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: AE93304
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE93304%27 HTTP/1.1" 200 None
2026-03-27 10:59:30 [auto1.de] INFO: Scrape type for AE93304: 0
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: WJ49334
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ49334%27 HTTP/1.1" 200 None
2026-03-27 10:59:30 [auto1.de] INFO: Scrape type for WJ49334: 0
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: WW56601
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: SG03941
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: ZT46656
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT46656%27 HTTP/1.1" 200 None
2026-03-27 10:59:30 [auto1.de] INFO: Scrape type for ZT46656: 0
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: YY80856
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY80856%27 HTTP/1.1" 200 None
2026-03-27 10:59:30 [auto1.de] INFO: Scrape type for YY80856: 0
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: VH97092
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH97092%27 HTTP/1.1" 200 None
2026-03-27 10:59:30 [auto1.de] INFO: Scrape type for VH97092: 0
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: KR57037
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: NH81971
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: JC34776
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC34776%27 HTTP/1.1" 200 None
2026-03-27 10:59:30 [auto1.de] INFO: Scrape type for JC34776: 0
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: CN60683
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: MV01217
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: VZ65007
2026-03-27 10:59:30 [auto1.de] INFO: Found listing with ID: SK72592
2026-03-27 10:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:59:38 [auto1.de] INFO: Channel: 24h | Page: 177 | totalHits: 10629 | hits on page: 40
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: SK72592
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: DK56258
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: BL18565
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: CK53116
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK53116%27 HTTP/1.1" 200 None
2026-03-27 10:59:38 [auto1.de] INFO: Scrape type for CK53116: 0
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: WB03660
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: KB07469
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB07469%27 HTTP/1.1" 200 None
2026-03-27 10:59:38 [auto1.de] INFO: Scrape type for KB07469: 0
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: UP80986
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP80986%27 HTTP/1.1" 200 None
2026-03-27 10:59:38 [auto1.de] INFO: Scrape type for UP80986: 0
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: TZ27206
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: VU62087
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: NS53225
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: EE31142
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE31142%27 HTTP/1.1" 200 None
2026-03-27 10:59:38 [auto1.de] INFO: Scrape type for EE31142: 0
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: SB59394
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: CE57384
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE57384%27 HTTP/1.1" 200 None
2026-03-27 10:59:38 [auto1.de] INFO: Scrape type for CE57384: 0
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: PN76408
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: EW09102
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW09102%27 HTTP/1.1" 200 None
2026-03-27 10:59:38 [auto1.de] INFO: Scrape type for EW09102: 0
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: LD46189
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD46189%27 HTTP/1.1" 200 None
2026-03-27 10:59:38 [auto1.de] INFO: Scrape type for LD46189: 0
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: JB97442
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: BD76971
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: GB52262
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: LC13671
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC13671%27 HTTP/1.1" 200 None
2026-03-27 10:59:38 [auto1.de] INFO: Scrape type for LC13671: 0
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: NG90783
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG90783%27 HTTP/1.1" 200 None
2026-03-27 10:59:38 [auto1.de] INFO: Scrape type for NG90783: 0
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: GH25740
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: LU76842
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU76842%27 HTTP/1.1" 200 None
2026-03-27 10:59:38 [auto1.de] INFO: Scrape type for LU76842: 0
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: LF77567
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: HP12660
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP12660%27 HTTP/1.1" 200 None
2026-03-27 10:59:38 [auto1.de] INFO: Scrape type for HP12660: 0
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: ST39834
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: XR02773
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR02773%27 HTTP/1.1" 200 None
2026-03-27 10:59:38 [auto1.de] INFO: Scrape type for XR02773: 0
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: AB21758
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: RB79900
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: ER70065
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER70065%27 HTTP/1.1" 200 None
2026-03-27 10:59:38 [auto1.de] INFO: Scrape type for ER70065: 0
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: MN42174
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: YP60462
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP60462%27 HTTP/1.1" 200 None
2026-03-27 10:59:38 [auto1.de] INFO: Scrape type for YP60462: 0
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: FE81350
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE81350%27 HTTP/1.1" 200 None
2026-03-27 10:59:38 [auto1.de] INFO: Scrape type for FE81350: 0
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: MX75449
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: RW94416
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW94416%27 HTTP/1.1" 200 None
2026-03-27 10:59:38 [auto1.de] INFO: Scrape type for RW94416: 0
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: DN74286
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN74286%27 HTTP/1.1" 200 None
2026-03-27 10:59:38 [auto1.de] INFO: Scrape type for DN74286: 0
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: AN31553
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: TJ01230
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: TW23443
2026-03-27 10:59:38 [auto1.de] INFO: Found listing with ID: XR50139
2026-03-27 10:59:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:59:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:59:39 [auto1.de] INFO: Channel: 24h | Page: 178 | totalHits: 10629 | hits on page: 40
2026-03-27 10:59:39 [auto1.de] INFO: Found listing with ID: EW88282
2026-03-27 10:59:39 [auto1.de] INFO: Found listing with ID: ZM68703
2026-03-27 10:59:39 [auto1.de] INFO: Found listing with ID: FK36679
2026-03-27 10:59:39 [auto1.de] INFO: Found listing with ID: ZA89308
2026-03-27 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA89308%27 HTTP/1.1" 200 None
2026-03-27 10:59:39 [auto1.de] INFO: Scrape type for ZA89308: 0
2026-03-27 10:59:39 [auto1.de] INFO: Found listing with ID: HF48968
2026-03-27 10:59:39 [auto1.de] INFO: Found listing with ID: WP35762
2026-03-27 10:59:39 [auto1.de] INFO: Found listing with ID: MV82057
2026-03-27 10:59:39 [auto1.de] INFO: Found listing with ID: HE95422
2026-03-27 10:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE95422%27 HTTP/1.1" 200 None
2026-03-27 10:59:40 [auto1.de] INFO: Scrape type for HE95422: 0
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: JP31774
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: AC06090
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: ZS96064
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: GJ82091
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: LT89703
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT89703%27 HTTP/1.1" 200 None
2026-03-27 10:59:40 [auto1.de] INFO: Scrape type for LT89703: 0
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: YZ90060
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: HZ78274
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ78274%27 HTTP/1.1" 200 None
2026-03-27 10:59:40 [auto1.de] INFO: Scrape type for HZ78274: 0
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: LR43035
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR43035%27 HTTP/1.1" 200 None
2026-03-27 10:59:40 [auto1.de] INFO: Scrape type for LR43035: 0
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: SK44857
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK44857%27 HTTP/1.1" 200 None
2026-03-27 10:59:40 [auto1.de] INFO: Scrape type for SK44857: 0
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: NV49426
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: FA98642
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA98642%27 HTTP/1.1" 200 None
2026-03-27 10:59:40 [auto1.de] INFO: Scrape type for FA98642: 0
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: TZ47250
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ47250%27 HTTP/1.1" 200 None
2026-03-27 10:59:40 [auto1.de] INFO: Scrape type for TZ47250: 0
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: MJ38460
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ38460%27 HTTP/1.1" 200 None
2026-03-27 10:59:40 [auto1.de] INFO: Scrape type for MJ38460: 0
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: XT50624
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT50624%27 HTTP/1.1" 200 None
2026-03-27 10:59:40 [auto1.de] INFO: Scrape type for XT50624: 0
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: ZP05230
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: CB05299
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: FK60142
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK60142%27 HTTP/1.1" 200 None
2026-03-27 10:59:40 [auto1.de] INFO: Scrape type for FK60142: 0
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: SL05189
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL05189%27 HTTP/1.1" 200 None
2026-03-27 10:59:40 [auto1.de] INFO: Scrape type for SL05189: 0
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: ED51510
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED51510%27 HTTP/1.1" 200 None
2026-03-27 10:59:40 [auto1.de] INFO: Scrape type for ED51510: 0
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: WW54595
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: SD42859
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: FC01823
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC01823%27 HTTP/1.1" 200 None
2026-03-27 10:59:40 [auto1.de] INFO: Scrape type for FC01823: 0
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: VB44523
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: AM86665
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM86665%27 HTTP/1.1" 200 None
2026-03-27 10:59:40 [auto1.de] INFO: Scrape type for AM86665: 0
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: SY69766
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: MY00378
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY00378%27 HTTP/1.1" 200 None
2026-03-27 10:59:40 [auto1.de] INFO: Scrape type for MY00378: 0
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: EP05746
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP05746%27 HTTP/1.1" 200 None
2026-03-27 10:59:40 [auto1.de] INFO: Scrape type for EP05746: 0
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: HL40021
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: FU29897
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: BF01952
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF01952%27 HTTP/1.1" 200 None
2026-03-27 10:59:40 [auto1.de] INFO: Scrape type for BF01952: 0
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: UM62946
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM62946%27 HTTP/1.1" 200 None
2026-03-27 10:59:40 [auto1.de] INFO: Scrape type for UM62946: 0
2026-03-27 10:59:40 [auto1.de] INFO: Found listing with ID: SJ24740
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ24740%27 HTTP/1.1" 200 None
2026-03-27 10:59:40 [auto1.de] INFO: Scrape type for SJ24740: 0
2026-03-27 10:59:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:59:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:59:43 [auto1.de] INFO: Channel: 24h | Page: 179 | totalHits: 10629 | hits on page: 40
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: HX53991
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: GX49972
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX49972%27 HTTP/1.1" 200 None
2026-03-27 10:59:43 [auto1.de] INFO: Scrape type for GX49972: 0
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: NE96763
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: SD72171
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: FP26768
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: XT08306
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: RY22097
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY22097%27 HTTP/1.1" 200 None
2026-03-27 10:59:43 [auto1.de] INFO: Scrape type for RY22097: 0
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: SJ07380
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ07380%27 HTTP/1.1" 200 None
2026-03-27 10:59:43 [auto1.de] INFO: Scrape type for SJ07380: 0
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: RT60437
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT60437%27 HTTP/1.1" 200 None
2026-03-27 10:59:43 [auto1.de] INFO: Scrape type for RT60437: 0
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: LP87124
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: EB31634
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB31634%27 HTTP/1.1" 200 None
2026-03-27 10:59:43 [auto1.de] INFO: Scrape type for EB31634: 0
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: AZ16208
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: BE29986
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: DF24349
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF24349%27 HTTP/1.1" 200 None
2026-03-27 10:59:43 [auto1.de] INFO: Scrape type for DF24349: 0
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: DP54739
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: LU46905
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU46905%27 HTTP/1.1" 200 None
2026-03-27 10:59:43 [auto1.de] INFO: Scrape type for LU46905: 0
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: JM90464
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: CT91396
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: VE96919
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE96919%27 HTTP/1.1" 200 None
2026-03-27 10:59:43 [auto1.de] INFO: Scrape type for VE96919: 0
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: LD55315
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: VB02230
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: SW55555
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: XB90815
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB90815%27 HTTP/1.1" 200 None
2026-03-27 10:59:43 [auto1.de] INFO: Scrape type for XB90815: 0
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: XL73598
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: FK07385
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: XY22197
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: TW55343
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW55343%27 HTTP/1.1" 200 None
2026-03-27 10:59:43 [auto1.de] INFO: Scrape type for TW55343: 0
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: DB45591
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: ED76181
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: AZ20598
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ20598%27 HTTP/1.1" 200 None
2026-03-27 10:59:43 [auto1.de] INFO: Scrape type for AZ20598: 0
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: GX33927
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX33927%27 HTTP/1.1" 200 None
2026-03-27 10:59:43 [auto1.de] INFO: Scrape type for GX33927: 0
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: VX44578
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX44578%27 HTTP/1.1" 200 None
2026-03-27 10:59:43 [auto1.de] INFO: Scrape type for VX44578: 0
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: FX73004
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX73004%27 HTTP/1.1" 200 None
2026-03-27 10:59:43 [auto1.de] INFO: Scrape type for FX73004: 0
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: JS82366
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: NC07497
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC07497%27 HTTP/1.1" 200 None
2026-03-27 10:59:43 [auto1.de] INFO: Scrape type for NC07497: 0
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: EG84867
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: YJ35877
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: YJ24873
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ24873%27 HTTP/1.1" 200 None
2026-03-27 10:59:43 [auto1.de] INFO: Scrape type for YJ24873: 0
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: UB98859
2026-03-27 10:59:43 [auto1.de] INFO: Found listing with ID: RG19344
2026-03-27 10:59:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:59:49 [auto1.de] INFO: Channel: 24h | Page: 180 | totalHits: 10629 | hits on page: 40
2026-03-27 10:59:49 [auto1.de] INFO: Found listing with ID: EL61903
2026-03-27 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL61903%27 HTTP/1.1" 200 None
2026-03-27 10:59:49 [auto1.de] INFO: Scrape type for EL61903: 0
2026-03-27 10:59:49 [auto1.de] INFO: Found listing with ID: SL38936
2026-03-27 10:59:49 [auto1.de] INFO: Found listing with ID: GM43588
2026-03-27 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM43588%27 HTTP/1.1" 200 None
2026-03-27 10:59:49 [auto1.de] INFO: Scrape type for GM43588: 0
2026-03-27 10:59:49 [auto1.de] INFO: Found listing with ID: HU86459
2026-03-27 10:59:49 [auto1.de] INFO: Found listing with ID: NA46399
2026-03-27 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA46399%27 HTTP/1.1" 200 None
2026-03-27 10:59:49 [auto1.de] INFO: Scrape type for NA46399: 0
2026-03-27 10:59:49 [auto1.de] INFO: Found listing with ID: JW66954
2026-03-27 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW66954%27 HTTP/1.1" 200 None
2026-03-27 10:59:49 [auto1.de] INFO: Scrape type for JW66954: 0
2026-03-27 10:59:49 [auto1.de] INFO: Found listing with ID: DN01543
2026-03-27 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN01543%27 HTTP/1.1" 200 None
2026-03-27 10:59:49 [auto1.de] INFO: Scrape type for DN01543: 0
2026-03-27 10:59:49 [auto1.de] INFO: Found listing with ID: DD55179
2026-03-27 10:59:49 [auto1.de] INFO: Found listing with ID: NU59007
2026-03-27 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU59007%27 HTTP/1.1" 200 None
2026-03-27 10:59:49 [auto1.de] INFO: Scrape type for NU59007: 2
2026-03-27 10:59:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5824c5c-e38c-5365-a1c8-658d98d5f06d with identifier: NU59007
2026-03-27 10:59:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5824c5c-e38c-5365-a1c8-658d98d5f06d with scrape type 2
2026-03-27 10:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5824c5c-e38c-5365-a1c8-658d98d5f06d with scrape type 2
2026-03-27 10:59:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5824c5c-e38c-5365-a1c8-658d98d5f06d, identifier: NU59007
2026-03-27 10:59:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5824c5c-e38c-5365-a1c8-658d98d5f06d with identifier: NU59007
2026-03-27 10:59:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5824c5c-e38c-5365-a1c8-658d98d5f06d with identifier: NU59007
2026-03-27 10:59:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5824c5c-e38c-5365-a1c8-658d98d5f06d with identifier: NU59007 to the API
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:59:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:15:18Z',
 'fuel_type': 'petrol',
 'id': 'f5824c5c-e38c-5365-a1c8-658d98d5f06d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU59007',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 179595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-15',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Team BlueMotion',
 'transmission': 'manual',
 'trim': 'Team BlueMotion',
 'year': 2010}
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU59007%27 HTTP/1.1" 200 None
2026-03-27 10:59:50 [auto1.de] INFO: Saving data for NU59007: {'auction_closing_time': 1774628118.0, 'created_time': 1773861542.235594, 'last_price_update_time': 1774609190.594345}
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU59007') HTTP/1.1" 204 0
2026-03-27 10:59:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: TY20437
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: HG32940
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: KV22388
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: WK04531
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: DM27064
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27064%27 HTTP/1.1" 200 None
2026-03-27 10:59:50 [auto1.de] INFO: Scrape type for DM27064: 0
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: DM61421
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: CK05183
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK05183%27 HTTP/1.1" 200 None
2026-03-27 10:59:50 [auto1.de] INFO: Scrape type for CK05183: 0
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: JL30060
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: SM53889
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: PL31001
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL31001%27 HTTP/1.1" 200 None
2026-03-27 10:59:50 [auto1.de] INFO: Scrape type for PL31001: 0
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: KB81265
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: MR48422
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: NF61931
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF61931%27 HTTP/1.1" 200 None
2026-03-27 10:59:50 [auto1.de] INFO: Scrape type for NF61931: 0
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: WT01744
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT01744%27 HTTP/1.1" 200 None
2026-03-27 10:59:50 [auto1.de] INFO: Scrape type for WT01744: 0
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: GP35592
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: AG42574
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG42574%27 HTTP/1.1" 200 None
2026-03-27 10:59:50 [auto1.de] INFO: Scrape type for AG42574: 0
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: DC32066
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: VE81778
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: HM40523
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: YU65678
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: KC97074
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: LT64157
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT64157%27 HTTP/1.1" 200 None
2026-03-27 10:59:50 [auto1.de] INFO: Scrape type for LT64157: 0
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: EB93057
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB93057%27 HTTP/1.1" 200 None
2026-03-27 10:59:50 [auto1.de] INFO: Scrape type for EB93057: 0
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: CS42122
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: CS66629
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS66629%27 HTTP/1.1" 200 None
2026-03-27 10:59:50 [auto1.de] INFO: Scrape type for CS66629: 0
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: CW98774
2026-03-27 10:59:50 [auto1.de] INFO: Found listing with ID: PP91076
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP91076%27 HTTP/1.1" 200 None
2026-03-27 10:59:50 [auto1.de] INFO: Scrape type for PP91076: 2
2026-03-27 10:59:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5babb102-a6c0-5aae-a126-65aa027faf5b with identifier: PP91076
2026-03-27 10:59:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5babb102-a6c0-5aae-a126-65aa027faf5b with scrape type 2
2026-03-27 10:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5babb102-a6c0-5aae-a126-65aa027faf5b with scrape type 2
2026-03-27 10:59:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5babb102-a6c0-5aae-a126-65aa027faf5b, identifier: PP91076
2026-03-27 10:59:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5babb102-a6c0-5aae-a126-65aa027faf5b with identifier: PP91076
2026-03-27 10:59:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5babb102-a6c0-5aae-a126-65aa027faf5b with identifier: PP91076
2026-03-27 10:59:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5babb102-a6c0-5aae-a126-65aa027faf5b with identifier: PP91076 to the API
2026-03-27 10:59:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 10:59:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 10:59:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:31:28Z',
 'fuel_type': 'petrol',
 'id': '5babb102-a6c0-5aae-a126-65aa027faf5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP91076',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 137870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Lounge BlueMotion Tech.',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech.',
 'year': 2015}
2026-03-27 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP91076%27 HTTP/1.1" 200 None
2026-03-27 10:59:51 [auto1.de] INFO: Saving data for PP91076: {'auction_closing_time': 1774629088.0, 'created_time': 1774424130.989757, 'last_price_update_time': 1774609191.293337}
2026-03-27 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP91076') HTTP/1.1" 204 0
2026-03-27 10:59:51 [auto1.de] INFO: Found listing with ID: TE76354
2026-03-27 10:59:51 [auto1.de] INFO: Found listing with ID: NZ55073
2026-03-27 10:59:51 [auto1.de] INFO: Found listing with ID: MS14458
2026-03-27 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS14458%27 HTTP/1.1" 200 None
2026-03-27 10:59:51 [auto1.de] INFO: Scrape type for MS14458: 0
2026-03-27 10:59:51 [auto1.de] INFO: Found listing with ID: YZ09307
2026-03-27 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ09307%27 HTTP/1.1" 200 None
2026-03-27 10:59:51 [auto1.de] INFO: Scrape type for YZ09307: 0
2026-03-27 10:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:59:55 [auto1.de] INFO: Channel: 24h | Page: 181 | totalHits: 10629 | hits on page: 40
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: ZJ32938
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ32938%27 HTTP/1.1" 200 None
2026-03-27 10:59:55 [auto1.de] INFO: Scrape type for ZJ32938: 0
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: FM56976
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: GC30082
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC30082%27 HTTP/1.1" 200 None
2026-03-27 10:59:55 [auto1.de] INFO: Scrape type for GC30082: 0
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: MS28207
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS28207%27 HTTP/1.1" 200 None
2026-03-27 10:59:55 [auto1.de] INFO: Scrape type for MS28207: 0
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: SC50732
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC50732%27 HTTP/1.1" 200 None
2026-03-27 10:59:55 [auto1.de] INFO: Scrape type for SC50732: 0
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: MH41234
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH41234%27 HTTP/1.1" 200 None
2026-03-27 10:59:55 [auto1.de] INFO: Scrape type for MH41234: 0
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: PD54175
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: HF61436
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: CY41602
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY41602%27 HTTP/1.1" 200 None
2026-03-27 10:59:55 [auto1.de] INFO: Scrape type for CY41602: 0
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: AH14108
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: JL53088
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL53088%27 HTTP/1.1" 200 None
2026-03-27 10:59:55 [auto1.de] INFO: Scrape type for JL53088: 0
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: KD92254
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: PF15071
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: HS50207
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS50207%27 HTTP/1.1" 200 None
2026-03-27 10:59:55 [auto1.de] INFO: Scrape type for HS50207: 0
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: FG94597
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG94597%27 HTTP/1.1" 200 None
2026-03-27 10:59:55 [auto1.de] INFO: Scrape type for FG94597: 0
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: PL20844
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: FX40711
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: HU07313
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU07313%27 HTTP/1.1" 200 None
2026-03-27 10:59:55 [auto1.de] INFO: Scrape type for HU07313: 0
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: WV90967
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV90967%27 HTTP/1.1" 200 None
2026-03-27 10:59:55 [auto1.de] INFO: Scrape type for WV90967: 0
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: XL53582
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL53582%27 HTTP/1.1" 200 None
2026-03-27 10:59:55 [auto1.de] INFO: Scrape type for XL53582: 0
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: CE18570
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: NF91521
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF91521%27 HTTP/1.1" 200 None
2026-03-27 10:59:55 [auto1.de] INFO: Scrape type for NF91521: 0
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: DV24375
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV24375%27 HTTP/1.1" 200 None
2026-03-27 10:59:55 [auto1.de] INFO: Scrape type for DV24375: 0
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: SJ67694
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: FR38517
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR38517%27 HTTP/1.1" 200 None
2026-03-27 10:59:55 [auto1.de] INFO: Scrape type for FR38517: 0
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: UH62107
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: NM18841
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: GR74650
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: XV17111
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV17111%27 HTTP/1.1" 200 None
2026-03-27 10:59:55 [auto1.de] INFO: Scrape type for XV17111: 0
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: GU28409
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: SY47802
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY47802%27 HTTP/1.1" 200 None
2026-03-27 10:59:55 [auto1.de] INFO: Scrape type for SY47802: 0
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: BW50194
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: CK72775
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: EC83870
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: MS64258
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: WR74334
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: YB38147
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: AN47371
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN47371%27 HTTP/1.1" 200 None
2026-03-27 10:59:55 [auto1.de] INFO: Scrape type for AN47371: 0
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: YV26215
2026-03-27 10:59:55 [auto1.de] INFO: Found listing with ID: BE02716
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE02716%27 HTTP/1.1" 200 None
2026-03-27 10:59:55 [auto1.de] INFO: Scrape type for BE02716: 0
2026-03-27 10:59:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 10:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 10:59:59 [auto1.de] INFO: Channel: 24h | Page: 182 | totalHits: 10629 | hits on page: 40
2026-03-27 10:59:59 [auto1.de] INFO: Found listing with ID: AK40102
2026-03-27 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 10:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK40102%27 HTTP/1.1" 200 None
2026-03-27 10:59:59 [auto1.de] INFO: Scrape type for AK40102: 0
2026-03-27 10:59:59 [auto1.de] INFO: Found listing with ID: AA40292
2026-03-27 10:59:59 [auto1.de] INFO: Found listing with ID: UB21777
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB21777%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for UB21777: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: BP04515
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: BU43780
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU43780%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for BU43780: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: DB49845
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB49845%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for DB49845: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: BX28873
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: WZ12668
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: NU80007
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU80007%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for NU80007: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: CG08693
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: GP04405
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: AJ97839
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: FC32673
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC32673%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for FC32673: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: AP01052
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP01052%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for AP01052: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: YT57607
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: XH11495
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: XA78750
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: YG55269
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG55269%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for YG55269: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: UX25395
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX25395%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for UX25395: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: RL18090
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL18090%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for RL18090: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: WA89012
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA89012%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for WA89012: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: KV63772
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV63772%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for KV63772: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: UD68347
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD68347%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for UD68347: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: HV93263
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV93263%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for HV93263: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: RV98185
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: LV13087
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV13087%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for LV13087: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: SV18640
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: PL27238
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL27238%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for PL27238: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: WN41134
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: VJ16820
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: UJ80076
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ80076%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for UJ80076: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: JY04317
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY04317%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for JY04317: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: VU47981
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU47981%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for VU47981: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: GW25301
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW25301%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for GW25301: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: JA20872
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: LW48159
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: HR87119
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR87119%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for HR87119: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: YW63189
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW63189%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for YW63189: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: LT03760
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT03760%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for LT03760: 0
2026-03-27 11:00:00 [auto1.de] INFO: Found listing with ID: FL10476
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL10476%27 HTTP/1.1" 200 None
2026-03-27 11:00:00 [auto1.de] INFO: Scrape type for FL10476: 0
2026-03-27 11:00:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:00:03 [auto1.de] INFO: Channel: 24h | Page: 183 | totalHits: 10628 | hits on page: 40
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: CM48950
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM48950%27 HTTP/1.1" 200 None
2026-03-27 11:00:03 [auto1.de] INFO: Scrape type for CM48950: 0
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: NE28687
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE28687%27 HTTP/1.1" 200 None
2026-03-27 11:00:03 [auto1.de] INFO: Scrape type for NE28687: 0
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: LY83688
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY83688%27 HTTP/1.1" 200 None
2026-03-27 11:00:03 [auto1.de] INFO: Scrape type for LY83688: 0
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: GU98415
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: AD17341
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: KA63283
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: CB18945
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: TV15766
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: AS57198
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: ZU14307
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU14307%27 HTTP/1.1" 200 None
2026-03-27 11:00:03 [auto1.de] INFO: Scrape type for ZU14307: 0
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: VP92353
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: PR75305
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR75305%27 HTTP/1.1" 200 None
2026-03-27 11:00:03 [auto1.de] INFO: Scrape type for PR75305: 0
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: RW16668
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: NX86985
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX86985%27 HTTP/1.1" 200 None
2026-03-27 11:00:03 [auto1.de] INFO: Scrape type for NX86985: 0
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: DX46321
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: PY07137
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: EG22482
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: PZ33628
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ33628%27 HTTP/1.1" 200 None
2026-03-27 11:00:03 [auto1.de] INFO: Scrape type for PZ33628: 0
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: JR47451
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR47451%27 HTTP/1.1" 200 None
2026-03-27 11:00:03 [auto1.de] INFO: Scrape type for JR47451: 0
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: GP05301
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP05301%27 HTTP/1.1" 200 None
2026-03-27 11:00:03 [auto1.de] INFO: Scrape type for GP05301: 0
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: KA35826
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: FH96122
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH96122%27 HTTP/1.1" 200 None
2026-03-27 11:00:03 [auto1.de] INFO: Scrape type for FH96122: 0
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: VV67467
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: AP30788
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP30788%27 HTTP/1.1" 200 None
2026-03-27 11:00:03 [auto1.de] INFO: Scrape type for AP30788: 0
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: UH01958
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH01958%27 HTTP/1.1" 200 None
2026-03-27 11:00:03 [auto1.de] INFO: Scrape type for UH01958: 0
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: FD50641
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: ZJ15384
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ15384%27 HTTP/1.1" 200 None
2026-03-27 11:00:03 [auto1.de] INFO: Scrape type for ZJ15384: 0
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: XR19518
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: AC00549
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC00549%27 HTTP/1.1" 200 None
2026-03-27 11:00:03 [auto1.de] INFO: Scrape type for AC00549: 0
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: ZB54249
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB54249%27 HTTP/1.1" 200 None
2026-03-27 11:00:03 [auto1.de] INFO: Scrape type for ZB54249: 0
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: SZ84834
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: GP79065
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP79065%27 HTTP/1.1" 200 None
2026-03-27 11:00:03 [auto1.de] INFO: Scrape type for GP79065: 0
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: ZL85266
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: AM54247
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM54247%27 HTTP/1.1" 200 None
2026-03-27 11:00:03 [auto1.de] INFO: Scrape type for AM54247: 0
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: HX02053
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: TR80662
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: EG37742
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG37742%27 HTTP/1.1" 200 None
2026-03-27 11:00:03 [auto1.de] INFO: Scrape type for EG37742: 0
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: AL81881
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL81881%27 HTTP/1.1" 200 None
2026-03-27 11:00:03 [auto1.de] INFO: Scrape type for AL81881: 0
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: RE74823
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE74823%27 HTTP/1.1" 200 None
2026-03-27 11:00:03 [auto1.de] INFO: Scrape type for RE74823: 0
2026-03-27 11:00:03 [auto1.de] INFO: Found listing with ID: BG37416
2026-03-27 11:00:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:00:04 [auto1.de] INFO: Channel: 24h | Page: 184 | totalHits: 10628 | hits on page: 40
2026-03-27 11:00:04 [auto1.de] INFO: Found listing with ID: KV84716
2026-03-27 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV84716%27 HTTP/1.1" 200 None
2026-03-27 11:00:04 [auto1.de] INFO: Scrape type for KV84716: 0
2026-03-27 11:00:04 [auto1.de] INFO: Found listing with ID: CL77632
2026-03-27 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL77632%27 HTTP/1.1" 200 None
2026-03-27 11:00:04 [auto1.de] INFO: Scrape type for CL77632: 0
2026-03-27 11:00:04 [auto1.de] INFO: Found listing with ID: GC23604
2026-03-27 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC23604%27 HTTP/1.1" 200 None
2026-03-27 11:00:04 [auto1.de] INFO: Scrape type for GC23604: 0
2026-03-27 11:00:04 [auto1.de] INFO: Found listing with ID: NW62557
2026-03-27 11:00:04 [auto1.de] INFO: Found listing with ID: FX85164
2026-03-27 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX85164%27 HTTP/1.1" 200 None
2026-03-27 11:00:04 [auto1.de] INFO: Scrape type for FX85164: 0
2026-03-27 11:00:04 [auto1.de] INFO: Found listing with ID: AW71127
2026-03-27 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW71127%27 HTTP/1.1" 200 None
2026-03-27 11:00:04 [auto1.de] INFO: Scrape type for AW71127: 0
2026-03-27 11:00:04 [auto1.de] INFO: Found listing with ID: ZT02890
2026-03-27 11:00:04 [auto1.de] INFO: Found listing with ID: YH65606
2026-03-27 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH65606%27 HTTP/1.1" 200 None
2026-03-27 11:00:04 [auto1.de] INFO: Scrape type for YH65606: 0
2026-03-27 11:00:04 [auto1.de] INFO: Found listing with ID: WR71017
2026-03-27 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR71017%27 HTTP/1.1" 200 None
2026-03-27 11:00:04 [auto1.de] INFO: Scrape type for WR71017: 0
2026-03-27 11:00:04 [auto1.de] INFO: Found listing with ID: AG29521
2026-03-27 11:00:04 [auto1.de] INFO: Found listing with ID: NA04350
2026-03-27 11:00:04 [auto1.de] INFO: Found listing with ID: RT58189
2026-03-27 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT58189%27 HTTP/1.1" 200 None
2026-03-27 11:00:04 [auto1.de] INFO: Scrape type for RT58189: 0
2026-03-27 11:00:04 [auto1.de] INFO: Found listing with ID: CF27323
2026-03-27 11:00:04 [auto1.de] INFO: Found listing with ID: DS42443
2026-03-27 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS42443%27 HTTP/1.1" 200 None
2026-03-27 11:00:04 [auto1.de] INFO: Scrape type for DS42443: 0
2026-03-27 11:00:04 [auto1.de] INFO: Found listing with ID: RJ91019
2026-03-27 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ91019%27 HTTP/1.1" 200 None
2026-03-27 11:00:04 [auto1.de] INFO: Scrape type for RJ91019: 0
2026-03-27 11:00:04 [auto1.de] INFO: Found listing with ID: HG98995
2026-03-27 11:00:04 [auto1.de] INFO: Found listing with ID: AU06034
2026-03-27 11:00:04 [auto1.de] INFO: Found listing with ID: VR01231
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR01231%27 HTTP/1.1" 200 None
2026-03-27 11:00:05 [auto1.de] INFO: Scrape type for VR01231: 0
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: SY04037
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY04037%27 HTTP/1.1" 200 None
2026-03-27 11:00:05 [auto1.de] INFO: Scrape type for SY04037: 0
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: XB57193
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB57193%27 HTTP/1.1" 200 None
2026-03-27 11:00:05 [auto1.de] INFO: Scrape type for XB57193: 0
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: HZ37968
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: DK78572
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: BV38290
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV38290%27 HTTP/1.1" 200 None
2026-03-27 11:00:05 [auto1.de] INFO: Scrape type for BV38290: 0
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: PR99901
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR99901%27 HTTP/1.1" 200 None
2026-03-27 11:00:05 [auto1.de] INFO: Scrape type for PR99901: 0
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: GM66597
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: ZC81938
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: MF46083
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: EH49621
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH49621%27 HTTP/1.1" 200 None
2026-03-27 11:00:05 [auto1.de] INFO: Scrape type for EH49621: 0
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: AC43981
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC43981%27 HTTP/1.1" 200 None
2026-03-27 11:00:05 [auto1.de] INFO: Scrape type for AC43981: 0
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: VC88612
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC88612%27 HTTP/1.1" 200 None
2026-03-27 11:00:05 [auto1.de] INFO: Scrape type for VC88612: 0
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: LC05735
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: AK28209
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK28209%27 HTTP/1.1" 200 None
2026-03-27 11:00:05 [auto1.de] INFO: Scrape type for AK28209: 0
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: AF90097
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF90097%27 HTTP/1.1" 200 None
2026-03-27 11:00:05 [auto1.de] INFO: Scrape type for AF90097: 0
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: PZ79327
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ79327%27 HTTP/1.1" 200 None
2026-03-27 11:00:05 [auto1.de] INFO: Scrape type for PZ79327: 0
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: SX00955
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: AK58988
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: ZK63444
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK63444%27 HTTP/1.1" 200 None
2026-03-27 11:00:05 [auto1.de] INFO: Scrape type for ZK63444: 0
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: MA94395
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: GX16623
2026-03-27 11:00:05 [auto1.de] INFO: Found listing with ID: GJ37038
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ37038%27 HTTP/1.1" 200 None
2026-03-27 11:00:05 [auto1.de] INFO: Scrape type for GJ37038: 0
2026-03-27 11:00:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:00:06 [scrapy.extensions.logstats] INFO: Crawled 652 pages (at 17 pages/min), scraped 922 items (at 4 items/min)
2026-03-27 11:00:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 11:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:00:07 [auto1.de] INFO: Channel: 24h | Page: 185 | totalHits: 10628 | hits on page: 40
2026-03-27 11:00:07 [auto1.de] INFO: Found listing with ID: NP76557
2026-03-27 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP76557%27 HTTP/1.1" 200 None
2026-03-27 11:00:07 [auto1.de] INFO: Scrape type for NP76557: 0
2026-03-27 11:00:07 [auto1.de] INFO: Found listing with ID: WK37492
2026-03-27 11:00:07 [auto1.de] INFO: Found listing with ID: EG86268
2026-03-27 11:00:07 [auto1.de] INFO: Found listing with ID: NE03799
2026-03-27 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE03799%27 HTTP/1.1" 200 None
2026-03-27 11:00:07 [auto1.de] INFO: Scrape type for NE03799: 0
2026-03-27 11:00:07 [auto1.de] INFO: Found listing with ID: XK66044
2026-03-27 11:00:07 [auto1.de] INFO: Found listing with ID: CE66063
2026-03-27 11:00:07 [auto1.de] INFO: Found listing with ID: ZK63599
2026-03-27 11:00:07 [auto1.de] INFO: Found listing with ID: HS27908
2026-03-27 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS27908%27 HTTP/1.1" 200 None
2026-03-27 11:00:07 [auto1.de] INFO: Scrape type for HS27908: 2
2026-03-27 11:00:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23fb78f0-b8cf-569d-893a-fed966d4fe80 with identifier: HS27908
2026-03-27 11:00:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23fb78f0-b8cf-569d-893a-fed966d4fe80 with scrape type 2
2026-03-27 11:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23fb78f0-b8cf-569d-893a-fed966d4fe80 with scrape type 2
2026-03-27 11:00:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23fb78f0-b8cf-569d-893a-fed966d4fe80, identifier: HS27908
2026-03-27 11:00:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23fb78f0-b8cf-569d-893a-fed966d4fe80 with identifier: HS27908
2026-03-27 11:00:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23fb78f0-b8cf-569d-893a-fed966d4fe80 with identifier: HS27908
2026-03-27 11:00:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23fb78f0-b8cf-569d-893a-fed966d4fe80 with identifier: HS27908 to the API
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:00:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:04:55Z',
 'fuel_type': 'diesel',
 'id': '23fb78f0-b8cf-569d-893a-fed966d4fe80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS27908',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Caravelle',
 'odometer': 386565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-27',
 'seller_name': None,
 'title': 'Volkswagen T6 Caravelle 2.0 TDI Comfortline lang',
 'transmission': 'manual',
 'trim': 'Comfortline lang',
 'year': 2019}
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS27908%27 HTTP/1.1" 200 None
2026-03-27 11:00:08 [auto1.de] INFO: Saving data for HS27908: {'auction_closing_time': 1774627495.0, 'created_time': 1773688470.80237, 'last_price_update_time': 1774609208.467701}
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS27908') HTTP/1.1" 204 0
2026-03-27 11:00:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: CN74246
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: SK50267
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK50267%27 HTTP/1.1" 200 None
2026-03-27 11:00:08 [auto1.de] INFO: Scrape type for SK50267: 0
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: UX27196
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: XM28055
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM28055%27 HTTP/1.1" 200 None
2026-03-27 11:00:08 [auto1.de] INFO: Scrape type for XM28055: 0
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: BZ43252
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ43252%27 HTTP/1.1" 200 None
2026-03-27 11:00:08 [auto1.de] INFO: Scrape type for BZ43252: 0
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: PF04540
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF04540%27 HTTP/1.1" 200 None
2026-03-27 11:00:08 [auto1.de] INFO: Scrape type for PF04540: 0
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: RC15993
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: VC21534
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC21534%27 HTTP/1.1" 200 None
2026-03-27 11:00:08 [auto1.de] INFO: Scrape type for VC21534: 0
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: DS74430
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS74430%27 HTTP/1.1" 200 None
2026-03-27 11:00:08 [auto1.de] INFO: Scrape type for DS74430: 0
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: XN06549
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN06549%27 HTTP/1.1" 200 None
2026-03-27 11:00:08 [auto1.de] INFO: Scrape type for XN06549: 0
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: AN43216
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: FA82480
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA82480%27 HTTP/1.1" 200 None
2026-03-27 11:00:08 [auto1.de] INFO: Scrape type for FA82480: 0
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: MH85381
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: BG74422
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: ED19877
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: GA18990
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: WK15849
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK15849%27 HTTP/1.1" 200 None
2026-03-27 11:00:08 [auto1.de] INFO: Scrape type for WK15849: 0
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: RL76868
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: XE05025
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE05025%27 HTTP/1.1" 200 None
2026-03-27 11:00:08 [auto1.de] INFO: Scrape type for XE05025: 0
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: CU91284
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU91284%27 HTTP/1.1" 200 None
2026-03-27 11:00:08 [auto1.de] INFO: Scrape type for CU91284: 0
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: ZL47575
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL47575%27 HTTP/1.1" 200 None
2026-03-27 11:00:08 [auto1.de] INFO: Scrape type for ZL47575: 0
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: UK07375
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: AX09860
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: BJ59034
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ59034%27 HTTP/1.1" 200 None
2026-03-27 11:00:08 [auto1.de] INFO: Scrape type for BJ59034: 0
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: EP28641
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: TZ59540
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ59540%27 HTTP/1.1" 200 None
2026-03-27 11:00:08 [auto1.de] INFO: Scrape type for TZ59540: 0
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: JF61688
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: LZ16112
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ16112%27 HTTP/1.1" 200 None
2026-03-27 11:00:08 [auto1.de] INFO: Scrape type for LZ16112: 0
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: WC76743
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: GT81427
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT81427%27 HTTP/1.1" 200 None
2026-03-27 11:00:08 [auto1.de] INFO: Scrape type for GT81427: 0
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: PK80050
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK80050%27 HTTP/1.1" 200 None
2026-03-27 11:00:08 [auto1.de] INFO: Scrape type for PK80050: 0
2026-03-27 11:00:08 [auto1.de] INFO: Found listing with ID: NJ23402
2026-03-27 11:01:06 [scrapy.extensions.logstats] INFO: Crawled 653 pages (at 1 pages/min), scraped 923 items (at 1 items/min)
2026-03-27 11:01:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 11:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:01:19 [auto1.de] INFO: Channel: 24h | Page: 186 | totalHits: 10632 | hits on page: 40
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: WC76743
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: GT81427
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT81427%27 HTTP/1.1" 200 None
2026-03-27 11:01:19 [auto1.de] INFO: Scrape type for GT81427: 0
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: PK80050
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK80050%27 HTTP/1.1" 200 None
2026-03-27 11:01:19 [auto1.de] INFO: Scrape type for PK80050: 0
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: NJ23402
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: PM22977
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: YR83365
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR83365%27 HTTP/1.1" 200 None
2026-03-27 11:01:19 [auto1.de] INFO: Scrape type for YR83365: 0
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: ZT46434
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: CC01881
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: SU46681
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU46681%27 HTTP/1.1" 200 None
2026-03-27 11:01:19 [auto1.de] INFO: Scrape type for SU46681: 0
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: AR52184
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR52184%27 HTTP/1.1" 200 None
2026-03-27 11:01:19 [auto1.de] INFO: Scrape type for AR52184: 0
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: ZB19421
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB19421%27 HTTP/1.1" 200 None
2026-03-27 11:01:19 [auto1.de] INFO: Scrape type for ZB19421: 0
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: YB70330
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB70330%27 HTTP/1.1" 200 None
2026-03-27 11:01:19 [auto1.de] INFO: Scrape type for YB70330: 0
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: RY66150
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: UF45405
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: XW84659
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW84659%27 HTTP/1.1" 200 None
2026-03-27 11:01:19 [auto1.de] INFO: Scrape type for XW84659: 0
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: JY84045
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY84045%27 HTTP/1.1" 200 None
2026-03-27 11:01:19 [auto1.de] INFO: Scrape type for JY84045: 0
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: ZD66155
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: MW59973
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: CX80626
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: WL44936
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: MW30112
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: CG03198
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG03198%27 HTTP/1.1" 200 None
2026-03-27 11:01:19 [auto1.de] INFO: Scrape type for CG03198: 0
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: GW45177
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW45177%27 HTTP/1.1" 200 None
2026-03-27 11:01:19 [auto1.de] INFO: Scrape type for GW45177: 0
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: PR29926
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR29926%27 HTTP/1.1" 200 None
2026-03-27 11:01:19 [auto1.de] INFO: Scrape type for PR29926: 0
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: GF47308
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF47308%27 HTTP/1.1" 200 None
2026-03-27 11:01:19 [auto1.de] INFO: Scrape type for GF47308: 0
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: ZB93875
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB93875%27 HTTP/1.1" 200 None
2026-03-27 11:01:19 [auto1.de] INFO: Scrape type for ZB93875: 0
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: YC31452
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC31452%27 HTTP/1.1" 200 None
2026-03-27 11:01:19 [auto1.de] INFO: Scrape type for YC31452: 0
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: EU79634
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: LG53091
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG53091%27 HTTP/1.1" 200 None
2026-03-27 11:01:19 [auto1.de] INFO: Scrape type for LG53091: 0
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: RA53800
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA53800%27 HTTP/1.1" 200 None
2026-03-27 11:01:19 [auto1.de] INFO: Scrape type for RA53800: 0
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: FA81241
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: HJ64002
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: LA26429
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA26429%27 HTTP/1.1" 200 None
2026-03-27 11:01:19 [auto1.de] INFO: Scrape type for LA26429: 0
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: MH16852
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH16852%27 HTTP/1.1" 200 None
2026-03-27 11:01:19 [auto1.de] INFO: Scrape type for MH16852: 0
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: TP19138
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: RP38115
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: HC07616
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: EU39655
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: KD28185
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD28185%27 HTTP/1.1" 200 None
2026-03-27 11:01:19 [auto1.de] INFO: Scrape type for KD28185: 0
2026-03-27 11:01:19 [auto1.de] INFO: Found listing with ID: PV29285
2026-03-27 11:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:01:21 [auto1.de] INFO: Channel: 24h | Page: 187 | totalHits: 10632 | hits on page: 40
2026-03-27 11:01:21 [auto1.de] INFO: Found listing with ID: YK59782
2026-03-27 11:01:21 [auto1.de] INFO: Found listing with ID: UC42988
2026-03-27 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC42988%27 HTTP/1.1" 200 None
2026-03-27 11:01:22 [auto1.de] INFO: Scrape type for UC42988: 0
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: EY08690
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY08690%27 HTTP/1.1" 200 None
2026-03-27 11:01:22 [auto1.de] INFO: Scrape type for EY08690: 0
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: TS71222
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS71222%27 HTTP/1.1" 200 None
2026-03-27 11:01:22 [auto1.de] INFO: Scrape type for TS71222: 0
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: LJ72286
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: NR02271
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: FZ55266
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ55266%27 HTTP/1.1" 200 None
2026-03-27 11:01:22 [auto1.de] INFO: Scrape type for FZ55266: 0
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: AB33949
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: KF96616
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: XG61094
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: MA92552
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA92552%27 HTTP/1.1" 200 None
2026-03-27 11:01:22 [auto1.de] INFO: Scrape type for MA92552: 0
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: ME73064
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: LP57888
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP57888%27 HTTP/1.1" 200 None
2026-03-27 11:01:22 [auto1.de] INFO: Scrape type for LP57888: 0
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: XK07577
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: VG94091
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG94091%27 HTTP/1.1" 200 None
2026-03-27 11:01:22 [auto1.de] INFO: Scrape type for VG94091: 0
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: UT40862
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT40862%27 HTTP/1.1" 200 None
2026-03-27 11:01:22 [auto1.de] INFO: Scrape type for UT40862: 0
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: WB92909
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: BH14343
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: LR92682
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR92682%27 HTTP/1.1" 200 None
2026-03-27 11:01:22 [auto1.de] INFO: Scrape type for LR92682: 0
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: RP79325
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: XV50693
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: GV55146
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: WZ77198
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ77198%27 HTTP/1.1" 200 None
2026-03-27 11:01:22 [auto1.de] INFO: Scrape type for WZ77198: 0
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: WM87026
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM87026%27 HTTP/1.1" 200 None
2026-03-27 11:01:22 [auto1.de] INFO: Scrape type for WM87026: 0
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: BL66823
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL66823%27 HTTP/1.1" 200 None
2026-03-27 11:01:22 [auto1.de] INFO: Scrape type for BL66823: 0
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: PY74539
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY74539%27 HTTP/1.1" 200 None
2026-03-27 11:01:22 [auto1.de] INFO: Scrape type for PY74539: 0
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: CP27370
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP27370%27 HTTP/1.1" 200 None
2026-03-27 11:01:22 [auto1.de] INFO: Scrape type for CP27370: 0
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: MR73293
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: CT28544
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: CA14151
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: UP55946
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: TZ11746
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: DZ95000
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ95000%27 HTTP/1.1" 200 None
2026-03-27 11:01:22 [auto1.de] INFO: Scrape type for DZ95000: 0
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: BC27569
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: NZ68458
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: RD70128
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: MG91199
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG91199%27 HTTP/1.1" 200 None
2026-03-27 11:01:22 [auto1.de] INFO: Scrape type for MG91199: 0
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: LW90225
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: UP80660
2026-03-27 11:01:22 [auto1.de] INFO: Found listing with ID: LN30435
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN30435%27 HTTP/1.1" 200 None
2026-03-27 11:01:22 [auto1.de] INFO: Scrape type for LN30435: 0
2026-03-27 11:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:01:23 [auto1.de] INFO: Channel: 24h | Page: 188 | totalHits: 10632 | hits on page: 40
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: VX90434
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX90434%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for VX90434: 0
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: WU38252
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU38252%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for WU38252: 0
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: GH45156
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: BH73994
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH73994%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for BH73994: 0
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: RG09784
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG09784%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for RG09784: 0
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: SL55745
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: LZ58710
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ58710%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for LZ58710: 0
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: AC85459
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC85459%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for AC85459: 0
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: SB14031
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB14031%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for SB14031: 0
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: VS98384
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS98384%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for VS98384: 0
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: TF08287
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: KL09374
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL09374%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for KL09374: 0
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: WT00588
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: MR59336
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: JN34556
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34556%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for JN34556: 0
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: VC12091
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: SD83034
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD83034%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for SD83034: 0
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: KY67779
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: UE63664
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE63664%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for UE63664: 0
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: FH60355
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH60355%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for FH60355: 0
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: TN52823
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN52823%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for TN52823: 0
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: VM58526
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: WN20430
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: XB95476
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB95476%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for XB95476: 0
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: ZW22458
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: XM77164
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: BM70881
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: CM04510
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM04510%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for CM04510: 0
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: HC69827
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC69827%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for HC69827: 0
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: JD67871
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: FY22177
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: FM49388
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: MK61736
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK61736%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for MK61736: 0
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: JD41613
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD41613%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for JD41613: 0
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: HK34206
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK34206%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for HK34206: 0
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: CE75609
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE75609%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for CE75609: 0
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: EA67695
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: XS73357
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: AD50252
2026-03-27 11:01:23 [auto1.de] INFO: Found listing with ID: UT59305
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT59305%27 HTTP/1.1" 200 None
2026-03-27 11:01:23 [auto1.de] INFO: Scrape type for UT59305: 0
2026-03-27 11:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:01:24 [auto1.de] INFO: Channel: 24h | Page: 189 | totalHits: 10632 | hits on page: 40
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: XY49734
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY49734%27 HTTP/1.1" 200 None
2026-03-27 11:01:24 [auto1.de] INFO: Scrape type for XY49734: 0
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: AP11154
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP11154%27 HTTP/1.1" 200 None
2026-03-27 11:01:24 [auto1.de] INFO: Scrape type for AP11154: 0
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: WP86079
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP86079%27 HTTP/1.1" 200 None
2026-03-27 11:01:24 [auto1.de] INFO: Scrape type for WP86079: 0
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: XA96250
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA96250%27 HTTP/1.1" 200 None
2026-03-27 11:01:24 [auto1.de] INFO: Scrape type for XA96250: 0
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: UV60068
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV60068%27 HTTP/1.1" 200 None
2026-03-27 11:01:24 [auto1.de] INFO: Scrape type for UV60068: 0
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: ZN73895
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN73895%27 HTTP/1.1" 200 None
2026-03-27 11:01:24 [auto1.de] INFO: Scrape type for ZN73895: 0
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: JN34969
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: GE40777
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE40777%27 HTTP/1.1" 200 None
2026-03-27 11:01:24 [auto1.de] INFO: Scrape type for GE40777: 0
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: ER07005
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: SP10059
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: XL60244
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL60244%27 HTTP/1.1" 200 None
2026-03-27 11:01:24 [auto1.de] INFO: Scrape type for XL60244: 0
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: LE46493
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: XX23158
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX23158%27 HTTP/1.1" 200 None
2026-03-27 11:01:24 [auto1.de] INFO: Scrape type for XX23158: 0
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: XB50161
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: HG98131
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG98131%27 HTTP/1.1" 200 None
2026-03-27 11:01:24 [auto1.de] INFO: Scrape type for HG98131: 0
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: VK76686
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: WN68055
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN68055%27 HTTP/1.1" 200 None
2026-03-27 11:01:24 [auto1.de] INFO: Scrape type for WN68055: 0
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: EH25554
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: PP00073
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: SD35692
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD35692%27 HTTP/1.1" 200 None
2026-03-27 11:01:24 [auto1.de] INFO: Scrape type for SD35692: 0
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: GM15631
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: CZ09643
2026-03-27 11:01:24 [auto1.de] INFO: Found listing with ID: MV64998
2026-03-27 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV64998%27 HTTP/1.1" 200 None
2026-03-27 11:01:25 [auto1.de] INFO: Scrape type for MV64998: 0
2026-03-27 11:01:25 [auto1.de] INFO: Found listing with ID: NT47170
2026-03-27 11:01:25 [auto1.de] INFO: Found listing with ID: WA46959
2026-03-27 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA46959%27 HTTP/1.1" 200 None
2026-03-27 11:01:25 [auto1.de] INFO: Scrape type for WA46959: 0
2026-03-27 11:01:25 [auto1.de] INFO: Found listing with ID: ZU43350
2026-03-27 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU43350%27 HTTP/1.1" 200 None
2026-03-27 11:01:25 [auto1.de] INFO: Scrape type for ZU43350: 0
2026-03-27 11:01:25 [auto1.de] INFO: Found listing with ID: FU95957
2026-03-27 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU95957%27 HTTP/1.1" 200 None
2026-03-27 11:01:25 [auto1.de] INFO: Scrape type for FU95957: 0
2026-03-27 11:01:25 [auto1.de] INFO: Found listing with ID: MA78181
2026-03-27 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA78181%27 HTTP/1.1" 200 None
2026-03-27 11:01:25 [auto1.de] INFO: Scrape type for MA78181: 0
2026-03-27 11:01:25 [auto1.de] INFO: Found listing with ID: FK64701
2026-03-27 11:01:25 [auto1.de] INFO: Found listing with ID: JT51313
2026-03-27 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT51313%27 HTTP/1.1" 200 None
2026-03-27 11:01:25 [auto1.de] INFO: Scrape type for JT51313: 0
2026-03-27 11:01:25 [auto1.de] INFO: Found listing with ID: FG94497
2026-03-27 11:01:25 [auto1.de] INFO: Found listing with ID: NF92899
2026-03-27 11:01:25 [auto1.de] INFO: Found listing with ID: PE22510
2026-03-27 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE22510%27 HTTP/1.1" 200 None
2026-03-27 11:01:25 [auto1.de] INFO: Scrape type for PE22510: 0
2026-03-27 11:01:25 [auto1.de] INFO: Found listing with ID: JD70113
2026-03-27 11:01:25 [auto1.de] INFO: Found listing with ID: AR35397
2026-03-27 11:01:25 [auto1.de] INFO: Found listing with ID: AR55742
2026-03-27 11:01:25 [auto1.de] INFO: Found listing with ID: VJ26450
2026-03-27 11:01:25 [auto1.de] INFO: Found listing with ID: EZ33128
2026-03-27 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ33128%27 HTTP/1.1" 200 None
2026-03-27 11:01:25 [auto1.de] INFO: Scrape type for EZ33128: 0
2026-03-27 11:01:25 [auto1.de] INFO: Found listing with ID: MH82914
2026-03-27 11:01:25 [auto1.de] INFO: Found listing with ID: ZJ36326
2026-03-27 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ36326%27 HTTP/1.1" 200 None
2026-03-27 11:01:25 [auto1.de] INFO: Scrape type for ZJ36326: 0
2026-03-27 11:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:01:35 [auto1.de] INFO: Channel: 24h | Page: 190 | totalHits: 10632 | hits on page: 40
2026-03-27 11:01:35 [auto1.de] INFO: Found listing with ID: EB22696
2026-03-27 11:01:35 [auto1.de] INFO: Found listing with ID: ML89634
2026-03-27 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML89634%27 HTTP/1.1" 200 None
2026-03-27 11:01:35 [auto1.de] INFO: Scrape type for ML89634: 0
2026-03-27 11:01:35 [auto1.de] INFO: Found listing with ID: HN27316
2026-03-27 11:01:35 [auto1.de] INFO: Found listing with ID: BC73489
2026-03-27 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC73489%27 HTTP/1.1" 200 None
2026-03-27 11:01:35 [auto1.de] INFO: Scrape type for BC73489: 0
2026-03-27 11:01:35 [auto1.de] INFO: Found listing with ID: YW46881
2026-03-27 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW46881%27 HTTP/1.1" 200 None
2026-03-27 11:01:35 [auto1.de] INFO: Scrape type for YW46881: 0
2026-03-27 11:01:35 [auto1.de] INFO: Found listing with ID: MT28952
2026-03-27 11:01:35 [auto1.de] INFO: Found listing with ID: AL76969
2026-03-27 11:01:35 [auto1.de] INFO: Found listing with ID: ZG52180
2026-03-27 11:01:35 [auto1.de] INFO: Found listing with ID: BB52240
2026-03-27 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB52240%27 HTTP/1.1" 200 None
2026-03-27 11:01:35 [auto1.de] INFO: Scrape type for BB52240: 0
2026-03-27 11:01:35 [auto1.de] INFO: Found listing with ID: ZF45936
2026-03-27 11:01:35 [auto1.de] INFO: Found listing with ID: XY03510
2026-03-27 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY03510%27 HTTP/1.1" 200 None
2026-03-27 11:01:35 [auto1.de] INFO: Scrape type for XY03510: 0
2026-03-27 11:01:35 [auto1.de] INFO: Found listing with ID: TY77956
2026-03-27 11:01:35 [auto1.de] INFO: Found listing with ID: KG80613
2026-03-27 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG80613%27 HTTP/1.1" 200 None
2026-03-27 11:01:36 [auto1.de] INFO: Scrape type for KG80613: 0
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: CK58457
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: RX78889
2026-03-27 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX78889%27 HTTP/1.1" 200 None
2026-03-27 11:01:36 [auto1.de] INFO: Scrape type for RX78889: 0
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: XW48128
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: AX13429
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: ZJ71499
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: JK52723
2026-03-27 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK52723%27 HTTP/1.1" 200 None
2026-03-27 11:01:36 [auto1.de] INFO: Scrape type for JK52723: 0
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: XM85964
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: SX22441
2026-03-27 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX22441%27 HTTP/1.1" 200 None
2026-03-27 11:01:36 [auto1.de] INFO: Scrape type for SX22441: 0
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: XS25100
2026-03-27 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS25100%27 HTTP/1.1" 200 None
2026-03-27 11:01:36 [auto1.de] INFO: Scrape type for XS25100: 0
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: HK91051
2026-03-27 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK91051%27 HTTP/1.1" 200 None
2026-03-27 11:01:36 [auto1.de] INFO: Scrape type for HK91051: 0
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: SG59726
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: EE06188
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: PP24406
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: ZZ39115
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: HB66964
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: RB04302
2026-03-27 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB04302%27 HTTP/1.1" 200 None
2026-03-27 11:01:36 [auto1.de] INFO: Scrape type for RB04302: 0
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: UY72197
2026-03-27 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY72197%27 HTTP/1.1" 200 None
2026-03-27 11:01:36 [auto1.de] INFO: Scrape type for UY72197: 0
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: JA47087
2026-03-27 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA47087%27 HTTP/1.1" 200 None
2026-03-27 11:01:36 [auto1.de] INFO: Scrape type for JA47087: 0
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: NJ99986
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: UG82717
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: ZX84028
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: XD51934
2026-03-27 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD51934%27 HTTP/1.1" 200 None
2026-03-27 11:01:36 [auto1.de] INFO: Scrape type for XD51934: 0
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: GB61251
2026-03-27 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB61251%27 HTTP/1.1" 200 None
2026-03-27 11:01:36 [auto1.de] INFO: Scrape type for GB61251: 0
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: RG01801
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: UM69189
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: JT99615
2026-03-27 11:01:36 [auto1.de] INFO: Found listing with ID: HA73784
2026-03-27 11:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:01:39 [auto1.de] INFO: Channel: 24h | Page: 191 | totalHits: 10632 | hits on page: 40
2026-03-27 11:01:39 [auto1.de] INFO: Found listing with ID: RW76455
2026-03-27 11:01:39 [auto1.de] INFO: Found listing with ID: EL67777
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL67777%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for EL67777: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: AA81624
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: DS69815
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: XY25128
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY25128%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for XY25128: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: FT31566
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT31566%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for FT31566: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: MH16408
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH16408%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for MH16408: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: EM69554
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: LT53153
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: YA93761
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: RB33058
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB33058%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for RB33058: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: ZL74472
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL74472%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for ZL74472: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: LL80730
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL80730%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for LL80730: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: KX92622
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX92622%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for KX92622: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: BL18853
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: KD61582
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD61582%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for KD61582: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: HA69853
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA69853%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for HA69853: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: EK95732
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: UT95819
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT95819%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for UT95819: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: JT90882
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: UU53045
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU53045%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for UU53045: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: JM98796
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM98796%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for JM98796: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: JV63576
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: TT26820
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT26820%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for TT26820: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: PC66618
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC66618%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for PC66618: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: JA40486
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA40486%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for JA40486: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: ZA83090
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA83090%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for ZA83090: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: XZ10610
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ10610%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for XZ10610: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: ZX40025
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX40025%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for ZX40025: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: MT96605
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT96605%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for MT96605: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: TH57593
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH57593%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for TH57593: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: VC99314
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: DL99683
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL99683%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for DL99683: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: HH17921
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH17921%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for HH17921: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: RU26230
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU26230%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for RU26230: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: AZ47181
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ47181%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for AZ47181: 0
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: PB26070
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: BN97091
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: FZ94191
2026-03-27 11:01:40 [auto1.de] INFO: Found listing with ID: TD61700
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD61700%27 HTTP/1.1" 200 None
2026-03-27 11:01:40 [auto1.de] INFO: Scrape type for TD61700: 0
2026-03-27 11:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:01:48 [auto1.de] INFO: Channel: 24h | Page: 192 | totalHits: 10632 | hits on page: 40
2026-03-27 11:01:48 [auto1.de] INFO: Found listing with ID: PV77274
2026-03-27 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV77274%27 HTTP/1.1" 200 None
2026-03-27 11:01:48 [auto1.de] INFO: Scrape type for PV77274: 0
2026-03-27 11:01:48 [auto1.de] INFO: Found listing with ID: ZN90500
2026-03-27 11:01:48 [auto1.de] INFO: Found listing with ID: MS75707
2026-03-27 11:01:48 [auto1.de] INFO: Found listing with ID: KW15920
2026-03-27 11:01:48 [auto1.de] INFO: Found listing with ID: SD63291
2026-03-27 11:01:48 [auto1.de] INFO: Found listing with ID: RS33970
2026-03-27 11:01:48 [auto1.de] INFO: Found listing with ID: UK73118
2026-03-27 11:01:48 [auto1.de] INFO: Found listing with ID: FF69632
2026-03-27 11:01:48 [auto1.de] INFO: Found listing with ID: YC14976
2026-03-27 11:01:48 [auto1.de] INFO: Found listing with ID: FC26071
2026-03-27 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC26071%27 HTTP/1.1" 200 None
2026-03-27 11:01:48 [auto1.de] INFO: Scrape type for FC26071: 0
2026-03-27 11:01:48 [auto1.de] INFO: Found listing with ID: GB77683
2026-03-27 11:01:48 [auto1.de] INFO: Found listing with ID: RL83760
2026-03-27 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83760%27 HTTP/1.1" 200 None
2026-03-27 11:01:48 [auto1.de] INFO: Scrape type for RL83760: 0
2026-03-27 11:01:48 [auto1.de] INFO: Found listing with ID: GR80371
2026-03-27 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR80371%27 HTTP/1.1" 200 None
2026-03-27 11:01:48 [auto1.de] INFO: Scrape type for GR80371: 0
2026-03-27 11:01:48 [auto1.de] INFO: Found listing with ID: NL27142
2026-03-27 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL27142%27 HTTP/1.1" 200 None
2026-03-27 11:01:48 [auto1.de] INFO: Scrape type for NL27142: 0
2026-03-27 11:01:48 [auto1.de] INFO: Found listing with ID: JA73585
2026-03-27 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA73585%27 HTTP/1.1" 200 None
2026-03-27 11:01:48 [auto1.de] INFO: Scrape type for JA73585: 0
2026-03-27 11:01:48 [auto1.de] INFO: Found listing with ID: EN74445
2026-03-27 11:01:48 [auto1.de] INFO: Found listing with ID: NB20811
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB20811%27 HTTP/1.1" 200 None
2026-03-27 11:01:49 [auto1.de] INFO: Scrape type for NB20811: 0
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: UN54145
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: HN36676
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: AG29735
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: ZD70727
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD70727%27 HTTP/1.1" 200 None
2026-03-27 11:01:49 [auto1.de] INFO: Scrape type for ZD70727: 0
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: NP45108
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP45108%27 HTTP/1.1" 200 None
2026-03-27 11:01:49 [auto1.de] INFO: Scrape type for NP45108: 0
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: CK85070
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK85070%27 HTTP/1.1" 200 None
2026-03-27 11:01:49 [auto1.de] INFO: Scrape type for CK85070: 0
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: HJ32930
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ32930%27 HTTP/1.1" 200 None
2026-03-27 11:01:49 [auto1.de] INFO: Scrape type for HJ32930: 0
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: XZ81913
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ81913%27 HTTP/1.1" 200 None
2026-03-27 11:01:49 [auto1.de] INFO: Scrape type for XZ81913: 0
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: KP69989
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP69989%27 HTTP/1.1" 200 None
2026-03-27 11:01:49 [auto1.de] INFO: Scrape type for KP69989: 0
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: TZ80807
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ80807%27 HTTP/1.1" 200 None
2026-03-27 11:01:49 [auto1.de] INFO: Scrape type for TZ80807: 0
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: RP79869
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: UF34296
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF34296%27 HTTP/1.1" 200 None
2026-03-27 11:01:49 [auto1.de] INFO: Scrape type for UF34296: 0
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: SR10535
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR10535%27 HTTP/1.1" 200 None
2026-03-27 11:01:49 [auto1.de] INFO: Scrape type for SR10535: 0
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: HE96850
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE96850%27 HTTP/1.1" 200 None
2026-03-27 11:01:49 [auto1.de] INFO: Scrape type for HE96850: 0
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: YR10762
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR10762%27 HTTP/1.1" 200 None
2026-03-27 11:01:49 [auto1.de] INFO: Scrape type for YR10762: 0
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: YG01358
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG01358%27 HTTP/1.1" 200 None
2026-03-27 11:01:49 [auto1.de] INFO: Scrape type for YG01358: 0
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: BP69075
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69075%27 HTTP/1.1" 200 None
2026-03-27 11:01:49 [auto1.de] INFO: Scrape type for BP69075: 0
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: MC98570
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC98570%27 HTTP/1.1" 200 None
2026-03-27 11:01:49 [auto1.de] INFO: Scrape type for MC98570: 0
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: MM90300
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM90300%27 HTTP/1.1" 200 None
2026-03-27 11:01:49 [auto1.de] INFO: Scrape type for MM90300: 0
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: WJ52801
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: DE26987
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE26987%27 HTTP/1.1" 200 None
2026-03-27 11:01:49 [auto1.de] INFO: Scrape type for DE26987: 0
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: PY06750
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY06750%27 HTTP/1.1" 200 None
2026-03-27 11:01:49 [auto1.de] INFO: Scrape type for PY06750: 0
2026-03-27 11:01:49 [auto1.de] INFO: Found listing with ID: SV60687
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV60687%27 HTTP/1.1" 200 None
2026-03-27 11:01:49 [auto1.de] INFO: Scrape type for SV60687: 0
2026-03-27 11:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:01:57 [auto1.de] INFO: Channel: 24h | Page: 193 | totalHits: 10632 | hits on page: 40
2026-03-27 11:01:57 [auto1.de] INFO: Found listing with ID: RR52693
2026-03-27 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR52693%27 HTTP/1.1" 200 None
2026-03-27 11:01:57 [auto1.de] INFO: Scrape type for RR52693: 0
2026-03-27 11:01:57 [auto1.de] INFO: Found listing with ID: SR61721
2026-03-27 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR61721%27 HTTP/1.1" 200 None
2026-03-27 11:01:57 [auto1.de] INFO: Scrape type for SR61721: 0
2026-03-27 11:01:57 [auto1.de] INFO: Found listing with ID: GH76140
2026-03-27 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH76140%27 HTTP/1.1" 200 None
2026-03-27 11:01:57 [auto1.de] INFO: Scrape type for GH76140: 0
2026-03-27 11:01:57 [auto1.de] INFO: Found listing with ID: MG05437
2026-03-27 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG05437%27 HTTP/1.1" 200 None
2026-03-27 11:01:57 [auto1.de] INFO: Scrape type for MG05437: 0
2026-03-27 11:01:57 [auto1.de] INFO: Found listing with ID: UF75132
2026-03-27 11:01:57 [auto1.de] INFO: Found listing with ID: FL43423
2026-03-27 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL43423%27 HTTP/1.1" 200 None
2026-03-27 11:01:57 [auto1.de] INFO: Scrape type for FL43423: 0
2026-03-27 11:01:57 [auto1.de] INFO: Found listing with ID: UM11777
2026-03-27 11:01:57 [auto1.de] INFO: Found listing with ID: BZ86716
2026-03-27 11:01:57 [auto1.de] INFO: Found listing with ID: DC29091
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: CM86164
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM86164%27 HTTP/1.1" 200 None
2026-03-27 11:01:58 [auto1.de] INFO: Scrape type for CM86164: 0
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: KL90594
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: MR80726
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: ZP16760
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP16760%27 HTTP/1.1" 200 None
2026-03-27 11:01:58 [auto1.de] INFO: Scrape type for ZP16760: 0
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: XW74930
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW74930%27 HTTP/1.1" 200 None
2026-03-27 11:01:58 [auto1.de] INFO: Scrape type for XW74930: 0
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: AU50389
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: CX65130
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX65130%27 HTTP/1.1" 200 None
2026-03-27 11:01:58 [auto1.de] INFO: Scrape type for CX65130: 0
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: BV77129
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV77129%27 HTTP/1.1" 200 None
2026-03-27 11:01:58 [auto1.de] INFO: Scrape type for BV77129: 0
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: PL32929
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL32929%27 HTTP/1.1" 200 None
2026-03-27 11:01:58 [auto1.de] INFO: Scrape type for PL32929: 0
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: SR95486
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: JZ24373
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ24373%27 HTTP/1.1" 200 None
2026-03-27 11:01:58 [auto1.de] INFO: Scrape type for JZ24373: 0
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: HA05469
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: BT45768
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: VX92858
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: NR32079
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: BD93645
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD93645%27 HTTP/1.1" 200 None
2026-03-27 11:01:58 [auto1.de] INFO: Scrape type for BD93645: 0
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: EC32180
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC32180%27 HTTP/1.1" 200 None
2026-03-27 11:01:58 [auto1.de] INFO: Scrape type for EC32180: 0
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: PJ44956
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: ST83220
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST83220%27 HTTP/1.1" 200 None
2026-03-27 11:01:58 [auto1.de] INFO: Scrape type for ST83220: 0
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: CL63619
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL63619%27 HTTP/1.1" 200 None
2026-03-27 11:01:58 [auto1.de] INFO: Scrape type for CL63619: 0
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: LK88331
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: HV97655
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV97655%27 HTTP/1.1" 200 None
2026-03-27 11:01:58 [auto1.de] INFO: Scrape type for HV97655: 0
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: TB12720
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: XG44569
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: VK78554
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: XA97306
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA97306%27 HTTP/1.1" 200 None
2026-03-27 11:01:58 [auto1.de] INFO: Scrape type for XA97306: 0
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: EK64818
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: AA06623
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA06623%27 HTTP/1.1" 200 None
2026-03-27 11:01:58 [auto1.de] INFO: Scrape type for AA06623: 0
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: VH77908
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH77908%27 HTTP/1.1" 200 None
2026-03-27 11:01:58 [auto1.de] INFO: Scrape type for VH77908: 0
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: NG38920
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG38920%27 HTTP/1.1" 200 None
2026-03-27 11:01:58 [auto1.de] INFO: Scrape type for NG38920: 0
2026-03-27 11:01:58 [auto1.de] INFO: Found listing with ID: AX63310
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX63310%27 HTTP/1.1" 200 None
2026-03-27 11:01:58 [auto1.de] INFO: Scrape type for AX63310: 0
2026-03-27 11:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:02:05 [auto1.de] INFO: Channel: 24h | Page: 194 | totalHits: 10631 | hits on page: 40
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: JY91311
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: VS12644
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: JY40414
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY40414%27 HTTP/1.1" 200 None
2026-03-27 11:02:05 [auto1.de] INFO: Scrape type for JY40414: 0
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: PM89696
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: US93398
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: RX07896
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: YE29000
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE29000%27 HTTP/1.1" 200 None
2026-03-27 11:02:05 [auto1.de] INFO: Scrape type for YE29000: 0
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: GZ46196
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ46196%27 HTTP/1.1" 200 None
2026-03-27 11:02:05 [auto1.de] INFO: Scrape type for GZ46196: 0
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: AS70680
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS70680%27 HTTP/1.1" 200 None
2026-03-27 11:02:05 [auto1.de] INFO: Scrape type for AS70680: 0
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: GX01989
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: TJ90592
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: KN90743
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN90743%27 HTTP/1.1" 200 None
2026-03-27 11:02:05 [auto1.de] INFO: Scrape type for KN90743: 0
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: VN24673
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: NU53106
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU53106%27 HTTP/1.1" 200 None
2026-03-27 11:02:05 [auto1.de] INFO: Scrape type for NU53106: 0
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: RM91466
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM91466%27 HTTP/1.1" 200 None
2026-03-27 11:02:05 [auto1.de] INFO: Scrape type for RM91466: 0
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: CP72119
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP72119%27 HTTP/1.1" 200 None
2026-03-27 11:02:05 [auto1.de] INFO: Scrape type for CP72119: 0
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: WU88616
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: TB77068
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77068%27 HTTP/1.1" 200 None
2026-03-27 11:02:05 [auto1.de] INFO: Scrape type for TB77068: 0
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: AB47970
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB47970%27 HTTP/1.1" 200 None
2026-03-27 11:02:05 [auto1.de] INFO: Scrape type for AB47970: 0
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: KR09634
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: ZK43846
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK43846%27 HTTP/1.1" 200 None
2026-03-27 11:02:05 [auto1.de] INFO: Scrape type for ZK43846: 0
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: SJ20316
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: BG75662
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: MM23632
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM23632%27 HTTP/1.1" 200 None
2026-03-27 11:02:05 [auto1.de] INFO: Scrape type for MM23632: 0
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: FN39592
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: FK91435
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK91435%27 HTTP/1.1" 200 None
2026-03-27 11:02:05 [auto1.de] INFO: Scrape type for FK91435: 0
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: MU98334
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU98334%27 HTTP/1.1" 200 None
2026-03-27 11:02:05 [auto1.de] INFO: Scrape type for MU98334: 0
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: VL17014
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL17014%27 HTTP/1.1" 200 None
2026-03-27 11:02:05 [auto1.de] INFO: Scrape type for VL17014: 0
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: CY38235
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY38235%27 HTTP/1.1" 200 None
2026-03-27 11:02:05 [auto1.de] INFO: Scrape type for CY38235: 0
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: AT70381
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: XP10610
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: BT01955
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: DK04977
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK04977%27 HTTP/1.1" 200 None
2026-03-27 11:02:05 [auto1.de] INFO: Scrape type for DK04977: 0
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: TC11564
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC11564%27 HTTP/1.1" 200 None
2026-03-27 11:02:05 [auto1.de] INFO: Scrape type for TC11564: 0
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: GS28506
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS28506%27 HTTP/1.1" 200 None
2026-03-27 11:02:05 [auto1.de] INFO: Scrape type for GS28506: 0
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: MC88386
2026-03-27 11:02:05 [auto1.de] INFO: Found listing with ID: FY49152
2026-03-27 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY49152%27 HTTP/1.1" 200 None
2026-03-27 11:02:06 [auto1.de] INFO: Scrape type for FY49152: 0
2026-03-27 11:02:06 [auto1.de] INFO: Found listing with ID: RA16868
2026-03-27 11:02:06 [auto1.de] INFO: Found listing with ID: FN44778
2026-03-27 11:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN44778%27 HTTP/1.1" 200 None
2026-03-27 11:02:06 [auto1.de] INFO: Scrape type for FN44778: 0
2026-03-27 11:02:06 [auto1.de] INFO: Found listing with ID: WL05450
2026-03-27 11:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL05450%27 HTTP/1.1" 200 None
2026-03-27 11:02:06 [auto1.de] INFO: Scrape type for WL05450: 0
2026-03-27 11:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:02:06 [scrapy.extensions.logstats] INFO: Crawled 662 pages (at 9 pages/min), scraped 923 items (at 0 items/min)
2026-03-27 11:02:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 11:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:02:13 [auto1.de] INFO: Channel: 24h | Page: 195 | totalHits: 10632 | hits on page: 40
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: WL05450
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL05450%27 HTTP/1.1" 200 None
2026-03-27 11:02:13 [auto1.de] INFO: Scrape type for WL05450: 0
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: EH18862
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH18862%27 HTTP/1.1" 200 None
2026-03-27 11:02:13 [auto1.de] INFO: Scrape type for EH18862: 0
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: SN44639
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN44639%27 HTTP/1.1" 200 None
2026-03-27 11:02:13 [auto1.de] INFO: Scrape type for SN44639: 0
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: ND21540
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND21540%27 HTTP/1.1" 200 None
2026-03-27 11:02:13 [auto1.de] INFO: Scrape type for ND21540: 0
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: LL89854
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: MK17159
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK17159%27 HTTP/1.1" 200 None
2026-03-27 11:02:13 [auto1.de] INFO: Scrape type for MK17159: 0
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: YL97575
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL97575%27 HTTP/1.1" 200 None
2026-03-27 11:02:13 [auto1.de] INFO: Scrape type for YL97575: 0
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: LT66855
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: NN38275
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN38275%27 HTTP/1.1" 200 None
2026-03-27 11:02:13 [auto1.de] INFO: Scrape type for NN38275: 0
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: YY28526
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY28526%27 HTTP/1.1" 200 None
2026-03-27 11:02:13 [auto1.de] INFO: Scrape type for YY28526: 0
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: GS13951
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: WW67061
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: CU38704
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: KJ70545
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ70545%27 HTTP/1.1" 200 None
2026-03-27 11:02:13 [auto1.de] INFO: Scrape type for KJ70545: 0
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: MJ54532
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: EM69588
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: XS94242
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: WX96485
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX96485%27 HTTP/1.1" 200 None
2026-03-27 11:02:13 [auto1.de] INFO: Scrape type for WX96485: 0
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: ZA27483
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: VD21110
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: LS63557
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS63557%27 HTTP/1.1" 200 None
2026-03-27 11:02:13 [auto1.de] INFO: Scrape type for LS63557: 0
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: XD67280
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: VP25864
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: HB52162
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: NB52001
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: SN79530
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: VD40294
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD40294%27 HTTP/1.1" 200 None
2026-03-27 11:02:13 [auto1.de] INFO: Scrape type for VD40294: 0
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: TB70799
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: PL40872
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: BM59430
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: XE08723
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: RA38840
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: BL55103
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL55103%27 HTTP/1.1" 200 None
2026-03-27 11:02:13 [auto1.de] INFO: Scrape type for BL55103: 0
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: KY24056
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: JK14067
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK14067%27 HTTP/1.1" 200 None
2026-03-27 11:02:13 [auto1.de] INFO: Scrape type for JK14067: 0
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: PT25597
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: BY81957
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: TW01944
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: KG40513
2026-03-27 11:02:13 [auto1.de] INFO: Found listing with ID: BN74180
2026-03-27 11:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:02:33 [auto1.de] INFO: Channel: 24h | Page: 196 | totalHits: 10634 | hits on page: 40
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: KG40513
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: BN74180
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: VV35069
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV35069%27 HTTP/1.1" 200 None
2026-03-27 11:02:33 [auto1.de] INFO: Scrape type for VV35069: 0
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: UN46702
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: LW41403
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: YR24336
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: KW13309
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW13309%27 HTTP/1.1" 200 None
2026-03-27 11:02:33 [auto1.de] INFO: Scrape type for KW13309: 0
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: TB49409
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB49409%27 HTTP/1.1" 200 None
2026-03-27 11:02:33 [auto1.de] INFO: Scrape type for TB49409: 0
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: DB08314
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: YZ16330
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: BM82137
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: ZB55107
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: XD38705
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: ZE88677
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE88677%27 HTTP/1.1" 200 None
2026-03-27 11:02:33 [auto1.de] INFO: Scrape type for ZE88677: 0
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: BD67330
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD67330%27 HTTP/1.1" 200 None
2026-03-27 11:02:33 [auto1.de] INFO: Scrape type for BD67330: 0
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: GK53684
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK53684%27 HTTP/1.1" 200 None
2026-03-27 11:02:33 [auto1.de] INFO: Scrape type for GK53684: 0
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: VD04186
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD04186%27 HTTP/1.1" 200 None
2026-03-27 11:02:33 [auto1.de] INFO: Scrape type for VD04186: 0
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: FS26250
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: TV09654
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: CA32038
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA32038%27 HTTP/1.1" 200 None
2026-03-27 11:02:33 [auto1.de] INFO: Scrape type for CA32038: 0
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: JH74996
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH74996%27 HTTP/1.1" 200 None
2026-03-27 11:02:33 [auto1.de] INFO: Scrape type for JH74996: 0
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: YD85923
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD85923%27 HTTP/1.1" 200 None
2026-03-27 11:02:33 [auto1.de] INFO: Scrape type for YD85923: 0
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: AA14867
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA14867%27 HTTP/1.1" 200 None
2026-03-27 11:02:33 [auto1.de] INFO: Scrape type for AA14867: 0
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: ET16564
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET16564%27 HTTP/1.1" 200 None
2026-03-27 11:02:33 [auto1.de] INFO: Scrape type for ET16564: 0
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: PM22315
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM22315%27 HTTP/1.1" 200 None
2026-03-27 11:02:33 [auto1.de] INFO: Scrape type for PM22315: 0
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: EH63177
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: FG67469
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: CY85484
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: GN33586
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN33586%27 HTTP/1.1" 200 None
2026-03-27 11:02:33 [auto1.de] INFO: Scrape type for GN33586: 0
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: LP71113
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP71113%27 HTTP/1.1" 200 None
2026-03-27 11:02:33 [auto1.de] INFO: Scrape type for LP71113: 0
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: YU55908
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU55908%27 HTTP/1.1" 200 None
2026-03-27 11:02:33 [auto1.de] INFO: Scrape type for YU55908: 0
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: XJ67603
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ67603%27 HTTP/1.1" 200 None
2026-03-27 11:02:33 [auto1.de] INFO: Scrape type for XJ67603: 0
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: BW42042
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: HH19499
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: YF03838
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF03838%27 HTTP/1.1" 200 None
2026-03-27 11:02:33 [auto1.de] INFO: Scrape type for YF03838: 0
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: ZY10708
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY10708%27 HTTP/1.1" 200 None
2026-03-27 11:02:33 [auto1.de] INFO: Scrape type for ZY10708: 0
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: DP06637
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: TA19435
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA19435%27 HTTP/1.1" 200 None
2026-03-27 11:02:33 [auto1.de] INFO: Scrape type for TA19435: 0
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: UG07575
2026-03-27 11:02:33 [auto1.de] INFO: Found listing with ID: NH85553
2026-03-27 11:02:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:02:37 [auto1.de] INFO: Channel: 24h | Page: 197 | totalHits: 10635 | hits on page: 40
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: NH85553
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: DE81571
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: PP74274
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: HM39692
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: TS58854
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS58854%27 HTTP/1.1" 200 None
2026-03-27 11:02:37 [auto1.de] INFO: Scrape type for TS58854: 0
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: NB45684
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB45684%27 HTTP/1.1" 200 None
2026-03-27 11:02:37 [auto1.de] INFO: Scrape type for NB45684: 0
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: CR70620
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: SU99742
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: TU72063
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: LL51230
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: EU26057
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: SN44411
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: HS56218
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS56218%27 HTTP/1.1" 200 None
2026-03-27 11:02:37 [auto1.de] INFO: Scrape type for HS56218: 0
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: JB14311
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB14311%27 HTTP/1.1" 200 None
2026-03-27 11:02:37 [auto1.de] INFO: Scrape type for JB14311: 0
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: MD96155
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD96155%27 HTTP/1.1" 200 None
2026-03-27 11:02:37 [auto1.de] INFO: Scrape type for MD96155: 0
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: WV90904
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV90904%27 HTTP/1.1" 200 None
2026-03-27 11:02:37 [auto1.de] INFO: Scrape type for WV90904: 0
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: JW57776
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: PT89331
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: LH85923
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: YM44270
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: NV52830
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV52830%27 HTTP/1.1" 200 None
2026-03-27 11:02:37 [auto1.de] INFO: Scrape type for NV52830: 0
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: NU43948
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU43948%27 HTTP/1.1" 200 None
2026-03-27 11:02:37 [auto1.de] INFO: Scrape type for NU43948: 0
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: RH18539
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH18539%27 HTTP/1.1" 200 None
2026-03-27 11:02:37 [auto1.de] INFO: Scrape type for RH18539: 0
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: GT35568
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: SC61449
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC61449%27 HTTP/1.1" 200 None
2026-03-27 11:02:37 [auto1.de] INFO: Scrape type for SC61449: 0
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: PY24938
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY24938%27 HTTP/1.1" 200 None
2026-03-27 11:02:37 [auto1.de] INFO: Scrape type for PY24938: 0
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: SV20830
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV20830%27 HTTP/1.1" 200 None
2026-03-27 11:02:37 [auto1.de] INFO: Scrape type for SV20830: 0
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: GP13655
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP13655%27 HTTP/1.1" 200 None
2026-03-27 11:02:37 [auto1.de] INFO: Scrape type for GP13655: 0
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: YW90897
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: ZP70733
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP70733%27 HTTP/1.1" 200 None
2026-03-27 11:02:37 [auto1.de] INFO: Scrape type for ZP70733: 0
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: YB78505
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: YF28204
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: JE17761
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: TE29982
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: CA17412
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA17412%27 HTTP/1.1" 200 None
2026-03-27 11:02:37 [auto1.de] INFO: Scrape type for CA17412: 0
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: EX66684
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: HN56943
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: BU85183
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: NC97946
2026-03-27 11:02:37 [auto1.de] INFO: Found listing with ID: YN77688
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN77688%27 HTTP/1.1" 200 None
2026-03-27 11:02:37 [auto1.de] INFO: Scrape type for YN77688: 0
2026-03-27 11:02:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:02:44 [auto1.de] INFO: Channel: 24h | Page: 198 | totalHits: 10635 | hits on page: 40
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: DE01502
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE01502%27 HTTP/1.1" 200 None
2026-03-27 11:02:44 [auto1.de] INFO: Scrape type for DE01502: 0
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: HE01439
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE01439%27 HTTP/1.1" 200 None
2026-03-27 11:02:44 [auto1.de] INFO: Scrape type for HE01439: 0
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: XZ40244
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: AU40494
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU40494%27 HTTP/1.1" 200 None
2026-03-27 11:02:44 [auto1.de] INFO: Scrape type for AU40494: 0
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: SF16440
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF16440%27 HTTP/1.1" 200 None
2026-03-27 11:02:44 [auto1.de] INFO: Scrape type for SF16440: 0
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: YX75704
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: AX39550
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: TW37614
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW37614%27 HTTP/1.1" 200 None
2026-03-27 11:02:44 [auto1.de] INFO: Scrape type for TW37614: 0
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: YZ49430
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: WK26503
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK26503%27 HTTP/1.1" 200 None
2026-03-27 11:02:44 [auto1.de] INFO: Scrape type for WK26503: 0
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: AL84266
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: YX99535
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX99535%27 HTTP/1.1" 200 None
2026-03-27 11:02:44 [auto1.de] INFO: Scrape type for YX99535: 0
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: SY67219
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: EX17549
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX17549%27 HTTP/1.1" 200 None
2026-03-27 11:02:44 [auto1.de] INFO: Scrape type for EX17549: 0
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: EL84503
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL84503%27 HTTP/1.1" 200 None
2026-03-27 11:02:44 [auto1.de] INFO: Scrape type for EL84503: 0
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: MR73500
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: EZ95126
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: RS88034
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS88034%27 HTTP/1.1" 200 None
2026-03-27 11:02:44 [auto1.de] INFO: Scrape type for RS88034: 0
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: DP96173
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: WE06039
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE06039%27 HTTP/1.1" 200 None
2026-03-27 11:02:44 [auto1.de] INFO: Scrape type for WE06039: 0
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: FF76246
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF76246%27 HTTP/1.1" 200 None
2026-03-27 11:02:44 [auto1.de] INFO: Scrape type for FF76246: 0
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: RN31650
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN31650%27 HTTP/1.1" 200 None
2026-03-27 11:02:44 [auto1.de] INFO: Scrape type for RN31650: 0
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: NE53248
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE53248%27 HTTP/1.1" 200 None
2026-03-27 11:02:44 [auto1.de] INFO: Scrape type for NE53248: 0
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: UV78939
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV78939%27 HTTP/1.1" 200 None
2026-03-27 11:02:44 [auto1.de] INFO: Scrape type for UV78939: 0
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: VZ13691
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: TN91759
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN91759%27 HTTP/1.1" 200 None
2026-03-27 11:02:44 [auto1.de] INFO: Scrape type for TN91759: 0
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: ER95455
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: FR18905
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR18905%27 HTTP/1.1" 200 None
2026-03-27 11:02:44 [auto1.de] INFO: Scrape type for FR18905: 0
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: YX07118
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX07118%27 HTTP/1.1" 200 None
2026-03-27 11:02:44 [auto1.de] INFO: Scrape type for YX07118: 0
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: ES97956
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES97956%27 HTTP/1.1" 200 None
2026-03-27 11:02:44 [auto1.de] INFO: Scrape type for ES97956: 0
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: SV01996
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: AF95202
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF95202%27 HTTP/1.1" 200 None
2026-03-27 11:02:44 [auto1.de] INFO: Scrape type for AF95202: 0
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: JW35262
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: NJ51378
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: GG42373
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG42373%27 HTTP/1.1" 200 None
2026-03-27 11:02:44 [auto1.de] INFO: Scrape type for GG42373: 0
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: LX56969
2026-03-27 11:02:44 [auto1.de] INFO: Found listing with ID: AD96227
2026-03-27 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD96227%27 HTTP/1.1" 200 None
2026-03-27 11:02:45 [auto1.de] INFO: Scrape type for AD96227: 0
2026-03-27 11:02:45 [auto1.de] INFO: Found listing with ID: PJ99813
2026-03-27 11:02:45 [auto1.de] INFO: Found listing with ID: LN64409
2026-03-27 11:02:45 [auto1.de] INFO: Found listing with ID: XB25676
2026-03-27 11:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:02:46 [auto1.de] INFO: Channel: 24h | Page: 199 | totalHits: 10635 | hits on page: 40
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: LR15372
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR15372%27 HTTP/1.1" 200 None
2026-03-27 11:02:46 [auto1.de] INFO: Scrape type for LR15372: 0
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: BA22494
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: XY86775
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY86775%27 HTTP/1.1" 200 None
2026-03-27 11:02:46 [auto1.de] INFO: Scrape type for XY86775: 0
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: BD68188
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD68188%27 HTTP/1.1" 200 None
2026-03-27 11:02:46 [auto1.de] INFO: Scrape type for BD68188: 0
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: KD55944
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: SV31103
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV31103%27 HTTP/1.1" 200 None
2026-03-27 11:02:46 [auto1.de] INFO: Scrape type for SV31103: 0
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: VV30036
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV30036%27 HTTP/1.1" 200 None
2026-03-27 11:02:46 [auto1.de] INFO: Scrape type for VV30036: 0
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: MN27803
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: EE17704
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: DX80175
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX80175%27 HTTP/1.1" 200 None
2026-03-27 11:02:46 [auto1.de] INFO: Scrape type for DX80175: 0
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: PG03676
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG03676%27 HTTP/1.1" 200 None
2026-03-27 11:02:46 [auto1.de] INFO: Scrape type for PG03676: 0
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: RC66900
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: XY93824
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY93824%27 HTTP/1.1" 200 None
2026-03-27 11:02:46 [auto1.de] INFO: Scrape type for XY93824: 0
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: MG41395
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: YM43542
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: ML01483
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML01483%27 HTTP/1.1" 200 None
2026-03-27 11:02:46 [auto1.de] INFO: Scrape type for ML01483: 0
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: NA28403
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: JZ38471
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ38471%27 HTTP/1.1" 200 None
2026-03-27 11:02:46 [auto1.de] INFO: Scrape type for JZ38471: 0
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: SW12858
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW12858%27 HTTP/1.1" 200 None
2026-03-27 11:02:46 [auto1.de] INFO: Scrape type for SW12858: 0
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: JC50514
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC50514%27 HTTP/1.1" 200 None
2026-03-27 11:02:46 [auto1.de] INFO: Scrape type for JC50514: 0
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: PS97494
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: XK54079
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: FU89113
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU89113%27 HTTP/1.1" 200 None
2026-03-27 11:02:46 [auto1.de] INFO: Scrape type for FU89113: 0
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: PE53774
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: SB63161
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB63161%27 HTTP/1.1" 200 None
2026-03-27 11:02:46 [auto1.de] INFO: Scrape type for SB63161: 0
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: PG50527
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: HA87343
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA87343%27 HTTP/1.1" 200 None
2026-03-27 11:02:46 [auto1.de] INFO: Scrape type for HA87343: 0
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: WL72943
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL72943%27 HTTP/1.1" 200 None
2026-03-27 11:02:46 [auto1.de] INFO: Scrape type for WL72943: 0
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: YF21110
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: HH19883
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH19883%27 HTTP/1.1" 200 None
2026-03-27 11:02:46 [auto1.de] INFO: Scrape type for HH19883: 0
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: PP77460
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: FE61251
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE61251%27 HTTP/1.1" 200 None
2026-03-27 11:02:46 [auto1.de] INFO: Scrape type for FE61251: 0
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: ZL05657
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL05657%27 HTTP/1.1" 200 None
2026-03-27 11:02:46 [auto1.de] INFO: Scrape type for ZL05657: 0
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: KK79035
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: DC12815
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: SC96558
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: YW33550
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: LL76709
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: VG40038
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG40038%27 HTTP/1.1" 200 None
2026-03-27 11:02:46 [auto1.de] INFO: Scrape type for VG40038: 0
2026-03-27 11:02:46 [auto1.de] INFO: Found listing with ID: AB72928
2026-03-27 11:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:03:06 [scrapy.extensions.logstats] INFO: Crawled 667 pages (at 5 pages/min), scraped 923 items (at 0 items/min)
2026-03-27 11:03:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 11:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:03:56 [auto1.de] INFO: Channel: 24h | Page: 200 | totalHits: 10638 | hits on page: 40
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: LL76709
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: VG40038
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG40038%27 HTTP/1.1" 200 None
2026-03-27 11:03:56 [auto1.de] INFO: Scrape type for VG40038: 0
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: AB72928
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: KM60144
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM60144%27 HTTP/1.1" 200 None
2026-03-27 11:03:56 [auto1.de] INFO: Scrape type for KM60144: 0
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: TN72862
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: JR14351
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: RV21792
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV21792%27 HTTP/1.1" 200 None
2026-03-27 11:03:56 [auto1.de] INFO: Scrape type for RV21792: 0
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: XZ94728
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: KN25796
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN25796%27 HTTP/1.1" 200 None
2026-03-27 11:03:56 [auto1.de] INFO: Scrape type for KN25796: 0
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: PN35416
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN35416%27 HTTP/1.1" 200 None
2026-03-27 11:03:56 [auto1.de] INFO: Scrape type for PN35416: 0
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: UW13006
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW13006%27 HTTP/1.1" 200 None
2026-03-27 11:03:56 [auto1.de] INFO: Scrape type for UW13006: 0
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: WK49951
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: AB43165
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB43165%27 HTTP/1.1" 200 None
2026-03-27 11:03:56 [auto1.de] INFO: Scrape type for AB43165: 0
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: ST69509
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: HC26014
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC26014%27 HTTP/1.1" 200 None
2026-03-27 11:03:56 [auto1.de] INFO: Scrape type for HC26014: 0
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: VW17844
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: NA64252
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: GM71175
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: HR80015
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: LG85370
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: NG43568
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG43568%27 HTTP/1.1" 200 None
2026-03-27 11:03:56 [auto1.de] INFO: Scrape type for NG43568: 0
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: WG22836
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: XL79428
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL79428%27 HTTP/1.1" 200 None
2026-03-27 11:03:56 [auto1.de] INFO: Scrape type for XL79428: 0
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: EY91540
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY91540%27 HTTP/1.1" 200 None
2026-03-27 11:03:56 [auto1.de] INFO: Scrape type for EY91540: 0
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: WX41278
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: HA10005
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10005%27 HTTP/1.1" 200 None
2026-03-27 11:03:56 [auto1.de] INFO: Scrape type for HA10005: 0
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: JT31965
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT31965%27 HTTP/1.1" 200 None
2026-03-27 11:03:56 [auto1.de] INFO: Scrape type for JT31965: 0
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: HG95875
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: MP03054
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: KL53508
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: HT99711
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: GK28000
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: XL83560
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: ZS08498
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: NB42822
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB42822%27 HTTP/1.1" 200 None
2026-03-27 11:03:56 [auto1.de] INFO: Scrape type for NB42822: 0
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: UG24074
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: RS57815
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: NF19506
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: VW68690
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW68690%27 HTTP/1.1" 200 None
2026-03-27 11:03:56 [auto1.de] INFO: Scrape type for VW68690: 0
2026-03-27 11:03:56 [auto1.de] INFO: Found listing with ID: HE28168
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE28168%27 HTTP/1.1" 200 None
2026-03-27 11:03:56 [auto1.de] INFO: Scrape type for HE28168: 0
2026-03-27 11:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:03:57 [auto1.de] INFO: Channel: 24h | Page: 201 | totalHits: 10638 | hits on page: 40
2026-03-27 11:03:57 [auto1.de] INFO: Found listing with ID: BP97760
2026-03-27 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97760%27 HTTP/1.1" 200 None
2026-03-27 11:03:57 [auto1.de] INFO: Scrape type for BP97760: 0
2026-03-27 11:03:57 [auto1.de] INFO: Found listing with ID: UH36573
2026-03-27 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH36573%27 HTTP/1.1" 200 None
2026-03-27 11:03:57 [auto1.de] INFO: Scrape type for UH36573: 0
2026-03-27 11:03:57 [auto1.de] INFO: Found listing with ID: DM11182
2026-03-27 11:03:57 [auto1.de] INFO: Found listing with ID: FH74417
2026-03-27 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH74417%27 HTTP/1.1" 200 None
2026-03-27 11:03:58 [auto1.de] INFO: Scrape type for FH74417: 0
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: UL96706
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL96706%27 HTTP/1.1" 200 None
2026-03-27 11:03:58 [auto1.de] INFO: Scrape type for UL96706: 0
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: KN84126
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN84126%27 HTTP/1.1" 200 None
2026-03-27 11:03:58 [auto1.de] INFO: Scrape type for KN84126: 0
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: FL64755
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: MG09595
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG09595%27 HTTP/1.1" 200 None
2026-03-27 11:03:58 [auto1.de] INFO: Scrape type for MG09595: 0
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: BF38543
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: WC33817
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC33817%27 HTTP/1.1" 200 None
2026-03-27 11:03:58 [auto1.de] INFO: Scrape type for WC33817: 0
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: EM51900
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: TP52522
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: UT02033
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT02033%27 HTTP/1.1" 200 None
2026-03-27 11:03:58 [auto1.de] INFO: Scrape type for UT02033: 0
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: NN18450
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN18450%27 HTTP/1.1" 200 None
2026-03-27 11:03:58 [auto1.de] INFO: Scrape type for NN18450: 0
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: XV33343
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV33343%27 HTTP/1.1" 200 None
2026-03-27 11:03:58 [auto1.de] INFO: Scrape type for XV33343: 0
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: CS58142
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS58142%27 HTTP/1.1" 200 None
2026-03-27 11:03:58 [auto1.de] INFO: Scrape type for CS58142: 0
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: NC19407
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC19407%27 HTTP/1.1" 200 None
2026-03-27 11:03:58 [auto1.de] INFO: Scrape type for NC19407: 0
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: TB93098
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: JM99394
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM99394%27 HTTP/1.1" 200 None
2026-03-27 11:03:58 [auto1.de] INFO: Scrape type for JM99394: 0
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: TF07187
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF07187%27 HTTP/1.1" 200 None
2026-03-27 11:03:58 [auto1.de] INFO: Scrape type for TF07187: 0
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: RC36772
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC36772%27 HTTP/1.1" 200 None
2026-03-27 11:03:58 [auto1.de] INFO: Scrape type for RC36772: 0
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: AK74682
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK74682%27 HTTP/1.1" 200 None
2026-03-27 11:03:58 [auto1.de] INFO: Scrape type for AK74682: 0
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: SH46340
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH46340%27 HTTP/1.1" 200 None
2026-03-27 11:03:58 [auto1.de] INFO: Scrape type for SH46340: 0
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: ZZ78746
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: ZH40630
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH40630%27 HTTP/1.1" 200 None
2026-03-27 11:03:58 [auto1.de] INFO: Scrape type for ZH40630: 0
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: UN73859
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: XK03599
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK03599%27 HTTP/1.1" 200 None
2026-03-27 11:03:58 [auto1.de] INFO: Scrape type for XK03599: 0
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: GW79394
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: EH94652
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH94652%27 HTTP/1.1" 200 None
2026-03-27 11:03:58 [auto1.de] INFO: Scrape type for EH94652: 0
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: DE87982
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: WE35343
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE35343%27 HTTP/1.1" 200 None
2026-03-27 11:03:58 [auto1.de] INFO: Scrape type for WE35343: 0
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: NZ77282
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: WF38446
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF38446%27 HTTP/1.1" 200 None
2026-03-27 11:03:58 [auto1.de] INFO: Scrape type for WF38446: 0
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: CN12486
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN12486%27 HTTP/1.1" 200 None
2026-03-27 11:03:58 [auto1.de] INFO: Scrape type for CN12486: 0
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: YW93310
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: VB08004
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: KX20703
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: XM39745
2026-03-27 11:03:58 [auto1.de] INFO: Found listing with ID: VJ88361
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ88361%27 HTTP/1.1" 200 None
2026-03-27 11:03:59 [auto1.de] INFO: Scrape type for VJ88361: 0
2026-03-27 11:03:59 [auto1.de] INFO: Found listing with ID: YG39629
2026-03-27 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG39629%27 HTTP/1.1" 200 None
2026-03-27 11:03:59 [auto1.de] INFO: Scrape type for YG39629: 0
2026-03-27 11:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:04:00 [auto1.de] INFO: Channel: 24h | Page: 202 | totalHits: 10638 | hits on page: 40
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: XW84981
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: TW33194
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: WJ67809
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ67809%27 HTTP/1.1" 200 None
2026-03-27 11:04:00 [auto1.de] INFO: Scrape type for WJ67809: 0
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: EB56792
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: NP66280
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP66280%27 HTTP/1.1" 200 None
2026-03-27 11:04:00 [auto1.de] INFO: Scrape type for NP66280: 0
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: RR75332
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: YY88868
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: PP52224
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: WN45698
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: JC72122
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC72122%27 HTTP/1.1" 200 None
2026-03-27 11:04:00 [auto1.de] INFO: Scrape type for JC72122: 0
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: HP19661
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: NV69214
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV69214%27 HTTP/1.1" 200 None
2026-03-27 11:04:00 [auto1.de] INFO: Scrape type for NV69214: 0
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: EM80925
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM80925%27 HTTP/1.1" 200 None
2026-03-27 11:04:00 [auto1.de] INFO: Scrape type for EM80925: 0
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: AY35093
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: MT42734
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: MA41720
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: JT74267
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: NC80162
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: KN36813
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: XC49831
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC49831%27 HTTP/1.1" 200 None
2026-03-27 11:04:00 [auto1.de] INFO: Scrape type for XC49831: 0
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: DM40706
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: HY69204
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY69204%27 HTTP/1.1" 200 None
2026-03-27 11:04:00 [auto1.de] INFO: Scrape type for HY69204: 0
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: VU22150
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: GE22934
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE22934%27 HTTP/1.1" 200 None
2026-03-27 11:04:00 [auto1.de] INFO: Scrape type for GE22934: 0
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: HE78253
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE78253%27 HTTP/1.1" 200 None
2026-03-27 11:04:00 [auto1.de] INFO: Scrape type for HE78253: 0
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: WY61426
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: YL03004
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL03004%27 HTTP/1.1" 200 None
2026-03-27 11:04:00 [auto1.de] INFO: Scrape type for YL03004: 0
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: ES84050
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: GF90377
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF90377%27 HTTP/1.1" 200 None
2026-03-27 11:04:00 [auto1.de] INFO: Scrape type for GF90377: 0
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: XV56284
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV56284%27 HTTP/1.1" 200 None
2026-03-27 11:04:00 [auto1.de] INFO: Scrape type for XV56284: 0
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: KB12311
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB12311%27 HTTP/1.1" 200 None
2026-03-27 11:04:00 [auto1.de] INFO: Scrape type for KB12311: 0
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: ME09724
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: EJ19003
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: LX71576
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX71576%27 HTTP/1.1" 200 None
2026-03-27 11:04:00 [auto1.de] INFO: Scrape type for LX71576: 0
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: BL60754
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL60754%27 HTTP/1.1" 200 None
2026-03-27 11:04:00 [auto1.de] INFO: Scrape type for BL60754: 0
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: JN09045
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: KC92338
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: KV42803
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV42803%27 HTTP/1.1" 200 None
2026-03-27 11:04:00 [auto1.de] INFO: Scrape type for KV42803: 0
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: RG72110
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG72110%27 HTTP/1.1" 200 None
2026-03-27 11:04:00 [auto1.de] INFO: Scrape type for RG72110: 0
2026-03-27 11:04:00 [auto1.de] INFO: Found listing with ID: AE04688
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE04688%27 HTTP/1.1" 200 None
2026-03-27 11:04:00 [auto1.de] INFO: Scrape type for AE04688: 0
2026-03-27 11:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:04:06 [scrapy.extensions.logstats] INFO: Crawled 670 pages (at 3 pages/min), scraped 923 items (at 0 items/min)
2026-03-27 11:04:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:04:20 [auto1.de] INFO: Channel: 24h | Page: 203 | totalHits: 10640 | hits on page: 40
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: RG72110
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG72110%27 HTTP/1.1" 200 None
2026-03-27 11:04:20 [auto1.de] INFO: Scrape type for RG72110: 0
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: AE04688
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE04688%27 HTTP/1.1" 200 None
2026-03-27 11:04:20 [auto1.de] INFO: Scrape type for AE04688: 0
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: RB35282
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: XE57640
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: ZV89003
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: BN19521
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN19521%27 HTTP/1.1" 200 None
2026-03-27 11:04:20 [auto1.de] INFO: Scrape type for BN19521: 0
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: UD33715
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD33715%27 HTTP/1.1" 200 None
2026-03-27 11:04:20 [auto1.de] INFO: Scrape type for UD33715: 0
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: XP44826
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: JZ94692
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ94692%27 HTTP/1.1" 200 None
2026-03-27 11:04:20 [auto1.de] INFO: Scrape type for JZ94692: 0
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: FY11827
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: RY86630
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: ZB59540
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB59540%27 HTTP/1.1" 200 None
2026-03-27 11:04:20 [auto1.de] INFO: Scrape type for ZB59540: 0
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: TV48059
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: KF39369
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF39369%27 HTTP/1.1" 200 None
2026-03-27 11:04:20 [auto1.de] INFO: Scrape type for KF39369: 0
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: JE61204
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: KF79880
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: SU20971
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: BK88001
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK88001%27 HTTP/1.1" 200 None
2026-03-27 11:04:20 [auto1.de] INFO: Scrape type for BK88001: 0
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: GE15008
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE15008%27 HTTP/1.1" 200 None
2026-03-27 11:04:20 [auto1.de] INFO: Scrape type for GE15008: 0
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: GS82653
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS82653%27 HTTP/1.1" 200 None
2026-03-27 11:04:20 [auto1.de] INFO: Scrape type for GS82653: 0
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: EP63346
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: VH01397
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH01397%27 HTTP/1.1" 200 None
2026-03-27 11:04:20 [auto1.de] INFO: Scrape type for VH01397: 0
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: HS27979
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: BK74807
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: SA16616
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: ZC69246
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: PD61007
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: KZ86116
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ86116%27 HTTP/1.1" 200 None
2026-03-27 11:04:20 [auto1.de] INFO: Scrape type for KZ86116: 0
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: LK11873
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK11873%27 HTTP/1.1" 200 None
2026-03-27 11:04:20 [auto1.de] INFO: Scrape type for LK11873: 0
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: GB96559
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: NG65344
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: BM72985
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: WW86665
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: RS97264
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: RN44116
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: EH84536
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH84536%27 HTTP/1.1" 200 None
2026-03-27 11:04:20 [auto1.de] INFO: Scrape type for EH84536: 0
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: VU91193
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU91193%27 HTTP/1.1" 200 None
2026-03-27 11:04:20 [auto1.de] INFO: Scrape type for VU91193: 0
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: VH02312
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH02312%27 HTTP/1.1" 200 None
2026-03-27 11:04:20 [auto1.de] INFO: Scrape type for VH02312: 0
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: TL92578
2026-03-27 11:04:20 [auto1.de] INFO: Found listing with ID: CL44276
2026-03-27 11:04:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:04:33 [auto1.de] INFO: Channel: 24h | Page: 204 | totalHits: 10641 | hits on page: 40
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: CL44276
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: UT98357
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: VM39350
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: KG68575
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: GG65874
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG65874%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for GG65874: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: EW21707
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW21707%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for EW21707: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: XF08057
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: MA44978
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: WY24415
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: CH48404
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: RD41525
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: LV32365
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV32365%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for LV32365: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: MS41783
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS41783%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for MS41783: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: GP40533
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: CM16402
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: AW84078
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: YZ29676
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ29676%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for YZ29676: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: RV72396
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV72396%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for RV72396: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: DY40129
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY40129%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for DY40129: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: FA89686
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA89686%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for FA89686: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: TY16080
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY16080%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for TY16080: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: LG88683
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG88683%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for LG88683: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: MD96905
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD96905%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for MD96905: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: UR84816
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR84816%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for UR84816: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: YT24397
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT24397%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for YT24397: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: RB63701
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: JE79090
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE79090%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for JE79090: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: ZE22126
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE22126%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for ZE22126: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: MW79047
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: UM55419
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM55419%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for UM55419: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: JR28441
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR28441%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for JR28441: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: UW44965
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW44965%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for UW44965: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: SX16558
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX16558%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for SX16558: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: XC74360
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC74360%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for XC74360: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: HE94758
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE94758%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for HE94758: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: PM99393
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM99393%27 HTTP/1.1" 200 None
2026-03-27 11:04:33 [auto1.de] INFO: Scrape type for PM99393: 0
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: JA88667
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: LR98326
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: UX30776
2026-03-27 11:04:33 [auto1.de] INFO: Found listing with ID: GC30442
2026-03-27 11:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:04:37 [auto1.de] INFO: Channel: 24h | Page: 205 | totalHits: 10641 | hits on page: 40
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: XE32981
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE32981%27 HTTP/1.1" 200 None
2026-03-27 11:04:37 [auto1.de] INFO: Scrape type for XE32981: 0
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: EF70916
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: PW82194
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: AY98929
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: LF01905
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: CP06642
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: CN84106
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: PN56757
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN56757%27 HTTP/1.1" 200 None
2026-03-27 11:04:37 [auto1.de] INFO: Scrape type for PN56757: 0
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: HT62005
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: GR33012
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR33012%27 HTTP/1.1" 200 None
2026-03-27 11:04:37 [auto1.de] INFO: Scrape type for GR33012: 0
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: UX47002
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: KV33048
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV33048%27 HTTP/1.1" 200 None
2026-03-27 11:04:37 [auto1.de] INFO: Scrape type for KV33048: 0
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: VE57105
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE57105%27 HTTP/1.1" 200 None
2026-03-27 11:04:37 [auto1.de] INFO: Scrape type for VE57105: 0
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: AF88464
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: CL40632
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL40632%27 HTTP/1.1" 200 None
2026-03-27 11:04:37 [auto1.de] INFO: Scrape type for CL40632: 0
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: CS13699
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS13699%27 HTTP/1.1" 200 None
2026-03-27 11:04:37 [auto1.de] INFO: Scrape type for CS13699: 0
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: ST45837
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: LG80642
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: CX62190
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: FU27618
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU27618%27 HTTP/1.1" 200 None
2026-03-27 11:04:37 [auto1.de] INFO: Scrape type for FU27618: 0
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: VH62706
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: CS57817
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: MP89368
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP89368%27 HTTP/1.1" 200 None
2026-03-27 11:04:37 [auto1.de] INFO: Scrape type for MP89368: 0
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: HU68423
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU68423%27 HTTP/1.1" 200 None
2026-03-27 11:04:37 [auto1.de] INFO: Scrape type for HU68423: 0
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: RX17782
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX17782%27 HTTP/1.1" 200 None
2026-03-27 11:04:37 [auto1.de] INFO: Scrape type for RX17782: 0
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: JY95314
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY95314%27 HTTP/1.1" 200 None
2026-03-27 11:04:37 [auto1.de] INFO: Scrape type for JY95314: 0
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: BE83152
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE83152%27 HTTP/1.1" 200 None
2026-03-27 11:04:37 [auto1.de] INFO: Scrape type for BE83152: 0
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: SE64605
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: KE01132
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: KW72669
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: HY28462
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: SY31818
2026-03-27 11:04:37 [auto1.de] INFO: Found listing with ID: HP72244
2026-03-27 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP72244%27 HTTP/1.1" 200 None
2026-03-27 11:04:38 [auto1.de] INFO: Scrape type for HP72244: 0
2026-03-27 11:04:38 [auto1.de] INFO: Found listing with ID: EC47952
2026-03-27 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC47952%27 HTTP/1.1" 200 None
2026-03-27 11:04:38 [auto1.de] INFO: Scrape type for EC47952: 0
2026-03-27 11:04:38 [auto1.de] INFO: Found listing with ID: PK72952
2026-03-27 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK72952%27 HTTP/1.1" 200 None
2026-03-27 11:04:38 [auto1.de] INFO: Scrape type for PK72952: 0
2026-03-27 11:04:38 [auto1.de] INFO: Found listing with ID: PP25437
2026-03-27 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP25437%27 HTTP/1.1" 200 None
2026-03-27 11:04:38 [auto1.de] INFO: Scrape type for PP25437: 0
2026-03-27 11:04:38 [auto1.de] INFO: Found listing with ID: NU64349
2026-03-27 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU64349%27 HTTP/1.1" 200 None
2026-03-27 11:04:38 [auto1.de] INFO: Scrape type for NU64349: 0
2026-03-27 11:04:38 [auto1.de] INFO: Found listing with ID: UD63369
2026-03-27 11:04:38 [auto1.de] INFO: Found listing with ID: ED94101
2026-03-27 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED94101%27 HTTP/1.1" 200 None
2026-03-27 11:04:38 [auto1.de] INFO: Scrape type for ED94101: 0
2026-03-27 11:04:38 [auto1.de] INFO: Found listing with ID: LM46602
2026-03-27 11:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:04:39 [auto1.de] INFO: Channel: 24h | Page: 206 | totalHits: 10641 | hits on page: 40
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: TF13079
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: XZ56002
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ56002%27 HTTP/1.1" 200 None
2026-03-27 11:04:39 [auto1.de] INFO: Scrape type for XZ56002: 0
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: WR53064
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: PC60688
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: HT34266
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT34266%27 HTTP/1.1" 200 None
2026-03-27 11:04:39 [auto1.de] INFO: Scrape type for HT34266: 0
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: TK60542
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK60542%27 HTTP/1.1" 200 None
2026-03-27 11:04:39 [auto1.de] INFO: Scrape type for TK60542: 0
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: BM31151
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM31151%27 HTTP/1.1" 200 None
2026-03-27 11:04:39 [auto1.de] INFO: Scrape type for BM31151: 0
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: UU35441
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: XB46016
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: NY15812
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: NM80523
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: FX32627
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: LR95574
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR95574%27 HTTP/1.1" 200 None
2026-03-27 11:04:39 [auto1.de] INFO: Scrape type for LR95574: 0
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: KV45181
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: WH84573
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH84573%27 HTTP/1.1" 200 None
2026-03-27 11:04:39 [auto1.de] INFO: Scrape type for WH84573: 0
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: KM84429
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: ST88871
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST88871%27 HTTP/1.1" 200 None
2026-03-27 11:04:39 [auto1.de] INFO: Scrape type for ST88871: 0
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: UM79372
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM79372%27 HTTP/1.1" 200 None
2026-03-27 11:04:39 [auto1.de] INFO: Scrape type for UM79372: 0
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: JG82135
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: FV65723
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV65723%27 HTTP/1.1" 200 None
2026-03-27 11:04:39 [auto1.de] INFO: Scrape type for FV65723: 0
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: EL53532
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL53532%27 HTTP/1.1" 200 None
2026-03-27 11:04:39 [auto1.de] INFO: Scrape type for EL53532: 0
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: VX41895
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX41895%27 HTTP/1.1" 200 None
2026-03-27 11:04:39 [auto1.de] INFO: Scrape type for VX41895: 0
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: DR68264
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68264%27 HTTP/1.1" 200 None
2026-03-27 11:04:39 [auto1.de] INFO: Scrape type for DR68264: 0
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: PC09309
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: PS82171
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: AG68218
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: AB69673
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB69673%27 HTTP/1.1" 200 None
2026-03-27 11:04:39 [auto1.de] INFO: Scrape type for AB69673: 0
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: HM43288
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM43288%27 HTTP/1.1" 200 None
2026-03-27 11:04:39 [auto1.de] INFO: Scrape type for HM43288: 0
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: RP88862
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: RB75427
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB75427%27 HTTP/1.1" 200 None
2026-03-27 11:04:39 [auto1.de] INFO: Scrape type for RB75427: 0
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: GL23432
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: RH08953
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: PY66131
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: NP30819
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP30819%27 HTTP/1.1" 200 None
2026-03-27 11:04:39 [auto1.de] INFO: Scrape type for NP30819: 0
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: PG96137
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG96137%27 HTTP/1.1" 200 None
2026-03-27 11:04:39 [auto1.de] INFO: Scrape type for PG96137: 0
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: DU69800
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: WV38848
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV38848%27 HTTP/1.1" 200 None
2026-03-27 11:04:39 [auto1.de] INFO: Scrape type for WV38848: 0
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: DK33698
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK33698%27 HTTP/1.1" 200 None
2026-03-27 11:04:39 [auto1.de] INFO: Scrape type for DK33698: 0
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: FH53485
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH53485%27 HTTP/1.1" 200 None
2026-03-27 11:04:39 [auto1.de] INFO: Scrape type for FH53485: 0
2026-03-27 11:04:39 [auto1.de] INFO: Found listing with ID: KM26302
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM26302%27 HTTP/1.1" 200 None
2026-03-27 11:04:39 [auto1.de] INFO: Scrape type for KM26302: 0
2026-03-27 11:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:05:06 [scrapy.extensions.logstats] INFO: Crawled 674 pages (at 4 pages/min), scraped 923 items (at 0 items/min)
2026-03-27 11:05:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 11:06:06 [scrapy.extensions.logstats] INFO: Crawled 674 pages (at 0 pages/min), scraped 923 items (at 0 items/min)
2026-03-27 11:06:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 11:06:49 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.083(s), this was the 1st time calling it.
2026-03-27 11:06:49 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.4141426037610225 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-27 11:06:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-27 11:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:06:56 [auto1.de] INFO: Channel: 24h | Page: 207 | totalHits: 10646 | hits on page: 40
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: DU69800
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: WV38848
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV38848%27 HTTP/1.1" 200 None
2026-03-27 11:06:56 [auto1.de] INFO: Scrape type for WV38848: 0
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: DK33698
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK33698%27 HTTP/1.1" 200 None
2026-03-27 11:06:56 [auto1.de] INFO: Scrape type for DK33698: 0
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: FH53485
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH53485%27 HTTP/1.1" 200 None
2026-03-27 11:06:56 [auto1.de] INFO: Scrape type for FH53485: 0
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: KM26302
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM26302%27 HTTP/1.1" 200 None
2026-03-27 11:06:56 [auto1.de] INFO: Scrape type for KM26302: 0
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: SS79282
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS79282%27 HTTP/1.1" 200 None
2026-03-27 11:06:56 [auto1.de] INFO: Scrape type for SS79282: 0
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: PE27175
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27175%27 HTTP/1.1" 200 None
2026-03-27 11:06:56 [auto1.de] INFO: Scrape type for PE27175: 0
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: RZ04242
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ04242%27 HTTP/1.1" 200 None
2026-03-27 11:06:56 [auto1.de] INFO: Scrape type for RZ04242: 0
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: AA02117
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA02117%27 HTTP/1.1" 200 None
2026-03-27 11:06:56 [auto1.de] INFO: Scrape type for AA02117: 0
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: HM89872
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: TR94323
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: RS41901
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: ZZ95708
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ95708%27 HTTP/1.1" 200 None
2026-03-27 11:06:56 [auto1.de] INFO: Scrape type for ZZ95708: 0
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: PC10688
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: YG26489
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG26489%27 HTTP/1.1" 200 None
2026-03-27 11:06:56 [auto1.de] INFO: Scrape type for YG26489: 0
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: NA39520
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA39520%27 HTTP/1.1" 200 None
2026-03-27 11:06:56 [auto1.de] INFO: Scrape type for NA39520: 0
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: JB80015
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB80015%27 HTTP/1.1" 200 None
2026-03-27 11:06:56 [auto1.de] INFO: Scrape type for JB80015: 0
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: FX27960
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: DW86500
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: VX05177
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: MM39918
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM39918%27 HTTP/1.1" 200 None
2026-03-27 11:06:56 [auto1.de] INFO: Scrape type for MM39918: 0
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: BP89276
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP89276%27 HTTP/1.1" 200 None
2026-03-27 11:06:56 [auto1.de] INFO: Scrape type for BP89276: 0
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: CJ85818
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ85818%27 HTTP/1.1" 200 None
2026-03-27 11:06:56 [auto1.de] INFO: Scrape type for CJ85818: 0
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: VY10701
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: UG05169
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: YB03442
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: PJ98033
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ98033%27 HTTP/1.1" 200 None
2026-03-27 11:06:56 [auto1.de] INFO: Scrape type for PJ98033: 0
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: UR70541
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR70541%27 HTTP/1.1" 200 None
2026-03-27 11:06:56 [auto1.de] INFO: Scrape type for UR70541: 0
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: TE58720
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: HY14352
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY14352%27 HTTP/1.1" 200 None
2026-03-27 11:06:56 [auto1.de] INFO: Scrape type for HY14352: 0
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: FH90697
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: DZ41694
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: UW50438
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW50438%27 HTTP/1.1" 200 None
2026-03-27 11:06:56 [auto1.de] INFO: Scrape type for UW50438: 0
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: NT89780
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT89780%27 HTTP/1.1" 200 None
2026-03-27 11:06:56 [auto1.de] INFO: Scrape type for NT89780: 0
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: GS48470
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS48470%27 HTTP/1.1" 200 None
2026-03-27 11:06:56 [auto1.de] INFO: Scrape type for GS48470: 0
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: YB90197
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: KY42168
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: TB02108
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: VG22194
2026-03-27 11:06:56 [auto1.de] INFO: Found listing with ID: HW22525
2026-03-27 11:06:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:07:06 [scrapy.extensions.logstats] INFO: Crawled 675 pages (at 1 pages/min), scraped 923 items (at 0 items/min)
2026-03-27 11:07:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:07:13 [auto1.de] INFO: Channel: 24h | Page: 208 | totalHits: 10647 | hits on page: 40
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: HW22525
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: YK03536
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: UW04367
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW04367%27 HTTP/1.1" 200 None
2026-03-27 11:07:13 [auto1.de] INFO: Scrape type for UW04367: 0
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: RF22787
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF22787%27 HTTP/1.1" 200 None
2026-03-27 11:07:13 [auto1.de] INFO: Scrape type for RF22787: 0
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: ZJ78917
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: EP01507
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP01507%27 HTTP/1.1" 200 None
2026-03-27 11:07:13 [auto1.de] INFO: Scrape type for EP01507: 0
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: SU57323
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: PW24497
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: UB49325
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB49325%27 HTTP/1.1" 200 None
2026-03-27 11:07:13 [auto1.de] INFO: Scrape type for UB49325: 0
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: RA95037
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: GE40868
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: DX94884
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: MG62084
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: YY23683
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY23683%27 HTTP/1.1" 200 None
2026-03-27 11:07:13 [auto1.de] INFO: Scrape type for YY23683: 0
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: ZG28103
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: XE46726
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: GM09493
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM09493%27 HTTP/1.1" 200 None
2026-03-27 11:07:13 [auto1.de] INFO: Scrape type for GM09493: 0
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: TA04227
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA04227%27 HTTP/1.1" 200 None
2026-03-27 11:07:13 [auto1.de] INFO: Scrape type for TA04227: 0
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: NY61783
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY61783%27 HTTP/1.1" 200 None
2026-03-27 11:07:13 [auto1.de] INFO: Scrape type for NY61783: 0
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: BH79353
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH79353%27 HTTP/1.1" 200 None
2026-03-27 11:07:13 [auto1.de] INFO: Scrape type for BH79353: 0
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: FK50485
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK50485%27 HTTP/1.1" 200 None
2026-03-27 11:07:13 [auto1.de] INFO: Scrape type for FK50485: 0
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: AY40999
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY40999%27 HTTP/1.1" 200 None
2026-03-27 11:07:13 [auto1.de] INFO: Scrape type for AY40999: 0
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: XM92815
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: TZ02637
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ02637%27 HTTP/1.1" 200 None
2026-03-27 11:07:13 [auto1.de] INFO: Scrape type for TZ02637: 0
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: RK41823
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: RA12129
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA12129%27 HTTP/1.1" 200 None
2026-03-27 11:07:13 [auto1.de] INFO: Scrape type for RA12129: 0
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: MW13078
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: NP64585
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: FB48782
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB48782%27 HTTP/1.1" 200 None
2026-03-27 11:07:13 [auto1.de] INFO: Scrape type for FB48782: 0
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: YG71277
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: RW27333
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW27333%27 HTTP/1.1" 200 None
2026-03-27 11:07:13 [auto1.de] INFO: Scrape type for RW27333: 0
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: TW18207
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW18207%27 HTTP/1.1" 200 None
2026-03-27 11:07:13 [auto1.de] INFO: Scrape type for TW18207: 0
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: RH59549
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH59549%27 HTTP/1.1" 200 None
2026-03-27 11:07:13 [auto1.de] INFO: Scrape type for RH59549: 0
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: MV46531
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: TF22102
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: PA69157
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: XP68837
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP68837%27 HTTP/1.1" 200 None
2026-03-27 11:07:13 [auto1.de] INFO: Scrape type for XP68837: 0
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: LC33387
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC33387%27 HTTP/1.1" 200 None
2026-03-27 11:07:13 [auto1.de] INFO: Scrape type for LC33387: 0
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: RR51930
2026-03-27 11:07:13 [auto1.de] INFO: Found listing with ID: DD96369
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD96369%27 HTTP/1.1" 200 None
2026-03-27 11:07:13 [auto1.de] INFO: Scrape type for DD96369: 0
2026-03-27 11:07:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:07:15 [auto1.de] INFO: Channel: 24h | Page: 209 | totalHits: 10647 | hits on page: 40
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: WK66375
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK66375%27 HTTP/1.1" 200 None
2026-03-27 11:07:15 [auto1.de] INFO: Scrape type for WK66375: 0
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: CB37253
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: SV14615
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: YS77012
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS77012%27 HTTP/1.1" 200 None
2026-03-27 11:07:15 [auto1.de] INFO: Scrape type for YS77012: 0
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: SX40861
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX40861%27 HTTP/1.1" 200 None
2026-03-27 11:07:15 [auto1.de] INFO: Scrape type for SX40861: 0
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: LD47846
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: MC32966
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: EU98596
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: AG96042
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: EL91395
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: KH07650
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH07650%27 HTTP/1.1" 200 None
2026-03-27 11:07:15 [auto1.de] INFO: Scrape type for KH07650: 0
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: XA33709
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA33709%27 HTTP/1.1" 200 None
2026-03-27 11:07:15 [auto1.de] INFO: Scrape type for XA33709: 0
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: NJ52578
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: SY31169
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: KJ67118
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: RJ13540
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ13540%27 HTTP/1.1" 200 None
2026-03-27 11:07:15 [auto1.de] INFO: Scrape type for RJ13540: 0
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: DU72496
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: SY05346
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: RJ91568
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: CC18685
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC18685%27 HTTP/1.1" 200 None
2026-03-27 11:07:15 [auto1.de] INFO: Scrape type for CC18685: 0
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: PD40486
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD40486%27 HTTP/1.1" 200 None
2026-03-27 11:07:15 [auto1.de] INFO: Scrape type for PD40486: 0
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: US63709
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US63709%27 HTTP/1.1" 200 None
2026-03-27 11:07:15 [auto1.de] INFO: Scrape type for US63709: 0
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: TF21479
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF21479%27 HTTP/1.1" 200 None
2026-03-27 11:07:15 [auto1.de] INFO: Scrape type for TF21479: 0
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: VM82441
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM82441%27 HTTP/1.1" 200 None
2026-03-27 11:07:15 [auto1.de] INFO: Scrape type for VM82441: 0
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: SJ56446
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ56446%27 HTTP/1.1" 200 None
2026-03-27 11:07:15 [auto1.de] INFO: Scrape type for SJ56446: 0
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: GC64334
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC64334%27 HTTP/1.1" 200 None
2026-03-27 11:07:15 [auto1.de] INFO: Scrape type for GC64334: 0
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: JN24932
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: ZC06479
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: NK96400
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: TC31207
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: JZ51300
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: HP67192
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: JN30081
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: HS11953
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS11953%27 HTTP/1.1" 200 None
2026-03-27 11:07:15 [auto1.de] INFO: Scrape type for HS11953: 0
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: TU83885
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU83885%27 HTTP/1.1" 200 None
2026-03-27 11:07:15 [auto1.de] INFO: Scrape type for TU83885: 0
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: BR88683
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: GZ22877
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ22877%27 HTTP/1.1" 200 None
2026-03-27 11:07:15 [auto1.de] INFO: Scrape type for GZ22877: 0
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: EC14916
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC14916%27 HTTP/1.1" 200 None
2026-03-27 11:07:15 [auto1.de] INFO: Scrape type for EC14916: 0
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: TX67175
2026-03-27 11:07:15 [auto1.de] INFO: Found listing with ID: LJ23138
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ23138%27 HTTP/1.1" 200 None
2026-03-27 11:07:15 [auto1.de] INFO: Scrape type for LJ23138: 0
2026-03-27 11:07:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:07:51 [auto1.de] INFO: Channel: 24h | Page: 210 | totalHits: 10651 | hits on page: 40
2026-03-27 11:07:51 [auto1.de] INFO: Found listing with ID: GZ22877
2026-03-27 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ22877%27 HTTP/1.1" 200 None
2026-03-27 11:07:51 [auto1.de] INFO: Scrape type for GZ22877: 0
2026-03-27 11:07:51 [auto1.de] INFO: Found listing with ID: EC14916
2026-03-27 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC14916%27 HTTP/1.1" 200 None
2026-03-27 11:07:51 [auto1.de] INFO: Scrape type for EC14916: 0
2026-03-27 11:07:51 [auto1.de] INFO: Found listing with ID: TX67175
2026-03-27 11:07:51 [auto1.de] INFO: Found listing with ID: LJ23138
2026-03-27 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ23138%27 HTTP/1.1" 200 None
2026-03-27 11:07:51 [auto1.de] INFO: Scrape type for LJ23138: 0
2026-03-27 11:07:51 [auto1.de] INFO: Found listing with ID: BK28670
2026-03-27 11:07:51 [auto1.de] INFO: Found listing with ID: CE21885
2026-03-27 11:07:51 [auto1.de] INFO: Found listing with ID: BJ01764
2026-03-27 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ01764%27 HTTP/1.1" 200 None
2026-03-27 11:07:51 [auto1.de] INFO: Scrape type for BJ01764: 0
2026-03-27 11:07:51 [auto1.de] INFO: Found listing with ID: SR82375
2026-03-27 11:07:51 [auto1.de] INFO: Found listing with ID: CW25656
2026-03-27 11:07:51 [auto1.de] INFO: Found listing with ID: WG47742
2026-03-27 11:07:51 [auto1.de] INFO: Found listing with ID: HD91447
2026-03-27 11:07:51 [auto1.de] INFO: Found listing with ID: DF87263
2026-03-27 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF87263%27 HTTP/1.1" 200 None
2026-03-27 11:07:51 [auto1.de] INFO: Scrape type for DF87263: 0
2026-03-27 11:07:51 [auto1.de] INFO: Found listing with ID: FA40158
2026-03-27 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA40158%27 HTTP/1.1" 200 None
2026-03-27 11:07:51 [auto1.de] INFO: Scrape type for FA40158: 0
2026-03-27 11:07:51 [auto1.de] INFO: Found listing with ID: YY96665
2026-03-27 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY96665%27 HTTP/1.1" 200 None
2026-03-27 11:07:51 [auto1.de] INFO: Scrape type for YY96665: 0
2026-03-27 11:07:51 [auto1.de] INFO: Found listing with ID: VX94865
2026-03-27 11:07:51 [auto1.de] INFO: Found listing with ID: TL51907
2026-03-27 11:07:51 [auto1.de] INFO: Found listing with ID: CV69713
2026-03-27 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV69713%27 HTTP/1.1" 200 None
2026-03-27 11:07:51 [auto1.de] INFO: Scrape type for CV69713: 0
2026-03-27 11:07:51 [auto1.de] INFO: Found listing with ID: FY85986
2026-03-27 11:07:51 [auto1.de] INFO: Found listing with ID: YE06250
2026-03-27 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE06250%27 HTTP/1.1" 200 None
2026-03-27 11:07:51 [auto1.de] INFO: Scrape type for YE06250: 0
2026-03-27 11:07:51 [auto1.de] INFO: Found listing with ID: MV49493
2026-03-27 11:07:51 [auto1.de] INFO: Found listing with ID: HA68744
2026-03-27 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA68744%27 HTTP/1.1" 200 None
2026-03-27 11:07:52 [auto1.de] INFO: Scrape type for HA68744: 0
2026-03-27 11:07:52 [auto1.de] INFO: Found listing with ID: WB33854
2026-03-27 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB33854%27 HTTP/1.1" 200 None
2026-03-27 11:07:52 [auto1.de] INFO: Scrape type for WB33854: 0
2026-03-27 11:07:52 [auto1.de] INFO: Found listing with ID: BN98168
2026-03-27 11:07:52 [auto1.de] INFO: Found listing with ID: XY60222
2026-03-27 11:07:52 [auto1.de] INFO: Found listing with ID: XC81585
2026-03-27 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC81585%27 HTTP/1.1" 200 None
2026-03-27 11:07:52 [auto1.de] INFO: Scrape type for XC81585: 0
2026-03-27 11:07:52 [auto1.de] INFO: Found listing with ID: VP39995
2026-03-27 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP39995%27 HTTP/1.1" 200 None
2026-03-27 11:07:52 [auto1.de] INFO: Scrape type for VP39995: 0
2026-03-27 11:07:52 [auto1.de] INFO: Found listing with ID: YV38391
2026-03-27 11:07:52 [auto1.de] INFO: Found listing with ID: DW77915
2026-03-27 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77915%27 HTTP/1.1" 200 None
2026-03-27 11:07:52 [auto1.de] INFO: Scrape type for DW77915: 0
2026-03-27 11:07:52 [auto1.de] INFO: Found listing with ID: VK68261
2026-03-27 11:07:52 [auto1.de] INFO: Found listing with ID: DX95888
2026-03-27 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX95888%27 HTTP/1.1" 200 None
2026-03-27 11:07:52 [auto1.de] INFO: Scrape type for DX95888: 0
2026-03-27 11:07:52 [auto1.de] INFO: Found listing with ID: YS99143
2026-03-27 11:07:52 [auto1.de] INFO: Found listing with ID: XW83383
2026-03-27 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW83383%27 HTTP/1.1" 200 None
2026-03-27 11:07:52 [auto1.de] INFO: Scrape type for XW83383: 0
2026-03-27 11:07:52 [auto1.de] INFO: Found listing with ID: CT47454
2026-03-27 11:07:52 [auto1.de] INFO: Found listing with ID: YU14604
2026-03-27 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU14604%27 HTTP/1.1" 200 None
2026-03-27 11:07:52 [auto1.de] INFO: Scrape type for YU14604: 0
2026-03-27 11:07:52 [auto1.de] INFO: Found listing with ID: MT90206
2026-03-27 11:07:52 [auto1.de] INFO: Found listing with ID: AZ36438
2026-03-27 11:07:52 [auto1.de] INFO: Found listing with ID: JW62069
2026-03-27 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW62069%27 HTTP/1.1" 200 None
2026-03-27 11:07:52 [auto1.de] INFO: Scrape type for JW62069: 0
2026-03-27 11:07:52 [auto1.de] INFO: Found listing with ID: UT80780
2026-03-27 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT80780%27 HTTP/1.1" 200 None
2026-03-27 11:07:52 [auto1.de] INFO: Scrape type for UT80780: 0
2026-03-27 11:07:52 [auto1.de] INFO: Found listing with ID: WK92303
2026-03-27 11:07:52 [auto1.de] INFO: Found listing with ID: EG83808
2026-03-27 11:07:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:07:54 [auto1.de] INFO: Channel: 24h | Page: 211 | totalHits: 10651 | hits on page: 40
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: RA29249
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA29249%27 HTTP/1.1" 200 None
2026-03-27 11:07:54 [auto1.de] INFO: Scrape type for RA29249: 0
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: UE92744
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE92744%27 HTTP/1.1" 200 None
2026-03-27 11:07:54 [auto1.de] INFO: Scrape type for UE92744: 0
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: JU34727
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU34727%27 HTTP/1.1" 200 None
2026-03-27 11:07:54 [auto1.de] INFO: Scrape type for JU34727: 0
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: DN40523
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: DK22923
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK22923%27 HTTP/1.1" 200 None
2026-03-27 11:07:54 [auto1.de] INFO: Scrape type for DK22923: 0
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: GB27698
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: BW72688
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW72688%27 HTTP/1.1" 200 None
2026-03-27 11:07:54 [auto1.de] INFO: Scrape type for BW72688: 0
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: HS83550
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: ZP90665
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP90665%27 HTTP/1.1" 200 None
2026-03-27 11:07:54 [auto1.de] INFO: Scrape type for ZP90665: 0
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: TD82929
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: RR70669
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR70669%27 HTTP/1.1" 200 None
2026-03-27 11:07:54 [auto1.de] INFO: Scrape type for RR70669: 0
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: CJ89052
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: YY17846
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: WD47440
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: KU18175
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: CG35532
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: RV83532
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: PP86111
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: BH27879
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH27879%27 HTTP/1.1" 200 None
2026-03-27 11:07:54 [auto1.de] INFO: Scrape type for BH27879: 0
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: NP09075
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP09075%27 HTTP/1.1" 200 None
2026-03-27 11:07:54 [auto1.de] INFO: Scrape type for NP09075: 0
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: PZ86932
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: TK92961
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: RM16277
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: YB55066
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB55066%27 HTTP/1.1" 200 None
2026-03-27 11:07:54 [auto1.de] INFO: Scrape type for YB55066: 0
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: DE54360
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE54360%27 HTTP/1.1" 200 None
2026-03-27 11:07:54 [auto1.de] INFO: Scrape type for DE54360: 0
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: GC63965
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC63965%27 HTTP/1.1" 200 None
2026-03-27 11:07:54 [auto1.de] INFO: Scrape type for GC63965: 0
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: VC08022
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: KF93179
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF93179%27 HTTP/1.1" 200 None
2026-03-27 11:07:54 [auto1.de] INFO: Scrape type for KF93179: 0
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: XZ28453
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ28453%27 HTTP/1.1" 200 None
2026-03-27 11:07:54 [auto1.de] INFO: Scrape type for XZ28453: 0
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: PM99817
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: AE92334
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: BU50951
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: MK79183
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK79183%27 HTTP/1.1" 200 None
2026-03-27 11:07:54 [auto1.de] INFO: Scrape type for MK79183: 0
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: SB68582
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: HY50047
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: VV51100
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: EY25478
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: YX40073
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: GG83747
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG83747%27 HTTP/1.1" 200 None
2026-03-27 11:07:54 [auto1.de] INFO: Scrape type for GG83747: 0
2026-03-27 11:07:54 [auto1.de] INFO: Found listing with ID: AB62071
2026-03-27 11:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:08:02 [auto1.de] INFO: Channel: 24h | Page: 212 | totalHits: 10652 | hits on page: 40
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: AB62071
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: UC73947
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: SZ12990
2026-03-27 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ12990%27 HTTP/1.1" 200 None
2026-03-27 11:08:02 [auto1.de] INFO: Scrape type for SZ12990: 0
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: UF39995
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: UZ09998
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: RJ95709
2026-03-27 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ95709%27 HTTP/1.1" 200 None
2026-03-27 11:08:02 [auto1.de] INFO: Scrape type for RJ95709: 0
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: YY16736
2026-03-27 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY16736%27 HTTP/1.1" 200 None
2026-03-27 11:08:02 [auto1.de] INFO: Scrape type for YY16736: 0
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: HW59412
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: HH67163
2026-03-27 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH67163%27 HTTP/1.1" 200 None
2026-03-27 11:08:02 [auto1.de] INFO: Scrape type for HH67163: 0
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: YM45200
2026-03-27 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM45200%27 HTTP/1.1" 200 None
2026-03-27 11:08:02 [auto1.de] INFO: Scrape type for YM45200: 0
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: GG50653
2026-03-27 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG50653%27 HTTP/1.1" 200 None
2026-03-27 11:08:02 [auto1.de] INFO: Scrape type for GG50653: 0
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: JN49232
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: US02373
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: YP11119
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: SW43272
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: ZU09977
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: TY02299
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: EB03489
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: XS74356
2026-03-27 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS74356%27 HTTP/1.1" 200 None
2026-03-27 11:08:02 [auto1.de] INFO: Scrape type for XS74356: 0
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: YR77753
2026-03-27 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR77753%27 HTTP/1.1" 200 None
2026-03-27 11:08:02 [auto1.de] INFO: Scrape type for YR77753: 0
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: TE37782
2026-03-27 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE37782%27 HTTP/1.1" 200 None
2026-03-27 11:08:02 [auto1.de] INFO: Scrape type for TE37782: 0
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: MS59141
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: TP62216
2026-03-27 11:08:02 [auto1.de] INFO: Found listing with ID: GG66892
2026-03-27 11:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG66892%27 HTTP/1.1" 200 None
2026-03-27 11:08:03 [auto1.de] INFO: Scrape type for GG66892: 0
2026-03-27 11:08:03 [auto1.de] INFO: Found listing with ID: UR41125
2026-03-27 11:08:03 [auto1.de] INFO: Found listing with ID: CM08776
2026-03-27 11:08:03 [auto1.de] INFO: Found listing with ID: TZ55203
2026-03-27 11:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ55203%27 HTTP/1.1" 200 None
2026-03-27 11:08:03 [auto1.de] INFO: Scrape type for TZ55203: 0
2026-03-27 11:08:03 [auto1.de] INFO: Found listing with ID: KY89472
2026-03-27 11:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY89472%27 HTTP/1.1" 200 None
2026-03-27 11:08:03 [auto1.de] INFO: Scrape type for KY89472: 0
2026-03-27 11:08:03 [auto1.de] INFO: Found listing with ID: RP25278
2026-03-27 11:08:03 [auto1.de] INFO: Found listing with ID: XY85959
2026-03-27 11:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY85959%27 HTTP/1.1" 200 None
2026-03-27 11:08:03 [auto1.de] INFO: Scrape type for XY85959: 0
2026-03-27 11:08:03 [auto1.de] INFO: Found listing with ID: KL34973
2026-03-27 11:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL34973%27 HTTP/1.1" 200 None
2026-03-27 11:08:03 [auto1.de] INFO: Scrape type for KL34973: 0
2026-03-27 11:08:03 [auto1.de] INFO: Found listing with ID: EY38885
2026-03-27 11:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY38885%27 HTTP/1.1" 200 None
2026-03-27 11:08:03 [auto1.de] INFO: Scrape type for EY38885: 0
2026-03-27 11:08:03 [auto1.de] INFO: Found listing with ID: XB35514
2026-03-27 11:08:03 [auto1.de] INFO: Found listing with ID: KZ84626
2026-03-27 11:08:03 [auto1.de] INFO: Found listing with ID: XM73112
2026-03-27 11:08:03 [auto1.de] INFO: Found listing with ID: BE05361
2026-03-27 11:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE05361%27 HTTP/1.1" 200 None
2026-03-27 11:08:03 [auto1.de] INFO: Scrape type for BE05361: 0
2026-03-27 11:08:03 [auto1.de] INFO: Found listing with ID: MR37276
2026-03-27 11:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR37276%27 HTTP/1.1" 200 None
2026-03-27 11:08:03 [auto1.de] INFO: Scrape type for MR37276: 0
2026-03-27 11:08:03 [auto1.de] INFO: Found listing with ID: WT63610
2026-03-27 11:08:03 [auto1.de] INFO: Found listing with ID: XB58662
2026-03-27 11:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB58662%27 HTTP/1.1" 200 None
2026-03-27 11:08:03 [auto1.de] INFO: Scrape type for XB58662: 0
2026-03-27 11:08:03 [auto1.de] INFO: Found listing with ID: DG11868
2026-03-27 11:08:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:08:06 [scrapy.extensions.logstats] INFO: Crawled 680 pages (at 5 pages/min), scraped 923 items (at 0 items/min)
2026-03-27 11:08:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 11:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:08:10 [auto1.de] INFO: Channel: 24h | Page: 213 | totalHits: 10652 | hits on page: 40
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: GR54934
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR54934%27 HTTP/1.1" 200 None
2026-03-27 11:08:10 [auto1.de] INFO: Scrape type for GR54934: 0
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: MX53389
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX53389%27 HTTP/1.1" 200 None
2026-03-27 11:08:10 [auto1.de] INFO: Scrape type for MX53389: 0
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: AC98269
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: CP17367
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: SV33608
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV33608%27 HTTP/1.1" 200 None
2026-03-27 11:08:10 [auto1.de] INFO: Scrape type for SV33608: 0
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: GL74113
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL74113%27 HTTP/1.1" 200 None
2026-03-27 11:08:10 [auto1.de] INFO: Scrape type for GL74113: 0
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: JW05429
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW05429%27 HTTP/1.1" 200 None
2026-03-27 11:08:10 [auto1.de] INFO: Scrape type for JW05429: 0
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: BG00548
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG00548%27 HTTP/1.1" 200 None
2026-03-27 11:08:10 [auto1.de] INFO: Scrape type for BG00548: 0
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: TW30601
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW30601%27 HTTP/1.1" 200 None
2026-03-27 11:08:10 [auto1.de] INFO: Scrape type for TW30601: 0
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: WA83944
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: DH43051
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: NN01563
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN01563%27 HTTP/1.1" 200 None
2026-03-27 11:08:10 [auto1.de] INFO: Scrape type for NN01563: 0
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: KG75007
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG75007%27 HTTP/1.1" 200 None
2026-03-27 11:08:10 [auto1.de] INFO: Scrape type for KG75007: 0
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: AY20057
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY20057%27 HTTP/1.1" 200 None
2026-03-27 11:08:10 [auto1.de] INFO: Scrape type for AY20057: 0
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: YX53981
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: SH98568
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: UL70730
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: EN52733
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: PX63030
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX63030%27 HTTP/1.1" 200 None
2026-03-27 11:08:10 [auto1.de] INFO: Scrape type for PX63030: 0
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: YB88928
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: GM00936
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: GE82789
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: CK91983
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: PE42975
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE42975%27 HTTP/1.1" 200 None
2026-03-27 11:08:10 [auto1.de] INFO: Scrape type for PE42975: 0
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: SV77983
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV77983%27 HTTP/1.1" 200 None
2026-03-27 11:08:10 [auto1.de] INFO: Scrape type for SV77983: 0
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: CB34680
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: AH80148
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: ZP83400
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP83400%27 HTTP/1.1" 200 None
2026-03-27 11:08:10 [auto1.de] INFO: Scrape type for ZP83400: 0
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: BP76332
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: UC03407
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: FY70837
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY70837%27 HTTP/1.1" 200 None
2026-03-27 11:08:10 [auto1.de] INFO: Scrape type for FY70837: 0
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: SW38418
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: UV90435
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV90435%27 HTTP/1.1" 200 None
2026-03-27 11:08:10 [auto1.de] INFO: Scrape type for UV90435: 0
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: NB71382
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB71382%27 HTTP/1.1" 200 None
2026-03-27 11:08:10 [auto1.de] INFO: Scrape type for NB71382: 0
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: KL04932
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: JL69965
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: UV32896
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV32896%27 HTTP/1.1" 200 None
2026-03-27 11:08:10 [auto1.de] INFO: Scrape type for UV32896: 0
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: HV52735
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV52735%27 HTTP/1.1" 200 None
2026-03-27 11:08:10 [auto1.de] INFO: Scrape type for HV52735: 0
2026-03-27 11:08:10 [auto1.de] INFO: Found listing with ID: LS67990
2026-03-27 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS67990%27 HTTP/1.1" 200 None
2026-03-27 11:08:11 [auto1.de] INFO: Scrape type for LS67990: 0
2026-03-27 11:08:11 [auto1.de] INFO: Found listing with ID: PV34075
2026-03-27 11:08:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:08:15 [auto1.de] INFO: Channel: 24h | Page: 214 | totalHits: 10652 | hits on page: 40
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: GR30468
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR30468%27 HTTP/1.1" 200 None
2026-03-27 11:08:15 [auto1.de] INFO: Scrape type for GR30468: 0
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: DX22811
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX22811%27 HTTP/1.1" 200 None
2026-03-27 11:08:15 [auto1.de] INFO: Scrape type for DX22811: 0
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: BK85396
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK85396%27 HTTP/1.1" 200 None
2026-03-27 11:08:15 [auto1.de] INFO: Scrape type for BK85396: 0
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: FL22674
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL22674%27 HTTP/1.1" 200 None
2026-03-27 11:08:15 [auto1.de] INFO: Scrape type for FL22674: 0
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: LR39854
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR39854%27 HTTP/1.1" 200 None
2026-03-27 11:08:15 [auto1.de] INFO: Scrape type for LR39854: 0
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: CK07020
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: KJ96980
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: NX34397
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX34397%27 HTTP/1.1" 200 None
2026-03-27 11:08:15 [auto1.de] INFO: Scrape type for NX34397: 0
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: EY98011
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: BZ01100
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: DX12150
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: UW91893
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: ST62599
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST62599%27 HTTP/1.1" 200 None
2026-03-27 11:08:15 [auto1.de] INFO: Scrape type for ST62599: 0
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: LL54176
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: WX08493
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX08493%27 HTTP/1.1" 200 None
2026-03-27 11:08:15 [auto1.de] INFO: Scrape type for WX08493: 0
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: SZ47728
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: EZ44975
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: HA98993
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA98993%27 HTTP/1.1" 200 None
2026-03-27 11:08:15 [auto1.de] INFO: Scrape type for HA98993: 0
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: MR96648
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: ZK17245
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: VN62534
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN62534%27 HTTP/1.1" 200 None
2026-03-27 11:08:15 [auto1.de] INFO: Scrape type for VN62534: 0
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: TP12754
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: TK37113
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: EH00349
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH00349%27 HTTP/1.1" 200 None
2026-03-27 11:08:15 [auto1.de] INFO: Scrape type for EH00349: 0
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: ZS75478
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS75478%27 HTTP/1.1" 200 None
2026-03-27 11:08:15 [auto1.de] INFO: Scrape type for ZS75478: 0
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: LB36722
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: MV67682
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV67682%27 HTTP/1.1" 200 None
2026-03-27 11:08:15 [auto1.de] INFO: Scrape type for MV67682: 0
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: NZ05908
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ05908%27 HTTP/1.1" 200 None
2026-03-27 11:08:15 [auto1.de] INFO: Scrape type for NZ05908: 0
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: PP18255
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: NM72048
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: ZC51806
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: FW88746
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: NV67467
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: US78573
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US78573%27 HTTP/1.1" 200 None
2026-03-27 11:08:15 [auto1.de] INFO: Scrape type for US78573: 0
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: EZ75605
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ75605%27 HTTP/1.1" 200 None
2026-03-27 11:08:15 [auto1.de] INFO: Scrape type for EZ75605: 0
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: PZ89360
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: ML68977
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: LN58455
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: JE51939
2026-03-27 11:08:15 [auto1.de] INFO: Found listing with ID: EZ57088
2026-03-27 11:08:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:08:23 [auto1.de] INFO: Channel: 24h | Page: 215 | totalHits: 10653 | hits on page: 40
2026-03-27 11:08:23 [auto1.de] INFO: Found listing with ID: EZ57088
2026-03-27 11:08:23 [auto1.de] INFO: Found listing with ID: GH70470
2026-03-27 11:08:23 [auto1.de] INFO: Found listing with ID: ZD23311
2026-03-27 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD23311%27 HTTP/1.1" 200 None
2026-03-27 11:08:23 [auto1.de] INFO: Scrape type for ZD23311: 0
2026-03-27 11:08:23 [auto1.de] INFO: Found listing with ID: CL74649
2026-03-27 11:08:23 [auto1.de] INFO: Found listing with ID: YF14674
2026-03-27 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF14674%27 HTTP/1.1" 200 None
2026-03-27 11:08:23 [auto1.de] INFO: Scrape type for YF14674: 0
2026-03-27 11:08:23 [auto1.de] INFO: Found listing with ID: KC96393
2026-03-27 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC96393%27 HTTP/1.1" 200 None
2026-03-27 11:08:23 [auto1.de] INFO: Scrape type for KC96393: 0
2026-03-27 11:08:23 [auto1.de] INFO: Found listing with ID: AU64628
2026-03-27 11:08:23 [auto1.de] INFO: Found listing with ID: SA48372
2026-03-27 11:08:23 [auto1.de] INFO: Found listing with ID: NZ82946
2026-03-27 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ82946%27 HTTP/1.1" 200 None
2026-03-27 11:08:23 [auto1.de] INFO: Scrape type for NZ82946: 0
2026-03-27 11:08:23 [auto1.de] INFO: Found listing with ID: MF47470
2026-03-27 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF47470%27 HTTP/1.1" 200 None
2026-03-27 11:08:23 [auto1.de] INFO: Scrape type for MF47470: 0
2026-03-27 11:08:23 [auto1.de] INFO: Found listing with ID: MY25415
2026-03-27 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY25415%27 HTTP/1.1" 200 None
2026-03-27 11:08:23 [auto1.de] INFO: Scrape type for MY25415: 0
2026-03-27 11:08:23 [auto1.de] INFO: Found listing with ID: EZ76409
2026-03-27 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ76409%27 HTTP/1.1" 200 None
2026-03-27 11:08:23 [auto1.de] INFO: Scrape type for EZ76409: 0
2026-03-27 11:08:23 [auto1.de] INFO: Found listing with ID: RV36092
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV36092%27 HTTP/1.1" 200 None
2026-03-27 11:08:24 [auto1.de] INFO: Scrape type for RV36092: 0
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: VP67929
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: KF13648
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF13648%27 HTTP/1.1" 200 None
2026-03-27 11:08:24 [auto1.de] INFO: Scrape type for KF13648: 0
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: BM44177
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM44177%27 HTTP/1.1" 200 None
2026-03-27 11:08:24 [auto1.de] INFO: Scrape type for BM44177: 0
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: BV96040
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: TJ05167
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ05167%27 HTTP/1.1" 200 None
2026-03-27 11:08:24 [auto1.de] INFO: Scrape type for TJ05167: 0
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: ZX80412
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: PB50731
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: KT24392
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT24392%27 HTTP/1.1" 200 None
2026-03-27 11:08:24 [auto1.de] INFO: Scrape type for KT24392: 0
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: TJ62592
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: NL89599
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL89599%27 HTTP/1.1" 200 None
2026-03-27 11:08:24 [auto1.de] INFO: Scrape type for NL89599: 0
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: GF94864
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF94864%27 HTTP/1.1" 200 None
2026-03-27 11:08:24 [auto1.de] INFO: Scrape type for GF94864: 0
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: KX03995
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: NL78703
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: HW09236
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: VB71623
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB71623%27 HTTP/1.1" 200 None
2026-03-27 11:08:24 [auto1.de] INFO: Scrape type for VB71623: 0
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: HA09750
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA09750%27 HTTP/1.1" 200 None
2026-03-27 11:08:24 [auto1.de] INFO: Scrape type for HA09750: 0
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: BL43909
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL43909%27 HTTP/1.1" 200 None
2026-03-27 11:08:24 [auto1.de] INFO: Scrape type for BL43909: 0
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: YE12250
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: NV41893
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV41893%27 HTTP/1.1" 200 None
2026-03-27 11:08:24 [auto1.de] INFO: Scrape type for NV41893: 0
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: DX78720
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: VK43455
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK43455%27 HTTP/1.1" 200 None
2026-03-27 11:08:24 [auto1.de] INFO: Scrape type for VK43455: 0
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: EK98953
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK98953%27 HTTP/1.1" 200 None
2026-03-27 11:08:24 [auto1.de] INFO: Scrape type for EK98953: 0
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: SE15980
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: UM11963
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: BG36952
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG36952%27 HTTP/1.1" 200 None
2026-03-27 11:08:24 [auto1.de] INFO: Scrape type for BG36952: 0
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: JJ97651
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ97651%27 HTTP/1.1" 200 None
2026-03-27 11:08:24 [auto1.de] INFO: Scrape type for JJ97651: 0
2026-03-27 11:08:24 [auto1.de] INFO: Found listing with ID: UL57886
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL57886%27 HTTP/1.1" 200 None
2026-03-27 11:08:24 [auto1.de] INFO: Scrape type for UL57886: 0
2026-03-27 11:08:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:08:31 [auto1.de] INFO: Channel: 24h | Page: 216 | totalHits: 10653 | hits on page: 40
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: MR35818
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR35818%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for MR35818: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: DN96798
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: KZ17416
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ17416%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for KZ17416: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: XR09411
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR09411%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for XR09411: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: FA50226
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: UX36326
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX36326%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for UX36326: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: EY98614
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY98614%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for EY98614: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: CV84531
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV84531%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for CV84531: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: HX26931
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX26931%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for HX26931: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: VU79387
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU79387%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for VU79387: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: YF58476
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF58476%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for YF58476: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: ZN75041
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: JS77816
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS77816%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for JS77816: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: XV44518
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: LL92955
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL92955%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for LL92955: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: DX59888
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX59888%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for DX59888: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: KM33756
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM33756%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for KM33756: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: JM51025
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: LW72301
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW72301%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for LW72301: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: MM33465
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33465%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for MM33465: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: FK38783
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: VD83817
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: WL76854
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL76854%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for WL76854: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: US03235
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US03235%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for US03235: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: BM42670
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: RS07727
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: PG97210
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: PY62114
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY62114%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for PY62114: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: ZR85210
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR85210%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for ZR85210: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: EU44470
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: HE15452
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: GU66928
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU66928%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for GU66928: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: GM39396
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: TN76999
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: JV26307
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV26307%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for JV26307: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: HZ17968
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ17968%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for HZ17968: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: TP81041
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP81041%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for TP81041: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: NE13487
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE13487%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for NE13487: 0
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: EB81332
2026-03-27 11:08:31 [auto1.de] INFO: Found listing with ID: EP31898
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP31898%27 HTTP/1.1" 200 None
2026-03-27 11:08:31 [auto1.de] INFO: Scrape type for EP31898: 0
2026-03-27 11:08:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:08:52 [auto1.de] INFO: Channel: 24h | Page: 217 | totalHits: 10655 | hits on page: 40
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: EB81332
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: EP31898
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP31898%27 HTTP/1.1" 200 None
2026-03-27 11:08:52 [auto1.de] INFO: Scrape type for EP31898: 0
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: FY87536
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: XV60758
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: GJ22872
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ22872%27 HTTP/1.1" 200 None
2026-03-27 11:08:52 [auto1.de] INFO: Scrape type for GJ22872: 0
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: CN69861
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN69861%27 HTTP/1.1" 200 None
2026-03-27 11:08:52 [auto1.de] INFO: Scrape type for CN69861: 0
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: SN98432
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: AB05978
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05978%27 HTTP/1.1" 200 None
2026-03-27 11:08:52 [auto1.de] INFO: Scrape type for AB05978: 0
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: DF53510
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: CY76913
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: FH31570
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: FN01227
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN01227%27 HTTP/1.1" 200 None
2026-03-27 11:08:52 [auto1.de] INFO: Scrape type for FN01227: 0
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: DW20402
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: DS59487
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS59487%27 HTTP/1.1" 200 None
2026-03-27 11:08:52 [auto1.de] INFO: Scrape type for DS59487: 0
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: KT75826
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT75826%27 HTTP/1.1" 200 None
2026-03-27 11:08:52 [auto1.de] INFO: Scrape type for KT75826: 0
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: AZ05535
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: MR02811
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR02811%27 HTTP/1.1" 200 None
2026-03-27 11:08:52 [auto1.de] INFO: Scrape type for MR02811: 0
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: VL86260
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL86260%27 HTTP/1.1" 200 None
2026-03-27 11:08:52 [auto1.de] INFO: Scrape type for VL86260: 0
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: BE47693
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE47693%27 HTTP/1.1" 200 None
2026-03-27 11:08:52 [auto1.de] INFO: Scrape type for BE47693: 0
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: MZ39955
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ39955%27 HTTP/1.1" 200 None
2026-03-27 11:08:52 [auto1.de] INFO: Scrape type for MZ39955: 0
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: PY46067
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY46067%27 HTTP/1.1" 200 None
2026-03-27 11:08:52 [auto1.de] INFO: Scrape type for PY46067: 0
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: AA30425
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: BK85630
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: XZ94866
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: PH18185
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: BD92301
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: ZJ91913
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ91913%27 HTTP/1.1" 200 None
2026-03-27 11:08:52 [auto1.de] INFO: Scrape type for ZJ91913: 0
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: CR46517
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR46517%27 HTTP/1.1" 200 None
2026-03-27 11:08:52 [auto1.de] INFO: Scrape type for CR46517: 0
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: BJ31953
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ31953%27 HTTP/1.1" 200 None
2026-03-27 11:08:52 [auto1.de] INFO: Scrape type for BJ31953: 0
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: VT13568
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT13568%27 HTTP/1.1" 200 None
2026-03-27 11:08:52 [auto1.de] INFO: Scrape type for VT13568: 0
2026-03-27 11:08:52 [auto1.de] INFO: Found listing with ID: DB79051
2026-03-27 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB79051%27 HTTP/1.1" 200 None
2026-03-27 11:08:53 [auto1.de] INFO: Scrape type for DB79051: 0
2026-03-27 11:08:53 [auto1.de] INFO: Found listing with ID: BB73777
2026-03-27 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB73777%27 HTTP/1.1" 200 None
2026-03-27 11:08:53 [auto1.de] INFO: Scrape type for BB73777: 0
2026-03-27 11:08:53 [auto1.de] INFO: Found listing with ID: TH45151
2026-03-27 11:08:53 [auto1.de] INFO: Found listing with ID: CK34526
2026-03-27 11:08:53 [auto1.de] INFO: Found listing with ID: HT24590
2026-03-27 11:08:53 [auto1.de] INFO: Found listing with ID: VW23046
2026-03-27 11:08:53 [auto1.de] INFO: Found listing with ID: FU04530
2026-03-27 11:08:53 [auto1.de] INFO: Found listing with ID: XB94191
2026-03-27 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB94191%27 HTTP/1.1" 200 None
2026-03-27 11:08:53 [auto1.de] INFO: Scrape type for XB94191: 0
2026-03-27 11:08:53 [auto1.de] INFO: Found listing with ID: XJ69708
2026-03-27 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ69708%27 HTTP/1.1" 200 None
2026-03-27 11:08:53 [auto1.de] INFO: Scrape type for XJ69708: 0
2026-03-27 11:08:53 [auto1.de] INFO: Found listing with ID: ZR53476
2026-03-27 11:08:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:08:55 [auto1.de] INFO: Channel: 24h | Page: 218 | totalHits: 10655 | hits on page: 40
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: UV72400
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: RS74456
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: UJ25272
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: DA54133
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: ZH34670
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH34670%27 HTTP/1.1" 200 None
2026-03-27 11:08:55 [auto1.de] INFO: Scrape type for ZH34670: 0
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: HX06187
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: WT92712
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: VU86734
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: ED13441
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: XZ78595
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: PF38232
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF38232%27 HTTP/1.1" 200 None
2026-03-27 11:08:55 [auto1.de] INFO: Scrape type for PF38232: 0
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: CM97024
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: BX05285
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: FJ59032
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ59032%27 HTTP/1.1" 200 None
2026-03-27 11:08:55 [auto1.de] INFO: Scrape type for FJ59032: 0
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: BC93322
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: PW38676
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW38676%27 HTTP/1.1" 200 None
2026-03-27 11:08:55 [auto1.de] INFO: Scrape type for PW38676: 0
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: EX17619
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX17619%27 HTTP/1.1" 200 None
2026-03-27 11:08:55 [auto1.de] INFO: Scrape type for EX17619: 0
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: UD33187
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD33187%27 HTTP/1.1" 200 None
2026-03-27 11:08:55 [auto1.de] INFO: Scrape type for UD33187: 0
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: BX62437
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX62437%27 HTTP/1.1" 200 None
2026-03-27 11:08:55 [auto1.de] INFO: Scrape type for BX62437: 0
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: WS52398
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS52398%27 HTTP/1.1" 200 None
2026-03-27 11:08:55 [auto1.de] INFO: Scrape type for WS52398: 0
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: XH76385
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH76385%27 HTTP/1.1" 200 None
2026-03-27 11:08:55 [auto1.de] INFO: Scrape type for XH76385: 0
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: DG76087
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: SW52547
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW52547%27 HTTP/1.1" 200 None
2026-03-27 11:08:55 [auto1.de] INFO: Scrape type for SW52547: 0
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: DD38415
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: PS77304
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: JT65336
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: MG33600
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG33600%27 HTTP/1.1" 200 None
2026-03-27 11:08:55 [auto1.de] INFO: Scrape type for MG33600: 0
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: RT57266
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: VD22189
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD22189%27 HTTP/1.1" 200 None
2026-03-27 11:08:55 [auto1.de] INFO: Scrape type for VD22189: 0
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: UP67375
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP67375%27 HTTP/1.1" 200 None
2026-03-27 11:08:55 [auto1.de] INFO: Scrape type for UP67375: 0
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: FT61600
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT61600%27 HTTP/1.1" 200 None
2026-03-27 11:08:55 [auto1.de] INFO: Scrape type for FT61600: 0
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: VA30276
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA30276%27 HTTP/1.1" 200 None
2026-03-27 11:08:55 [auto1.de] INFO: Scrape type for VA30276: 0
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: EV07795
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV07795%27 HTTP/1.1" 200 None
2026-03-27 11:08:55 [auto1.de] INFO: Scrape type for EV07795: 0
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: WA28068
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: XA52176
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: RS41513
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS41513%27 HTTP/1.1" 200 None
2026-03-27 11:08:55 [auto1.de] INFO: Scrape type for RS41513: 0
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: AD55960
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: ER63937
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER63937%27 HTTP/1.1" 200 None
2026-03-27 11:08:55 [auto1.de] INFO: Scrape type for ER63937: 0
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: RC91464
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC91464%27 HTTP/1.1" 200 None
2026-03-27 11:08:55 [auto1.de] INFO: Scrape type for RC91464: 0
2026-03-27 11:08:55 [auto1.de] INFO: Found listing with ID: WV85362
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV85362%27 HTTP/1.1" 200 None
2026-03-27 11:08:55 [auto1.de] INFO: Scrape type for WV85362: 0
2026-03-27 11:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:08:56 [auto1.de] INFO: Channel: 24h | Page: 219 | totalHits: 10655 | hits on page: 40
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: YW42118
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW42118%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for YW42118: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: DY95504
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY95504%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for DY95504: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: DT00203
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00203%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for DT00203: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: HP14670
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP14670%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for HP14670: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: NR16619
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: UX90461
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX90461%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for UX90461: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: MR04970
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR04970%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for MR04970: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: GX19680
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX19680%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for GX19680: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: UK85475
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK85475%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for UK85475: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: HT24863
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: LW37492
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW37492%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for LW37492: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: BS60844
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS60844%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for BS60844: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: TT40648
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT40648%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for TT40648: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: PG24274
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24274%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for PG24274: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: CN22561
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: DH62259
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: BP79375
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP79375%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for BP79375: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: VN17122
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: MX20419
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX20419%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for MX20419: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: FF04972
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF04972%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for FF04972: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: NW58647
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: DJ67988
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ67988%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for DJ67988: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: GT74179
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: DV26733
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV26733%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for DV26733: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: AT83868
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: BX03994
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: AK11757
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: BZ86499
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ86499%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for BZ86499: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: TA09073
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA09073%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for TA09073: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: KK24443
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: ST34460
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST34460%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for ST34460: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: FV59404
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV59404%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for FV59404: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: GX38542
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX38542%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for GX38542: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: XP99541
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: JX59316
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX59316%27 HTTP/1.1" 200 None
2026-03-27 11:08:56 [auto1.de] INFO: Scrape type for JX59316: 0
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: XM82116
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: ST31852
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: GG08245
2026-03-27 11:08:56 [auto1.de] INFO: Found listing with ID: WK97473
2026-03-27 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK97473%27 HTTP/1.1" 200 None
2026-03-27 11:08:57 [auto1.de] INFO: Scrape type for WK97473: 0
2026-03-27 11:08:57 [auto1.de] INFO: Found listing with ID: PL21406
2026-03-27 11:08:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:08:58 [auto1.de] INFO: Channel: 24h | Page: 220 | totalHits: 10655 | hits on page: 40
2026-03-27 11:08:58 [auto1.de] INFO: Found listing with ID: ET11394
2026-03-27 11:08:58 [auto1.de] INFO: Found listing with ID: HA34984
2026-03-27 11:08:58 [auto1.de] INFO: Found listing with ID: WB33438
2026-03-27 11:08:58 [auto1.de] INFO: Found listing with ID: CB90406
2026-03-27 11:08:58 [auto1.de] INFO: Found listing with ID: UA60360
2026-03-27 11:08:58 [auto1.de] INFO: Found listing with ID: MH25029
2026-03-27 11:08:58 [auto1.de] INFO: Found listing with ID: YD12579
2026-03-27 11:08:58 [auto1.de] INFO: Found listing with ID: EA13854
2026-03-27 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13854%27 HTTP/1.1" 200 None
2026-03-27 11:08:58 [auto1.de] INFO: Scrape type for EA13854: 0
2026-03-27 11:08:58 [auto1.de] INFO: Found listing with ID: MC69787
2026-03-27 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC69787%27 HTTP/1.1" 200 None
2026-03-27 11:08:58 [auto1.de] INFO: Scrape type for MC69787: 0
2026-03-27 11:08:58 [auto1.de] INFO: Found listing with ID: AJ08614
2026-03-27 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08614%27 HTTP/1.1" 200 None
2026-03-27 11:08:58 [auto1.de] INFO: Scrape type for AJ08614: 0
2026-03-27 11:08:58 [auto1.de] INFO: Found listing with ID: VL75204
2026-03-27 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL75204%27 HTTP/1.1" 200 None
2026-03-27 11:08:58 [auto1.de] INFO: Scrape type for VL75204: 0
2026-03-27 11:08:58 [auto1.de] INFO: Found listing with ID: BE37865
2026-03-27 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE37865%27 HTTP/1.1" 200 None
2026-03-27 11:08:58 [auto1.de] INFO: Scrape type for BE37865: 0
2026-03-27 11:08:58 [auto1.de] INFO: Found listing with ID: SX50197
2026-03-27 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX50197%27 HTTP/1.1" 200 None
2026-03-27 11:08:58 [auto1.de] INFO: Scrape type for SX50197: 0
2026-03-27 11:08:58 [auto1.de] INFO: Found listing with ID: KR66468
2026-03-27 11:08:58 [auto1.de] INFO: Found listing with ID: BR43966
2026-03-27 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR43966%27 HTTP/1.1" 200 None
2026-03-27 11:08:58 [auto1.de] INFO: Scrape type for BR43966: 0
2026-03-27 11:08:58 [auto1.de] INFO: Found listing with ID: CW94235
2026-03-27 11:08:58 [auto1.de] INFO: Found listing with ID: KY80445
2026-03-27 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY80445%27 HTTP/1.1" 200 None
2026-03-27 11:08:58 [auto1.de] INFO: Scrape type for KY80445: 0
2026-03-27 11:08:58 [auto1.de] INFO: Found listing with ID: ES36606
2026-03-27 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES36606%27 HTTP/1.1" 200 None
2026-03-27 11:08:58 [auto1.de] INFO: Scrape type for ES36606: 0
2026-03-27 11:08:58 [auto1.de] INFO: Found listing with ID: LS93174
2026-03-27 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS93174%27 HTTP/1.1" 200 None
2026-03-27 11:08:59 [auto1.de] INFO: Scrape type for LS93174: 0
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: GV09290
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: BH65594
2026-03-27 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH65594%27 HTTP/1.1" 200 None
2026-03-27 11:08:59 [auto1.de] INFO: Scrape type for BH65594: 0
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: AM78577
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: ES44709
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: CZ73212
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: BR02307
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: VE03726
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: CM96643
2026-03-27 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM96643%27 HTTP/1.1" 200 None
2026-03-27 11:08:59 [auto1.de] INFO: Scrape type for CM96643: 0
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: NF21542
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: KR19080
2026-03-27 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR19080%27 HTTP/1.1" 200 None
2026-03-27 11:08:59 [auto1.de] INFO: Scrape type for KR19080: 0
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: MU97238
2026-03-27 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU97238%27 HTTP/1.1" 200 None
2026-03-27 11:08:59 [auto1.de] INFO: Scrape type for MU97238: 0
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: UL19330
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: XC05261
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: UR88141
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: PD23584
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: YV66765
2026-03-27 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV66765%27 HTTP/1.1" 200 None
2026-03-27 11:08:59 [auto1.de] INFO: Scrape type for YV66765: 0
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: NV55096
2026-03-27 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV55096%27 HTTP/1.1" 200 None
2026-03-27 11:08:59 [auto1.de] INFO: Scrape type for NV55096: 0
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: DK81412
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: EP01379
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: TY77644
2026-03-27 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY77644%27 HTTP/1.1" 200 None
2026-03-27 11:08:59 [auto1.de] INFO: Scrape type for TY77644: 0
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: SL46561
2026-03-27 11:08:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:08:59 [auto1.de] INFO: Channel: 24h | Page: 221 | totalHits: 10655 | hits on page: 40
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: XF93739
2026-03-27 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF93739%27 HTTP/1.1" 200 None
2026-03-27 11:08:59 [auto1.de] INFO: Scrape type for XF93739: 0
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: RW78406
2026-03-27 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW78406%27 HTTP/1.1" 200 None
2026-03-27 11:08:59 [auto1.de] INFO: Scrape type for RW78406: 0
2026-03-27 11:08:59 [auto1.de] INFO: Found listing with ID: RY54075
2026-03-27 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY54075%27 HTTP/1.1" 200 None
2026-03-27 11:09:00 [auto1.de] INFO: Scrape type for RY54075: 0
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: TX72935
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX72935%27 HTTP/1.1" 200 None
2026-03-27 11:09:00 [auto1.de] INFO: Scrape type for TX72935: 0
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: VH50621
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH50621%27 HTTP/1.1" 200 None
2026-03-27 11:09:00 [auto1.de] INFO: Scrape type for VH50621: 0
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: YW55799
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: HA14963
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA14963%27 HTTP/1.1" 200 None
2026-03-27 11:09:00 [auto1.de] INFO: Scrape type for HA14963: 0
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: MT24956
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: PJ23427
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: FK00341
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: LT09542
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: ZE28536
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE28536%27 HTTP/1.1" 200 None
2026-03-27 11:09:00 [auto1.de] INFO: Scrape type for ZE28536: 0
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: XH15947
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH15947%27 HTTP/1.1" 200 None
2026-03-27 11:09:00 [auto1.de] INFO: Scrape type for XH15947: 0
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: CR84704
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: ZW18782
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW18782%27 HTTP/1.1" 200 None
2026-03-27 11:09:00 [auto1.de] INFO: Scrape type for ZW18782: 0
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: DX36449
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: KB04713
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB04713%27 HTTP/1.1" 200 None
2026-03-27 11:09:00 [auto1.de] INFO: Scrape type for KB04713: 0
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: FC74080
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC74080%27 HTTP/1.1" 200 None
2026-03-27 11:09:00 [auto1.de] INFO: Scrape type for FC74080: 0
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: CF62011
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF62011%27 HTTP/1.1" 200 None
2026-03-27 11:09:00 [auto1.de] INFO: Scrape type for CF62011: 0
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: BE30085
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: GJ82118
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: UD91634
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: ER72643
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER72643%27 HTTP/1.1" 200 None
2026-03-27 11:09:00 [auto1.de] INFO: Scrape type for ER72643: 0
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: CP25768
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: WG47382
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: MZ36812
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: SN65200
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: FM88493
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: RG74932
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: AL02035
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: UW13690
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW13690%27 HTTP/1.1" 200 None
2026-03-27 11:09:00 [auto1.de] INFO: Scrape type for UW13690: 0
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: DB59774
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: YA77478
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: UZ04747
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ04747%27 HTTP/1.1" 200 None
2026-03-27 11:09:00 [auto1.de] INFO: Scrape type for UZ04747: 0
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: FJ58428
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: VR66334
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: DW68578
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: LE56152
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE56152%27 HTTP/1.1" 200 None
2026-03-27 11:09:00 [auto1.de] INFO: Scrape type for LE56152: 0
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: GS84935
2026-03-27 11:09:00 [auto1.de] INFO: Found listing with ID: BJ29098
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ29098%27 HTTP/1.1" 200 None
2026-03-27 11:09:00 [auto1.de] INFO: Scrape type for BJ29098: 0
2026-03-27 11:09:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:09:06 [scrapy.extensions.logstats] INFO: Crawled 689 pages (at 9 pages/min), scraped 923 items (at 0 items/min)
2026-03-27 11:09:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 11:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:09:08 [auto1.de] INFO: Channel: 24h | Page: 222 | totalHits: 10656 | hits on page: 40
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: BJ29098
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ29098%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for BJ29098: 0
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: RA92759
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA92759%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for RA92759: 0
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: WG75781
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: BN18490
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN18490%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for BN18490: 0
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: KZ71348
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ71348%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for KZ71348: 0
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: EC39473
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: ML64265
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML64265%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for ML64265: 0
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: KC39120
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: WL10604
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: AU22690
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: YY60165
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY60165%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for YY60165: 0
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: AU85949
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU85949%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for AU85949: 0
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: MD58686
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD58686%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for MD58686: 0
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: HS09512
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS09512%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for HS09512: 0
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: XF30370
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF30370%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for XF30370: 0
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: HT67416
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: FW46825
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: GE04346
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: JT67031
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: WZ19127
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: DM07006
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM07006%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for DM07006: 0
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: LT29180
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: AF55838
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: BG43270
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG43270%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for BG43270: 0
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: LB77280
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB77280%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for LB77280: 0
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: PD62632
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: UK70882
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: ZC85664
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC85664%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for ZC85664: 0
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: NZ12847
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: GA94662
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA94662%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for GA94662: 0
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: ST87748
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST87748%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for ST87748: 0
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: BY37084
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY37084%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for BY37084: 0
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: YH28050
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH28050%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for YH28050: 0
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: NW19977
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW19977%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for NW19977: 0
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: VY22593
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY22593%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for VY22593: 0
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: GE51133
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE51133%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for GE51133: 0
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: SK30483
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: DK10933
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: HN78687
2026-03-27 11:09:08 [auto1.de] INFO: Found listing with ID: EL29465
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL29465%27 HTTP/1.1" 200 None
2026-03-27 11:09:08 [auto1.de] INFO: Scrape type for EL29465: 0
2026-03-27 11:09:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:09:09 [auto1.de] INFO: Channel: 24h | Page: 223 | totalHits: 10656 | hits on page: 40
2026-03-27 11:09:09 [auto1.de] INFO: Found listing with ID: EE77460
2026-03-27 11:09:09 [auto1.de] INFO: Found listing with ID: TH75068
2026-03-27 11:09:09 [auto1.de] INFO: Found listing with ID: KL52024
2026-03-27 11:09:09 [auto1.de] INFO: Found listing with ID: BJ98180
2026-03-27 11:09:09 [auto1.de] INFO: Found listing with ID: CS43152
2026-03-27 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS43152%27 HTTP/1.1" 200 None
2026-03-27 11:09:09 [auto1.de] INFO: Scrape type for CS43152: 0
2026-03-27 11:09:09 [auto1.de] INFO: Found listing with ID: SM09271
2026-03-27 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09271%27 HTTP/1.1" 200 None
2026-03-27 11:09:10 [auto1.de] INFO: Scrape type for SM09271: 0
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: US71241
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: NF12247
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF12247%27 HTTP/1.1" 200 None
2026-03-27 11:09:10 [auto1.de] INFO: Scrape type for NF12247: 0
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: VG84958
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: CF91602
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF91602%27 HTTP/1.1" 200 None
2026-03-27 11:09:10 [auto1.de] INFO: Scrape type for CF91602: 0
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: SM52671
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: VB50601
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: PH27110
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH27110%27 HTTP/1.1" 200 None
2026-03-27 11:09:10 [auto1.de] INFO: Scrape type for PH27110: 0
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: DN90837
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: MG85593
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG85593%27 HTTP/1.1" 200 None
2026-03-27 11:09:10 [auto1.de] INFO: Scrape type for MG85593: 0
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: JX06129
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX06129%27 HTTP/1.1" 200 None
2026-03-27 11:09:10 [auto1.de] INFO: Scrape type for JX06129: 0
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: WW51915
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW51915%27 HTTP/1.1" 200 None
2026-03-27 11:09:10 [auto1.de] INFO: Scrape type for WW51915: 0
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: VZ19342
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: PB95967
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: AG38936
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: WJ18132
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: PE28100
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: AM22108
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM22108%27 HTTP/1.1" 200 None
2026-03-27 11:09:10 [auto1.de] INFO: Scrape type for AM22108: 0
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: MR72377
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: MN33638
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: JB89617
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB89617%27 HTTP/1.1" 200 None
2026-03-27 11:09:10 [auto1.de] INFO: Scrape type for JB89617: 0
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: AZ40865
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ40865%27 HTTP/1.1" 200 None
2026-03-27 11:09:10 [auto1.de] INFO: Scrape type for AZ40865: 0
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: SX52884
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: PV88809
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: TW44839
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: FN44724
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: ZA25327
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA25327%27 HTTP/1.1" 200 None
2026-03-27 11:09:10 [auto1.de] INFO: Scrape type for ZA25327: 0
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: UC38867
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: GL61912
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61912%27 HTTP/1.1" 200 None
2026-03-27 11:09:10 [auto1.de] INFO: Scrape type for GL61912: 0
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: PR50786
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: LB03108
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB03108%27 HTTP/1.1" 200 None
2026-03-27 11:09:10 [auto1.de] INFO: Scrape type for LB03108: 0
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: KG29776
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: GR91976
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR91976%27 HTTP/1.1" 200 None
2026-03-27 11:09:10 [auto1.de] INFO: Scrape type for GR91976: 0
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: XE39544
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE39544%27 HTTP/1.1" 200 None
2026-03-27 11:09:10 [auto1.de] INFO: Scrape type for XE39544: 0
2026-03-27 11:09:10 [auto1.de] INFO: Found listing with ID: AS18464
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS18464%27 HTTP/1.1" 200 None
2026-03-27 11:09:10 [auto1.de] INFO: Scrape type for AS18464: 0
2026-03-27 11:09:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:09:11 [auto1.de] INFO: Channel: 24h | Page: 224 | totalHits: 10656 | hits on page: 40
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: EN92666
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN92666%27 HTTP/1.1" 200 None
2026-03-27 11:09:11 [auto1.de] INFO: Scrape type for EN92666: 0
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: KU99299
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU99299%27 HTTP/1.1" 200 None
2026-03-27 11:09:11 [auto1.de] INFO: Scrape type for KU99299: 0
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: NB45839
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB45839%27 HTTP/1.1" 200 None
2026-03-27 11:09:11 [auto1.de] INFO: Scrape type for NB45839: 0
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: RJ76690
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: EB43981
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB43981%27 HTTP/1.1" 200 None
2026-03-27 11:09:11 [auto1.de] INFO: Scrape type for EB43981: 0
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: MC57954
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC57954%27 HTTP/1.1" 200 None
2026-03-27 11:09:11 [auto1.de] INFO: Scrape type for MC57954: 0
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: CW19006
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: WW55400
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: MD20057
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: CW57830
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: BW33957
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: EK02801
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK02801%27 HTTP/1.1" 200 None
2026-03-27 11:09:11 [auto1.de] INFO: Scrape type for EK02801: 0
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: JL88093
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL88093%27 HTTP/1.1" 200 None
2026-03-27 11:09:11 [auto1.de] INFO: Scrape type for JL88093: 0
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: CH60628
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: YL37879
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL37879%27 HTTP/1.1" 200 None
2026-03-27 11:09:11 [auto1.de] INFO: Scrape type for YL37879: 0
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: WK90635
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: VD42182
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD42182%27 HTTP/1.1" 200 None
2026-03-27 11:09:11 [auto1.de] INFO: Scrape type for VD42182: 0
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: NV16003
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV16003%27 HTTP/1.1" 200 None
2026-03-27 11:09:11 [auto1.de] INFO: Scrape type for NV16003: 0
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: ND67175
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND67175%27 HTTP/1.1" 200 None
2026-03-27 11:09:11 [auto1.de] INFO: Scrape type for ND67175: 0
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: MB44364
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: CA27289
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: RW93776
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: CR61198
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR61198%27 HTTP/1.1" 200 None
2026-03-27 11:09:11 [auto1.de] INFO: Scrape type for CR61198: 0
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: MX47183
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: ZK10618
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK10618%27 HTTP/1.1" 200 None
2026-03-27 11:09:11 [auto1.de] INFO: Scrape type for ZK10618: 0
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: BL02906
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: WJ94391
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: SC48990
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: HB57575
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB57575%27 HTTP/1.1" 200 None
2026-03-27 11:09:11 [auto1.de] INFO: Scrape type for HB57575: 0
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: WC38783
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: PN00069
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN00069%27 HTTP/1.1" 200 None
2026-03-27 11:09:11 [auto1.de] INFO: Scrape type for PN00069: 0
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: ZP13586
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: BS00232
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: BW78905
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW78905%27 HTTP/1.1" 200 None
2026-03-27 11:09:11 [auto1.de] INFO: Scrape type for BW78905: 0
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: GU60494
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU60494%27 HTTP/1.1" 200 None
2026-03-27 11:09:11 [auto1.de] INFO: Scrape type for GU60494: 0
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: BE24372
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE24372%27 HTTP/1.1" 200 None
2026-03-27 11:09:11 [auto1.de] INFO: Scrape type for BE24372: 0
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: RB10929
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB10929%27 HTTP/1.1" 200 None
2026-03-27 11:09:11 [auto1.de] INFO: Scrape type for RB10929: 0
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: UZ81937
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: CX46071
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX46071%27 HTTP/1.1" 200 None
2026-03-27 11:09:11 [auto1.de] INFO: Scrape type for CX46071: 0
2026-03-27 11:09:11 [auto1.de] INFO: Found listing with ID: KP36824
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP36824%27 HTTP/1.1" 200 None
2026-03-27 11:09:11 [auto1.de] INFO: Scrape type for KP36824: 0
2026-03-27 11:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:09:28 [auto1.de] INFO: Channel: 24h | Page: 225 | totalHits: 10656 | hits on page: 40
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: DY72609
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY72609%27 HTTP/1.1" 200 None
2026-03-27 11:09:28 [auto1.de] INFO: Scrape type for DY72609: 0
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: ZV20362
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV20362%27 HTTP/1.1" 200 None
2026-03-27 11:09:28 [auto1.de] INFO: Scrape type for ZV20362: 0
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: CU27746
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: PD91808
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: VF40931
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: BW09320
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW09320%27 HTTP/1.1" 200 None
2026-03-27 11:09:28 [auto1.de] INFO: Scrape type for BW09320: 0
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: HD39951
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: AT91043
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: DC71620
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC71620%27 HTTP/1.1" 200 None
2026-03-27 11:09:28 [auto1.de] INFO: Scrape type for DC71620: 0
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: XJ09015
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: CW24668
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: VY33286
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY33286%27 HTTP/1.1" 200 None
2026-03-27 11:09:28 [auto1.de] INFO: Scrape type for VY33286: 0
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: HY99539
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: YD60070
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: JR17394
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17394%27 HTTP/1.1" 200 None
2026-03-27 11:09:28 [auto1.de] INFO: Scrape type for JR17394: 0
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: EU33293
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU33293%27 HTTP/1.1" 200 None
2026-03-27 11:09:28 [auto1.de] INFO: Scrape type for EU33293: 0
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: HC04240
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC04240%27 HTTP/1.1" 200 None
2026-03-27 11:09:28 [auto1.de] INFO: Scrape type for HC04240: 0
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: BB83728
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: JS64432
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: SR72775
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR72775%27 HTTP/1.1" 200 None
2026-03-27 11:09:28 [auto1.de] INFO: Scrape type for SR72775: 0
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: GP53136
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP53136%27 HTTP/1.1" 200 None
2026-03-27 11:09:28 [auto1.de] INFO: Scrape type for GP53136: 0
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: PN08712
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: KA69017
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: HW30650
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: WC25701
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: PY45045
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: ME32399
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME32399%27 HTTP/1.1" 200 None
2026-03-27 11:09:28 [auto1.de] INFO: Scrape type for ME32399: 0
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: VH67229
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: YG83893
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: UA00536
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: SS68419
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: KK09798
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: DL82245
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL82245%27 HTTP/1.1" 200 None
2026-03-27 11:09:28 [auto1.de] INFO: Scrape type for DL82245: 0
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: RU51432
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU51432%27 HTTP/1.1" 200 None
2026-03-27 11:09:28 [auto1.de] INFO: Scrape type for RU51432: 0
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: RH43725
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH43725%27 HTTP/1.1" 200 None
2026-03-27 11:09:28 [auto1.de] INFO: Scrape type for RH43725: 0
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: HN56676
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN56676%27 HTTP/1.1" 200 None
2026-03-27 11:09:28 [auto1.de] INFO: Scrape type for HN56676: 0
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: CD05825
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD05825%27 HTTP/1.1" 200 None
2026-03-27 11:09:28 [auto1.de] INFO: Scrape type for CD05825: 0
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: NE62435
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: UK84754
2026-03-27 11:09:28 [auto1.de] INFO: Found listing with ID: YF79248
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF79248%27 HTTP/1.1" 200 None
2026-03-27 11:09:28 [auto1.de] INFO: Scrape type for YF79248: 0
2026-03-27 11:09:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:09:29 [auto1.de] INFO: Channel: 24h | Page: 226 | totalHits: 10656 | hits on page: 40
2026-03-27 11:09:29 [auto1.de] INFO: Found listing with ID: AR62221
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: WY50003
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY50003%27 HTTP/1.1" 200 None
2026-03-27 11:09:30 [auto1.de] INFO: Scrape type for WY50003: 0
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: HW68760
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW68760%27 HTTP/1.1" 200 None
2026-03-27 11:09:30 [auto1.de] INFO: Scrape type for HW68760: 0
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: GS49465
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: VH44928
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: HJ54596
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: SC73852
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: PV27021
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV27021%27 HTTP/1.1" 200 None
2026-03-27 11:09:30 [auto1.de] INFO: Scrape type for PV27021: 0
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: EU24195
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: TE58420
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: LJ52871
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: SX98211
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: EF54488
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF54488%27 HTTP/1.1" 200 None
2026-03-27 11:09:30 [auto1.de] INFO: Scrape type for EF54488: 0
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: DJ97721
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: RM28655
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: CN74001
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN74001%27 HTTP/1.1" 200 None
2026-03-27 11:09:30 [auto1.de] INFO: Scrape type for CN74001: 0
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: YL01247
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL01247%27 HTTP/1.1" 200 None
2026-03-27 11:09:30 [auto1.de] INFO: Scrape type for YL01247: 0
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: RJ18784
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ18784%27 HTTP/1.1" 200 None
2026-03-27 11:09:30 [auto1.de] INFO: Scrape type for RJ18784: 0
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: JE07637
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: ER69054
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: VB93359
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: TB88794
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: DF95353
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: ZR98160
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR98160%27 HTTP/1.1" 200 None
2026-03-27 11:09:30 [auto1.de] INFO: Scrape type for ZR98160: 0
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: NZ77836
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: GX67290
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: SS59240
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS59240%27 HTTP/1.1" 200 None
2026-03-27 11:09:30 [auto1.de] INFO: Scrape type for SS59240: 0
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: HW81308
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: XX76692
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: PD62787
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD62787%27 HTTP/1.1" 200 None
2026-03-27 11:09:30 [auto1.de] INFO: Scrape type for PD62787: 0
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: ZT22955
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT22955%27 HTTP/1.1" 200 None
2026-03-27 11:09:30 [auto1.de] INFO: Scrape type for ZT22955: 0
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: MT59111
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT59111%27 HTTP/1.1" 200 None
2026-03-27 11:09:30 [auto1.de] INFO: Scrape type for MT59111: 0
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: GL55365
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: YC79153
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: UG43365
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG43365%27 HTTP/1.1" 200 None
2026-03-27 11:09:30 [auto1.de] INFO: Scrape type for UG43365: 0
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: MC25913
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC25913%27 HTTP/1.1" 200 None
2026-03-27 11:09:30 [auto1.de] INFO: Scrape type for MC25913: 0
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: AT78165
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT78165%27 HTTP/1.1" 200 None
2026-03-27 11:09:30 [auto1.de] INFO: Scrape type for AT78165: 0
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: XD17470
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: ZY22077
2026-03-27 11:09:30 [auto1.de] INFO: Found listing with ID: AP00033
2026-03-27 11:09:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:09:36 [auto1.de] INFO: Channel: 24h | Page: 227 | totalHits: 10657 | hits on page: 40
2026-03-27 11:09:36 [auto1.de] INFO: Found listing with ID: AP00033
2026-03-27 11:09:36 [auto1.de] INFO: Found listing with ID: AH07700
2026-03-27 11:09:36 [auto1.de] INFO: Found listing with ID: NW69156
2026-03-27 11:09:36 [auto1.de] INFO: Found listing with ID: ZL77888
2026-03-27 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL77888%27 HTTP/1.1" 200 None
2026-03-27 11:09:36 [auto1.de] INFO: Scrape type for ZL77888: 0
2026-03-27 11:09:36 [auto1.de] INFO: Found listing with ID: WJ57335
2026-03-27 11:09:36 [auto1.de] INFO: Found listing with ID: SA80165
2026-03-27 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA80165%27 HTTP/1.1" 200 None
2026-03-27 11:09:36 [auto1.de] INFO: Scrape type for SA80165: 0
2026-03-27 11:09:36 [auto1.de] INFO: Found listing with ID: JY06885
2026-03-27 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY06885%27 HTTP/1.1" 200 None
2026-03-27 11:09:36 [auto1.de] INFO: Scrape type for JY06885: 0
2026-03-27 11:09:36 [auto1.de] INFO: Found listing with ID: XE55302
2026-03-27 11:09:36 [auto1.de] INFO: Found listing with ID: KH49369
2026-03-27 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH49369%27 HTTP/1.1" 200 None
2026-03-27 11:09:36 [auto1.de] INFO: Scrape type for KH49369: 0
2026-03-27 11:09:36 [auto1.de] INFO: Found listing with ID: TH05050
2026-03-27 11:09:36 [auto1.de] INFO: Found listing with ID: HN24396
2026-03-27 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN24396%27 HTTP/1.1" 200 None
2026-03-27 11:09:36 [auto1.de] INFO: Scrape type for HN24396: 0
2026-03-27 11:09:36 [auto1.de] INFO: Found listing with ID: XX63179
2026-03-27 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX63179%27 HTTP/1.1" 200 None
2026-03-27 11:09:36 [auto1.de] INFO: Scrape type for XX63179: 0
2026-03-27 11:09:36 [auto1.de] INFO: Found listing with ID: NK37699
2026-03-27 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK37699%27 HTTP/1.1" 200 None
2026-03-27 11:09:36 [auto1.de] INFO: Scrape type for NK37699: 0
2026-03-27 11:09:36 [auto1.de] INFO: Found listing with ID: JH14314
2026-03-27 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH14314%27 HTTP/1.1" 200 None
2026-03-27 11:09:36 [auto1.de] INFO: Scrape type for JH14314: 0
2026-03-27 11:09:36 [auto1.de] INFO: Found listing with ID: CV73589
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV73589%27 HTTP/1.1" 200 None
2026-03-27 11:09:37 [auto1.de] INFO: Scrape type for CV73589: 0
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: VS89065
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89065%27 HTTP/1.1" 200 None
2026-03-27 11:09:37 [auto1.de] INFO: Scrape type for VS89065: 0
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: KV71185
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: BU09322
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: KB55712
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: NY81856
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY81856%27 HTTP/1.1" 200 None
2026-03-27 11:09:37 [auto1.de] INFO: Scrape type for NY81856: 0
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: SC92751
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: EY77023
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY77023%27 HTTP/1.1" 200 None
2026-03-27 11:09:37 [auto1.de] INFO: Scrape type for EY77023: 0
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: SD17030
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: EA30541
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: LW92140
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: MZ83474
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ83474%27 HTTP/1.1" 200 None
2026-03-27 11:09:37 [auto1.de] INFO: Scrape type for MZ83474: 0
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: XF69711
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF69711%27 HTTP/1.1" 200 None
2026-03-27 11:09:37 [auto1.de] INFO: Scrape type for XF69711: 0
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: TW05581
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW05581%27 HTTP/1.1" 200 None
2026-03-27 11:09:37 [auto1.de] INFO: Scrape type for TW05581: 0
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: RC23376
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC23376%27 HTTP/1.1" 200 None
2026-03-27 11:09:37 [auto1.de] INFO: Scrape type for RC23376: 0
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: YU84960
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: MA65803
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA65803%27 HTTP/1.1" 200 None
2026-03-27 11:09:37 [auto1.de] INFO: Scrape type for MA65803: 0
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: DW13867
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: KA00227
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA00227%27 HTTP/1.1" 200 None
2026-03-27 11:09:37 [auto1.de] INFO: Scrape type for KA00227: 0
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: KL19137
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: PX47030
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: VH61709
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: KT54325
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: ZT28178
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: GM26241
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM26241%27 HTTP/1.1" 200 None
2026-03-27 11:09:37 [auto1.de] INFO: Scrape type for GM26241: 0
2026-03-27 11:09:37 [auto1.de] INFO: Found listing with ID: DS04882
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS04882%27 HTTP/1.1" 200 None
2026-03-27 11:09:37 [auto1.de] INFO: Scrape type for DS04882: 0
2026-03-27 11:09:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:09:38 [auto1.de] INFO: Channel: 24h | Page: 228 | totalHits: 10658 | hits on page: 40
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: DS04882
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS04882%27 HTTP/1.1" 200 None
2026-03-27 11:09:38 [auto1.de] INFO: Scrape type for DS04882: 0
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: NZ21452
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ21452%27 HTTP/1.1" 200 None
2026-03-27 11:09:38 [auto1.de] INFO: Scrape type for NZ21452: 0
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: RM92330
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: BK73701
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK73701%27 HTTP/1.1" 200 None
2026-03-27 11:09:38 [auto1.de] INFO: Scrape type for BK73701: 0
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: FS26045
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS26045%27 HTTP/1.1" 200 None
2026-03-27 11:09:38 [auto1.de] INFO: Scrape type for FS26045: 0
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: WX30438
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX30438%27 HTTP/1.1" 200 None
2026-03-27 11:09:38 [auto1.de] INFO: Scrape type for WX30438: 0
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: WW54945
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW54945%27 HTTP/1.1" 200 None
2026-03-27 11:09:38 [auto1.de] INFO: Scrape type for WW54945: 0
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: FE38357
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: ET07412
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: CC57472
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC57472%27 HTTP/1.1" 200 None
2026-03-27 11:09:38 [auto1.de] INFO: Scrape type for CC57472: 0
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: EE74949
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: CE84593
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: MF98327
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: HR44152
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: GR15301
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: MZ37789
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ37789%27 HTTP/1.1" 200 None
2026-03-27 11:09:38 [auto1.de] INFO: Scrape type for MZ37789: 0
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: SG08680
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG08680%27 HTTP/1.1" 200 None
2026-03-27 11:09:38 [auto1.de] INFO: Scrape type for SG08680: 0
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: YT16808
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: FM24732
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM24732%27 HTTP/1.1" 200 None
2026-03-27 11:09:38 [auto1.de] INFO: Scrape type for FM24732: 0
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: VG60095
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG60095%27 HTTP/1.1" 200 None
2026-03-27 11:09:38 [auto1.de] INFO: Scrape type for VG60095: 0
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: YH77655
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: UC60552
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: SE09507
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE09507%27 HTTP/1.1" 200 None
2026-03-27 11:09:38 [auto1.de] INFO: Scrape type for SE09507: 0
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: DV89701
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV89701%27 HTTP/1.1" 200 None
2026-03-27 11:09:38 [auto1.de] INFO: Scrape type for DV89701: 0
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: LP76245
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP76245%27 HTTP/1.1" 200 None
2026-03-27 11:09:38 [auto1.de] INFO: Scrape type for LP76245: 0
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: EB96923
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: WS02487
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: ST39161
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST39161%27 HTTP/1.1" 200 None
2026-03-27 11:09:38 [auto1.de] INFO: Scrape type for ST39161: 0
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: AV13612
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV13612%27 HTTP/1.1" 200 None
2026-03-27 11:09:38 [auto1.de] INFO: Scrape type for AV13612: 0
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: AH58675
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: BN46018
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN46018%27 HTTP/1.1" 200 None
2026-03-27 11:09:38 [auto1.de] INFO: Scrape type for BN46018: 0
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: FZ87366
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: WZ27429
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ27429%27 HTTP/1.1" 200 None
2026-03-27 11:09:38 [auto1.de] INFO: Scrape type for WZ27429: 0
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: YJ47814
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: BC28433
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: ZJ19484
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: ES02537
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: CN06101
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN06101%27 HTTP/1.1" 200 None
2026-03-27 11:09:38 [auto1.de] INFO: Scrape type for CN06101: 0
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: UR14264
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR14264%27 HTTP/1.1" 200 None
2026-03-27 11:09:38 [auto1.de] INFO: Scrape type for UR14264: 0
2026-03-27 11:09:38 [auto1.de] INFO: Found listing with ID: HT41484
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT41484%27 HTTP/1.1" 200 None
2026-03-27 11:09:38 [auto1.de] INFO: Scrape type for HT41484: 0
2026-03-27 11:09:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:10:06 [scrapy.extensions.logstats] INFO: Crawled 696 pages (at 7 pages/min), scraped 923 items (at 0 items/min)
2026-03-27 11:10:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 11:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:10:17 [auto1.de] INFO: Channel: 24h | Page: 229 | totalHits: 10661 | hits on page: 40
2026-03-27 11:10:17 [auto1.de] INFO: Found listing with ID: CN06101
2026-03-27 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN06101%27 HTTP/1.1" 200 None
2026-03-27 11:10:17 [auto1.de] INFO: Scrape type for CN06101: 0
2026-03-27 11:10:17 [auto1.de] INFO: Found listing with ID: UR14264
2026-03-27 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR14264%27 HTTP/1.1" 200 None
2026-03-27 11:10:17 [auto1.de] INFO: Scrape type for UR14264: 0
2026-03-27 11:10:17 [auto1.de] INFO: Found listing with ID: HT41484
2026-03-27 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT41484%27 HTTP/1.1" 200 None
2026-03-27 11:10:17 [auto1.de] INFO: Scrape type for HT41484: 0
2026-03-27 11:10:17 [auto1.de] INFO: Found listing with ID: ZG67202
2026-03-27 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG67202%27 HTTP/1.1" 200 None
2026-03-27 11:10:17 [auto1.de] INFO: Scrape type for ZG67202: 0
2026-03-27 11:10:17 [auto1.de] INFO: Found listing with ID: DX42832
2026-03-27 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX42832%27 HTTP/1.1" 200 None
2026-03-27 11:10:17 [auto1.de] INFO: Scrape type for DX42832: 0
2026-03-27 11:10:17 [auto1.de] INFO: Found listing with ID: TZ90006
2026-03-27 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ90006%27 HTTP/1.1" 200 None
2026-03-27 11:10:17 [auto1.de] INFO: Scrape type for TZ90006: 0
2026-03-27 11:10:17 [auto1.de] INFO: Found listing with ID: FE12352
2026-03-27 11:10:17 [auto1.de] INFO: Found listing with ID: RS08760
2026-03-27 11:10:17 [auto1.de] INFO: Found listing with ID: XK50877
2026-03-27 11:10:17 [auto1.de] INFO: Found listing with ID: SY16661
2026-03-27 11:10:17 [auto1.de] INFO: Found listing with ID: KM04480
2026-03-27 11:10:17 [auto1.de] INFO: Found listing with ID: UD68888
2026-03-27 11:10:17 [auto1.de] INFO: Found listing with ID: XC31328
2026-03-27 11:10:17 [auto1.de] INFO: Found listing with ID: KC01296
2026-03-27 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC01296%27 HTTP/1.1" 200 None
2026-03-27 11:10:17 [auto1.de] INFO: Scrape type for KC01296: 0
2026-03-27 11:10:17 [auto1.de] INFO: Found listing with ID: EH96711
2026-03-27 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH96711%27 HTTP/1.1" 200 None
2026-03-27 11:10:18 [auto1.de] INFO: Scrape type for EH96711: 0
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: KH41700
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH41700%27 HTTP/1.1" 200 None
2026-03-27 11:10:18 [auto1.de] INFO: Scrape type for KH41700: 0
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: VY54552
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: UW48203
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: SE80059
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: SG68469
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG68469%27 HTTP/1.1" 200 None
2026-03-27 11:10:18 [auto1.de] INFO: Scrape type for SG68469: 0
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: TX27735
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: UN86111
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN86111%27 HTTP/1.1" 200 None
2026-03-27 11:10:18 [auto1.de] INFO: Scrape type for UN86111: 0
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: AH65179
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: DG73044
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: PP83297
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP83297%27 HTTP/1.1" 200 None
2026-03-27 11:10:18 [auto1.de] INFO: Scrape type for PP83297: 0
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: PW05275
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW05275%27 HTTP/1.1" 200 None
2026-03-27 11:10:18 [auto1.de] INFO: Scrape type for PW05275: 0
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: CA65942
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65942%27 HTTP/1.1" 200 None
2026-03-27 11:10:18 [auto1.de] INFO: Scrape type for CA65942: 0
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: EU98670
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98670%27 HTTP/1.1" 200 None
2026-03-27 11:10:18 [auto1.de] INFO: Scrape type for EU98670: 0
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: UH11904
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: SM94434
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM94434%27 HTTP/1.1" 200 None
2026-03-27 11:10:18 [auto1.de] INFO: Scrape type for SM94434: 0
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: GV12841
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV12841%27 HTTP/1.1" 200 None
2026-03-27 11:10:18 [auto1.de] INFO: Scrape type for GV12841: 0
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: GZ76571
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ76571%27 HTTP/1.1" 200 None
2026-03-27 11:10:18 [auto1.de] INFO: Scrape type for GZ76571: 0
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: SE43748
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: YY05300
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: KG76209
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG76209%27 HTTP/1.1" 200 None
2026-03-27 11:10:18 [auto1.de] INFO: Scrape type for KG76209: 0
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: LX45168
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: ST98775
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST98775%27 HTTP/1.1" 200 None
2026-03-27 11:10:18 [auto1.de] INFO: Scrape type for ST98775: 0
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: MA82889
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA82889%27 HTTP/1.1" 200 None
2026-03-27 11:10:18 [auto1.de] INFO: Scrape type for MA82889: 0
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: AY74749
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY74749%27 HTTP/1.1" 200 None
2026-03-27 11:10:18 [auto1.de] INFO: Scrape type for AY74749: 0
2026-03-27 11:10:18 [auto1.de] INFO: Found listing with ID: HP53076
2026-03-27 11:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:10:20 [auto1.de] INFO: Channel: 24h | Page: 230 | totalHits: 10661 | hits on page: 40
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: XT25114
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT25114%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for XT25114: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: EJ09252
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: UE11202
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: GC08315
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: UL75790
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL75790%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for UL75790: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: SR63884
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: HW43883
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW43883%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for HW43883: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: UB61823
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB61823%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for UB61823: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: HJ62454
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: GY35476
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY35476%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for GY35476: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: BE16908
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: YL91986
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL91986%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for YL91986: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: DK51297
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK51297%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for DK51297: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: XR73410
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: KX50860
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: HY48346
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY48346%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for HY48346: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: HU93536
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU93536%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for HU93536: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: PC58149
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: DD72399
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD72399%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for DD72399: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: PV02416
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV02416%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for PV02416: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: EZ47162
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ47162%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for EZ47162: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: AE81199
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE81199%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for AE81199: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: KK19800
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: CL06528
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: VY02082
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: YJ21750
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ21750%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for YJ21750: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: PC56188
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: PD50375
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: NX83619
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: TF62892
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: DB69488
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB69488%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for DB69488: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: DX51383
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX51383%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for DX51383: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: LP86406
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP86406%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for LP86406: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: AR60138
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR60138%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for AR60138: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: XJ03116
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ03116%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for XJ03116: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: SX31870
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: GJ75374
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ75374%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for GJ75374: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: LK62819
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK62819%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for LK62819: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: KA32322
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA32322%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for KA32322: 0
2026-03-27 11:10:20 [auto1.de] INFO: Found listing with ID: YT11339
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT11339%27 HTTP/1.1" 200 None
2026-03-27 11:10:20 [auto1.de] INFO: Scrape type for YT11339: 0
2026-03-27 11:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:10:27 [auto1.de] INFO: Channel: 24h | Page: 231 | totalHits: 10661 | hits on page: 40
2026-03-27 11:10:27 [auto1.de] INFO: Found listing with ID: XR09135
2026-03-27 11:10:27 [auto1.de] INFO: Found listing with ID: RD30950
2026-03-27 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD30950%27 HTTP/1.1" 200 None
2026-03-27 11:10:27 [auto1.de] INFO: Scrape type for RD30950: 0
2026-03-27 11:10:27 [auto1.de] INFO: Found listing with ID: KN87388
2026-03-27 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN87388%27 HTTP/1.1" 200 None
2026-03-27 11:10:27 [auto1.de] INFO: Scrape type for KN87388: 0
2026-03-27 11:10:27 [auto1.de] INFO: Found listing with ID: CP99772
2026-03-27 11:10:27 [auto1.de] INFO: Found listing with ID: UA59883
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA59883%27 HTTP/1.1" 200 None
2026-03-27 11:10:28 [auto1.de] INFO: Scrape type for UA59883: 0
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: FD57756
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: KH87635
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH87635%27 HTTP/1.1" 200 None
2026-03-27 11:10:28 [auto1.de] INFO: Scrape type for KH87635: 0
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: XU52502
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU52502%27 HTTP/1.1" 200 None
2026-03-27 11:10:28 [auto1.de] INFO: Scrape type for XU52502: 0
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: JP98585
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP98585%27 HTTP/1.1" 200 None
2026-03-27 11:10:28 [auto1.de] INFO: Scrape type for JP98585: 0
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: JC70183
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: KZ61437
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: DN02562
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN02562%27 HTTP/1.1" 200 None
2026-03-27 11:10:28 [auto1.de] INFO: Scrape type for DN02562: 0
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: PT72928
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT72928%27 HTTP/1.1" 200 None
2026-03-27 11:10:28 [auto1.de] INFO: Scrape type for PT72928: 0
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: KG08192
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: WL56832
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: CB52035
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: TN44984
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: BN76417
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: RV14336
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV14336%27 HTTP/1.1" 200 None
2026-03-27 11:10:28 [auto1.de] INFO: Scrape type for RV14336: 0
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: RV02014
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV02014%27 HTTP/1.1" 200 None
2026-03-27 11:10:28 [auto1.de] INFO: Scrape type for RV02014: 0
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: UM14784
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM14784%27 HTTP/1.1" 200 None
2026-03-27 11:10:28 [auto1.de] INFO: Scrape type for UM14784: 0
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: ZE88330
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE88330%27 HTTP/1.1" 200 None
2026-03-27 11:10:28 [auto1.de] INFO: Scrape type for ZE88330: 0
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: MP52945
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: MH83701
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: UF80186
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF80186%27 HTTP/1.1" 200 None
2026-03-27 11:10:28 [auto1.de] INFO: Scrape type for UF80186: 0
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: YC90372
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: EK94412
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: EJ12041
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: GJ53227
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ53227%27 HTTP/1.1" 200 None
2026-03-27 11:10:28 [auto1.de] INFO: Scrape type for GJ53227: 0
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: SJ97268
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ97268%27 HTTP/1.1" 200 None
2026-03-27 11:10:28 [auto1.de] INFO: Scrape type for SJ97268: 0
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: PP85770
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: MB83489
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB83489%27 HTTP/1.1" 200 None
2026-03-27 11:10:28 [auto1.de] INFO: Scrape type for MB83489: 0
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: YY19180
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY19180%27 HTTP/1.1" 200 None
2026-03-27 11:10:28 [auto1.de] INFO: Scrape type for YY19180: 0
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: PF87060
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: AF99280
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF99280%27 HTTP/1.1" 200 None
2026-03-27 11:10:28 [auto1.de] INFO: Scrape type for AF99280: 0
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: TE46043
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: MA51695
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: YZ55782
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ55782%27 HTTP/1.1" 200 None
2026-03-27 11:10:28 [auto1.de] INFO: Scrape type for YZ55782: 0
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: ZZ55407
2026-03-27 11:10:28 [auto1.de] INFO: Found listing with ID: KR99013
2026-03-27 11:10:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:11:03 [auto1.de] INFO: Channel: 24h | Page: 232 | totalHits: 10666 | hits on page: 40
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: TE46043
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: MA51695
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: YZ55782
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ55782%27 HTTP/1.1" 200 None
2026-03-27 11:11:03 [auto1.de] INFO: Scrape type for YZ55782: 0
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: ZZ55407
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: KR99013
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: RT09261
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT09261%27 HTTP/1.1" 200 None
2026-03-27 11:11:03 [auto1.de] INFO: Scrape type for RT09261: 0
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: WP14042
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP14042%27 HTTP/1.1" 200 None
2026-03-27 11:11:03 [auto1.de] INFO: Scrape type for WP14042: 0
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: MT99965
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: XS50752
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: WP71067
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP71067%27 HTTP/1.1" 200 None
2026-03-27 11:11:03 [auto1.de] INFO: Scrape type for WP71067: 0
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: JM70147
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM70147%27 HTTP/1.1" 200 None
2026-03-27 11:11:03 [auto1.de] INFO: Scrape type for JM70147: 0
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: AM47417
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: RL20580
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: UB74163
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB74163%27 HTTP/1.1" 200 None
2026-03-27 11:11:03 [auto1.de] INFO: Scrape type for UB74163: 0
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: TH10598
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: WT76728
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT76728%27 HTTP/1.1" 200 None
2026-03-27 11:11:03 [auto1.de] INFO: Scrape type for WT76728: 0
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: AS79616
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: ZG00805
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: GF35852
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: SS30943
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS30943%27 HTTP/1.1" 200 None
2026-03-27 11:11:03 [auto1.de] INFO: Scrape type for SS30943: 0
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: PL23541
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: HU97464
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: MK09620
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: CX50338
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX50338%27 HTTP/1.1" 200 None
2026-03-27 11:11:03 [auto1.de] INFO: Scrape type for CX50338: 0
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: ED27900
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: LN34178
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN34178%27 HTTP/1.1" 200 None
2026-03-27 11:11:03 [auto1.de] INFO: Scrape type for LN34178: 0
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: UW61615
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: AD58556
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD58556%27 HTTP/1.1" 200 None
2026-03-27 11:11:03 [auto1.de] INFO: Scrape type for AD58556: 0
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: ZP35673
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP35673%27 HTTP/1.1" 200 None
2026-03-27 11:11:03 [auto1.de] INFO: Scrape type for ZP35673: 0
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: WV73288
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: BR96483
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: SV23538
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV23538%27 HTTP/1.1" 200 None
2026-03-27 11:11:03 [auto1.de] INFO: Scrape type for SV23538: 0
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: TA12714
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: NV16288
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV16288%27 HTTP/1.1" 200 None
2026-03-27 11:11:03 [auto1.de] INFO: Scrape type for NV16288: 0
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: EX53387
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX53387%27 HTTP/1.1" 200 None
2026-03-27 11:11:03 [auto1.de] INFO: Scrape type for EX53387: 0
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: MN42254
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN42254%27 HTTP/1.1" 200 None
2026-03-27 11:11:03 [auto1.de] INFO: Scrape type for MN42254: 0
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: PV67596
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: JG99974
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: ZW69442
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW69442%27 HTTP/1.1" 200 None
2026-03-27 11:11:03 [auto1.de] INFO: Scrape type for ZW69442: 0
2026-03-27 11:11:03 [auto1.de] INFO: Found listing with ID: VH61695
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61695%27 HTTP/1.1" 200 None
2026-03-27 11:11:03 [auto1.de] INFO: Scrape type for VH61695: 0
2026-03-27 11:11:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:11:06 [scrapy.extensions.logstats] INFO: Crawled 700 pages (at 4 pages/min), scraped 923 items (at 0 items/min)
2026-03-27 11:11:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 11:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:11:15 [auto1.de] INFO: Channel: 24h | Page: 233 | totalHits: 10666 | hits on page: 40
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: VY07286
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: SH34786
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH34786%27 HTTP/1.1" 200 None
2026-03-27 11:11:15 [auto1.de] INFO: Scrape type for SH34786: 0
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: ZU61173
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: EW02544
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW02544%27 HTTP/1.1" 200 None
2026-03-27 11:11:15 [auto1.de] INFO: Scrape type for EW02544: 0
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: TS98939
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS98939%27 HTTP/1.1" 200 None
2026-03-27 11:11:15 [auto1.de] INFO: Scrape type for TS98939: 0
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: KY51324
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: TG41269
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: ZW06761
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: PT15230
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT15230%27 HTTP/1.1" 200 None
2026-03-27 11:11:15 [auto1.de] INFO: Scrape type for PT15230: 0
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: KE52706
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: SM68052
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: ZM65960
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM65960%27 HTTP/1.1" 200 None
2026-03-27 11:11:15 [auto1.de] INFO: Scrape type for ZM65960: 0
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: CA88273
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: HE35464
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: NG76002
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: JN76212
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: HM11779
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: EH98635
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: GF78107
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: KU16473
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: EG70840
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: UA25868
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA25868%27 HTTP/1.1" 200 None
2026-03-27 11:11:15 [auto1.de] INFO: Scrape type for UA25868: 0
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: XS27718
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS27718%27 HTTP/1.1" 200 None
2026-03-27 11:11:15 [auto1.de] INFO: Scrape type for XS27718: 0
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: ZB74366
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: CP53308
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: HV40211
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: VS90710
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: UZ18000
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: SB50854
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: WA59157
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: TC82828
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC82828%27 HTTP/1.1" 200 None
2026-03-27 11:11:15 [auto1.de] INFO: Scrape type for TC82828: 0
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: WH66881
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: HJ82357
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: YZ73060
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: MD91791
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD91791%27 HTTP/1.1" 200 None
2026-03-27 11:11:15 [auto1.de] INFO: Scrape type for MD91791: 0
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: SM03586
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: DG70282
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG70282%27 HTTP/1.1" 200 None
2026-03-27 11:11:15 [auto1.de] INFO: Scrape type for DG70282: 0
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: KK88346
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK88346%27 HTTP/1.1" 200 None
2026-03-27 11:11:15 [auto1.de] INFO: Scrape type for KK88346: 0
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: JD76793
2026-03-27 11:11:15 [auto1.de] INFO: Found listing with ID: HV21869
2026-03-27 11:11:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:11:22 [auto1.de] INFO: Channel: 24h | Page: 234 | totalHits: 10666 | hits on page: 40
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: FZ60509
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: BB15265
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB15265%27 HTTP/1.1" 200 None
2026-03-27 11:11:22 [auto1.de] INFO: Scrape type for BB15265: 0
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: ZU57618
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: VG60146
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG60146%27 HTTP/1.1" 200 None
2026-03-27 11:11:22 [auto1.de] INFO: Scrape type for VG60146: 0
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: UY21095
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY21095%27 HTTP/1.1" 200 None
2026-03-27 11:11:22 [auto1.de] INFO: Scrape type for UY21095: 0
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: HM75653
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM75653%27 HTTP/1.1" 200 None
2026-03-27 11:11:22 [auto1.de] INFO: Scrape type for HM75653: 0
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: WR55651
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR55651%27 HTTP/1.1" 200 None
2026-03-27 11:11:22 [auto1.de] INFO: Scrape type for WR55651: 0
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: XL14326
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL14326%27 HTTP/1.1" 200 None
2026-03-27 11:11:22 [auto1.de] INFO: Scrape type for XL14326: 0
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: XV87595
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: DG36538
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG36538%27 HTTP/1.1" 200 None
2026-03-27 11:11:22 [auto1.de] INFO: Scrape type for DG36538: 0
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: MT90802
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: MF63690
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF63690%27 HTTP/1.1" 200 None
2026-03-27 11:11:22 [auto1.de] INFO: Scrape type for MF63690: 0
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: SZ45535
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ45535%27 HTTP/1.1" 200 None
2026-03-27 11:11:22 [auto1.de] INFO: Scrape type for SZ45535: 0
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: AA51921
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: SW44796
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: HR12459
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR12459%27 HTTP/1.1" 200 None
2026-03-27 11:11:22 [auto1.de] INFO: Scrape type for HR12459: 0
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: WN03095
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: NV31897
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV31897%27 HTTP/1.1" 200 None
2026-03-27 11:11:22 [auto1.de] INFO: Scrape type for NV31897: 0
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: FZ63336
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ63336%27 HTTP/1.1" 200 None
2026-03-27 11:11:22 [auto1.de] INFO: Scrape type for FZ63336: 0
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: TF40616
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF40616%27 HTTP/1.1" 200 None
2026-03-27 11:11:22 [auto1.de] INFO: Scrape type for TF40616: 0
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: BT36587
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: AK43100
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: RE06888
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: XR15758
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: FT65392
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT65392%27 HTTP/1.1" 200 None
2026-03-27 11:11:22 [auto1.de] INFO: Scrape type for FT65392: 0
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: JL26666
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: PA62833
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA62833%27 HTTP/1.1" 200 None
2026-03-27 11:11:22 [auto1.de] INFO: Scrape type for PA62833: 0
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: GR38931
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR38931%27 HTTP/1.1" 200 None
2026-03-27 11:11:22 [auto1.de] INFO: Scrape type for GR38931: 0
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: WB37074
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: GR91589
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: XP95900
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: KN98252
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN98252%27 HTTP/1.1" 200 None
2026-03-27 11:11:22 [auto1.de] INFO: Scrape type for KN98252: 0
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: LU55179
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU55179%27 HTTP/1.1" 200 None
2026-03-27 11:11:22 [auto1.de] INFO: Scrape type for LU55179: 0
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: TP67168
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: PG33349
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: MA41049
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: YZ02891
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ02891%27 HTTP/1.1" 200 None
2026-03-27 11:11:22 [auto1.de] INFO: Scrape type for YZ02891: 0
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: XD50788
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD50788%27 HTTP/1.1" 200 None
2026-03-27 11:11:22 [auto1.de] INFO: Scrape type for XD50788: 0
2026-03-27 11:11:22 [auto1.de] INFO: Found listing with ID: LT13241
2026-03-27 11:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT13241%27 HTTP/1.1" 200 None
2026-03-27 11:11:23 [auto1.de] INFO: Scrape type for LT13241: 0
2026-03-27 11:11:23 [auto1.de] INFO: Found listing with ID: NY59732
2026-03-27 11:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY59732%27 HTTP/1.1" 200 None
2026-03-27 11:11:23 [auto1.de] INFO: Scrape type for NY59732: 0
2026-03-27 11:11:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:11:24 [auto1.de] INFO: Channel: 24h | Page: 235 | totalHits: 10666 | hits on page: 40
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: DX01657
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: RM13353
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM13353%27 HTTP/1.1" 200 None
2026-03-27 11:11:24 [auto1.de] INFO: Scrape type for RM13353: 0
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: VS10261
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: KY16497
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: FE62159
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE62159%27 HTTP/1.1" 200 None
2026-03-27 11:11:24 [auto1.de] INFO: Scrape type for FE62159: 0
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: BZ53185
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: HV72401
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV72401%27 HTTP/1.1" 200 None
2026-03-27 11:11:24 [auto1.de] INFO: Scrape type for HV72401: 0
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: BY97768
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: KF64937
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: UF58370
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: MA12811
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA12811%27 HTTP/1.1" 200 None
2026-03-27 11:11:24 [auto1.de] INFO: Scrape type for MA12811: 0
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: UH78050
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: MH48828
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH48828%27 HTTP/1.1" 200 None
2026-03-27 11:11:24 [auto1.de] INFO: Scrape type for MH48828: 0
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: LM30127
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: GD15410
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD15410%27 HTTP/1.1" 200 None
2026-03-27 11:11:24 [auto1.de] INFO: Scrape type for GD15410: 0
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: XE77714
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE77714%27 HTTP/1.1" 200 None
2026-03-27 11:11:24 [auto1.de] INFO: Scrape type for XE77714: 0
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: XC51801
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: LB57303
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: PA09004
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: ZP65093
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: SV18867
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: XN65057
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN65057%27 HTTP/1.1" 200 None
2026-03-27 11:11:24 [auto1.de] INFO: Scrape type for XN65057: 0
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: PT91078
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT91078%27 HTTP/1.1" 200 None
2026-03-27 11:11:24 [auto1.de] INFO: Scrape type for PT91078: 0
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: GF03310
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: BL43167
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: YN15948
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: RY74768
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: DX64051
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: RN23486
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: ZG14470
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: NU91903
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: SC05662
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: TH98147
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH98147%27 HTTP/1.1" 200 None
2026-03-27 11:11:24 [auto1.de] INFO: Scrape type for TH98147: 0
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: BH71289
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: HE34283
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE34283%27 HTTP/1.1" 200 None
2026-03-27 11:11:24 [auto1.de] INFO: Scrape type for HE34283: 0
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: UR98494
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR98494%27 HTTP/1.1" 200 None
2026-03-27 11:11:24 [auto1.de] INFO: Scrape type for UR98494: 0
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: JR17780
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: KB34579
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB34579%27 HTTP/1.1" 200 None
2026-03-27 11:11:24 [auto1.de] INFO: Scrape type for KB34579: 0
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: JE63209
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE63209%27 HTTP/1.1" 200 None
2026-03-27 11:11:24 [auto1.de] INFO: Scrape type for JE63209: 0
2026-03-27 11:11:24 [auto1.de] INFO: Found listing with ID: NR35132
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35132%27 HTTP/1.1" 200 None
2026-03-27 11:11:24 [auto1.de] INFO: Scrape type for NR35132: 0
2026-03-27 11:11:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:11:26 [auto1.de] INFO: Channel: 24h | Page: 236 | totalHits: 10666 | hits on page: 40
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: JK70703
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: UM78498
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: LA89414
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA89414%27 HTTP/1.1" 200 None
2026-03-27 11:11:26 [auto1.de] INFO: Scrape type for LA89414: 0
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: RG61391
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG61391%27 HTTP/1.1" 200 None
2026-03-27 11:11:26 [auto1.de] INFO: Scrape type for RG61391: 0
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: MJ60258
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ60258%27 HTTP/1.1" 200 None
2026-03-27 11:11:26 [auto1.de] INFO: Scrape type for MJ60258: 0
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: WE79254
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: TT67137
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67137%27 HTTP/1.1" 200 None
2026-03-27 11:11:26 [auto1.de] INFO: Scrape type for TT67137: 0
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: YL64188
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: LZ96644
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: RC84625
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: LM88961
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: SS17412
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: JK17936
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK17936%27 HTTP/1.1" 200 None
2026-03-27 11:11:26 [auto1.de] INFO: Scrape type for JK17936: 0
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: LL99453
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL99453%27 HTTP/1.1" 200 None
2026-03-27 11:11:26 [auto1.de] INFO: Scrape type for LL99453: 0
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: RM81648
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM81648%27 HTTP/1.1" 200 None
2026-03-27 11:11:26 [auto1.de] INFO: Scrape type for RM81648: 0
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: UY51096
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY51096%27 HTTP/1.1" 200 None
2026-03-27 11:11:26 [auto1.de] INFO: Scrape type for UY51096: 0
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: AU66427
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: XE56865
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE56865%27 HTTP/1.1" 200 None
2026-03-27 11:11:26 [auto1.de] INFO: Scrape type for XE56865: 0
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: TG50792
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: GE87881
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: MK91624
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK91624%27 HTTP/1.1" 200 None
2026-03-27 11:11:26 [auto1.de] INFO: Scrape type for MK91624: 0
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: LZ26330
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ26330%27 HTTP/1.1" 200 None
2026-03-27 11:11:26 [auto1.de] INFO: Scrape type for LZ26330: 0
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: NX47984
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX47984%27 HTTP/1.1" 200 None
2026-03-27 11:11:26 [auto1.de] INFO: Scrape type for NX47984: 0
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: DP64260
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP64260%27 HTTP/1.1" 200 None
2026-03-27 11:11:26 [auto1.de] INFO: Scrape type for DP64260: 0
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: ZJ58005
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: UL71230
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: AU38078
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: HZ20287
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: VV79476
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV79476%27 HTTP/1.1" 200 None
2026-03-27 11:11:26 [auto1.de] INFO: Scrape type for VV79476: 0
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: CL15351
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL15351%27 HTTP/1.1" 200 None
2026-03-27 11:11:26 [auto1.de] INFO: Scrape type for CL15351: 0
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: HS42053
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS42053%27 HTTP/1.1" 200 None
2026-03-27 11:11:26 [auto1.de] INFO: Scrape type for HS42053: 0
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: HX55522
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX55522%27 HTTP/1.1" 200 None
2026-03-27 11:11:26 [auto1.de] INFO: Scrape type for HX55522: 0
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: HX46540
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX46540%27 HTTP/1.1" 200 None
2026-03-27 11:11:26 [auto1.de] INFO: Scrape type for HX46540: 0
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: PJ53054
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: KH22589
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: YN38539
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: VL78522
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: FX11245
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX11245%27 HTTP/1.1" 200 None
2026-03-27 11:11:26 [auto1.de] INFO: Scrape type for FX11245: 0
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: SR45801
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR45801%27 HTTP/1.1" 200 None
2026-03-27 11:11:26 [auto1.de] INFO: Scrape type for SR45801: 0
2026-03-27 11:11:26 [auto1.de] INFO: Found listing with ID: LS49952
2026-03-27 11:11:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:11:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:11:28 [auto1.de] INFO: Channel: 24h | Page: 237 | totalHits: 10666 | hits on page: 40
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: SP90277
2026-03-27 11:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP90277%27 HTTP/1.1" 200 None
2026-03-27 11:11:28 [auto1.de] INFO: Scrape type for SP90277: 0
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: JF12446
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: ED43113
2026-03-27 11:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED43113%27 HTTP/1.1" 200 None
2026-03-27 11:11:28 [auto1.de] INFO: Scrape type for ED43113: 0
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: TL72428
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: HF93741
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: CZ98836
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: MG52367
2026-03-27 11:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG52367%27 HTTP/1.1" 200 None
2026-03-27 11:11:28 [auto1.de] INFO: Scrape type for MG52367: 0
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: YJ52051
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: UY95441
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: DF27266
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: AB27737
2026-03-27 11:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB27737%27 HTTP/1.1" 200 None
2026-03-27 11:11:28 [auto1.de] INFO: Scrape type for AB27737: 0
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: ER22754
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: PY07739
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: PY88123
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: FJ09626
2026-03-27 11:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ09626%27 HTTP/1.1" 200 None
2026-03-27 11:11:28 [auto1.de] INFO: Scrape type for FJ09626: 0
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: DU80644
2026-03-27 11:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU80644%27 HTTP/1.1" 200 None
2026-03-27 11:11:28 [auto1.de] INFO: Scrape type for DU80644: 0
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: UA17642
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: WA59870
2026-03-27 11:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA59870%27 HTTP/1.1" 200 None
2026-03-27 11:11:28 [auto1.de] INFO: Scrape type for WA59870: 0
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: GY99851
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: JA27410
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: EY26571
2026-03-27 11:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY26571%27 HTTP/1.1" 200 None
2026-03-27 11:11:28 [auto1.de] INFO: Scrape type for EY26571: 0
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: JL76063
2026-03-27 11:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL76063%27 HTTP/1.1" 200 None
2026-03-27 11:11:28 [auto1.de] INFO: Scrape type for JL76063: 0
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: KG01306
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: XF58855
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: TK34912
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: NT88605
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: JU62614
2026-03-27 11:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU62614%27 HTTP/1.1" 200 None
2026-03-27 11:11:28 [auto1.de] INFO: Scrape type for JU62614: 0
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: KX26949
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: BH13413
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: RT01969
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: KR20197
2026-03-27 11:11:28 [auto1.de] INFO: Found listing with ID: CV14435
2026-03-27 11:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV14435%27 HTTP/1.1" 200 None
2026-03-27 11:11:29 [auto1.de] INFO: Scrape type for CV14435: 0
2026-03-27 11:11:29 [auto1.de] INFO: Found listing with ID: TK41211
2026-03-27 11:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK41211%27 HTTP/1.1" 200 None
2026-03-27 11:11:29 [auto1.de] INFO: Scrape type for TK41211: 0
2026-03-27 11:11:29 [auto1.de] INFO: Found listing with ID: CF43434
2026-03-27 11:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF43434%27 HTTP/1.1" 200 None
2026-03-27 11:11:29 [auto1.de] INFO: Scrape type for CF43434: 0
2026-03-27 11:11:29 [auto1.de] INFO: Found listing with ID: ZZ55238
2026-03-27 11:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ55238%27 HTTP/1.1" 200 None
2026-03-27 11:11:29 [auto1.de] INFO: Scrape type for ZZ55238: 0
2026-03-27 11:11:29 [auto1.de] INFO: Found listing with ID: EX67540
2026-03-27 11:11:29 [auto1.de] INFO: Found listing with ID: DC50657
2026-03-27 11:11:29 [auto1.de] INFO: Found listing with ID: ZY67116
2026-03-27 11:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY67116%27 HTTP/1.1" 200 None
2026-03-27 11:11:29 [auto1.de] INFO: Scrape type for ZY67116: 0
2026-03-27 11:11:29 [auto1.de] INFO: Found listing with ID: KS41473
2026-03-27 11:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS41473%27 HTTP/1.1" 200 None
2026-03-27 11:11:29 [auto1.de] INFO: Scrape type for KS41473: 0
2026-03-27 11:11:29 [auto1.de] INFO: Found listing with ID: WR26669
2026-03-27 11:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR26669%27 HTTP/1.1" 200 None
2026-03-27 11:11:29 [auto1.de] INFO: Scrape type for WR26669: 0
2026-03-27 11:11:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:11:43 [auto1.de] INFO: Channel: 24h | Page: 238 | totalHits: 10668 | hits on page: 40
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: KS41473
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS41473%27 HTTP/1.1" 200 None
2026-03-27 11:11:43 [auto1.de] INFO: Scrape type for KS41473: 0
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: WR26669
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR26669%27 HTTP/1.1" 200 None
2026-03-27 11:11:43 [auto1.de] INFO: Scrape type for WR26669: 0
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: FP35448
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: ZF63164
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: SW28229
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW28229%27 HTTP/1.1" 200 None
2026-03-27 11:11:43 [auto1.de] INFO: Scrape type for SW28229: 0
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: RZ53370
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: CV86752
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV86752%27 HTTP/1.1" 200 None
2026-03-27 11:11:43 [auto1.de] INFO: Scrape type for CV86752: 0
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: TL08912
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: CK27476
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: RR42480
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: PA77354
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA77354%27 HTTP/1.1" 200 None
2026-03-27 11:11:43 [auto1.de] INFO: Scrape type for PA77354: 0
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: WP28886
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: YN98514
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: DG24182
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: GJ62462
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: WJ04835
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: GK14526
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: UF19032
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF19032%27 HTTP/1.1" 200 None
2026-03-27 11:11:43 [auto1.de] INFO: Scrape type for UF19032: 0
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: HX36326
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX36326%27 HTTP/1.1" 200 None
2026-03-27 11:11:43 [auto1.de] INFO: Scrape type for HX36326: 0
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: CS93004
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS93004%27 HTTP/1.1" 200 None
2026-03-27 11:11:43 [auto1.de] INFO: Scrape type for CS93004: 0
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: GW30453
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW30453%27 HTTP/1.1" 200 None
2026-03-27 11:11:43 [auto1.de] INFO: Scrape type for GW30453: 0
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: PR68171
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR68171%27 HTTP/1.1" 200 None
2026-03-27 11:11:43 [auto1.de] INFO: Scrape type for PR68171: 0
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: UN48068
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: EK27182
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK27182%27 HTTP/1.1" 200 None
2026-03-27 11:11:43 [auto1.de] INFO: Scrape type for EK27182: 0
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: ZG88444
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG88444%27 HTTP/1.1" 200 None
2026-03-27 11:11:43 [auto1.de] INFO: Scrape type for ZG88444: 0
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: UB61530
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: AY25775
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY25775%27 HTTP/1.1" 200 None
2026-03-27 11:11:43 [auto1.de] INFO: Scrape type for AY25775: 0
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: UY68757
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY68757%27 HTTP/1.1" 200 None
2026-03-27 11:11:43 [auto1.de] INFO: Scrape type for UY68757: 0
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: XS93446
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS93446%27 HTTP/1.1" 200 None
2026-03-27 11:11:43 [auto1.de] INFO: Scrape type for XS93446: 0
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: PK18306
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: AM64478
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM64478%27 HTTP/1.1" 200 None
2026-03-27 11:11:43 [auto1.de] INFO: Scrape type for AM64478: 0
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: RE35722
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: FM53272
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: PD72391
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: PS10948
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS10948%27 HTTP/1.1" 200 None
2026-03-27 11:11:43 [auto1.de] INFO: Scrape type for PS10948: 0
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: GM59339
2026-03-27 11:11:43 [auto1.de] INFO: Found listing with ID: PF14640
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF14640%27 HTTP/1.1" 200 None
2026-03-27 11:11:43 [auto1.de] INFO: Scrape type for PF14640: 2
2026-03-27 11:11:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a4f48d8-75d2-53b5-8676-10b07587cd4e with identifier: PF14640
2026-03-27 11:11:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a4f48d8-75d2-53b5-8676-10b07587cd4e with scrape type 2
2026-03-27 11:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a4f48d8-75d2-53b5-8676-10b07587cd4e with scrape type 2
2026-03-27 11:11:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a4f48d8-75d2-53b5-8676-10b07587cd4e, identifier: PF14640
2026-03-27 11:11:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a4f48d8-75d2-53b5-8676-10b07587cd4e with identifier: PF14640
2026-03-27 11:11:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a4f48d8-75d2-53b5-8676-10b07587cd4e with identifier: PF14640
2026-03-27 11:11:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a4f48d8-75d2-53b5-8676-10b07587cd4e with identifier: PF14640 to the API
2026-03-27 11:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:11:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:11:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-27T16:05:43Z',
 'fuel_type': 'petrol',
 'id': '6a4f48d8-75d2-53b5-8676-10b07587cd4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF14640',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 100907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-27 11:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF14640%27 HTTP/1.1" 200 None
2026-03-27 11:11:44 [auto1.de] INFO: Saving data for PF14640: {'auction_closing_time': 1774627543.0, 'created_time': 1774521608.428813, 'last_price_update_time': 1774609904.789053}
2026-03-27 11:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF14640') HTTP/1.1" 204 0
2026-03-27 11:11:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:11:44 [auto1.de] INFO: Found listing with ID: XR30933
2026-03-27 11:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR30933%27 HTTP/1.1" 200 None
2026-03-27 11:11:44 [auto1.de] INFO: Scrape type for XR30933: 2
2026-03-27 11:11:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62d4e062-82c8-5091-a3ab-fcbf0a3ee14e with identifier: XR30933
2026-03-27 11:11:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62d4e062-82c8-5091-a3ab-fcbf0a3ee14e with scrape type 2
2026-03-27 11:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62d4e062-82c8-5091-a3ab-fcbf0a3ee14e with scrape type 2
2026-03-27 11:11:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62d4e062-82c8-5091-a3ab-fcbf0a3ee14e, identifier: XR30933
2026-03-27 11:11:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62d4e062-82c8-5091-a3ab-fcbf0a3ee14e with identifier: XR30933
2026-03-27 11:11:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62d4e062-82c8-5091-a3ab-fcbf0a3ee14e with identifier: XR30933
2026-03-27 11:11:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62d4e062-82c8-5091-a3ab-fcbf0a3ee14e with identifier: XR30933 to the API
2026-03-27 11:11:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:11:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:11:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:02:26Z',
 'fuel_type': 'petrol',
 'id': '62d4e062-82c8-5091-a3ab-fcbf0a3ee14e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR30933',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 103570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-07',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT ACT',
 'transmission': 'manual',
 'trim': 'ACT',
 'year': 2018}
2026-03-27 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR30933%27 HTTP/1.1" 200 None
2026-03-27 11:11:45 [auto1.de] INFO: Saving data for XR30933: {'auction_closing_time': 1774627346.0, 'created_time': 1774521546.322635, 'last_price_update_time': 1774609905.370896}
2026-03-27 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR30933') HTTP/1.1" 204 0
2026-03-27 11:11:45 [auto1.de] INFO: Found listing with ID: PJ78874
2026-03-27 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ78874%27 HTTP/1.1" 200 None
2026-03-27 11:11:45 [auto1.de] INFO: Scrape type for PJ78874: 2
2026-03-27 11:11:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 710b2d8f-07fc-5626-804d-69a6cb6cf8e3 with identifier: PJ78874
2026-03-27 11:11:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 710b2d8f-07fc-5626-804d-69a6cb6cf8e3 with scrape type 2
2026-03-27 11:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 710b2d8f-07fc-5626-804d-69a6cb6cf8e3 with scrape type 2
2026-03-27 11:11:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 710b2d8f-07fc-5626-804d-69a6cb6cf8e3, identifier: PJ78874
2026-03-27 11:11:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 710b2d8f-07fc-5626-804d-69a6cb6cf8e3 with identifier: PJ78874
2026-03-27 11:11:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 710b2d8f-07fc-5626-804d-69a6cb6cf8e3 with identifier: PJ78874
2026-03-27 11:11:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 710b2d8f-07fc-5626-804d-69a6cb6cf8e3 with identifier: PJ78874 to the API
2026-03-27 11:11:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:11:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:11:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-27T16:26:30Z',
 'fuel_type': 'hybrid',
 'id': '710b2d8f-07fc-5626-804d-69a6cb6cf8e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ78874',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 41729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-27',
 'seller_name': None,
 'title': 'Opel Grandland X 1.6 Plug-in Hybrid Ultimate',
 'transmission': 'automatic',
 'trim': 'Ultimate',
 'year': 2021}
2026-03-27 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ78874%27 HTTP/1.1" 200 None
2026-03-27 11:11:45 [auto1.de] INFO: Saving data for PJ78874: {'auction_closing_time': 1774628790.0, 'created_time': 1774521830.514971, 'last_price_update_time': 1774609905.845516}
2026-03-27 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ78874') HTTP/1.1" 204 0
2026-03-27 11:11:45 [auto1.de] INFO: Found listing with ID: UR32228
2026-03-27 11:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:11:47 [auto1.de] INFO: Channel: 24h | Page: 239 | totalHits: 10668 | hits on page: 40
2026-03-27 11:11:47 [auto1.de] INFO: Found listing with ID: YV51703
2026-03-27 11:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV51703%27 HTTP/1.1" 200 None
2026-03-27 11:11:47 [auto1.de] INFO: Scrape type for YV51703: 2
2026-03-27 11:11:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b35c82d1-99d6-5aa3-8e3b-de58610965be with identifier: YV51703
2026-03-27 11:11:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b35c82d1-99d6-5aa3-8e3b-de58610965be with scrape type 2
2026-03-27 11:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b35c82d1-99d6-5aa3-8e3b-de58610965be with scrape type 2
2026-03-27 11:11:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b35c82d1-99d6-5aa3-8e3b-de58610965be, identifier: YV51703
2026-03-27 11:11:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b35c82d1-99d6-5aa3-8e3b-de58610965be with identifier: YV51703
2026-03-27 11:11:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b35c82d1-99d6-5aa3-8e3b-de58610965be with identifier: YV51703
2026-03-27 11:11:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b35c82d1-99d6-5aa3-8e3b-de58610965be with identifier: YV51703 to the API
2026-03-27 11:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:11:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:11:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-27T16:28:23Z',
 'fuel_type': 'petrol',
 'id': 'b35c82d1-99d6-5aa3-8e3b-de58610965be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV51703',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 44263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-12',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Ghia',
 'transmission': 'automatic',
 'trim': 'Ghia',
 'year': 2009}
2026-03-27 11:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV51703%27 HTTP/1.1" 200 None
2026-03-27 11:11:49 [auto1.de] INFO: Saving data for YV51703: {'auction_closing_time': 1774628903.0, 'created_time': 1774521370.698568, 'last_price_update_time': 1774609909.057772}
2026-03-27 11:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV51703') HTTP/1.1" 204 0
2026-03-27 11:11:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:11:49 [auto1.de] INFO: Found listing with ID: NY21217
2026-03-27 11:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21217%27 HTTP/1.1" 200 None
2026-03-27 11:11:49 [auto1.de] INFO: Scrape type for NY21217: 2
2026-03-27 11:11:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5354c06-711e-5a00-aef7-3de8a7d627d6 with identifier: NY21217
2026-03-27 11:11:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5354c06-711e-5a00-aef7-3de8a7d627d6 with scrape type 2
2026-03-27 11:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5354c06-711e-5a00-aef7-3de8a7d627d6 with scrape type 2
2026-03-27 11:11:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5354c06-711e-5a00-aef7-3de8a7d627d6, identifier: NY21217
2026-03-27 11:11:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5354c06-711e-5a00-aef7-3de8a7d627d6 with identifier: NY21217
2026-03-27 11:11:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5354c06-711e-5a00-aef7-3de8a7d627d6 with identifier: NY21217
2026-03-27 11:11:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5354c06-711e-5a00-aef7-3de8a7d627d6 with identifier: NY21217 to the API
2026-03-27 11:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:11:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:11:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 330,
 'expiration_date': '2026-03-27T16:33:36Z',
 'fuel_type': 'diesel',
 'id': 'c5354c06-711e-5a00-aef7-3de8a7d627d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY21217',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 131661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-25',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 400 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2021}
2026-03-27 11:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21217%27 HTTP/1.1" 200 None
2026-03-27 11:11:49 [auto1.de] INFO: Saving data for NY21217: {'auction_closing_time': 1774629216.0, 'created_time': 1774521415.441809, 'last_price_update_time': 1774609909.576926}
2026-03-27 11:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY21217') HTTP/1.1" 204 0
2026-03-27 11:11:49 [auto1.de] INFO: Found listing with ID: FK68648
2026-03-27 11:11:49 [auto1.de] INFO: Found listing with ID: AG24612
2026-03-27 11:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG24612%27 HTTP/1.1" 200 None
2026-03-27 11:11:49 [auto1.de] INFO: Scrape type for AG24612: 2
2026-03-27 11:11:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83c72ebc-8b5c-5269-8ab5-656ab2f051bc with identifier: AG24612
2026-03-27 11:11:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83c72ebc-8b5c-5269-8ab5-656ab2f051bc with scrape type 2
2026-03-27 11:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83c72ebc-8b5c-5269-8ab5-656ab2f051bc with scrape type 2
2026-03-27 11:11:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83c72ebc-8b5c-5269-8ab5-656ab2f051bc, identifier: AG24612
2026-03-27 11:11:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83c72ebc-8b5c-5269-8ab5-656ab2f051bc with identifier: AG24612
2026-03-27 11:11:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83c72ebc-8b5c-5269-8ab5-656ab2f051bc with identifier: AG24612
2026-03-27 11:11:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83c72ebc-8b5c-5269-8ab5-656ab2f051bc with identifier: AG24612 to the API
2026-03-27 11:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:11:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:11:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:39:26Z',
 'fuel_type': 'diesel',
 'id': '83c72ebc-8b5c-5269-8ab5-656ab2f051bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG24612',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 204163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-04',
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 200 d Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2021}
2026-03-27 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG24612%27 HTTP/1.1" 200 None
2026-03-27 11:11:50 [auto1.de] INFO: Saving data for AG24612: {'auction_closing_time': 1774629566.0, 'created_time': 1774521374.437965, 'last_price_update_time': 1774609910.105836}
2026-03-27 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG24612') HTTP/1.1" 204 0
2026-03-27 11:11:50 [auto1.de] INFO: Found listing with ID: BF09730
2026-03-27 11:11:50 [auto1.de] INFO: Found listing with ID: YM11561
2026-03-27 11:11:50 [auto1.de] INFO: Found listing with ID: UY74953
2026-03-27 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY74953%27 HTTP/1.1" 200 None
2026-03-27 11:11:50 [auto1.de] INFO: Scrape type for UY74953: 2
2026-03-27 11:11:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9721ed22-61f8-579a-86ea-8b999fbc939a with identifier: UY74953
2026-03-27 11:11:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9721ed22-61f8-579a-86ea-8b999fbc939a with scrape type 2
2026-03-27 11:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9721ed22-61f8-579a-86ea-8b999fbc939a with scrape type 2
2026-03-27 11:11:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9721ed22-61f8-579a-86ea-8b999fbc939a, identifier: UY74953
2026-03-27 11:11:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9721ed22-61f8-579a-86ea-8b999fbc939a with identifier: UY74953
2026-03-27 11:11:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9721ed22-61f8-579a-86ea-8b999fbc939a with identifier: UY74953
2026-03-27 11:11:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9721ed22-61f8-579a-86ea-8b999fbc939a with identifier: UY74953 to the API
2026-03-27 11:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:11:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:11:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:16:11Z',
 'fuel_type': 'petrol',
 'id': '9721ed22-61f8-579a-86ea-8b999fbc939a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY74953',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 116889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-18',
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT Xcellence',
 'transmission': 'manual',
 'trim': 'Xcellence',
 'year': 2019}
2026-03-27 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY74953%27 HTTP/1.1" 200 None
2026-03-27 11:11:50 [auto1.de] INFO: Saving data for UY74953: {'auction_closing_time': 1774628171.0, 'created_time': 1774521387.225599, 'last_price_update_time': 1774609910.653742}
2026-03-27 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY74953') HTTP/1.1" 204 0
2026-03-27 11:11:50 [auto1.de] INFO: Found listing with ID: TD77753
2026-03-27 11:11:50 [auto1.de] INFO: Found listing with ID: AT64776
2026-03-27 11:11:50 [auto1.de] INFO: Found listing with ID: ZY94421
2026-03-27 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY94421%27 HTTP/1.1" 200 None
2026-03-27 11:11:50 [auto1.de] INFO: Scrape type for ZY94421: 2
2026-03-27 11:11:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5a5ece7-0122-5032-98d5-9adef530e5cb with identifier: ZY94421
2026-03-27 11:11:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5a5ece7-0122-5032-98d5-9adef530e5cb with scrape type 2
2026-03-27 11:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5a5ece7-0122-5032-98d5-9adef530e5cb with scrape type 2
2026-03-27 11:11:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5a5ece7-0122-5032-98d5-9adef530e5cb, identifier: ZY94421
2026-03-27 11:11:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5a5ece7-0122-5032-98d5-9adef530e5cb with identifier: ZY94421
2026-03-27 11:11:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5a5ece7-0122-5032-98d5-9adef530e5cb with identifier: ZY94421
2026-03-27 11:11:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5a5ece7-0122-5032-98d5-9adef530e5cb with identifier: ZY94421 to the API
2026-03-27 11:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:11:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-27T16:29:10Z',
 'fuel_type': 'petrol',
 'id': 'b5a5ece7-0122-5032-98d5-9adef530e5cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY94421',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 156391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-17',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-27 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY94421%27 HTTP/1.1" 200 None
2026-03-27 11:11:51 [auto1.de] INFO: Saving data for ZY94421: {'auction_closing_time': 1774628950.0, 'created_time': 1774521362.880234, 'last_price_update_time': 1774609911.32805}
2026-03-27 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY94421') HTTP/1.1" 204 0
2026-03-27 11:11:51 [auto1.de] INFO: Found listing with ID: BB37977
2026-03-27 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB37977%27 HTTP/1.1" 200 None
2026-03-27 11:11:51 [auto1.de] INFO: Scrape type for BB37977: 2
2026-03-27 11:11:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0218e752-1b3e-526c-beff-52955fd0c744 with identifier: BB37977
2026-03-27 11:11:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0218e752-1b3e-526c-beff-52955fd0c744 with scrape type 2
2026-03-27 11:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0218e752-1b3e-526c-beff-52955fd0c744 with scrape type 2
2026-03-27 11:11:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0218e752-1b3e-526c-beff-52955fd0c744, identifier: BB37977
2026-03-27 11:11:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0218e752-1b3e-526c-beff-52955fd0c744 with identifier: BB37977
2026-03-27 11:11:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0218e752-1b3e-526c-beff-52955fd0c744 with identifier: BB37977
2026-03-27 11:11:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0218e752-1b3e-526c-beff-52955fd0c744 with identifier: BB37977 to the API
2026-03-27 11:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:11:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:11:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 255,
 'expiration_date': '2026-03-27T16:31:41Z',
 'fuel_type': 'diesel',
 'id': '0218e752-1b3e-526c-beff-52955fd0c744',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB37977',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 4',
 'odometer': 158338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-17',
 'seller_name': None,
 'title': 'Land Rover Discovery 4 3.0 TD V6 SDV6 HSE',
 'transmission': 'automatic',
 'trim': 'SDV6 HSE',
 'year': 2013}
2026-03-27 11:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB37977%27 HTTP/1.1" 200 None
2026-03-27 11:11:52 [auto1.de] INFO: Saving data for BB37977: {'auction_closing_time': 1774629101.0, 'created_time': 1774521365.47602, 'last_price_update_time': 1774609912.087057}
2026-03-27 11:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB37977') HTTP/1.1" 204 0
2026-03-27 11:11:52 [auto1.de] INFO: Found listing with ID: NS09930
2026-03-27 11:11:52 [auto1.de] INFO: Found listing with ID: GF99672
2026-03-27 11:11:52 [auto1.de] INFO: Found listing with ID: AP13896
2026-03-27 11:11:52 [auto1.de] INFO: Found listing with ID: WS48624
2026-03-27 11:11:52 [auto1.de] INFO: Found listing with ID: GC51107
2026-03-27 11:11:52 [auto1.de] INFO: Found listing with ID: UV26569
2026-03-27 11:11:52 [auto1.de] INFO: Found listing with ID: HW71141
2026-03-27 11:11:52 [auto1.de] INFO: Found listing with ID: PV25356
2026-03-27 11:11:52 [auto1.de] INFO: Found listing with ID: ZX77272
2026-03-27 11:11:52 [auto1.de] INFO: Found listing with ID: XU27440
2026-03-27 11:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU27440%27 HTTP/1.1" 200 None
2026-03-27 11:11:52 [auto1.de] INFO: Scrape type for XU27440: 2
2026-03-27 11:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f1dcb1f-79c2-58c5-82da-95297a965d97 with identifier: XU27440
2026-03-27 11:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f1dcb1f-79c2-58c5-82da-95297a965d97 with scrape type 2
2026-03-27 11:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f1dcb1f-79c2-58c5-82da-95297a965d97 with scrape type 2
2026-03-27 11:11:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f1dcb1f-79c2-58c5-82da-95297a965d97, identifier: XU27440
2026-03-27 11:11:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f1dcb1f-79c2-58c5-82da-95297a965d97 with identifier: XU27440
2026-03-27 11:11:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f1dcb1f-79c2-58c5-82da-95297a965d97 with identifier: XU27440
2026-03-27 11:11:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f1dcb1f-79c2-58c5-82da-95297a965d97 with identifier: XU27440 to the API
2026-03-27 11:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:11:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:11:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-27T16:46:07Z',
 'fuel_type': 'petrol',
 'id': '5f1dcb1f-79c2-58c5-82da-95297a965d97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU27440',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 35990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ 4Drive',
 'year': 2022}
2026-03-27 11:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU27440%27 HTTP/1.1" 200 None
2026-03-27 11:11:52 [auto1.de] INFO: Saving data for XU27440: {'auction_closing_time': 1774629967.0, 'created_time': 1773303866.861516, 'last_price_update_time': 1774609912.650428}
2026-03-27 11:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU27440') HTTP/1.1" 204 0
2026-03-27 11:11:52 [auto1.de] INFO: Found listing with ID: ET29931
2026-03-27 11:11:52 [auto1.de] INFO: Found listing with ID: HZ88582
2026-03-27 11:11:52 [auto1.de] INFO: Found listing with ID: ZN01973
2026-03-27 11:11:52 [auto1.de] INFO: Found listing with ID: KA60508
2026-03-27 11:11:52 [auto1.de] INFO: Found listing with ID: XE92284
2026-03-27 11:11:52 [auto1.de] INFO: Found listing with ID: GP39031
2026-03-27 11:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP39031%27 HTTP/1.1" 200 None
2026-03-27 11:11:52 [auto1.de] INFO: Scrape type for GP39031: 2
2026-03-27 11:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17d530e7-ae97-5d81-a349-c0bcd09e8eaa with identifier: GP39031
2026-03-27 11:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17d530e7-ae97-5d81-a349-c0bcd09e8eaa with scrape type 2
2026-03-27 11:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17d530e7-ae97-5d81-a349-c0bcd09e8eaa with scrape type 2
2026-03-27 11:11:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17d530e7-ae97-5d81-a349-c0bcd09e8eaa, identifier: GP39031
2026-03-27 11:11:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17d530e7-ae97-5d81-a349-c0bcd09e8eaa with identifier: GP39031
2026-03-27 11:11:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17d530e7-ae97-5d81-a349-c0bcd09e8eaa with identifier: GP39031
2026-03-27 11:11:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17d530e7-ae97-5d81-a349-c0bcd09e8eaa with identifier: GP39031 to the API
2026-03-27 11:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:11:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:11:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:54:17Z',
 'fuel_type': 'diesel',
 'id': '17d530e7-ae97-5d81-a349-c0bcd09e8eaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP39031',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 208446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-26',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2014}
2026-03-27 11:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP39031%27 HTTP/1.1" 200 None
2026-03-27 11:11:53 [auto1.de] INFO: Saving data for GP39031: {'auction_closing_time': 1774630457.0, 'created_time': 1773305518.422373, 'last_price_update_time': 1774609913.553381}
2026-03-27 11:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GP39031') HTTP/1.1" 204 0
2026-03-27 11:11:53 [auto1.de] INFO: Found listing with ID: JP43917
2026-03-27 11:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP43917%27 HTTP/1.1" 200 None
2026-03-27 11:11:53 [auto1.de] INFO: Scrape type for JP43917: 2
2026-03-27 11:11:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6c4e00c-bbba-5ffc-946f-501ca151a72c with identifier: JP43917
2026-03-27 11:11:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6c4e00c-bbba-5ffc-946f-501ca151a72c with scrape type 2
2026-03-27 11:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6c4e00c-bbba-5ffc-946f-501ca151a72c with scrape type 2
2026-03-27 11:11:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6c4e00c-bbba-5ffc-946f-501ca151a72c, identifier: JP43917
2026-03-27 11:11:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6c4e00c-bbba-5ffc-946f-501ca151a72c with identifier: JP43917
2026-03-27 11:11:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6c4e00c-bbba-5ffc-946f-501ca151a72c with identifier: JP43917
2026-03-27 11:11:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6c4e00c-bbba-5ffc-946f-501ca151a72c with identifier: JP43917 to the API
2026-03-27 11:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:11:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 290,
 'expiration_date': '2026-03-27T16:55:46Z',
 'fuel_type': 'petrol',
 'id': 'd6c4e00c-bbba-5ffc-946f-501ca151a72c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP43917',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 67409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-24',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI TCR',
 'transmission': 'automatic',
 'trim': 'GTI TCR',
 'year': 2019}
2026-03-27 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP43917%27 HTTP/1.1" 200 None
2026-03-27 11:11:54 [auto1.de] INFO: Saving data for JP43917: {'auction_closing_time': 1774630546.0, 'created_time': 1774521369.818013, 'last_price_update_time': 1774609914.039972}
2026-03-27 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP43917') HTTP/1.1" 204 0
2026-03-27 11:11:54 [auto1.de] INFO: Found listing with ID: JR87294
2026-03-27 11:11:54 [auto1.de] INFO: Found listing with ID: GT81151
2026-03-27 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT81151%27 HTTP/1.1" 200 None
2026-03-27 11:11:54 [auto1.de] INFO: Scrape type for GT81151: 2
2026-03-27 11:11:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd25ecaa-5dd7-5ac7-bd02-669695c638bb with identifier: GT81151
2026-03-27 11:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd25ecaa-5dd7-5ac7-bd02-669695c638bb with scrape type 2
2026-03-27 11:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd25ecaa-5dd7-5ac7-bd02-669695c638bb with scrape type 2
2026-03-27 11:11:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd25ecaa-5dd7-5ac7-bd02-669695c638bb, identifier: GT81151
2026-03-27 11:11:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd25ecaa-5dd7-5ac7-bd02-669695c638bb with identifier: GT81151
2026-03-27 11:11:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd25ecaa-5dd7-5ac7-bd02-669695c638bb with identifier: GT81151
2026-03-27 11:11:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd25ecaa-5dd7-5ac7-bd02-669695c638bb with identifier: GT81151 to the API
2026-03-27 11:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:11:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-27T16:40:18Z',
 'fuel_type': 'diesel',
 'id': 'cd25ecaa-5dd7-5ac7-bd02-669695c638bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT81151',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 266127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-31',
 'seller_name': None,
 'title': 'Kia Sorento 2.2 CRDi Platinum Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Platinum Edition 4WD',
 'year': 2016}
2026-03-27 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT81151%27 HTTP/1.1" 200 None
2026-03-27 11:11:54 [auto1.de] INFO: Saving data for GT81151: {'auction_closing_time': 1774629618.0, 'created_time': 1773945997.534217, 'last_price_update_time': 1774609914.582512}
2026-03-27 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT81151') HTTP/1.1" 204 0
2026-03-27 11:11:54 [auto1.de] INFO: Found listing with ID: WE27153
2026-03-27 11:11:54 [auto1.de] INFO: Found listing with ID: LL90229
2026-03-27 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL90229%27 HTTP/1.1" 200 None
2026-03-27 11:11:54 [auto1.de] INFO: Scrape type for LL90229: 2
2026-03-27 11:11:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fc31fba-be9d-5e40-b656-97bfbe6d3f86 with identifier: LL90229
2026-03-27 11:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fc31fba-be9d-5e40-b656-97bfbe6d3f86 with scrape type 2
2026-03-27 11:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fc31fba-be9d-5e40-b656-97bfbe6d3f86 with scrape type 2
2026-03-27 11:11:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3fc31fba-be9d-5e40-b656-97bfbe6d3f86, identifier: LL90229
2026-03-27 11:11:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3fc31fba-be9d-5e40-b656-97bfbe6d3f86 with identifier: LL90229
2026-03-27 11:11:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3fc31fba-be9d-5e40-b656-97bfbe6d3f86 with identifier: LL90229
2026-03-27 11:11:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3fc31fba-be9d-5e40-b656-97bfbe6d3f86 with identifier: LL90229 to the API
2026-03-27 11:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:11:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:11:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:49:11Z',
 'fuel_type': 'petrol',
 'id': '3fc31fba-be9d-5e40-b656-97bfbe6d3f86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL90229',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 210019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-03',
 'seller_name': None,
 'title': "Kia cee'd 1.4 TGDI Vision",
 'transmission': 'manual',
 'trim': 'Vision',
 'year': 2019}
2026-03-27 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL90229%27 HTTP/1.1" 200 None
2026-03-27 11:11:55 [auto1.de] INFO: Saving data for LL90229: {'auction_closing_time': 1774630151.0, 'created_time': 1774521376.817994, 'last_price_update_time': 1774609915.080152}
2026-03-27 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL90229') HTTP/1.1" 204 0
2026-03-27 11:11:55 [auto1.de] INFO: Found listing with ID: JK15259
2026-03-27 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK15259%27 HTTP/1.1" 200 None
2026-03-27 11:11:55 [auto1.de] INFO: Scrape type for JK15259: 2
2026-03-27 11:11:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c6e4d36-d51b-5f67-863e-94d749e6e875 with identifier: JK15259
2026-03-27 11:11:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c6e4d36-d51b-5f67-863e-94d749e6e875 with scrape type 2
2026-03-27 11:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c6e4d36-d51b-5f67-863e-94d749e6e875 with scrape type 2
2026-03-27 11:11:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c6e4d36-d51b-5f67-863e-94d749e6e875, identifier: JK15259
2026-03-27 11:11:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c6e4d36-d51b-5f67-863e-94d749e6e875 with identifier: JK15259
2026-03-27 11:11:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c6e4d36-d51b-5f67-863e-94d749e6e875 with identifier: JK15259
2026-03-27 11:11:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c6e4d36-d51b-5f67-863e-94d749e6e875 with identifier: JK15259 to the API
2026-03-27 11:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:11:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:11:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-27T16:14:59Z',
 'fuel_type': 'diesel',
 'id': '3c6e4d36-d51b-5f67-863e-94d749e6e875',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK15259',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 108936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-11',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2018}
2026-03-27 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK15259%27 HTTP/1.1" 200 None
2026-03-27 11:11:55 [auto1.de] INFO: Saving data for JK15259: {'auction_closing_time': 1774628099.0, 'created_time': 1773380312.116959, 'last_price_update_time': 1774609915.84718}
2026-03-27 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK15259') HTTP/1.1" 204 0
2026-03-27 11:11:55 [auto1.de] INFO: Found listing with ID: JT24059
2026-03-27 11:11:55 [auto1.de] INFO: Found listing with ID: EE01889
2026-03-27 11:11:55 [auto1.de] INFO: Found listing with ID: KH76596
2026-03-27 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH76596%27 HTTP/1.1" 200 None
2026-03-27 11:11:55 [auto1.de] INFO: Scrape type for KH76596: 2
2026-03-27 11:11:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b471b52f-1655-5b16-a086-4b9ae5b57d00 with identifier: KH76596
2026-03-27 11:11:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b471b52f-1655-5b16-a086-4b9ae5b57d00 with scrape type 2
2026-03-27 11:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b471b52f-1655-5b16-a086-4b9ae5b57d00 with scrape type 2
2026-03-27 11:11:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b471b52f-1655-5b16-a086-4b9ae5b57d00, identifier: KH76596
2026-03-27 11:11:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b471b52f-1655-5b16-a086-4b9ae5b57d00 with identifier: KH76596
2026-03-27 11:11:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b471b52f-1655-5b16-a086-4b9ae5b57d00 with identifier: KH76596
2026-03-27 11:11:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b471b52f-1655-5b16-a086-4b9ae5b57d00 with identifier: KH76596 to the API
2026-03-27 11:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:11:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:11:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-27T16:19:04Z',
 'fuel_type': 'petrol',
 'id': 'b471b52f-1655-5b16-a086-4b9ae5b57d00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH76596',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 131735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-14',
 'seller_name': None,
 'title': 'Skoda Yeti 1.4 TSI Joy',
 'transmission': 'automatic',
 'trim': 'Joy',
 'year': 2016}
2026-03-27 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH76596%27 HTTP/1.1" 200 None
2026-03-27 11:11:56 [auto1.de] INFO: Saving data for KH76596: {'auction_closing_time': 1774628344.0, 'created_time': 1773227843.395148, 'last_price_update_time': 1774609916.361944}
2026-03-27 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH76596') HTTP/1.1" 204 0
2026-03-27 11:11:56 [auto1.de] INFO: Found listing with ID: ZY80626
2026-03-27 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY80626%27 HTTP/1.1" 200 None
2026-03-27 11:11:56 [auto1.de] INFO: Scrape type for ZY80626: 2
2026-03-27 11:11:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af2a3052-9c8c-506a-8f8a-809dd36567cc with identifier: ZY80626
2026-03-27 11:11:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af2a3052-9c8c-506a-8f8a-809dd36567cc with scrape type 2
2026-03-27 11:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af2a3052-9c8c-506a-8f8a-809dd36567cc with scrape type 2
2026-03-27 11:11:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af2a3052-9c8c-506a-8f8a-809dd36567cc, identifier: ZY80626
2026-03-27 11:11:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af2a3052-9c8c-506a-8f8a-809dd36567cc with identifier: ZY80626
2026-03-27 11:11:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af2a3052-9c8c-506a-8f8a-809dd36567cc with identifier: ZY80626
2026-03-27 11:11:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af2a3052-9c8c-506a-8f8a-809dd36567cc with identifier: ZY80626 to the API
2026-03-27 11:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:11:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:11:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:55:53Z',
 'fuel_type': 'petrol',
 'id': 'af2a3052-9c8c-506a-8f8a-809dd36567cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY80626',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 200927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-06-01',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-27 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY80626%27 HTTP/1.1" 200 None
2026-03-27 11:11:56 [auto1.de] INFO: Saving data for ZY80626: {'auction_closing_time': 1774630553.0, 'created_time': 1773380532.526951, 'last_price_update_time': 1774609916.844744}
2026-03-27 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY80626') HTTP/1.1" 204 0
2026-03-27 11:11:56 [auto1.de] INFO: Found listing with ID: SZ55877
2026-03-27 11:11:56 [auto1.de] INFO: Found listing with ID: SM47095
2026-03-27 11:11:56 [auto1.de] INFO: Found listing with ID: GJ72633
2026-03-27 11:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:11:58 [auto1.de] INFO: Channel: 24h | Page: 240 | totalHits: 10669 | hits on page: 40
2026-03-27 11:11:58 [auto1.de] INFO: Found listing with ID: GJ72633
2026-03-27 11:11:58 [auto1.de] INFO: Found listing with ID: LP44310
2026-03-27 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP44310%27 HTTP/1.1" 200 None
2026-03-27 11:11:58 [auto1.de] INFO: Scrape type for LP44310: 2
2026-03-27 11:11:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1255ff5-d6df-5a6d-bb47-e7a0ead192d4 with identifier: LP44310
2026-03-27 11:11:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1255ff5-d6df-5a6d-bb47-e7a0ead192d4 with scrape type 2
2026-03-27 11:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1255ff5-d6df-5a6d-bb47-e7a0ead192d4 with scrape type 2
2026-03-27 11:11:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1255ff5-d6df-5a6d-bb47-e7a0ead192d4, identifier: LP44310
2026-03-27 11:11:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1255ff5-d6df-5a6d-bb47-e7a0ead192d4 with identifier: LP44310
2026-03-27 11:11:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1255ff5-d6df-5a6d-bb47-e7a0ead192d4 with identifier: LP44310
2026-03-27 11:11:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1255ff5-d6df-5a6d-bb47-e7a0ead192d4 with identifier: LP44310 to the API
2026-03-27 11:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:11:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:11:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-27T16:51:53Z',
 'fuel_type': 'petrol',
 'id': 'e1255ff5-d6df-5a6d-bb47-e7a0ead192d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP44310',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 137678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-17',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2006}
2026-03-27 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP44310%27 HTTP/1.1" 200 None
2026-03-27 11:11:58 [auto1.de] INFO: Saving data for LP44310: {'auction_closing_time': 1774630313.0, 'created_time': 1774521858.018781, 'last_price_update_time': 1774609918.6169}
2026-03-27 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LP44310') HTTP/1.1" 204 0
2026-03-27 11:11:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:11:58 [auto1.de] INFO: Found listing with ID: NE75382
2026-03-27 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE75382%27 HTTP/1.1" 200 None
2026-03-27 11:11:58 [auto1.de] INFO: Scrape type for NE75382: 2
2026-03-27 11:11:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86fc747d-f2fa-5c85-828d-cdd6d9ea161e with identifier: NE75382
2026-03-27 11:11:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86fc747d-f2fa-5c85-828d-cdd6d9ea161e with scrape type 2
2026-03-27 11:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86fc747d-f2fa-5c85-828d-cdd6d9ea161e with scrape type 2
2026-03-27 11:11:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86fc747d-f2fa-5c85-828d-cdd6d9ea161e, identifier: NE75382
2026-03-27 11:11:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86fc747d-f2fa-5c85-828d-cdd6d9ea161e with identifier: NE75382
2026-03-27 11:11:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86fc747d-f2fa-5c85-828d-cdd6d9ea161e with identifier: NE75382
2026-03-27 11:11:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86fc747d-f2fa-5c85-828d-cdd6d9ea161e with identifier: NE75382 to the API
2026-03-27 11:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:11:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:11:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:53:45Z',
 'fuel_type': 'petrol',
 'id': '86fc747d-f2fa-5c85-828d-cdd6d9ea161e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE75382',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Citigo',
 'odometer': 19371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-28',
 'seller_name': None,
 'title': 'Skoda Citigo 1.0 MPI Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2018}
2026-03-27 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE75382%27 HTTP/1.1" 200 None
2026-03-27 11:11:59 [auto1.de] INFO: Saving data for NE75382: {'auction_closing_time': 1774630425.0, 'created_time': 1774521554.06296, 'last_price_update_time': 1774609919.059373}
2026-03-27 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE75382') HTTP/1.1" 204 0
2026-03-27 11:11:59 [auto1.de] INFO: Found listing with ID: GG35295
2026-03-27 11:11:59 [auto1.de] INFO: Found listing with ID: MC05048
2026-03-27 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC05048%27 HTTP/1.1" 200 None
2026-03-27 11:11:59 [auto1.de] INFO: Scrape type for MC05048: 2
2026-03-27 11:11:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75e5cfd8-4029-5e95-9ae2-a79fbee0c76c with identifier: MC05048
2026-03-27 11:11:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75e5cfd8-4029-5e95-9ae2-a79fbee0c76c with scrape type 2
2026-03-27 11:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75e5cfd8-4029-5e95-9ae2-a79fbee0c76c with scrape type 2
2026-03-27 11:11:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75e5cfd8-4029-5e95-9ae2-a79fbee0c76c, identifier: MC05048
2026-03-27 11:11:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75e5cfd8-4029-5e95-9ae2-a79fbee0c76c with identifier: MC05048
2026-03-27 11:11:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75e5cfd8-4029-5e95-9ae2-a79fbee0c76c with identifier: MC05048
2026-03-27 11:11:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75e5cfd8-4029-5e95-9ae2-a79fbee0c76c with identifier: MC05048 to the API
2026-03-27 11:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:11:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:11:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:31:48Z',
 'fuel_type': 'petrol',
 'id': '75e5cfd8-4029-5e95-9ae2-a79fbee0c76c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC05048',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 72732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-08',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-27 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC05048%27 HTTP/1.1" 200 None
2026-03-27 11:11:59 [auto1.de] INFO: Saving data for MC05048: {'auction_closing_time': 1774629108.0, 'created_time': 1774521413.657316, 'last_price_update_time': 1774609919.663365}
2026-03-27 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC05048') HTTP/1.1" 204 0
2026-03-27 11:11:59 [auto1.de] INFO: Found listing with ID: EN23227
2026-03-27 11:11:59 [auto1.de] INFO: Found listing with ID: MM26865
2026-03-27 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM26865%27 HTTP/1.1" 200 None
2026-03-27 11:11:59 [auto1.de] INFO: Scrape type for MM26865: 2
2026-03-27 11:11:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5 with identifier: MM26865
2026-03-27 11:11:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5 with scrape type 2
2026-03-27 11:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5 with scrape type 2
2026-03-27 11:11:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5, identifier: MM26865
2026-03-27 11:11:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5 with identifier: MM26865
2026-03-27 11:11:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5 with identifier: MM26865
2026-03-27 11:11:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5 with identifier: MM26865 to the API
2026-03-27 11:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:11:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-27T16:18:42Z',
 'fuel_type': 'diesel',
 'id': 'f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM26865',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 213560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-18',
 'seller_name': None,
 'title': 'BMW X3 xDrive 35d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-27 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM26865%27 HTTP/1.1" 200 None
2026-03-27 11:12:00 [auto1.de] INFO: Saving data for MM26865: {'auction_closing_time': 1774628322.0, 'created_time': 1774521547.303999, 'last_price_update_time': 1774609920.118328}
2026-03-27 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM26865') HTTP/1.1" 204 0
2026-03-27 11:12:00 [auto1.de] INFO: Found listing with ID: UE07801
2026-03-27 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE07801%27 HTTP/1.1" 200 None
2026-03-27 11:12:00 [auto1.de] INFO: Scrape type for UE07801: 2
2026-03-27 11:12:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dfed500-8f4e-5a9e-99dc-d4d116904826 with identifier: UE07801
2026-03-27 11:12:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dfed500-8f4e-5a9e-99dc-d4d116904826 with scrape type 2
2026-03-27 11:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8dfed500-8f4e-5a9e-99dc-d4d116904826 with scrape type 2
2026-03-27 11:12:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8dfed500-8f4e-5a9e-99dc-d4d116904826, identifier: UE07801
2026-03-27 11:12:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8dfed500-8f4e-5a9e-99dc-d4d116904826 with identifier: UE07801
2026-03-27 11:12:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8dfed500-8f4e-5a9e-99dc-d4d116904826 with identifier: UE07801
2026-03-27 11:12:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8dfed500-8f4e-5a9e-99dc-d4d116904826 with identifier: UE07801 to the API
2026-03-27 11:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 45,
 'expiration_date': '2026-03-27T16:08:06Z',
 'fuel_type': 'electro',
 'id': '8dfed500-8f4e-5a9e-99dc-d4d116904826',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE07801',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 19352,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-05',
 'seller_name': None,
 'title': 'Dacia Spring electric drive 33 kW Essential',
 'transmission': 'automatic',
 'trim': 'Essential',
 'year': 2023}
2026-03-27 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE07801%27 HTTP/1.1" 200 None
2026-03-27 11:12:00 [auto1.de] INFO: Saving data for UE07801: {'auction_closing_time': 1774627686.0, 'created_time': 1773776295.596901, 'last_price_update_time': 1774609920.572744}
2026-03-27 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE07801') HTTP/1.1" 204 0
2026-03-27 11:12:00 [auto1.de] INFO: Found listing with ID: KK55814
2026-03-27 11:12:00 [auto1.de] INFO: Found listing with ID: RW27513
2026-03-27 11:12:00 [auto1.de] INFO: Found listing with ID: MV55764
2026-03-27 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV55764%27 HTTP/1.1" 200 None
2026-03-27 11:12:00 [auto1.de] INFO: Scrape type for MV55764: 2
2026-03-27 11:12:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29705ca4-6e85-5668-a1ff-fa117cac1b3d with identifier: MV55764
2026-03-27 11:12:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29705ca4-6e85-5668-a1ff-fa117cac1b3d with scrape type 2
2026-03-27 11:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29705ca4-6e85-5668-a1ff-fa117cac1b3d with scrape type 2
2026-03-27 11:12:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29705ca4-6e85-5668-a1ff-fa117cac1b3d, identifier: MV55764
2026-03-27 11:12:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29705ca4-6e85-5668-a1ff-fa117cac1b3d with identifier: MV55764
2026-03-27 11:12:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29705ca4-6e85-5668-a1ff-fa117cac1b3d with identifier: MV55764
2026-03-27 11:12:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29705ca4-6e85-5668-a1ff-fa117cac1b3d with identifier: MV55764 to the API
2026-03-27 11:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-27T16:22:34Z',
 'fuel_type': 'electro',
 'id': '29705ca4-6e85-5668-a1ff-fa117cac1b3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV55764',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 26266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-18',
 'seller_name': None,
 'title': 'Renault Twingo electric drive 60 kW Techno Electric',
 'transmission': 'automatic',
 'trim': 'Techno Electric',
 'year': 2023}
2026-03-27 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV55764%27 HTTP/1.1" 200 None
2026-03-27 11:12:01 [auto1.de] INFO: Saving data for MV55764: {'auction_closing_time': 1774628554.0, 'created_time': 1773776321.203083, 'last_price_update_time': 1774609921.004924}
2026-03-27 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV55764') HTTP/1.1" 204 0
2026-03-27 11:12:01 [auto1.de] INFO: Found listing with ID: MX27199
2026-03-27 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX27199%27 HTTP/1.1" 200 None
2026-03-27 11:12:01 [auto1.de] INFO: Scrape type for MX27199: 2
2026-03-27 11:12:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9c04522-57c5-5ec6-b1c7-3aeb401d2dc1 with identifier: MX27199
2026-03-27 11:12:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9c04522-57c5-5ec6-b1c7-3aeb401d2dc1 with scrape type 2
2026-03-27 11:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9c04522-57c5-5ec6-b1c7-3aeb401d2dc1 with scrape type 2
2026-03-27 11:12:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9c04522-57c5-5ec6-b1c7-3aeb401d2dc1, identifier: MX27199
2026-03-27 11:12:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9c04522-57c5-5ec6-b1c7-3aeb401d2dc1 with identifier: MX27199
2026-03-27 11:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9c04522-57c5-5ec6-b1c7-3aeb401d2dc1 with identifier: MX27199
2026-03-27 11:12:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9c04522-57c5-5ec6-b1c7-3aeb401d2dc1 with identifier: MX27199 to the API
2026-03-27 11:12:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 45,
 'expiration_date': '2026-03-27T16:57:45Z',
 'fuel_type': 'electro',
 'id': 'a9c04522-57c5-5ec6-b1c7-3aeb401d2dc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX27199',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 29434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-09',
 'seller_name': None,
 'title': 'Dacia Spring electric drive 33 kW Essential',
 'transmission': 'automatic',
 'trim': 'Essential',
 'year': 2023}
2026-03-27 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX27199%27 HTTP/1.1" 200 None
2026-03-27 11:12:01 [auto1.de] INFO: Saving data for MX27199: {'auction_closing_time': 1774630665.0, 'created_time': 1773776347.076264, 'last_price_update_time': 1774609921.484657}
2026-03-27 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX27199') HTTP/1.1" 204 0
2026-03-27 11:12:01 [auto1.de] INFO: Found listing with ID: SR33990
2026-03-27 11:12:01 [auto1.de] INFO: Found listing with ID: MX76960
2026-03-27 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX76960%27 HTTP/1.1" 200 None
2026-03-27 11:12:01 [auto1.de] INFO: Scrape type for MX76960: 2
2026-03-27 11:12:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7e9b40e-f587-5d7c-b48b-38e313560c19 with identifier: MX76960
2026-03-27 11:12:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7e9b40e-f587-5d7c-b48b-38e313560c19 with scrape type 2
2026-03-27 11:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7e9b40e-f587-5d7c-b48b-38e313560c19 with scrape type 2
2026-03-27 11:12:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7e9b40e-f587-5d7c-b48b-38e313560c19, identifier: MX76960
2026-03-27 11:12:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7e9b40e-f587-5d7c-b48b-38e313560c19 with identifier: MX76960
2026-03-27 11:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7e9b40e-f587-5d7c-b48b-38e313560c19 with identifier: MX76960
2026-03-27 11:12:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7e9b40e-f587-5d7c-b48b-38e313560c19 with identifier: MX76960 to the API
2026-03-27 11:12:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:20:06Z',
 'fuel_type': 'electro',
 'id': 'e7e9b40e-f587-5d7c-b48b-38e313560c19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX76960',
 'listing': 'auction',
 'make': 'MAXUS',
 'model': 'Deliver 3',
 'odometer': 4857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-22',
 'seller_name': None,
 'title': 'MAXUS Deliver 3 electric drive 90 kW L2H1',
 'transmission': 'automatic',
 'trim': 'L2H1',
 'year': 2023}
2026-03-27 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX76960%27 HTTP/1.1" 200 None
2026-03-27 11:12:01 [auto1.de] INFO: Saving data for MX76960: {'auction_closing_time': 1774628406.0, 'created_time': 1773776342.700549, 'last_price_update_time': 1774609921.988927}
2026-03-27 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX76960') HTTP/1.1" 204 0
2026-03-27 11:12:02 [auto1.de] INFO: Found listing with ID: MA63217
2026-03-27 11:12:02 [auto1.de] INFO: Found listing with ID: CT77406
2026-03-27 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT77406%27 HTTP/1.1" 200 None
2026-03-27 11:12:02 [auto1.de] INFO: Scrape type for CT77406: 2
2026-03-27 11:12:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cba9edea-030c-5896-ae16-a35c080ee341 with identifier: CT77406
2026-03-27 11:12:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cba9edea-030c-5896-ae16-a35c080ee341 with scrape type 2
2026-03-27 11:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cba9edea-030c-5896-ae16-a35c080ee341 with scrape type 2
2026-03-27 11:12:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cba9edea-030c-5896-ae16-a35c080ee341, identifier: CT77406
2026-03-27 11:12:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cba9edea-030c-5896-ae16-a35c080ee341 with identifier: CT77406
2026-03-27 11:12:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cba9edea-030c-5896-ae16-a35c080ee341 with identifier: CT77406
2026-03-27 11:12:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cba9edea-030c-5896-ae16-a35c080ee341 with identifier: CT77406 to the API
2026-03-27 11:12:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:58:34Z',
 'fuel_type': 'petrol',
 'id': 'cba9edea-030c-5896-ae16-a35c080ee341',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT77406',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 189049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-22',
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-03-27 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT77406%27 HTTP/1.1" 200 None
2026-03-27 11:12:02 [auto1.de] INFO: Saving data for CT77406: {'auction_closing_time': 1774630714.0, 'created_time': 1774521548.577333, 'last_price_update_time': 1774609922.561834}
2026-03-27 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT77406') HTTP/1.1" 204 0
2026-03-27 11:12:02 [auto1.de] INFO: Found listing with ID: XW72193
2026-03-27 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW72193%27 HTTP/1.1" 200 None
2026-03-27 11:12:02 [auto1.de] INFO: Scrape type for XW72193: 2
2026-03-27 11:12:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b43c048e-e6da-5f99-881b-84f3ffb29ca3 with identifier: XW72193
2026-03-27 11:12:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b43c048e-e6da-5f99-881b-84f3ffb29ca3 with scrape type 2
2026-03-27 11:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b43c048e-e6da-5f99-881b-84f3ffb29ca3 with scrape type 2
2026-03-27 11:12:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b43c048e-e6da-5f99-881b-84f3ffb29ca3, identifier: XW72193
2026-03-27 11:12:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b43c048e-e6da-5f99-881b-84f3ffb29ca3 with identifier: XW72193
2026-03-27 11:12:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b43c048e-e6da-5f99-881b-84f3ffb29ca3 with identifier: XW72193
2026-03-27 11:12:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b43c048e-e6da-5f99-881b-84f3ffb29ca3 with identifier: XW72193 to the API
2026-03-27 11:12:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:19:16Z',
 'fuel_type': 'petrol',
 'id': 'b43c048e-e6da-5f99-881b-84f3ffb29ca3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW72193',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 162844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-24',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2017}
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW72193%27 HTTP/1.1" 200 None
2026-03-27 11:12:03 [auto1.de] INFO: Saving data for XW72193: {'auction_closing_time': 1774628356.0, 'created_time': 1774521426.575627, 'last_price_update_time': 1774609923.03115}
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW72193') HTTP/1.1" 204 0
2026-03-27 11:12:03 [auto1.de] INFO: Found listing with ID: AE03495
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE03495%27 HTTP/1.1" 200 None
2026-03-27 11:12:03 [auto1.de] INFO: Scrape type for AE03495: 2
2026-03-27 11:12:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4 with identifier: AE03495
2026-03-27 11:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4 with scrape type 2
2026-03-27 11:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4 with scrape type 2
2026-03-27 11:12:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4, identifier: AE03495
2026-03-27 11:12:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4 with identifier: AE03495
2026-03-27 11:12:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4 with identifier: AE03495
2026-03-27 11:12:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4 with identifier: AE03495 to the API
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:22:16Z',
 'fuel_type': 'diesel',
 'id': '1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE03495',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 133856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-23',
 'seller_name': None,
 'title': 'Audi A5 Sportback 40 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE03495%27 HTTP/1.1" 200 None
2026-03-27 11:12:03 [auto1.de] INFO: Saving data for AE03495: {'auction_closing_time': 1774628536.0, 'created_time': 1774521494.378935, 'last_price_update_time': 1774609923.482807}
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE03495') HTTP/1.1" 204 0
2026-03-27 11:12:03 [auto1.de] INFO: Found listing with ID: EF09795
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF09795%27 HTTP/1.1" 200 None
2026-03-27 11:12:03 [auto1.de] INFO: Scrape type for EF09795: 2
2026-03-27 11:12:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4038a2dd-7201-5265-b254-d68ab451c944 with identifier: EF09795
2026-03-27 11:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4038a2dd-7201-5265-b254-d68ab451c944 with scrape type 2
2026-03-27 11:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4038a2dd-7201-5265-b254-d68ab451c944 with scrape type 2
2026-03-27 11:12:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4038a2dd-7201-5265-b254-d68ab451c944, identifier: EF09795
2026-03-27 11:12:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4038a2dd-7201-5265-b254-d68ab451c944 with identifier: EF09795
2026-03-27 11:12:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4038a2dd-7201-5265-b254-d68ab451c944 with identifier: EF09795
2026-03-27 11:12:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4038a2dd-7201-5265-b254-d68ab451c944 with identifier: EF09795 to the API
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-27T16:51:26Z',
 'fuel_type': 'petrol',
 'id': '4038a2dd-7201-5265-b254-d68ab451c944',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF09795',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 14317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-26',
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.0 TSI R-Line',
 'transmission': 'manual',
 'trim': 'R-Line',
 'year': 2024}
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF09795%27 HTTP/1.1" 200 None
2026-03-27 11:12:03 [auto1.de] INFO: Saving data for EF09795: {'auction_closing_time': 1774630286.0, 'created_time': 1774521425.203857, 'last_price_update_time': 1774609923.915246}
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF09795') HTTP/1.1" 204 0
2026-03-27 11:12:03 [auto1.de] INFO: Found listing with ID: MY48051
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48051%27 HTTP/1.1" 200 None
2026-03-27 11:12:03 [auto1.de] INFO: Scrape type for MY48051: 2
2026-03-27 11:12:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 607cd388-1ec9-5ecb-bbcc-d483e737cb20 with identifier: MY48051
2026-03-27 11:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 607cd388-1ec9-5ecb-bbcc-d483e737cb20 with scrape type 2
2026-03-27 11:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 607cd388-1ec9-5ecb-bbcc-d483e737cb20 with scrape type 2
2026-03-27 11:12:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 607cd388-1ec9-5ecb-bbcc-d483e737cb20, identifier: MY48051
2026-03-27 11:12:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 607cd388-1ec9-5ecb-bbcc-d483e737cb20 with identifier: MY48051
2026-03-27 11:12:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 607cd388-1ec9-5ecb-bbcc-d483e737cb20 with identifier: MY48051
2026-03-27 11:12:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 607cd388-1ec9-5ecb-bbcc-d483e737cb20 with identifier: MY48051 to the API
2026-03-27 11:12:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 239,
 'expiration_date': '2026-03-27T16:57:27Z',
 'fuel_type': 'diesel',
 'id': '607cd388-1ec9-5ecb-bbcc-d483e737cb20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY48051',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 111287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-14',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 300 d 4MATIC AVANTGARDE EDITION 19 lang',
 'transmission': 'automatic',
 'trim': '4MATIC AVANTGARDE EDITION 19 lang',
 'year': 2019}
2026-03-27 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48051%27 HTTP/1.1" 200 None
2026-03-27 11:12:04 [auto1.de] INFO: Saving data for MY48051: {'auction_closing_time': 1774630647.0, 'created_time': 1774521425.753132, 'last_price_update_time': 1774609924.406803}
2026-03-27 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY48051') HTTP/1.1" 204 0
2026-03-27 11:12:04 [auto1.de] INFO: Found listing with ID: XK59182
2026-03-27 11:12:04 [auto1.de] INFO: Found listing with ID: LG52677
2026-03-27 11:12:04 [auto1.de] INFO: Found listing with ID: CN52913
2026-03-27 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN52913%27 HTTP/1.1" 200 None
2026-03-27 11:12:04 [auto1.de] INFO: Scrape type for CN52913: 2
2026-03-27 11:12:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08ec429f-4eeb-59b1-8cf0-fa1d69ec62d6 with identifier: CN52913
2026-03-27 11:12:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08ec429f-4eeb-59b1-8cf0-fa1d69ec62d6 with scrape type 2
2026-03-27 11:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08ec429f-4eeb-59b1-8cf0-fa1d69ec62d6 with scrape type 2
2026-03-27 11:12:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08ec429f-4eeb-59b1-8cf0-fa1d69ec62d6, identifier: CN52913
2026-03-27 11:12:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08ec429f-4eeb-59b1-8cf0-fa1d69ec62d6 with identifier: CN52913
2026-03-27 11:12:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08ec429f-4eeb-59b1-8cf0-fa1d69ec62d6 with identifier: CN52913
2026-03-27 11:12:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08ec429f-4eeb-59b1-8cf0-fa1d69ec62d6 with identifier: CN52913 to the API
2026-03-27 11:12:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-27T16:01:42Z',
 'fuel_type': 'diesel',
 'id': '08ec429f-4eeb-59b1-8cf0-fa1d69ec62d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN52913',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '807',
 'odometer': 170996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-01',
 'seller_name': None,
 'title': 'Peugeot 807 2.0 HDi Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2010}
2026-03-27 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN52913%27 HTTP/1.1" 200 None
2026-03-27 11:12:04 [auto1.de] INFO: Saving data for CN52913: {'auction_closing_time': 1774627302.0, 'created_time': 1773135285.829331, 'last_price_update_time': 1774609924.892781}
2026-03-27 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN52913') HTTP/1.1" 204 0
2026-03-27 11:12:04 [auto1.de] INFO: Found listing with ID: YF83541
2026-03-27 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF83541%27 HTTP/1.1" 200 None
2026-03-27 11:12:04 [auto1.de] INFO: Scrape type for YF83541: 2
2026-03-27 11:12:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e56f4e5-e247-56cf-a2b9-697d39dca00a with identifier: YF83541
2026-03-27 11:12:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e56f4e5-e247-56cf-a2b9-697d39dca00a with scrape type 2
2026-03-27 11:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e56f4e5-e247-56cf-a2b9-697d39dca00a with scrape type 2
2026-03-27 11:12:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e56f4e5-e247-56cf-a2b9-697d39dca00a, identifier: YF83541
2026-03-27 11:12:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e56f4e5-e247-56cf-a2b9-697d39dca00a with identifier: YF83541
2026-03-27 11:12:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e56f4e5-e247-56cf-a2b9-697d39dca00a with identifier: YF83541
2026-03-27 11:12:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e56f4e5-e247-56cf-a2b9-697d39dca00a with identifier: YF83541 to the API
2026-03-27 11:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-27T16:01:44Z',
 'fuel_type': 'diesel',
 'id': '0e56f4e5-e247-56cf-a2b9-697d39dca00a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF83541',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 284890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-09',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-27 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF83541%27 HTTP/1.1" 200 None
2026-03-27 11:12:05 [auto1.de] INFO: Saving data for YF83541: {'auction_closing_time': 1774627304.0, 'created_time': 1774521584.185089, 'last_price_update_time': 1774609925.345866}
2026-03-27 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF83541') HTTP/1.1" 204 0
2026-03-27 11:12:05 [auto1.de] INFO: Found listing with ID: NY57954
2026-03-27 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY57954%27 HTTP/1.1" 200 None
2026-03-27 11:12:05 [auto1.de] INFO: Scrape type for NY57954: 2
2026-03-27 11:12:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b575ab56-4e40-5e82-a411-f0b973127896 with identifier: NY57954
2026-03-27 11:12:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b575ab56-4e40-5e82-a411-f0b973127896 with scrape type 2
2026-03-27 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b575ab56-4e40-5e82-a411-f0b973127896 with scrape type 2
2026-03-27 11:12:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b575ab56-4e40-5e82-a411-f0b973127896, identifier: NY57954
2026-03-27 11:12:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b575ab56-4e40-5e82-a411-f0b973127896 with identifier: NY57954
2026-03-27 11:12:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b575ab56-4e40-5e82-a411-f0b973127896 with identifier: NY57954
2026-03-27 11:12:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b575ab56-4e40-5e82-a411-f0b973127896 with identifier: NY57954 to the API
2026-03-27 11:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:57:22Z',
 'fuel_type': 'diesel',
 'id': 'b575ab56-4e40-5e82-a411-f0b973127896',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY57954',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': 'Grand Voyager',
 'odometer': 255384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-26',
 'seller_name': None,
 'title': 'Chrysler Grand Voyager 2.8 CRD Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2006}
2026-03-27 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY57954%27 HTTP/1.1" 200 None
2026-03-27 11:12:05 [auto1.de] INFO: Saving data for NY57954: {'auction_closing_time': 1774630642.0, 'created_time': 1774521566.263937, 'last_price_update_time': 1774609925.7675}
2026-03-27 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY57954') HTTP/1.1" 204 0
2026-03-27 11:12:05 [auto1.de] INFO: Found listing with ID: KZ11746
2026-03-27 11:12:05 [auto1.de] INFO: Found listing with ID: YR25980
2026-03-27 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR25980%27 HTTP/1.1" 200 None
2026-03-27 11:12:05 [auto1.de] INFO: Scrape type for YR25980: 2
2026-03-27 11:12:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1315275e-81ac-5ae2-a803-94d2ead6b39f with identifier: YR25980
2026-03-27 11:12:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1315275e-81ac-5ae2-a803-94d2ead6b39f with scrape type 2
2026-03-27 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1315275e-81ac-5ae2-a803-94d2ead6b39f with scrape type 2
2026-03-27 11:12:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1315275e-81ac-5ae2-a803-94d2ead6b39f, identifier: YR25980
2026-03-27 11:12:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1315275e-81ac-5ae2-a803-94d2ead6b39f with identifier: YR25980
2026-03-27 11:12:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1315275e-81ac-5ae2-a803-94d2ead6b39f with identifier: YR25980
2026-03-27 11:12:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1315275e-81ac-5ae2-a803-94d2ead6b39f with identifier: YR25980 to the API
2026-03-27 11:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-27T16:44:37Z',
 'fuel_type': 'diesel',
 'id': '1315275e-81ac-5ae2-a803-94d2ead6b39f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR25980',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 72123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-26',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 111 CDI lang Tourer Edition',
 'transmission': 'manual',
 'trim': 'lang Tourer Edition',
 'year': 2019}
2026-03-27 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR25980%27 HTTP/1.1" 200 None
2026-03-27 11:12:06 [auto1.de] INFO: Saving data for YR25980: {'auction_closing_time': 1774629877.0, 'created_time': 1774521421.949189, 'last_price_update_time': 1774609926.295041}
2026-03-27 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR25980') HTTP/1.1" 204 0
2026-03-27 11:12:06 [auto1.de] INFO: Found listing with ID: EW76820
2026-03-27 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW76820%27 HTTP/1.1" 200 None
2026-03-27 11:12:06 [auto1.de] INFO: Scrape type for EW76820: 2
2026-03-27 11:12:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6d78fca-0ccf-556f-a814-b1f2fd005cd4 with identifier: EW76820
2026-03-27 11:12:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6d78fca-0ccf-556f-a814-b1f2fd005cd4 with scrape type 2
2026-03-27 11:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6d78fca-0ccf-556f-a814-b1f2fd005cd4 with scrape type 2
2026-03-27 11:12:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6d78fca-0ccf-556f-a814-b1f2fd005cd4, identifier: EW76820
2026-03-27 11:12:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6d78fca-0ccf-556f-a814-b1f2fd005cd4 with identifier: EW76820
2026-03-27 11:12:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6d78fca-0ccf-556f-a814-b1f2fd005cd4 with identifier: EW76820
2026-03-27 11:12:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6d78fca-0ccf-556f-a814-b1f2fd005cd4 with identifier: EW76820 to the API
2026-03-27 11:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:08:06Z',
 'fuel_type': 'diesel',
 'id': 'b6d78fca-0ccf-556f-a814-b1f2fd005cd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW76820',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 140632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-06',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI SportLine',
 'transmission': 'automatic',
 'trim': 'SportLine',
 'year': 2019}
2026-03-27 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW76820%27 HTTP/1.1" 200 None
2026-03-27 11:12:06 [auto1.de] INFO: Saving data for EW76820: {'auction_closing_time': 1774627686.0, 'created_time': 1773226322.388167, 'last_price_update_time': 1774609926.767332}
2026-03-27 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW76820') HTTP/1.1" 204 0
2026-03-27 11:12:06 [auto1.de] INFO: Found listing with ID: JG35901
2026-03-27 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35901%27 HTTP/1.1" 200 None
2026-03-27 11:12:06 [auto1.de] INFO: Scrape type for JG35901: 2
2026-03-27 11:12:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79d36106-5c9a-596d-8d83-23deec829d4e with identifier: JG35901
2026-03-27 11:12:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79d36106-5c9a-596d-8d83-23deec829d4e with scrape type 2
2026-03-27 11:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79d36106-5c9a-596d-8d83-23deec829d4e with scrape type 2
2026-03-27 11:12:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79d36106-5c9a-596d-8d83-23deec829d4e, identifier: JG35901
2026-03-27 11:12:06 [scrapy.extensions.logstats] INFO: Crawled 708 pages (at 8 pages/min), scraped 958 items (at 35 items/min)
2026-03-27 11:12:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 11:12:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79d36106-5c9a-596d-8d83-23deec829d4e with identifier: JG35901
2026-03-27 11:12:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79d36106-5c9a-596d-8d83-23deec829d4e with identifier: JG35901
2026-03-27 11:12:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79d36106-5c9a-596d-8d83-23deec829d4e with identifier: JG35901 to the API
2026-03-27 11:12:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-27T16:57:41Z',
 'fuel_type': 'petrol',
 'id': '79d36106-5c9a-596d-8d83-23deec829d4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG35901',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 121500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-04',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 2.0 TSI BlueMotion',
 'transmission': 'manual',
 'trim': 'BlueMotion',
 'year': 2014}
2026-03-27 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35901%27 HTTP/1.1" 200 None
2026-03-27 11:12:07 [auto1.de] INFO: Saving data for JG35901: {'auction_closing_time': 1774630661.0, 'created_time': 1773945741.360783, 'last_price_update_time': 1774609927.261479}
2026-03-27 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG35901') HTTP/1.1" 204 0
2026-03-27 11:12:07 [auto1.de] INFO: Found listing with ID: UC57702
2026-03-27 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC57702%27 HTTP/1.1" 200 None
2026-03-27 11:12:07 [auto1.de] INFO: Scrape type for UC57702: 2
2026-03-27 11:12:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae953408-218b-5398-b7bb-a00311d56ab8 with identifier: UC57702
2026-03-27 11:12:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae953408-218b-5398-b7bb-a00311d56ab8 with scrape type 2
2026-03-27 11:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae953408-218b-5398-b7bb-a00311d56ab8 with scrape type 2
2026-03-27 11:12:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae953408-218b-5398-b7bb-a00311d56ab8, identifier: UC57702
2026-03-27 11:12:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae953408-218b-5398-b7bb-a00311d56ab8 with identifier: UC57702
2026-03-27 11:12:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae953408-218b-5398-b7bb-a00311d56ab8 with identifier: UC57702
2026-03-27 11:12:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae953408-218b-5398-b7bb-a00311d56ab8 with identifier: UC57702 to the API
2026-03-27 11:12:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-27T16:17:00Z',
 'fuel_type': 'electro',
 'id': 'ae953408-218b-5398-b7bb-a00311d56ab8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC57702',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'EV6',
 'odometer': 15069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-20',
 'seller_name': None,
 'title': 'Kia EV6 electric drive 239 kW GT Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line 4WD',
 'year': 2024}
2026-03-27 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC57702%27 HTTP/1.1" 200 None
2026-03-27 11:12:07 [auto1.de] INFO: Saving data for UC57702: {'auction_closing_time': 1774628220.0, 'created_time': 1773776348.9408, 'last_price_update_time': 1774609927.717635}
2026-03-27 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC57702') HTTP/1.1" 204 0
2026-03-27 11:12:07 [auto1.de] INFO: Found listing with ID: JF67398
2026-03-27 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF67398%27 HTTP/1.1" 200 None
2026-03-27 11:12:07 [auto1.de] INFO: Scrape type for JF67398: 2
2026-03-27 11:12:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44679018-c0b4-5e6a-b3e2-0081539839c4 with identifier: JF67398
2026-03-27 11:12:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44679018-c0b4-5e6a-b3e2-0081539839c4 with scrape type 2
2026-03-27 11:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44679018-c0b4-5e6a-b3e2-0081539839c4 with scrape type 2
2026-03-27 11:12:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44679018-c0b4-5e6a-b3e2-0081539839c4, identifier: JF67398
2026-03-27 11:12:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44679018-c0b4-5e6a-b3e2-0081539839c4 with identifier: JF67398
2026-03-27 11:12:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44679018-c0b4-5e6a-b3e2-0081539839c4 with identifier: JF67398
2026-03-27 11:12:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44679018-c0b4-5e6a-b3e2-0081539839c4 with identifier: JF67398 to the API
2026-03-27 11:12:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-27T16:21:47Z',
 'fuel_type': 'electro',
 'id': '44679018-c0b4-5e6a-b3e2-0081539839c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF67398',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'EV6',
 'odometer': 25,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-03',
 'seller_name': None,
 'title': 'Kia EV6 electric drive 239 kW Business 4WD',
 'transmission': 'automatic',
 'trim': 'Business 4WD',
 'year': 2024}
2026-03-27 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF67398%27 HTTP/1.1" 200 None
2026-03-27 11:12:08 [auto1.de] INFO: Saving data for JF67398: {'auction_closing_time': 1774628507.0, 'created_time': 1773776317.40867, 'last_price_update_time': 1774609928.164657}
2026-03-27 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JF67398') HTTP/1.1" 204 0
2026-03-27 11:12:08 [auto1.de] INFO: Found listing with ID: CT12503
2026-03-27 11:12:08 [auto1.de] INFO: Found listing with ID: KE44581
2026-03-27 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE44581%27 HTTP/1.1" 200 None
2026-03-27 11:12:08 [auto1.de] INFO: Scrape type for KE44581: 2
2026-03-27 11:12:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c20ff28a-fe7d-59ad-bd61-c526b84f7ff5 with identifier: KE44581
2026-03-27 11:12:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c20ff28a-fe7d-59ad-bd61-c526b84f7ff5 with scrape type 2
2026-03-27 11:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c20ff28a-fe7d-59ad-bd61-c526b84f7ff5 with scrape type 2
2026-03-27 11:12:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c20ff28a-fe7d-59ad-bd61-c526b84f7ff5, identifier: KE44581
2026-03-27 11:12:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c20ff28a-fe7d-59ad-bd61-c526b84f7ff5 with identifier: KE44581
2026-03-27 11:12:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c20ff28a-fe7d-59ad-bd61-c526b84f7ff5 with identifier: KE44581
2026-03-27 11:12:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c20ff28a-fe7d-59ad-bd61-c526b84f7ff5 with identifier: KE44581 to the API
2026-03-27 11:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-27T16:13:39Z',
 'fuel_type': 'diesel',
 'id': 'c20ff28a-fe7d-59ad-bd61-c526b84f7ff5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE44581',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 166717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-27',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2017}
2026-03-27 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE44581%27 HTTP/1.1" 200 None
2026-03-27 11:12:08 [auto1.de] INFO: Saving data for KE44581: {'auction_closing_time': 1774628019.0, 'created_time': 1773345592.819199, 'last_price_update_time': 1774609928.585197}
2026-03-27 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE44581') HTTP/1.1" 204 0
2026-03-27 11:12:08 [auto1.de] INFO: Found listing with ID: EL88998
2026-03-27 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL88998%27 HTTP/1.1" 200 None
2026-03-27 11:12:08 [auto1.de] INFO: Scrape type for EL88998: 2
2026-03-27 11:12:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05d89643-7bce-5dc9-b67a-18cca70e44d5 with identifier: EL88998
2026-03-27 11:12:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05d89643-7bce-5dc9-b67a-18cca70e44d5 with scrape type 2
2026-03-27 11:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05d89643-7bce-5dc9-b67a-18cca70e44d5 with scrape type 2
2026-03-27 11:12:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05d89643-7bce-5dc9-b67a-18cca70e44d5, identifier: EL88998
2026-03-27 11:12:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05d89643-7bce-5dc9-b67a-18cca70e44d5 with identifier: EL88998
2026-03-27 11:12:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05d89643-7bce-5dc9-b67a-18cca70e44d5 with identifier: EL88998
2026-03-27 11:12:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05d89643-7bce-5dc9-b67a-18cca70e44d5 with identifier: EL88998 to the API
2026-03-27 11:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 118,
 'expiration_date': '2026-03-27T16:16:02Z',
 'fuel_type': 'electro',
 'id': '05d89643-7bce-5dc9-b67a-18cca70e44d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL88998',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500e',
 'odometer': 16291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seller_name': None,
 'title': 'Fiat 500e electric drive 87 kW Icon',
 'transmission': 'automatic',
 'trim': 'Icon',
 'year': 2022}
2026-03-27 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL88998%27 HTTP/1.1" 200 None
2026-03-27 11:12:09 [auto1.de] INFO: Saving data for EL88998: {'auction_closing_time': 1774628162.0, 'created_time': 1773686271.471977, 'last_price_update_time': 1774609929.032097}
2026-03-27 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL88998') HTTP/1.1" 204 0
2026-03-27 11:12:09 [auto1.de] INFO: Found listing with ID: EN95932
2026-03-27 11:12:09 [auto1.de] INFO: Found listing with ID: HX06871
2026-03-27 11:12:09 [auto1.de] INFO: Found listing with ID: MZ42263
2026-03-27 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ42263%27 HTTP/1.1" 200 None
2026-03-27 11:12:09 [auto1.de] INFO: Scrape type for MZ42263: 2
2026-03-27 11:12:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a16d3b90-d713-5273-98ea-420199b89fb9 with identifier: MZ42263
2026-03-27 11:12:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a16d3b90-d713-5273-98ea-420199b89fb9 with scrape type 2
2026-03-27 11:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a16d3b90-d713-5273-98ea-420199b89fb9 with scrape type 2
2026-03-27 11:12:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a16d3b90-d713-5273-98ea-420199b89fb9, identifier: MZ42263
2026-03-27 11:12:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a16d3b90-d713-5273-98ea-420199b89fb9 with identifier: MZ42263
2026-03-27 11:12:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a16d3b90-d713-5273-98ea-420199b89fb9 with identifier: MZ42263
2026-03-27 11:12:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a16d3b90-d713-5273-98ea-420199b89fb9 with identifier: MZ42263 to the API
2026-03-27 11:12:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:01:06Z',
 'fuel_type': 'diesel',
 'id': 'a16d3b90-d713-5273-98ea-420199b89fb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ42263',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Movano',
 'odometer': 11,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-03',
 'seller_name': None,
 'title': 'Opel Movano 2.2 CDTI HKa L3H2 3,5t Edition',
 'transmission': 'manual',
 'trim': 'HKa L3H2 3,5t Edition',
 'year': 2024}
2026-03-27 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ42263%27 HTTP/1.1" 200 None
2026-03-27 11:12:09 [auto1.de] INFO: Saving data for MZ42263: {'auction_closing_time': 1774627266.0, 'created_time': 1773381262.384473, 'last_price_update_time': 1774609929.499284}
2026-03-27 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ42263') HTTP/1.1" 204 0
2026-03-27 11:12:09 [auto1.de] INFO: Found listing with ID: ML81527
2026-03-27 11:12:09 [auto1.de] INFO: Found listing with ID: MW19833
2026-03-27 11:12:09 [auto1.de] INFO: Found listing with ID: TK27520
2026-03-27 11:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:12:10 [auto1.de] INFO: Channel: 24h | Page: 241 | totalHits: 10672 | hits on page: 40
2026-03-27 11:12:10 [auto1.de] INFO: Found listing with ID: ML81527
2026-03-27 11:12:10 [auto1.de] INFO: Found listing with ID: MW19833
2026-03-27 11:12:10 [auto1.de] INFO: Found listing with ID: TK27520
2026-03-27 11:12:10 [auto1.de] INFO: Found listing with ID: RN98053
2026-03-27 11:12:10 [auto1.de] INFO: Found listing with ID: RA50795
2026-03-27 11:12:10 [auto1.de] INFO: Found listing with ID: NV02261
2026-03-27 11:12:10 [auto1.de] INFO: Found listing with ID: CV53813
2026-03-27 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV53813%27 HTTP/1.1" 200 None
2026-03-27 11:12:10 [auto1.de] INFO: Scrape type for CV53813: 2
2026-03-27 11:12:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6a2f113-bd85-5c42-a72e-ca22dbf17510 with identifier: CV53813
2026-03-27 11:12:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6a2f113-bd85-5c42-a72e-ca22dbf17510 with scrape type 2
2026-03-27 11:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6a2f113-bd85-5c42-a72e-ca22dbf17510 with scrape type 2
2026-03-27 11:12:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6a2f113-bd85-5c42-a72e-ca22dbf17510, identifier: CV53813
2026-03-27 11:12:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6a2f113-bd85-5c42-a72e-ca22dbf17510 with identifier: CV53813
2026-03-27 11:12:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6a2f113-bd85-5c42-a72e-ca22dbf17510 with identifier: CV53813
2026-03-27 11:12:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6a2f113-bd85-5c42-a72e-ca22dbf17510 with identifier: CV53813 to the API
2026-03-27 11:12:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-27T16:47:31Z',
 'fuel_type': 'electro',
 'id': 'd6a2f113-bd85-5c42-a72e-ca22dbf17510',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV53813',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 18337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-08',
 'seller_name': None,
 'title': 'Renault Twingo electric drive 60 kW Techno Electric',
 'transmission': 'automatic',
 'trim': 'Techno Electric',
 'year': 2022}
2026-03-27 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV53813%27 HTTP/1.1" 200 None
2026-03-27 11:12:11 [auto1.de] INFO: Saving data for CV53813: {'auction_closing_time': 1774630051.0, 'created_time': 1773400246.214753, 'last_price_update_time': 1774609931.129519}
2026-03-27 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV53813') HTTP/1.1" 204 0
2026-03-27 11:12:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:12:11 [auto1.de] INFO: Found listing with ID: UU21358
2026-03-27 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU21358%27 HTTP/1.1" 200 None
2026-03-27 11:12:11 [auto1.de] INFO: Scrape type for UU21358: 2
2026-03-27 11:12:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abf950d6-4c82-5cf0-8952-9ae795f86ad1 with identifier: UU21358
2026-03-27 11:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abf950d6-4c82-5cf0-8952-9ae795f86ad1 with scrape type 2
2026-03-27 11:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abf950d6-4c82-5cf0-8952-9ae795f86ad1 with scrape type 2
2026-03-27 11:12:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abf950d6-4c82-5cf0-8952-9ae795f86ad1, identifier: UU21358
2026-03-27 11:12:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abf950d6-4c82-5cf0-8952-9ae795f86ad1 with identifier: UU21358
2026-03-27 11:12:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abf950d6-4c82-5cf0-8952-9ae795f86ad1 with identifier: UU21358
2026-03-27 11:12:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abf950d6-4c82-5cf0-8952-9ae795f86ad1 with identifier: UU21358 to the API
2026-03-27 11:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-27T16:29:15Z',
 'fuel_type': 'electro',
 'id': 'abf950d6-4c82-5cf0-8952-9ae795f86ad1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU21358',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 30041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-01',
 'seller_name': None,
 'title': 'Renault Twingo electric drive 60 kW Techno Electric',
 'transmission': 'automatic',
 'trim': 'Techno Electric',
 'year': 2023}
2026-03-27 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU21358%27 HTTP/1.1" 200 None
2026-03-27 11:12:11 [auto1.de] INFO: Saving data for UU21358: {'auction_closing_time': 1774628955.0, 'created_time': 1773400160.362147, 'last_price_update_time': 1774609931.581407}
2026-03-27 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UU21358') HTTP/1.1" 204 0
2026-03-27 11:12:11 [auto1.de] INFO: Found listing with ID: GB40487
2026-03-27 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB40487%27 HTTP/1.1" 200 None
2026-03-27 11:12:11 [auto1.de] INFO: Scrape type for GB40487: 2
2026-03-27 11:12:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb2609a2-1aca-568c-94a3-4f23f6faeee1 with identifier: GB40487
2026-03-27 11:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb2609a2-1aca-568c-94a3-4f23f6faeee1 with scrape type 2
2026-03-27 11:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb2609a2-1aca-568c-94a3-4f23f6faeee1 with scrape type 2
2026-03-27 11:12:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb2609a2-1aca-568c-94a3-4f23f6faeee1, identifier: GB40487
2026-03-27 11:12:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb2609a2-1aca-568c-94a3-4f23f6faeee1 with identifier: GB40487
2026-03-27 11:12:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb2609a2-1aca-568c-94a3-4f23f6faeee1 with identifier: GB40487
2026-03-27 11:12:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb2609a2-1aca-568c-94a3-4f23f6faeee1 with identifier: GB40487 to the API
2026-03-27 11:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-27T16:21:11Z',
 'fuel_type': 'electro',
 'id': 'fb2609a2-1aca-568c-94a3-4f23f6faeee1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB40487',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 17481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-20',
 'seller_name': None,
 'title': 'Renault Twingo electric drive 60 kW Techno Electric',
 'transmission': 'automatic',
 'trim': 'Techno Electric',
 'year': 2023}
2026-03-27 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB40487%27 HTTP/1.1" 200 None
2026-03-27 11:12:12 [auto1.de] INFO: Saving data for GB40487: {'auction_closing_time': 1774628471.0, 'created_time': 1773400202.308976, 'last_price_update_time': 1774609932.144729}
2026-03-27 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB40487') HTTP/1.1" 204 0
2026-03-27 11:12:12 [auto1.de] INFO: Found listing with ID: XM87892
2026-03-27 11:12:12 [auto1.de] INFO: Found listing with ID: NF41900
2026-03-27 11:12:12 [auto1.de] INFO: Found listing with ID: WG90471
2026-03-27 11:12:12 [auto1.de] INFO: Found listing with ID: FL75040
2026-03-27 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL75040%27 HTTP/1.1" 200 None
2026-03-27 11:12:12 [auto1.de] INFO: Scrape type for FL75040: 2
2026-03-27 11:12:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99a8a499-1bee-5c4a-9848-fc0a063e31ce with identifier: FL75040
2026-03-27 11:12:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99a8a499-1bee-5c4a-9848-fc0a063e31ce with scrape type 2
2026-03-27 11:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99a8a499-1bee-5c4a-9848-fc0a063e31ce with scrape type 2
2026-03-27 11:12:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99a8a499-1bee-5c4a-9848-fc0a063e31ce, identifier: FL75040
2026-03-27 11:12:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99a8a499-1bee-5c4a-9848-fc0a063e31ce with identifier: FL75040
2026-03-27 11:12:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99a8a499-1bee-5c4a-9848-fc0a063e31ce with identifier: FL75040
2026-03-27 11:12:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99a8a499-1bee-5c4a-9848-fc0a063e31ce with identifier: FL75040 to the API
2026-03-27 11:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-27T16:40:49Z',
 'fuel_type': 'electro',
 'id': '99a8a499-1bee-5c4a-9848-fc0a063e31ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL75040',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane E-Tech',
 'odometer': 27161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-20',
 'seller_name': None,
 'title': 'Renault Megane E-Tech EV60 Iconic',
 'transmission': 'automatic',
 'trim': 'Iconic',
 'year': 2022}
2026-03-27 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL75040%27 HTTP/1.1" 200 None
2026-03-27 11:12:12 [auto1.de] INFO: Saving data for FL75040: {'auction_closing_time': 1774629649.0, 'created_time': 1773776317.936727, 'last_price_update_time': 1774609932.591316}
2026-03-27 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL75040') HTTP/1.1" 204 0
2026-03-27 11:12:12 [auto1.de] INFO: Found listing with ID: XY68351
2026-03-27 11:12:12 [auto1.de] INFO: Found listing with ID: FH83727
2026-03-27 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH83727%27 HTTP/1.1" 200 None
2026-03-27 11:12:12 [auto1.de] INFO: Scrape type for FH83727: 2
2026-03-27 11:12:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be3e642c-a2bf-5ae2-9bf5-274759b71517 with identifier: FH83727
2026-03-27 11:12:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be3e642c-a2bf-5ae2-9bf5-274759b71517 with scrape type 2
2026-03-27 11:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be3e642c-a2bf-5ae2-9bf5-274759b71517 with scrape type 2
2026-03-27 11:12:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be3e642c-a2bf-5ae2-9bf5-274759b71517, identifier: FH83727
2026-03-27 11:12:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be3e642c-a2bf-5ae2-9bf5-274759b71517 with identifier: FH83727
2026-03-27 11:12:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be3e642c-a2bf-5ae2-9bf5-274759b71517 with identifier: FH83727
2026-03-27 11:12:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be3e642c-a2bf-5ae2-9bf5-274759b71517 with identifier: FH83727 to the API
2026-03-27 11:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:02:25Z',
 'fuel_type': 'diesel',
 'id': 'be3e642c-a2bf-5ae2-9bf5-274759b71517',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH83727',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 29035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-23',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI IQ.DRIVE 4Motion',
 'transmission': 'automatic',
 'trim': 'IQ.DRIVE 4Motion',
 'year': 2019}
2026-03-27 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH83727%27 HTTP/1.1" 200 None
2026-03-27 11:12:13 [auto1.de] INFO: Saving data for FH83727: {'auction_closing_time': 1774627345.0, 'created_time': 1774521891.880888, 'last_price_update_time': 1774609933.013635}
2026-03-27 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH83727') HTTP/1.1" 204 0
2026-03-27 11:12:13 [auto1.de] INFO: Found listing with ID: WX86572
2026-03-27 11:12:13 [auto1.de] INFO: Found listing with ID: AA64046
2026-03-27 11:12:13 [auto1.de] INFO: Found listing with ID: ZW60338
2026-03-27 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW60338%27 HTTP/1.1" 200 None
2026-03-27 11:12:13 [auto1.de] INFO: Scrape type for ZW60338: 2
2026-03-27 11:12:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6761bb1-61f1-5615-ba88-c15d724142ed with identifier: ZW60338
2026-03-27 11:12:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6761bb1-61f1-5615-ba88-c15d724142ed with scrape type 2
2026-03-27 11:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6761bb1-61f1-5615-ba88-c15d724142ed with scrape type 2
2026-03-27 11:12:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6761bb1-61f1-5615-ba88-c15d724142ed, identifier: ZW60338
2026-03-27 11:12:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6761bb1-61f1-5615-ba88-c15d724142ed with identifier: ZW60338
2026-03-27 11:12:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6761bb1-61f1-5615-ba88-c15d724142ed with identifier: ZW60338
2026-03-27 11:12:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6761bb1-61f1-5615-ba88-c15d724142ed with identifier: ZW60338 to the API
2026-03-27 11:12:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-27T16:06:21Z',
 'fuel_type': 'petrol',
 'id': 'f6761bb1-61f1-5615-ba88-c15d724142ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW60338',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 162693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-29',
 'seller_name': None,
 'title': 'Opel Insignia 2.0 Turbo Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2010}
2026-03-27 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW60338%27 HTTP/1.1" 200 None
2026-03-27 11:12:13 [auto1.de] INFO: Saving data for ZW60338: {'auction_closing_time': 1774627581.0, 'created_time': 1774522151.260255, 'last_price_update_time': 1774609933.460836}
2026-03-27 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW60338') HTTP/1.1" 204 0
2026-03-27 11:12:13 [auto1.de] INFO: Found listing with ID: VX17100
2026-03-27 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX17100%27 HTTP/1.1" 200 None
2026-03-27 11:12:13 [auto1.de] INFO: Scrape type for VX17100: 2
2026-03-27 11:12:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecc6d56a-cfae-57d2-973a-735e6fc273ef with identifier: VX17100
2026-03-27 11:12:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecc6d56a-cfae-57d2-973a-735e6fc273ef with scrape type 2
2026-03-27 11:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecc6d56a-cfae-57d2-973a-735e6fc273ef with scrape type 2
2026-03-27 11:12:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecc6d56a-cfae-57d2-973a-735e6fc273ef, identifier: VX17100
2026-03-27 11:12:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecc6d56a-cfae-57d2-973a-735e6fc273ef with identifier: VX17100
2026-03-27 11:12:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecc6d56a-cfae-57d2-973a-735e6fc273ef with identifier: VX17100
2026-03-27 11:12:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecc6d56a-cfae-57d2-973a-735e6fc273ef with identifier: VX17100 to the API
2026-03-27 11:12:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:38:39Z',
 'fuel_type': 'electro',
 'id': 'ecc6d56a-cfae-57d2-973a-735e6fc273ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX17100',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 11601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-20',
 'seller_name': None,
 'title': 'Renault Kangoo electric drive 90 kW Start L1',
 'transmission': 'automatic',
 'trim': 'Start L1',
 'year': 2022}
2026-03-27 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX17100%27 HTTP/1.1" 200 None
2026-03-27 11:12:13 [auto1.de] INFO: Saving data for VX17100: {'auction_closing_time': 1774629519.0, 'created_time': 1773776337.10057, 'last_price_update_time': 1774609933.897087}
2026-03-27 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX17100') HTTP/1.1" 204 0
2026-03-27 11:12:14 [auto1.de] INFO: Found listing with ID: HZ79705
2026-03-27 11:12:14 [auto1.de] INFO: Found listing with ID: BP69696
2026-03-27 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69696%27 HTTP/1.1" 200 None
2026-03-27 11:12:14 [auto1.de] INFO: Scrape type for BP69696: 2
2026-03-27 11:12:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b59145b-d2ac-5292-8f2e-a1f9dd99288b with identifier: BP69696
2026-03-27 11:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b59145b-d2ac-5292-8f2e-a1f9dd99288b with scrape type 2
2026-03-27 11:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b59145b-d2ac-5292-8f2e-a1f9dd99288b with scrape type 2
2026-03-27 11:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b59145b-d2ac-5292-8f2e-a1f9dd99288b, identifier: BP69696
2026-03-27 11:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b59145b-d2ac-5292-8f2e-a1f9dd99288b with identifier: BP69696
2026-03-27 11:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b59145b-d2ac-5292-8f2e-a1f9dd99288b with identifier: BP69696
2026-03-27 11:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b59145b-d2ac-5292-8f2e-a1f9dd99288b with identifier: BP69696 to the API
2026-03-27 11:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-27T16:05:03Z',
 'fuel_type': 'petrol',
 'id': '0b59145b-d2ac-5292-8f2e-a1f9dd99288b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP69696',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 79789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 220 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-27 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69696%27 HTTP/1.1" 200 None
2026-03-27 11:12:14 [auto1.de] INFO: Saving data for BP69696: {'auction_closing_time': 1774627503.0, 'created_time': 1774521623.259345, 'last_price_update_time': 1774609934.581826}
2026-03-27 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP69696') HTTP/1.1" 204 0
2026-03-27 11:12:14 [auto1.de] INFO: Found listing with ID: AC15179
2026-03-27 11:12:14 [auto1.de] INFO: Found listing with ID: CY45921
2026-03-27 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY45921%27 HTTP/1.1" 200 None
2026-03-27 11:12:14 [auto1.de] INFO: Scrape type for CY45921: 2
2026-03-27 11:12:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5 with identifier: CY45921
2026-03-27 11:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5 with scrape type 2
2026-03-27 11:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5 with scrape type 2
2026-03-27 11:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5, identifier: CY45921
2026-03-27 11:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5 with identifier: CY45921
2026-03-27 11:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5 with identifier: CY45921
2026-03-27 11:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5 with identifier: CY45921 to the API
2026-03-27 11:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-27T16:10:34Z',
 'fuel_type': 'petrol',
 'id': 'f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY45921',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 40343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-13',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI Beats',
 'transmission': 'manual',
 'trim': 'Beats',
 'year': 2020}
2026-03-27 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY45921%27 HTTP/1.1" 200 None
2026-03-27 11:12:15 [auto1.de] INFO: Saving data for CY45921: {'auction_closing_time': 1774627834.0, 'created_time': 1774521622.535347, 'last_price_update_time': 1774609935.457168}
2026-03-27 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY45921') HTTP/1.1" 204 0
2026-03-27 11:12:15 [auto1.de] INFO: Found listing with ID: SN37311
2026-03-27 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN37311%27 HTTP/1.1" 200 None
2026-03-27 11:12:15 [auto1.de] INFO: Scrape type for SN37311: 2
2026-03-27 11:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c7cf833-f49f-5e7c-9f99-805f5a0076e1 with identifier: SN37311
2026-03-27 11:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c7cf833-f49f-5e7c-9f99-805f5a0076e1 with scrape type 2
2026-03-27 11:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c7cf833-f49f-5e7c-9f99-805f5a0076e1 with scrape type 2
2026-03-27 11:12:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c7cf833-f49f-5e7c-9f99-805f5a0076e1, identifier: SN37311
2026-03-27 11:12:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c7cf833-f49f-5e7c-9f99-805f5a0076e1 with identifier: SN37311
2026-03-27 11:12:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c7cf833-f49f-5e7c-9f99-805f5a0076e1 with identifier: SN37311
2026-03-27 11:12:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c7cf833-f49f-5e7c-9f99-805f5a0076e1 with identifier: SN37311 to the API
2026-03-27 11:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-27T16:07:22Z',
 'fuel_type': 'petrol',
 'id': '0c7cf833-f49f-5e7c-9f99-805f5a0076e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN37311',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 7403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-20',
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2024}
2026-03-27 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN37311%27 HTTP/1.1" 200 None
2026-03-27 11:12:15 [auto1.de] INFO: Saving data for SN37311: {'auction_closing_time': 1774627642.0, 'created_time': 1774521698.321286, 'last_price_update_time': 1774609935.883856}
2026-03-27 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN37311') HTTP/1.1" 204 0
2026-03-27 11:12:15 [auto1.de] INFO: Found listing with ID: CY90259
2026-03-27 11:12:15 [auto1.de] INFO: Found listing with ID: HP00850
2026-03-27 11:12:15 [auto1.de] INFO: Found listing with ID: ZR08367
2026-03-27 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR08367%27 HTTP/1.1" 200 None
2026-03-27 11:12:15 [auto1.de] INFO: Scrape type for ZR08367: 2
2026-03-27 11:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25d98715-d5bd-5045-b106-666888f5010e with identifier: ZR08367
2026-03-27 11:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25d98715-d5bd-5045-b106-666888f5010e with scrape type 2
2026-03-27 11:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25d98715-d5bd-5045-b106-666888f5010e with scrape type 2
2026-03-27 11:12:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25d98715-d5bd-5045-b106-666888f5010e, identifier: ZR08367
2026-03-27 11:12:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25d98715-d5bd-5045-b106-666888f5010e with identifier: ZR08367
2026-03-27 11:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25d98715-d5bd-5045-b106-666888f5010e with identifier: ZR08367
2026-03-27 11:12:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25d98715-d5bd-5045-b106-666888f5010e with identifier: ZR08367 to the API
2026-03-27 11:12:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-27T16:11:46Z',
 'fuel_type': 'petrol',
 'id': '25d98715-d5bd-5045-b106-666888f5010e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR08367',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 107814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-31',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-27 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR08367%27 HTTP/1.1" 200 None
2026-03-27 11:12:16 [auto1.de] INFO: Saving data for ZR08367: {'auction_closing_time': 1774627906.0, 'created_time': 1774521562.999123, 'last_price_update_time': 1774609936.344416}
2026-03-27 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR08367') HTTP/1.1" 204 0
2026-03-27 11:12:16 [auto1.de] INFO: Found listing with ID: ZJ17739
2026-03-27 11:12:16 [auto1.de] INFO: Found listing with ID: JF38028
2026-03-27 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF38028%27 HTTP/1.1" 200 None
2026-03-27 11:12:16 [auto1.de] INFO: Scrape type for JF38028: 2
2026-03-27 11:12:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a6e0a4a-5b22-5d6a-8843-6fb8336ff1ea with identifier: JF38028
2026-03-27 11:12:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a6e0a4a-5b22-5d6a-8843-6fb8336ff1ea with scrape type 2
2026-03-27 11:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a6e0a4a-5b22-5d6a-8843-6fb8336ff1ea with scrape type 2
2026-03-27 11:12:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a6e0a4a-5b22-5d6a-8843-6fb8336ff1ea, identifier: JF38028
2026-03-27 11:12:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a6e0a4a-5b22-5d6a-8843-6fb8336ff1ea with identifier: JF38028
2026-03-27 11:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a6e0a4a-5b22-5d6a-8843-6fb8336ff1ea with identifier: JF38028
2026-03-27 11:12:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a6e0a4a-5b22-5d6a-8843-6fb8336ff1ea with identifier: JF38028 to the API
2026-03-27 11:12:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-27T16:22:30Z',
 'fuel_type': 'electro',
 'id': '5a6e0a4a-5b22-5d6a-8843-6fb8336ff1ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF38028',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 10818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seller_name': None,
 'title': 'Renault Kangoo electric drive 44 kW Z.E. 33',
 'transmission': 'automatic',
 'trim': 'Z.E. 33',
 'year': 2021}
2026-03-27 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF38028%27 HTTP/1.1" 200 None
2026-03-27 11:12:16 [auto1.de] INFO: Saving data for JF38028: {'auction_closing_time': 1774628550.0, 'created_time': 1773776316.544518, 'last_price_update_time': 1774609936.78511}
2026-03-27 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JF38028') HTTP/1.1" 204 0
2026-03-27 11:12:16 [auto1.de] INFO: Found listing with ID: JD63234
2026-03-27 11:12:16 [auto1.de] INFO: Found listing with ID: BE80399
2026-03-27 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE80399%27 HTTP/1.1" 200 None
2026-03-27 11:12:16 [auto1.de] INFO: Scrape type for BE80399: 2
2026-03-27 11:12:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d641f77-047a-55f1-a7f1-71533fde03ad with identifier: BE80399
2026-03-27 11:12:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d641f77-047a-55f1-a7f1-71533fde03ad with scrape type 2
2026-03-27 11:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d641f77-047a-55f1-a7f1-71533fde03ad with scrape type 2
2026-03-27 11:12:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d641f77-047a-55f1-a7f1-71533fde03ad, identifier: BE80399
2026-03-27 11:12:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d641f77-047a-55f1-a7f1-71533fde03ad with identifier: BE80399
2026-03-27 11:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d641f77-047a-55f1-a7f1-71533fde03ad with identifier: BE80399
2026-03-27 11:12:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d641f77-047a-55f1-a7f1-71533fde03ad with identifier: BE80399 to the API
2026-03-27 11:12:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-27T16:11:17Z',
 'fuel_type': 'petrol',
 'id': '0d641f77-047a-55f1-a7f1-71533fde03ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE80399',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 63237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-19',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Argento',
 'transmission': 'manual',
 'trim': 'Argento',
 'year': 2004}
2026-03-27 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE80399%27 HTTP/1.1" 200 None
2026-03-27 11:12:17 [auto1.de] INFO: Saving data for BE80399: {'auction_closing_time': 1774627877.0, 'created_time': 1774521607.137808, 'last_price_update_time': 1774609937.269791}
2026-03-27 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE80399') HTTP/1.1" 204 0
2026-03-27 11:12:17 [auto1.de] INFO: Found listing with ID: KW04664
2026-03-27 11:12:17 [auto1.de] INFO: Found listing with ID: UG63926
2026-03-27 11:12:17 [auto1.de] INFO: Found listing with ID: YA55635
2026-03-27 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA55635%27 HTTP/1.1" 200 None
2026-03-27 11:12:17 [auto1.de] INFO: Scrape type for YA55635: 2
2026-03-27 11:12:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4992bf17-9608-5ab3-ab4e-7acc54ff6c79 with identifier: YA55635
2026-03-27 11:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4992bf17-9608-5ab3-ab4e-7acc54ff6c79 with scrape type 2
2026-03-27 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4992bf17-9608-5ab3-ab4e-7acc54ff6c79 with scrape type 2
2026-03-27 11:12:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4992bf17-9608-5ab3-ab4e-7acc54ff6c79, identifier: YA55635
2026-03-27 11:12:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4992bf17-9608-5ab3-ab4e-7acc54ff6c79 with identifier: YA55635
2026-03-27 11:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4992bf17-9608-5ab3-ab4e-7acc54ff6c79 with identifier: YA55635
2026-03-27 11:12:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4992bf17-9608-5ab3-ab4e-7acc54ff6c79 with identifier: YA55635 to the API
2026-03-27 11:12:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-27T16:37:40Z',
 'fuel_type': 'petrol',
 'id': '4992bf17-9608-5ab3-ab4e-7acc54ff6c79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA55635',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Austral',
 'odometer': 26957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-04',
 'seller_name': None,
 'title': 'Renault Austral 1.3 TCe Mild-Hybrid Evolution',
 'transmission': 'automatic',
 'trim': 'Evolution',
 'year': 2023}
2026-03-27 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA55635%27 HTTP/1.1" 200 None
2026-03-27 11:12:17 [auto1.de] INFO: Saving data for YA55635: {'auction_closing_time': 1774629460.0, 'created_time': 1774034742.403735, 'last_price_update_time': 1774609937.82416}
2026-03-27 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA55635') HTTP/1.1" 204 0
2026-03-27 11:12:17 [auto1.de] INFO: Found listing with ID: DH07343
2026-03-27 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH07343%27 HTTP/1.1" 200 None
2026-03-27 11:12:17 [auto1.de] INFO: Scrape type for DH07343: 2
2026-03-27 11:12:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0214fa84-74a5-5f98-bf78-b441e7b5eb15 with identifier: DH07343
2026-03-27 11:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0214fa84-74a5-5f98-bf78-b441e7b5eb15 with scrape type 2
2026-03-27 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0214fa84-74a5-5f98-bf78-b441e7b5eb15 with scrape type 2
2026-03-27 11:12:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0214fa84-74a5-5f98-bf78-b441e7b5eb15, identifier: DH07343
2026-03-27 11:12:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0214fa84-74a5-5f98-bf78-b441e7b5eb15 with identifier: DH07343
2026-03-27 11:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0214fa84-74a5-5f98-bf78-b441e7b5eb15 with identifier: DH07343
2026-03-27 11:12:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0214fa84-74a5-5f98-bf78-b441e7b5eb15 with identifier: DH07343 to the API
2026-03-27 11:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:33:21Z',
 'fuel_type': 'petrol',
 'id': '0214fa84-74a5-5f98-bf78-b441e7b5eb15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH07343',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 46936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-07',
 'seller_name': None,
 'title': 'Renault Arkana 1.3 TCe Mild-Hybrid Techno',
 'transmission': 'automatic',
 'trim': 'Techno',
 'year': 2022}
2026-03-27 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH07343%27 HTTP/1.1" 200 None
2026-03-27 11:12:18 [auto1.de] INFO: Saving data for DH07343: {'auction_closing_time': 1774629201.0, 'created_time': 1773403328.256214, 'last_price_update_time': 1774609938.271356}
2026-03-27 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DH07343') HTTP/1.1" 204 0
2026-03-27 11:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:12:18 [auto1.de] INFO: Found listing with ID: YH78241
2026-03-27 11:12:18 [auto1.de] INFO: Found listing with ID: NZ25875
2026-03-27 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ25875%27 HTTP/1.1" 200 None
2026-03-27 11:12:18 [auto1.de] INFO: Scrape type for NZ25875: 2
2026-03-27 11:12:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 601e9cdd-97c9-525e-b7cf-7c4a8e449b2a with identifier: NZ25875
2026-03-27 11:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 601e9cdd-97c9-525e-b7cf-7c4a8e449b2a with scrape type 2
2026-03-27 11:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 601e9cdd-97c9-525e-b7cf-7c4a8e449b2a with scrape type 2
2026-03-27 11:12:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 601e9cdd-97c9-525e-b7cf-7c4a8e449b2a, identifier: NZ25875
2026-03-27 11:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 601e9cdd-97c9-525e-b7cf-7c4a8e449b2a with identifier: NZ25875
2026-03-27 11:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 601e9cdd-97c9-525e-b7cf-7c4a8e449b2a with identifier: NZ25875
2026-03-27 11:12:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 601e9cdd-97c9-525e-b7cf-7c4a8e449b2a with identifier: NZ25875 to the API
2026-03-27 11:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:21:08Z',
 'fuel_type': 'diesel',
 'id': '601e9cdd-97c9-525e-b7cf-7c4a8e449b2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ25875',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 260732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-14',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2016}
2026-03-27 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ25875%27 HTTP/1.1" 200 None
2026-03-27 11:12:18 [auto1.de] INFO: Saving data for NZ25875: {'auction_closing_time': 1774628468.0, 'created_time': 1774521561.69777, 'last_price_update_time': 1774609938.886923}
2026-03-27 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ25875') HTTP/1.1" 204 0
2026-03-27 11:12:18 [auto1.de] INFO: Found listing with ID: HD32388
2026-03-27 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD32388%27 HTTP/1.1" 200 None
2026-03-27 11:12:18 [auto1.de] INFO: Scrape type for HD32388: 2
2026-03-27 11:12:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af33255c-4c68-5ceb-a8f9-2f3d5f556bc5 with identifier: HD32388
2026-03-27 11:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af33255c-4c68-5ceb-a8f9-2f3d5f556bc5 with scrape type 2
2026-03-27 11:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af33255c-4c68-5ceb-a8f9-2f3d5f556bc5 with scrape type 2
2026-03-27 11:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af33255c-4c68-5ceb-a8f9-2f3d5f556bc5, identifier: HD32388
2026-03-27 11:12:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af33255c-4c68-5ceb-a8f9-2f3d5f556bc5 with identifier: HD32388
2026-03-27 11:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af33255c-4c68-5ceb-a8f9-2f3d5f556bc5 with identifier: HD32388
2026-03-27 11:12:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af33255c-4c68-5ceb-a8f9-2f3d5f556bc5 with identifier: HD32388 to the API
2026-03-27 11:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:22:31Z',
 'fuel_type': 'petrol',
 'id': 'af33255c-4c68-5ceb-a8f9-2f3d5f556bc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD32388',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 29324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-28',
 'seller_name': None,
 'title': 'Renault Arkana 1.3 TCe Mild-Hybrid Techno',
 'transmission': 'automatic',
 'trim': 'Techno',
 'year': 2023}
2026-03-27 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD32388%27 HTTP/1.1" 200 None
2026-03-27 11:12:19 [auto1.de] INFO: Saving data for HD32388: {'auction_closing_time': 1774628551.0, 'created_time': 1773403125.82703, 'last_price_update_time': 1774609939.667048}
2026-03-27 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD32388') HTTP/1.1" 204 0
2026-03-27 11:12:19 [auto1.de] INFO: Channel: 24h | Page: 242 | totalHits: 10672 | hits on page: 40
2026-03-27 11:12:19 [auto1.de] INFO: Found listing with ID: PS23653
2026-03-27 11:12:19 [auto1.de] INFO: Found listing with ID: RT59744
2026-03-27 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT59744%27 HTTP/1.1" 200 None
2026-03-27 11:12:19 [auto1.de] INFO: Scrape type for RT59744: 2
2026-03-27 11:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ddc1664-9aec-54ae-ad97-7cfa2b4021ef with identifier: RT59744
2026-03-27 11:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ddc1664-9aec-54ae-ad97-7cfa2b4021ef with scrape type 2
2026-03-27 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ddc1664-9aec-54ae-ad97-7cfa2b4021ef with scrape type 2
2026-03-27 11:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ddc1664-9aec-54ae-ad97-7cfa2b4021ef, identifier: RT59744
2026-03-27 11:12:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ddc1664-9aec-54ae-ad97-7cfa2b4021ef with identifier: RT59744
2026-03-27 11:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ddc1664-9aec-54ae-ad97-7cfa2b4021ef with identifier: RT59744
2026-03-27 11:12:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ddc1664-9aec-54ae-ad97-7cfa2b4021ef with identifier: RT59744 to the API
2026-03-27 11:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-27T16:49:12Z',
 'fuel_type': 'diesel',
 'id': '7ddc1664-9aec-54ae-ad97-7cfa2b4021ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT59744',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Amarok',
 'odometer': 158795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-19',
 'seller_name': None,
 'title': 'Volkswagen Amarok 3.0 V6 TDI Aventura DoubleCab 4Motion',
 'transmission': 'automatic',
 'trim': 'Aventura DoubleCab 4Motion',
 'year': 2017}
2026-03-27 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT59744%27 HTTP/1.1" 200 None
2026-03-27 11:12:20 [auto1.de] INFO: Saving data for RT59744: {'auction_closing_time': 1774630152.0, 'created_time': 1774521549.306085, 'last_price_update_time': 1774609940.149379}
2026-03-27 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT59744') HTTP/1.1" 204 0
2026-03-27 11:12:20 [auto1.de] INFO: Found listing with ID: SM57605
2026-03-27 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM57605%27 HTTP/1.1" 200 None
2026-03-27 11:12:20 [auto1.de] INFO: Scrape type for SM57605: 2
2026-03-27 11:12:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8149d089-0eaf-5f16-9848-cfa3b115f894 with identifier: SM57605
2026-03-27 11:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8149d089-0eaf-5f16-9848-cfa3b115f894 with scrape type 2
2026-03-27 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8149d089-0eaf-5f16-9848-cfa3b115f894 with scrape type 2
2026-03-27 11:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8149d089-0eaf-5f16-9848-cfa3b115f894, identifier: SM57605
2026-03-27 11:12:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8149d089-0eaf-5f16-9848-cfa3b115f894 with identifier: SM57605
2026-03-27 11:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8149d089-0eaf-5f16-9848-cfa3b115f894 with identifier: SM57605
2026-03-27 11:12:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8149d089-0eaf-5f16-9848-cfa3b115f894 with identifier: SM57605 to the API
2026-03-27 11:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-27T16:00:14Z',
 'fuel_type': 'petrol',
 'id': '8149d089-0eaf-5f16-9848-cfa3b115f894',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM57605',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 81796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-07',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Spirit 2WD',
 'transmission': 'manual',
 'trim': 'Spirit 2WD',
 'year': 2013}
2026-03-27 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM57605%27 HTTP/1.1" 200 None
2026-03-27 11:12:20 [auto1.de] INFO: Saving data for SM57605: {'auction_closing_time': 1774627214.0, 'created_time': 1773308022.508721, 'last_price_update_time': 1774609940.594704}
2026-03-27 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM57605') HTTP/1.1" 204 0
2026-03-27 11:12:20 [auto1.de] INFO: Found listing with ID: GS80229
2026-03-27 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS80229%27 HTTP/1.1" 200 None
2026-03-27 11:12:20 [auto1.de] INFO: Scrape type for GS80229: 2
2026-03-27 11:12:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d793b1d-1de1-53df-a4de-8a50779b81af with identifier: GS80229
2026-03-27 11:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d793b1d-1de1-53df-a4de-8a50779b81af with scrape type 2
2026-03-27 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d793b1d-1de1-53df-a4de-8a50779b81af with scrape type 2
2026-03-27 11:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d793b1d-1de1-53df-a4de-8a50779b81af, identifier: GS80229
2026-03-27 11:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d793b1d-1de1-53df-a4de-8a50779b81af with identifier: GS80229
2026-03-27 11:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d793b1d-1de1-53df-a4de-8a50779b81af with identifier: GS80229
2026-03-27 11:12:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d793b1d-1de1-53df-a4de-8a50779b81af with identifier: GS80229 to the API
2026-03-27 11:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-27T16:01:29Z',
 'fuel_type': 'petrol',
 'id': '7d793b1d-1de1-53df-a4de-8a50779b81af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS80229',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 21499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-29',
 'seller_name': None,
 'title': 'Opel Grandland X 1.2 Turbo Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2023}
2026-03-27 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS80229%27 HTTP/1.1" 200 None
2026-03-27 11:12:21 [auto1.de] INFO: Saving data for GS80229: {'auction_closing_time': 1774627289.0, 'created_time': 1774034744.96931, 'last_price_update_time': 1774609941.084828}
2026-03-27 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS80229') HTTP/1.1" 204 0
2026-03-27 11:12:21 [auto1.de] INFO: Found listing with ID: VW21734
2026-03-27 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW21734%27 HTTP/1.1" 200 None
2026-03-27 11:12:21 [auto1.de] INFO: Scrape type for VW21734: 2
2026-03-27 11:12:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4e9caa8-41c0-595f-ad8a-261a85610953 with identifier: VW21734
2026-03-27 11:12:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4e9caa8-41c0-595f-ad8a-261a85610953 with scrape type 2
2026-03-27 11:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4e9caa8-41c0-595f-ad8a-261a85610953 with scrape type 2
2026-03-27 11:12:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4e9caa8-41c0-595f-ad8a-261a85610953, identifier: VW21734
2026-03-27 11:12:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4e9caa8-41c0-595f-ad8a-261a85610953 with identifier: VW21734
2026-03-27 11:12:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4e9caa8-41c0-595f-ad8a-261a85610953 with identifier: VW21734
2026-03-27 11:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4e9caa8-41c0-595f-ad8a-261a85610953 with identifier: VW21734 to the API
2026-03-27 11:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-27T16:29:12Z',
 'fuel_type': 'petrol',
 'id': 'e4e9caa8-41c0-595f-ad8a-261a85610953',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW21734',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 40855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-29',
 'seller_name': None,
 'title': 'Opel Grandland X 1.2 Turbo Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2023}
2026-03-27 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW21734%27 HTTP/1.1" 200 None
2026-03-27 11:12:21 [auto1.de] INFO: Saving data for VW21734: {'auction_closing_time': 1774628952.0, 'created_time': 1774034865.801645, 'last_price_update_time': 1774609941.649708}
2026-03-27 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW21734') HTTP/1.1" 204 0
2026-03-27 11:12:21 [auto1.de] INFO: Found listing with ID: EB72108
2026-03-27 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB72108%27 HTTP/1.1" 200 None
2026-03-27 11:12:21 [auto1.de] INFO: Scrape type for EB72108: 2
2026-03-27 11:12:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0da710b4-360a-5b6b-9b9d-72a0566cb47d with identifier: EB72108
2026-03-27 11:12:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0da710b4-360a-5b6b-9b9d-72a0566cb47d with scrape type 2
2026-03-27 11:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0da710b4-360a-5b6b-9b9d-72a0566cb47d with scrape type 2
2026-03-27 11:12:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0da710b4-360a-5b6b-9b9d-72a0566cb47d, identifier: EB72108
2026-03-27 11:12:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0da710b4-360a-5b6b-9b9d-72a0566cb47d with identifier: EB72108
2026-03-27 11:12:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0da710b4-360a-5b6b-9b9d-72a0566cb47d with identifier: EB72108
2026-03-27 11:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0da710b4-360a-5b6b-9b9d-72a0566cb47d with identifier: EB72108 to the API
2026-03-27 11:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-27T16:52:59Z',
 'fuel_type': 'petrol',
 'id': '0da710b4-360a-5b6b-9b9d-72a0566cb47d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB72108',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 43579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-07',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2019}
2026-03-27 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB72108%27 HTTP/1.1" 200 None
2026-03-27 11:12:22 [auto1.de] INFO: Saving data for EB72108: {'auction_closing_time': 1774630379.0, 'created_time': 1773403248.885377, 'last_price_update_time': 1774609942.118207}
2026-03-27 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB72108') HTTP/1.1" 204 0
2026-03-27 11:12:22 [auto1.de] INFO: Found listing with ID: TV24413
2026-03-27 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV24413%27 HTTP/1.1" 200 None
2026-03-27 11:12:22 [auto1.de] INFO: Scrape type for TV24413: 2
2026-03-27 11:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ce6f1f8-423e-594f-88c3-c02a552a7900 with identifier: TV24413
2026-03-27 11:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ce6f1f8-423e-594f-88c3-c02a552a7900 with scrape type 2
2026-03-27 11:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ce6f1f8-423e-594f-88c3-c02a552a7900 with scrape type 2
2026-03-27 11:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ce6f1f8-423e-594f-88c3-c02a552a7900, identifier: TV24413
2026-03-27 11:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ce6f1f8-423e-594f-88c3-c02a552a7900 with identifier: TV24413
2026-03-27 11:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ce6f1f8-423e-594f-88c3-c02a552a7900 with identifier: TV24413
2026-03-27 11:12:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ce6f1f8-423e-594f-88c3-c02a552a7900 with identifier: TV24413 to the API
2026-03-27 11:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 207,
 'expiration_date': '2026-03-27T16:13:13Z',
 'fuel_type': 'petrol',
 'id': '1ce6f1f8-423e-594f-88c3-c02a552a7900',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV24413',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 18015,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-21',
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2023}
2026-03-27 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV24413%27 HTTP/1.1" 200 None
2026-03-27 11:12:22 [auto1.de] INFO: Saving data for TV24413: {'auction_closing_time': 1774627993.0, 'created_time': 1774521549.938154, 'last_price_update_time': 1774609942.534189}
2026-03-27 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV24413') HTTP/1.1" 204 0
2026-03-27 11:12:22 [auto1.de] INFO: Found listing with ID: RV57455
2026-03-27 11:12:22 [auto1.de] INFO: Found listing with ID: CD04973
2026-03-27 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD04973%27 HTTP/1.1" 200 None
2026-03-27 11:12:22 [auto1.de] INFO: Scrape type for CD04973: 2
2026-03-27 11:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8117dddb-e3fe-5b54-94c0-c834d81573fb with identifier: CD04973
2026-03-27 11:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8117dddb-e3fe-5b54-94c0-c834d81573fb with scrape type 2
2026-03-27 11:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8117dddb-e3fe-5b54-94c0-c834d81573fb with scrape type 2
2026-03-27 11:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8117dddb-e3fe-5b54-94c0-c834d81573fb, identifier: CD04973
2026-03-27 11:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8117dddb-e3fe-5b54-94c0-c834d81573fb with identifier: CD04973
2026-03-27 11:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8117dddb-e3fe-5b54-94c0-c834d81573fb with identifier: CD04973
2026-03-27 11:12:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8117dddb-e3fe-5b54-94c0-c834d81573fb with identifier: CD04973 to the API
2026-03-27 11:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-27T16:44:20Z',
 'fuel_type': 'petrol',
 'id': '8117dddb-e3fe-5b54-94c0-c834d81573fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD04973',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 57215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-06',
 'seller_name': None,
 'title': 'Kia XCeed 1.6 TGDI Black Xdition',
 'transmission': 'automatic',
 'trim': 'Black Xdition',
 'year': 2022}
2026-03-27 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD04973%27 HTTP/1.1" 200 None
2026-03-27 11:12:22 [auto1.de] INFO: Saving data for CD04973: {'auction_closing_time': 1774629860.0, 'created_time': 1774034743.312976, 'last_price_update_time': 1774609942.98133}
2026-03-27 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD04973') HTTP/1.1" 204 0
2026-03-27 11:12:22 [auto1.de] INFO: Found listing with ID: RX78682
2026-03-27 11:12:22 [auto1.de] INFO: Found listing with ID: DU13968
2026-03-27 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13968%27 HTTP/1.1" 200 None
2026-03-27 11:12:23 [auto1.de] INFO: Scrape type for DU13968: 2
2026-03-27 11:12:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c61dfcc6-16b0-50a2-964f-30a0979ab6c7 with identifier: DU13968
2026-03-27 11:12:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c61dfcc6-16b0-50a2-964f-30a0979ab6c7 with scrape type 2
2026-03-27 11:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c61dfcc6-16b0-50a2-964f-30a0979ab6c7 with scrape type 2
2026-03-27 11:12:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c61dfcc6-16b0-50a2-964f-30a0979ab6c7, identifier: DU13968
2026-03-27 11:12:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c61dfcc6-16b0-50a2-964f-30a0979ab6c7 with identifier: DU13968
2026-03-27 11:12:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c61dfcc6-16b0-50a2-964f-30a0979ab6c7 with identifier: DU13968
2026-03-27 11:12:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c61dfcc6-16b0-50a2-964f-30a0979ab6c7 with identifier: DU13968 to the API
2026-03-27 11:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-27T16:39:04Z',
 'fuel_type': 'petrol',
 'id': 'c61dfcc6-16b0-50a2-964f-30a0979ab6c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU13968',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 38777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-06',
 'seller_name': None,
 'title': 'Kia XCeed 1.6 TGDI Black Xdition',
 'transmission': 'automatic',
 'trim': 'Black Xdition',
 'year': 2022}
2026-03-27 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13968%27 HTTP/1.1" 200 None
2026-03-27 11:12:23 [auto1.de] INFO: Saving data for DU13968: {'auction_closing_time': 1774629544.0, 'created_time': 1774034744.068483, 'last_price_update_time': 1774609943.551151}
2026-03-27 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU13968') HTTP/1.1" 204 0
2026-03-27 11:12:23 [auto1.de] INFO: Found listing with ID: EH00258
2026-03-27 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH00258%27 HTTP/1.1" 200 None
2026-03-27 11:12:23 [auto1.de] INFO: Scrape type for EH00258: 2
2026-03-27 11:12:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f94685e6-1c20-5569-b249-6caa68015c87 with identifier: EH00258
2026-03-27 11:12:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f94685e6-1c20-5569-b249-6caa68015c87 with scrape type 2
2026-03-27 11:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f94685e6-1c20-5569-b249-6caa68015c87 with scrape type 2
2026-03-27 11:12:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f94685e6-1c20-5569-b249-6caa68015c87, identifier: EH00258
2026-03-27 11:12:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f94685e6-1c20-5569-b249-6caa68015c87 with identifier: EH00258
2026-03-27 11:12:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f94685e6-1c20-5569-b249-6caa68015c87 with identifier: EH00258
2026-03-27 11:12:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f94685e6-1c20-5569-b249-6caa68015c87 with identifier: EH00258 to the API
2026-03-27 11:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:45:50Z',
 'fuel_type': 'diesel',
 'id': 'f94685e6-1c20-5569-b249-6caa68015c87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH00258',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 222528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-29',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2012}
2026-03-27 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH00258%27 HTTP/1.1" 200 None
2026-03-27 11:12:23 [auto1.de] INFO: Saving data for EH00258: {'auction_closing_time': 1774629950.0, 'created_time': 1774521605.730745, 'last_price_update_time': 1774609943.993592}
2026-03-27 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH00258') HTTP/1.1" 204 0
2026-03-27 11:12:24 [auto1.de] INFO: Found listing with ID: JK83099
2026-03-27 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK83099%27 HTTP/1.1" 200 None
2026-03-27 11:12:24 [auto1.de] INFO: Scrape type for JK83099: 2
2026-03-27 11:12:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5199a26-7796-52c4-afc5-74a32e41560b with identifier: JK83099
2026-03-27 11:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5199a26-7796-52c4-afc5-74a32e41560b with scrape type 2
2026-03-27 11:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5199a26-7796-52c4-afc5-74a32e41560b with scrape type 2
2026-03-27 11:12:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5199a26-7796-52c4-afc5-74a32e41560b, identifier: JK83099
2026-03-27 11:12:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5199a26-7796-52c4-afc5-74a32e41560b with identifier: JK83099
2026-03-27 11:12:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5199a26-7796-52c4-afc5-74a32e41560b with identifier: JK83099
2026-03-27 11:12:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5199a26-7796-52c4-afc5-74a32e41560b with identifier: JK83099 to the API
2026-03-27 11:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-27T16:53:25Z',
 'fuel_type': 'petrol',
 'id': 'b5199a26-7796-52c4-afc5-74a32e41560b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK83099',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 22522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-05',
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Vision',
 'transmission': 'automatic',
 'trim': 'Vision',
 'year': 2023}
2026-03-27 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK83099%27 HTTP/1.1" 200 None
2026-03-27 11:12:24 [auto1.de] INFO: Saving data for JK83099: {'auction_closing_time': 1774630405.0, 'created_time': 1774521492.189816, 'last_price_update_time': 1774609944.496269}
2026-03-27 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK83099') HTTP/1.1" 204 0
2026-03-27 11:12:24 [auto1.de] INFO: Found listing with ID: YZ04063
2026-03-27 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ04063%27 HTTP/1.1" 200 None
2026-03-27 11:12:24 [auto1.de] INFO: Scrape type for YZ04063: 2
2026-03-27 11:12:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aa88795-6713-551b-b717-cb02060df12c with identifier: YZ04063
2026-03-27 11:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aa88795-6713-551b-b717-cb02060df12c with scrape type 2
2026-03-27 11:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0aa88795-6713-551b-b717-cb02060df12c with scrape type 2
2026-03-27 11:12:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0aa88795-6713-551b-b717-cb02060df12c, identifier: YZ04063
2026-03-27 11:12:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0aa88795-6713-551b-b717-cb02060df12c with identifier: YZ04063
2026-03-27 11:12:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0aa88795-6713-551b-b717-cb02060df12c with identifier: YZ04063
2026-03-27 11:12:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0aa88795-6713-551b-b717-cb02060df12c with identifier: YZ04063 to the API
2026-03-27 11:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-27T16:20:45Z',
 'fuel_type': 'petrol',
 'id': '0aa88795-6713-551b-b717-cb02060df12c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ04063',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 17639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-05',
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Vision',
 'transmission': 'automatic',
 'trim': 'Vision',
 'year': 2023}
2026-03-27 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ04063%27 HTTP/1.1" 200 None
2026-03-27 11:12:24 [auto1.de] INFO: Saving data for YZ04063: {'auction_closing_time': 1774628445.0, 'created_time': 1773381924.788078, 'last_price_update_time': 1774609944.973344}
2026-03-27 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ04063') HTTP/1.1" 204 0
2026-03-27 11:12:24 [auto1.de] INFO: Found listing with ID: XP60907
2026-03-27 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP60907%27 HTTP/1.1" 200 None
2026-03-27 11:12:25 [auto1.de] INFO: Scrape type for XP60907: 2
2026-03-27 11:12:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e756d3c3-533c-5c66-b84b-3bc96378295e with identifier: XP60907
2026-03-27 11:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e756d3c3-533c-5c66-b84b-3bc96378295e with scrape type 2
2026-03-27 11:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e756d3c3-533c-5c66-b84b-3bc96378295e with scrape type 2
2026-03-27 11:12:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e756d3c3-533c-5c66-b84b-3bc96378295e, identifier: XP60907
2026-03-27 11:12:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e756d3c3-533c-5c66-b84b-3bc96378295e with identifier: XP60907
2026-03-27 11:12:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e756d3c3-533c-5c66-b84b-3bc96378295e with identifier: XP60907
2026-03-27 11:12:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e756d3c3-533c-5c66-b84b-3bc96378295e with identifier: XP60907 to the API
2026-03-27 11:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-27T16:52:43Z',
 'fuel_type': 'petrol',
 'id': 'e756d3c3-533c-5c66-b84b-3bc96378295e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP60907',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 4828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-05',
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Vision',
 'transmission': 'automatic',
 'trim': 'Vision',
 'year': 2023}
2026-03-27 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP60907%27 HTTP/1.1" 200 None
2026-03-27 11:12:25 [auto1.de] INFO: Saving data for XP60907: {'auction_closing_time': 1774630363.0, 'created_time': 1774034721.017186, 'last_price_update_time': 1774609945.653323}
2026-03-27 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP60907') HTTP/1.1" 204 0
2026-03-27 11:12:25 [auto1.de] INFO: Found listing with ID: CX48191
2026-03-27 11:12:25 [auto1.de] INFO: Found listing with ID: CR22972
2026-03-27 11:12:25 [auto1.de] INFO: Found listing with ID: DM52516
2026-03-27 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM52516%27 HTTP/1.1" 200 None
2026-03-27 11:12:26 [auto1.de] INFO: Scrape type for DM52516: 2
2026-03-27 11:12:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbf1ed71-e341-5fa6-a05a-75a7bf08bdd7 with identifier: DM52516
2026-03-27 11:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbf1ed71-e341-5fa6-a05a-75a7bf08bdd7 with scrape type 2
2026-03-27 11:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbf1ed71-e341-5fa6-a05a-75a7bf08bdd7 with scrape type 2
2026-03-27 11:12:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbf1ed71-e341-5fa6-a05a-75a7bf08bdd7, identifier: DM52516
2026-03-27 11:12:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbf1ed71-e341-5fa6-a05a-75a7bf08bdd7 with identifier: DM52516
2026-03-27 11:12:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbf1ed71-e341-5fa6-a05a-75a7bf08bdd7 with identifier: DM52516
2026-03-27 11:12:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbf1ed71-e341-5fa6-a05a-75a7bf08bdd7 with identifier: DM52516 to the API
2026-03-27 11:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-27T16:24:17Z',
 'fuel_type': 'petrol',
 'id': 'bbf1ed71-e341-5fa6-a05a-75a7bf08bdd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM52516',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 33757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seller_name': None,
 'title': "Kia cee'd 1.5 TGDI Vision",
 'transmission': 'automatic',
 'trim': 'Vision',
 'year': 2022}
2026-03-27 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM52516%27 HTTP/1.1" 200 None
2026-03-27 11:12:26 [auto1.de] INFO: Saving data for DM52516: {'auction_closing_time': 1774628657.0, 'created_time': 1774034711.510459, 'last_price_update_time': 1774609946.516463}
2026-03-27 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM52516') HTTP/1.1" 204 0
2026-03-27 11:12:26 [auto1.de] INFO: Found listing with ID: AU45488
2026-03-27 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU45488%27 HTTP/1.1" 200 None
2026-03-27 11:12:26 [auto1.de] INFO: Scrape type for AU45488: 2
2026-03-27 11:12:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 355fd167-c2ec-5164-afa5-43979cb293f1 with identifier: AU45488
2026-03-27 11:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 355fd167-c2ec-5164-afa5-43979cb293f1 with scrape type 2
2026-03-27 11:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 355fd167-c2ec-5164-afa5-43979cb293f1 with scrape type 2
2026-03-27 11:12:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 355fd167-c2ec-5164-afa5-43979cb293f1, identifier: AU45488
2026-03-27 11:12:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 355fd167-c2ec-5164-afa5-43979cb293f1 with identifier: AU45488
2026-03-27 11:12:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 355fd167-c2ec-5164-afa5-43979cb293f1 with identifier: AU45488
2026-03-27 11:12:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 355fd167-c2ec-5164-afa5-43979cb293f1 with identifier: AU45488 to the API
2026-03-27 11:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 241,
 'expiration_date': '2026-03-27T16:20:09Z',
 'fuel_type': 'hybrid',
 'id': '355fd167-c2ec-5164-afa5-43979cb293f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU45488',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 34831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-15',
 'seller_name': None,
 'title': 'Jeep Renegade 1.3 T4 4xe Plug-in Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2021}
2026-03-27 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU45488%27 HTTP/1.1" 200 None
2026-03-27 11:12:27 [auto1.de] INFO: Saving data for AU45488: {'auction_closing_time': 1774628409.0, 'created_time': 1774034788.813637, 'last_price_update_time': 1774609947.115193}
2026-03-27 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU45488') HTTP/1.1" 204 0
2026-03-27 11:12:27 [auto1.de] INFO: Found listing with ID: KE25474
2026-03-27 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE25474%27 HTTP/1.1" 200 None
2026-03-27 11:12:27 [auto1.de] INFO: Scrape type for KE25474: 2
2026-03-27 11:12:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 033695e2-3c91-542d-b8b5-2af414a92c44 with identifier: KE25474
2026-03-27 11:12:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 033695e2-3c91-542d-b8b5-2af414a92c44 with scrape type 2
2026-03-27 11:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 033695e2-3c91-542d-b8b5-2af414a92c44 with scrape type 2
2026-03-27 11:12:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 033695e2-3c91-542d-b8b5-2af414a92c44, identifier: KE25474
2026-03-27 11:12:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 033695e2-3c91-542d-b8b5-2af414a92c44 with identifier: KE25474
2026-03-27 11:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 033695e2-3c91-542d-b8b5-2af414a92c44 with identifier: KE25474
2026-03-27 11:12:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 033695e2-3c91-542d-b8b5-2af414a92c44 with identifier: KE25474 to the API
2026-03-27 11:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 241,
 'expiration_date': '2026-03-27T16:35:28Z',
 'fuel_type': 'hybrid',
 'id': '033695e2-3c91-542d-b8b5-2af414a92c44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE25474',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 37234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-06',
 'seller_name': None,
 'title': 'Jeep Compass 1.3 T4 4xe Plug-in Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2021}
2026-03-27 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE25474%27 HTTP/1.1" 200 None
2026-03-27 11:12:27 [auto1.de] INFO: Saving data for KE25474: {'auction_closing_time': 1774629328.0, 'created_time': 1774034776.341906, 'last_price_update_time': 1774609947.73288}
2026-03-27 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE25474') HTTP/1.1" 204 0
2026-03-27 11:12:27 [auto1.de] INFO: Found listing with ID: AM14625
2026-03-27 11:12:27 [auto1.de] INFO: Found listing with ID: JE39664
2026-03-27 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE39664%27 HTTP/1.1" 200 None
2026-03-27 11:12:27 [auto1.de] INFO: Scrape type for JE39664: 2
2026-03-27 11:12:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba174415-56ba-5338-859a-14417868863a with identifier: JE39664
2026-03-27 11:12:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba174415-56ba-5338-859a-14417868863a with scrape type 2
2026-03-27 11:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba174415-56ba-5338-859a-14417868863a with scrape type 2
2026-03-27 11:12:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba174415-56ba-5338-859a-14417868863a, identifier: JE39664
2026-03-27 11:12:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba174415-56ba-5338-859a-14417868863a with identifier: JE39664
2026-03-27 11:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba174415-56ba-5338-859a-14417868863a with identifier: JE39664
2026-03-27 11:12:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba174415-56ba-5338-859a-14417868863a with identifier: JE39664 to the API
2026-03-27 11:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-27T16:37:38Z',
 'fuel_type': 'diesel',
 'id': 'ba174415-56ba-5338-859a-14417868863a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE39664',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Talento',
 'odometer': 29949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-15',
 'seller_name': None,
 'title': 'Fiat Talento 2.0 TwinTurbo Diesel Ecojet L1H1 1,0t',
 'transmission': 'manual',
 'trim': 'L1H1 1,0t',
 'year': 2020}
2026-03-27 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE39664%27 HTTP/1.1" 200 None
2026-03-27 11:12:28 [auto1.de] INFO: Saving data for JE39664: {'auction_closing_time': 1774629458.0, 'created_time': 1774034719.151503, 'last_price_update_time': 1774609948.253619}
2026-03-27 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE39664') HTTP/1.1" 204 0
2026-03-27 11:12:28 [auto1.de] INFO: Found listing with ID: FW52822
2026-03-27 11:12:28 [auto1.de] INFO: Found listing with ID: VP91263
2026-03-27 11:12:28 [auto1.de] INFO: Found listing with ID: RR89865
2026-03-27 11:12:28 [auto1.de] INFO: Found listing with ID: FF90609
2026-03-27 11:12:28 [auto1.de] INFO: Found listing with ID: FM78984
2026-03-27 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78984%27 HTTP/1.1" 200 None
2026-03-27 11:12:28 [auto1.de] INFO: Scrape type for FM78984: 2
2026-03-27 11:12:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e0f6b8f-8693-514f-83ad-6057e8d509fd with identifier: FM78984
2026-03-27 11:12:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e0f6b8f-8693-514f-83ad-6057e8d509fd with scrape type 2
2026-03-27 11:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e0f6b8f-8693-514f-83ad-6057e8d509fd with scrape type 2
2026-03-27 11:12:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e0f6b8f-8693-514f-83ad-6057e8d509fd, identifier: FM78984
2026-03-27 11:12:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e0f6b8f-8693-514f-83ad-6057e8d509fd with identifier: FM78984
2026-03-27 11:12:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e0f6b8f-8693-514f-83ad-6057e8d509fd with identifier: FM78984
2026-03-27 11:12:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e0f6b8f-8693-514f-83ad-6057e8d509fd with identifier: FM78984 to the API
2026-03-27 11:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:31:37Z',
 'fuel_type': 'diesel',
 'id': '5e0f6b8f-8693-514f-83ad-6057e8d509fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM78984',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 180429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-27',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Prestige',
 'transmission': 'automatic',
 'trim': 'Prestige',
 'year': 2018}
2026-03-27 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78984%27 HTTP/1.1" 200 None
2026-03-27 11:12:28 [auto1.de] INFO: Saving data for FM78984: {'auction_closing_time': 1774629097.0, 'created_time': 1774521527.218854, 'last_price_update_time': 1774609948.672213}
2026-03-27 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM78984') HTTP/1.1" 204 0
2026-03-27 11:12:28 [auto1.de] INFO: Found listing with ID: VW58947
2026-03-27 11:12:28 [auto1.de] INFO: Found listing with ID: EN93789
2026-03-27 11:12:28 [auto1.de] INFO: Found listing with ID: CV73879
2026-03-27 11:12:28 [auto1.de] INFO: Found listing with ID: AF78578
2026-03-27 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF78578%27 HTTP/1.1" 200 None
2026-03-27 11:12:28 [auto1.de] INFO: Scrape type for AF78578: 2
2026-03-27 11:12:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00c7b488-7644-53c3-8844-6723d117dadf with identifier: AF78578
2026-03-27 11:12:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00c7b488-7644-53c3-8844-6723d117dadf with scrape type 2
2026-03-27 11:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00c7b488-7644-53c3-8844-6723d117dadf with scrape type 2
2026-03-27 11:12:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00c7b488-7644-53c3-8844-6723d117dadf, identifier: AF78578
2026-03-27 11:12:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00c7b488-7644-53c3-8844-6723d117dadf with identifier: AF78578
2026-03-27 11:12:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00c7b488-7644-53c3-8844-6723d117dadf with identifier: AF78578
2026-03-27 11:12:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00c7b488-7644-53c3-8844-6723d117dadf with identifier: AF78578 to the API
2026-03-27 11:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:13:17Z',
 'fuel_type': 'petrol',
 'id': '00c7b488-7644-53c3-8844-6723d117dadf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF78578',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 134605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1995-01-09',
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'automatic',
 'trim': '',
 'year': 1995}
2026-03-27 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF78578%27 HTTP/1.1" 200 None
2026-03-27 11:12:29 [auto1.de] INFO: Saving data for AF78578: {'auction_closing_time': 1774627997.0, 'created_time': 1774521527.993925, 'last_price_update_time': 1774609949.219467}
2026-03-27 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF78578') HTTP/1.1" 204 0
2026-03-27 11:12:29 [auto1.de] INFO: Found listing with ID: CS78773
2026-03-27 11:12:29 [auto1.de] INFO: Found listing with ID: WG33870
2026-03-27 11:12:29 [auto1.de] INFO: Found listing with ID: YB31045
2026-03-27 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB31045%27 HTTP/1.1" 200 None
2026-03-27 11:12:29 [auto1.de] INFO: Scrape type for YB31045: 2
2026-03-27 11:12:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33b9b009-445f-5846-b199-a56b72b297da with identifier: YB31045
2026-03-27 11:12:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33b9b009-445f-5846-b199-a56b72b297da with scrape type 2
2026-03-27 11:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33b9b009-445f-5846-b199-a56b72b297da with scrape type 2
2026-03-27 11:12:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33b9b009-445f-5846-b199-a56b72b297da, identifier: YB31045
2026-03-27 11:12:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33b9b009-445f-5846-b199-a56b72b297da with identifier: YB31045
2026-03-27 11:12:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33b9b009-445f-5846-b199-a56b72b297da with identifier: YB31045
2026-03-27 11:12:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33b9b009-445f-5846-b199-a56b72b297da with identifier: YB31045 to the API
2026-03-27 11:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-27T16:24:54Z',
 'fuel_type': 'petrol',
 'id': '33b9b009-445f-5846-b199-a56b72b297da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB31045',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 207834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-28',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2018}
2026-03-27 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB31045%27 HTTP/1.1" 200 None
2026-03-27 11:12:29 [auto1.de] INFO: Saving data for YB31045: {'auction_closing_time': 1774628694.0, 'created_time': 1772546711.323475, 'last_price_update_time': 1774609949.740136}
2026-03-27 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB31045') HTTP/1.1" 204 0
2026-03-27 11:12:29 [auto1.de] INFO: Found listing with ID: AG96871
2026-03-27 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG96871%27 HTTP/1.1" 200 None
2026-03-27 11:12:29 [auto1.de] INFO: Scrape type for AG96871: 2
2026-03-27 11:12:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a534fc4a-21fa-50ba-8a81-b6d195c9038e with identifier: AG96871
2026-03-27 11:12:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a534fc4a-21fa-50ba-8a81-b6d195c9038e with scrape type 2
2026-03-27 11:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a534fc4a-21fa-50ba-8a81-b6d195c9038e with scrape type 2
2026-03-27 11:12:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a534fc4a-21fa-50ba-8a81-b6d195c9038e, identifier: AG96871
2026-03-27 11:12:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a534fc4a-21fa-50ba-8a81-b6d195c9038e with identifier: AG96871
2026-03-27 11:12:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a534fc4a-21fa-50ba-8a81-b6d195c9038e with identifier: AG96871
2026-03-27 11:12:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a534fc4a-21fa-50ba-8a81-b6d195c9038e with identifier: AG96871 to the API
2026-03-27 11:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-27T16:47:23Z',
 'fuel_type': 'electro',
 'id': 'a534fc4a-21fa-50ba-8a81-b6d195c9038e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG96871',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ulysse',
 'odometer': 24505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-28',
 'seller_name': None,
 'title': 'Fiat Ulysse electric drive 100 kW L2',
 'transmission': 'automatic',
 'trim': 'L2',
 'year': 2022}
2026-03-27 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG96871%27 HTTP/1.1" 200 None
2026-03-27 11:12:30 [auto1.de] INFO: Saving data for AG96871: {'auction_closing_time': 1774630043.0, 'created_time': 1773387503.191656, 'last_price_update_time': 1774609950.224058}
2026-03-27 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG96871') HTTP/1.1" 204 0
2026-03-27 11:12:30 [auto1.de] INFO: Found listing with ID: MB42489
2026-03-27 11:12:30 [auto1.de] INFO: Found listing with ID: DA23811
2026-03-27 11:12:30 [auto1.de] INFO: Found listing with ID: XC82221
2026-03-27 11:12:30 [auto1.de] INFO: Found listing with ID: MX81863
2026-03-27 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX81863%27 HTTP/1.1" 200 None
2026-03-27 11:12:30 [auto1.de] INFO: Scrape type for MX81863: 2
2026-03-27 11:12:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adb78a47-4bf8-5658-9afb-025130850c60 with identifier: MX81863
2026-03-27 11:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adb78a47-4bf8-5658-9afb-025130850c60 with scrape type 2
2026-03-27 11:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adb78a47-4bf8-5658-9afb-025130850c60 with scrape type 2
2026-03-27 11:12:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: adb78a47-4bf8-5658-9afb-025130850c60, identifier: MX81863
2026-03-27 11:12:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: adb78a47-4bf8-5658-9afb-025130850c60 with identifier: MX81863
2026-03-27 11:12:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: adb78a47-4bf8-5658-9afb-025130850c60 with identifier: MX81863
2026-03-27 11:12:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: adb78a47-4bf8-5658-9afb-025130850c60 with identifier: MX81863 to the API
2026-03-27 11:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-27T16:48:24Z',
 'fuel_type': 'electro',
 'id': 'adb78a47-4bf8-5658-9afb-025130850c60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX81863',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 8543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-21',
 'seller_name': None,
 'title': 'Fiat Doblo electric drive 100 kW Multicab L2',
 'transmission': 'automatic',
 'trim': 'Multicab L2',
 'year': 2022}
2026-03-27 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX81863%27 HTTP/1.1" 200 None
2026-03-27 11:12:30 [auto1.de] INFO: Saving data for MX81863: {'auction_closing_time': 1774630104.0, 'created_time': 1773776308.849978, 'last_price_update_time': 1774609950.684917}
2026-03-27 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX81863') HTTP/1.1" 204 0
2026-03-27 11:12:30 [auto1.de] INFO: Found listing with ID: DR45006
2026-03-27 11:12:30 [auto1.de] INFO: Found listing with ID: YP97608
2026-03-27 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP97608%27 HTTP/1.1" 200 None
2026-03-27 11:12:30 [auto1.de] INFO: Scrape type for YP97608: 2
2026-03-27 11:12:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad9df17e-ae25-5b94-9aba-c34be2335fc7 with identifier: YP97608
2026-03-27 11:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad9df17e-ae25-5b94-9aba-c34be2335fc7 with scrape type 2
2026-03-27 11:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad9df17e-ae25-5b94-9aba-c34be2335fc7 with scrape type 2
2026-03-27 11:12:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad9df17e-ae25-5b94-9aba-c34be2335fc7, identifier: YP97608
2026-03-27 11:12:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad9df17e-ae25-5b94-9aba-c34be2335fc7 with identifier: YP97608
2026-03-27 11:12:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad9df17e-ae25-5b94-9aba-c34be2335fc7 with identifier: YP97608
2026-03-27 11:12:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad9df17e-ae25-5b94-9aba-c34be2335fc7 with identifier: YP97608 to the API
2026-03-27 11:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-27T16:59:59Z',
 'fuel_type': 'electro',
 'id': 'ad9df17e-ae25-5b94-9aba-c34be2335fc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP97608',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 11920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-21',
 'seller_name': None,
 'title': 'Fiat Doblo electric drive 100 kW Multicab L2',
 'transmission': 'automatic',
 'trim': 'Multicab L2',
 'year': 2022}
2026-03-27 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP97608%27 HTTP/1.1" 200 None
2026-03-27 11:12:31 [auto1.de] INFO: Saving data for YP97608: {'auction_closing_time': 1774630799.0, 'created_time': 1773776291.515918, 'last_price_update_time': 1774609951.459601}
2026-03-27 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP97608') HTTP/1.1" 204 0
2026-03-27 11:12:31 [auto1.de] INFO: Found listing with ID: AJ20282
2026-03-27 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ20282%27 HTTP/1.1" 200 None
2026-03-27 11:12:31 [auto1.de] INFO: Scrape type for AJ20282: 2
2026-03-27 11:12:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc1d80f8-3f11-5bde-b3c0-1946cd3ef792 with identifier: AJ20282
2026-03-27 11:12:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc1d80f8-3f11-5bde-b3c0-1946cd3ef792 with scrape type 2
2026-03-27 11:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc1d80f8-3f11-5bde-b3c0-1946cd3ef792 with scrape type 2
2026-03-27 11:12:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc1d80f8-3f11-5bde-b3c0-1946cd3ef792, identifier: AJ20282
2026-03-27 11:12:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc1d80f8-3f11-5bde-b3c0-1946cd3ef792 with identifier: AJ20282
2026-03-27 11:12:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc1d80f8-3f11-5bde-b3c0-1946cd3ef792 with identifier: AJ20282
2026-03-27 11:12:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc1d80f8-3f11-5bde-b3c0-1946cd3ef792 with identifier: AJ20282 to the API
2026-03-27 11:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-27T16:11:01Z',
 'fuel_type': 'electro',
 'id': 'fc1d80f8-3f11-5bde-b3c0-1946cd3ef792',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ20282',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 5446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-15',
 'seller_name': None,
 'title': 'Fiat Doblo electric drive 100 kW Multicab L2',
 'transmission': 'automatic',
 'trim': 'Multicab L2',
 'year': 2022}
2026-03-27 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ20282%27 HTTP/1.1" 200 None
2026-03-27 11:12:31 [auto1.de] INFO: Saving data for AJ20282: {'auction_closing_time': 1774627861.0, 'created_time': 1773775938.312311, 'last_price_update_time': 1774609951.993087}
2026-03-27 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ20282') HTTP/1.1" 204 0
2026-03-27 11:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:12:38 [auto1.de] INFO: Channel: 24h | Page: 243 | totalHits: 10673 | hits on page: 40
2026-03-27 11:12:38 [auto1.de] INFO: Found listing with ID: AJ20282
2026-03-27 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ20282%27 HTTP/1.1" 200 None
2026-03-27 11:12:38 [auto1.de] INFO: Scrape type for AJ20282: 0
2026-03-27 11:12:38 [auto1.de] INFO: Found listing with ID: HE24986
2026-03-27 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE24986%27 HTTP/1.1" 200 None
2026-03-27 11:12:38 [auto1.de] INFO: Scrape type for HE24986: 2
2026-03-27 11:12:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8616473-2ca4-5408-84f5-615dd402c604 with identifier: HE24986
2026-03-27 11:12:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8616473-2ca4-5408-84f5-615dd402c604 with scrape type 2
2026-03-27 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8616473-2ca4-5408-84f5-615dd402c604 with scrape type 2
2026-03-27 11:12:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8616473-2ca4-5408-84f5-615dd402c604, identifier: HE24986
2026-03-27 11:12:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8616473-2ca4-5408-84f5-615dd402c604 with identifier: HE24986
2026-03-27 11:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8616473-2ca4-5408-84f5-615dd402c604 with identifier: HE24986
2026-03-27 11:12:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8616473-2ca4-5408-84f5-615dd402c604 with identifier: HE24986 to the API
2026-03-27 11:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 118,
 'expiration_date': '2026-03-27T16:58:53Z',
 'fuel_type': 'electro',
 'id': 'e8616473-2ca4-5408-84f5-615dd402c604',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE24986',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500e',
 'odometer': 23811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-07',
 'seller_name': None,
 'title': 'Fiat 500e electric drive 87 kW Red',
 'transmission': 'automatic',
 'trim': 'Red',
 'year': 2022}
2026-03-27 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE24986%27 HTTP/1.1" 200 None
2026-03-27 11:12:38 [auto1.de] INFO: Saving data for HE24986: {'auction_closing_time': 1774630733.0, 'created_time': 1773387339.221878, 'last_price_update_time': 1774609958.999467}
2026-03-27 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE24986') HTTP/1.1" 204 0
2026-03-27 11:12:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:12:39 [auto1.de] INFO: Found listing with ID: PY45280
2026-03-27 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY45280%27 HTTP/1.1" 200 None
2026-03-27 11:12:39 [auto1.de] INFO: Scrape type for PY45280: 2
2026-03-27 11:12:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e3bc108-d0af-5451-9a76-fb281eb2287e with identifier: PY45280
2026-03-27 11:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e3bc108-d0af-5451-9a76-fb281eb2287e with scrape type 2
2026-03-27 11:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e3bc108-d0af-5451-9a76-fb281eb2287e with scrape type 2
2026-03-27 11:12:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e3bc108-d0af-5451-9a76-fb281eb2287e, identifier: PY45280
2026-03-27 11:12:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e3bc108-d0af-5451-9a76-fb281eb2287e with identifier: PY45280
2026-03-27 11:12:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e3bc108-d0af-5451-9a76-fb281eb2287e with identifier: PY45280
2026-03-27 11:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e3bc108-d0af-5451-9a76-fb281eb2287e with identifier: PY45280 to the API
2026-03-27 11:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 118,
 'expiration_date': '2026-03-27T16:50:54Z',
 'fuel_type': 'electro',
 'id': '9e3bc108-d0af-5451-9a76-fb281eb2287e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY45280',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500e',
 'odometer': 45744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-27',
 'seller_name': None,
 'title': 'Fiat 500e electric drive 87 kW 3+1 Icon',
 'transmission': 'automatic',
 'trim': '3+1 Icon',
 'year': 2023}
2026-03-27 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY45280%27 HTTP/1.1" 200 None
2026-03-27 11:12:39 [auto1.de] INFO: Saving data for PY45280: {'auction_closing_time': 1774630254.0, 'created_time': 1773387367.148869, 'last_price_update_time': 1774609959.47948}
2026-03-27 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY45280') HTTP/1.1" 204 0
2026-03-27 11:12:39 [auto1.de] INFO: Found listing with ID: RR35143
2026-03-27 11:12:39 [auto1.de] INFO: Found listing with ID: PG96928
2026-03-27 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG96928%27 HTTP/1.1" 200 None
2026-03-27 11:12:39 [auto1.de] INFO: Scrape type for PG96928: 2
2026-03-27 11:12:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f64dda5-ea8a-5125-8944-3880e5cc1d0d with identifier: PG96928
2026-03-27 11:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f64dda5-ea8a-5125-8944-3880e5cc1d0d with scrape type 2
2026-03-27 11:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f64dda5-ea8a-5125-8944-3880e5cc1d0d with scrape type 2
2026-03-27 11:12:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f64dda5-ea8a-5125-8944-3880e5cc1d0d, identifier: PG96928
2026-03-27 11:12:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f64dda5-ea8a-5125-8944-3880e5cc1d0d with identifier: PG96928
2026-03-27 11:12:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f64dda5-ea8a-5125-8944-3880e5cc1d0d with identifier: PG96928
2026-03-27 11:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f64dda5-ea8a-5125-8944-3880e5cc1d0d with identifier: PG96928 to the API
2026-03-27 11:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-27T16:07:58Z',
 'fuel_type': 'electro',
 'id': '7f64dda5-ea8a-5125-8944-3880e5cc1d0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG96928',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500e',
 'odometer': 42336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-18',
 'seller_name': None,
 'title': 'Fiat 500e electric drive 70 kW Action',
 'transmission': 'automatic',
 'trim': 'Action',
 'year': 2021}
2026-03-27 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG96928%27 HTTP/1.1" 200 None
2026-03-27 11:12:39 [auto1.de] INFO: Saving data for PG96928: {'auction_closing_time': 1774627678.0, 'created_time': 1773387352.028157, 'last_price_update_time': 1774609959.938006}
2026-03-27 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG96928') HTTP/1.1" 204 0
2026-03-27 11:12:39 [auto1.de] INFO: Found listing with ID: WW58737
2026-03-27 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW58737%27 HTTP/1.1" 200 None
2026-03-27 11:12:39 [auto1.de] INFO: Scrape type for WW58737: 2
2026-03-27 11:12:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13b72aaf-ddd4-57fa-9a4d-926d051981db with identifier: WW58737
2026-03-27 11:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13b72aaf-ddd4-57fa-9a4d-926d051981db with scrape type 2
2026-03-27 11:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13b72aaf-ddd4-57fa-9a4d-926d051981db with scrape type 2
2026-03-27 11:12:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13b72aaf-ddd4-57fa-9a4d-926d051981db, identifier: WW58737
2026-03-27 11:12:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13b72aaf-ddd4-57fa-9a4d-926d051981db with identifier: WW58737
2026-03-27 11:12:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13b72aaf-ddd4-57fa-9a4d-926d051981db with identifier: WW58737
2026-03-27 11:12:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13b72aaf-ddd4-57fa-9a4d-926d051981db with identifier: WW58737 to the API
2026-03-27 11:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-27T16:21:02Z',
 'fuel_type': 'electro',
 'id': '13b72aaf-ddd4-57fa-9a4d-926d051981db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW58737',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500e',
 'odometer': 60307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-07',
 'seller_name': None,
 'title': 'Fiat 500e electric drive 70 kW Action',
 'transmission': 'automatic',
 'trim': 'Action',
 'year': 2021}
2026-03-27 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW58737%27 HTTP/1.1" 200 None
2026-03-27 11:12:40 [auto1.de] INFO: Saving data for WW58737: {'auction_closing_time': 1774628462.0, 'created_time': 1773387358.468157, 'last_price_update_time': 1774609960.389743}
2026-03-27 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW58737') HTTP/1.1" 204 0
2026-03-27 11:12:40 [auto1.de] INFO: Found listing with ID: CV49808
2026-03-27 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV49808%27 HTTP/1.1" 200 None
2026-03-27 11:12:40 [auto1.de] INFO: Scrape type for CV49808: 2
2026-03-27 11:12:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 508a83b5-ddb3-59d5-b6ad-8ede1a1cc41d with identifier: CV49808
2026-03-27 11:12:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 508a83b5-ddb3-59d5-b6ad-8ede1a1cc41d with scrape type 2
2026-03-27 11:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 508a83b5-ddb3-59d5-b6ad-8ede1a1cc41d with scrape type 2
2026-03-27 11:12:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 508a83b5-ddb3-59d5-b6ad-8ede1a1cc41d, identifier: CV49808
2026-03-27 11:12:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 508a83b5-ddb3-59d5-b6ad-8ede1a1cc41d with identifier: CV49808
2026-03-27 11:12:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 508a83b5-ddb3-59d5-b6ad-8ede1a1cc41d with identifier: CV49808
2026-03-27 11:12:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 508a83b5-ddb3-59d5-b6ad-8ede1a1cc41d with identifier: CV49808 to the API
2026-03-27 11:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-27T16:19:58Z',
 'fuel_type': 'electro',
 'id': '508a83b5-ddb3-59d5-b6ad-8ede1a1cc41d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV49808',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500e',
 'odometer': 19377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-20',
 'seller_name': None,
 'title': 'Fiat 500e electric drive 70 kW Action',
 'transmission': 'automatic',
 'trim': 'Action',
 'year': 2022}
2026-03-27 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV49808%27 HTTP/1.1" 200 None
2026-03-27 11:12:40 [auto1.de] INFO: Saving data for CV49808: {'auction_closing_time': 1774628398.0, 'created_time': 1773387360.436505, 'last_price_update_time': 1774609960.813964}
2026-03-27 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV49808') HTTP/1.1" 204 0
2026-03-27 11:12:40 [auto1.de] INFO: Found listing with ID: SK46257
2026-03-27 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK46257%27 HTTP/1.1" 200 None
2026-03-27 11:12:40 [auto1.de] INFO: Scrape type for SK46257: 2
2026-03-27 11:12:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dbd23dc-8e1b-5905-873b-990d2c345450 with identifier: SK46257
2026-03-27 11:12:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dbd23dc-8e1b-5905-873b-990d2c345450 with scrape type 2
2026-03-27 11:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dbd23dc-8e1b-5905-873b-990d2c345450 with scrape type 2
2026-03-27 11:12:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6dbd23dc-8e1b-5905-873b-990d2c345450, identifier: SK46257
2026-03-27 11:12:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6dbd23dc-8e1b-5905-873b-990d2c345450 with identifier: SK46257
2026-03-27 11:12:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6dbd23dc-8e1b-5905-873b-990d2c345450 with identifier: SK46257
2026-03-27 11:12:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6dbd23dc-8e1b-5905-873b-990d2c345450 with identifier: SK46257 to the API
2026-03-27 11:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-27T16:11:50Z',
 'fuel_type': 'electro',
 'id': '6dbd23dc-8e1b-5905-873b-990d2c345450',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK46257',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 3994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-15',
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2023}
2026-03-27 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK46257%27 HTTP/1.1" 200 None
2026-03-27 11:12:41 [auto1.de] INFO: Saving data for SK46257: {'auction_closing_time': 1774627910.0, 'created_time': 1773387361.250638, 'last_price_update_time': 1774609961.299214}
2026-03-27 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK46257') HTTP/1.1" 204 0
2026-03-27 11:12:41 [auto1.de] INFO: Found listing with ID: TV39764
2026-03-27 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV39764%27 HTTP/1.1" 200 None
2026-03-27 11:12:41 [auto1.de] INFO: Scrape type for TV39764: 2
2026-03-27 11:12:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90bbecaa-c0d1-54c2-be68-f0192c7280f0 with identifier: TV39764
2026-03-27 11:12:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90bbecaa-c0d1-54c2-be68-f0192c7280f0 with scrape type 2
2026-03-27 11:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90bbecaa-c0d1-54c2-be68-f0192c7280f0 with scrape type 2
2026-03-27 11:12:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90bbecaa-c0d1-54c2-be68-f0192c7280f0, identifier: TV39764
2026-03-27 11:12:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90bbecaa-c0d1-54c2-be68-f0192c7280f0 with identifier: TV39764
2026-03-27 11:12:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90bbecaa-c0d1-54c2-be68-f0192c7280f0 with identifier: TV39764
2026-03-27 11:12:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90bbecaa-c0d1-54c2-be68-f0192c7280f0 with identifier: TV39764 to the API
2026-03-27 11:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-27T16:25:54Z',
 'fuel_type': 'petrol',
 'id': '90bbecaa-c0d1-54c2-be68-f0192c7280f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV39764',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Tonale',
 'odometer': 25292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-27',
 'seller_name': None,
 'title': 'Alfa Romeo Tonale 1.5 VGT Veloce',
 'transmission': 'automatic',
 'trim': 'Veloce',
 'year': 2022}
2026-03-27 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV39764%27 HTTP/1.1" 200 None
2026-03-27 11:12:41 [auto1.de] INFO: Saving data for TV39764: {'auction_closing_time': 1774628754.0, 'created_time': 1774034716.073606, 'last_price_update_time': 1774609961.87553}
2026-03-27 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV39764') HTTP/1.1" 204 0
2026-03-27 11:12:41 [auto1.de] INFO: Found listing with ID: JM21145
2026-03-27 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM21145%27 HTTP/1.1" 200 None
2026-03-27 11:12:41 [auto1.de] INFO: Scrape type for JM21145: 2
2026-03-27 11:12:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 975e6ac5-250d-5bb6-8ecf-3308799273a7 with identifier: JM21145
2026-03-27 11:12:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 975e6ac5-250d-5bb6-8ecf-3308799273a7 with scrape type 2
2026-03-27 11:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 975e6ac5-250d-5bb6-8ecf-3308799273a7 with scrape type 2
2026-03-27 11:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 975e6ac5-250d-5bb6-8ecf-3308799273a7, identifier: JM21145
2026-03-27 11:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 975e6ac5-250d-5bb6-8ecf-3308799273a7 with identifier: JM21145
2026-03-27 11:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 975e6ac5-250d-5bb6-8ecf-3308799273a7 with identifier: JM21145
2026-03-27 11:12:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 975e6ac5-250d-5bb6-8ecf-3308799273a7 with identifier: JM21145 to the API
2026-03-27 11:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-27T16:32:10Z',
 'fuel_type': 'electro',
 'id': '975e6ac5-250d-5bb6-8ecf-3308799273a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM21145',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 9,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-12-18',
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-27 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM21145%27 HTTP/1.1" 200 None
2026-03-27 11:12:42 [auto1.de] INFO: Saving data for JM21145: {'auction_closing_time': 1774629130.0, 'created_time': 1774521686.294098, 'last_price_update_time': 1774609962.345483}
2026-03-27 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM21145') HTTP/1.1" 204 0
2026-03-27 11:12:42 [auto1.de] INFO: Found listing with ID: GM57900
2026-03-27 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM57900%27 HTTP/1.1" 200 None
2026-03-27 11:12:42 [auto1.de] INFO: Scrape type for GM57900: 2
2026-03-27 11:12:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb64e9fd-98fe-5cbb-829e-bc19b69e9594 with identifier: GM57900
2026-03-27 11:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb64e9fd-98fe-5cbb-829e-bc19b69e9594 with scrape type 2
2026-03-27 11:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb64e9fd-98fe-5cbb-829e-bc19b69e9594 with scrape type 2
2026-03-27 11:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb64e9fd-98fe-5cbb-829e-bc19b69e9594, identifier: GM57900
2026-03-27 11:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb64e9fd-98fe-5cbb-829e-bc19b69e9594 with identifier: GM57900
2026-03-27 11:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb64e9fd-98fe-5cbb-829e-bc19b69e9594 with identifier: GM57900
2026-03-27 11:12:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb64e9fd-98fe-5cbb-829e-bc19b69e9594 with identifier: GM57900 to the API
2026-03-27 11:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-27T16:26:11Z',
 'fuel_type': 'petrol',
 'id': 'eb64e9fd-98fe-5cbb-829e-bc19b69e9594',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM57900',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595',
 'odometer': 17170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-25',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Turbo',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-27 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM57900%27 HTTP/1.1" 200 None
2026-03-27 11:12:42 [auto1.de] INFO: Saving data for GM57900: {'auction_closing_time': 1774628771.0, 'created_time': 1774521594.270659, 'last_price_update_time': 1774609962.775015}
2026-03-27 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM57900') HTTP/1.1" 204 0
2026-03-27 11:12:42 [auto1.de] INFO: Found listing with ID: MA76308
2026-03-27 11:12:42 [auto1.de] INFO: Found listing with ID: LH60880
2026-03-27 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH60880%27 HTTP/1.1" 200 None
2026-03-27 11:12:42 [auto1.de] INFO: Scrape type for LH60880: 2
2026-03-27 11:12:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9010bfc7-3b00-5b7d-9e5b-41ab2f2c9a30 with identifier: LH60880
2026-03-27 11:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9010bfc7-3b00-5b7d-9e5b-41ab2f2c9a30 with scrape type 2
2026-03-27 11:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9010bfc7-3b00-5b7d-9e5b-41ab2f2c9a30 with scrape type 2
2026-03-27 11:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9010bfc7-3b00-5b7d-9e5b-41ab2f2c9a30, identifier: LH60880
2026-03-27 11:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9010bfc7-3b00-5b7d-9e5b-41ab2f2c9a30 with identifier: LH60880
2026-03-27 11:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9010bfc7-3b00-5b7d-9e5b-41ab2f2c9a30 with identifier: LH60880
2026-03-27 11:12:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9010bfc7-3b00-5b7d-9e5b-41ab2f2c9a30 with identifier: LH60880 to the API
2026-03-27 11:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:44:02Z',
 'fuel_type': 'diesel',
 'id': '9010bfc7-3b00-5b7d-9e5b-41ab2f2c9a30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH60880',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 160531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2011}
2026-03-27 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH60880%27 HTTP/1.1" 200 None
2026-03-27 11:12:43 [auto1.de] INFO: Saving data for LH60880: {'auction_closing_time': 1774629842.0, 'created_time': 1774521593.570827, 'last_price_update_time': 1774609963.216441}
2026-03-27 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LH60880') HTTP/1.1" 204 0
2026-03-27 11:12:43 [auto1.de] INFO: Found listing with ID: SY27864
2026-03-27 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY27864%27 HTTP/1.1" 200 None
2026-03-27 11:12:43 [auto1.de] INFO: Scrape type for SY27864: 2
2026-03-27 11:12:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c914d27-8d8c-5463-aeb3-8297e021caf3 with identifier: SY27864
2026-03-27 11:12:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c914d27-8d8c-5463-aeb3-8297e021caf3 with scrape type 2
2026-03-27 11:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c914d27-8d8c-5463-aeb3-8297e021caf3 with scrape type 2
2026-03-27 11:12:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c914d27-8d8c-5463-aeb3-8297e021caf3, identifier: SY27864
2026-03-27 11:12:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c914d27-8d8c-5463-aeb3-8297e021caf3 with identifier: SY27864
2026-03-27 11:12:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c914d27-8d8c-5463-aeb3-8297e021caf3 with identifier: SY27864
2026-03-27 11:12:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c914d27-8d8c-5463-aeb3-8297e021caf3 with identifier: SY27864 to the API
2026-03-27 11:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-27T16:10:42Z',
 'fuel_type': 'petrol',
 'id': '6c914d27-8d8c-5463-aeb3-8297e021caf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY27864',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 93531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-06',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Trendline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Trendline BlueMotion',
 'year': 2018}
2026-03-27 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY27864%27 HTTP/1.1" 200 None
2026-03-27 11:12:43 [auto1.de] INFO: Saving data for SY27864: {'auction_closing_time': 1774627842.0, 'created_time': 1774521727.177535, 'last_price_update_time': 1774609963.63501}
2026-03-27 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY27864') HTTP/1.1" 204 0
2026-03-27 11:12:43 [auto1.de] INFO: Found listing with ID: JY20186
2026-03-27 11:12:43 [auto1.de] INFO: Found listing with ID: JN55022
2026-03-27 11:12:43 [auto1.de] INFO: Found listing with ID: CF53394
2026-03-27 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF53394%27 HTTP/1.1" 200 None
2026-03-27 11:12:43 [auto1.de] INFO: Scrape type for CF53394: 2
2026-03-27 11:12:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63c9e92d-56fb-5e73-b357-ae329b705d99 with identifier: CF53394
2026-03-27 11:12:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63c9e92d-56fb-5e73-b357-ae329b705d99 with scrape type 2
2026-03-27 11:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63c9e92d-56fb-5e73-b357-ae329b705d99 with scrape type 2
2026-03-27 11:12:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63c9e92d-56fb-5e73-b357-ae329b705d99, identifier: CF53394
2026-03-27 11:12:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63c9e92d-56fb-5e73-b357-ae329b705d99 with identifier: CF53394
2026-03-27 11:12:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63c9e92d-56fb-5e73-b357-ae329b705d99 with identifier: CF53394
2026-03-27 11:12:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63c9e92d-56fb-5e73-b357-ae329b705d99 with identifier: CF53394 to the API
2026-03-27 11:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-27T16:00:59Z',
 'fuel_type': 'petrol',
 'id': '63c9e92d-56fb-5e73-b357-ae329b705d99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF53394',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 115619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-16',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-27 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF53394%27 HTTP/1.1" 200 None
2026-03-27 11:12:44 [auto1.de] INFO: Saving data for CF53394: {'auction_closing_time': 1774627259.0, 'created_time': 1774521597.440524, 'last_price_update_time': 1774609964.069449}
2026-03-27 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF53394') HTTP/1.1" 204 0
2026-03-27 11:12:44 [auto1.de] INFO: Found listing with ID: PC32478
2026-03-27 11:12:44 [auto1.de] INFO: Found listing with ID: MJ46117
2026-03-27 11:12:44 [auto1.de] INFO: Found listing with ID: SF89930
2026-03-27 11:12:44 [auto1.de] INFO: Found listing with ID: CW72943
2026-03-27 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW72943%27 HTTP/1.1" 200 None
2026-03-27 11:12:44 [auto1.de] INFO: Scrape type for CW72943: 2
2026-03-27 11:12:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e07916f-c93b-531c-bdf4-70781d17b4de with identifier: CW72943
2026-03-27 11:12:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e07916f-c93b-531c-bdf4-70781d17b4de with scrape type 2
2026-03-27 11:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e07916f-c93b-531c-bdf4-70781d17b4de with scrape type 2
2026-03-27 11:12:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e07916f-c93b-531c-bdf4-70781d17b4de, identifier: CW72943
2026-03-27 11:12:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e07916f-c93b-531c-bdf4-70781d17b4de with identifier: CW72943
2026-03-27 11:12:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e07916f-c93b-531c-bdf4-70781d17b4de with identifier: CW72943
2026-03-27 11:12:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e07916f-c93b-531c-bdf4-70781d17b4de with identifier: CW72943 to the API
2026-03-27 11:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:42:45Z',
 'fuel_type': 'petrol',
 'id': '1e07916f-c93b-531c-bdf4-70781d17b4de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW72943',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 151047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-24',
 'seller_name': None,
 'title': 'Fiat 500C 1.2 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2012}
2026-03-27 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW72943%27 HTTP/1.1" 200 None
2026-03-27 11:12:44 [auto1.de] INFO: Saving data for CW72943: {'auction_closing_time': 1774629765.0, 'created_time': 1774521595.197411, 'last_price_update_time': 1774609964.553699}
2026-03-27 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW72943') HTTP/1.1" 204 0
2026-03-27 11:12:44 [auto1.de] INFO: Found listing with ID: XU28434
2026-03-27 11:12:44 [auto1.de] INFO: Found listing with ID: ZA74026
2026-03-27 11:12:44 [auto1.de] INFO: Found listing with ID: ZJ06184
2026-03-27 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ06184%27 HTTP/1.1" 200 None
2026-03-27 11:12:44 [auto1.de] INFO: Scrape type for ZJ06184: 2
2026-03-27 11:12:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a41e0dfb-aba5-5720-8e88-ddac7d34d0f2 with identifier: ZJ06184
2026-03-27 11:12:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a41e0dfb-aba5-5720-8e88-ddac7d34d0f2 with scrape type 2
2026-03-27 11:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a41e0dfb-aba5-5720-8e88-ddac7d34d0f2 with scrape type 2
2026-03-27 11:12:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a41e0dfb-aba5-5720-8e88-ddac7d34d0f2, identifier: ZJ06184
2026-03-27 11:12:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a41e0dfb-aba5-5720-8e88-ddac7d34d0f2 with identifier: ZJ06184
2026-03-27 11:12:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a41e0dfb-aba5-5720-8e88-ddac7d34d0f2 with identifier: ZJ06184
2026-03-27 11:12:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a41e0dfb-aba5-5720-8e88-ddac7d34d0f2 with identifier: ZJ06184 to the API
2026-03-27 11:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:05:56Z',
 'fuel_type': 'petrol',
 'id': 'a41e0dfb-aba5-5720-8e88-ddac7d34d0f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ06184',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 38802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-12',
 'seller_name': None,
 'title': 'Dacia Duster 1.3 TCe Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2024}
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ06184%27 HTTP/1.1" 200 None
2026-03-27 11:12:45 [auto1.de] INFO: Saving data for ZJ06184: {'auction_closing_time': 1774627556.0, 'created_time': 1774521559.878471, 'last_price_update_time': 1774609965.079298}
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ06184') HTTP/1.1" 204 0
2026-03-27 11:12:45 [auto1.de] INFO: Found listing with ID: XY68410
2026-03-27 11:12:45 [auto1.de] INFO: Found listing with ID: KX24751
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24751%27 HTTP/1.1" 200 None
2026-03-27 11:12:45 [auto1.de] INFO: Scrape type for KX24751: 2
2026-03-27 11:12:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38dd2c2f-cd8c-5649-b67c-3d8d625e6b02 with identifier: KX24751
2026-03-27 11:12:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38dd2c2f-cd8c-5649-b67c-3d8d625e6b02 with scrape type 2
2026-03-27 11:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38dd2c2f-cd8c-5649-b67c-3d8d625e6b02 with scrape type 2
2026-03-27 11:12:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38dd2c2f-cd8c-5649-b67c-3d8d625e6b02, identifier: KX24751
2026-03-27 11:12:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38dd2c2f-cd8c-5649-b67c-3d8d625e6b02 with identifier: KX24751
2026-03-27 11:12:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38dd2c2f-cd8c-5649-b67c-3d8d625e6b02 with identifier: KX24751
2026-03-27 11:12:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38dd2c2f-cd8c-5649-b67c-3d8d625e6b02 with identifier: KX24751 to the API
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-27T16:32:18Z',
 'fuel_type': 'petrol',
 'id': '38dd2c2f-cd8c-5649-b67c-3d8d625e6b02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX24751',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 95671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.8 Turbo Veloce',
 'transmission': 'automatic',
 'trim': 'Veloce',
 'year': 2016}
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24751%27 HTTP/1.1" 200 None
2026-03-27 11:12:45 [auto1.de] INFO: Saving data for KX24751: {'auction_closing_time': 1774629138.0, 'created_time': 1774521581.237791, 'last_price_update_time': 1774609965.505753}
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX24751') HTTP/1.1" 204 0
2026-03-27 11:12:45 [auto1.de] INFO: Found listing with ID: GD73586
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD73586%27 HTTP/1.1" 200 None
2026-03-27 11:12:45 [auto1.de] INFO: Scrape type for GD73586: 2
2026-03-27 11:12:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 046ec5f5-89cd-57f8-9429-d461c72adfcc with identifier: GD73586
2026-03-27 11:12:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 046ec5f5-89cd-57f8-9429-d461c72adfcc with scrape type 2
2026-03-27 11:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 046ec5f5-89cd-57f8-9429-d461c72adfcc with scrape type 2
2026-03-27 11:12:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 046ec5f5-89cd-57f8-9429-d461c72adfcc, identifier: GD73586
2026-03-27 11:12:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 046ec5f5-89cd-57f8-9429-d461c72adfcc with identifier: GD73586
2026-03-27 11:12:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 046ec5f5-89cd-57f8-9429-d461c72adfcc with identifier: GD73586
2026-03-27 11:12:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 046ec5f5-89cd-57f8-9429-d461c72adfcc with identifier: GD73586 to the API
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:46:43Z',
 'fuel_type': 'petrol',
 'id': '046ec5f5-89cd-57f8-9429-d461c72adfcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD73586',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 146913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-15',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Basis passion',
 'transmission': 'manual',
 'trim': 'Basis passion',
 'year': 2015}
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD73586%27 HTTP/1.1" 200 None
2026-03-27 11:12:45 [auto1.de] INFO: Saving data for GD73586: {'auction_closing_time': 1774630003.0, 'created_time': 1774521590.849128, 'last_price_update_time': 1774609965.960238}
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD73586') HTTP/1.1" 204 0
2026-03-27 11:12:45 [auto1.de] INFO: Found listing with ID: KU48054
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU48054%27 HTTP/1.1" 200 None
2026-03-27 11:12:45 [auto1.de] INFO: Scrape type for KU48054: 2
2026-03-27 11:12:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0129e928-3c84-5feb-91dc-6bca30cbfa90 with identifier: KU48054
2026-03-27 11:12:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0129e928-3c84-5feb-91dc-6bca30cbfa90 with scrape type 2
2026-03-27 11:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0129e928-3c84-5feb-91dc-6bca30cbfa90 with scrape type 2
2026-03-27 11:12:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0129e928-3c84-5feb-91dc-6bca30cbfa90, identifier: KU48054
2026-03-27 11:12:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0129e928-3c84-5feb-91dc-6bca30cbfa90 with identifier: KU48054
2026-03-27 11:12:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0129e928-3c84-5feb-91dc-6bca30cbfa90 with identifier: KU48054
2026-03-27 11:12:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0129e928-3c84-5feb-91dc-6bca30cbfa90 with identifier: KU48054 to the API
2026-03-27 11:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-27T16:44:30Z',
 'fuel_type': 'petrol',
 'id': '0129e928-3c84-5feb-91dc-6bca30cbfa90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU48054',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 6971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-24',
 'seller_name': None,
 'title': 'BMW 1er 120i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2024}
2026-03-27 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU48054%27 HTTP/1.1" 200 None
2026-03-27 11:12:46 [auto1.de] INFO: Saving data for KU48054: {'auction_closing_time': 1774629870.0, 'created_time': 1774521582.177692, 'last_price_update_time': 1774609966.428335}
2026-03-27 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU48054') HTTP/1.1" 204 0
2026-03-27 11:12:46 [auto1.de] INFO: Found listing with ID: XA19312
2026-03-27 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA19312%27 HTTP/1.1" 200 None
2026-03-27 11:12:46 [auto1.de] INFO: Scrape type for XA19312: 2
2026-03-27 11:12:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5 with identifier: XA19312
2026-03-27 11:12:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5 with scrape type 2
2026-03-27 11:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5 with scrape type 2
2026-03-27 11:12:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5, identifier: XA19312
2026-03-27 11:12:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5 with identifier: XA19312
2026-03-27 11:12:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5 with identifier: XA19312
2026-03-27 11:12:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5 with identifier: XA19312 to the API
2026-03-27 11:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-27T16:36:32Z',
 'fuel_type': 'petrol',
 'id': '2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA19312',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 89333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-25',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2018}
2026-03-27 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA19312%27 HTTP/1.1" 200 None
2026-03-27 11:12:46 [auto1.de] INFO: Saving data for XA19312: {'auction_closing_time': 1774629392.0, 'created_time': 1774521577.153559, 'last_price_update_time': 1774609966.887433}
2026-03-27 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA19312') HTTP/1.1" 204 0
2026-03-27 11:12:46 [auto1.de] INFO: Found listing with ID: PU11267
2026-03-27 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU11267%27 HTTP/1.1" 200 None
2026-03-27 11:12:46 [auto1.de] INFO: Scrape type for PU11267: 2
2026-03-27 11:12:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8caa3d6-751b-547e-91dd-070393e16382 with identifier: PU11267
2026-03-27 11:12:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8caa3d6-751b-547e-91dd-070393e16382 with scrape type 2
2026-03-27 11:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8caa3d6-751b-547e-91dd-070393e16382 with scrape type 2
2026-03-27 11:12:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8caa3d6-751b-547e-91dd-070393e16382, identifier: PU11267
2026-03-27 11:12:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8caa3d6-751b-547e-91dd-070393e16382 with identifier: PU11267
2026-03-27 11:12:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8caa3d6-751b-547e-91dd-070393e16382 with identifier: PU11267
2026-03-27 11:12:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8caa3d6-751b-547e-91dd-070393e16382 with identifier: PU11267 to the API
2026-03-27 11:12:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:01:12Z',
 'fuel_type': 'petrol',
 'id': 'd8caa3d6-751b-547e-91dd-070393e16382',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU11267',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 37127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-03',
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2019}
2026-03-27 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU11267%27 HTTP/1.1" 200 None
2026-03-27 11:12:47 [auto1.de] INFO: Saving data for PU11267: {'auction_closing_time': 1774627272.0, 'created_time': 1774521870.657776, 'last_price_update_time': 1774609967.313297}
2026-03-27 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU11267') HTTP/1.1" 204 0
2026-03-27 11:12:47 [auto1.de] INFO: Found listing with ID: RU42318
2026-03-27 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU42318%27 HTTP/1.1" 200 None
2026-03-27 11:12:47 [auto1.de] INFO: Scrape type for RU42318: 2
2026-03-27 11:12:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4675149c-e5e5-508e-af9d-6d678b3b1109 with identifier: RU42318
2026-03-27 11:12:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4675149c-e5e5-508e-af9d-6d678b3b1109 with scrape type 2
2026-03-27 11:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4675149c-e5e5-508e-af9d-6d678b3b1109 with scrape type 2
2026-03-27 11:12:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4675149c-e5e5-508e-af9d-6d678b3b1109, identifier: RU42318
2026-03-27 11:12:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4675149c-e5e5-508e-af9d-6d678b3b1109 with identifier: RU42318
2026-03-27 11:12:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4675149c-e5e5-508e-af9d-6d678b3b1109 with identifier: RU42318
2026-03-27 11:12:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4675149c-e5e5-508e-af9d-6d678b3b1109 with identifier: RU42318 to the API
2026-03-27 11:12:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:33:19Z',
 'fuel_type': 'diesel',
 'id': '4675149c-e5e5-508e-af9d-6d678b3b1109',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU42318',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 252642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-10',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2015}
2026-03-27 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU42318%27 HTTP/1.1" 200 None
2026-03-27 11:12:47 [auto1.de] INFO: Saving data for RU42318: {'auction_closing_time': 1774629199.0, 'created_time': 1773226686.88639, 'last_price_update_time': 1774609967.799013}
2026-03-27 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU42318') HTTP/1.1" 204 0
2026-03-27 11:12:47 [auto1.de] INFO: Found listing with ID: EN73396
2026-03-27 11:12:47 [auto1.de] INFO: Found listing with ID: EV72489
2026-03-27 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV72489%27 HTTP/1.1" 200 None
2026-03-27 11:12:47 [auto1.de] INFO: Scrape type for EV72489: 2
2026-03-27 11:12:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83963d0e-2d9c-545a-9406-f116e26815a7 with identifier: EV72489
2026-03-27 11:12:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83963d0e-2d9c-545a-9406-f116e26815a7 with scrape type 2
2026-03-27 11:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83963d0e-2d9c-545a-9406-f116e26815a7 with scrape type 2
2026-03-27 11:12:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83963d0e-2d9c-545a-9406-f116e26815a7, identifier: EV72489
2026-03-27 11:12:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83963d0e-2d9c-545a-9406-f116e26815a7 with identifier: EV72489
2026-03-27 11:12:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83963d0e-2d9c-545a-9406-f116e26815a7 with identifier: EV72489
2026-03-27 11:12:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83963d0e-2d9c-545a-9406-f116e26815a7 with identifier: EV72489 to the API
2026-03-27 11:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-27T16:55:10Z',
 'fuel_type': 'diesel',
 'id': '83963d0e-2d9c-545a-9406-f116e26815a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV72489',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 200824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-26',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Individual',
 'transmission': 'automatic',
 'trim': 'Individual',
 'year': 2016}
2026-03-27 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV72489%27 HTTP/1.1" 200 None
2026-03-27 11:12:48 [auto1.de] INFO: Saving data for EV72489: {'auction_closing_time': 1774630510.0, 'created_time': 1774521576.00924, 'last_price_update_time': 1774609968.345602}
2026-03-27 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV72489') HTTP/1.1" 204 0
2026-03-27 11:12:48 [auto1.de] INFO: Found listing with ID: TS65125
2026-03-27 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS65125%27 HTTP/1.1" 200 None
2026-03-27 11:12:48 [auto1.de] INFO: Scrape type for TS65125: 2
2026-03-27 11:12:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f38a44cc-2c4b-55de-8fda-14cd9a5721e1 with identifier: TS65125
2026-03-27 11:12:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f38a44cc-2c4b-55de-8fda-14cd9a5721e1 with scrape type 2
2026-03-27 11:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f38a44cc-2c4b-55de-8fda-14cd9a5721e1 with scrape type 2
2026-03-27 11:12:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f38a44cc-2c4b-55de-8fda-14cd9a5721e1, identifier: TS65125
2026-03-27 11:12:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f38a44cc-2c4b-55de-8fda-14cd9a5721e1 with identifier: TS65125
2026-03-27 11:12:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f38a44cc-2c4b-55de-8fda-14cd9a5721e1 with identifier: TS65125
2026-03-27 11:12:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f38a44cc-2c4b-55de-8fda-14cd9a5721e1 with identifier: TS65125 to the API
2026-03-27 11:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-27T16:06:50Z',
 'fuel_type': 'petrol',
 'id': 'f38a44cc-2c4b-55de-8fda-14cd9a5721e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS65125',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 35585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-03',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T5 Momentum 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum 2WD',
 'year': 2018}
2026-03-27 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS65125%27 HTTP/1.1" 200 None
2026-03-27 11:12:48 [auto1.de] INFO: Saving data for TS65125: {'auction_closing_time': 1774627610.0, 'created_time': 1773946815.264712, 'last_price_update_time': 1774609968.91528}
2026-03-27 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS65125') HTTP/1.1" 204 0
2026-03-27 11:12:48 [auto1.de] INFO: Found listing with ID: ZJ39351
2026-03-27 11:12:48 [auto1.de] INFO: Found listing with ID: AT14625
2026-03-27 11:12:48 [auto1.de] INFO: Found listing with ID: FZ71323
2026-03-27 11:12:48 [auto1.de] INFO: Found listing with ID: TX59054
2026-03-27 11:12:48 [auto1.de] INFO: Found listing with ID: NW06214
2026-03-27 11:12:48 [auto1.de] INFO: Found listing with ID: SM51050
2026-03-27 11:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:12:49 [auto1.de] INFO: Channel: 24h | Page: 244 | totalHits: 10673 | hits on page: 40
2026-03-27 11:12:49 [auto1.de] INFO: Found listing with ID: VT41344
2026-03-27 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT41344%27 HTTP/1.1" 200 None
2026-03-27 11:12:49 [auto1.de] INFO: Scrape type for VT41344: 2
2026-03-27 11:12:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b88936e-3414-5b11-8023-bd9586466aec with identifier: VT41344
2026-03-27 11:12:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b88936e-3414-5b11-8023-bd9586466aec with scrape type 2
2026-03-27 11:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b88936e-3414-5b11-8023-bd9586466aec with scrape type 2
2026-03-27 11:12:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b88936e-3414-5b11-8023-bd9586466aec, identifier: VT41344
2026-03-27 11:12:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b88936e-3414-5b11-8023-bd9586466aec with identifier: VT41344
2026-03-27 11:12:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b88936e-3414-5b11-8023-bd9586466aec with identifier: VT41344
2026-03-27 11:12:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b88936e-3414-5b11-8023-bd9586466aec with identifier: VT41344 to the API
2026-03-27 11:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-27T16:29:59Z',
 'fuel_type': 'diesel',
 'id': '2b88936e-3414-5b11-8023-bd9586466aec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT41344',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 219034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-02',
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-27 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT41344%27 HTTP/1.1" 200 None
2026-03-27 11:12:50 [auto1.de] INFO: Saving data for VT41344: {'auction_closing_time': 1774628999.0, 'created_time': 1774521577.971607, 'last_price_update_time': 1774609970.319993}
2026-03-27 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT41344') HTTP/1.1" 204 0
2026-03-27 11:12:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:12:50 [auto1.de] INFO: Found listing with ID: VL46030
2026-03-27 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL46030%27 HTTP/1.1" 200 None
2026-03-27 11:12:50 [auto1.de] INFO: Scrape type for VL46030: 2
2026-03-27 11:12:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1485a78a-04fa-5302-ad0d-da3eac10dc1c with identifier: VL46030
2026-03-27 11:12:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1485a78a-04fa-5302-ad0d-da3eac10dc1c with scrape type 2
2026-03-27 11:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1485a78a-04fa-5302-ad0d-da3eac10dc1c with scrape type 2
2026-03-27 11:12:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1485a78a-04fa-5302-ad0d-da3eac10dc1c, identifier: VL46030
2026-03-27 11:12:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1485a78a-04fa-5302-ad0d-da3eac10dc1c with identifier: VL46030
2026-03-27 11:12:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1485a78a-04fa-5302-ad0d-da3eac10dc1c with identifier: VL46030
2026-03-27 11:12:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1485a78a-04fa-5302-ad0d-da3eac10dc1c with identifier: VL46030 to the API
2026-03-27 11:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-27T16:30:22Z',
 'fuel_type': 'petrol',
 'id': '1485a78a-04fa-5302-ad0d-da3eac10dc1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL46030',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 48507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-10-14',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 500',
 'transmission': 'automatic',
 'trim': '',
 'year': 2003}
2026-03-27 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL46030%27 HTTP/1.1" 200 None
2026-03-27 11:12:50 [auto1.de] INFO: Saving data for VL46030: {'auction_closing_time': 1774629022.0, 'created_time': 1774521588.907601, 'last_price_update_time': 1774609970.762198}
2026-03-27 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL46030') HTTP/1.1" 204 0
2026-03-27 11:12:50 [auto1.de] INFO: Found listing with ID: LA48706
2026-03-27 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA48706%27 HTTP/1.1" 200 None
2026-03-27 11:12:50 [auto1.de] INFO: Scrape type for LA48706: 2
2026-03-27 11:12:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 593bce64-97e7-5de4-86ab-55df8b57ec8f with identifier: LA48706
2026-03-27 11:12:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 593bce64-97e7-5de4-86ab-55df8b57ec8f with scrape type 2
2026-03-27 11:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 593bce64-97e7-5de4-86ab-55df8b57ec8f with scrape type 2
2026-03-27 11:12:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 593bce64-97e7-5de4-86ab-55df8b57ec8f, identifier: LA48706
2026-03-27 11:12:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 593bce64-97e7-5de4-86ab-55df8b57ec8f with identifier: LA48706
2026-03-27 11:12:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 593bce64-97e7-5de4-86ab-55df8b57ec8f with identifier: LA48706
2026-03-27 11:12:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 593bce64-97e7-5de4-86ab-55df8b57ec8f with identifier: LA48706 to the API
2026-03-27 11:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-27T16:53:43Z',
 'fuel_type': 'petrol',
 'id': '593bce64-97e7-5de4-86ab-55df8b57ec8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA48706',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 58265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-12',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Dream Team',
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2017}
2026-03-27 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA48706%27 HTTP/1.1" 200 None
2026-03-27 11:12:51 [auto1.de] INFO: Saving data for LA48706: {'auction_closing_time': 1774630423.0, 'created_time': 1774521565.02783, 'last_price_update_time': 1774609971.186752}
2026-03-27 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA48706') HTTP/1.1" 204 0
2026-03-27 11:12:51 [auto1.de] INFO: Found listing with ID: JY03084
2026-03-27 11:12:51 [auto1.de] INFO: Found listing with ID: BJ84738
2026-03-27 11:12:51 [auto1.de] INFO: Found listing with ID: TN32015
2026-03-27 11:12:51 [auto1.de] INFO: Found listing with ID: GL29302
2026-03-27 11:12:51 [auto1.de] INFO: Found listing with ID: MV56275
2026-03-27 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV56275%27 HTTP/1.1" 200 None
2026-03-27 11:12:51 [auto1.de] INFO: Scrape type for MV56275: 2
2026-03-27 11:12:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6189e685-b492-5397-8129-9f814bfe874c with identifier: MV56275
2026-03-27 11:12:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6189e685-b492-5397-8129-9f814bfe874c with scrape type 2
2026-03-27 11:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6189e685-b492-5397-8129-9f814bfe874c with scrape type 2
2026-03-27 11:12:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6189e685-b492-5397-8129-9f814bfe874c, identifier: MV56275
2026-03-27 11:12:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6189e685-b492-5397-8129-9f814bfe874c with identifier: MV56275
2026-03-27 11:12:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6189e685-b492-5397-8129-9f814bfe874c with identifier: MV56275
2026-03-27 11:12:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6189e685-b492-5397-8129-9f814bfe874c with identifier: MV56275 to the API
2026-03-27 11:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:11:57Z',
 'fuel_type': 'petrol',
 'id': '6189e685-b492-5397-8129-9f814bfe874c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV56275',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 151634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-30',
 'seller_name': None,
 'title': 'Honda Jazz 1.2 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2011}
2026-03-27 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV56275%27 HTTP/1.1" 200 None
2026-03-27 11:12:51 [auto1.de] INFO: Saving data for MV56275: {'auction_closing_time': 1774627917.0, 'created_time': 1774521560.807268, 'last_price_update_time': 1774609971.763566}
2026-03-27 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV56275') HTTP/1.1" 204 0
2026-03-27 11:12:51 [auto1.de] INFO: Found listing with ID: XL13857
2026-03-27 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL13857%27 HTTP/1.1" 200 None
2026-03-27 11:12:51 [auto1.de] INFO: Scrape type for XL13857: 2
2026-03-27 11:12:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2 with identifier: XL13857
2026-03-27 11:12:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2 with scrape type 2
2026-03-27 11:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2 with scrape type 2
2026-03-27 11:12:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2, identifier: XL13857
2026-03-27 11:12:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2 with identifier: XL13857
2026-03-27 11:12:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2 with identifier: XL13857
2026-03-27 11:12:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2 with identifier: XL13857 to the API
2026-03-27 11:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-27T16:39:21Z',
 'fuel_type': 'petrol',
 'id': 'f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL13857',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 25693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-03',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-27 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL13857%27 HTTP/1.1" 200 None
2026-03-27 11:12:52 [auto1.de] INFO: Saving data for XL13857: {'auction_closing_time': 1774629561.0, 'created_time': 1774521563.494481, 'last_price_update_time': 1774609972.332466}
2026-03-27 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL13857') HTTP/1.1" 204 0
2026-03-27 11:12:52 [auto1.de] INFO: Found listing with ID: EM22494
2026-03-27 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM22494%27 HTTP/1.1" 200 None
2026-03-27 11:12:52 [auto1.de] INFO: Scrape type for EM22494: 2
2026-03-27 11:12:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29a1effc-b0de-5c9b-85c0-bf35fff7962e with identifier: EM22494
2026-03-27 11:12:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a1effc-b0de-5c9b-85c0-bf35fff7962e with scrape type 2
2026-03-27 11:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29a1effc-b0de-5c9b-85c0-bf35fff7962e with scrape type 2
2026-03-27 11:12:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29a1effc-b0de-5c9b-85c0-bf35fff7962e, identifier: EM22494
2026-03-27 11:12:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29a1effc-b0de-5c9b-85c0-bf35fff7962e with identifier: EM22494
2026-03-27 11:12:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29a1effc-b0de-5c9b-85c0-bf35fff7962e with identifier: EM22494
2026-03-27 11:12:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29a1effc-b0de-5c9b-85c0-bf35fff7962e with identifier: EM22494 to the API
2026-03-27 11:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-27T16:04:46Z',
 'fuel_type': 'petrol',
 'id': '29a1effc-b0de-5c9b-85c0-bf35fff7962e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM22494',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 143229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-30',
 'seller_name': None,
 'title': 'BMW 3er 328i GT xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-27 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM22494%27 HTTP/1.1" 200 None
2026-03-27 11:12:52 [auto1.de] INFO: Saving data for EM22494: {'auction_closing_time': 1774627486.0, 'created_time': 1774521552.554999, 'last_price_update_time': 1774609972.751813}
2026-03-27 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM22494') HTTP/1.1" 204 0
2026-03-27 11:12:52 [auto1.de] INFO: Found listing with ID: PE69175
2026-03-27 11:12:52 [auto1.de] INFO: Found listing with ID: TB42941
2026-03-27 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB42941%27 HTTP/1.1" 200 None
2026-03-27 11:12:52 [auto1.de] INFO: Scrape type for TB42941: 2
2026-03-27 11:12:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e63e799-a946-5728-ab08-7b19f10afa1f with identifier: TB42941
2026-03-27 11:12:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e63e799-a946-5728-ab08-7b19f10afa1f with scrape type 2
2026-03-27 11:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e63e799-a946-5728-ab08-7b19f10afa1f with scrape type 2
2026-03-27 11:12:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e63e799-a946-5728-ab08-7b19f10afa1f, identifier: TB42941
2026-03-27 11:12:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e63e799-a946-5728-ab08-7b19f10afa1f with identifier: TB42941
2026-03-27 11:12:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e63e799-a946-5728-ab08-7b19f10afa1f with identifier: TB42941
2026-03-27 11:12:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e63e799-a946-5728-ab08-7b19f10afa1f with identifier: TB42941 to the API
2026-03-27 11:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-27T16:09:04Z',
 'fuel_type': 'petrol',
 'id': '4e63e799-a946-5728-ab08-7b19f10afa1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB42941',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 30143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-12',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2026-03-27 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB42941%27 HTTP/1.1" 200 None
2026-03-27 11:12:53 [auto1.de] INFO: Saving data for TB42941: {'auction_closing_time': 1774627744.0, 'created_time': 1774521555.50864, 'last_price_update_time': 1774609973.239421}
2026-03-27 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB42941') HTTP/1.1" 204 0
2026-03-27 11:12:53 [auto1.de] INFO: Found listing with ID: AL34551
2026-03-27 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL34551%27 HTTP/1.1" 200 None
2026-03-27 11:12:53 [auto1.de] INFO: Scrape type for AL34551: 2
2026-03-27 11:12:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c12c7325-bbda-58aa-a7db-87bbba1fe59b with identifier: AL34551
2026-03-27 11:12:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c12c7325-bbda-58aa-a7db-87bbba1fe59b with scrape type 2
2026-03-27 11:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c12c7325-bbda-58aa-a7db-87bbba1fe59b with scrape type 2
2026-03-27 11:12:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c12c7325-bbda-58aa-a7db-87bbba1fe59b, identifier: AL34551
2026-03-27 11:12:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c12c7325-bbda-58aa-a7db-87bbba1fe59b with identifier: AL34551
2026-03-27 11:12:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c12c7325-bbda-58aa-a7db-87bbba1fe59b with identifier: AL34551
2026-03-27 11:12:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c12c7325-bbda-58aa-a7db-87bbba1fe59b with identifier: AL34551 to the API
2026-03-27 11:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:12:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:12:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:19:42Z',
 'fuel_type': 'petrol',
 'id': 'c12c7325-bbda-58aa-a7db-87bbba1fe59b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL34551',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 112550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-26',
 'seller_name': None,
 'title': 'Renault Megane 1.2 BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2012}
2026-03-27 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL34551%27 HTTP/1.1" 200 None
2026-03-27 11:12:54 [auto1.de] INFO: Saving data for AL34551: {'auction_closing_time': 1774628382.0, 'created_time': 1774521556.467277, 'last_price_update_time': 1774609974.072422}
2026-03-27 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL34551') HTTP/1.1" 204 0
2026-03-27 11:12:54 [auto1.de] INFO: Found listing with ID: WT60048
2026-03-27 11:12:54 [auto1.de] INFO: Found listing with ID: TC55492
2026-03-27 11:12:54 [auto1.de] INFO: Found listing with ID: BL86865
2026-03-27 11:12:54 [auto1.de] INFO: Found listing with ID: XU69783
2026-03-27 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU69783%27 HTTP/1.1" 200 None
2026-03-27 11:12:54 [auto1.de] INFO: Scrape type for XU69783: 2
2026-03-27 11:12:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a34dc4ad-f99d-50bd-99d0-93b09c465cd9 with identifier: XU69783
2026-03-27 11:12:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a34dc4ad-f99d-50bd-99d0-93b09c465cd9 with scrape type 2
2026-03-27 11:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a34dc4ad-f99d-50bd-99d0-93b09c465cd9 with scrape type 2
2026-03-27 11:12:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a34dc4ad-f99d-50bd-99d0-93b09c465cd9, identifier: XU69783
2026-03-27 11:12:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a34dc4ad-f99d-50bd-99d0-93b09c465cd9 with identifier: XU69783
2026-03-27 11:12:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a34dc4ad-f99d-50bd-99d0-93b09c465cd9 with identifier: XU69783
2026-03-27 11:12:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a34dc4ad-f99d-50bd-99d0-93b09c465cd9 with identifier: XU69783 to the API
2026-03-27 11:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-27T16:23:45Z',
 'fuel_type': 'diesel',
 'id': 'a34dc4ad-f99d-50bd-99d0-93b09c465cd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU69783',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 206492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-04',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style Allrad',
 'transmission': 'automatic',
 'trim': 'Style Allrad',
 'year': 2019}
2026-03-27 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU69783%27 HTTP/1.1" 200 None
2026-03-27 11:13:20 [auto1.de] INFO: Saving data for XU69783: {'auction_closing_time': 1774628625.0, 'created_time': 1774521827.42546, 'last_price_update_time': 1774610000.166829}
2026-03-27 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU69783') HTTP/1.1" 204 0
2026-03-27 11:13:20 [auto1.de] INFO: Found listing with ID: RM44288
2026-03-27 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM44288%27 HTTP/1.1" 200 None
2026-03-27 11:13:20 [auto1.de] INFO: Scrape type for RM44288: 2
2026-03-27 11:13:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7dadd69-4268-5386-bb11-a9fc32343992 with identifier: RM44288
2026-03-27 11:13:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7dadd69-4268-5386-bb11-a9fc32343992 with scrape type 2
2026-03-27 11:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7dadd69-4268-5386-bb11-a9fc32343992 with scrape type 2
2026-03-27 11:13:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7dadd69-4268-5386-bb11-a9fc32343992, identifier: RM44288
2026-03-27 11:13:20 [scrapy.extensions.logstats] INFO: Crawled 712 pages (at 4 pages/min), scraped 1035 items (at 77 items/min)
2026-03-27 11:13:20 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 11:13:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7dadd69-4268-5386-bb11-a9fc32343992 with identifier: RM44288
2026-03-27 11:13:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7dadd69-4268-5386-bb11-a9fc32343992 with identifier: RM44288
2026-03-27 11:13:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7dadd69-4268-5386-bb11-a9fc32343992 with identifier: RM44288 to the API
2026-03-27 11:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-27T16:57:35Z',
 'fuel_type': 'diesel',
 'id': 'c7dadd69-4268-5386-bb11-a9fc32343992',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM44288',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 224714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-16',
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2026-03-27 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM44288%27 HTTP/1.1" 200 None
2026-03-27 11:13:20 [auto1.de] INFO: Saving data for RM44288: {'auction_closing_time': 1774630655.0, 'created_time': 1774521588.523144, 'last_price_update_time': 1774610000.637496}
2026-03-27 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM44288') HTTP/1.1" 204 0
2026-03-27 11:13:20 [auto1.de] INFO: Found listing with ID: PS32841
2026-03-27 11:13:20 [auto1.de] INFO: Found listing with ID: SK64465
2026-03-27 11:13:20 [auto1.de] INFO: Found listing with ID: PA83352
2026-03-27 11:13:20 [auto1.de] INFO: Found listing with ID: AJ59677
2026-03-27 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ59677%27 HTTP/1.1" 200 None
2026-03-27 11:13:20 [auto1.de] INFO: Scrape type for AJ59677: 2
2026-03-27 11:13:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e02ef16-a8da-5c93-b715-6efd97cfc9b3 with identifier: AJ59677
2026-03-27 11:13:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e02ef16-a8da-5c93-b715-6efd97cfc9b3 with scrape type 2
2026-03-27 11:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e02ef16-a8da-5c93-b715-6efd97cfc9b3 with scrape type 2
2026-03-27 11:13:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e02ef16-a8da-5c93-b715-6efd97cfc9b3, identifier: AJ59677
2026-03-27 11:13:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e02ef16-a8da-5c93-b715-6efd97cfc9b3 with identifier: AJ59677
2026-03-27 11:13:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e02ef16-a8da-5c93-b715-6efd97cfc9b3 with identifier: AJ59677
2026-03-27 11:13:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e02ef16-a8da-5c93-b715-6efd97cfc9b3 with identifier: AJ59677 to the API
2026-03-27 11:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 290,
 'expiration_date': '2026-03-27T16:20:09Z',
 'fuel_type': 'petrol',
 'id': '5e02ef16-a8da-5c93-b715-6efd97cfc9b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ59677',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 74153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-27',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TSI Cupra 290',
 'transmission': 'automatic',
 'trim': 'Cupra 290',
 'year': 2019}
2026-03-27 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ59677%27 HTTP/1.1" 200 None
2026-03-27 11:13:21 [auto1.de] INFO: Saving data for AJ59677: {'auction_closing_time': 1774628409.0, 'created_time': 1773303215.094568, 'last_price_update_time': 1774610001.109404}
2026-03-27 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ59677') HTTP/1.1" 204 0
2026-03-27 11:13:21 [auto1.de] INFO: Found listing with ID: VD19209
2026-03-27 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD19209%27 HTTP/1.1" 200 None
2026-03-27 11:13:21 [auto1.de] INFO: Scrape type for VD19209: 2
2026-03-27 11:13:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3294c016-0346-571a-93c5-88172ea8ce35 with identifier: VD19209
2026-03-27 11:13:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3294c016-0346-571a-93c5-88172ea8ce35 with scrape type 2
2026-03-27 11:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3294c016-0346-571a-93c5-88172ea8ce35 with scrape type 2
2026-03-27 11:13:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3294c016-0346-571a-93c5-88172ea8ce35, identifier: VD19209
2026-03-27 11:13:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3294c016-0346-571a-93c5-88172ea8ce35 with identifier: VD19209
2026-03-27 11:13:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3294c016-0346-571a-93c5-88172ea8ce35 with identifier: VD19209
2026-03-27 11:13:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3294c016-0346-571a-93c5-88172ea8ce35 with identifier: VD19209 to the API
2026-03-27 11:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-27T16:41:05Z',
 'fuel_type': 'hybrid',
 'id': '3294c016-0346-571a-93c5-88172ea8ce35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD19209',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 42942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350de 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2022}
2026-03-27 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD19209%27 HTTP/1.1" 200 None
2026-03-27 11:13:21 [auto1.de] INFO: Saving data for VD19209: {'auction_closing_time': 1774629665.0, 'created_time': 1773380970.822602, 'last_price_update_time': 1774610001.754276}
2026-03-27 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VD19209') HTTP/1.1" 204 0
2026-03-27 11:13:21 [auto1.de] INFO: Found listing with ID: ZT31160
2026-03-27 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT31160%27 HTTP/1.1" 200 None
2026-03-27 11:13:21 [auto1.de] INFO: Scrape type for ZT31160: 2
2026-03-27 11:13:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f334e259-ee7e-5995-9536-848d194c005c with identifier: ZT31160
2026-03-27 11:13:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f334e259-ee7e-5995-9536-848d194c005c with scrape type 2
2026-03-27 11:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f334e259-ee7e-5995-9536-848d194c005c with scrape type 2
2026-03-27 11:13:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f334e259-ee7e-5995-9536-848d194c005c, identifier: ZT31160
2026-03-27 11:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:13:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f334e259-ee7e-5995-9536-848d194c005c with identifier: ZT31160
2026-03-27 11:13:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f334e259-ee7e-5995-9536-848d194c005c with identifier: ZT31160
2026-03-27 11:13:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f334e259-ee7e-5995-9536-848d194c005c with identifier: ZT31160 to the API
2026-03-27 11:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-27T16:09:59Z',
 'fuel_type': 'diesel',
 'id': 'f334e259-ee7e-5995-9536-848d194c005c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT31160',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 224478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-06',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 114 CDI extralang Pro',
 'transmission': 'automatic',
 'trim': 'extralang Pro',
 'year': 2017}
2026-03-27 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT31160%27 HTTP/1.1" 200 None
2026-03-27 11:13:22 [auto1.de] INFO: Saving data for ZT31160: {'auction_closing_time': 1774627799.0, 'created_time': 1774521629.333873, 'last_price_update_time': 1774610002.196259}
2026-03-27 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT31160') HTTP/1.1" 204 0
2026-03-27 11:13:22 [auto1.de] INFO: Found listing with ID: LZ60338
2026-03-27 11:13:22 [auto1.de] INFO: Found listing with ID: MN38149
2026-03-27 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN38149%27 HTTP/1.1" 200 None
2026-03-27 11:13:22 [auto1.de] INFO: Scrape type for MN38149: 2
2026-03-27 11:13:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2b3abc7-ff9b-53b1-bcab-97dc2aa40886 with identifier: MN38149
2026-03-27 11:13:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2b3abc7-ff9b-53b1-bcab-97dc2aa40886 with scrape type 2
2026-03-27 11:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2b3abc7-ff9b-53b1-bcab-97dc2aa40886 with scrape type 2
2026-03-27 11:13:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2b3abc7-ff9b-53b1-bcab-97dc2aa40886, identifier: MN38149
2026-03-27 11:13:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2b3abc7-ff9b-53b1-bcab-97dc2aa40886 with identifier: MN38149
2026-03-27 11:13:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2b3abc7-ff9b-53b1-bcab-97dc2aa40886 with identifier: MN38149
2026-03-27 11:13:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2b3abc7-ff9b-53b1-bcab-97dc2aa40886 with identifier: MN38149 to the API
2026-03-27 11:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-27T16:42:39Z',
 'fuel_type': 'diesel',
 'id': 'f2b3abc7-ff9b-53b1-bcab-97dc2aa40886',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN38149',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 189203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Color Edition ecoFlex',
 'transmission': 'manual',
 'trim': 'Color Edition ecoFlex',
 'year': 2016}
2026-03-27 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN38149%27 HTTP/1.1" 200 None
2026-03-27 11:13:22 [auto1.de] INFO: Saving data for MN38149: {'auction_closing_time': 1774629759.0, 'created_time': 1774521694.104823, 'last_price_update_time': 1774610002.670959}
2026-03-27 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN38149') HTTP/1.1" 204 0
2026-03-27 11:13:22 [auto1.de] INFO: Found listing with ID: BJ90757
2026-03-27 11:13:22 [auto1.de] INFO: Found listing with ID: KG57755
2026-03-27 11:13:22 [auto1.de] INFO: Found listing with ID: XZ76786
2026-03-27 11:13:22 [auto1.de] INFO: Found listing with ID: RJ41827
2026-03-27 11:13:22 [auto1.de] INFO: Found listing with ID: PP42616
2026-03-27 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP42616%27 HTTP/1.1" 200 None
2026-03-27 11:13:22 [auto1.de] INFO: Scrape type for PP42616: 2
2026-03-27 11:13:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2efc9f65-2879-5396-ad22-f22fd4117735 with identifier: PP42616
2026-03-27 11:13:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2efc9f65-2879-5396-ad22-f22fd4117735 with scrape type 2
2026-03-27 11:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2efc9f65-2879-5396-ad22-f22fd4117735 with scrape type 2
2026-03-27 11:13:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2efc9f65-2879-5396-ad22-f22fd4117735, identifier: PP42616
2026-03-27 11:13:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2efc9f65-2879-5396-ad22-f22fd4117735 with identifier: PP42616
2026-03-27 11:13:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2efc9f65-2879-5396-ad22-f22fd4117735 with identifier: PP42616
2026-03-27 11:13:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2efc9f65-2879-5396-ad22-f22fd4117735 with identifier: PP42616 to the API
2026-03-27 11:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-27T16:02:57Z',
 'fuel_type': 'petrol',
 'id': '2efc9f65-2879-5396-ad22-f22fd4117735',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP42616',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 107383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-02',
 'seller_name': None,
 'title': 'Mazda CX-5 2.5 Sports-Line AWD',
 'transmission': 'automatic',
 'trim': 'Sports-Line AWD',
 'year': 2021}
2026-03-27 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP42616%27 HTTP/1.1" 200 None
2026-03-27 11:13:23 [auto1.de] INFO: Saving data for PP42616: {'auction_closing_time': 1774627377.0, 'created_time': 1774521630.126617, 'last_price_update_time': 1774610003.142015}
2026-03-27 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP42616') HTTP/1.1" 204 0
2026-03-27 11:13:23 [auto1.de] INFO: Channel: 24h | Page: 245 | totalHits: 10676 | hits on page: 40
2026-03-27 11:13:23 [auto1.de] INFO: Found listing with ID: LW42175
2026-03-27 11:13:23 [auto1.de] INFO: Found listing with ID: HP87000
2026-03-27 11:13:23 [auto1.de] INFO: Found listing with ID: LJ34502
2026-03-27 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ34502%27 HTTP/1.1" 200 None
2026-03-27 11:13:23 [auto1.de] INFO: Scrape type for LJ34502: 2
2026-03-27 11:13:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a355cc45-b00a-515e-9827-996bbf42d84a with identifier: LJ34502
2026-03-27 11:13:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a355cc45-b00a-515e-9827-996bbf42d84a with scrape type 2
2026-03-27 11:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a355cc45-b00a-515e-9827-996bbf42d84a with scrape type 2
2026-03-27 11:13:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a355cc45-b00a-515e-9827-996bbf42d84a, identifier: LJ34502
2026-03-27 11:13:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a355cc45-b00a-515e-9827-996bbf42d84a with identifier: LJ34502
2026-03-27 11:13:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a355cc45-b00a-515e-9827-996bbf42d84a with identifier: LJ34502
2026-03-27 11:13:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a355cc45-b00a-515e-9827-996bbf42d84a with identifier: LJ34502 to the API
2026-03-27 11:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-27T16:52:00Z',
 'fuel_type': 'diesel',
 'id': 'a355cc45-b00a-515e-9827-996bbf42d84a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ34502',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 87038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-13',
 'seller_name': None,
 'title': 'Kia Sorento 2.2 CRDi Platinum Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Platinum Edition 4WD',
 'year': 2017}
2026-03-27 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ34502%27 HTTP/1.1" 200 None
2026-03-27 11:13:23 [auto1.de] INFO: Saving data for LJ34502: {'auction_closing_time': 1774630320.0, 'created_time': 1774521625.805204, 'last_price_update_time': 1774610003.595669}
2026-03-27 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ34502') HTTP/1.1" 204 0
2026-03-27 11:13:23 [auto1.de] INFO: Found listing with ID: ZZ01082
2026-03-27 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ01082%27 HTTP/1.1" 200 None
2026-03-27 11:13:23 [auto1.de] INFO: Scrape type for ZZ01082: 2
2026-03-27 11:13:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcee49b7-5e93-5ce3-84c1-f6fb6b73291a with identifier: ZZ01082
2026-03-27 11:13:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcee49b7-5e93-5ce3-84c1-f6fb6b73291a with scrape type 2
2026-03-27 11:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcee49b7-5e93-5ce3-84c1-f6fb6b73291a with scrape type 2
2026-03-27 11:13:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dcee49b7-5e93-5ce3-84c1-f6fb6b73291a, identifier: ZZ01082
2026-03-27 11:13:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:13:23 [auto1.de] INFO: Found listing with ID: YC50370
2026-03-27 11:13:23 [auto1.de] INFO: Found listing with ID: AM93844
2026-03-27 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM93844%27 HTTP/1.1" 200 None
2026-03-27 11:13:23 [auto1.de] INFO: Scrape type for AM93844: 2
2026-03-27 11:13:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 197eccf2-9048-5d0f-bd99-5c4515514c07 with identifier: AM93844
2026-03-27 11:13:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 197eccf2-9048-5d0f-bd99-5c4515514c07 with scrape type 2
2026-03-27 11:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 197eccf2-9048-5d0f-bd99-5c4515514c07 with scrape type 2
2026-03-27 11:13:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 197eccf2-9048-5d0f-bd99-5c4515514c07, identifier: AM93844
2026-03-27 11:13:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dcee49b7-5e93-5ce3-84c1-f6fb6b73291a with identifier: ZZ01082
2026-03-27 11:13:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dcee49b7-5e93-5ce3-84c1-f6fb6b73291a with identifier: ZZ01082
2026-03-27 11:13:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dcee49b7-5e93-5ce3-84c1-f6fb6b73291a with identifier: ZZ01082 to the API
2026-03-27 11:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-27T16:21:16Z',
 'fuel_type': 'petrol',
 'id': 'dcee49b7-5e93-5ce3-84c1-f6fb6b73291a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ01082',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 54025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-28',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Cool Plus',
 'transmission': 'manual',
 'trim': 'Cool Plus',
 'year': 2021}
2026-03-27 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ01082%27 HTTP/1.1" 200 None
2026-03-27 11:13:24 [auto1.de] INFO: Saving data for ZZ01082: {'auction_closing_time': 1774628476.0, 'created_time': 1774521718.402582, 'last_price_update_time': 1774610004.742395}
2026-03-27 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ01082') HTTP/1.1" 204 0
2026-03-27 11:13:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 197eccf2-9048-5d0f-bd99-5c4515514c07 with identifier: AM93844
2026-03-27 11:13:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 197eccf2-9048-5d0f-bd99-5c4515514c07 with identifier: AM93844
2026-03-27 11:13:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 197eccf2-9048-5d0f-bd99-5c4515514c07 with identifier: AM93844 to the API
2026-03-27 11:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-27T16:25:03Z',
 'fuel_type': 'diesel',
 'id': '197eccf2-9048-5d0f-bd99-5c4515514c07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM93844',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 114358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi Mild-Hybrid 350 L4 Einzelkabine Trend',
 'transmission': 'manual',
 'trim': '350 L4 Einzelkabine Trend',
 'year': 2021}
2026-03-27 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM93844%27 HTTP/1.1" 200 None
2026-03-27 11:13:25 [auto1.de] INFO: Saving data for AM93844: {'auction_closing_time': 1774628703.0, 'created_time': 1774521621.660793, 'last_price_update_time': 1774610005.137886}
2026-03-27 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM93844') HTTP/1.1" 204 0
2026-03-27 11:13:25 [auto1.de] INFO: Found listing with ID: TW15848
2026-03-27 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW15848%27 HTTP/1.1" 200 None
2026-03-27 11:13:25 [auto1.de] INFO: Scrape type for TW15848: 2
2026-03-27 11:13:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8097b80-dd32-5c15-9311-e37f7ab126b1 with identifier: TW15848
2026-03-27 11:13:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8097b80-dd32-5c15-9311-e37f7ab126b1 with scrape type 2
2026-03-27 11:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8097b80-dd32-5c15-9311-e37f7ab126b1 with scrape type 2
2026-03-27 11:13:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8097b80-dd32-5c15-9311-e37f7ab126b1, identifier: TW15848
2026-03-27 11:13:25 [auto1.de] INFO: Found listing with ID: GG27070
2026-03-27 11:13:25 [auto1.de] INFO: Found listing with ID: ZZ01082
2026-03-27 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ01082%27 HTTP/1.1" 200 None
2026-03-27 11:13:25 [auto1.de] INFO: Scrape type for ZZ01082: 0
2026-03-27 11:13:25 [auto1.de] INFO: Found listing with ID: TW15848
2026-03-27 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW15848%27 HTTP/1.1" 200 None
2026-03-27 11:13:25 [auto1.de] INFO: Scrape type for TW15848: 2
2026-03-27 11:13:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8097b80-dd32-5c15-9311-e37f7ab126b1 with scrape type 2
2026-03-27 11:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8097b80-dd32-5c15-9311-e37f7ab126b1 with scrape type 2
2026-03-27 11:13:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8097b80-dd32-5c15-9311-e37f7ab126b1, identifier: TW15848
2026-03-27 11:13:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8097b80-dd32-5c15-9311-e37f7ab126b1 with identifier: TW15848
2026-03-27 11:13:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8097b80-dd32-5c15-9311-e37f7ab126b1 with identifier: TW15848
2026-03-27 11:13:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8097b80-dd32-5c15-9311-e37f7ab126b1 with identifier: TW15848 to the API
2026-03-27 11:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-27T16:47:05Z',
 'fuel_type': 'diesel',
 'id': 'e8097b80-dd32-5c15-9311-e37f7ab126b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW15848',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 192905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-30',
 'seller_name': None,
 'title': 'BMW 5er 535d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2012}
2026-03-27 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW15848%27 HTTP/1.1" 200 None
2026-03-27 11:13:25 [auto1.de] INFO: Saving data for TW15848: {'auction_closing_time': 1774630025.0, 'created_time': 1774521829.629072, 'last_price_update_time': 1774610005.822906}
2026-03-27 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW15848') HTTP/1.1" 204 0
2026-03-27 11:13:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8097b80-dd32-5c15-9311-e37f7ab126b1 with identifier: TW15848
2026-03-27 11:13:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8097b80-dd32-5c15-9311-e37f7ab126b1 with identifier: TW15848
2026-03-27 11:13:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8097b80-dd32-5c15-9311-e37f7ab126b1 with identifier: TW15848 to the API
2026-03-27 11:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-27T16:47:05Z',
 'fuel_type': 'diesel',
 'id': 'e8097b80-dd32-5c15-9311-e37f7ab126b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW15848',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 192905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-30',
 'seller_name': None,
 'title': 'BMW 5er 535d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2012}
2026-03-27 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW15848%27 HTTP/1.1" 200 None
2026-03-27 11:13:26 [auto1.de] INFO: Saving data for TW15848: {'auction_closing_time': 1774630025.0, 'created_time': 1774521829.629072, 'last_price_update_time': 1774610006.193985}
2026-03-27 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW15848') HTTP/1.1" 204 0
2026-03-27 11:13:26 [auto1.de] INFO: Found listing with ID: KE90655
2026-03-27 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90655%27 HTTP/1.1" 200 None
2026-03-27 11:13:26 [auto1.de] INFO: Scrape type for KE90655: 2
2026-03-27 11:13:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9947bc2-0b22-5943-896a-b022d95f0f3e with identifier: KE90655
2026-03-27 11:13:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9947bc2-0b22-5943-896a-b022d95f0f3e with scrape type 2
2026-03-27 11:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9947bc2-0b22-5943-896a-b022d95f0f3e with scrape type 2
2026-03-27 11:13:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9947bc2-0b22-5943-896a-b022d95f0f3e, identifier: KE90655
2026-03-27 11:13:26 [auto1.de] INFO: Found listing with ID: KE90655
2026-03-27 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90655%27 HTTP/1.1" 200 None
2026-03-27 11:13:26 [auto1.de] INFO: Scrape type for KE90655: 2
2026-03-27 11:13:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9947bc2-0b22-5943-896a-b022d95f0f3e with scrape type 2
2026-03-27 11:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9947bc2-0b22-5943-896a-b022d95f0f3e with scrape type 2
2026-03-27 11:13:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9947bc2-0b22-5943-896a-b022d95f0f3e, identifier: KE90655
2026-03-27 11:13:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9947bc2-0b22-5943-896a-b022d95f0f3e with identifier: KE90655
2026-03-27 11:13:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9947bc2-0b22-5943-896a-b022d95f0f3e with identifier: KE90655
2026-03-27 11:13:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9947bc2-0b22-5943-896a-b022d95f0f3e with identifier: KE90655 to the API
2026-03-27 11:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 45,
 'expiration_date': '2026-03-27T16:28:47Z',
 'fuel_type': 'electro',
 'id': 'f9947bc2-0b22-5943-896a-b022d95f0f3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE90655',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 27212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-15',
 'seller_name': None,
 'title': 'Dacia Spring electric drive 33 kW Essential',
 'transmission': 'automatic',
 'trim': 'Essential',
 'year': 2023}
2026-03-27 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90655%27 HTTP/1.1" 200 None
2026-03-27 11:13:26 [auto1.de] INFO: Saving data for KE90655: {'auction_closing_time': 1774628927.0, 'created_time': 1773387361.762688, 'last_price_update_time': 1774610006.803762}
2026-03-27 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE90655') HTTP/1.1" 204 0
2026-03-27 11:13:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9947bc2-0b22-5943-896a-b022d95f0f3e with identifier: KE90655
2026-03-27 11:13:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9947bc2-0b22-5943-896a-b022d95f0f3e with identifier: KE90655
2026-03-27 11:13:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9947bc2-0b22-5943-896a-b022d95f0f3e with identifier: KE90655 to the API
2026-03-27 11:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 45,
 'expiration_date': '2026-03-27T16:28:47Z',
 'fuel_type': 'electro',
 'id': 'f9947bc2-0b22-5943-896a-b022d95f0f3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE90655',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 27212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-15',
 'seller_name': None,
 'title': 'Dacia Spring electric drive 33 kW Essential',
 'transmission': 'automatic',
 'trim': 'Essential',
 'year': 2023}
2026-03-27 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90655%27 HTTP/1.1" 200 None
2026-03-27 11:13:27 [auto1.de] INFO: Saving data for KE90655: {'auction_closing_time': 1774628927.0, 'created_time': 1773387361.762688, 'last_price_update_time': 1774610007.233977}
2026-03-27 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE90655') HTTP/1.1" 204 0
2026-03-27 11:13:27 [auto1.de] INFO: Found listing with ID: AK95286
2026-03-27 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK95286%27 HTTP/1.1" 200 None
2026-03-27 11:13:27 [auto1.de] INFO: Scrape type for AK95286: 2
2026-03-27 11:13:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e04b0931-8c4e-5df6-8762-c470d1b91222 with identifier: AK95286
2026-03-27 11:13:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e04b0931-8c4e-5df6-8762-c470d1b91222 with scrape type 2
2026-03-27 11:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e04b0931-8c4e-5df6-8762-c470d1b91222 with scrape type 2
2026-03-27 11:13:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e04b0931-8c4e-5df6-8762-c470d1b91222, identifier: AK95286
2026-03-27 11:13:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e04b0931-8c4e-5df6-8762-c470d1b91222 with identifier: AK95286
2026-03-27 11:13:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e04b0931-8c4e-5df6-8762-c470d1b91222 with identifier: AK95286
2026-03-27 11:13:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e04b0931-8c4e-5df6-8762-c470d1b91222 with identifier: AK95286 to the API
2026-03-27 11:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-27T16:37:14Z',
 'fuel_type': 'diesel',
 'id': 'e04b0931-8c4e-5df6-8762-c470d1b91222',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK95286',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 136509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-13',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2018}
2026-03-27 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK95286%27 HTTP/1.1" 200 None
2026-03-27 11:13:27 [auto1.de] INFO: Saving data for AK95286: {'auction_closing_time': 1774629434.0, 'created_time': 1774521602.161792, 'last_price_update_time': 1774610007.973132}
2026-03-27 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK95286') HTTP/1.1" 204 0
2026-03-27 11:13:27 [auto1.de] INFO: Found listing with ID: VW46858
2026-03-27 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW46858%27 HTTP/1.1" 200 None
2026-03-27 11:13:28 [auto1.de] INFO: Scrape type for VW46858: 2
2026-03-27 11:13:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68fc5dce-e5fa-5e9f-88e0-69a42d29b9cb with identifier: VW46858
2026-03-27 11:13:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68fc5dce-e5fa-5e9f-88e0-69a42d29b9cb with scrape type 2
2026-03-27 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68fc5dce-e5fa-5e9f-88e0-69a42d29b9cb with scrape type 2
2026-03-27 11:13:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68fc5dce-e5fa-5e9f-88e0-69a42d29b9cb, identifier: VW46858
2026-03-27 11:13:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68fc5dce-e5fa-5e9f-88e0-69a42d29b9cb with identifier: VW46858
2026-03-27 11:13:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68fc5dce-e5fa-5e9f-88e0-69a42d29b9cb with identifier: VW46858
2026-03-27 11:13:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68fc5dce-e5fa-5e9f-88e0-69a42d29b9cb with identifier: VW46858 to the API
2026-03-27 11:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:18:56Z',
 'fuel_type': 'petrol',
 'id': '68fc5dce-e5fa-5e9f-88e0-69a42d29b9cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW46858',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 77117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-04',
 'seller_name': None,
 'title': 'Mazda 3 2.0 High-Line',
 'transmission': 'automatic',
 'trim': 'High-Line',
 'year': 2009}
2026-03-27 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW46858%27 HTTP/1.1" 200 None
2026-03-27 11:13:28 [auto1.de] INFO: Saving data for VW46858: {'auction_closing_time': 1774628336.0, 'created_time': 1774521639.466876, 'last_price_update_time': 1774610008.438954}
2026-03-27 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW46858') HTTP/1.1" 204 0
2026-03-27 11:13:28 [auto1.de] INFO: Found listing with ID: TL68554
2026-03-27 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL68554%27 HTTP/1.1" 200 None
2026-03-27 11:13:28 [auto1.de] INFO: Scrape type for TL68554: 2
2026-03-27 11:13:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8315b0f-e112-57a0-bca8-ddb5fbd2bed5 with identifier: TL68554
2026-03-27 11:13:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8315b0f-e112-57a0-bca8-ddb5fbd2bed5 with scrape type 2
2026-03-27 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8315b0f-e112-57a0-bca8-ddb5fbd2bed5 with scrape type 2
2026-03-27 11:13:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8315b0f-e112-57a0-bca8-ddb5fbd2bed5, identifier: TL68554
2026-03-27 11:13:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8315b0f-e112-57a0-bca8-ddb5fbd2bed5 with identifier: TL68554
2026-03-27 11:13:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8315b0f-e112-57a0-bca8-ddb5fbd2bed5 with identifier: TL68554
2026-03-27 11:13:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8315b0f-e112-57a0-bca8-ddb5fbd2bed5 with identifier: TL68554 to the API
2026-03-27 11:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:26:21Z',
 'fuel_type': 'petrol',
 'id': 'a8315b0f-e112-57a0-bca8-ddb5fbd2bed5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL68554',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 50884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-27',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2020}
2026-03-27 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL68554%27 HTTP/1.1" 200 None
2026-03-27 11:13:28 [auto1.de] INFO: Saving data for TL68554: {'auction_closing_time': 1774628781.0, 'created_time': 1774521601.311613, 'last_price_update_time': 1774610008.975026}
2026-03-27 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL68554') HTTP/1.1" 204 0
2026-03-27 11:13:28 [auto1.de] INFO: Found listing with ID: VG51069
2026-03-27 11:13:28 [auto1.de] INFO: Found listing with ID: ZN20945
2026-03-27 11:13:28 [auto1.de] INFO: Found listing with ID: JV66840
2026-03-27 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV66840%27 HTTP/1.1" 200 None
2026-03-27 11:13:29 [auto1.de] INFO: Scrape type for JV66840: 2
2026-03-27 11:13:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f66e88fe-f417-571c-955a-d46ee92603db with identifier: JV66840
2026-03-27 11:13:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f66e88fe-f417-571c-955a-d46ee92603db with scrape type 2
2026-03-27 11:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f66e88fe-f417-571c-955a-d46ee92603db with scrape type 2
2026-03-27 11:13:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f66e88fe-f417-571c-955a-d46ee92603db, identifier: JV66840
2026-03-27 11:13:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f66e88fe-f417-571c-955a-d46ee92603db with identifier: JV66840
2026-03-27 11:13:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f66e88fe-f417-571c-955a-d46ee92603db with identifier: JV66840
2026-03-27 11:13:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f66e88fe-f417-571c-955a-d46ee92603db with identifier: JV66840 to the API
2026-03-27 11:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:14:11Z',
 'fuel_type': 'diesel',
 'id': 'f66e88fe-f417-571c-955a-d46ee92603db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV66840',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 78935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-05',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2019}
2026-03-27 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV66840%27 HTTP/1.1" 200 None
2026-03-27 11:13:29 [auto1.de] INFO: Saving data for JV66840: {'auction_closing_time': 1774628051.0, 'created_time': 1774521607.543785, 'last_price_update_time': 1774610009.437459}
2026-03-27 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV66840') HTTP/1.1" 204 0
2026-03-27 11:13:29 [auto1.de] INFO: Found listing with ID: UY88235
2026-03-27 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY88235%27 HTTP/1.1" 200 None
2026-03-27 11:13:29 [auto1.de] INFO: Scrape type for UY88235: 2
2026-03-27 11:13:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 764343d9-576f-5ee5-af1e-55c3fda02c1d with identifier: UY88235
2026-03-27 11:13:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 764343d9-576f-5ee5-af1e-55c3fda02c1d with scrape type 2
2026-03-27 11:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 764343d9-576f-5ee5-af1e-55c3fda02c1d with scrape type 2
2026-03-27 11:13:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 764343d9-576f-5ee5-af1e-55c3fda02c1d, identifier: UY88235
2026-03-27 11:13:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 764343d9-576f-5ee5-af1e-55c3fda02c1d with identifier: UY88235
2026-03-27 11:13:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 764343d9-576f-5ee5-af1e-55c3fda02c1d with identifier: UY88235
2026-03-27 11:13:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 764343d9-576f-5ee5-af1e-55c3fda02c1d with identifier: UY88235 to the API
2026-03-27 11:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:28:53Z',
 'fuel_type': 'diesel',
 'id': '764343d9-576f-5ee5-af1e-55c3fda02c1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY88235',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Carens',
 'odometer': 160406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-03',
 'seller_name': None,
 'title': 'Kia Carens 1.7 CRDi Dream Team',
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2017}
2026-03-27 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY88235%27 HTTP/1.1" 200 None
2026-03-27 11:13:29 [auto1.de] INFO: Saving data for UY88235: {'auction_closing_time': 1774628933.0, 'created_time': 1774521603.886496, 'last_price_update_time': 1774610009.939354}
2026-03-27 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY88235') HTTP/1.1" 204 0
2026-03-27 11:13:29 [auto1.de] INFO: Found listing with ID: MS83797
2026-03-27 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS83797%27 HTTP/1.1" 200 None
2026-03-27 11:13:29 [auto1.de] INFO: Scrape type for MS83797: 2
2026-03-27 11:13:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5096e04a-1eb3-5c5f-be0a-a09195bf10ba with identifier: MS83797
2026-03-27 11:13:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5096e04a-1eb3-5c5f-be0a-a09195bf10ba with scrape type 2
2026-03-27 11:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5096e04a-1eb3-5c5f-be0a-a09195bf10ba with scrape type 2
2026-03-27 11:13:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5096e04a-1eb3-5c5f-be0a-a09195bf10ba, identifier: MS83797
2026-03-27 11:13:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5096e04a-1eb3-5c5f-be0a-a09195bf10ba with identifier: MS83797
2026-03-27 11:13:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5096e04a-1eb3-5c5f-be0a-a09195bf10ba with identifier: MS83797
2026-03-27 11:13:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5096e04a-1eb3-5c5f-be0a-a09195bf10ba with identifier: MS83797 to the API
2026-03-27 11:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:48:58Z',
 'fuel_type': 'petrol',
 'id': '5096e04a-1eb3-5c5f-be0a-a09195bf10ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS83797',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 193019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-17',
 'seller_name': None,
 'title': 'Dacia Lodgy 1.2 TCe Stepway Celebration',
 'transmission': 'manual',
 'trim': 'Stepway Celebration',
 'year': 2017}
2026-03-27 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS83797%27 HTTP/1.1" 200 None
2026-03-27 11:13:30 [auto1.de] INFO: Saving data for MS83797: {'auction_closing_time': 1774630138.0, 'created_time': 1774521824.53306, 'last_price_update_time': 1774610010.420179}
2026-03-27 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS83797') HTTP/1.1" 204 0
2026-03-27 11:13:30 [auto1.de] INFO: Found listing with ID: SK26235
2026-03-27 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK26235%27 HTTP/1.1" 200 None
2026-03-27 11:13:30 [auto1.de] INFO: Scrape type for SK26235: 2
2026-03-27 11:13:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68b63d54-369e-5b20-9d4f-525c24598e29 with identifier: SK26235
2026-03-27 11:13:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68b63d54-369e-5b20-9d4f-525c24598e29 with scrape type 2
2026-03-27 11:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68b63d54-369e-5b20-9d4f-525c24598e29 with scrape type 2
2026-03-27 11:13:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68b63d54-369e-5b20-9d4f-525c24598e29, identifier: SK26235
2026-03-27 11:13:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68b63d54-369e-5b20-9d4f-525c24598e29 with identifier: SK26235
2026-03-27 11:13:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68b63d54-369e-5b20-9d4f-525c24598e29 with identifier: SK26235
2026-03-27 11:13:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68b63d54-369e-5b20-9d4f-525c24598e29 with identifier: SK26235 to the API
2026-03-27 11:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 45,
 'expiration_date': '2026-03-27T16:03:29Z',
 'fuel_type': 'electro',
 'id': '68b63d54-369e-5b20-9d4f-525c24598e29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK26235',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 28775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-28',
 'seller_name': None,
 'title': 'Dacia Spring electric drive 33 kW Essential',
 'transmission': 'automatic',
 'trim': 'Essential',
 'year': 2023}
2026-03-27 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK26235%27 HTTP/1.1" 200 None
2026-03-27 11:13:30 [auto1.de] INFO: Saving data for SK26235: {'auction_closing_time': 1774627409.0, 'created_time': 1773387352.734614, 'last_price_update_time': 1774610010.891332}
2026-03-27 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK26235') HTTP/1.1" 204 0
2026-03-27 11:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:13:30 [auto1.de] INFO: Found listing with ID: HT50639
2026-03-27 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT50639%27 HTTP/1.1" 200 None
2026-03-27 11:13:30 [auto1.de] INFO: Scrape type for HT50639: 2
2026-03-27 11:13:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4b369d5-2f5a-542d-b74c-040f2e62bd2c with identifier: HT50639
2026-03-27 11:13:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4b369d5-2f5a-542d-b74c-040f2e62bd2c with scrape type 2
2026-03-27 11:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4b369d5-2f5a-542d-b74c-040f2e62bd2c with scrape type 2
2026-03-27 11:13:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4b369d5-2f5a-542d-b74c-040f2e62bd2c, identifier: HT50639
2026-03-27 11:13:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4b369d5-2f5a-542d-b74c-040f2e62bd2c with identifier: HT50639
2026-03-27 11:13:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4b369d5-2f5a-542d-b74c-040f2e62bd2c with identifier: HT50639
2026-03-27 11:13:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4b369d5-2f5a-542d-b74c-040f2e62bd2c with identifier: HT50639 to the API
2026-03-27 11:13:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-27T16:48:01Z',
 'fuel_type': 'petrol',
 'id': 'b4b369d5-2f5a-542d-b74c-040f2e62bd2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT50639',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon Shooting Brake',
 'odometer': 24144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-10',
 'seller_name': None,
 'title': 'Volkswagen Arteon Shooting Brake 2.0 TSI R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2023}
2026-03-27 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT50639%27 HTTP/1.1" 200 None
2026-03-27 11:13:31 [auto1.de] INFO: Saving data for HT50639: {'auction_closing_time': 1774630081.0, 'created_time': 1774034265.605657, 'last_price_update_time': 1774610011.903381}
2026-03-27 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT50639') HTTP/1.1" 204 0
2026-03-27 11:13:31 [auto1.de] INFO: Found listing with ID: SE52552
2026-03-27 11:13:31 [auto1.de] INFO: Found listing with ID: MV88700
2026-03-27 11:13:31 [auto1.de] INFO: Found listing with ID: RB07232
2026-03-27 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB07232%27 HTTP/1.1" 200 None
2026-03-27 11:13:31 [auto1.de] INFO: Scrape type for RB07232: 2
2026-03-27 11:13:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1a5547c-b917-5bb5-8905-3d2d563be4fd with identifier: RB07232
2026-03-27 11:13:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1a5547c-b917-5bb5-8905-3d2d563be4fd with scrape type 2
2026-03-27 11:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1a5547c-b917-5bb5-8905-3d2d563be4fd with scrape type 2
2026-03-27 11:13:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1a5547c-b917-5bb5-8905-3d2d563be4fd, identifier: RB07232
2026-03-27 11:13:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1a5547c-b917-5bb5-8905-3d2d563be4fd with identifier: RB07232
2026-03-27 11:13:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1a5547c-b917-5bb5-8905-3d2d563be4fd with identifier: RB07232
2026-03-27 11:13:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1a5547c-b917-5bb5-8905-3d2d563be4fd with identifier: RB07232 to the API
2026-03-27 11:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-27T16:44:58Z',
 'fuel_type': 'diesel',
 'id': 'f1a5547c-b917-5bb5-8905-3d2d563be4fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB07232',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 44185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-03',
 'seller_name': None,
 'title': 'Audi A6 40 TDI Mild-Hybrid Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2023}
2026-03-27 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB07232%27 HTTP/1.1" 200 None
2026-03-27 11:13:32 [auto1.de] INFO: Saving data for RB07232: {'auction_closing_time': 1774629898.0, 'created_time': 1774032289.286593, 'last_price_update_time': 1774610012.522343}
2026-03-27 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB07232') HTTP/1.1" 204 0
2026-03-27 11:13:32 [auto1.de] INFO: Channel: 24h | Page: 246 | totalHits: 10677 | hits on page: 40
2026-03-27 11:13:32 [auto1.de] INFO: Found listing with ID: HK07166
2026-03-27 11:13:32 [auto1.de] INFO: Found listing with ID: FX40974
2026-03-27 11:13:32 [auto1.de] INFO: Found listing with ID: PY89525
2026-03-27 11:13:32 [auto1.de] INFO: Found listing with ID: JB79030
2026-03-27 11:13:32 [auto1.de] INFO: Found listing with ID: JR50197
2026-03-27 11:13:32 [auto1.de] INFO: Found listing with ID: HD47083
2026-03-27 11:13:32 [auto1.de] INFO: Found listing with ID: MN48527
2026-03-27 11:13:32 [auto1.de] INFO: Found listing with ID: AZ64153
2026-03-27 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ64153%27 HTTP/1.1" 200 None
2026-03-27 11:13:32 [auto1.de] INFO: Scrape type for AZ64153: 0
2026-03-27 11:13:32 [auto1.de] INFO: Found listing with ID: MU53820
2026-03-27 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU53820%27 HTTP/1.1" 200 None
2026-03-27 11:13:32 [auto1.de] INFO: Scrape type for MU53820: 2
2026-03-27 11:13:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3821cf1d-5878-5b4a-b36d-fb886f936bb5 with identifier: MU53820
2026-03-27 11:13:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3821cf1d-5878-5b4a-b36d-fb886f936bb5 with scrape type 2
2026-03-27 11:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3821cf1d-5878-5b4a-b36d-fb886f936bb5 with scrape type 2
2026-03-27 11:13:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3821cf1d-5878-5b4a-b36d-fb886f936bb5, identifier: MU53820
2026-03-27 11:13:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3821cf1d-5878-5b4a-b36d-fb886f936bb5 with identifier: MU53820
2026-03-27 11:13:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3821cf1d-5878-5b4a-b36d-fb886f936bb5 with identifier: MU53820
2026-03-27 11:13:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3821cf1d-5878-5b4a-b36d-fb886f936bb5 with identifier: MU53820 to the API
2026-03-27 11:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-27T16:11:35Z',
 'fuel_type': 'diesel',
 'id': '3821cf1d-5878-5b4a-b36d-fb886f936bb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU53820',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 142813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-03',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2019}
2026-03-27 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU53820%27 HTTP/1.1" 200 None
2026-03-27 11:13:33 [auto1.de] INFO: Saving data for MU53820: {'auction_closing_time': 1774627895.0, 'created_time': 1774521848.095377, 'last_price_update_time': 1774610013.36408}
2026-03-27 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU53820') HTTP/1.1" 204 0
2026-03-27 11:13:33 [auto1.de] INFO: Found listing with ID: EZ20386
2026-03-27 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ20386%27 HTTP/1.1" 200 None
2026-03-27 11:13:33 [auto1.de] INFO: Scrape type for EZ20386: 2
2026-03-27 11:13:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fee3655-c78c-5e2b-b30d-b07c1c7cace7 with identifier: EZ20386
2026-03-27 11:13:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fee3655-c78c-5e2b-b30d-b07c1c7cace7 with scrape type 2
2026-03-27 11:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fee3655-c78c-5e2b-b30d-b07c1c7cace7 with scrape type 2
2026-03-27 11:13:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fee3655-c78c-5e2b-b30d-b07c1c7cace7, identifier: EZ20386
2026-03-27 11:13:33 [auto1.de] INFO: Found listing with ID: LV93529
2026-03-27 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV93529%27 HTTP/1.1" 200 None
2026-03-27 11:13:33 [auto1.de] INFO: Scrape type for LV93529: 2
2026-03-27 11:13:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43184f3f-f371-5419-a62d-32e3bc25f1bb with identifier: LV93529
2026-03-27 11:13:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43184f3f-f371-5419-a62d-32e3bc25f1bb with scrape type 2
2026-03-27 11:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43184f3f-f371-5419-a62d-32e3bc25f1bb with scrape type 2
2026-03-27 11:13:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43184f3f-f371-5419-a62d-32e3bc25f1bb, identifier: LV93529
2026-03-27 11:13:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fee3655-c78c-5e2b-b30d-b07c1c7cace7 with identifier: EZ20386
2026-03-27 11:13:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fee3655-c78c-5e2b-b30d-b07c1c7cace7 with identifier: EZ20386
2026-03-27 11:13:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fee3655-c78c-5e2b-b30d-b07c1c7cace7 with identifier: EZ20386 to the API
2026-03-27 11:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-27T16:05:14Z',
 'fuel_type': 'petrol',
 'id': '0fee3655-c78c-5e2b-b30d-b07c1c7cace7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ20386',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 52526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-30',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2010}
2026-03-27 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ20386%27 HTTP/1.1" 200 None
2026-03-27 11:13:34 [auto1.de] INFO: Saving data for EZ20386: {'auction_closing_time': 1774627514.0, 'created_time': 1774521813.92987, 'last_price_update_time': 1774610014.017224}
2026-03-27 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ20386') HTTP/1.1" 204 0
2026-03-27 11:13:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:13:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43184f3f-f371-5419-a62d-32e3bc25f1bb with identifier: LV93529
2026-03-27 11:13:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43184f3f-f371-5419-a62d-32e3bc25f1bb with identifier: LV93529
2026-03-27 11:13:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43184f3f-f371-5419-a62d-32e3bc25f1bb with identifier: LV93529 to the API
2026-03-27 11:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-27T16:18:40Z',
 'fuel_type': 'petrol',
 'id': '43184f3f-f371-5419-a62d-32e3bc25f1bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV93529',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLC-Klasse',
 'odometer': 44203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-01',
 'seller_name': None,
 'title': 'Mercedes-Benz SLC-Klasse SLC 300 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-27 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV93529%27 HTTP/1.1" 200 None
2026-03-27 11:13:34 [auto1.de] INFO: Saving data for LV93529: {'auction_closing_time': 1774628320.0, 'created_time': 1774521671.36499, 'last_price_update_time': 1774610014.512917}
2026-03-27 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV93529') HTTP/1.1" 204 0
2026-03-27 11:13:34 [auto1.de] INFO: Found listing with ID: AF60989
2026-03-27 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF60989%27 HTTP/1.1" 200 None
2026-03-27 11:13:34 [auto1.de] INFO: Scrape type for AF60989: 2
2026-03-27 11:13:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af980481-d378-5c03-be28-d29468890c19 with identifier: AF60989
2026-03-27 11:13:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af980481-d378-5c03-be28-d29468890c19 with scrape type 2
2026-03-27 11:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af980481-d378-5c03-be28-d29468890c19 with scrape type 2
2026-03-27 11:13:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af980481-d378-5c03-be28-d29468890c19, identifier: AF60989
2026-03-27 11:13:34 [auto1.de] INFO: Found listing with ID: AU30632
2026-03-27 11:13:34 [auto1.de] INFO: Found listing with ID: EM39798
2026-03-27 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM39798%27 HTTP/1.1" 200 None
2026-03-27 11:13:34 [auto1.de] INFO: Scrape type for EM39798: 2
2026-03-27 11:13:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40c3e429-f056-56c4-a65a-eac1e75c02d7 with identifier: EM39798
2026-03-27 11:13:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40c3e429-f056-56c4-a65a-eac1e75c02d7 with scrape type 2
2026-03-27 11:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40c3e429-f056-56c4-a65a-eac1e75c02d7 with scrape type 2
2026-03-27 11:13:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40c3e429-f056-56c4-a65a-eac1e75c02d7, identifier: EM39798
2026-03-27 11:13:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af980481-d378-5c03-be28-d29468890c19 with identifier: AF60989
2026-03-27 11:13:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af980481-d378-5c03-be28-d29468890c19 with identifier: AF60989
2026-03-27 11:13:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af980481-d378-5c03-be28-d29468890c19 with identifier: AF60989 to the API
2026-03-27 11:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-27T16:57:34Z',
 'fuel_type': 'petrol',
 'id': 'af980481-d378-5c03-be28-d29468890c19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF60989',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 153751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-29',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2009}
2026-03-27 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF60989%27 HTTP/1.1" 200 None
2026-03-27 11:13:35 [auto1.de] INFO: Saving data for AF60989: {'auction_closing_time': 1774630654.0, 'created_time': 1774381443.384115, 'last_price_update_time': 1774610015.105188}
2026-03-27 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF60989') HTTP/1.1" 204 0
2026-03-27 11:13:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40c3e429-f056-56c4-a65a-eac1e75c02d7 with identifier: EM39798
2026-03-27 11:13:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40c3e429-f056-56c4-a65a-eac1e75c02d7 with identifier: EM39798
2026-03-27 11:13:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40c3e429-f056-56c4-a65a-eac1e75c02d7 with identifier: EM39798 to the API
2026-03-27 11:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:18:34Z',
 'fuel_type': 'diesel',
 'id': '40c3e429-f056-56c4-a65a-eac1e75c02d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM39798',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 81713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-20',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2023}
2026-03-27 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM39798%27 HTTP/1.1" 200 None
2026-03-27 11:13:35 [auto1.de] INFO: Saving data for EM39798: {'auction_closing_time': 1774628314.0, 'created_time': 1774263590.717959, 'last_price_update_time': 1774610015.393926}
2026-03-27 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM39798') HTTP/1.1" 204 0
2026-03-27 11:13:35 [auto1.de] INFO: Found listing with ID: XF22574
2026-03-27 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF22574%27 HTTP/1.1" 200 None
2026-03-27 11:13:35 [auto1.de] INFO: Scrape type for XF22574: 2
2026-03-27 11:13:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c633f4c-27dc-55c4-9705-aadb87489ba9 with identifier: XF22574
2026-03-27 11:13:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c633f4c-27dc-55c4-9705-aadb87489ba9 with scrape type 2
2026-03-27 11:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c633f4c-27dc-55c4-9705-aadb87489ba9 with scrape type 2
2026-03-27 11:13:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c633f4c-27dc-55c4-9705-aadb87489ba9, identifier: XF22574
2026-03-27 11:13:35 [auto1.de] INFO: Found listing with ID: XS49738
2026-03-27 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS49738%27 HTTP/1.1" 200 None
2026-03-27 11:13:35 [auto1.de] INFO: Scrape type for XS49738: 0
2026-03-27 11:13:35 [auto1.de] INFO: Found listing with ID: VP72018
2026-03-27 11:13:35 [auto1.de] INFO: Found listing with ID: UM60373
2026-03-27 11:13:35 [auto1.de] INFO: Found listing with ID: ZA36637
2026-03-27 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA36637%27 HTTP/1.1" 200 None
2026-03-27 11:13:35 [auto1.de] INFO: Scrape type for ZA36637: 2
2026-03-27 11:13:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ddb2ac9-a5bb-5fc0-aec6-3df966636436 with identifier: ZA36637
2026-03-27 11:13:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ddb2ac9-a5bb-5fc0-aec6-3df966636436 with scrape type 2
2026-03-27 11:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ddb2ac9-a5bb-5fc0-aec6-3df966636436 with scrape type 2
2026-03-27 11:13:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ddb2ac9-a5bb-5fc0-aec6-3df966636436, identifier: ZA36637
2026-03-27 11:13:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c633f4c-27dc-55c4-9705-aadb87489ba9 with identifier: XF22574
2026-03-27 11:13:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c633f4c-27dc-55c4-9705-aadb87489ba9 with identifier: XF22574
2026-03-27 11:13:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c633f4c-27dc-55c4-9705-aadb87489ba9 with identifier: XF22574 to the API
2026-03-27 11:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:13:30Z',
 'fuel_type': 'petrol',
 'id': '0c633f4c-27dc-55c4-9705-aadb87489ba9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF22574',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 171561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-21',
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-03-27 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF22574%27 HTTP/1.1" 200 None
2026-03-27 11:13:35 [auto1.de] INFO: Saving data for XF22574: {'auction_closing_time': 1774628010.0, 'created_time': 1774521734.102301, 'last_price_update_time': 1774610015.98534}
2026-03-27 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF22574') HTTP/1.1" 204 0
2026-03-27 11:13:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ddb2ac9-a5bb-5fc0-aec6-3df966636436 with identifier: ZA36637
2026-03-27 11:13:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ddb2ac9-a5bb-5fc0-aec6-3df966636436 with identifier: ZA36637
2026-03-27 11:13:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ddb2ac9-a5bb-5fc0-aec6-3df966636436 with identifier: ZA36637 to the API
2026-03-27 11:13:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:48:58Z',
 'fuel_type': 'petrol',
 'id': '4ddb2ac9-a5bb-5fc0-aec6-3df966636436',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA36637',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 102358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-23',
 'seller_name': None,
 'title': 'Seat Tarraco 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2023}
2026-03-27 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA36637%27 HTTP/1.1" 200 None
2026-03-27 11:13:36 [auto1.de] INFO: Saving data for ZA36637: {'auction_closing_time': 1774630138.0, 'created_time': 1774032085.713049, 'last_price_update_time': 1774610016.364601}
2026-03-27 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA36637') HTTP/1.1" 204 0
2026-03-27 11:13:36 [auto1.de] INFO: Found listing with ID: BP60521
2026-03-27 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP60521%27 HTTP/1.1" 200 None
2026-03-27 11:13:36 [auto1.de] INFO: Scrape type for BP60521: 2
2026-03-27 11:13:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5c1cf87-dd32-5a99-b4cf-523710b19edd with identifier: BP60521
2026-03-27 11:13:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5c1cf87-dd32-5a99-b4cf-523710b19edd with scrape type 2
2026-03-27 11:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5c1cf87-dd32-5a99-b4cf-523710b19edd with scrape type 2
2026-03-27 11:13:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5c1cf87-dd32-5a99-b4cf-523710b19edd, identifier: BP60521
2026-03-27 11:13:36 [auto1.de] INFO: Found listing with ID: DM83834
2026-03-27 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM83834%27 HTTP/1.1" 200 None
2026-03-27 11:13:36 [auto1.de] INFO: Scrape type for DM83834: 0
2026-03-27 11:13:36 [auto1.de] INFO: Found listing with ID: PU44541
2026-03-27 11:13:36 [auto1.de] INFO: Found listing with ID: ST98155
2026-03-27 11:13:36 [auto1.de] INFO: Found listing with ID: TU78427
2026-03-27 11:13:36 [auto1.de] INFO: Found listing with ID: CZ43959
2026-03-27 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ43959%27 HTTP/1.1" 200 None
2026-03-27 11:13:36 [auto1.de] INFO: Scrape type for CZ43959: 2
2026-03-27 11:13:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1acbf564-1dcf-5245-8784-69027b5e814e with identifier: CZ43959
2026-03-27 11:13:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1acbf564-1dcf-5245-8784-69027b5e814e with scrape type 2
2026-03-27 11:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1acbf564-1dcf-5245-8784-69027b5e814e with scrape type 2
2026-03-27 11:13:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1acbf564-1dcf-5245-8784-69027b5e814e, identifier: CZ43959
2026-03-27 11:13:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5c1cf87-dd32-5a99-b4cf-523710b19edd with identifier: BP60521
2026-03-27 11:13:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5c1cf87-dd32-5a99-b4cf-523710b19edd with identifier: BP60521
2026-03-27 11:13:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5c1cf87-dd32-5a99-b4cf-523710b19edd with identifier: BP60521 to the API
2026-03-27 11:13:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-27T16:06:01Z',
 'fuel_type': 'gas',
 'id': 'e5c1cf87-dd32-5a99-b4cf-523710b19edd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP60521',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 3173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-25',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Stepway Expression +',
 'transmission': 'manual',
 'trim': 'Stepway Expression +',
 'year': 2023}
2026-03-27 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP60521%27 HTTP/1.1" 200 None
2026-03-27 11:13:36 [auto1.de] INFO: Saving data for BP60521: {'auction_closing_time': 1774627561.0, 'created_time': 1773387353.576135, 'last_price_update_time': 1774610016.948557}
2026-03-27 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP60521') HTTP/1.1" 204 0
2026-03-27 11:13:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1acbf564-1dcf-5245-8784-69027b5e814e with identifier: CZ43959
2026-03-27 11:13:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1acbf564-1dcf-5245-8784-69027b5e814e with identifier: CZ43959
2026-03-27 11:13:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1acbf564-1dcf-5245-8784-69027b5e814e with identifier: CZ43959 to the API
2026-03-27 11:13:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-27T16:05:53Z',
 'fuel_type': 'petrol',
 'id': '1acbf564-1dcf-5245-8784-69027b5e814e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ43959',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 53025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2024}
2026-03-27 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ43959%27 HTTP/1.1" 200 None
2026-03-27 11:13:37 [auto1.de] INFO: Saving data for CZ43959: {'auction_closing_time': 1774627553.0, 'created_time': 1774034422.889041, 'last_price_update_time': 1774610017.372572}
2026-03-27 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ43959') HTTP/1.1" 204 0
2026-03-27 11:13:37 [auto1.de] INFO: Found listing with ID: UM76387
2026-03-27 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM76387%27 HTTP/1.1" 200 None
2026-03-27 11:13:37 [auto1.de] INFO: Scrape type for UM76387: 2
2026-03-27 11:13:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39993884-77f1-5ea7-8c9c-06743626dbd5 with identifier: UM76387
2026-03-27 11:13:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39993884-77f1-5ea7-8c9c-06743626dbd5 with scrape type 2
2026-03-27 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39993884-77f1-5ea7-8c9c-06743626dbd5 with scrape type 2
2026-03-27 11:13:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39993884-77f1-5ea7-8c9c-06743626dbd5, identifier: UM76387
2026-03-27 11:13:37 [auto1.de] INFO: Found listing with ID: EW61653
2026-03-27 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW61653%27 HTTP/1.1" 200 None
2026-03-27 11:13:37 [auto1.de] INFO: Scrape type for EW61653: 2
2026-03-27 11:13:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c96a514b-6a29-5ee1-977b-2850b750b1d8 with identifier: EW61653
2026-03-27 11:13:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c96a514b-6a29-5ee1-977b-2850b750b1d8 with scrape type 2
2026-03-27 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c96a514b-6a29-5ee1-977b-2850b750b1d8 with scrape type 2
2026-03-27 11:13:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c96a514b-6a29-5ee1-977b-2850b750b1d8, identifier: EW61653
2026-03-27 11:13:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39993884-77f1-5ea7-8c9c-06743626dbd5 with identifier: UM76387
2026-03-27 11:13:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39993884-77f1-5ea7-8c9c-06743626dbd5 with identifier: UM76387
2026-03-27 11:13:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39993884-77f1-5ea7-8c9c-06743626dbd5 with identifier: UM76387 to the API
2026-03-27 11:13:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:36:37Z',
 'fuel_type': 'petrol',
 'id': '39993884-77f1-5ea7-8c9c-06743626dbd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM76387',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 111804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-20',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-27 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM76387%27 HTTP/1.1" 200 None
2026-03-27 11:13:38 [auto1.de] INFO: Saving data for UM76387: {'auction_closing_time': 1774629397.0, 'created_time': 1773225802.036576, 'last_price_update_time': 1774610018.001082}
2026-03-27 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM76387') HTTP/1.1" 204 0
2026-03-27 11:13:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c96a514b-6a29-5ee1-977b-2850b750b1d8 with identifier: EW61653
2026-03-27 11:13:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c96a514b-6a29-5ee1-977b-2850b750b1d8 with identifier: EW61653
2026-03-27 11:13:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c96a514b-6a29-5ee1-977b-2850b750b1d8 with identifier: EW61653 to the API
2026-03-27 11:13:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-27T16:23:52Z',
 'fuel_type': 'petrol',
 'id': 'c96a514b-6a29-5ee1-977b-2850b750b1d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW61653',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 46090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-16',
 'seller_name': None,
 'title': 'Audi A6 45 TFSI Mild-Hybrid quattro Design',
 'transmission': 'automatic',
 'trim': 'quattro Design',
 'year': 2022}
2026-03-27 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW61653%27 HTTP/1.1" 200 None
2026-03-27 11:13:38 [auto1.de] INFO: Saving data for EW61653: {'auction_closing_time': 1774628632.0, 'created_time': 1774032702.589182, 'last_price_update_time': 1774610018.333796}
2026-03-27 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW61653') HTTP/1.1" 204 0
2026-03-27 11:13:38 [auto1.de] INFO: Found listing with ID: PX80115
2026-03-27 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX80115%27 HTTP/1.1" 200 None
2026-03-27 11:13:38 [auto1.de] INFO: Scrape type for PX80115: 2
2026-03-27 11:13:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7611aa3f-9b4b-59d1-8b74-402dac8441ea with identifier: PX80115
2026-03-27 11:13:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7611aa3f-9b4b-59d1-8b74-402dac8441ea with scrape type 2
2026-03-27 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7611aa3f-9b4b-59d1-8b74-402dac8441ea with scrape type 2
2026-03-27 11:13:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7611aa3f-9b4b-59d1-8b74-402dac8441ea, identifier: PX80115
2026-03-27 11:13:38 [auto1.de] INFO: Found listing with ID: HR35994
2026-03-27 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR35994%27 HTTP/1.1" 200 None
2026-03-27 11:13:38 [auto1.de] INFO: Scrape type for HR35994: 2
2026-03-27 11:13:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b40d53c6-0fac-5c73-b6dd-a139b84b870c with identifier: HR35994
2026-03-27 11:13:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b40d53c6-0fac-5c73-b6dd-a139b84b870c with scrape type 2
2026-03-27 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b40d53c6-0fac-5c73-b6dd-a139b84b870c with scrape type 2
2026-03-27 11:13:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b40d53c6-0fac-5c73-b6dd-a139b84b870c, identifier: HR35994
2026-03-27 11:13:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7611aa3f-9b4b-59d1-8b74-402dac8441ea with identifier: PX80115
2026-03-27 11:13:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7611aa3f-9b4b-59d1-8b74-402dac8441ea with identifier: PX80115
2026-03-27 11:13:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7611aa3f-9b4b-59d1-8b74-402dac8441ea with identifier: PX80115 to the API
2026-03-27 11:13:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-27T16:26:47Z',
 'fuel_type': 'petrol',
 'id': '7611aa3f-9b4b-59d1-8b74-402dac8441ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX80115',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Splash',
 'odometer': 33272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-06',
 'seller_name': None,
 'title': 'Suzuki Splash 1.2 Club',
 'transmission': 'automatic',
 'trim': 'Club',
 'year': 2012}
2026-03-27 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX80115%27 HTTP/1.1" 200 None
2026-03-27 11:13:38 [auto1.de] INFO: Saving data for PX80115: {'auction_closing_time': 1774628807.0, 'created_time': 1774521690.849647, 'last_price_update_time': 1774610018.868227}
2026-03-27 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX80115') HTTP/1.1" 204 0
2026-03-27 11:13:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b40d53c6-0fac-5c73-b6dd-a139b84b870c with identifier: HR35994
2026-03-27 11:13:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b40d53c6-0fac-5c73-b6dd-a139b84b870c with identifier: HR35994
2026-03-27 11:13:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b40d53c6-0fac-5c73-b6dd-a139b84b870c with identifier: HR35994 to the API
2026-03-27 11:13:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-27T16:23:45Z',
 'fuel_type': 'petrol',
 'id': 'b40d53c6-0fac-5c73-b6dd-a139b84b870c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR35994',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S3',
 'odometer': 12202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-20',
 'seller_name': None,
 'title': 'Audi S3 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2025}
2026-03-27 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR35994%27 HTTP/1.1" 200 None
2026-03-27 11:13:39 [auto1.de] INFO: Saving data for HR35994: {'auction_closing_time': 1774628625.0, 'created_time': 1774032567.946426, 'last_price_update_time': 1774610019.266167}
2026-03-27 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR35994') HTTP/1.1" 204 0
2026-03-27 11:13:39 [auto1.de] INFO: Found listing with ID: RZ07739
2026-03-27 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ07739%27 HTTP/1.1" 200 None
2026-03-27 11:13:39 [auto1.de] INFO: Scrape type for RZ07739: 2
2026-03-27 11:13:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73225278-d1dc-55fc-855c-ef4139203fff with identifier: RZ07739
2026-03-27 11:13:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73225278-d1dc-55fc-855c-ef4139203fff with scrape type 2
2026-03-27 11:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73225278-d1dc-55fc-855c-ef4139203fff with scrape type 2
2026-03-27 11:13:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73225278-d1dc-55fc-855c-ef4139203fff, identifier: RZ07739
2026-03-27 11:13:39 [auto1.de] INFO: Found listing with ID: EZ20386
2026-03-27 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ20386%27 HTTP/1.1" 200 None
2026-03-27 11:13:39 [auto1.de] INFO: Scrape type for EZ20386: 0
2026-03-27 11:13:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73225278-d1dc-55fc-855c-ef4139203fff with identifier: RZ07739
2026-03-27 11:13:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73225278-d1dc-55fc-855c-ef4139203fff with identifier: RZ07739
2026-03-27 11:13:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73225278-d1dc-55fc-855c-ef4139203fff with identifier: RZ07739 to the API
2026-03-27 11:13:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:04:08Z',
 'fuel_type': 'petrol',
 'id': '73225278-d1dc-55fc-855c-ef4139203fff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ07739',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 32658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seller_name': None,
 'title': 'Fiat 500C 1.0 Mild-Hybrid Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2021}
2026-03-27 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ07739%27 HTTP/1.1" 200 None
2026-03-27 11:13:39 [auto1.de] INFO: Saving data for RZ07739: {'auction_closing_time': 1774627448.0, 'created_time': 1774521673.859668, 'last_price_update_time': 1774610019.765332}
2026-03-27 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ07739') HTTP/1.1" 204 0
2026-03-27 11:13:39 [auto1.de] INFO: Found listing with ID: FW21815
2026-03-27 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW21815%27 HTTP/1.1" 200 None
2026-03-27 11:13:39 [auto1.de] INFO: Scrape type for FW21815: 2
2026-03-27 11:13:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89a91f52-5516-5b00-b7fd-fb08af19f848 with identifier: FW21815
2026-03-27 11:13:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89a91f52-5516-5b00-b7fd-fb08af19f848 with scrape type 2
2026-03-27 11:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89a91f52-5516-5b00-b7fd-fb08af19f848 with scrape type 2
2026-03-27 11:13:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89a91f52-5516-5b00-b7fd-fb08af19f848, identifier: FW21815
2026-03-27 11:13:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89a91f52-5516-5b00-b7fd-fb08af19f848 with identifier: FW21815
2026-03-27 11:13:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89a91f52-5516-5b00-b7fd-fb08af19f848 with identifier: FW21815
2026-03-27 11:13:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89a91f52-5516-5b00-b7fd-fb08af19f848 with identifier: FW21815 to the API
2026-03-27 11:13:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-27T16:24:34Z',
 'fuel_type': 'petrol',
 'id': '89a91f52-5516-5b00-b7fd-fb08af19f848',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW21815',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 84370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-15',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2018}
2026-03-27 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW21815%27 HTTP/1.1" 200 None
2026-03-27 11:13:40 [auto1.de] INFO: Saving data for FW21815: {'auction_closing_time': 1774628674.0, 'created_time': 1772542547.703106, 'last_price_update_time': 1774610020.209149}
2026-03-27 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW21815') HTTP/1.1" 204 0
2026-03-27 11:13:40 [auto1.de] INFO: Found listing with ID: SA50642
2026-03-27 11:13:40 [auto1.de] INFO: Found listing with ID: KZ16276
2026-03-27 11:13:40 [auto1.de] INFO: Found listing with ID: NX11654
2026-03-27 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX11654%27 HTTP/1.1" 200 None
2026-03-27 11:13:40 [auto1.de] INFO: Scrape type for NX11654: 2
2026-03-27 11:13:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cca1ef19-49de-5742-80fb-7d131cbfc052 with identifier: NX11654
2026-03-27 11:13:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cca1ef19-49de-5742-80fb-7d131cbfc052 with scrape type 2
2026-03-27 11:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cca1ef19-49de-5742-80fb-7d131cbfc052 with scrape type 2
2026-03-27 11:13:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cca1ef19-49de-5742-80fb-7d131cbfc052, identifier: NX11654
2026-03-27 11:13:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cca1ef19-49de-5742-80fb-7d131cbfc052 with identifier: NX11654
2026-03-27 11:13:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cca1ef19-49de-5742-80fb-7d131cbfc052 with identifier: NX11654
2026-03-27 11:13:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cca1ef19-49de-5742-80fb-7d131cbfc052 with identifier: NX11654 to the API
2026-03-27 11:13:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:13:02Z',
 'fuel_type': 'diesel',
 'id': 'cca1ef19-49de-5742-80fb-7d131cbfc052',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX11654',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 63587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-26',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2022}
2026-03-27 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX11654%27 HTTP/1.1" 200 None
2026-03-27 11:13:40 [auto1.de] INFO: Saving data for NX11654: {'auction_closing_time': 1774627982.0, 'created_time': 1774032528.587006, 'last_price_update_time': 1774610020.672018}
2026-03-27 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX11654') HTTP/1.1" 204 0
2026-03-27 11:13:40 [auto1.de] INFO: Found listing with ID: BY17285
2026-03-27 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY17285%27 HTTP/1.1" 200 None
2026-03-27 11:13:40 [auto1.de] INFO: Scrape type for BY17285: 2
2026-03-27 11:13:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0233dd4f-45f8-5bd7-8747-27fd1b6ea2f3 with identifier: BY17285
2026-03-27 11:13:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0233dd4f-45f8-5bd7-8747-27fd1b6ea2f3 with scrape type 2
2026-03-27 11:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0233dd4f-45f8-5bd7-8747-27fd1b6ea2f3 with scrape type 2
2026-03-27 11:13:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0233dd4f-45f8-5bd7-8747-27fd1b6ea2f3, identifier: BY17285
2026-03-27 11:13:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0233dd4f-45f8-5bd7-8747-27fd1b6ea2f3 with identifier: BY17285
2026-03-27 11:13:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0233dd4f-45f8-5bd7-8747-27fd1b6ea2f3 with identifier: BY17285
2026-03-27 11:13:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0233dd4f-45f8-5bd7-8747-27fd1b6ea2f3 with identifier: BY17285 to the API
2026-03-27 11:13:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-27T16:41:20Z',
 'fuel_type': 'hybrid',
 'id': '0233dd4f-45f8-5bd7-8747-27fd1b6ea2f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY17285',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 71502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-16',
 'seller_name': None,
 'title': 'Audi Q5 50 TFSIe quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2023}
2026-03-27 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY17285%27 HTTP/1.1" 200 None
2026-03-27 11:13:41 [auto1.de] INFO: Saving data for BY17285: {'auction_closing_time': 1774629680.0, 'created_time': 1774033520.66671, 'last_price_update_time': 1774610021.136292}
2026-03-27 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY17285') HTTP/1.1" 204 0
2026-03-27 11:13:41 [auto1.de] INFO: Found listing with ID: KZ12060
2026-03-27 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ12060%27 HTTP/1.1" 200 None
2026-03-27 11:13:41 [auto1.de] INFO: Scrape type for KZ12060: 2
2026-03-27 11:13:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02cb47ea-50c6-5fc0-bb6d-e8839e731cbc with identifier: KZ12060
2026-03-27 11:13:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02cb47ea-50c6-5fc0-bb6d-e8839e731cbc with scrape type 2
2026-03-27 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02cb47ea-50c6-5fc0-bb6d-e8839e731cbc with scrape type 2
2026-03-27 11:13:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02cb47ea-50c6-5fc0-bb6d-e8839e731cbc, identifier: KZ12060
2026-03-27 11:13:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02cb47ea-50c6-5fc0-bb6d-e8839e731cbc with identifier: KZ12060
2026-03-27 11:13:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02cb47ea-50c6-5fc0-bb6d-e8839e731cbc with identifier: KZ12060
2026-03-27 11:13:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02cb47ea-50c6-5fc0-bb6d-e8839e731cbc with identifier: KZ12060 to the API
2026-03-27 11:13:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-27T16:08:10Z',
 'fuel_type': 'petrol',
 'id': '02cb47ea-50c6-5fc0-bb6d-e8839e731cbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ12060',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 12622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-03',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-03-27 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ12060%27 HTTP/1.1" 200 None
2026-03-27 11:13:41 [auto1.de] INFO: Saving data for KZ12060: {'auction_closing_time': 1774627690.0, 'created_time': 1774263282.431658, 'last_price_update_time': 1774610021.695408}
2026-03-27 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ12060') HTTP/1.1" 204 0
2026-03-27 11:13:41 [auto1.de] INFO: Found listing with ID: DE74854
2026-03-27 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE74854%27 HTTP/1.1" 200 None
2026-03-27 11:13:41 [auto1.de] INFO: Scrape type for DE74854: 2
2026-03-27 11:13:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88671118-0c73-5ae9-b9ac-0139b551a669 with identifier: DE74854
2026-03-27 11:13:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88671118-0c73-5ae9-b9ac-0139b551a669 with scrape type 2
2026-03-27 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88671118-0c73-5ae9-b9ac-0139b551a669 with scrape type 2
2026-03-27 11:13:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88671118-0c73-5ae9-b9ac-0139b551a669, identifier: DE74854
2026-03-27 11:13:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88671118-0c73-5ae9-b9ac-0139b551a669 with identifier: DE74854
2026-03-27 11:13:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88671118-0c73-5ae9-b9ac-0139b551a669 with identifier: DE74854
2026-03-27 11:13:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88671118-0c73-5ae9-b9ac-0139b551a669 with identifier: DE74854 to the API
2026-03-27 11:13:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:55:30Z',
 'fuel_type': 'petrol',
 'id': '88671118-0c73-5ae9-b9ac-0139b551a669',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE74854',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 55501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.0 TSI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2022}
2026-03-27 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE74854%27 HTTP/1.1" 200 None
2026-03-27 11:13:42 [auto1.de] INFO: Saving data for DE74854: {'auction_closing_time': 1774630530.0, 'created_time': 1774034421.823611, 'last_price_update_time': 1774610022.160226}
2026-03-27 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE74854') HTTP/1.1" 204 0
2026-03-27 11:13:42 [auto1.de] INFO: Found listing with ID: NG65522
2026-03-27 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG65522%27 HTTP/1.1" 200 None
2026-03-27 11:13:42 [auto1.de] INFO: Scrape type for NG65522: 2
2026-03-27 11:13:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 864d583d-b3b3-5fd5-a8a3-51bb3a191959 with identifier: NG65522
2026-03-27 11:13:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 864d583d-b3b3-5fd5-a8a3-51bb3a191959 with scrape type 2
2026-03-27 11:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 864d583d-b3b3-5fd5-a8a3-51bb3a191959 with scrape type 2
2026-03-27 11:13:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 864d583d-b3b3-5fd5-a8a3-51bb3a191959, identifier: NG65522
2026-03-27 11:13:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 864d583d-b3b3-5fd5-a8a3-51bb3a191959 with identifier: NG65522
2026-03-27 11:13:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 864d583d-b3b3-5fd5-a8a3-51bb3a191959 with identifier: NG65522
2026-03-27 11:13:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 864d583d-b3b3-5fd5-a8a3-51bb3a191959 with identifier: NG65522 to the API
2026-03-27 11:13:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-27T16:36:56Z',
 'fuel_type': 'diesel',
 'id': '864d583d-b3b3-5fd5-a8a3-51bb3a191959',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG65522',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 37393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-06',
 'seller_name': None,
 'title': 'Audi A4 40 TDI Mild-Hybrid advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2022}
2026-03-27 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG65522%27 HTTP/1.1" 200 None
2026-03-27 11:13:42 [auto1.de] INFO: Saving data for NG65522: {'auction_closing_time': 1774629416.0, 'created_time': 1774034189.748667, 'last_price_update_time': 1774610022.600123}
2026-03-27 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG65522') HTTP/1.1" 204 0
2026-03-27 11:13:42 [auto1.de] INFO: Found listing with ID: ZB59934
2026-03-27 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB59934%27 HTTP/1.1" 200 None
2026-03-27 11:13:42 [auto1.de] INFO: Scrape type for ZB59934: 2
2026-03-27 11:13:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 941389e8-05d9-550e-b351-8fed75360bb8 with identifier: ZB59934
2026-03-27 11:13:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 941389e8-05d9-550e-b351-8fed75360bb8 with scrape type 2
2026-03-27 11:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 941389e8-05d9-550e-b351-8fed75360bb8 with scrape type 2
2026-03-27 11:13:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 941389e8-05d9-550e-b351-8fed75360bb8, identifier: ZB59934
2026-03-27 11:13:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 941389e8-05d9-550e-b351-8fed75360bb8 with identifier: ZB59934
2026-03-27 11:13:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 941389e8-05d9-550e-b351-8fed75360bb8 with identifier: ZB59934
2026-03-27 11:13:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 941389e8-05d9-550e-b351-8fed75360bb8 with identifier: ZB59934 to the API
2026-03-27 11:13:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-27T16:09:14Z',
 'fuel_type': 'petrol',
 'id': '941389e8-05d9-550e-b351-8fed75360bb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB59934',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595',
 'odometer': 73492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-26',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Competizione',
 'transmission': 'manual',
 'trim': 'Competizione',
 'year': 2019}
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB59934%27 HTTP/1.1" 200 None
2026-03-27 11:13:43 [auto1.de] INFO: Saving data for ZB59934: {'auction_closing_time': 1774627754.0, 'created_time': 1774521943.580163, 'last_price_update_time': 1774610023.047393}
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB59934') HTTP/1.1" 204 0
2026-03-27 11:13:43 [auto1.de] INFO: Found listing with ID: MH00339
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH00339%27 HTTP/1.1" 200 None
2026-03-27 11:13:43 [auto1.de] INFO: Scrape type for MH00339: 2
2026-03-27 11:13:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d66e78f4-0e59-527a-a8ef-caa0455a3d8a with identifier: MH00339
2026-03-27 11:13:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d66e78f4-0e59-527a-a8ef-caa0455a3d8a with scrape type 2
2026-03-27 11:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d66e78f4-0e59-527a-a8ef-caa0455a3d8a with scrape type 2
2026-03-27 11:13:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d66e78f4-0e59-527a-a8ef-caa0455a3d8a, identifier: MH00339
2026-03-27 11:13:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d66e78f4-0e59-527a-a8ef-caa0455a3d8a with identifier: MH00339
2026-03-27 11:13:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d66e78f4-0e59-527a-a8ef-caa0455a3d8a with identifier: MH00339
2026-03-27 11:13:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d66e78f4-0e59-527a-a8ef-caa0455a3d8a with identifier: MH00339 to the API
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:51:31Z',
 'fuel_type': 'electro',
 'id': 'd66e78f4-0e59-527a-a8ef-caa0455a3d8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH00339',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 60318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-18',
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 110 kW City Pure Performance',
 'transmission': 'automatic',
 'trim': 'City Pure Performance',
 'year': 2021}
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH00339%27 HTTP/1.1" 200 None
2026-03-27 11:13:43 [auto1.de] INFO: Saving data for MH00339: {'auction_closing_time': 1774630291.0, 'created_time': 1774033949.108333, 'last_price_update_time': 1774610023.45846}
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH00339') HTTP/1.1" 204 0
2026-03-27 11:13:43 [auto1.de] INFO: Found listing with ID: JK23522
2026-03-27 11:13:43 [auto1.de] INFO: Found listing with ID: KC92999
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC92999%27 HTTP/1.1" 200 None
2026-03-27 11:13:43 [auto1.de] INFO: Scrape type for KC92999: 2
2026-03-27 11:13:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e3bb2b6-2ff1-55d0-af94-b68b3850b7d5 with identifier: KC92999
2026-03-27 11:13:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e3bb2b6-2ff1-55d0-af94-b68b3850b7d5 with scrape type 2
2026-03-27 11:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e3bb2b6-2ff1-55d0-af94-b68b3850b7d5 with scrape type 2
2026-03-27 11:13:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e3bb2b6-2ff1-55d0-af94-b68b3850b7d5, identifier: KC92999
2026-03-27 11:13:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e3bb2b6-2ff1-55d0-af94-b68b3850b7d5 with identifier: KC92999
2026-03-27 11:13:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e3bb2b6-2ff1-55d0-af94-b68b3850b7d5 with identifier: KC92999
2026-03-27 11:13:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e3bb2b6-2ff1-55d0-af94-b68b3850b7d5 with identifier: KC92999 to the API
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:59:16Z',
 'fuel_type': 'petrol',
 'id': '5e3bb2b6-2ff1-55d0-af94-b68b3850b7d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC92999',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 10156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-01',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Xperience',
 'transmission': 'automatic',
 'trim': 'Xperience',
 'year': 2023}
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC92999%27 HTTP/1.1" 200 None
2026-03-27 11:13:43 [auto1.de] INFO: Saving data for KC92999: {'auction_closing_time': 1774630756.0, 'created_time': 1774031999.608747, 'last_price_update_time': 1774610023.886198}
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC92999') HTTP/1.1" 204 0
2026-03-27 11:13:43 [auto1.de] INFO: Found listing with ID: MZ53691
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ53691%27 HTTP/1.1" 200 None
2026-03-27 11:13:43 [auto1.de] INFO: Scrape type for MZ53691: 2
2026-03-27 11:13:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7ac4162-4fb2-57ee-b0c0-16870f4c5f23 with identifier: MZ53691
2026-03-27 11:13:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7ac4162-4fb2-57ee-b0c0-16870f4c5f23 with scrape type 2
2026-03-27 11:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7ac4162-4fb2-57ee-b0c0-16870f4c5f23 with scrape type 2
2026-03-27 11:13:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7ac4162-4fb2-57ee-b0c0-16870f4c5f23, identifier: MZ53691
2026-03-27 11:13:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7ac4162-4fb2-57ee-b0c0-16870f4c5f23 with identifier: MZ53691
2026-03-27 11:13:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7ac4162-4fb2-57ee-b0c0-16870f4c5f23 with identifier: MZ53691
2026-03-27 11:13:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7ac4162-4fb2-57ee-b0c0-16870f4c5f23 with identifier: MZ53691 to the API
2026-03-27 11:13:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-27T16:38:02Z',
 'fuel_type': 'diesel',
 'id': 'd7ac4162-4fb2-57ee-b0c0-16870f4c5f23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ53691',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 245386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-23',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
 'transmission': 'manual',
 'trim': 'Sport & Style 4Motion',
 'year': 2011}
2026-03-27 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ53691%27 HTTP/1.1" 200 None
2026-03-27 11:13:45 [auto1.de] INFO: Saving data for MZ53691: {'auction_closing_time': 1774629482.0, 'created_time': 1774521792.769065, 'last_price_update_time': 1774610025.564894}
2026-03-27 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ53691') HTTP/1.1" 204 0
2026-03-27 11:13:45 [auto1.de] INFO: Found listing with ID: ZC60024
2026-03-27 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC60024%27 HTTP/1.1" 200 None
2026-03-27 11:13:45 [auto1.de] INFO: Scrape type for ZC60024: 2
2026-03-27 11:13:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e31ff5f9-1683-555e-91cf-390083e9eb95 with identifier: ZC60024
2026-03-27 11:13:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e31ff5f9-1683-555e-91cf-390083e9eb95 with scrape type 2
2026-03-27 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e31ff5f9-1683-555e-91cf-390083e9eb95 with scrape type 2
2026-03-27 11:13:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e31ff5f9-1683-555e-91cf-390083e9eb95, identifier: ZC60024
2026-03-27 11:13:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e31ff5f9-1683-555e-91cf-390083e9eb95 with identifier: ZC60024
2026-03-27 11:13:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e31ff5f9-1683-555e-91cf-390083e9eb95 with identifier: ZC60024
2026-03-27 11:13:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e31ff5f9-1683-555e-91cf-390083e9eb95 with identifier: ZC60024 to the API
2026-03-27 11:13:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:39:11Z',
 'fuel_type': 'petrol',
 'id': 'e31ff5f9-1683-555e-91cf-390083e9eb95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC60024',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 44179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-22',
 'seller_name': None,
 'title': 'Audi A4 35 TFSI Mild-Hybrid advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2023}
2026-03-27 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC60024%27 HTTP/1.1" 200 None
2026-03-27 11:13:46 [auto1.de] INFO: Saving data for ZC60024: {'auction_closing_time': 1774629551.0, 'created_time': 1774034182.624567, 'last_price_update_time': 1774610026.028409}
2026-03-27 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC60024') HTTP/1.1" 204 0
2026-03-27 11:13:46 [auto1.de] INFO: Found listing with ID: FZ98450
2026-03-27 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ98450%27 HTTP/1.1" 200 None
2026-03-27 11:13:46 [auto1.de] INFO: Scrape type for FZ98450: 2
2026-03-27 11:13:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4042cea6-e7ba-5edd-a18e-4f4483c826c9 with identifier: FZ98450
2026-03-27 11:13:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4042cea6-e7ba-5edd-a18e-4f4483c826c9 with scrape type 2
2026-03-27 11:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4042cea6-e7ba-5edd-a18e-4f4483c826c9 with scrape type 2
2026-03-27 11:13:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4042cea6-e7ba-5edd-a18e-4f4483c826c9, identifier: FZ98450
2026-03-27 11:13:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4042cea6-e7ba-5edd-a18e-4f4483c826c9 with identifier: FZ98450
2026-03-27 11:13:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4042cea6-e7ba-5edd-a18e-4f4483c826c9 with identifier: FZ98450
2026-03-27 11:13:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4042cea6-e7ba-5edd-a18e-4f4483c826c9 with identifier: FZ98450 to the API
2026-03-27 11:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 450,
 'expiration_date': '2026-03-27T16:40:57Z',
 'fuel_type': 'petrol',
 'id': '4042cea6-e7ba-5edd-a18e-4f4483c826c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ98450',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 103181,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-22',
 'seller_name': None,
 'title': 'BMW 6er 650i Gran Coupé xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2018}
2026-03-27 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ98450%27 HTTP/1.1" 200 None
2026-03-27 11:13:46 [auto1.de] INFO: Saving data for FZ98450: {'auction_closing_time': 1774629657.0, 'created_time': 1774521799.193456, 'last_price_update_time': 1774610026.59114}
2026-03-27 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ98450') HTTP/1.1" 204 0
2026-03-27 11:13:46 [auto1.de] INFO: Found listing with ID: CL60178
2026-03-27 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL60178%27 HTTP/1.1" 200 None
2026-03-27 11:13:46 [auto1.de] INFO: Scrape type for CL60178: 2
2026-03-27 11:13:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a430a13-c0fb-51e9-8ffc-94d5f025fb3e with identifier: CL60178
2026-03-27 11:13:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a430a13-c0fb-51e9-8ffc-94d5f025fb3e with scrape type 2
2026-03-27 11:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a430a13-c0fb-51e9-8ffc-94d5f025fb3e with scrape type 2
2026-03-27 11:13:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a430a13-c0fb-51e9-8ffc-94d5f025fb3e, identifier: CL60178
2026-03-27 11:13:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a430a13-c0fb-51e9-8ffc-94d5f025fb3e with identifier: CL60178
2026-03-27 11:13:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a430a13-c0fb-51e9-8ffc-94d5f025fb3e with identifier: CL60178
2026-03-27 11:13:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a430a13-c0fb-51e9-8ffc-94d5f025fb3e with identifier: CL60178 to the API
2026-03-27 11:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-27T16:30:57Z',
 'fuel_type': 'diesel',
 'id': '2a430a13-c0fb-51e9-8ffc-94d5f025fb3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL60178',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Crafter',
 'odometer': 109881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-19',
 'seller_name': None,
 'title': 'Volkswagen Crafter 2.5 TDI DPF Pritsche 50 langer Radstand',
 'transmission': 'manual',
 'trim': 'Pritsche 50 langer Radstand',
 'year': 2009}
2026-03-27 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL60178%27 HTTP/1.1" 200 None
2026-03-27 11:13:47 [auto1.de] INFO: Saving data for CL60178: {'auction_closing_time': 1774629057.0, 'created_time': 1773308114.779299, 'last_price_update_time': 1774610027.092605}
2026-03-27 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL60178') HTTP/1.1" 204 0
2026-03-27 11:13:47 [auto1.de] INFO: Found listing with ID: FM77884
2026-03-27 11:13:47 [auto1.de] INFO: Found listing with ID: JP48947
2026-03-27 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP48947%27 HTTP/1.1" 200 None
2026-03-27 11:13:47 [auto1.de] INFO: Scrape type for JP48947: 2
2026-03-27 11:13:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19ae3471-9f33-5d04-ae29-ee431ec9309f with identifier: JP48947
2026-03-27 11:13:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19ae3471-9f33-5d04-ae29-ee431ec9309f with scrape type 2
2026-03-27 11:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19ae3471-9f33-5d04-ae29-ee431ec9309f with scrape type 2
2026-03-27 11:13:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19ae3471-9f33-5d04-ae29-ee431ec9309f, identifier: JP48947
2026-03-27 11:13:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19ae3471-9f33-5d04-ae29-ee431ec9309f with identifier: JP48947
2026-03-27 11:13:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19ae3471-9f33-5d04-ae29-ee431ec9309f with identifier: JP48947
2026-03-27 11:13:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19ae3471-9f33-5d04-ae29-ee431ec9309f with identifier: JP48947 to the API
2026-03-27 11:13:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:22:29Z',
 'fuel_type': 'petrol',
 'id': '19ae3471-9f33-5d04-ae29-ee431ec9309f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP48947',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 174344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-03',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TSI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2022}
2026-03-27 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP48947%27 HTTP/1.1" 200 None
2026-03-27 11:13:47 [auto1.de] INFO: Saving data for JP48947: {'auction_closing_time': 1774628549.0, 'created_time': 1774293530.050079, 'last_price_update_time': 1774610027.781734}
2026-03-27 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP48947') HTTP/1.1" 204 0
2026-03-27 11:13:47 [auto1.de] INFO: Found listing with ID: PB64145
2026-03-27 11:13:47 [auto1.de] INFO: Found listing with ID: WC79885
2026-03-27 11:13:47 [auto1.de] INFO: Found listing with ID: KU93910
2026-03-27 11:13:47 [auto1.de] INFO: Found listing with ID: FT35863
2026-03-27 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT35863%27 HTTP/1.1" 200 None
2026-03-27 11:13:47 [auto1.de] INFO: Scrape type for FT35863: 2
2026-03-27 11:13:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d43c89a7-4dd3-5bc0-a058-406ed738f712 with identifier: FT35863
2026-03-27 11:13:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d43c89a7-4dd3-5bc0-a058-406ed738f712 with scrape type 2
2026-03-27 11:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d43c89a7-4dd3-5bc0-a058-406ed738f712 with scrape type 2
2026-03-27 11:13:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d43c89a7-4dd3-5bc0-a058-406ed738f712, identifier: FT35863
2026-03-27 11:13:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d43c89a7-4dd3-5bc0-a058-406ed738f712 with identifier: FT35863
2026-03-27 11:13:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d43c89a7-4dd3-5bc0-a058-406ed738f712 with identifier: FT35863
2026-03-27 11:13:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d43c89a7-4dd3-5bc0-a058-406ed738f712 with identifier: FT35863 to the API
2026-03-27 11:13:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:21:27Z',
 'fuel_type': 'hybrid',
 'id': 'd43c89a7-4dd3-5bc0-a058-406ed738f712',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT35863',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 65146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-05',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Hybrid Titanium X',
 'transmission': 'automatic',
 'trim': 'Titanium X',
 'year': 2023}
2026-03-27 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT35863%27 HTTP/1.1" 200 None
2026-03-27 11:13:48 [auto1.de] INFO: Saving data for FT35863: {'auction_closing_time': 1774628487.0, 'created_time': 1774294084.973968, 'last_price_update_time': 1774610028.296816}
2026-03-27 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT35863') HTTP/1.1" 204 0
2026-03-27 11:13:48 [auto1.de] INFO: Found listing with ID: GL61413
2026-03-27 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61413%27 HTTP/1.1" 200 None
2026-03-27 11:13:48 [auto1.de] INFO: Scrape type for GL61413: 2
2026-03-27 11:13:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfd23eaf-f455-53c7-bc7b-8dc71fbc5255 with identifier: GL61413
2026-03-27 11:13:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfd23eaf-f455-53c7-bc7b-8dc71fbc5255 with scrape type 2
2026-03-27 11:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfd23eaf-f455-53c7-bc7b-8dc71fbc5255 with scrape type 2
2026-03-27 11:13:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfd23eaf-f455-53c7-bc7b-8dc71fbc5255, identifier: GL61413
2026-03-27 11:13:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfd23eaf-f455-53c7-bc7b-8dc71fbc5255 with identifier: GL61413
2026-03-27 11:13:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfd23eaf-f455-53c7-bc7b-8dc71fbc5255 with identifier: GL61413
2026-03-27 11:13:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfd23eaf-f455-53c7-bc7b-8dc71fbc5255 with identifier: GL61413 to the API
2026-03-27 11:13:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:41:04Z',
 'fuel_type': 'diesel',
 'id': 'cfd23eaf-f455-53c7-bc7b-8dc71fbc5255',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL61413',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 113138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-08',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2023}
2026-03-27 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61413%27 HTTP/1.1" 200 None
2026-03-27 11:13:48 [auto1.de] INFO: Saving data for GL61413: {'auction_closing_time': 1774629664.0, 'created_time': 1774033435.669581, 'last_price_update_time': 1774610028.746859}
2026-03-27 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL61413') HTTP/1.1" 204 0
2026-03-27 11:13:48 [auto1.de] INFO: Found listing with ID: HX69030
2026-03-27 11:13:48 [auto1.de] INFO: Found listing with ID: YH55403
2026-03-27 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH55403%27 HTTP/1.1" 200 None
2026-03-27 11:13:48 [auto1.de] INFO: Scrape type for YH55403: 2
2026-03-27 11:13:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca with identifier: YH55403
2026-03-27 11:13:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca with scrape type 2
2026-03-27 11:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca with scrape type 2
2026-03-27 11:13:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca, identifier: YH55403
2026-03-27 11:13:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca with identifier: YH55403
2026-03-27 11:13:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca with identifier: YH55403
2026-03-27 11:13:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca with identifier: YH55403 to the API
2026-03-27 11:13:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:34:26Z',
 'fuel_type': 'petrol',
 'id': '5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH55403',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 130298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-13',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2011}
2026-03-27 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH55403%27 HTTP/1.1" 200 None
2026-03-27 11:13:49 [auto1.de] INFO: Saving data for YH55403: {'auction_closing_time': 1774629266.0, 'created_time': 1774521782.404606, 'last_price_update_time': 1774610029.210138}
2026-03-27 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH55403') HTTP/1.1" 204 0
2026-03-27 11:13:49 [auto1.de] INFO: Found listing with ID: MU83359
2026-03-27 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU83359%27 HTTP/1.1" 200 None
2026-03-27 11:13:49 [auto1.de] INFO: Scrape type for MU83359: 2
2026-03-27 11:13:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bf13c1a-e5d8-506a-a482-caba11daa539 with identifier: MU83359
2026-03-27 11:13:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bf13c1a-e5d8-506a-a482-caba11daa539 with scrape type 2
2026-03-27 11:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bf13c1a-e5d8-506a-a482-caba11daa539 with scrape type 2
2026-03-27 11:13:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bf13c1a-e5d8-506a-a482-caba11daa539, identifier: MU83359
2026-03-27 11:13:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bf13c1a-e5d8-506a-a482-caba11daa539 with identifier: MU83359
2026-03-27 11:13:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bf13c1a-e5d8-506a-a482-caba11daa539 with identifier: MU83359
2026-03-27 11:13:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bf13c1a-e5d8-506a-a482-caba11daa539 with identifier: MU83359 to the API
2026-03-27 11:13:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:40:51Z',
 'fuel_type': 'diesel',
 'id': '8bf13c1a-e5d8-506a-a482-caba11daa539',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU83359',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 201828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-27 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU83359%27 HTTP/1.1" 200 None
2026-03-27 11:13:49 [auto1.de] INFO: Saving data for MU83359: {'auction_closing_time': 1774629651.0, 'created_time': 1774521888.655067, 'last_price_update_time': 1774610029.67163}
2026-03-27 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU83359') HTTP/1.1" 204 0
2026-03-27 11:13:49 [auto1.de] INFO: Found listing with ID: HX46123
2026-03-27 11:13:49 [auto1.de] INFO: Found listing with ID: UL79092
2026-03-27 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL79092%27 HTTP/1.1" 200 None
2026-03-27 11:13:49 [auto1.de] INFO: Scrape type for UL79092: 2
2026-03-27 11:13:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f40fef4-d061-5c72-97a4-ed037793a692 with identifier: UL79092
2026-03-27 11:13:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f40fef4-d061-5c72-97a4-ed037793a692 with scrape type 2
2026-03-27 11:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f40fef4-d061-5c72-97a4-ed037793a692 with scrape type 2
2026-03-27 11:13:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f40fef4-d061-5c72-97a4-ed037793a692, identifier: UL79092
2026-03-27 11:13:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f40fef4-d061-5c72-97a4-ed037793a692 with identifier: UL79092
2026-03-27 11:13:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f40fef4-d061-5c72-97a4-ed037793a692 with identifier: UL79092
2026-03-27 11:13:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f40fef4-d061-5c72-97a4-ed037793a692 with identifier: UL79092 to the API
2026-03-27 11:13:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-27T16:50:34Z',
 'fuel_type': 'diesel',
 'id': '3f40fef4-d061-5c72-97a4-ed037793a692',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL79092',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 27309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-15',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2024}
2026-03-27 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL79092%27 HTTP/1.1" 200 None
2026-03-27 11:13:50 [auto1.de] INFO: Saving data for UL79092: {'auction_closing_time': 1774630234.0, 'created_time': 1774262940.567902, 'last_price_update_time': 1774610030.137125}
2026-03-27 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL79092') HTTP/1.1" 204 0
2026-03-27 11:13:50 [auto1.de] INFO: Found listing with ID: FD11975
2026-03-27 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD11975%27 HTTP/1.1" 200 None
2026-03-27 11:13:50 [auto1.de] INFO: Scrape type for FD11975: 2
2026-03-27 11:13:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff6ad943-664e-5a5f-b5f9-aef78b5c20f9 with identifier: FD11975
2026-03-27 11:13:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff6ad943-664e-5a5f-b5f9-aef78b5c20f9 with scrape type 2
2026-03-27 11:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff6ad943-664e-5a5f-b5f9-aef78b5c20f9 with scrape type 2
2026-03-27 11:13:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff6ad943-664e-5a5f-b5f9-aef78b5c20f9, identifier: FD11975
2026-03-27 11:13:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff6ad943-664e-5a5f-b5f9-aef78b5c20f9 with identifier: FD11975
2026-03-27 11:13:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff6ad943-664e-5a5f-b5f9-aef78b5c20f9 with identifier: FD11975
2026-03-27 11:13:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff6ad943-664e-5a5f-b5f9-aef78b5c20f9 with identifier: FD11975 to the API
2026-03-27 11:13:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:05:58Z',
 'fuel_type': 'diesel',
 'id': 'ff6ad943-664e-5a5f-b5f9-aef78b5c20f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD11975',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 72569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-23',
 'seller_name': None,
 'title': 'Audi A3 Limousine 30 TDI advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2021}
2026-03-27 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD11975%27 HTTP/1.1" 200 None
2026-03-27 11:13:50 [auto1.de] INFO: Saving data for FD11975: {'auction_closing_time': 1774627558.0, 'created_time': 1774034276.436047, 'last_price_update_time': 1774610030.67683}
2026-03-27 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD11975') HTTP/1.1" 204 0
2026-03-27 11:13:50 [auto1.de] INFO: Found listing with ID: UN33148
2026-03-27 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN33148%27 HTTP/1.1" 200 None
2026-03-27 11:13:50 [auto1.de] INFO: Scrape type for UN33148: 2
2026-03-27 11:13:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f8df986-7f10-5ec5-bc3a-bc1942a95bad with identifier: UN33148
2026-03-27 11:13:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f8df986-7f10-5ec5-bc3a-bc1942a95bad with scrape type 2
2026-03-27 11:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f8df986-7f10-5ec5-bc3a-bc1942a95bad with scrape type 2
2026-03-27 11:13:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f8df986-7f10-5ec5-bc3a-bc1942a95bad, identifier: UN33148
2026-03-27 11:13:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f8df986-7f10-5ec5-bc3a-bc1942a95bad with identifier: UN33148
2026-03-27 11:13:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f8df986-7f10-5ec5-bc3a-bc1942a95bad with identifier: UN33148
2026-03-27 11:13:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f8df986-7f10-5ec5-bc3a-bc1942a95bad with identifier: UN33148 to the API
2026-03-27 11:13:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:55:28Z',
 'fuel_type': 'petrol',
 'id': '5f8df986-7f10-5ec5-bc3a-bc1942a95bad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN33148',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 9035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 eTSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2023}
2026-03-27 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN33148%27 HTTP/1.1" 200 None
2026-03-27 11:13:51 [auto1.de] INFO: Saving data for UN33148: {'auction_closing_time': 1774630528.0, 'created_time': 1774034263.666822, 'last_price_update_time': 1774610031.134558}
2026-03-27 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN33148') HTTP/1.1" 204 0
2026-03-27 11:13:51 [auto1.de] INFO: Found listing with ID: RV77607
2026-03-27 11:13:51 [auto1.de] INFO: Found listing with ID: XS16960
2026-03-27 11:13:51 [auto1.de] INFO: Found listing with ID: RD80564
2026-03-27 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD80564%27 HTTP/1.1" 200 None
2026-03-27 11:13:51 [auto1.de] INFO: Scrape type for RD80564: 2
2026-03-27 11:13:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52902457-75bc-54d2-b7e9-8cd48c6269a0 with identifier: RD80564
2026-03-27 11:13:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52902457-75bc-54d2-b7e9-8cd48c6269a0 with scrape type 2
2026-03-27 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52902457-75bc-54d2-b7e9-8cd48c6269a0 with scrape type 2
2026-03-27 11:13:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52902457-75bc-54d2-b7e9-8cd48c6269a0, identifier: RD80564
2026-03-27 11:13:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52902457-75bc-54d2-b7e9-8cd48c6269a0 with identifier: RD80564
2026-03-27 11:13:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52902457-75bc-54d2-b7e9-8cd48c6269a0 with identifier: RD80564
2026-03-27 11:13:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52902457-75bc-54d2-b7e9-8cd48c6269a0 with identifier: RD80564 to the API
2026-03-27 11:13:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:13:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:13:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:42:48Z',
 'fuel_type': 'diesel',
 'id': '52902457-75bc-54d2-b7e9-8cd48c6269a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD80564',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 374134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2012}
2026-03-27 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD80564%27 HTTP/1.1" 200 None
2026-03-27 11:13:51 [auto1.de] INFO: Saving data for RD80564: {'auction_closing_time': 1774629768.0, 'created_time': 1774521743.956604, 'last_price_update_time': 1774610031.592674}
2026-03-27 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD80564') HTTP/1.1" 204 0
2026-03-27 11:14:06 [scrapy.extensions.logstats] INFO: Crawled 714 pages (at 2 pages/min), scraped 1093 items (at 58 items/min)
2026-03-27 11:14:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 11:14:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:14:08 [auto1.de] INFO: Channel: 24h | Page: 247 | totalHits: 10679 | hits on page: 40
2026-03-27 11:14:08 [auto1.de] INFO: Found listing with ID: XS16960
2026-03-27 11:14:08 [auto1.de] INFO: Found listing with ID: RD80564
2026-03-27 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD80564%27 HTTP/1.1" 200 None
2026-03-27 11:14:08 [auto1.de] INFO: Scrape type for RD80564: 0
2026-03-27 11:14:08 [auto1.de] INFO: Found listing with ID: DA30470
2026-03-27 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA30470%27 HTTP/1.1" 200 None
2026-03-27 11:14:08 [auto1.de] INFO: Scrape type for DA30470: 2
2026-03-27 11:14:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5524d183-3bc2-584d-ba6c-ed84c0c6052d with identifier: DA30470
2026-03-27 11:14:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5524d183-3bc2-584d-ba6c-ed84c0c6052d with scrape type 2
2026-03-27 11:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5524d183-3bc2-584d-ba6c-ed84c0c6052d with scrape type 2
2026-03-27 11:14:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5524d183-3bc2-584d-ba6c-ed84c0c6052d, identifier: DA30470
2026-03-27 11:14:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5524d183-3bc2-584d-ba6c-ed84c0c6052d with identifier: DA30470
2026-03-27 11:14:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5524d183-3bc2-584d-ba6c-ed84c0c6052d with identifier: DA30470
2026-03-27 11:14:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5524d183-3bc2-584d-ba6c-ed84c0c6052d with identifier: DA30470 to the API
2026-03-27 11:14:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:18:46Z',
 'fuel_type': 'electro',
 'id': '5524d183-3bc2-584d-ba6c-ed84c0c6052d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA30470',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 38966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-24',
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 110 kW Pure Performance',
 'transmission': 'automatic',
 'trim': 'Pure Performance',
 'year': 2022}
2026-03-27 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA30470%27 HTTP/1.1" 200 None
2026-03-27 11:14:10 [auto1.de] INFO: Saving data for DA30470: {'auction_closing_time': 1774628326.0, 'created_time': 1774033775.824657, 'last_price_update_time': 1774610050.829032}
2026-03-27 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA30470') HTTP/1.1" 204 0
2026-03-27 11:14:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:14:10 [auto1.de] INFO: Found listing with ID: XV42513
2026-03-27 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV42513%27 HTTP/1.1" 200 None
2026-03-27 11:14:10 [auto1.de] INFO: Scrape type for XV42513: 2
2026-03-27 11:14:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd9a485c-99e3-571b-a7fe-61c04238e6eb with identifier: XV42513
2026-03-27 11:14:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd9a485c-99e3-571b-a7fe-61c04238e6eb with scrape type 2
2026-03-27 11:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd9a485c-99e3-571b-a7fe-61c04238e6eb with scrape type 2
2026-03-27 11:14:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd9a485c-99e3-571b-a7fe-61c04238e6eb, identifier: XV42513
2026-03-27 11:14:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd9a485c-99e3-571b-a7fe-61c04238e6eb with identifier: XV42513
2026-03-27 11:14:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd9a485c-99e3-571b-a7fe-61c04238e6eb with identifier: XV42513
2026-03-27 11:14:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd9a485c-99e3-571b-a7fe-61c04238e6eb with identifier: XV42513 to the API
2026-03-27 11:14:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-27T16:01:59Z',
 'fuel_type': 'diesel',
 'id': 'cd9a485c-99e3-571b-a7fe-61c04238e6eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV42513',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T4 Kombi',
 'odometer': 405975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-06-22',
 'seller_name': None,
 'title': 'Volkswagen T4 Kombi 2.5 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 1998}
2026-03-27 11:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV42513%27 HTTP/1.1" 200 None
2026-03-27 11:14:11 [auto1.de] INFO: Saving data for XV42513: {'auction_closing_time': 1774627319.0, 'created_time': 1774521679.778747, 'last_price_update_time': 1774610051.662258}
2026-03-27 11:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV42513') HTTP/1.1" 204 0
2026-03-27 11:14:11 [auto1.de] INFO: Found listing with ID: VA51114
2026-03-27 11:14:11 [auto1.de] INFO: Found listing with ID: FY69551
2026-03-27 11:14:11 [auto1.de] INFO: Found listing with ID: CE53903
2026-03-27 11:14:11 [auto1.de] INFO: Found listing with ID: FS91363
2026-03-27 11:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS91363%27 HTTP/1.1" 200 None
2026-03-27 11:14:11 [auto1.de] INFO: Scrape type for FS91363: 2
2026-03-27 11:14:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c71dc0c3-9853-5206-aea5-e722152d92e8 with identifier: FS91363
2026-03-27 11:14:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c71dc0c3-9853-5206-aea5-e722152d92e8 with scrape type 2
2026-03-27 11:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c71dc0c3-9853-5206-aea5-e722152d92e8 with scrape type 2
2026-03-27 11:14:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c71dc0c3-9853-5206-aea5-e722152d92e8, identifier: FS91363
2026-03-27 11:14:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c71dc0c3-9853-5206-aea5-e722152d92e8 with identifier: FS91363
2026-03-27 11:14:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c71dc0c3-9853-5206-aea5-e722152d92e8 with identifier: FS91363
2026-03-27 11:14:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c71dc0c3-9853-5206-aea5-e722152d92e8 with identifier: FS91363 to the API
2026-03-27 11:14:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:32:45Z',
 'fuel_type': 'diesel',
 'id': 'c71dc0c3-9853-5206-aea5-e722152d92e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS91363',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 134450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-12',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2009}
2026-03-27 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS91363%27 HTTP/1.1" 200 None
2026-03-27 11:14:13 [auto1.de] INFO: Saving data for FS91363: {'auction_closing_time': 1774629165.0, 'created_time': 1773230577.262544, 'last_price_update_time': 1774610053.525282}
2026-03-27 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS91363') HTTP/1.1" 204 0
2026-03-27 11:14:13 [auto1.de] INFO: Found listing with ID: SN12965
2026-03-27 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN12965%27 HTTP/1.1" 200 None
2026-03-27 11:14:13 [auto1.de] INFO: Scrape type for SN12965: 2
2026-03-27 11:14:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c71b4f79-ed8b-5352-a3b7-82f5771b8ce6 with identifier: SN12965
2026-03-27 11:14:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c71b4f79-ed8b-5352-a3b7-82f5771b8ce6 with scrape type 2
2026-03-27 11:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c71b4f79-ed8b-5352-a3b7-82f5771b8ce6 with scrape type 2
2026-03-27 11:14:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c71b4f79-ed8b-5352-a3b7-82f5771b8ce6, identifier: SN12965
2026-03-27 11:14:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c71b4f79-ed8b-5352-a3b7-82f5771b8ce6 with identifier: SN12965
2026-03-27 11:14:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c71b4f79-ed8b-5352-a3b7-82f5771b8ce6 with identifier: SN12965
2026-03-27 11:14:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c71b4f79-ed8b-5352-a3b7-82f5771b8ce6 with identifier: SN12965 to the API
2026-03-27 11:14:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:55:36Z',
 'fuel_type': 'diesel',
 'id': 'c71b4f79-ed8b-5352-a3b7-82f5771b8ce6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN12965',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 150253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-18',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2020}
2026-03-27 11:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN12965%27 HTTP/1.1" 200 None
2026-03-27 11:14:14 [auto1.de] INFO: Saving data for SN12965: {'auction_closing_time': 1774630536.0, 'created_time': 1774033135.259525, 'last_price_update_time': 1774610054.998876}
2026-03-27 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN12965') HTTP/1.1" 204 0
2026-03-27 11:14:15 [auto1.de] INFO: Found listing with ID: GG73924
2026-03-27 11:14:15 [auto1.de] INFO: Found listing with ID: FW07623
2026-03-27 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW07623%27 HTTP/1.1" 200 None
2026-03-27 11:14:15 [auto1.de] INFO: Scrape type for FW07623: 2
2026-03-27 11:14:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adbab63c-2a58-583f-a690-7f2a4289dbc7 with identifier: FW07623
2026-03-27 11:14:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adbab63c-2a58-583f-a690-7f2a4289dbc7 with scrape type 2
2026-03-27 11:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adbab63c-2a58-583f-a690-7f2a4289dbc7 with scrape type 2
2026-03-27 11:14:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: adbab63c-2a58-583f-a690-7f2a4289dbc7, identifier: FW07623
2026-03-27 11:14:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: adbab63c-2a58-583f-a690-7f2a4289dbc7 with identifier: FW07623
2026-03-27 11:14:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: adbab63c-2a58-583f-a690-7f2a4289dbc7 with identifier: FW07623
2026-03-27 11:14:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: adbab63c-2a58-583f-a690-7f2a4289dbc7 with identifier: FW07623 to the API
2026-03-27 11:14:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:13:21Z',
 'fuel_type': 'petrol',
 'id': 'adbab63c-2a58-583f-a690-7f2a4289dbc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW07623',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 31105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-07',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-27 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW07623%27 HTTP/1.1" 200 None
2026-03-27 11:14:15 [auto1.de] INFO: Saving data for FW07623: {'auction_closing_time': 1774628001.0, 'created_time': 1774521681.480761, 'last_price_update_time': 1774610055.4922}
2026-03-27 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW07623') HTTP/1.1" 204 0
2026-03-27 11:14:15 [auto1.de] INFO: Found listing with ID: UX08950
2026-03-27 11:14:15 [auto1.de] INFO: Found listing with ID: ZT57353
2026-03-27 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT57353%27 HTTP/1.1" 200 None
2026-03-27 11:14:15 [auto1.de] INFO: Scrape type for ZT57353: 2
2026-03-27 11:14:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbc267b2-f9d5-50f7-9cd3-023c7a2b7b42 with identifier: ZT57353
2026-03-27 11:14:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbc267b2-f9d5-50f7-9cd3-023c7a2b7b42 with scrape type 2
2026-03-27 11:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbc267b2-f9d5-50f7-9cd3-023c7a2b7b42 with scrape type 2
2026-03-27 11:14:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dbc267b2-f9d5-50f7-9cd3-023c7a2b7b42, identifier: ZT57353
2026-03-27 11:14:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dbc267b2-f9d5-50f7-9cd3-023c7a2b7b42 with identifier: ZT57353
2026-03-27 11:14:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dbc267b2-f9d5-50f7-9cd3-023c7a2b7b42 with identifier: ZT57353
2026-03-27 11:14:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dbc267b2-f9d5-50f7-9cd3-023c7a2b7b42 with identifier: ZT57353 to the API
2026-03-27 11:14:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:54:06Z',
 'fuel_type': 'petrol',
 'id': 'dbc267b2-f9d5-50f7-9cd3-023c7a2b7b42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT57353',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 60263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-03',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-03-27 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT57353%27 HTTP/1.1" 200 None
2026-03-27 11:14:16 [auto1.de] INFO: Saving data for ZT57353: {'auction_closing_time': 1774630446.0, 'created_time': 1774033808.964396, 'last_price_update_time': 1774610056.301273}
2026-03-27 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT57353') HTTP/1.1" 204 0
2026-03-27 11:14:16 [auto1.de] INFO: Found listing with ID: HE88614
2026-03-27 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE88614%27 HTTP/1.1" 200 None
2026-03-27 11:14:16 [auto1.de] INFO: Scrape type for HE88614: 2
2026-03-27 11:14:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bddbb0f-7639-5aac-b3fe-10eea658426a with identifier: HE88614
2026-03-27 11:14:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bddbb0f-7639-5aac-b3fe-10eea658426a with scrape type 2
2026-03-27 11:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bddbb0f-7639-5aac-b3fe-10eea658426a with scrape type 2
2026-03-27 11:14:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bddbb0f-7639-5aac-b3fe-10eea658426a, identifier: HE88614
2026-03-27 11:14:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bddbb0f-7639-5aac-b3fe-10eea658426a with identifier: HE88614
2026-03-27 11:14:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bddbb0f-7639-5aac-b3fe-10eea658426a with identifier: HE88614
2026-03-27 11:14:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bddbb0f-7639-5aac-b3fe-10eea658426a with identifier: HE88614 to the API
2026-03-27 11:14:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-27T16:17:18Z',
 'fuel_type': 'electro',
 'id': '3bddbb0f-7639-5aac-b3fe-10eea658426a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE88614',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'e-tron',
 'odometer': 62199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-04',
 'seller_name': None,
 'title': 'Audi e-tron 50 quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-03-27 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE88614%27 HTTP/1.1" 200 None
2026-03-27 11:14:16 [auto1.de] INFO: Saving data for HE88614: {'auction_closing_time': 1774628238.0, 'created_time': 1774032221.33558, 'last_price_update_time': 1774610056.906619}
2026-03-27 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE88614') HTTP/1.1" 204 0
2026-03-27 11:14:16 [auto1.de] INFO: Found listing with ID: GC69129
2026-03-27 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC69129%27 HTTP/1.1" 200 None
2026-03-27 11:14:16 [auto1.de] INFO: Scrape type for GC69129: 2
2026-03-27 11:14:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 970e7cad-a8f7-51f3-86cf-b4f09653c371 with identifier: GC69129
2026-03-27 11:14:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 970e7cad-a8f7-51f3-86cf-b4f09653c371 with scrape type 2
2026-03-27 11:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 970e7cad-a8f7-51f3-86cf-b4f09653c371 with scrape type 2
2026-03-27 11:14:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 970e7cad-a8f7-51f3-86cf-b4f09653c371, identifier: GC69129
2026-03-27 11:14:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 970e7cad-a8f7-51f3-86cf-b4f09653c371 with identifier: GC69129
2026-03-27 11:14:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 970e7cad-a8f7-51f3-86cf-b4f09653c371 with identifier: GC69129
2026-03-27 11:14:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 970e7cad-a8f7-51f3-86cf-b4f09653c371 with identifier: GC69129 to the API
2026-03-27 11:14:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-27T16:01:48Z',
 'fuel_type': 'hybrid',
 'id': '970e7cad-a8f7-51f3-86cf-b4f09653c371',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC69129',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 92026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-16',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-27 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC69129%27 HTTP/1.1" 200 None
2026-03-27 11:14:17 [auto1.de] INFO: Saving data for GC69129: {'auction_closing_time': 1774627308.0, 'created_time': 1774034317.431708, 'last_price_update_time': 1774610057.423606}
2026-03-27 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC69129') HTTP/1.1" 204 0
2026-03-27 11:14:17 [auto1.de] INFO: Found listing with ID: RD35105
2026-03-27 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD35105%27 HTTP/1.1" 200 None
2026-03-27 11:14:17 [auto1.de] INFO: Scrape type for RD35105: 2
2026-03-27 11:14:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f4cd017-9eb1-5923-8313-23b0ba090ccd with identifier: RD35105
2026-03-27 11:14:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f4cd017-9eb1-5923-8313-23b0ba090ccd with scrape type 2
2026-03-27 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f4cd017-9eb1-5923-8313-23b0ba090ccd with scrape type 2
2026-03-27 11:14:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f4cd017-9eb1-5923-8313-23b0ba090ccd, identifier: RD35105
2026-03-27 11:14:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f4cd017-9eb1-5923-8313-23b0ba090ccd with identifier: RD35105
2026-03-27 11:14:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f4cd017-9eb1-5923-8313-23b0ba090ccd with identifier: RD35105
2026-03-27 11:14:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f4cd017-9eb1-5923-8313-23b0ba090ccd with identifier: RD35105 to the API
2026-03-27 11:14:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-27T16:28:29Z',
 'fuel_type': 'petrol',
 'id': '1f4cd017-9eb1-5923-8313-23b0ba090ccd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD35105',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595C',
 'odometer': 70202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-26',
 'seller_name': None,
 'title': 'Abarth 595C 1.4 Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2014}
2026-03-27 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD35105%27 HTTP/1.1" 200 None
2026-03-27 11:14:18 [auto1.de] INFO: Saving data for RD35105: {'auction_closing_time': 1774628909.0, 'created_time': 1774521700.736752, 'last_price_update_time': 1774610058.240307}
2026-03-27 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD35105') HTTP/1.1" 204 0
2026-03-27 11:14:18 [auto1.de] INFO: Found listing with ID: JX78173
2026-03-27 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX78173%27 HTTP/1.1" 200 None
2026-03-27 11:14:18 [auto1.de] INFO: Scrape type for JX78173: 2
2026-03-27 11:14:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ad09f4d-4b8f-54b0-bf44-c7191d055bb2 with identifier: JX78173
2026-03-27 11:14:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ad09f4d-4b8f-54b0-bf44-c7191d055bb2 with scrape type 2
2026-03-27 11:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ad09f4d-4b8f-54b0-bf44-c7191d055bb2 with scrape type 2
2026-03-27 11:14:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ad09f4d-4b8f-54b0-bf44-c7191d055bb2, identifier: JX78173
2026-03-27 11:14:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ad09f4d-4b8f-54b0-bf44-c7191d055bb2 with identifier: JX78173
2026-03-27 11:14:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ad09f4d-4b8f-54b0-bf44-c7191d055bb2 with identifier: JX78173
2026-03-27 11:14:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ad09f4d-4b8f-54b0-bf44-c7191d055bb2 with identifier: JX78173 to the API
2026-03-27 11:14:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-27T16:27:01Z',
 'fuel_type': 'petrol',
 'id': '4ad09f4d-4b8f-54b0-bf44-c7191d055bb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX78173',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 27786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-26',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
 'transmission': 'manual',
 'trim': 'GTI',
 'year': 2023}
2026-03-27 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX78173%27 HTTP/1.1" 200 None
2026-03-27 11:14:18 [auto1.de] INFO: Saving data for JX78173: {'auction_closing_time': 1774628821.0, 'created_time': 1774264824.718767, 'last_price_update_time': 1774610058.732311}
2026-03-27 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX78173') HTTP/1.1" 204 0
2026-03-27 11:14:18 [auto1.de] INFO: Found listing with ID: PX03424
2026-03-27 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX03424%27 HTTP/1.1" 200 None
2026-03-27 11:14:18 [auto1.de] INFO: Scrape type for PX03424: 2
2026-03-27 11:14:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71528674-7c3f-5beb-aca5-d3380e586a6f with identifier: PX03424
2026-03-27 11:14:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71528674-7c3f-5beb-aca5-d3380e586a6f with scrape type 2
2026-03-27 11:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71528674-7c3f-5beb-aca5-d3380e586a6f with scrape type 2
2026-03-27 11:14:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71528674-7c3f-5beb-aca5-d3380e586a6f, identifier: PX03424
2026-03-27 11:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:14:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71528674-7c3f-5beb-aca5-d3380e586a6f with identifier: PX03424
2026-03-27 11:14:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71528674-7c3f-5beb-aca5-d3380e586a6f with identifier: PX03424
2026-03-27 11:14:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71528674-7c3f-5beb-aca5-d3380e586a6f with identifier: PX03424 to the API
2026-03-27 11:14:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:19:30Z',
 'fuel_type': 'petrol',
 'id': '71528674-7c3f-5beb-aca5-d3380e586a6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX03424',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 128494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-04',
 'seller_name': None,
 'title': 'Skoda Superb 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2022}
2026-03-27 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX03424%27 HTTP/1.1" 200 None
2026-03-27 11:14:19 [auto1.de] INFO: Saving data for PX03424: {'auction_closing_time': 1774628370.0, 'created_time': 1774034276.030667, 'last_price_update_time': 1774610059.203972}
2026-03-27 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX03424') HTTP/1.1" 204 0
2026-03-27 11:14:19 [auto1.de] INFO: Found listing with ID: DK83940
2026-03-27 11:14:19 [auto1.de] INFO: Found listing with ID: TG08691
2026-03-27 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG08691%27 HTTP/1.1" 200 None
2026-03-27 11:14:19 [auto1.de] INFO: Scrape type for TG08691: 2
2026-03-27 11:14:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d64d54a-81c5-5789-bad1-f4c8ae239c87 with identifier: TG08691
2026-03-27 11:14:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d64d54a-81c5-5789-bad1-f4c8ae239c87 with scrape type 2
2026-03-27 11:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d64d54a-81c5-5789-bad1-f4c8ae239c87 with scrape type 2
2026-03-27 11:14:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d64d54a-81c5-5789-bad1-f4c8ae239c87, identifier: TG08691
2026-03-27 11:14:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d64d54a-81c5-5789-bad1-f4c8ae239c87 with identifier: TG08691
2026-03-27 11:14:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d64d54a-81c5-5789-bad1-f4c8ae239c87 with identifier: TG08691
2026-03-27 11:14:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d64d54a-81c5-5789-bad1-f4c8ae239c87 with identifier: TG08691 to the API
2026-03-27 11:14:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-27T16:48:43Z',
 'fuel_type': 'petrol',
 'id': '7d64d54a-81c5-5789-bad1-f4c8ae239c87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG08691',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 96778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-30',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 FIFA World Cup Edition',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition',
 'year': 2014}
2026-03-27 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG08691%27 HTTP/1.1" 200 None
2026-03-27 11:14:19 [auto1.de] INFO: Saving data for TG08691: {'auction_closing_time': 1774630123.0, 'created_time': 1774521780.070121, 'last_price_update_time': 1774610059.91221}
2026-03-27 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG08691') HTTP/1.1" 204 0
2026-03-27 11:14:20 [auto1.de] INFO: Found listing with ID: ZR73456
2026-03-27 11:14:20 [auto1.de] INFO: Found listing with ID: YM01115
2026-03-27 11:14:20 [auto1.de] INFO: Found listing with ID: ZP21008
2026-03-27 11:14:20 [auto1.de] INFO: Found listing with ID: PB97720
2026-03-27 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB97720%27 HTTP/1.1" 200 None
2026-03-27 11:14:20 [auto1.de] INFO: Scrape type for PB97720: 2
2026-03-27 11:14:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e35bd96b-2eb1-5b61-a191-102ea07baa7b with identifier: PB97720
2026-03-27 11:14:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e35bd96b-2eb1-5b61-a191-102ea07baa7b with scrape type 2
2026-03-27 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e35bd96b-2eb1-5b61-a191-102ea07baa7b with scrape type 2
2026-03-27 11:14:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e35bd96b-2eb1-5b61-a191-102ea07baa7b, identifier: PB97720
2026-03-27 11:14:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e35bd96b-2eb1-5b61-a191-102ea07baa7b with identifier: PB97720
2026-03-27 11:14:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e35bd96b-2eb1-5b61-a191-102ea07baa7b with identifier: PB97720
2026-03-27 11:14:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e35bd96b-2eb1-5b61-a191-102ea07baa7b with identifier: PB97720 to the API
2026-03-27 11:14:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:03:48Z',
 'fuel_type': 'petrol',
 'id': 'e35bd96b-2eb1-5b61-a191-102ea07baa7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB97720',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 75737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-18',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2012}
2026-03-27 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB97720%27 HTTP/1.1" 200 None
2026-03-27 11:14:20 [auto1.de] INFO: Saving data for PB97720: {'auction_closing_time': 1774627428.0, 'created_time': 1774521687.934687, 'last_price_update_time': 1774610060.553788}
2026-03-27 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB97720') HTTP/1.1" 204 0
2026-03-27 11:14:20 [auto1.de] INFO: Channel: 24h | Page: 248 | totalHits: 10679 | hits on page: 40
2026-03-27 11:14:20 [auto1.de] INFO: Found listing with ID: TK92834
2026-03-27 11:14:20 [auto1.de] INFO: Found listing with ID: JW34091
2026-03-27 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW34091%27 HTTP/1.1" 200 None
2026-03-27 11:14:20 [auto1.de] INFO: Scrape type for JW34091: 2
2026-03-27 11:14:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e82c02cd-d27a-5bd6-9159-17c0f6b6fbe8 with identifier: JW34091
2026-03-27 11:14:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e82c02cd-d27a-5bd6-9159-17c0f6b6fbe8 with scrape type 2
2026-03-27 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e82c02cd-d27a-5bd6-9159-17c0f6b6fbe8 with scrape type 2
2026-03-27 11:14:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e82c02cd-d27a-5bd6-9159-17c0f6b6fbe8, identifier: JW34091
2026-03-27 11:14:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e82c02cd-d27a-5bd6-9159-17c0f6b6fbe8 with identifier: JW34091
2026-03-27 11:14:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e82c02cd-d27a-5bd6-9159-17c0f6b6fbe8 with identifier: JW34091
2026-03-27 11:14:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e82c02cd-d27a-5bd6-9159-17c0f6b6fbe8 with identifier: JW34091 to the API
2026-03-27 11:14:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:16:14Z',
 'fuel_type': 'petrol',
 'id': 'e82c02cd-d27a-5bd6-9159-17c0f6b6fbe8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW34091',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 37709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-05',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport 4Motion',
 'year': 2022}
2026-03-27 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW34091%27 HTTP/1.1" 200 None
2026-03-27 11:14:21 [auto1.de] INFO: Saving data for JW34091: {'auction_closing_time': 1774628174.0, 'created_time': 1774265262.756104, 'last_price_update_time': 1774610061.190765}
2026-03-27 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW34091') HTTP/1.1" 204 0
2026-03-27 11:14:21 [auto1.de] INFO: Found listing with ID: DV59283
2026-03-27 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV59283%27 HTTP/1.1" 200 None
2026-03-27 11:14:21 [auto1.de] INFO: Scrape type for DV59283: 2
2026-03-27 11:14:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 248e691a-f9be-5698-9fbd-6d6dbe6763bc with identifier: DV59283
2026-03-27 11:14:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 248e691a-f9be-5698-9fbd-6d6dbe6763bc with scrape type 2
2026-03-27 11:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 248e691a-f9be-5698-9fbd-6d6dbe6763bc with scrape type 2
2026-03-27 11:14:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 248e691a-f9be-5698-9fbd-6d6dbe6763bc, identifier: DV59283
2026-03-27 11:14:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:14:21 [auto1.de] INFO: Found listing with ID: UY13907
2026-03-27 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY13907%27 HTTP/1.1" 200 None
2026-03-27 11:14:21 [auto1.de] INFO: Scrape type for UY13907: 2
2026-03-27 11:14:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c28d3a3-fa42-5438-8580-82d256f0d8ee with identifier: UY13907
2026-03-27 11:14:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c28d3a3-fa42-5438-8580-82d256f0d8ee with scrape type 2
2026-03-27 11:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c28d3a3-fa42-5438-8580-82d256f0d8ee with scrape type 2
2026-03-27 11:14:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c28d3a3-fa42-5438-8580-82d256f0d8ee, identifier: UY13907
2026-03-27 11:14:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 248e691a-f9be-5698-9fbd-6d6dbe6763bc with identifier: DV59283
2026-03-27 11:14:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 248e691a-f9be-5698-9fbd-6d6dbe6763bc with identifier: DV59283
2026-03-27 11:14:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 248e691a-f9be-5698-9fbd-6d6dbe6763bc with identifier: DV59283 to the API
2026-03-27 11:14:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-27T16:37:27Z',
 'fuel_type': 'petrol',
 'id': '248e691a-f9be-5698-9fbd-6d6dbe6763bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV59283',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 56799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-24',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
 'transmission': 'automatic',
 'trim': 'GTI Clubsport',
 'year': 2022}
2026-03-27 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV59283%27 HTTP/1.1" 200 None
2026-03-27 11:14:22 [auto1.de] INFO: Saving data for DV59283: {'auction_closing_time': 1774629447.0, 'created_time': 1774521684.490555, 'last_price_update_time': 1774610062.061498}
2026-03-27 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV59283') HTTP/1.1" 204 0
2026-03-27 11:14:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c28d3a3-fa42-5438-8580-82d256f0d8ee with identifier: UY13907
2026-03-27 11:14:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c28d3a3-fa42-5438-8580-82d256f0d8ee with identifier: UY13907
2026-03-27 11:14:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c28d3a3-fa42-5438-8580-82d256f0d8ee with identifier: UY13907 to the API
2026-03-27 11:14:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:37:48Z',
 'fuel_type': 'diesel',
 'id': '0c28d3a3-fa42-5438-8580-82d256f0d8ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY13907',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 46461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-05',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2023}
2026-03-27 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY13907%27 HTTP/1.1" 200 None
2026-03-27 11:14:22 [auto1.de] INFO: Saving data for UY13907: {'auction_closing_time': 1774629468.0, 'created_time': 1774031883.318445, 'last_price_update_time': 1774610062.459223}
2026-03-27 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY13907') HTTP/1.1" 204 0
2026-03-27 11:14:22 [auto1.de] INFO: Found listing with ID: FK38121
2026-03-27 11:14:22 [auto1.de] INFO: Found listing with ID: BH90023
2026-03-27 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH90023%27 HTTP/1.1" 200 None
2026-03-27 11:14:22 [auto1.de] INFO: Scrape type for BH90023: 2
2026-03-27 11:14:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ad07537-8373-55cc-a6f4-cafb2cb5693e with identifier: BH90023
2026-03-27 11:14:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ad07537-8373-55cc-a6f4-cafb2cb5693e with scrape type 2
2026-03-27 11:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ad07537-8373-55cc-a6f4-cafb2cb5693e with scrape type 2
2026-03-27 11:14:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ad07537-8373-55cc-a6f4-cafb2cb5693e, identifier: BH90023
2026-03-27 11:14:22 [auto1.de] INFO: Found listing with ID: LD16717
2026-03-27 11:14:22 [auto1.de] INFO: Found listing with ID: KU20599
2026-03-27 11:14:22 [auto1.de] INFO: Found listing with ID: PB24249
2026-03-27 11:14:22 [auto1.de] INFO: Found listing with ID: DN26053
2026-03-27 11:14:22 [auto1.de] INFO: Found listing with ID: YD46257
2026-03-27 11:14:22 [auto1.de] INFO: Found listing with ID: YT53556
2026-03-27 11:14:22 [auto1.de] INFO: Found listing with ID: AN41414
2026-03-27 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN41414%27 HTTP/1.1" 200 None
2026-03-27 11:14:22 [auto1.de] INFO: Scrape type for AN41414: 2
2026-03-27 11:14:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a6b024f-8851-548e-b542-c66f26fc002d with identifier: AN41414
2026-03-27 11:14:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a6b024f-8851-548e-b542-c66f26fc002d with scrape type 2
2026-03-27 11:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a6b024f-8851-548e-b542-c66f26fc002d with scrape type 2
2026-03-27 11:14:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a6b024f-8851-548e-b542-c66f26fc002d, identifier: AN41414
2026-03-27 11:14:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ad07537-8373-55cc-a6f4-cafb2cb5693e with identifier: BH90023
2026-03-27 11:14:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ad07537-8373-55cc-a6f4-cafb2cb5693e with identifier: BH90023
2026-03-27 11:14:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ad07537-8373-55cc-a6f4-cafb2cb5693e with identifier: BH90023 to the API
2026-03-27 11:14:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:23:11Z',
 'fuel_type': 'diesel',
 'id': '6ad07537-8373-55cc-a6f4-cafb2cb5693e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH90023',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 198635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-25',
 'seller_name': None,
 'title': 'Skoda Karoq 2.0 TDI Ambition 4x4',
 'transmission': 'automatic',
 'trim': 'Ambition 4x4',
 'year': 2022}
2026-03-27 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH90023%27 HTTP/1.1" 200 None
2026-03-27 11:14:23 [auto1.de] INFO: Saving data for BH90023: {'auction_closing_time': 1774628591.0, 'created_time': 1774378282.672518, 'last_price_update_time': 1774610063.287598}
2026-03-27 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH90023') HTTP/1.1" 204 0
2026-03-27 11:14:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a6b024f-8851-548e-b542-c66f26fc002d with identifier: AN41414
2026-03-27 11:14:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a6b024f-8851-548e-b542-c66f26fc002d with identifier: AN41414
2026-03-27 11:14:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a6b024f-8851-548e-b542-c66f26fc002d with identifier: AN41414 to the API
2026-03-27 11:14:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:58:10Z',
 'fuel_type': 'petrol',
 'id': '3a6b024f-8851-548e-b542-c66f26fc002d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN41414',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 103179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-29',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Style Salsa',
 'transmission': 'manual',
 'trim': 'Style Salsa',
 'year': 2014}
2026-03-27 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN41414%27 HTTP/1.1" 200 None
2026-03-27 11:14:23 [auto1.de] INFO: Saving data for AN41414: {'auction_closing_time': 1774630690.0, 'created_time': 1774521693.272948, 'last_price_update_time': 1774610063.872382}
2026-03-27 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN41414') HTTP/1.1" 204 0
2026-03-27 11:14:23 [auto1.de] INFO: Found listing with ID: AU80136
2026-03-27 11:14:23 [auto1.de] INFO: Found listing with ID: XP68134
2026-03-27 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP68134%27 HTTP/1.1" 200 None
2026-03-27 11:14:23 [auto1.de] INFO: Scrape type for XP68134: 2
2026-03-27 11:14:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffa02034-39c2-50cd-a3ff-6482f49667a4 with identifier: XP68134
2026-03-27 11:14:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffa02034-39c2-50cd-a3ff-6482f49667a4 with scrape type 2
2026-03-27 11:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffa02034-39c2-50cd-a3ff-6482f49667a4 with scrape type 2
2026-03-27 11:14:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffa02034-39c2-50cd-a3ff-6482f49667a4, identifier: XP68134
2026-03-27 11:14:24 [auto1.de] INFO: Found listing with ID: RV88520
2026-03-27 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV88520%27 HTTP/1.1" 200 None
2026-03-27 11:14:24 [auto1.de] INFO: Scrape type for RV88520: 2
2026-03-27 11:14:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 363e2299-3b63-59dc-b872-5788775e6973 with identifier: RV88520
2026-03-27 11:14:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 363e2299-3b63-59dc-b872-5788775e6973 with scrape type 2
2026-03-27 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 363e2299-3b63-59dc-b872-5788775e6973 with scrape type 2
2026-03-27 11:14:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 363e2299-3b63-59dc-b872-5788775e6973, identifier: RV88520
2026-03-27 11:14:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffa02034-39c2-50cd-a3ff-6482f49667a4 with identifier: XP68134
2026-03-27 11:14:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffa02034-39c2-50cd-a3ff-6482f49667a4 with identifier: XP68134
2026-03-27 11:14:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffa02034-39c2-50cd-a3ff-6482f49667a4 with identifier: XP68134 to the API
2026-03-27 11:14:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-27T16:57:01Z',
 'fuel_type': 'hybrid',
 'id': 'ffa02034-39c2-50cd-a3ff-6482f49667a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP68134',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 12187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-08-18',
 'seller_name': None,
 'title': 'Audi Q5 50 TFSIe quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2024}
2026-03-27 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP68134%27 HTTP/1.1" 200 None
2026-03-27 11:14:24 [auto1.de] INFO: Saving data for XP68134: {'auction_closing_time': 1774630621.0, 'created_time': 1774380154.423945, 'last_price_update_time': 1774610064.494218}
2026-03-27 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP68134') HTTP/1.1" 204 0
2026-03-27 11:14:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 363e2299-3b63-59dc-b872-5788775e6973 with identifier: RV88520
2026-03-27 11:14:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 363e2299-3b63-59dc-b872-5788775e6973 with identifier: RV88520
2026-03-27 11:14:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 363e2299-3b63-59dc-b872-5788775e6973 with identifier: RV88520 to the API
2026-03-27 11:14:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:34:58Z',
 'fuel_type': 'diesel',
 'id': '363e2299-3b63-59dc-b872-5788775e6973',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV88520',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 185029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-11',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2022}
2026-03-27 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV88520%27 HTTP/1.1" 200 None
2026-03-27 11:14:25 [auto1.de] INFO: Saving data for RV88520: {'auction_closing_time': 1774629298.0, 'created_time': 1774378405.405727, 'last_price_update_time': 1774610065.160736}
2026-03-27 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV88520') HTTP/1.1" 204 0
2026-03-27 11:14:25 [auto1.de] INFO: Found listing with ID: JM62920
2026-03-27 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM62920%27 HTTP/1.1" 200 None
2026-03-27 11:14:25 [auto1.de] INFO: Scrape type for JM62920: 2
2026-03-27 11:14:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b41141db-bea9-5764-b5f1-023b0eaf45f8 with identifier: JM62920
2026-03-27 11:14:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b41141db-bea9-5764-b5f1-023b0eaf45f8 with scrape type 2
2026-03-27 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b41141db-bea9-5764-b5f1-023b0eaf45f8 with scrape type 2
2026-03-27 11:14:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b41141db-bea9-5764-b5f1-023b0eaf45f8, identifier: JM62920
2026-03-27 11:14:25 [auto1.de] INFO: Found listing with ID: YU52700
2026-03-27 11:14:25 [auto1.de] INFO: Found listing with ID: ZD80361
2026-03-27 11:14:25 [auto1.de] INFO: Found listing with ID: KE90255
2026-03-27 11:14:25 [auto1.de] INFO: Found listing with ID: SK01939
2026-03-27 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK01939%27 HTTP/1.1" 200 None
2026-03-27 11:14:25 [auto1.de] INFO: Scrape type for SK01939: 2
2026-03-27 11:14:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc80b894-e4ea-5f4f-aed6-f6670bdbba9e with identifier: SK01939
2026-03-27 11:14:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc80b894-e4ea-5f4f-aed6-f6670bdbba9e with scrape type 2
2026-03-27 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc80b894-e4ea-5f4f-aed6-f6670bdbba9e with scrape type 2
2026-03-27 11:14:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc80b894-e4ea-5f4f-aed6-f6670bdbba9e, identifier: SK01939
2026-03-27 11:14:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b41141db-bea9-5764-b5f1-023b0eaf45f8 with identifier: JM62920
2026-03-27 11:14:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b41141db-bea9-5764-b5f1-023b0eaf45f8 with identifier: JM62920
2026-03-27 11:14:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b41141db-bea9-5764-b5f1-023b0eaf45f8 with identifier: JM62920 to the API
2026-03-27 11:14:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-27T16:12:28Z',
 'fuel_type': 'hybrid',
 'id': 'b41141db-bea9-5764-b5f1-023b0eaf45f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM62920',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 23017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-27',
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-27 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM62920%27 HTTP/1.1" 200 None
2026-03-27 11:14:25 [auto1.de] INFO: Saving data for JM62920: {'auction_closing_time': 1774627948.0, 'created_time': 1774379970.420521, 'last_price_update_time': 1774610065.956354}
2026-03-27 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM62920') HTTP/1.1" 204 0
2026-03-27 11:14:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc80b894-e4ea-5f4f-aed6-f6670bdbba9e with identifier: SK01939
2026-03-27 11:14:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc80b894-e4ea-5f4f-aed6-f6670bdbba9e with identifier: SK01939
2026-03-27 11:14:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc80b894-e4ea-5f4f-aed6-f6670bdbba9e with identifier: SK01939 to the API
2026-03-27 11:14:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-27T16:25:02Z',
 'fuel_type': 'hybrid',
 'id': 'fc80b894-e4ea-5f4f-aed6-f6670bdbba9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK01939',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 20549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-06',
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID VZ',
 'transmission': 'automatic',
 'trim': 'VZ',
 'year': 2023}
2026-03-27 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK01939%27 HTTP/1.1" 200 None
2026-03-27 11:14:26 [auto1.de] INFO: Saving data for SK01939: {'auction_closing_time': 1774628702.0, 'created_time': 1774378273.097117, 'last_price_update_time': 1774610066.381009}
2026-03-27 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK01939') HTTP/1.1" 204 0
2026-03-27 11:14:26 [auto1.de] INFO: Found listing with ID: UB70112
2026-03-27 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB70112%27 HTTP/1.1" 200 None
2026-03-27 11:14:26 [auto1.de] INFO: Scrape type for UB70112: 2
2026-03-27 11:14:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 225ba9d9-7262-5022-bea7-d875cf2563a6 with identifier: UB70112
2026-03-27 11:14:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 225ba9d9-7262-5022-bea7-d875cf2563a6 with scrape type 2
2026-03-27 11:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 225ba9d9-7262-5022-bea7-d875cf2563a6 with scrape type 2
2026-03-27 11:14:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 225ba9d9-7262-5022-bea7-d875cf2563a6, identifier: UB70112
2026-03-27 11:14:26 [auto1.de] INFO: Found listing with ID: RS13541
2026-03-27 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS13541%27 HTTP/1.1" 200 None
2026-03-27 11:14:26 [auto1.de] INFO: Scrape type for RS13541: 2
2026-03-27 11:14:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb59f592-f5b1-5a8d-837f-1eaeb0dc08e9 with identifier: RS13541
2026-03-27 11:14:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb59f592-f5b1-5a8d-837f-1eaeb0dc08e9 with scrape type 2
2026-03-27 11:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb59f592-f5b1-5a8d-837f-1eaeb0dc08e9 with scrape type 2
2026-03-27 11:14:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb59f592-f5b1-5a8d-837f-1eaeb0dc08e9, identifier: RS13541
2026-03-27 11:14:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 225ba9d9-7262-5022-bea7-d875cf2563a6 with identifier: UB70112
2026-03-27 11:14:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 225ba9d9-7262-5022-bea7-d875cf2563a6 with identifier: UB70112
2026-03-27 11:14:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 225ba9d9-7262-5022-bea7-d875cf2563a6 with identifier: UB70112 to the API
2026-03-27 11:14:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:41:44Z',
 'fuel_type': 'petrol',
 'id': '225ba9d9-7262-5022-bea7-d875cf2563a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB70112',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 32105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.0 TSI Move',
 'transmission': 'manual',
 'trim': 'Move',
 'year': 2024}
2026-03-27 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB70112%27 HTTP/1.1" 200 None
2026-03-27 11:14:26 [auto1.de] INFO: Saving data for UB70112: {'auction_closing_time': 1774629704.0, 'created_time': 1774377817.94928, 'last_price_update_time': 1774610066.98938}
2026-03-27 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB70112') HTTP/1.1" 204 0
2026-03-27 11:14:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb59f592-f5b1-5a8d-837f-1eaeb0dc08e9 with identifier: RS13541
2026-03-27 11:14:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb59f592-f5b1-5a8d-837f-1eaeb0dc08e9 with identifier: RS13541
2026-03-27 11:14:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb59f592-f5b1-5a8d-837f-1eaeb0dc08e9 with identifier: RS13541 to the API
2026-03-27 11:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-27T16:24:45Z',
 'fuel_type': 'hybrid',
 'id': 'fb59f592-f5b1-5a8d-837f-1eaeb0dc08e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS13541',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 18872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-12',
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID VZ',
 'transmission': 'automatic',
 'trim': 'VZ',
 'year': 2023}
2026-03-27 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS13541%27 HTTP/1.1" 200 None
2026-03-27 11:14:27 [auto1.de] INFO: Saving data for RS13541: {'auction_closing_time': 1774628685.0, 'created_time': 1774380110.130528, 'last_price_update_time': 1774610067.40571}
2026-03-27 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS13541') HTTP/1.1" 204 0
2026-03-27 11:14:27 [auto1.de] INFO: Found listing with ID: TK72536
2026-03-27 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK72536%27 HTTP/1.1" 200 None
2026-03-27 11:14:27 [auto1.de] INFO: Scrape type for TK72536: 2
2026-03-27 11:14:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29aa4a11-9a58-5139-b9a1-da36bdac7b17 with identifier: TK72536
2026-03-27 11:14:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29aa4a11-9a58-5139-b9a1-da36bdac7b17 with scrape type 2
2026-03-27 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29aa4a11-9a58-5139-b9a1-da36bdac7b17 with scrape type 2
2026-03-27 11:14:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29aa4a11-9a58-5139-b9a1-da36bdac7b17, identifier: TK72536
2026-03-27 11:14:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29aa4a11-9a58-5139-b9a1-da36bdac7b17 with identifier: TK72536
2026-03-27 11:14:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29aa4a11-9a58-5139-b9a1-da36bdac7b17 with identifier: TK72536
2026-03-27 11:14:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29aa4a11-9a58-5139-b9a1-da36bdac7b17 with identifier: TK72536 to the API
2026-03-27 11:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:24:58Z',
 'fuel_type': 'petrol',
 'id': '29aa4a11-9a58-5139-b9a1-da36bdac7b17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK72536',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Scala',
 'odometer': 36550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-05',
 'seller_name': None,
 'title': 'Skoda Scala 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2022}
2026-03-27 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK72536%27 HTTP/1.1" 200 None
2026-03-27 11:14:27 [auto1.de] INFO: Saving data for TK72536: {'auction_closing_time': 1774628698.0, 'created_time': 1774379357.930378, 'last_price_update_time': 1774610067.972985}
2026-03-27 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK72536') HTTP/1.1" 204 0
2026-03-27 11:14:28 [auto1.de] INFO: Found listing with ID: DZ18684
2026-03-27 11:14:28 [auto1.de] INFO: Found listing with ID: NY81640
2026-03-27 11:14:28 [auto1.de] INFO: Found listing with ID: CR34033
2026-03-27 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR34033%27 HTTP/1.1" 200 None
2026-03-27 11:14:28 [auto1.de] INFO: Scrape type for CR34033: 2
2026-03-27 11:14:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de54c0b4-2eb9-5ba3-a135-3e8ad7c8bc32 with identifier: CR34033
2026-03-27 11:14:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de54c0b4-2eb9-5ba3-a135-3e8ad7c8bc32 with scrape type 2
2026-03-27 11:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de54c0b4-2eb9-5ba3-a135-3e8ad7c8bc32 with scrape type 2
2026-03-27 11:14:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de54c0b4-2eb9-5ba3-a135-3e8ad7c8bc32, identifier: CR34033
2026-03-27 11:14:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de54c0b4-2eb9-5ba3-a135-3e8ad7c8bc32 with identifier: CR34033
2026-03-27 11:14:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de54c0b4-2eb9-5ba3-a135-3e8ad7c8bc32 with identifier: CR34033
2026-03-27 11:14:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de54c0b4-2eb9-5ba3-a135-3e8ad7c8bc32 with identifier: CR34033 to the API
2026-03-27 11:14:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-27T16:56:06Z',
 'fuel_type': 'diesel',
 'id': 'de54c0b4-2eb9-5ba3-a135-3e8ad7c8bc32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR34033',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 36189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2022}
2026-03-27 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR34033%27 HTTP/1.1" 200 None
2026-03-27 11:14:28 [auto1.de] INFO: Saving data for CR34033: {'auction_closing_time': 1774630566.0, 'created_time': 1774378377.614925, 'last_price_update_time': 1774610068.568616}
2026-03-27 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR34033') HTTP/1.1" 204 0
2026-03-27 11:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:14:28 [auto1.de] INFO: Found listing with ID: KX43312
2026-03-27 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX43312%27 HTTP/1.1" 200 None
2026-03-27 11:14:28 [auto1.de] INFO: Scrape type for KX43312: 2
2026-03-27 11:14:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa3063bf-0f2f-549e-b244-4f43f9ae2102 with identifier: KX43312
2026-03-27 11:14:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa3063bf-0f2f-549e-b244-4f43f9ae2102 with scrape type 2
2026-03-27 11:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa3063bf-0f2f-549e-b244-4f43f9ae2102 with scrape type 2
2026-03-27 11:14:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa3063bf-0f2f-549e-b244-4f43f9ae2102, identifier: KX43312
2026-03-27 11:14:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa3063bf-0f2f-549e-b244-4f43f9ae2102 with identifier: KX43312
2026-03-27 11:14:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa3063bf-0f2f-549e-b244-4f43f9ae2102 with identifier: KX43312
2026-03-27 11:14:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa3063bf-0f2f-549e-b244-4f43f9ae2102 with identifier: KX43312 to the API
2026-03-27 11:14:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:17:25Z',
 'fuel_type': 'petrol',
 'id': 'fa3063bf-0f2f-549e-b244-4f43f9ae2102',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX43312',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 63952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-22',
 'seller_name': None,
 'title': 'Audi A3 Limousine 35 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-27 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX43312%27 HTTP/1.1" 200 None
2026-03-27 11:14:29 [auto1.de] INFO: Saving data for KX43312: {'auction_closing_time': 1774628245.0, 'created_time': 1774379701.092478, 'last_price_update_time': 1774610069.044396}
2026-03-27 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX43312') HTTP/1.1" 204 0
2026-03-27 11:14:29 [auto1.de] INFO: Found listing with ID: CN14345
2026-03-27 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN14345%27 HTTP/1.1" 200 None
2026-03-27 11:14:29 [auto1.de] INFO: Scrape type for CN14345: 2
2026-03-27 11:14:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffbb78d6-184b-596e-96e3-f771a06571ce with identifier: CN14345
2026-03-27 11:14:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffbb78d6-184b-596e-96e3-f771a06571ce with scrape type 2
2026-03-27 11:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffbb78d6-184b-596e-96e3-f771a06571ce with scrape type 2
2026-03-27 11:14:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffbb78d6-184b-596e-96e3-f771a06571ce, identifier: CN14345
2026-03-27 11:14:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffbb78d6-184b-596e-96e3-f771a06571ce with identifier: CN14345
2026-03-27 11:14:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffbb78d6-184b-596e-96e3-f771a06571ce with identifier: CN14345
2026-03-27 11:14:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffbb78d6-184b-596e-96e3-f771a06571ce with identifier: CN14345 to the API
2026-03-27 11:14:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-27T16:35:46Z',
 'fuel_type': 'petrol',
 'id': 'ffbb78d6-184b-596e-96e3-f771a06571ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN14345',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S3',
 'odometer': 16570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-13',
 'seller_name': None,
 'title': 'Audi S3 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2025}
2026-03-27 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN14345%27 HTTP/1.1" 200 None
2026-03-27 11:14:29 [auto1.de] INFO: Saving data for CN14345: {'auction_closing_time': 1774629346.0, 'created_time': 1774380267.82213, 'last_price_update_time': 1774610069.729475}
2026-03-27 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN14345') HTTP/1.1" 204 0
2026-03-27 11:14:29 [auto1.de] INFO: Found listing with ID: CG19639
2026-03-27 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG19639%27 HTTP/1.1" 200 None
2026-03-27 11:14:29 [auto1.de] INFO: Scrape type for CG19639: 2
2026-03-27 11:14:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b6a4717-ed0c-5b5a-8d6b-94c9643fc92b with identifier: CG19639
2026-03-27 11:14:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b6a4717-ed0c-5b5a-8d6b-94c9643fc92b with scrape type 2
2026-03-27 11:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b6a4717-ed0c-5b5a-8d6b-94c9643fc92b with scrape type 2
2026-03-27 11:14:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b6a4717-ed0c-5b5a-8d6b-94c9643fc92b, identifier: CG19639
2026-03-27 11:14:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b6a4717-ed0c-5b5a-8d6b-94c9643fc92b with identifier: CG19639
2026-03-27 11:14:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b6a4717-ed0c-5b5a-8d6b-94c9643fc92b with identifier: CG19639
2026-03-27 11:14:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b6a4717-ed0c-5b5a-8d6b-94c9643fc92b with identifier: CG19639 to the API
2026-03-27 11:14:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:04:13Z',
 'fuel_type': 'diesel',
 'id': '3b6a4717-ed0c-5b5a-8d6b-94c9643fc92b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG19639',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 152028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-29',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-03-27 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG19639%27 HTTP/1.1" 200 None
2026-03-27 11:14:30 [auto1.de] INFO: Saving data for CG19639: {'auction_closing_time': 1774627453.0, 'created_time': 1774378651.489844, 'last_price_update_time': 1774610070.314699}
2026-03-27 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG19639') HTTP/1.1" 204 0
2026-03-27 11:14:30 [auto1.de] INFO: Channel: 24h | Page: 249 | totalHits: 10679 | hits on page: 40
2026-03-27 11:14:30 [auto1.de] INFO: Found listing with ID: PB00154
2026-03-27 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB00154%27 HTTP/1.1" 200 None
2026-03-27 11:14:30 [auto1.de] INFO: Scrape type for PB00154: 2
2026-03-27 11:14:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aef63ced-dd76-505a-aa74-c10a3ab8c15a with identifier: PB00154
2026-03-27 11:14:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aef63ced-dd76-505a-aa74-c10a3ab8c15a with scrape type 2
2026-03-27 11:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aef63ced-dd76-505a-aa74-c10a3ab8c15a with scrape type 2
2026-03-27 11:14:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aef63ced-dd76-505a-aa74-c10a3ab8c15a, identifier: PB00154
2026-03-27 11:14:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aef63ced-dd76-505a-aa74-c10a3ab8c15a with identifier: PB00154
2026-03-27 11:14:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aef63ced-dd76-505a-aa74-c10a3ab8c15a with identifier: PB00154
2026-03-27 11:14:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aef63ced-dd76-505a-aa74-c10a3ab8c15a with identifier: PB00154 to the API
2026-03-27 11:14:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-27T16:07:58Z',
 'fuel_type': 'hybrid',
 'id': 'aef63ced-dd76-505a-aa74-c10a3ab8c15a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB00154',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 17282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-13',
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-27 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB00154%27 HTTP/1.1" 200 None
2026-03-27 11:14:30 [auto1.de] INFO: Saving data for PB00154: {'auction_closing_time': 1774627678.0, 'created_time': 1774380088.037902, 'last_price_update_time': 1774610070.842134}
2026-03-27 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB00154') HTTP/1.1" 204 0
2026-03-27 11:14:30 [auto1.de] INFO: Found listing with ID: DC86001
2026-03-27 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC86001%27 HTTP/1.1" 200 None
2026-03-27 11:14:30 [auto1.de] INFO: Scrape type for DC86001: 2
2026-03-27 11:14:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 181b85f0-aaae-5756-a8c0-4bee5f697971 with identifier: DC86001
2026-03-27 11:14:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 181b85f0-aaae-5756-a8c0-4bee5f697971 with scrape type 2
2026-03-27 11:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 181b85f0-aaae-5756-a8c0-4bee5f697971 with scrape type 2
2026-03-27 11:14:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 181b85f0-aaae-5756-a8c0-4bee5f697971, identifier: DC86001
2026-03-27 11:14:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:14:30 [auto1.de] INFO: Found listing with ID: LE38537
2026-03-27 11:14:30 [auto1.de] INFO: Found listing with ID: VU25989
2026-03-27 11:14:30 [auto1.de] INFO: Found listing with ID: VK80269
2026-03-27 11:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK80269%27 HTTP/1.1" 200 None
2026-03-27 11:14:31 [auto1.de] INFO: Scrape type for VK80269: 2
2026-03-27 11:14:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0a5f268-9849-5d95-814b-4a03d612efc5 with identifier: VK80269
2026-03-27 11:14:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0a5f268-9849-5d95-814b-4a03d612efc5 with scrape type 2
2026-03-27 11:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0a5f268-9849-5d95-814b-4a03d612efc5 with scrape type 2
2026-03-27 11:14:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0a5f268-9849-5d95-814b-4a03d612efc5, identifier: VK80269
2026-03-27 11:14:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 181b85f0-aaae-5756-a8c0-4bee5f697971 with identifier: DC86001
2026-03-27 11:14:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 181b85f0-aaae-5756-a8c0-4bee5f697971 with identifier: DC86001
2026-03-27 11:14:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 181b85f0-aaae-5756-a8c0-4bee5f697971 with identifier: DC86001 to the API
2026-03-27 11:14:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-27T16:45:04Z',
 'fuel_type': 'petrol',
 'id': '181b85f0-aaae-5756-a8c0-4bee5f697971',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC86001',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 9160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-05-21',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 B4 Mild-Hybrid Ultra Black Edition 2WD',
 'transmission': 'automatic',
 'trim': 'Ultra Black Edition 2WD',
 'year': 2025}
2026-03-27 11:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC86001%27 HTTP/1.1" 200 None
2026-03-27 11:14:31 [auto1.de] INFO: Saving data for DC86001: {'auction_closing_time': 1774629904.0, 'created_time': 1774265071.789892, 'last_price_update_time': 1774610071.845149}
2026-03-27 11:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC86001') HTTP/1.1" 204 0
2026-03-27 11:14:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0a5f268-9849-5d95-814b-4a03d612efc5 with identifier: VK80269
2026-03-27 11:14:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0a5f268-9849-5d95-814b-4a03d612efc5 with identifier: VK80269
2026-03-27 11:14:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0a5f268-9849-5d95-814b-4a03d612efc5 with identifier: VK80269 to the API
2026-03-27 11:14:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:44:57Z',
 'fuel_type': 'diesel',
 'id': 'a0a5f268-9849-5d95-814b-4a03d612efc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK80269',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 125401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-22',
 'seller_name': None,
 'title': 'BMW 3er 320d xDrive M Sport Shadow',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport Shadow',
 'year': 2018}
2026-03-27 11:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK80269%27 HTTP/1.1" 200 None
2026-03-27 11:14:32 [auto1.de] INFO: Saving data for VK80269: {'auction_closing_time': 1774629897.0, 'created_time': 1774521732.587345, 'last_price_update_time': 1774610072.486764}
2026-03-27 11:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK80269') HTTP/1.1" 204 0
2026-03-27 11:14:32 [auto1.de] INFO: Found listing with ID: WL99589
2026-03-27 11:14:32 [auto1.de] INFO: Found listing with ID: UH26172
2026-03-27 11:14:32 [auto1.de] INFO: Found listing with ID: BJ83438
2026-03-27 11:14:32 [auto1.de] INFO: Found listing with ID: SA01659
2026-03-27 11:14:32 [auto1.de] INFO: Found listing with ID: CW06594
2026-03-27 11:14:32 [auto1.de] INFO: Found listing with ID: LB83317
2026-03-27 11:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB83317%27 HTTP/1.1" 200 None
2026-03-27 11:14:32 [auto1.de] INFO: Scrape type for LB83317: 2
2026-03-27 11:14:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03354952-0d29-5c9f-871f-cec7b3b440b0 with identifier: LB83317
2026-03-27 11:14:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03354952-0d29-5c9f-871f-cec7b3b440b0 with scrape type 2
2026-03-27 11:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03354952-0d29-5c9f-871f-cec7b3b440b0 with scrape type 2
2026-03-27 11:14:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03354952-0d29-5c9f-871f-cec7b3b440b0, identifier: LB83317
2026-03-27 11:14:32 [auto1.de] INFO: Found listing with ID: RP43844
2026-03-27 11:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP43844%27 HTTP/1.1" 200 None
2026-03-27 11:14:32 [auto1.de] INFO: Scrape type for RP43844: 2
2026-03-27 11:14:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 088df3e3-9235-5b9d-a75d-1adfcfabf07a with identifier: RP43844
2026-03-27 11:14:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 088df3e3-9235-5b9d-a75d-1adfcfabf07a with scrape type 2
2026-03-27 11:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 088df3e3-9235-5b9d-a75d-1adfcfabf07a with scrape type 2
2026-03-27 11:14:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 088df3e3-9235-5b9d-a75d-1adfcfabf07a, identifier: RP43844
2026-03-27 11:14:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03354952-0d29-5c9f-871f-cec7b3b440b0 with identifier: LB83317
2026-03-27 11:14:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03354952-0d29-5c9f-871f-cec7b3b440b0 with identifier: LB83317
2026-03-27 11:14:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03354952-0d29-5c9f-871f-cec7b3b440b0 with identifier: LB83317 to the API
2026-03-27 11:14:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:40:39Z',
 'fuel_type': 'diesel',
 'id': '03354952-0d29-5c9f-871f-cec7b3b440b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB83317',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 121219,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-30',
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TDI Xperience',
 'transmission': 'automatic',
 'trim': 'Xperience',
 'year': 2022}
2026-03-27 11:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB83317%27 HTTP/1.1" 200 None
2026-03-27 11:14:33 [auto1.de] INFO: Saving data for LB83317: {'auction_closing_time': 1774629639.0, 'created_time': 1774378283.912131, 'last_price_update_time': 1774610073.280244}
2026-03-27 11:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB83317') HTTP/1.1" 204 0
2026-03-27 11:14:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 088df3e3-9235-5b9d-a75d-1adfcfabf07a with identifier: RP43844
2026-03-27 11:14:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 088df3e3-9235-5b9d-a75d-1adfcfabf07a with identifier: RP43844
2026-03-27 11:14:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 088df3e3-9235-5b9d-a75d-1adfcfabf07a with identifier: RP43844 to the API
2026-03-27 11:14:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-27T16:47:04Z',
 'fuel_type': 'diesel',
 'id': '088df3e3-9235-5b9d-a75d-1adfcfabf07a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP43844',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 242153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-26',
 'seller_name': None,
 'title': 'Ford S-Max 2.2 TDCi Titanium S',
 'transmission': 'manual',
 'trim': 'Titanium S',
 'year': 2009}
2026-03-27 11:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP43844%27 HTTP/1.1" 200 None
2026-03-27 11:14:33 [auto1.de] INFO: Saving data for RP43844: {'auction_closing_time': 1774630024.0, 'created_time': 1774521789.034606, 'last_price_update_time': 1774610073.809457}
2026-03-27 11:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP43844') HTTP/1.1" 204 0
2026-03-27 11:14:33 [auto1.de] INFO: Found listing with ID: UL01231
2026-03-27 11:14:33 [auto1.de] INFO: Found listing with ID: ZE05640
2026-03-27 11:14:33 [auto1.de] INFO: Found listing with ID: FN74519
2026-03-27 11:14:33 [auto1.de] INFO: Found listing with ID: KA72514
2026-03-27 11:14:33 [auto1.de] INFO: Found listing with ID: JD37588
2026-03-27 11:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD37588%27 HTTP/1.1" 200 None
2026-03-27 11:14:33 [auto1.de] INFO: Scrape type for JD37588: 2
2026-03-27 11:14:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26aeebb4-b92a-5204-b997-d138b5f59f50 with identifier: JD37588
2026-03-27 11:14:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26aeebb4-b92a-5204-b997-d138b5f59f50 with scrape type 2
2026-03-27 11:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26aeebb4-b92a-5204-b997-d138b5f59f50 with scrape type 2
2026-03-27 11:14:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26aeebb4-b92a-5204-b997-d138b5f59f50, identifier: JD37588
2026-03-27 11:14:33 [auto1.de] INFO: Found listing with ID: EU38402
2026-03-27 11:14:33 [auto1.de] INFO: Found listing with ID: FY99153
2026-03-27 11:14:33 [auto1.de] INFO: Found listing with ID: UA59950
2026-03-27 11:14:33 [auto1.de] INFO: Found listing with ID: XC67226
2026-03-27 11:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC67226%27 HTTP/1.1" 200 None
2026-03-27 11:14:33 [auto1.de] INFO: Scrape type for XC67226: 2
2026-03-27 11:14:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac7448ae-c3ad-57fe-91ed-618f9cd516ce with identifier: XC67226
2026-03-27 11:14:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac7448ae-c3ad-57fe-91ed-618f9cd516ce with scrape type 2
2026-03-27 11:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac7448ae-c3ad-57fe-91ed-618f9cd516ce with scrape type 2
2026-03-27 11:14:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac7448ae-c3ad-57fe-91ed-618f9cd516ce, identifier: XC67226
2026-03-27 11:14:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26aeebb4-b92a-5204-b997-d138b5f59f50 with identifier: JD37588
2026-03-27 11:14:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26aeebb4-b92a-5204-b997-d138b5f59f50 with identifier: JD37588
2026-03-27 11:14:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26aeebb4-b92a-5204-b997-d138b5f59f50 with identifier: JD37588 to the API
2026-03-27 11:14:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-27T16:10:29Z',
 'fuel_type': 'diesel',
 'id': '26aeebb4-b92a-5204-b997-d138b5f59f50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD37588',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 46303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-08',
 'seller_name': None,
 'title': 'Audi A4 40 TDI Mild-Hybrid quattro advanced',
 'transmission': 'automatic',
 'trim': 'quattro advanced',
 'year': 2023}
2026-03-27 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD37588%27 HTTP/1.1" 200 None
2026-03-27 11:14:34 [auto1.de] INFO: Saving data for JD37588: {'auction_closing_time': 1774627829.0, 'created_time': 1774378372.801906, 'last_price_update_time': 1774610074.628273}
2026-03-27 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD37588') HTTP/1.1" 204 0
2026-03-27 11:14:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac7448ae-c3ad-57fe-91ed-618f9cd516ce with identifier: XC67226
2026-03-27 11:14:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac7448ae-c3ad-57fe-91ed-618f9cd516ce with identifier: XC67226
2026-03-27 11:14:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac7448ae-c3ad-57fe-91ed-618f9cd516ce with identifier: XC67226 to the API
2026-03-27 11:14:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:48:41Z',
 'fuel_type': 'petrol',
 'id': 'ac7448ae-c3ad-57fe-91ed-618f9cd516ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC67226',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 74122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-11',
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TSI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2020}
2026-03-27 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC67226%27 HTTP/1.1" 200 None
2026-03-27 11:14:35 [auto1.de] INFO: Saving data for XC67226: {'auction_closing_time': 1774630121.0, 'created_time': 1774521747.744556, 'last_price_update_time': 1774610075.167457}
2026-03-27 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC67226') HTTP/1.1" 204 0
2026-03-27 11:14:35 [auto1.de] INFO: Found listing with ID: RN45358
2026-03-27 11:14:35 [auto1.de] INFO: Found listing with ID: ZD66624
2026-03-27 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD66624%27 HTTP/1.1" 200 None
2026-03-27 11:14:35 [auto1.de] INFO: Scrape type for ZD66624: 2
2026-03-27 11:14:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbd47751-44ca-52c0-89eb-f3e3b6101db6 with identifier: ZD66624
2026-03-27 11:14:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbd47751-44ca-52c0-89eb-f3e3b6101db6 with scrape type 2
2026-03-27 11:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbd47751-44ca-52c0-89eb-f3e3b6101db6 with scrape type 2
2026-03-27 11:14:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbd47751-44ca-52c0-89eb-f3e3b6101db6, identifier: ZD66624
2026-03-27 11:14:35 [auto1.de] INFO: Found listing with ID: WN23452
2026-03-27 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN23452%27 HTTP/1.1" 200 None
2026-03-27 11:14:35 [auto1.de] INFO: Scrape type for WN23452: 0
2026-03-27 11:14:35 [auto1.de] INFO: Found listing with ID: DW05211
2026-03-27 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW05211%27 HTTP/1.1" 200 None
2026-03-27 11:14:35 [auto1.de] INFO: Scrape type for DW05211: 2
2026-03-27 11:14:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4775d05d-cad3-522a-8687-67eaae32a76c with identifier: DW05211
2026-03-27 11:14:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4775d05d-cad3-522a-8687-67eaae32a76c with scrape type 2
2026-03-27 11:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4775d05d-cad3-522a-8687-67eaae32a76c with scrape type 2
2026-03-27 11:14:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4775d05d-cad3-522a-8687-67eaae32a76c, identifier: DW05211
2026-03-27 11:14:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbd47751-44ca-52c0-89eb-f3e3b6101db6 with identifier: ZD66624
2026-03-27 11:14:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbd47751-44ca-52c0-89eb-f3e3b6101db6 with identifier: ZD66624
2026-03-27 11:14:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbd47751-44ca-52c0-89eb-f3e3b6101db6 with identifier: ZD66624 to the API
2026-03-27 11:14:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 344,
 'expiration_date': '2026-03-27T16:14:24Z',
 'fuel_type': 'diesel',
 'id': 'cbd47751-44ca-52c0-89eb-f3e3b6101db6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD66624',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S6',
 'odometer': 48511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-26',
 'seller_name': None,
 'title': 'Audi S6 3.0 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2023}
2026-03-27 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD66624%27 HTTP/1.1" 200 None
2026-03-27 11:14:35 [auto1.de] INFO: Saving data for ZD66624: {'auction_closing_time': 1774628064.0, 'created_time': 1774379142.563086, 'last_price_update_time': 1774610075.90569}
2026-03-27 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD66624') HTTP/1.1" 204 0
2026-03-27 11:14:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4775d05d-cad3-522a-8687-67eaae32a76c with identifier: DW05211
2026-03-27 11:14:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4775d05d-cad3-522a-8687-67eaae32a76c with identifier: DW05211
2026-03-27 11:14:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4775d05d-cad3-522a-8687-67eaae32a76c with identifier: DW05211 to the API
2026-03-27 11:14:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-27T16:46:46Z',
 'fuel_type': 'diesel',
 'id': '4775d05d-cad3-522a-8687-67eaae32a76c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW05211',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 238483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-18',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi BOSE-Edition',
 'transmission': 'automatic',
 'trim': 'BOSE-Edition',
 'year': 2020}
2026-03-27 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW05211%27 HTTP/1.1" 200 None
2026-03-27 11:14:36 [auto1.de] INFO: Saving data for DW05211: {'auction_closing_time': 1774630006.0, 'created_time': 1774521710.379405, 'last_price_update_time': 1774610076.347762}
2026-03-27 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW05211') HTTP/1.1" 204 0
2026-03-27 11:14:36 [auto1.de] INFO: Found listing with ID: NT32461
2026-03-27 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT32461%27 HTTP/1.1" 200 None
2026-03-27 11:14:36 [auto1.de] INFO: Scrape type for NT32461: 2
2026-03-27 11:14:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74c7cd01-2cec-5dc1-84a8-624803c396c9 with identifier: NT32461
2026-03-27 11:14:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74c7cd01-2cec-5dc1-84a8-624803c396c9 with scrape type 2
2026-03-27 11:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74c7cd01-2cec-5dc1-84a8-624803c396c9 with scrape type 2
2026-03-27 11:14:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74c7cd01-2cec-5dc1-84a8-624803c396c9, identifier: NT32461
2026-03-27 11:14:36 [auto1.de] INFO: Found listing with ID: UE61705
2026-03-27 11:14:36 [auto1.de] INFO: Found listing with ID: KY92219
2026-03-27 11:14:36 [auto1.de] INFO: Found listing with ID: FG50189
2026-03-27 11:14:36 [auto1.de] INFO: Found listing with ID: WS77403
2026-03-27 11:14:36 [auto1.de] INFO: Found listing with ID: AK23764
2026-03-27 11:14:36 [auto1.de] INFO: Found listing with ID: WJ03890
2026-03-27 11:14:36 [auto1.de] INFO: Found listing with ID: XK33490
2026-03-27 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK33490%27 HTTP/1.1" 200 None
2026-03-27 11:14:36 [auto1.de] INFO: Scrape type for XK33490: 2
2026-03-27 11:14:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 653584ff-c1e3-5e4e-985b-b7fb4c81b7f1 with identifier: XK33490
2026-03-27 11:14:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 653584ff-c1e3-5e4e-985b-b7fb4c81b7f1 with scrape type 2
2026-03-27 11:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 653584ff-c1e3-5e4e-985b-b7fb4c81b7f1 with scrape type 2
2026-03-27 11:14:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 653584ff-c1e3-5e4e-985b-b7fb4c81b7f1, identifier: XK33490
2026-03-27 11:14:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74c7cd01-2cec-5dc1-84a8-624803c396c9 with identifier: NT32461
2026-03-27 11:14:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74c7cd01-2cec-5dc1-84a8-624803c396c9 with identifier: NT32461
2026-03-27 11:14:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74c7cd01-2cec-5dc1-84a8-624803c396c9 with identifier: NT32461 to the API
2026-03-27 11:14:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:39:48Z',
 'fuel_type': 'diesel',
 'id': '74c7cd01-2cec-5dc1-84a8-624803c396c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT32461',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 126297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-21',
 'seller_name': None,
 'title': 'Skoda Karoq 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2022}
2026-03-27 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT32461%27 HTTP/1.1" 200 None
2026-03-27 11:14:36 [auto1.de] INFO: Saving data for NT32461: {'auction_closing_time': 1774629588.0, 'created_time': 1774379500.234028, 'last_price_update_time': 1774610076.986379}
2026-03-27 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT32461') HTTP/1.1" 204 0
2026-03-27 11:14:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 653584ff-c1e3-5e4e-985b-b7fb4c81b7f1 with identifier: XK33490
2026-03-27 11:14:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 653584ff-c1e3-5e4e-985b-b7fb4c81b7f1 with identifier: XK33490
2026-03-27 11:14:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 653584ff-c1e3-5e4e-985b-b7fb4c81b7f1 with identifier: XK33490 to the API
2026-03-27 11:14:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:50:40Z',
 'fuel_type': 'petrol',
 'id': '653584ff-c1e3-5e4e-985b-b7fb4c81b7f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK33490',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 56717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-19',
 'seller_name': None,
 'title': 'Seat Alhambra 1.4 TSI FR-Line',
 'transmission': 'automatic',
 'trim': 'FR-Line',
 'year': 2019}
2026-03-27 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK33490%27 HTTP/1.1" 200 None
2026-03-27 11:14:37 [auto1.de] INFO: Saving data for XK33490: {'auction_closing_time': 1774630240.0, 'created_time': 1774521697.438965, 'last_price_update_time': 1774610077.537524}
2026-03-27 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK33490') HTTP/1.1" 204 0
2026-03-27 11:14:37 [auto1.de] INFO: Found listing with ID: DF94308
2026-03-27 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF94308%27 HTTP/1.1" 200 None
2026-03-27 11:14:37 [auto1.de] INFO: Scrape type for DF94308: 2
2026-03-27 11:14:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f with identifier: DF94308
2026-03-27 11:14:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f with scrape type 2
2026-03-27 11:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f with scrape type 2
2026-03-27 11:14:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f, identifier: DF94308
2026-03-27 11:14:37 [auto1.de] INFO: Found listing with ID: DW75560
2026-03-27 11:14:37 [auto1.de] INFO: Found listing with ID: HJ11711
2026-03-27 11:14:37 [auto1.de] INFO: Found listing with ID: KD22825
2026-03-27 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD22825%27 HTTP/1.1" 200 None
2026-03-27 11:14:37 [auto1.de] INFO: Scrape type for KD22825: 2
2026-03-27 11:14:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1044cfb6-a292-59db-9b35-a54d490db463 with identifier: KD22825
2026-03-27 11:14:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1044cfb6-a292-59db-9b35-a54d490db463 with scrape type 2
2026-03-27 11:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1044cfb6-a292-59db-9b35-a54d490db463 with scrape type 2
2026-03-27 11:14:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1044cfb6-a292-59db-9b35-a54d490db463, identifier: KD22825
2026-03-27 11:14:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f with identifier: DF94308
2026-03-27 11:14:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f with identifier: DF94308
2026-03-27 11:14:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f with identifier: DF94308 to the API
2026-03-27 11:14:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:13:01Z',
 'fuel_type': 'petrol',
 'id': 'a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF94308',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 135320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-27 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF94308%27 HTTP/1.1" 200 None
2026-03-27 11:14:38 [auto1.de] INFO: Saving data for DF94308: {'auction_closing_time': 1774627981.0, 'created_time': 1774521856.722234, 'last_price_update_time': 1774610078.377479}
2026-03-27 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF94308') HTTP/1.1" 204 0
2026-03-27 11:14:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1044cfb6-a292-59db-9b35-a54d490db463 with identifier: KD22825
2026-03-27 11:14:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1044cfb6-a292-59db-9b35-a54d490db463 with identifier: KD22825
2026-03-27 11:14:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1044cfb6-a292-59db-9b35-a54d490db463 with identifier: KD22825 to the API
2026-03-27 11:14:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-27T16:15:56Z',
 'fuel_type': 'petrol',
 'id': '1044cfb6-a292-59db-9b35-a54d490db463',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD22825',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 56186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-24',
 'seller_name': None,
 'title': 'Audi A6 45 TFSI Mild-Hybrid quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2022}
2026-03-27 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD22825%27 HTTP/1.1" 200 None
2026-03-27 11:14:38 [auto1.de] INFO: Saving data for KD22825: {'auction_closing_time': 1774628156.0, 'created_time': 1774379459.532744, 'last_price_update_time': 1774610078.808974}
2026-03-27 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD22825') HTTP/1.1" 204 0
2026-03-27 11:14:38 [auto1.de] INFO: Found listing with ID: GE22311
2026-03-27 11:14:38 [auto1.de] INFO: Found listing with ID: RK19274
2026-03-27 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK19274%27 HTTP/1.1" 200 None
2026-03-27 11:14:38 [auto1.de] INFO: Scrape type for RK19274: 2
2026-03-27 11:14:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57b919c0-9b44-5a09-853a-4a11ccc063f5 with identifier: RK19274
2026-03-27 11:14:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57b919c0-9b44-5a09-853a-4a11ccc063f5 with scrape type 2
2026-03-27 11:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57b919c0-9b44-5a09-853a-4a11ccc063f5 with scrape type 2
2026-03-27 11:14:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57b919c0-9b44-5a09-853a-4a11ccc063f5, identifier: RK19274
2026-03-27 11:14:38 [auto1.de] INFO: Found listing with ID: PC65158
2026-03-27 11:14:38 [auto1.de] INFO: Found listing with ID: NP46589
2026-03-27 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP46589%27 HTTP/1.1" 200 None
2026-03-27 11:14:38 [auto1.de] INFO: Scrape type for NP46589: 2
2026-03-27 11:14:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca1bcc98-8849-55f2-a537-755fbdd9d1e1 with identifier: NP46589
2026-03-27 11:14:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca1bcc98-8849-55f2-a537-755fbdd9d1e1 with scrape type 2
2026-03-27 11:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca1bcc98-8849-55f2-a537-755fbdd9d1e1 with scrape type 2
2026-03-27 11:14:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca1bcc98-8849-55f2-a537-755fbdd9d1e1, identifier: NP46589
2026-03-27 11:14:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57b919c0-9b44-5a09-853a-4a11ccc063f5 with identifier: RK19274
2026-03-27 11:14:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57b919c0-9b44-5a09-853a-4a11ccc063f5 with identifier: RK19274
2026-03-27 11:14:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57b919c0-9b44-5a09-853a-4a11ccc063f5 with identifier: RK19274 to the API
2026-03-27 11:14:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 355,
 'expiration_date': '2026-03-27T16:28:39Z',
 'fuel_type': 'petrol',
 'id': '57b919c0-9b44-5a09-853a-4a11ccc063f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK19274',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 115865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-15',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-27 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK19274%27 HTTP/1.1" 200 None
2026-03-27 11:14:39 [auto1.de] INFO: Saving data for RK19274: {'auction_closing_time': 1774628919.0, 'created_time': 1773136724.122623, 'last_price_update_time': 1774610079.533646}
2026-03-27 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK19274') HTTP/1.1" 204 0
2026-03-27 11:14:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca1bcc98-8849-55f2-a537-755fbdd9d1e1 with identifier: NP46589
2026-03-27 11:14:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca1bcc98-8849-55f2-a537-755fbdd9d1e1 with identifier: NP46589
2026-03-27 11:14:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca1bcc98-8849-55f2-a537-755fbdd9d1e1 with identifier: NP46589 to the API
2026-03-27 11:14:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 326,
 'expiration_date': '2026-03-27T16:19:24Z',
 'fuel_type': 'diesel',
 'id': 'ca1bcc98-8849-55f2-a537-755fbdd9d1e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP46589',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 98865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-13',
 'seller_name': None,
 'title': 'BMW X3 M40d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-27 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP46589%27 HTTP/1.1" 200 None
2026-03-27 11:14:39 [auto1.de] INFO: Saving data for NP46589: {'auction_closing_time': 1774628364.0, 'created_time': 1774521713.523712, 'last_price_update_time': 1774610079.896532}
2026-03-27 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP46589') HTTP/1.1" 204 0
2026-03-27 11:14:39 [auto1.de] INFO: Found listing with ID: BZ43557
2026-03-27 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ43557%27 HTTP/1.1" 200 None
2026-03-27 11:14:39 [auto1.de] INFO: Scrape type for BZ43557: 2
2026-03-27 11:14:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 821d7450-7ec0-5b0a-8f0f-84eb282b52e9 with identifier: BZ43557
2026-03-27 11:14:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 821d7450-7ec0-5b0a-8f0f-84eb282b52e9 with scrape type 2
2026-03-27 11:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 821d7450-7ec0-5b0a-8f0f-84eb282b52e9 with scrape type 2
2026-03-27 11:14:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 821d7450-7ec0-5b0a-8f0f-84eb282b52e9, identifier: BZ43557
2026-03-27 11:14:40 [auto1.de] INFO: Found listing with ID: DT77456
2026-03-27 11:14:40 [auto1.de] INFO: Found listing with ID: KF25894
2026-03-27 11:14:40 [auto1.de] INFO: Found listing with ID: CM49859
2026-03-27 11:14:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 821d7450-7ec0-5b0a-8f0f-84eb282b52e9 with identifier: BZ43557
2026-03-27 11:14:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 821d7450-7ec0-5b0a-8f0f-84eb282b52e9 with identifier: BZ43557
2026-03-27 11:14:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 821d7450-7ec0-5b0a-8f0f-84eb282b52e9 with identifier: BZ43557 to the API
2026-03-27 11:14:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-27T16:03:54Z',
 'fuel_type': 'hybrid',
 'id': '821d7450-7ec0-5b0a-8f0f-84eb282b52e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ43557',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 62144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-01',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.4 eHybrid Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-03-27 11:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ43557%27 HTTP/1.1" 200 None
2026-03-27 11:14:40 [auto1.de] INFO: Saving data for BZ43557: {'auction_closing_time': 1774627434.0, 'created_time': 1774378473.40098, 'last_price_update_time': 1774610080.511128}
2026-03-27 11:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ43557') HTTP/1.1" 204 0
2026-03-27 11:14:40 [auto1.de] INFO: Found listing with ID: CZ58096
2026-03-27 11:14:40 [auto1.de] INFO: Found listing with ID: BN07386
2026-03-27 11:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN07386%27 HTTP/1.1" 200 None
2026-03-27 11:14:40 [auto1.de] INFO: Scrape type for BN07386: 2
2026-03-27 11:14:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2626c29d-9e29-5f20-a0bb-692fe754724e with identifier: BN07386
2026-03-27 11:14:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2626c29d-9e29-5f20-a0bb-692fe754724e with scrape type 2
2026-03-27 11:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2626c29d-9e29-5f20-a0bb-692fe754724e with scrape type 2
2026-03-27 11:14:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2626c29d-9e29-5f20-a0bb-692fe754724e, identifier: BN07386
2026-03-27 11:14:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2626c29d-9e29-5f20-a0bb-692fe754724e with identifier: BN07386
2026-03-27 11:14:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2626c29d-9e29-5f20-a0bb-692fe754724e with identifier: BN07386
2026-03-27 11:14:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2626c29d-9e29-5f20-a0bb-692fe754724e with identifier: BN07386 to the API
2026-03-27 11:14:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:07:30Z',
 'fuel_type': 'petrol',
 'id': '2626c29d-9e29-5f20-a0bb-692fe754724e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN07386',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Mii',
 'odometer': 155573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-12',
 'seller_name': None,
 'title': 'Seat Mii 1.0 Style Salsa',
 'transmission': 'manual',
 'trim': 'Style Salsa',
 'year': 2013}
2026-03-27 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN07386%27 HTTP/1.1" 200 None
2026-03-27 11:14:41 [auto1.de] INFO: Saving data for BN07386: {'auction_closing_time': 1774627650.0, 'created_time': 1774521929.346643, 'last_price_update_time': 1774610081.311332}
2026-03-27 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN07386') HTTP/1.1" 204 0
2026-03-27 11:14:41 [auto1.de] INFO: Found listing with ID: AV92816
2026-03-27 11:14:41 [auto1.de] INFO: Found listing with ID: FL49784
2026-03-27 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL49784%27 HTTP/1.1" 200 None
2026-03-27 11:14:41 [auto1.de] INFO: Scrape type for FL49784: 2
2026-03-27 11:14:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fc41889-ff96-560c-8a94-6d90ef208b28 with identifier: FL49784
2026-03-27 11:14:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fc41889-ff96-560c-8a94-6d90ef208b28 with scrape type 2
2026-03-27 11:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fc41889-ff96-560c-8a94-6d90ef208b28 with scrape type 2
2026-03-27 11:14:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fc41889-ff96-560c-8a94-6d90ef208b28, identifier: FL49784
2026-03-27 11:14:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fc41889-ff96-560c-8a94-6d90ef208b28 with identifier: FL49784
2026-03-27 11:14:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fc41889-ff96-560c-8a94-6d90ef208b28 with identifier: FL49784
2026-03-27 11:14:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fc41889-ff96-560c-8a94-6d90ef208b28 with identifier: FL49784 to the API
2026-03-27 11:14:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-27T16:39:23Z',
 'fuel_type': 'hybrid',
 'id': '1fc41889-ff96-560c-8a94-6d90ef208b28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL49784',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 63594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-24',
 'seller_name': None,
 'title': 'Kia Niro 1.6 Hybrid Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2017}
2026-03-27 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL49784%27 HTTP/1.1" 200 None
2026-03-27 11:14:41 [auto1.de] INFO: Saving data for FL49784: {'auction_closing_time': 1774629563.0, 'created_time': 1774521867.581167, 'last_price_update_time': 1774610081.813909}
2026-03-27 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL49784') HTTP/1.1" 204 0
2026-03-27 11:14:41 [auto1.de] INFO: Found listing with ID: PX94808
2026-03-27 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX94808%27 HTTP/1.1" 200 None
2026-03-27 11:14:41 [auto1.de] INFO: Scrape type for PX94808: 2
2026-03-27 11:14:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f50b661f-08a8-5cca-8d75-d5d0b68646b7 with identifier: PX94808
2026-03-27 11:14:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f50b661f-08a8-5cca-8d75-d5d0b68646b7 with scrape type 2
2026-03-27 11:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f50b661f-08a8-5cca-8d75-d5d0b68646b7 with scrape type 2
2026-03-27 11:14:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f50b661f-08a8-5cca-8d75-d5d0b68646b7, identifier: PX94808
2026-03-27 11:14:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f50b661f-08a8-5cca-8d75-d5d0b68646b7 with identifier: PX94808
2026-03-27 11:14:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f50b661f-08a8-5cca-8d75-d5d0b68646b7 with identifier: PX94808
2026-03-27 11:14:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f50b661f-08a8-5cca-8d75-d5d0b68646b7 with identifier: PX94808 to the API
2026-03-27 11:14:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:04:11Z',
 'fuel_type': 'petrol',
 'id': 'f50b661f-08a8-5cca-8d75-d5d0b68646b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX94808',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 47410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-11',
 'seller_name': None,
 'title': 'Audi A4 35 TFSI Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-27 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX94808%27 HTTP/1.1" 200 None
2026-03-27 11:14:42 [auto1.de] INFO: Saving data for PX94808: {'auction_closing_time': 1774627451.0, 'created_time': 1774377852.264551, 'last_price_update_time': 1774610082.292686}
2026-03-27 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX94808') HTTP/1.1" 204 0
2026-03-27 11:14:42 [auto1.de] INFO: Found listing with ID: PB45130
2026-03-27 11:14:42 [auto1.de] INFO: Found listing with ID: JD22751
2026-03-27 11:14:42 [auto1.de] INFO: Found listing with ID: RU68935
2026-03-27 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU68935%27 HTTP/1.1" 200 None
2026-03-27 11:14:42 [auto1.de] INFO: Scrape type for RU68935: 2
2026-03-27 11:14:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6ba9fe0-dea6-58c5-8d9a-8d0753c915f3 with identifier: RU68935
2026-03-27 11:14:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6ba9fe0-dea6-58c5-8d9a-8d0753c915f3 with scrape type 2
2026-03-27 11:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6ba9fe0-dea6-58c5-8d9a-8d0753c915f3 with scrape type 2
2026-03-27 11:14:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6ba9fe0-dea6-58c5-8d9a-8d0753c915f3, identifier: RU68935
2026-03-27 11:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:14:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6ba9fe0-dea6-58c5-8d9a-8d0753c915f3 with identifier: RU68935
2026-03-27 11:14:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6ba9fe0-dea6-58c5-8d9a-8d0753c915f3 with identifier: RU68935
2026-03-27 11:14:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6ba9fe0-dea6-58c5-8d9a-8d0753c915f3 with identifier: RU68935 to the API
2026-03-27 11:14:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:02:47Z',
 'fuel_type': 'petrol',
 'id': 'c6ba9fe0-dea6-58c5-8d9a-8d0753c915f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU68935',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 18299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.0 TSI Move',
 'transmission': 'manual',
 'trim': 'Move',
 'year': 2024}
2026-03-27 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU68935%27 HTTP/1.1" 200 None
2026-03-27 11:14:42 [auto1.de] INFO: Saving data for RU68935: {'auction_closing_time': 1774627367.0, 'created_time': 1774378352.124667, 'last_price_update_time': 1774610082.826105}
2026-03-27 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU68935') HTTP/1.1" 204 0
2026-03-27 11:14:42 [auto1.de] INFO: Found listing with ID: CU78638
2026-03-27 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU78638%27 HTTP/1.1" 200 None
2026-03-27 11:14:42 [auto1.de] INFO: Scrape type for CU78638: 2
2026-03-27 11:14:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8b8945d-4073-5578-80c8-03244d61f1de with identifier: CU78638
2026-03-27 11:14:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8b8945d-4073-5578-80c8-03244d61f1de with scrape type 2
2026-03-27 11:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8b8945d-4073-5578-80c8-03244d61f1de with scrape type 2
2026-03-27 11:14:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8b8945d-4073-5578-80c8-03244d61f1de, identifier: CU78638
2026-03-27 11:14:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8b8945d-4073-5578-80c8-03244d61f1de with identifier: CU78638
2026-03-27 11:14:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8b8945d-4073-5578-80c8-03244d61f1de with identifier: CU78638
2026-03-27 11:14:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8b8945d-4073-5578-80c8-03244d61f1de with identifier: CU78638 to the API
2026-03-27 11:14:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:06:50Z',
 'fuel_type': 'petrol',
 'id': 'f8b8945d-4073-5578-80c8-03244d61f1de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU78638',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 142623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-08',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2015}
2026-03-27 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU78638%27 HTTP/1.1" 200 None
2026-03-27 11:14:43 [auto1.de] INFO: Saving data for CU78638: {'auction_closing_time': 1774627610.0, 'created_time': 1774521797.967337, 'last_price_update_time': 1774610083.374805}
2026-03-27 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU78638') HTTP/1.1" 204 0
2026-03-27 11:14:43 [auto1.de] INFO: Found listing with ID: WM73178
2026-03-27 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM73178%27 HTTP/1.1" 200 None
2026-03-27 11:14:43 [auto1.de] INFO: Scrape type for WM73178: 2
2026-03-27 11:14:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15c31bd6-b9d7-512a-9658-2b1041c2609d with identifier: WM73178
2026-03-27 11:14:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15c31bd6-b9d7-512a-9658-2b1041c2609d with scrape type 2
2026-03-27 11:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15c31bd6-b9d7-512a-9658-2b1041c2609d with scrape type 2
2026-03-27 11:14:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15c31bd6-b9d7-512a-9658-2b1041c2609d, identifier: WM73178
2026-03-27 11:14:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15c31bd6-b9d7-512a-9658-2b1041c2609d with identifier: WM73178
2026-03-27 11:14:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15c31bd6-b9d7-512a-9658-2b1041c2609d with identifier: WM73178
2026-03-27 11:14:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15c31bd6-b9d7-512a-9658-2b1041c2609d with identifier: WM73178 to the API
2026-03-27 11:14:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 69,
 'expiration_date': '2026-03-27T16:58:55Z',
 'fuel_type': 'petrol',
 'id': '15c31bd6-b9d7-512a-9658-2b1041c2609d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM73178',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 49980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-12',
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2023}
2026-03-27 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM73178%27 HTTP/1.1" 200 None
2026-03-27 11:14:44 [auto1.de] INFO: Saving data for WM73178: {'auction_closing_time': 1774630735.0, 'created_time': 1774521845.029763, 'last_price_update_time': 1774610084.307998}
2026-03-27 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM73178') HTTP/1.1" 204 0
2026-03-27 11:14:44 [auto1.de] INFO: Channel: 24h | Page: 250 | totalHits: 10681 | hits on page: 40
2026-03-27 11:14:44 [auto1.de] INFO: Found listing with ID: XK41528
2026-03-27 11:14:44 [auto1.de] INFO: Found listing with ID: PG60395
2026-03-27 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG60395%27 HTTP/1.1" 200 None
2026-03-27 11:14:44 [auto1.de] INFO: Scrape type for PG60395: 2
2026-03-27 11:14:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae38f945-b0fd-5c10-80ca-c504a826b940 with identifier: PG60395
2026-03-27 11:14:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae38f945-b0fd-5c10-80ca-c504a826b940 with scrape type 2
2026-03-27 11:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae38f945-b0fd-5c10-80ca-c504a826b940 with scrape type 2
2026-03-27 11:14:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae38f945-b0fd-5c10-80ca-c504a826b940, identifier: PG60395
2026-03-27 11:14:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae38f945-b0fd-5c10-80ca-c504a826b940 with identifier: PG60395
2026-03-27 11:14:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae38f945-b0fd-5c10-80ca-c504a826b940 with identifier: PG60395
2026-03-27 11:14:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae38f945-b0fd-5c10-80ca-c504a826b940 with identifier: PG60395 to the API
2026-03-27 11:14:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:22:33Z',
 'fuel_type': 'petrol',
 'id': 'ae38f945-b0fd-5c10-80ca-c504a826b940',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG60395',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 17446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-19',
 'seller_name': None,
 'title': 'Renault Captur 1.3 TCe Mild-Hybrid Evolution',
 'transmission': 'automatic',
 'trim': 'Evolution',
 'year': 2023}
2026-03-27 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG60395%27 HTTP/1.1" 200 None
2026-03-27 11:14:44 [auto1.de] INFO: Saving data for PG60395: {'auction_closing_time': 1774628553.0, 'created_time': 1774521844.156974, 'last_price_update_time': 1774610084.946749}
2026-03-27 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG60395') HTTP/1.1" 204 0
2026-03-27 11:14:45 [auto1.de] INFO: Found listing with ID: EP51043
2026-03-27 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP51043%27 HTTP/1.1" 200 None
2026-03-27 11:14:45 [auto1.de] INFO: Scrape type for EP51043: 2
2026-03-27 11:14:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 450cffe2-f932-5715-bfd0-874233206589 with identifier: EP51043
2026-03-27 11:14:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 450cffe2-f932-5715-bfd0-874233206589 with scrape type 2
2026-03-27 11:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 450cffe2-f932-5715-bfd0-874233206589 with scrape type 2
2026-03-27 11:14:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 450cffe2-f932-5715-bfd0-874233206589, identifier: EP51043
2026-03-27 11:14:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:14:45 [auto1.de] INFO: Found listing with ID: YP81287
2026-03-27 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP81287%27 HTTP/1.1" 200 None
2026-03-27 11:14:45 [auto1.de] INFO: Scrape type for YP81287: 2
2026-03-27 11:14:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0e62444-6b8e-5f66-b51c-c50bd5c2c103 with identifier: YP81287
2026-03-27 11:14:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0e62444-6b8e-5f66-b51c-c50bd5c2c103 with scrape type 2
2026-03-27 11:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0e62444-6b8e-5f66-b51c-c50bd5c2c103 with scrape type 2
2026-03-27 11:14:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0e62444-6b8e-5f66-b51c-c50bd5c2c103, identifier: YP81287
2026-03-27 11:14:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 450cffe2-f932-5715-bfd0-874233206589 with identifier: EP51043
2026-03-27 11:14:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 450cffe2-f932-5715-bfd0-874233206589 with identifier: EP51043
2026-03-27 11:14:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 450cffe2-f932-5715-bfd0-874233206589 with identifier: EP51043 to the API
2026-03-27 11:14:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-27T16:45:21Z',
 'fuel_type': 'petrol',
 'id': '450cffe2-f932-5715-bfd0-874233206589',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP51043',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid',
 'odometer': 178144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-26',
 'seller_name': None,
 'title': 'Skoda Rapid 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-27 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP51043%27 HTTP/1.1" 200 None
2026-03-27 11:14:45 [auto1.de] INFO: Saving data for EP51043: {'auction_closing_time': 1774629921.0, 'created_time': 1774521826.166608, 'last_price_update_time': 1774610085.653406}
2026-03-27 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP51043') HTTP/1.1" 204 0
2026-03-27 11:14:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0e62444-6b8e-5f66-b51c-c50bd5c2c103 with identifier: YP81287
2026-03-27 11:14:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0e62444-6b8e-5f66-b51c-c50bd5c2c103 with identifier: YP81287
2026-03-27 11:14:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0e62444-6b8e-5f66-b51c-c50bd5c2c103 with identifier: YP81287 to the API
2026-03-27 11:14:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 69,
 'expiration_date': '2026-03-27T16:06:51Z',
 'fuel_type': 'petrol',
 'id': 'f0e62444-6b8e-5f66-b51c-c50bd5c2c103',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP81287',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 16727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-26',
 'seller_name': None,
 'title': 'Fiat 500C 1.0 Mild-Hybrid Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2023}
2026-03-27 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP81287%27 HTTP/1.1" 200 None
2026-03-27 11:14:46 [auto1.de] INFO: Saving data for YP81287: {'auction_closing_time': 1774627611.0, 'created_time': 1774521849.795934, 'last_price_update_time': 1774610086.169877}
2026-03-27 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP81287') HTTP/1.1" 204 0
2026-03-27 11:14:46 [auto1.de] INFO: Found listing with ID: FV61169
2026-03-27 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV61169%27 HTTP/1.1" 200 None
2026-03-27 11:14:46 [auto1.de] INFO: Scrape type for FV61169: 2
2026-03-27 11:14:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad64f96e-2ea2-550d-a29c-726875bf8ae6 with identifier: FV61169
2026-03-27 11:14:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad64f96e-2ea2-550d-a29c-726875bf8ae6 with scrape type 2
2026-03-27 11:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad64f96e-2ea2-550d-a29c-726875bf8ae6 with scrape type 2
2026-03-27 11:14:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad64f96e-2ea2-550d-a29c-726875bf8ae6, identifier: FV61169
2026-03-27 11:14:46 [auto1.de] INFO: Found listing with ID: FF66760
2026-03-27 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF66760%27 HTTP/1.1" 200 None
2026-03-27 11:14:46 [auto1.de] INFO: Scrape type for FF66760: 2
2026-03-27 11:14:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bb17aab-22bd-5813-882f-1c811b8994f0 with identifier: FF66760
2026-03-27 11:14:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bb17aab-22bd-5813-882f-1c811b8994f0 with scrape type 2
2026-03-27 11:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bb17aab-22bd-5813-882f-1c811b8994f0 with scrape type 2
2026-03-27 11:14:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9bb17aab-22bd-5813-882f-1c811b8994f0, identifier: FF66760
2026-03-27 11:14:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad64f96e-2ea2-550d-a29c-726875bf8ae6 with identifier: FV61169
2026-03-27 11:14:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad64f96e-2ea2-550d-a29c-726875bf8ae6 with identifier: FV61169
2026-03-27 11:14:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad64f96e-2ea2-550d-a29c-726875bf8ae6 with identifier: FV61169 to the API
2026-03-27 11:14:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:27:24Z',
 'fuel_type': 'diesel',
 'id': 'ad64f96e-2ea2-550d-a29c-726875bf8ae6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV61169',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 42905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-17',
 'seller_name': None,
 'title': 'Fiat Ducato 2.2 M-Jet L2H2 RS: 3450 mm',
 'transmission': 'manual',
 'trim': 'L2H2 RS: 3450 mm',
 'year': 2023}
2026-03-27 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV61169%27 HTTP/1.1" 200 None
2026-03-27 11:14:46 [auto1.de] INFO: Saving data for FV61169: {'auction_closing_time': 1774628844.0, 'created_time': 1774521790.800841, 'last_price_update_time': 1774610086.933541}
2026-03-27 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV61169') HTTP/1.1" 204 0
2026-03-27 11:14:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9bb17aab-22bd-5813-882f-1c811b8994f0 with identifier: FF66760
2026-03-27 11:14:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9bb17aab-22bd-5813-882f-1c811b8994f0 with identifier: FF66760
2026-03-27 11:14:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9bb17aab-22bd-5813-882f-1c811b8994f0 with identifier: FF66760 to the API
2026-03-27 11:14:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:46:22Z',
 'fuel_type': 'diesel',
 'id': '9bb17aab-22bd-5813-882f-1c811b8994f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF66760',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 38500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-26',
 'seller_name': None,
 'title': 'Fiat Ducato 2.2 M-Jet L4H2 RS: 4035 mm',
 'transmission': 'manual',
 'trim': 'L4H2 RS: 4035 mm',
 'year': 2023}
2026-03-27 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF66760%27 HTTP/1.1" 200 None
2026-03-27 11:14:47 [auto1.de] INFO: Saving data for FF66760: {'auction_closing_time': 1774629982.0, 'created_time': 1774521819.254078, 'last_price_update_time': 1774610087.851253}
2026-03-27 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF66760') HTTP/1.1" 204 0
2026-03-27 11:14:47 [auto1.de] INFO: Found listing with ID: CA53230
2026-03-27 11:14:47 [auto1.de] INFO: Found listing with ID: ZD84444
2026-03-27 11:14:47 [auto1.de] INFO: Found listing with ID: MV65179
2026-03-27 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV65179%27 HTTP/1.1" 200 None
2026-03-27 11:14:47 [auto1.de] INFO: Scrape type for MV65179: 2
2026-03-27 11:14:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b370a501-dd20-55d3-a56f-091746c02c6f with identifier: MV65179
2026-03-27 11:14:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b370a501-dd20-55d3-a56f-091746c02c6f with scrape type 2
2026-03-27 11:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b370a501-dd20-55d3-a56f-091746c02c6f with scrape type 2
2026-03-27 11:14:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b370a501-dd20-55d3-a56f-091746c02c6f, identifier: MV65179
2026-03-27 11:14:48 [auto1.de] INFO: Found listing with ID: VN20464
2026-03-27 11:14:48 [auto1.de] INFO: Found listing with ID: NL28592
2026-03-27 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL28592%27 HTTP/1.1" 200 None
2026-03-27 11:14:48 [auto1.de] INFO: Scrape type for NL28592: 2
2026-03-27 11:14:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19358901-7cd2-551d-a992-e79a10e51eda with identifier: NL28592
2026-03-27 11:14:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19358901-7cd2-551d-a992-e79a10e51eda with scrape type 2
2026-03-27 11:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19358901-7cd2-551d-a992-e79a10e51eda with scrape type 2
2026-03-27 11:14:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19358901-7cd2-551d-a992-e79a10e51eda, identifier: NL28592
2026-03-27 11:14:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b370a501-dd20-55d3-a56f-091746c02c6f with identifier: MV65179
2026-03-27 11:14:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b370a501-dd20-55d3-a56f-091746c02c6f with identifier: MV65179
2026-03-27 11:14:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b370a501-dd20-55d3-a56f-091746c02c6f with identifier: MV65179 to the API
2026-03-27 11:14:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 241,
 'expiration_date': '2026-03-27T16:18:44Z',
 'fuel_type': 'hybrid',
 'id': 'b370a501-dd20-55d3-a56f-091746c02c6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV65179',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 40644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-27',
 'seller_name': None,
 'title': 'Jeep Compass 1.3 T4 4xe Plug-in Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2020}
2026-03-27 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV65179%27 HTTP/1.1" 200 None
2026-03-27 11:14:48 [auto1.de] INFO: Saving data for MV65179: {'auction_closing_time': 1774628324.0, 'created_time': 1774521997.556939, 'last_price_update_time': 1774610088.594167}
2026-03-27 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV65179') HTTP/1.1" 204 0
2026-03-27 11:14:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19358901-7cd2-551d-a992-e79a10e51eda with identifier: NL28592
2026-03-27 11:14:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19358901-7cd2-551d-a992-e79a10e51eda with identifier: NL28592
2026-03-27 11:14:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19358901-7cd2-551d-a992-e79a10e51eda with identifier: NL28592 to the API
2026-03-27 11:14:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-27T16:23:16Z',
 'fuel_type': 'petrol',
 'id': '19358901-7cd2-551d-a992-e79a10e51eda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL28592',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 55997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-17',
 'seller_name': None,
 'title': 'Renault Arkana 1.3 TCe R.S. Line',
 'transmission': 'automatic',
 'trim': 'R.S. Line',
 'year': 2022}
2026-03-27 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL28592%27 HTTP/1.1" 200 None
2026-03-27 11:14:48 [auto1.de] INFO: Saving data for NL28592: {'auction_closing_time': 1774628596.0, 'created_time': 1774521823.59182, 'last_price_update_time': 1774610088.965643}
2026-03-27 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL28592') HTTP/1.1" 204 0
2026-03-27 11:14:48 [auto1.de] INFO: Found listing with ID: FF74716
2026-03-27 11:14:48 [auto1.de] INFO: Found listing with ID: BU14942
2026-03-27 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU14942%27 HTTP/1.1" 200 None
2026-03-27 11:14:48 [auto1.de] INFO: Scrape type for BU14942: 2
2026-03-27 11:14:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4227124-e764-5fb5-b402-55f02a4d80a7 with identifier: BU14942
2026-03-27 11:14:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4227124-e764-5fb5-b402-55f02a4d80a7 with scrape type 2
2026-03-27 11:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4227124-e764-5fb5-b402-55f02a4d80a7 with scrape type 2
2026-03-27 11:14:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4227124-e764-5fb5-b402-55f02a4d80a7, identifier: BU14942
2026-03-27 11:14:49 [auto1.de] INFO: Found listing with ID: NH09376
2026-03-27 11:14:49 [auto1.de] INFO: Found listing with ID: FR67547
2026-03-27 11:14:49 [auto1.de] INFO: Found listing with ID: VC90079
2026-03-27 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC90079%27 HTTP/1.1" 200 None
2026-03-27 11:14:49 [auto1.de] INFO: Scrape type for VC90079: 2
2026-03-27 11:14:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e0e4c72-b6a6-52d9-ae40-607700fe1af4 with identifier: VC90079
2026-03-27 11:14:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e0e4c72-b6a6-52d9-ae40-607700fe1af4 with scrape type 2
2026-03-27 11:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e0e4c72-b6a6-52d9-ae40-607700fe1af4 with scrape type 2
2026-03-27 11:14:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e0e4c72-b6a6-52d9-ae40-607700fe1af4, identifier: VC90079
2026-03-27 11:14:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4227124-e764-5fb5-b402-55f02a4d80a7 with identifier: BU14942
2026-03-27 11:14:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4227124-e764-5fb5-b402-55f02a4d80a7 with identifier: BU14942
2026-03-27 11:14:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4227124-e764-5fb5-b402-55f02a4d80a7 with identifier: BU14942 to the API
2026-03-27 11:14:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:54:39Z',
 'fuel_type': 'petrol',
 'id': 'a4227124-e764-5fb5-b402-55f02a4d80a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU14942',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 29737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-04',
 'seller_name': None,
 'title': 'Renault Arkana 1.3 TCe Mild-Hybrid Equilibre',
 'transmission': 'automatic',
 'trim': 'Equilibre',
 'year': 2023}
2026-03-27 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU14942%27 HTTP/1.1" 200 None
2026-03-27 11:14:49 [auto1.de] INFO: Saving data for BU14942: {'auction_closing_time': 1774630479.0, 'created_time': 1774521952.848138, 'last_price_update_time': 1774610089.565191}
2026-03-27 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU14942') HTTP/1.1" 204 0
2026-03-27 11:14:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e0e4c72-b6a6-52d9-ae40-607700fe1af4 with identifier: VC90079
2026-03-27 11:14:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e0e4c72-b6a6-52d9-ae40-607700fe1af4 with identifier: VC90079
2026-03-27 11:14:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e0e4c72-b6a6-52d9-ae40-607700fe1af4 with identifier: VC90079 to the API
2026-03-27 11:14:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-27T16:07:21Z',
 'fuel_type': 'hybrid',
 'id': '7e0e4c72-b6a6-52d9-ae40-607700fe1af4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC90079',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 76530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-16',
 'seller_name': None,
 'title': 'BMW 2er 225xe Active Tourer Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2016}
2026-03-27 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC90079%27 HTTP/1.1" 200 None
2026-03-27 11:14:50 [auto1.de] INFO: Saving data for VC90079: {'auction_closing_time': 1774627641.0, 'created_time': 1774521948.6381, 'last_price_update_time': 1774610090.038288}
2026-03-27 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC90079') HTTP/1.1" 204 0
2026-03-27 11:14:50 [auto1.de] INFO: Found listing with ID: NW78421
2026-03-27 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW78421%27 HTTP/1.1" 200 None
2026-03-27 11:14:50 [auto1.de] INFO: Scrape type for NW78421: 2
2026-03-27 11:14:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7eecba8e-5ae0-5137-9c09-a5c1663b0902 with identifier: NW78421
2026-03-27 11:14:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7eecba8e-5ae0-5137-9c09-a5c1663b0902 with scrape type 2
2026-03-27 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7eecba8e-5ae0-5137-9c09-a5c1663b0902 with scrape type 2
2026-03-27 11:14:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7eecba8e-5ae0-5137-9c09-a5c1663b0902, identifier: NW78421
2026-03-27 11:14:50 [auto1.de] INFO: Found listing with ID: EP51043
2026-03-27 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP51043%27 HTTP/1.1" 200 None
2026-03-27 11:14:50 [auto1.de] INFO: Scrape type for EP51043: 0
2026-03-27 11:14:50 [auto1.de] INFO: Found listing with ID: FV61169
2026-03-27 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV61169%27 HTTP/1.1" 200 None
2026-03-27 11:14:50 [auto1.de] INFO: Scrape type for FV61169: 0
2026-03-27 11:14:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7eecba8e-5ae0-5137-9c09-a5c1663b0902 with identifier: NW78421
2026-03-27 11:14:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7eecba8e-5ae0-5137-9c09-a5c1663b0902 with identifier: NW78421
2026-03-27 11:14:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7eecba8e-5ae0-5137-9c09-a5c1663b0902 with identifier: NW78421 to the API
2026-03-27 11:14:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-27T16:42:03Z',
 'fuel_type': 'petrol',
 'id': '7eecba8e-5ae0-5137-9c09-a5c1663b0902',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW78421',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 17390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-01',
 'seller_name': None,
 'title': 'Renault Captur 1.0 TCe Equilibre',
 'transmission': 'manual',
 'trim': 'Equilibre',
 'year': 2023}
2026-03-27 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW78421%27 HTTP/1.1" 200 None
2026-03-27 11:14:50 [auto1.de] INFO: Saving data for NW78421: {'auction_closing_time': 1774629723.0, 'created_time': 1774521953.538485, 'last_price_update_time': 1774610090.678485}
2026-03-27 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW78421') HTTP/1.1" 204 0
2026-03-27 11:14:50 [auto1.de] INFO: Found listing with ID: SJ39122
2026-03-27 11:14:50 [auto1.de] INFO: Found listing with ID: MR49641
2026-03-27 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR49641%27 HTTP/1.1" 200 None
2026-03-27 11:14:50 [auto1.de] INFO: Scrape type for MR49641: 2
2026-03-27 11:14:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f86e3701-aba0-559d-b0ec-f90b77f764d2 with identifier: MR49641
2026-03-27 11:14:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f86e3701-aba0-559d-b0ec-f90b77f764d2 with scrape type 2
2026-03-27 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f86e3701-aba0-559d-b0ec-f90b77f764d2 with scrape type 2
2026-03-27 11:14:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f86e3701-aba0-559d-b0ec-f90b77f764d2, identifier: MR49641
2026-03-27 11:14:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f86e3701-aba0-559d-b0ec-f90b77f764d2 with identifier: MR49641
2026-03-27 11:14:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f86e3701-aba0-559d-b0ec-f90b77f764d2 with identifier: MR49641
2026-03-27 11:14:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f86e3701-aba0-559d-b0ec-f90b77f764d2 with identifier: MR49641 to the API
2026-03-27 11:14:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-27T16:56:07Z',
 'fuel_type': 'petrol',
 'id': 'f86e3701-aba0-559d-b0ec-f90b77f764d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR49641',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 8938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-28',
 'seller_name': None,
 'title': 'Renault Captur 1.0 TCe Equilibre',
 'transmission': 'manual',
 'trim': 'Equilibre',
 'year': 2024}
2026-03-27 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR49641%27 HTTP/1.1" 200 None
2026-03-27 11:14:51 [auto1.de] INFO: Saving data for MR49641: {'auction_closing_time': 1774630567.0, 'created_time': 1774521959.183712, 'last_price_update_time': 1774610091.432873}
2026-03-27 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR49641') HTTP/1.1" 204 0
2026-03-27 11:14:51 [auto1.de] INFO: Found listing with ID: HT99787
2026-03-27 11:14:51 [auto1.de] INFO: Found listing with ID: KA89514
2026-03-27 11:14:51 [auto1.de] INFO: Found listing with ID: GN70982
2026-03-27 11:14:51 [auto1.de] INFO: Found listing with ID: KU08485
2026-03-27 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU08485%27 HTTP/1.1" 200 None
2026-03-27 11:14:51 [auto1.de] INFO: Scrape type for KU08485: 2
2026-03-27 11:14:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6000d34a-ffa9-5150-a0b2-5e7c108e797a with identifier: KU08485
2026-03-27 11:14:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6000d34a-ffa9-5150-a0b2-5e7c108e797a with scrape type 2
2026-03-27 11:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6000d34a-ffa9-5150-a0b2-5e7c108e797a with scrape type 2
2026-03-27 11:14:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6000d34a-ffa9-5150-a0b2-5e7c108e797a, identifier: KU08485
2026-03-27 11:14:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6000d34a-ffa9-5150-a0b2-5e7c108e797a with identifier: KU08485
2026-03-27 11:14:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6000d34a-ffa9-5150-a0b2-5e7c108e797a with identifier: KU08485
2026-03-27 11:14:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6000d34a-ffa9-5150-a0b2-5e7c108e797a with identifier: KU08485 to the API
2026-03-27 11:14:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-27T16:26:51Z',
 'fuel_type': 'hybrid',
 'id': '6000d34a-ffa9-5150-a0b2-5e7c108e797a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU08485',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 7333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-20',
 'seller_name': None,
 'title': 'Renault Megane 1.6 Hybrid E-Tech Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2021}
2026-03-27 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU08485%27 HTTP/1.1" 200 None
2026-03-27 11:14:52 [auto1.de] INFO: Saving data for KU08485: {'auction_closing_time': 1774628811.0, 'created_time': 1774521950.706039, 'last_price_update_time': 1774610092.025747}
2026-03-27 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU08485') HTTP/1.1" 204 0
2026-03-27 11:14:52 [auto1.de] INFO: Found listing with ID: TF78066
2026-03-27 11:14:52 [auto1.de] INFO: Found listing with ID: BG27909
2026-03-27 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG27909%27 HTTP/1.1" 200 None
2026-03-27 11:14:52 [auto1.de] INFO: Scrape type for BG27909: 2
2026-03-27 11:14:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36c9d574-5ffb-5619-8435-005227d17693 with identifier: BG27909
2026-03-27 11:14:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c9d574-5ffb-5619-8435-005227d17693 with scrape type 2
2026-03-27 11:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36c9d574-5ffb-5619-8435-005227d17693 with scrape type 2
2026-03-27 11:14:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36c9d574-5ffb-5619-8435-005227d17693, identifier: BG27909
2026-03-27 11:14:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36c9d574-5ffb-5619-8435-005227d17693 with identifier: BG27909
2026-03-27 11:14:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36c9d574-5ffb-5619-8435-005227d17693 with identifier: BG27909
2026-03-27 11:14:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36c9d574-5ffb-5619-8435-005227d17693 with identifier: BG27909 to the API
2026-03-27 11:14:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:08:42Z',
 'fuel_type': 'petrol',
 'id': '36c9d574-5ffb-5619-8435-005227d17693',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG27909',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 39519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-23',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Sport Edition',
 'transmission': 'manual',
 'trim': 'Sport Edition',
 'year': 2005}
2026-03-27 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG27909%27 HTTP/1.1" 200 None
2026-03-27 11:14:52 [auto1.de] INFO: Saving data for BG27909: {'auction_closing_time': 1774627722.0, 'created_time': 1774521951.273152, 'last_price_update_time': 1774610092.717387}
2026-03-27 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG27909') HTTP/1.1" 204 0
2026-03-27 11:14:52 [auto1.de] INFO: Found listing with ID: VJ44121
2026-03-27 11:14:52 [auto1.de] INFO: Found listing with ID: PB29000
2026-03-27 11:14:52 [auto1.de] INFO: Found listing with ID: PF77443
2026-03-27 11:14:52 [auto1.de] INFO: Found listing with ID: FC97863
2026-03-27 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC97863%27 HTTP/1.1" 200 None
2026-03-27 11:14:52 [auto1.de] INFO: Scrape type for FC97863: 2
2026-03-27 11:14:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61cfaff5-319c-5618-9753-1facae6b8c7e with identifier: FC97863
2026-03-27 11:14:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61cfaff5-319c-5618-9753-1facae6b8c7e with scrape type 2
2026-03-27 11:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61cfaff5-319c-5618-9753-1facae6b8c7e with scrape type 2
2026-03-27 11:14:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61cfaff5-319c-5618-9753-1facae6b8c7e, identifier: FC97863
2026-03-27 11:14:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61cfaff5-319c-5618-9753-1facae6b8c7e with identifier: FC97863
2026-03-27 11:14:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61cfaff5-319c-5618-9753-1facae6b8c7e with identifier: FC97863
2026-03-27 11:14:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61cfaff5-319c-5618-9753-1facae6b8c7e with identifier: FC97863 to the API
2026-03-27 11:14:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-27T16:24:21Z',
 'fuel_type': 'petrol',
 'id': '61cfaff5-319c-5618-9753-1facae6b8c7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC97863',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 190144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-30',
 'seller_name': None,
 'title': 'BMW 3er 330i GT xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2017}
2026-03-27 11:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC97863%27 HTTP/1.1" 200 None
2026-03-27 11:14:53 [auto1.de] INFO: Saving data for FC97863: {'auction_closing_time': 1774628661.0, 'created_time': 1774521949.92873, 'last_price_update_time': 1774610093.483369}
2026-03-27 11:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC97863') HTTP/1.1" 204 0
2026-03-27 11:14:53 [auto1.de] INFO: Found listing with ID: TF25413
2026-03-27 11:14:53 [auto1.de] INFO: Found listing with ID: VK94352
2026-03-27 11:14:53 [auto1.de] INFO: Found listing with ID: ZY80421
2026-03-27 11:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY80421%27 HTTP/1.1" 200 None
2026-03-27 11:14:53 [auto1.de] INFO: Scrape type for ZY80421: 2
2026-03-27 11:14:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612908d7-ef20-59ba-8b4e-6619ad523824 with identifier: ZY80421
2026-03-27 11:14:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612908d7-ef20-59ba-8b4e-6619ad523824 with scrape type 2
2026-03-27 11:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 612908d7-ef20-59ba-8b4e-6619ad523824 with scrape type 2
2026-03-27 11:14:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 612908d7-ef20-59ba-8b4e-6619ad523824, identifier: ZY80421
2026-03-27 11:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:14:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 612908d7-ef20-59ba-8b4e-6619ad523824 with identifier: ZY80421
2026-03-27 11:14:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 612908d7-ef20-59ba-8b4e-6619ad523824 with identifier: ZY80421
2026-03-27 11:14:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 612908d7-ef20-59ba-8b4e-6619ad523824 with identifier: ZY80421 to the API
2026-03-27 11:14:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-27T16:21:00Z',
 'fuel_type': 'petrol',
 'id': '612908d7-ef20-59ba-8b4e-6619ad523824',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY80421',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 220116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-08',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Team Edition',
 'transmission': 'manual',
 'trim': 'Team Edition',
 'year': 2008}
2026-03-27 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY80421%27 HTTP/1.1" 200 None
2026-03-27 11:14:54 [auto1.de] INFO: Saving data for ZY80421: {'auction_closing_time': 1774628460.0, 'created_time': 1774521890.753075, 'last_price_update_time': 1774610094.172482}
2026-03-27 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY80421') HTTP/1.1" 204 0
2026-03-27 11:14:54 [auto1.de] INFO: Found listing with ID: KF79768
2026-03-27 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF79768%27 HTTP/1.1" 200 None
2026-03-27 11:14:54 [auto1.de] INFO: Scrape type for KF79768: 2
2026-03-27 11:14:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdb52312-98e2-5243-ae12-319f19f84c31 with identifier: KF79768
2026-03-27 11:14:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdb52312-98e2-5243-ae12-319f19f84c31 with scrape type 2
2026-03-27 11:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdb52312-98e2-5243-ae12-319f19f84c31 with scrape type 2
2026-03-27 11:14:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdb52312-98e2-5243-ae12-319f19f84c31, identifier: KF79768
2026-03-27 11:14:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdb52312-98e2-5243-ae12-319f19f84c31 with identifier: KF79768
2026-03-27 11:14:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdb52312-98e2-5243-ae12-319f19f84c31 with identifier: KF79768
2026-03-27 11:14:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdb52312-98e2-5243-ae12-319f19f84c31 with identifier: KF79768 to the API
2026-03-27 11:14:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-27T16:41:52Z',
 'fuel_type': 'petrol',
 'id': 'bdb52312-98e2-5243-ae12-319f19f84c31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF79768',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 196056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-31',
 'seller_name': None,
 'title': 'Audi A1 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-27 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF79768%27 HTTP/1.1" 200 None
2026-03-27 11:14:54 [auto1.de] INFO: Saving data for KF79768: {'auction_closing_time': 1774629712.0, 'created_time': 1774521895.79806, 'last_price_update_time': 1774610094.643328}
2026-03-27 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF79768') HTTP/1.1" 204 0
2026-03-27 11:14:54 [auto1.de] INFO: Found listing with ID: PP02879
2026-03-27 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP02879%27 HTTP/1.1" 200 None
2026-03-27 11:14:54 [auto1.de] INFO: Scrape type for PP02879: 2
2026-03-27 11:14:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 541bac74-bcfa-5d19-a32e-8cd99b021d33 with identifier: PP02879
2026-03-27 11:14:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 541bac74-bcfa-5d19-a32e-8cd99b021d33 with scrape type 2
2026-03-27 11:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 541bac74-bcfa-5d19-a32e-8cd99b021d33 with scrape type 2
2026-03-27 11:14:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 541bac74-bcfa-5d19-a32e-8cd99b021d33, identifier: PP02879
2026-03-27 11:14:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 541bac74-bcfa-5d19-a32e-8cd99b021d33 with identifier: PP02879
2026-03-27 11:14:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 541bac74-bcfa-5d19-a32e-8cd99b021d33 with identifier: PP02879
2026-03-27 11:14:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 541bac74-bcfa-5d19-a32e-8cd99b021d33 with identifier: PP02879 to the API
2026-03-27 11:14:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:49:23Z',
 'fuel_type': 'petrol',
 'id': '541bac74-bcfa-5d19-a32e-8cd99b021d33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP02879',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 83786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-18',
 'seller_name': None,
 'title': 'Opel Adam 1.2 Jam',
 'transmission': 'manual',
 'trim': 'Jam',
 'year': 2014}
2026-03-27 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP02879%27 HTTP/1.1" 200 None
2026-03-27 11:14:55 [auto1.de] INFO: Saving data for PP02879: {'auction_closing_time': 1774630163.0, 'created_time': 1774521907.988235, 'last_price_update_time': 1774610095.10479}
2026-03-27 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP02879') HTTP/1.1" 204 0
2026-03-27 11:14:55 [auto1.de] INFO: Channel: 24h | Page: 251 | totalHits: 10682 | hits on page: 40
2026-03-27 11:14:55 [auto1.de] INFO: Found listing with ID: MD86394
2026-03-27 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD86394%27 HTTP/1.1" 200 None
2026-03-27 11:14:55 [auto1.de] INFO: Scrape type for MD86394: 2
2026-03-27 11:14:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68d1724a-50ab-52c8-9693-fb602a7719b5 with identifier: MD86394
2026-03-27 11:14:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68d1724a-50ab-52c8-9693-fb602a7719b5 with scrape type 2
2026-03-27 11:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68d1724a-50ab-52c8-9693-fb602a7719b5 with scrape type 2
2026-03-27 11:14:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68d1724a-50ab-52c8-9693-fb602a7719b5, identifier: MD86394
2026-03-27 11:14:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68d1724a-50ab-52c8-9693-fb602a7719b5 with identifier: MD86394
2026-03-27 11:14:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68d1724a-50ab-52c8-9693-fb602a7719b5 with identifier: MD86394
2026-03-27 11:14:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68d1724a-50ab-52c8-9693-fb602a7719b5 with identifier: MD86394 to the API
2026-03-27 11:14:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:08:21Z',
 'fuel_type': 'petrol',
 'id': '68d1724a-50ab-52c8-9693-fb602a7719b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD86394',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 143251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-05',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2008}
2026-03-27 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD86394%27 HTTP/1.1" 200 None
2026-03-27 11:14:55 [auto1.de] INFO: Saving data for MD86394: {'auction_closing_time': 1774627701.0, 'created_time': 1774521896.623548, 'last_price_update_time': 1774610095.56071}
2026-03-27 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD86394') HTTP/1.1" 204 0
2026-03-27 11:14:55 [auto1.de] INFO: Found listing with ID: GL92144
2026-03-27 11:14:55 [auto1.de] INFO: Found listing with ID: PD35712
2026-03-27 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD35712%27 HTTP/1.1" 200 None
2026-03-27 11:14:55 [auto1.de] INFO: Scrape type for PD35712: 2
2026-03-27 11:14:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72cfdfac-6b65-5561-b6fa-e462d07caede with identifier: PD35712
2026-03-27 11:14:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72cfdfac-6b65-5561-b6fa-e462d07caede with scrape type 2
2026-03-27 11:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72cfdfac-6b65-5561-b6fa-e462d07caede with scrape type 2
2026-03-27 11:14:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72cfdfac-6b65-5561-b6fa-e462d07caede, identifier: PD35712
2026-03-27 11:14:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:14:55 [auto1.de] INFO: Found listing with ID: NH53597
2026-03-27 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH53597%27 HTTP/1.1" 200 None
2026-03-27 11:14:55 [auto1.de] INFO: Scrape type for NH53597: 2
2026-03-27 11:14:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f0b80de-9547-533f-a1a7-ce853cabc5d5 with identifier: NH53597
2026-03-27 11:14:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f0b80de-9547-533f-a1a7-ce853cabc5d5 with scrape type 2
2026-03-27 11:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f0b80de-9547-533f-a1a7-ce853cabc5d5 with scrape type 2
2026-03-27 11:14:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f0b80de-9547-533f-a1a7-ce853cabc5d5, identifier: NH53597
2026-03-27 11:14:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72cfdfac-6b65-5561-b6fa-e462d07caede with identifier: PD35712
2026-03-27 11:14:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72cfdfac-6b65-5561-b6fa-e462d07caede with identifier: PD35712
2026-03-27 11:14:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72cfdfac-6b65-5561-b6fa-e462d07caede with identifier: PD35712 to the API
2026-03-27 11:14:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:55:48Z',
 'fuel_type': 'petrol',
 'id': '72cfdfac-6b65-5561-b6fa-e462d07caede',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD35712',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 233666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-18',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 Style Salsa',
 'transmission': 'manual',
 'trim': 'Style Salsa',
 'year': 2013}
2026-03-27 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD35712%27 HTTP/1.1" 200 None
2026-03-27 11:14:56 [auto1.de] INFO: Saving data for PD35712: {'auction_closing_time': 1774630548.0, 'created_time': 1774521947.185263, 'last_price_update_time': 1774610096.18001}
2026-03-27 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD35712') HTTP/1.1" 204 0
2026-03-27 11:14:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f0b80de-9547-533f-a1a7-ce853cabc5d5 with identifier: NH53597
2026-03-27 11:14:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f0b80de-9547-533f-a1a7-ce853cabc5d5 with identifier: NH53597
2026-03-27 11:14:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f0b80de-9547-533f-a1a7-ce853cabc5d5 with identifier: NH53597 to the API
2026-03-27 11:14:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:14:05Z',
 'fuel_type': 'diesel',
 'id': '4f0b80de-9547-533f-a1a7-ce853cabc5d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH53597',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 155788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-01',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-27 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH53597%27 HTTP/1.1" 200 None
2026-03-27 11:14:56 [auto1.de] INFO: Saving data for NH53597: {'auction_closing_time': 1774628045.0, 'created_time': 1774521889.511364, 'last_price_update_time': 1774610096.604671}
2026-03-27 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH53597') HTTP/1.1" 204 0
2026-03-27 11:14:56 [auto1.de] INFO: Found listing with ID: AD50420
2026-03-27 11:14:56 [auto1.de] INFO: Found listing with ID: LC97609
2026-03-27 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC97609%27 HTTP/1.1" 200 None
2026-03-27 11:14:56 [auto1.de] INFO: Scrape type for LC97609: 2
2026-03-27 11:14:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a761af3-7b82-55b8-bb35-a432795424a3 with identifier: LC97609
2026-03-27 11:14:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a761af3-7b82-55b8-bb35-a432795424a3 with scrape type 2
2026-03-27 11:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a761af3-7b82-55b8-bb35-a432795424a3 with scrape type 2
2026-03-27 11:14:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a761af3-7b82-55b8-bb35-a432795424a3, identifier: LC97609
2026-03-27 11:14:56 [auto1.de] INFO: Found listing with ID: CG48828
2026-03-27 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG48828%27 HTTP/1.1" 200 None
2026-03-27 11:14:56 [auto1.de] INFO: Scrape type for CG48828: 2
2026-03-27 11:14:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 758d756f-c01d-5b10-83c2-a0981fabbb97 with identifier: CG48828
2026-03-27 11:14:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 758d756f-c01d-5b10-83c2-a0981fabbb97 with scrape type 2
2026-03-27 11:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 758d756f-c01d-5b10-83c2-a0981fabbb97 with scrape type 2
2026-03-27 11:14:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 758d756f-c01d-5b10-83c2-a0981fabbb97, identifier: CG48828
2026-03-27 11:14:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a761af3-7b82-55b8-bb35-a432795424a3 with identifier: LC97609
2026-03-27 11:14:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a761af3-7b82-55b8-bb35-a432795424a3 with identifier: LC97609
2026-03-27 11:14:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a761af3-7b82-55b8-bb35-a432795424a3 with identifier: LC97609 to the API
2026-03-27 11:14:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:54:04Z',
 'fuel_type': 'diesel',
 'id': '8a761af3-7b82-55b8-bb35-a432795424a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC97609',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 170239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-31',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2017}
2026-03-27 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC97609%27 HTTP/1.1" 200 None
2026-03-27 11:14:57 [auto1.de] INFO: Saving data for LC97609: {'auction_closing_time': 1774630444.0, 'created_time': 1774521940.678531, 'last_price_update_time': 1774610097.180293}
2026-03-27 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC97609') HTTP/1.1" 204 0
2026-03-27 11:14:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 758d756f-c01d-5b10-83c2-a0981fabbb97 with identifier: CG48828
2026-03-27 11:14:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 758d756f-c01d-5b10-83c2-a0981fabbb97 with identifier: CG48828
2026-03-27 11:14:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 758d756f-c01d-5b10-83c2-a0981fabbb97 with identifier: CG48828 to the API
2026-03-27 11:14:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-27T16:22:23Z',
 'fuel_type': 'petrol',
 'id': '758d756f-c01d-5b10-83c2-a0981fabbb97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG48828',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 76335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-20',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Turbo Drive ecoFlex',
 'transmission': 'manual',
 'trim': 'Drive ecoFlex',
 'year': 2016}
2026-03-27 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG48828%27 HTTP/1.1" 200 None
2026-03-27 11:14:57 [auto1.de] INFO: Saving data for CG48828: {'auction_closing_time': 1774628543.0, 'created_time': 1774522038.053966, 'last_price_update_time': 1774610097.588919}
2026-03-27 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG48828') HTTP/1.1" 204 0
2026-03-27 11:14:57 [auto1.de] INFO: Found listing with ID: FN16508
2026-03-27 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN16508%27 HTTP/1.1" 200 None
2026-03-27 11:14:57 [auto1.de] INFO: Scrape type for FN16508: 2
2026-03-27 11:14:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26d876f6-2cca-5451-bdcb-237bb64d12ec with identifier: FN16508
2026-03-27 11:14:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26d876f6-2cca-5451-bdcb-237bb64d12ec with scrape type 2
2026-03-27 11:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26d876f6-2cca-5451-bdcb-237bb64d12ec with scrape type 2
2026-03-27 11:14:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26d876f6-2cca-5451-bdcb-237bb64d12ec, identifier: FN16508
2026-03-27 11:14:57 [auto1.de] INFO: Found listing with ID: TV27875
2026-03-27 11:14:57 [auto1.de] INFO: Found listing with ID: TK79700
2026-03-27 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK79700%27 HTTP/1.1" 200 None
2026-03-27 11:14:57 [auto1.de] INFO: Scrape type for TK79700: 2
2026-03-27 11:14:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b7a95d6-cfd3-53b1-8d0f-cf75fe71f781 with identifier: TK79700
2026-03-27 11:14:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b7a95d6-cfd3-53b1-8d0f-cf75fe71f781 with scrape type 2
2026-03-27 11:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b7a95d6-cfd3-53b1-8d0f-cf75fe71f781 with scrape type 2
2026-03-27 11:14:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b7a95d6-cfd3-53b1-8d0f-cf75fe71f781, identifier: TK79700
2026-03-27 11:14:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26d876f6-2cca-5451-bdcb-237bb64d12ec with identifier: FN16508
2026-03-27 11:14:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26d876f6-2cca-5451-bdcb-237bb64d12ec with identifier: FN16508
2026-03-27 11:14:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26d876f6-2cca-5451-bdcb-237bb64d12ec with identifier: FN16508 to the API
2026-03-27 11:14:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-27T16:39:12Z',
 'fuel_type': 'petrol',
 'id': '26d876f6-2cca-5451-bdcb-237bb64d12ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN16508',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 55689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-05',
 'seller_name': None,
 'title': 'BMW 1er 118i Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2018}
2026-03-27 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN16508%27 HTTP/1.1" 200 None
2026-03-27 11:14:58 [auto1.de] INFO: Saving data for FN16508: {'auction_closing_time': 1774629552.0, 'created_time': 1774521934.83695, 'last_price_update_time': 1774610098.291601}
2026-03-27 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN16508') HTTP/1.1" 204 0
2026-03-27 11:14:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b7a95d6-cfd3-53b1-8d0f-cf75fe71f781 with identifier: TK79700
2026-03-27 11:14:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b7a95d6-cfd3-53b1-8d0f-cf75fe71f781 with identifier: TK79700
2026-03-27 11:14:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b7a95d6-cfd3-53b1-8d0f-cf75fe71f781 with identifier: TK79700 to the API
2026-03-27 11:14:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:50:58Z',
 'fuel_type': 'diesel',
 'id': '9b7a95d6-cfd3-53b1-8d0f-cf75fe71f781',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK79700',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 30526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-31',
 'seller_name': None,
 'title': 'Fiat Ducato 2.2 M-Jet L4H2 RS: 4035 mm',
 'transmission': 'manual',
 'trim': 'L4H2 RS: 4035 mm',
 'year': 2023}
2026-03-27 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK79700%27 HTTP/1.1" 200 None
2026-03-27 11:14:58 [auto1.de] INFO: Saving data for TK79700: {'auction_closing_time': 1774630258.0, 'created_time': 1774521877.857644, 'last_price_update_time': 1774610098.789937}
2026-03-27 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK79700') HTTP/1.1" 204 0
2026-03-27 11:14:58 [auto1.de] INFO: Found listing with ID: MR38870
2026-03-27 11:14:58 [auto1.de] INFO: Found listing with ID: BB96456
2026-03-27 11:14:58 [auto1.de] INFO: Found listing with ID: DJ88162
2026-03-27 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ88162%27 HTTP/1.1" 200 None
2026-03-27 11:14:58 [auto1.de] INFO: Scrape type for DJ88162: 2
2026-03-27 11:14:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f4028d1-ce25-510b-951c-61a73ca007ee with identifier: DJ88162
2026-03-27 11:14:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f4028d1-ce25-510b-951c-61a73ca007ee with scrape type 2
2026-03-27 11:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f4028d1-ce25-510b-951c-61a73ca007ee with scrape type 2
2026-03-27 11:14:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f4028d1-ce25-510b-951c-61a73ca007ee, identifier: DJ88162
2026-03-27 11:14:58 [auto1.de] INFO: Found listing with ID: UA30528
2026-03-27 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA30528%27 HTTP/1.1" 200 None
2026-03-27 11:14:58 [auto1.de] INFO: Scrape type for UA30528: 2
2026-03-27 11:14:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bfeebf2-5add-581b-951d-3d3ecbfef7e8 with identifier: UA30528
2026-03-27 11:14:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bfeebf2-5add-581b-951d-3d3ecbfef7e8 with scrape type 2
2026-03-27 11:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bfeebf2-5add-581b-951d-3d3ecbfef7e8 with scrape type 2
2026-03-27 11:14:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5bfeebf2-5add-581b-951d-3d3ecbfef7e8, identifier: UA30528
2026-03-27 11:14:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f4028d1-ce25-510b-951c-61a73ca007ee with identifier: DJ88162
2026-03-27 11:14:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f4028d1-ce25-510b-951c-61a73ca007ee with identifier: DJ88162
2026-03-27 11:14:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f4028d1-ce25-510b-951c-61a73ca007ee with identifier: DJ88162 to the API
2026-03-27 11:14:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:55:25Z',
 'fuel_type': 'diesel',
 'id': '5f4028d1-ce25-510b-951c-61a73ca007ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ88162',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 97842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-23',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2019}
2026-03-27 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ88162%27 HTTP/1.1" 200 None
2026-03-27 11:14:59 [auto1.de] INFO: Saving data for DJ88162: {'auction_closing_time': 1774630525.0, 'created_time': 1773305459.769915, 'last_price_update_time': 1774610099.555692}
2026-03-27 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ88162') HTTP/1.1" 204 0
2026-03-27 11:14:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5bfeebf2-5add-581b-951d-3d3ecbfef7e8 with identifier: UA30528
2026-03-27 11:14:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5bfeebf2-5add-581b-951d-3d3ecbfef7e8 with identifier: UA30528
2026-03-27 11:14:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5bfeebf2-5add-581b-951d-3d3ecbfef7e8 with identifier: UA30528 to the API
2026-03-27 11:14:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:14:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:14:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:09:59Z',
 'fuel_type': 'petrol',
 'id': '5bfeebf2-5add-581b-951d-3d3ecbfef7e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA30528',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 118104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-20',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-03-27 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA30528%27 HTTP/1.1" 200 None
2026-03-27 11:14:59 [auto1.de] INFO: Saving data for UA30528: {'auction_closing_time': 1774627799.0, 'created_time': 1773380952.640998, 'last_price_update_time': 1774610099.878283}
2026-03-27 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA30528') HTTP/1.1" 204 0
2026-03-27 11:14:59 [auto1.de] INFO: Found listing with ID: TW80485
2026-03-27 11:14:59 [auto1.de] INFO: Found listing with ID: CL87720
2026-03-27 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL87720%27 HTTP/1.1" 200 None
2026-03-27 11:14:59 [auto1.de] INFO: Scrape type for CL87720: 2
2026-03-27 11:14:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee5596a6-f10b-506e-9f8a-8eaa2fee8398 with identifier: CL87720
2026-03-27 11:14:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee5596a6-f10b-506e-9f8a-8eaa2fee8398 with scrape type 2
2026-03-27 11:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee5596a6-f10b-506e-9f8a-8eaa2fee8398 with scrape type 2
2026-03-27 11:15:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee5596a6-f10b-506e-9f8a-8eaa2fee8398, identifier: CL87720
2026-03-27 11:15:00 [auto1.de] INFO: Found listing with ID: WF56073
2026-03-27 11:15:00 [auto1.de] INFO: Found listing with ID: VU50436
2026-03-27 11:15:00 [auto1.de] INFO: Found listing with ID: BD80758
2026-03-27 11:15:00 [auto1.de] INFO: Found listing with ID: ZJ62513
2026-03-27 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ62513%27 HTTP/1.1" 200 None
2026-03-27 11:15:00 [auto1.de] INFO: Scrape type for ZJ62513: 2
2026-03-27 11:15:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 641ded04-aca0-5e47-b47c-93ee0ab0c260 with identifier: ZJ62513
2026-03-27 11:15:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 641ded04-aca0-5e47-b47c-93ee0ab0c260 with scrape type 2
2026-03-27 11:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 641ded04-aca0-5e47-b47c-93ee0ab0c260 with scrape type 2
2026-03-27 11:15:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 641ded04-aca0-5e47-b47c-93ee0ab0c260, identifier: ZJ62513
2026-03-27 11:15:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee5596a6-f10b-506e-9f8a-8eaa2fee8398 with identifier: CL87720
2026-03-27 11:15:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee5596a6-f10b-506e-9f8a-8eaa2fee8398 with identifier: CL87720
2026-03-27 11:15:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee5596a6-f10b-506e-9f8a-8eaa2fee8398 with identifier: CL87720 to the API
2026-03-27 11:15:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 330,
 'expiration_date': '2026-03-27T16:51:49Z',
 'fuel_type': 'diesel',
 'id': 'ee5596a6-f10b-506e-9f8a-8eaa2fee8398',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL87720',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 179760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 400 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2021}
2026-03-27 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL87720%27 HTTP/1.1" 200 None
2026-03-27 11:15:00 [auto1.de] INFO: Saving data for CL87720: {'auction_closing_time': 1774630309.0, 'created_time': 1774521893.25755, 'last_price_update_time': 1774610100.771368}
2026-03-27 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL87720') HTTP/1.1" 204 0
2026-03-27 11:15:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 641ded04-aca0-5e47-b47c-93ee0ab0c260 with identifier: ZJ62513
2026-03-27 11:15:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 641ded04-aca0-5e47-b47c-93ee0ab0c260 with identifier: ZJ62513
2026-03-27 11:15:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 641ded04-aca0-5e47-b47c-93ee0ab0c260 with identifier: ZJ62513 to the API
2026-03-27 11:15:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-27T16:36:45Z',
 'fuel_type': 'electro',
 'id': '641ded04-aca0-5e47-b47c-93ee0ab0c260',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ62513',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 16338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-19',
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 150 kW Pro Performance',
 'transmission': 'automatic',
 'trim': 'Pro Performance',
 'year': 2022}
2026-03-27 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ62513%27 HTTP/1.1" 200 None
2026-03-27 11:15:01 [auto1.de] INFO: Saving data for ZJ62513: {'auction_closing_time': 1774629405.0, 'created_time': 1774521944.556881, 'last_price_update_time': 1774610101.4575}
2026-03-27 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ62513') HTTP/1.1" 204 0
2026-03-27 11:15:01 [auto1.de] INFO: Found listing with ID: YH76604
2026-03-27 11:15:01 [auto1.de] INFO: Found listing with ID: HY99663
2026-03-27 11:15:01 [auto1.de] INFO: Found listing with ID: LW30512
2026-03-27 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW30512%27 HTTP/1.1" 200 None
2026-03-27 11:15:01 [auto1.de] INFO: Scrape type for LW30512: 2
2026-03-27 11:15:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0608d3a7-1169-5bf8-9ee0-2aecb643c36b with identifier: LW30512
2026-03-27 11:15:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0608d3a7-1169-5bf8-9ee0-2aecb643c36b with scrape type 2
2026-03-27 11:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0608d3a7-1169-5bf8-9ee0-2aecb643c36b with scrape type 2
2026-03-27 11:15:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0608d3a7-1169-5bf8-9ee0-2aecb643c36b, identifier: LW30512
2026-03-27 11:15:01 [auto1.de] INFO: Found listing with ID: KM56537
2026-03-27 11:15:01 [auto1.de] INFO: Found listing with ID: CA38635
2026-03-27 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA38635%27 HTTP/1.1" 200 None
2026-03-27 11:15:01 [auto1.de] INFO: Scrape type for CA38635: 2
2026-03-27 11:15:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 157be5da-54e5-5423-a70d-ddbb67a42497 with identifier: CA38635
2026-03-27 11:15:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 157be5da-54e5-5423-a70d-ddbb67a42497 with scrape type 2
2026-03-27 11:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 157be5da-54e5-5423-a70d-ddbb67a42497 with scrape type 2
2026-03-27 11:15:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 157be5da-54e5-5423-a70d-ddbb67a42497, identifier: CA38635
2026-03-27 11:15:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0608d3a7-1169-5bf8-9ee0-2aecb643c36b with identifier: LW30512
2026-03-27 11:15:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0608d3a7-1169-5bf8-9ee0-2aecb643c36b with identifier: LW30512
2026-03-27 11:15:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0608d3a7-1169-5bf8-9ee0-2aecb643c36b with identifier: LW30512 to the API
2026-03-27 11:15:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-27T16:38:24Z',
 'fuel_type': 'diesel',
 'id': '0608d3a7-1169-5bf8-9ee0-2aecb643c36b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW30512',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 92994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-05',
 'seller_name': None,
 'title': 'Citroen Jumpy 1.5 Blue-HDi M',
 'transmission': 'manual',
 'trim': 'M',
 'year': 2019}
2026-03-27 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW30512%27 HTTP/1.1" 200 None
2026-03-27 11:15:02 [auto1.de] INFO: Saving data for LW30512: {'auction_closing_time': 1774629504.0, 'created_time': 1774521932.563648, 'last_price_update_time': 1774610102.265353}
2026-03-27 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW30512') HTTP/1.1" 204 0
2026-03-27 11:15:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 157be5da-54e5-5423-a70d-ddbb67a42497 with identifier: CA38635
2026-03-27 11:15:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 157be5da-54e5-5423-a70d-ddbb67a42497 with identifier: CA38635
2026-03-27 11:15:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 157be5da-54e5-5423-a70d-ddbb67a42497 with identifier: CA38635 to the API
2026-03-27 11:15:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-27T16:18:51Z',
 'fuel_type': 'petrol',
 'id': '157be5da-54e5-5423-a70d-ddbb67a42497',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA38635',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 136468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-30',
 'seller_name': None,
 'title': 'Hyundai ix35 1.6 Classic 2WD',
 'transmission': 'manual',
 'trim': 'Classic 2WD',
 'year': 2015}
2026-03-27 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA38635%27 HTTP/1.1" 200 None
2026-03-27 11:15:02 [auto1.de] INFO: Saving data for CA38635: {'auction_closing_time': 1774628331.0, 'created_time': 1774521945.324151, 'last_price_update_time': 1774610102.895516}
2026-03-27 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA38635') HTTP/1.1" 204 0
2026-03-27 11:15:02 [auto1.de] INFO: Found listing with ID: TD17986
2026-03-27 11:15:02 [auto1.de] INFO: Found listing with ID: GF12602
2026-03-27 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF12602%27 HTTP/1.1" 200 None
2026-03-27 11:15:02 [auto1.de] INFO: Scrape type for GF12602: 2
2026-03-27 11:15:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d8b3e04-70ec-506b-a7cf-5bf0f3ade30e with identifier: GF12602
2026-03-27 11:15:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d8b3e04-70ec-506b-a7cf-5bf0f3ade30e with scrape type 2
2026-03-27 11:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d8b3e04-70ec-506b-a7cf-5bf0f3ade30e with scrape type 2
2026-03-27 11:15:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d8b3e04-70ec-506b-a7cf-5bf0f3ade30e, identifier: GF12602
2026-03-27 11:15:03 [auto1.de] INFO: Found listing with ID: HK49782
2026-03-27 11:15:03 [auto1.de] INFO: Found listing with ID: UP37190
2026-03-27 11:15:03 [auto1.de] INFO: Found listing with ID: GL92144
2026-03-27 11:15:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d8b3e04-70ec-506b-a7cf-5bf0f3ade30e with identifier: GF12602
2026-03-27 11:15:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d8b3e04-70ec-506b-a7cf-5bf0f3ade30e with identifier: GF12602
2026-03-27 11:15:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d8b3e04-70ec-506b-a7cf-5bf0f3ade30e with identifier: GF12602 to the API
2026-03-27 11:15:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-27T16:13:42Z',
 'fuel_type': 'petrol',
 'id': '4d8b3e04-70ec-506b-a7cf-5bf0f3ade30e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF12602',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 113182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-13',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-27 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF12602%27 HTTP/1.1" 200 None
2026-03-27 11:15:03 [auto1.de] INFO: Saving data for GF12602: {'auction_closing_time': 1774628022.0, 'created_time': 1774521999.168608, 'last_price_update_time': 1774610103.361124}
2026-03-27 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF12602') HTTP/1.1" 204 0
2026-03-27 11:15:03 [auto1.de] INFO: Found listing with ID: ZR39968
2026-03-27 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39968%27 HTTP/1.1" 200 None
2026-03-27 11:15:03 [auto1.de] INFO: Scrape type for ZR39968: 2
2026-03-27 11:15:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 836be76b-a6ba-5107-aaf9-dddbb4b82082 with identifier: ZR39968
2026-03-27 11:15:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 836be76b-a6ba-5107-aaf9-dddbb4b82082 with scrape type 2
2026-03-27 11:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 836be76b-a6ba-5107-aaf9-dddbb4b82082 with scrape type 2
2026-03-27 11:15:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 836be76b-a6ba-5107-aaf9-dddbb4b82082, identifier: ZR39968
2026-03-27 11:15:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 836be76b-a6ba-5107-aaf9-dddbb4b82082 with identifier: ZR39968
2026-03-27 11:15:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 836be76b-a6ba-5107-aaf9-dddbb4b82082 with identifier: ZR39968
2026-03-27 11:15:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 836be76b-a6ba-5107-aaf9-dddbb4b82082 with identifier: ZR39968 to the API
2026-03-27 11:15:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:58:19Z',
 'fuel_type': 'petrol',
 'id': '836be76b-a6ba-5107-aaf9-dddbb4b82082',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR39968',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 190168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-01',
 'seller_name': None,
 'title': 'Opel Astra 1.8 CATCH ME',
 'transmission': 'manual',
 'trim': 'CATCH ME',
 'year': 2007}
2026-03-27 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39968%27 HTTP/1.1" 200 None
2026-03-27 11:15:03 [auto1.de] INFO: Saving data for ZR39968: {'auction_closing_time': 1774630699.0, 'created_time': 1773306592.653282, 'last_price_update_time': 1774610103.873215}
2026-03-27 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR39968') HTTP/1.1" 204 0
2026-03-27 11:15:04 [auto1.de] INFO: Found listing with ID: UW74525
2026-03-27 11:15:04 [auto1.de] INFO: Found listing with ID: DM15147
2026-03-27 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM15147%27 HTTP/1.1" 200 None
2026-03-27 11:15:04 [auto1.de] INFO: Scrape type for DM15147: 2
2026-03-27 11:15:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8144086-3344-51d7-ac27-c84cb40c5245 with identifier: DM15147
2026-03-27 11:15:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8144086-3344-51d7-ac27-c84cb40c5245 with scrape type 2
2026-03-27 11:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8144086-3344-51d7-ac27-c84cb40c5245 with scrape type 2
2026-03-27 11:15:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8144086-3344-51d7-ac27-c84cb40c5245, identifier: DM15147
2026-03-27 11:15:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8144086-3344-51d7-ac27-c84cb40c5245 with identifier: DM15147
2026-03-27 11:15:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8144086-3344-51d7-ac27-c84cb40c5245 with identifier: DM15147
2026-03-27 11:15:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8144086-3344-51d7-ac27-c84cb40c5245 with identifier: DM15147 to the API
2026-03-27 11:15:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:04:44Z',
 'fuel_type': 'diesel',
 'id': 'a8144086-3344-51d7-ac27-c84cb40c5245',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM15147',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 133578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-19',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Active L2',
 'transmission': 'manual',
 'trim': 'Active L2',
 'year': 2018}
2026-03-27 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM15147%27 HTTP/1.1" 200 None
2026-03-27 11:15:04 [auto1.de] INFO: Saving data for DM15147: {'auction_closing_time': 1774627484.0, 'created_time': 1774521931.523521, 'last_price_update_time': 1774610104.577789}
2026-03-27 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM15147') HTTP/1.1" 204 0
2026-03-27 11:15:04 [auto1.de] INFO: Found listing with ID: PH98737
2026-03-27 11:15:04 [auto1.de] INFO: Found listing with ID: VS79881
2026-03-27 11:15:04 [auto1.de] INFO: Found listing with ID: RA28686
2026-03-27 11:15:04 [auto1.de] INFO: Found listing with ID: XF59932
2026-03-27 11:15:04 [auto1.de] INFO: Found listing with ID: YN11150
2026-03-27 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN11150%27 HTTP/1.1" 200 None
2026-03-27 11:15:04 [auto1.de] INFO: Scrape type for YN11150: 2
2026-03-27 11:15:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d47f2394-b127-55c2-870b-e69723767512 with identifier: YN11150
2026-03-27 11:15:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d47f2394-b127-55c2-870b-e69723767512 with scrape type 2
2026-03-27 11:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d47f2394-b127-55c2-870b-e69723767512 with scrape type 2
2026-03-27 11:15:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d47f2394-b127-55c2-870b-e69723767512, identifier: YN11150
2026-03-27 11:15:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:15:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d47f2394-b127-55c2-870b-e69723767512 with identifier: YN11150
2026-03-27 11:15:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d47f2394-b127-55c2-870b-e69723767512 with identifier: YN11150
2026-03-27 11:15:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d47f2394-b127-55c2-870b-e69723767512 with identifier: YN11150 to the API
2026-03-27 11:15:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:22:17Z',
 'fuel_type': 'petrol',
 'id': 'd47f2394-b127-55c2-870b-e69723767512',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN11150',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 45610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-18',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.0 Edition 100',
 'transmission': 'manual',
 'trim': 'Edition 100',
 'year': 2018}
2026-03-27 11:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN11150%27 HTTP/1.1" 200 None
2026-03-27 11:15:05 [auto1.de] INFO: Saving data for YN11150: {'auction_closing_time': 1774628537.0, 'created_time': 1774521938.857293, 'last_price_update_time': 1774610105.105952}
2026-03-27 11:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN11150') HTTP/1.1" 204 0
2026-03-27 11:15:05 [auto1.de] INFO: Found listing with ID: WR84011
2026-03-27 11:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR84011%27 HTTP/1.1" 200 None
2026-03-27 11:15:05 [auto1.de] INFO: Scrape type for WR84011: 0
2026-03-27 11:15:05 [auto1.de] INFO: Found listing with ID: TY75534
2026-03-27 11:15:05 [auto1.de] INFO: Found listing with ID: MY90175
2026-03-27 11:15:05 [auto1.de] INFO: Found listing with ID: JD54519
2026-03-27 11:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD54519%27 HTTP/1.1" 200 None
2026-03-27 11:15:05 [auto1.de] INFO: Scrape type for JD54519: 2
2026-03-27 11:15:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82613229-5d6b-5cac-baf3-14872d15bd46 with identifier: JD54519
2026-03-27 11:15:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82613229-5d6b-5cac-baf3-14872d15bd46 with scrape type 2
2026-03-27 11:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82613229-5d6b-5cac-baf3-14872d15bd46 with scrape type 2
2026-03-27 11:15:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82613229-5d6b-5cac-baf3-14872d15bd46, identifier: JD54519
2026-03-27 11:15:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82613229-5d6b-5cac-baf3-14872d15bd46 with identifier: JD54519
2026-03-27 11:15:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82613229-5d6b-5cac-baf3-14872d15bd46 with identifier: JD54519
2026-03-27 11:15:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82613229-5d6b-5cac-baf3-14872d15bd46 with identifier: JD54519 to the API
2026-03-27 11:15:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:40:48Z',
 'fuel_type': 'diesel',
 'id': '82613229-5d6b-5cac-baf3-14872d15bd46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD54519',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 167835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-27',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2011}
2026-03-27 11:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD54519%27 HTTP/1.1" 200 None
2026-03-27 11:15:20 [auto1.de] INFO: Saving data for JD54519: {'auction_closing_time': 1774629648.0, 'created_time': 1774521924.19585, 'last_price_update_time': 1774610120.81766}
2026-03-27 11:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD54519') HTTP/1.1" 204 0
2026-03-27 11:15:21 [auto1.de] INFO: Found listing with ID: RT67139
2026-03-27 11:15:21 [auto1.de] INFO: Found listing with ID: KH49386
2026-03-27 11:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH49386%27 HTTP/1.1" 200 None
2026-03-27 11:15:21 [auto1.de] INFO: Scrape type for KH49386: 2
2026-03-27 11:15:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1098002-570d-5dd2-8a61-e25a0a3d36d4 with identifier: KH49386
2026-03-27 11:15:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1098002-570d-5dd2-8a61-e25a0a3d36d4 with scrape type 2
2026-03-27 11:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1098002-570d-5dd2-8a61-e25a0a3d36d4 with scrape type 2
2026-03-27 11:15:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1098002-570d-5dd2-8a61-e25a0a3d36d4, identifier: KH49386
2026-03-27 11:15:21 [scrapy.extensions.logstats] INFO: Crawled 720 pages (at 6 pages/min), scraped 1179 items (at 86 items/min)
2026-03-27 11:15:21 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 11:15:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1098002-570d-5dd2-8a61-e25a0a3d36d4 with identifier: KH49386
2026-03-27 11:15:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1098002-570d-5dd2-8a61-e25a0a3d36d4 with identifier: KH49386
2026-03-27 11:15:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1098002-570d-5dd2-8a61-e25a0a3d36d4 with identifier: KH49386 to the API
2026-03-27 11:15:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-27T16:08:57Z',
 'fuel_type': 'petrol',
 'id': 'f1098002-570d-5dd2-8a61-e25a0a3d36d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH49386',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 138207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-13',
 'seller_name': None,
 'title': 'Opel Astra 1.6 SIDI Turbo Dynamic Start/Stop',
 'transmission': 'manual',
 'trim': 'Dynamic Start/Stop',
 'year': 2017}
2026-03-27 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH49386%27 HTTP/1.1" 200 None
2026-03-27 11:15:22 [auto1.de] INFO: Saving data for KH49386: {'auction_closing_time': 1774627737.0, 'created_time': 1774521947.847682, 'last_price_update_time': 1774610122.220864}
2026-03-27 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH49386') HTTP/1.1" 204 0
2026-03-27 11:15:22 [auto1.de] INFO: Channel: 24h | Page: 252 | totalHits: 10682 | hits on page: 40
2026-03-27 11:15:22 [auto1.de] INFO: Found listing with ID: SB37681
2026-03-27 11:15:22 [auto1.de] INFO: Found listing with ID: GR31363
2026-03-27 11:15:22 [auto1.de] INFO: Found listing with ID: NL93561
2026-03-27 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL93561%27 HTTP/1.1" 200 None
2026-03-27 11:15:22 [auto1.de] INFO: Scrape type for NL93561: 2
2026-03-27 11:15:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4daa08b9-1ffe-5e58-bbb6-763aeb4137ed with identifier: NL93561
2026-03-27 11:15:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4daa08b9-1ffe-5e58-bbb6-763aeb4137ed with scrape type 2
2026-03-27 11:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4daa08b9-1ffe-5e58-bbb6-763aeb4137ed with scrape type 2
2026-03-27 11:15:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4daa08b9-1ffe-5e58-bbb6-763aeb4137ed, identifier: NL93561
2026-03-27 11:15:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4daa08b9-1ffe-5e58-bbb6-763aeb4137ed with identifier: NL93561
2026-03-27 11:15:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4daa08b9-1ffe-5e58-bbb6-763aeb4137ed with identifier: NL93561
2026-03-27 11:15:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4daa08b9-1ffe-5e58-bbb6-763aeb4137ed with identifier: NL93561 to the API
2026-03-27 11:15:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:56:40Z',
 'fuel_type': 'diesel',
 'id': '4daa08b9-1ffe-5e58-bbb6-763aeb4137ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL93561',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 142410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-14',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-27 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL93561%27 HTTP/1.1" 200 None
2026-03-27 11:15:22 [auto1.de] INFO: Saving data for NL93561: {'auction_closing_time': 1774630600.0, 'created_time': 1774521904.825234, 'last_price_update_time': 1774610122.895472}
2026-03-27 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL93561') HTTP/1.1" 204 0
2026-03-27 11:15:22 [auto1.de] INFO: Found listing with ID: PS90319
2026-03-27 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS90319%27 HTTP/1.1" 200 None
2026-03-27 11:15:22 [auto1.de] INFO: Scrape type for PS90319: 2
2026-03-27 11:15:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6872f563-e08c-5155-9b5b-185c006a69d5 with identifier: PS90319
2026-03-27 11:15:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6872f563-e08c-5155-9b5b-185c006a69d5 with scrape type 2
2026-03-27 11:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6872f563-e08c-5155-9b5b-185c006a69d5 with scrape type 2
2026-03-27 11:15:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6872f563-e08c-5155-9b5b-185c006a69d5, identifier: PS90319
2026-03-27 11:15:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:15:23 [auto1.de] INFO: Found listing with ID: YH20513
2026-03-27 11:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH20513%27 HTTP/1.1" 200 None
2026-03-27 11:15:23 [auto1.de] INFO: Scrape type for YH20513: 2
2026-03-27 11:15:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62770e11-6db2-5921-b647-aa9690722767 with identifier: YH20513
2026-03-27 11:15:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62770e11-6db2-5921-b647-aa9690722767 with scrape type 2
2026-03-27 11:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62770e11-6db2-5921-b647-aa9690722767 with scrape type 2
2026-03-27 11:15:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62770e11-6db2-5921-b647-aa9690722767, identifier: YH20513
2026-03-27 11:15:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6872f563-e08c-5155-9b5b-185c006a69d5 with identifier: PS90319
2026-03-27 11:15:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6872f563-e08c-5155-9b5b-185c006a69d5 with identifier: PS90319
2026-03-27 11:15:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6872f563-e08c-5155-9b5b-185c006a69d5 with identifier: PS90319 to the API
2026-03-27 11:15:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-27T16:00:33Z',
 'fuel_type': 'diesel',
 'id': '6872f563-e08c-5155-9b5b-185c006a69d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS90319',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 48073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-10',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2019}
2026-03-27 11:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS90319%27 HTTP/1.1" 200 None
2026-03-27 11:15:23 [auto1.de] INFO: Saving data for PS90319: {'auction_closing_time': 1774627233.0, 'created_time': 1774522017.143249, 'last_price_update_time': 1774610123.933396}
2026-03-27 11:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS90319') HTTP/1.1" 204 0
2026-03-27 11:15:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62770e11-6db2-5921-b647-aa9690722767 with identifier: YH20513
2026-03-27 11:15:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62770e11-6db2-5921-b647-aa9690722767 with identifier: YH20513
2026-03-27 11:15:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62770e11-6db2-5921-b647-aa9690722767 with identifier: YH20513 to the API
2026-03-27 11:15:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:33:49Z',
 'fuel_type': 'diesel',
 'id': '62770e11-6db2-5921-b647-aa9690722767',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH20513',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 208074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-18',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2018}
2026-03-27 11:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH20513%27 HTTP/1.1" 200 None
2026-03-27 11:15:24 [auto1.de] INFO: Saving data for YH20513: {'auction_closing_time': 1774629229.0, 'created_time': 1774521920.934352, 'last_price_update_time': 1774610124.312052}
2026-03-27 11:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH20513') HTTP/1.1" 204 0
2026-03-27 11:15:24 [auto1.de] INFO: Found listing with ID: ED37263
2026-03-27 11:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED37263%27 HTTP/1.1" 200 None
2026-03-27 11:15:24 [auto1.de] INFO: Scrape type for ED37263: 2
2026-03-27 11:15:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e3dc73b-eac7-50e5-b763-ab79b518d3e1 with identifier: ED37263
2026-03-27 11:15:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e3dc73b-eac7-50e5-b763-ab79b518d3e1 with scrape type 2
2026-03-27 11:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e3dc73b-eac7-50e5-b763-ab79b518d3e1 with scrape type 2
2026-03-27 11:15:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e3dc73b-eac7-50e5-b763-ab79b518d3e1, identifier: ED37263
2026-03-27 11:15:25 [auto1.de] INFO: Found listing with ID: BS12616
2026-03-27 11:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS12616%27 HTTP/1.1" 200 None
2026-03-27 11:15:25 [auto1.de] INFO: Scrape type for BS12616: 2
2026-03-27 11:15:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2244790d-e541-5d10-8880-2d09b5610945 with identifier: BS12616
2026-03-27 11:15:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2244790d-e541-5d10-8880-2d09b5610945 with scrape type 2
2026-03-27 11:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2244790d-e541-5d10-8880-2d09b5610945 with scrape type 2
2026-03-27 11:15:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2244790d-e541-5d10-8880-2d09b5610945, identifier: BS12616
2026-03-27 11:15:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e3dc73b-eac7-50e5-b763-ab79b518d3e1 with identifier: ED37263
2026-03-27 11:15:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e3dc73b-eac7-50e5-b763-ab79b518d3e1 with identifier: ED37263
2026-03-27 11:15:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e3dc73b-eac7-50e5-b763-ab79b518d3e1 with identifier: ED37263 to the API
2026-03-27 11:15:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-27T16:38:04Z',
 'fuel_type': 'petrol',
 'id': '3e3dc73b-eac7-50e5-b763-ab79b518d3e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED37263',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 106912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-16',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2014}
2026-03-27 11:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED37263%27 HTTP/1.1" 200 None
2026-03-27 11:15:25 [auto1.de] INFO: Saving data for ED37263: {'auction_closing_time': 1774629484.0, 'created_time': 1774522095.084998, 'last_price_update_time': 1774610125.494829}
2026-03-27 11:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED37263') HTTP/1.1" 204 0
2026-03-27 11:15:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2244790d-e541-5d10-8880-2d09b5610945 with identifier: BS12616
2026-03-27 11:15:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2244790d-e541-5d10-8880-2d09b5610945 with identifier: BS12616
2026-03-27 11:15:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2244790d-e541-5d10-8880-2d09b5610945 with identifier: BS12616 to the API
2026-03-27 11:15:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:12:56Z',
 'fuel_type': 'petrol',
 'id': '2244790d-e541-5d10-8880-2d09b5610945',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS12616',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 110335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-25',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2015}
2026-03-27 11:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS12616%27 HTTP/1.1" 200 None
2026-03-27 11:15:25 [auto1.de] INFO: Saving data for BS12616: {'auction_closing_time': 1774627976.0, 'created_time': 1774521918.672766, 'last_price_update_time': 1774610125.891217}
2026-03-27 11:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS12616') HTTP/1.1" 204 0
2026-03-27 11:15:25 [auto1.de] INFO: Found listing with ID: PB63814
2026-03-27 11:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB63814%27 HTTP/1.1" 200 None
2026-03-27 11:15:25 [auto1.de] INFO: Scrape type for PB63814: 2
2026-03-27 11:15:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b3be3b1-1db7-5994-ab79-49c53d1f559d with identifier: PB63814
2026-03-27 11:15:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b3be3b1-1db7-5994-ab79-49c53d1f559d with scrape type 2
2026-03-27 11:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b3be3b1-1db7-5994-ab79-49c53d1f559d with scrape type 2
2026-03-27 11:15:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b3be3b1-1db7-5994-ab79-49c53d1f559d, identifier: PB63814
2026-03-27 11:15:26 [auto1.de] INFO: Found listing with ID: SK08799
2026-03-27 11:15:26 [auto1.de] INFO: Found listing with ID: ZT00838
2026-03-27 11:15:26 [auto1.de] INFO: Found listing with ID: JH22526
2026-03-27 11:15:26 [auto1.de] INFO: Found listing with ID: NN53970
2026-03-27 11:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN53970%27 HTTP/1.1" 200 None
2026-03-27 11:15:26 [auto1.de] INFO: Scrape type for NN53970: 2
2026-03-27 11:15:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 733a19cb-c57c-5fd7-b643-7864d4ea7418 with identifier: NN53970
2026-03-27 11:15:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 733a19cb-c57c-5fd7-b643-7864d4ea7418 with scrape type 2
2026-03-27 11:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 733a19cb-c57c-5fd7-b643-7864d4ea7418 with scrape type 2
2026-03-27 11:15:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 733a19cb-c57c-5fd7-b643-7864d4ea7418, identifier: NN53970
2026-03-27 11:15:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b3be3b1-1db7-5994-ab79-49c53d1f559d with identifier: PB63814
2026-03-27 11:15:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b3be3b1-1db7-5994-ab79-49c53d1f559d with identifier: PB63814
2026-03-27 11:15:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b3be3b1-1db7-5994-ab79-49c53d1f559d with identifier: PB63814 to the API
2026-03-27 11:15:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:44:31Z',
 'fuel_type': 'diesel',
 'id': '2b3be3b1-1db7-5994-ab79-49c53d1f559d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB63814',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 173829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-31',
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Tendance',
 'transmission': 'automatic',
 'trim': 'Tendance',
 'year': 2011}
2026-03-27 11:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB63814%27 HTTP/1.1" 200 None
2026-03-27 11:15:26 [auto1.de] INFO: Saving data for PB63814: {'auction_closing_time': 1774629871.0, 'created_time': 1774522013.944685, 'last_price_update_time': 1774610126.576871}
2026-03-27 11:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB63814') HTTP/1.1" 204 0
2026-03-27 11:15:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 733a19cb-c57c-5fd7-b643-7864d4ea7418 with identifier: NN53970
2026-03-27 11:15:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 733a19cb-c57c-5fd7-b643-7864d4ea7418 with identifier: NN53970
2026-03-27 11:15:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 733a19cb-c57c-5fd7-b643-7864d4ea7418 with identifier: NN53970 to the API
2026-03-27 11:15:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-27T16:52:09Z',
 'fuel_type': 'petrol',
 'id': '733a19cb-c57c-5fd7-b643-7864d4ea7418',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN53970',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 25988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-24',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS',
 'transmission': 'manual',
 'trim': 'GS',
 'year': 2024}
2026-03-27 11:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN53970%27 HTTP/1.1" 200 None
2026-03-27 11:15:27 [auto1.de] INFO: Saving data for NN53970: {'auction_closing_time': 1774630329.0, 'created_time': 1774522205.073338, 'last_price_update_time': 1774610127.448574}
2026-03-27 11:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN53970') HTTP/1.1" 204 0
2026-03-27 11:15:27 [auto1.de] INFO: Found listing with ID: XS43563
2026-03-27 11:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS43563%27 HTTP/1.1" 200 None
2026-03-27 11:15:27 [auto1.de] INFO: Scrape type for XS43563: 2
2026-03-27 11:15:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81f74628-013a-543b-97f9-e050c19bc70e with identifier: XS43563
2026-03-27 11:15:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81f74628-013a-543b-97f9-e050c19bc70e with scrape type 2
2026-03-27 11:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81f74628-013a-543b-97f9-e050c19bc70e with scrape type 2
2026-03-27 11:15:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81f74628-013a-543b-97f9-e050c19bc70e, identifier: XS43563
2026-03-27 11:15:27 [auto1.de] INFO: Found listing with ID: XJ33844
2026-03-27 11:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ33844%27 HTTP/1.1" 200 None
2026-03-27 11:15:27 [auto1.de] INFO: Scrape type for XJ33844: 2
2026-03-27 11:15:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc1912f5-56a8-59f8-8454-39d5c4842405 with identifier: XJ33844
2026-03-27 11:15:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc1912f5-56a8-59f8-8454-39d5c4842405 with scrape type 2
2026-03-27 11:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc1912f5-56a8-59f8-8454-39d5c4842405 with scrape type 2
2026-03-27 11:15:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc1912f5-56a8-59f8-8454-39d5c4842405, identifier: XJ33844
2026-03-27 11:15:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81f74628-013a-543b-97f9-e050c19bc70e with identifier: XS43563
2026-03-27 11:15:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81f74628-013a-543b-97f9-e050c19bc70e with identifier: XS43563
2026-03-27 11:15:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81f74628-013a-543b-97f9-e050c19bc70e with identifier: XS43563 to the API
2026-03-27 11:15:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-27T16:28:17Z',
 'fuel_type': 'petrol',
 'id': '81f74628-013a-543b-97f9-e050c19bc70e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS43563',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 92183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-12',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2017}
2026-03-27 11:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS43563%27 HTTP/1.1" 200 None
2026-03-27 11:15:28 [auto1.de] INFO: Saving data for XS43563: {'auction_closing_time': 1774628897.0, 'created_time': 1774522020.128607, 'last_price_update_time': 1774610128.197445}
2026-03-27 11:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS43563') HTTP/1.1" 204 0
2026-03-27 11:15:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc1912f5-56a8-59f8-8454-39d5c4842405 with identifier: XJ33844
2026-03-27 11:15:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc1912f5-56a8-59f8-8454-39d5c4842405 with identifier: XJ33844
2026-03-27 11:15:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc1912f5-56a8-59f8-8454-39d5c4842405 with identifier: XJ33844 to the API
2026-03-27 11:15:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-27T16:58:46Z',
 'fuel_type': 'diesel',
 'id': 'dc1912f5-56a8-59f8-8454-39d5c4842405',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ33844',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 167229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-08',
 'seller_name': None,
 'title': 'Peugeot 208 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-27 11:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ33844%27 HTTP/1.1" 200 None
2026-03-27 11:15:28 [auto1.de] INFO: Saving data for XJ33844: {'auction_closing_time': 1774630726.0, 'created_time': 1774522164.144774, 'last_price_update_time': 1774610128.607208}
2026-03-27 11:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ33844') HTTP/1.1" 204 0
2026-03-27 11:15:28 [auto1.de] INFO: Found listing with ID: LS65332
2026-03-27 11:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS65332%27 HTTP/1.1" 200 None
2026-03-27 11:15:28 [auto1.de] INFO: Scrape type for LS65332: 2
2026-03-27 11:15:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47fe9947-cd6a-512d-b2d3-1ca5bb936c1f with identifier: LS65332
2026-03-27 11:15:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47fe9947-cd6a-512d-b2d3-1ca5bb936c1f with scrape type 2
2026-03-27 11:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47fe9947-cd6a-512d-b2d3-1ca5bb936c1f with scrape type 2
2026-03-27 11:15:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47fe9947-cd6a-512d-b2d3-1ca5bb936c1f, identifier: LS65332
2026-03-27 11:15:28 [auto1.de] INFO: Found listing with ID: WM76389
2026-03-27 11:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM76389%27 HTTP/1.1" 200 None
2026-03-27 11:15:28 [auto1.de] INFO: Scrape type for WM76389: 2
2026-03-27 11:15:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc99452c-87b0-5d0f-b0c1-95573163e5ef with identifier: WM76389
2026-03-27 11:15:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc99452c-87b0-5d0f-b0c1-95573163e5ef with scrape type 2
2026-03-27 11:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc99452c-87b0-5d0f-b0c1-95573163e5ef with scrape type 2
2026-03-27 11:15:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc99452c-87b0-5d0f-b0c1-95573163e5ef, identifier: WM76389
2026-03-27 11:15:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47fe9947-cd6a-512d-b2d3-1ca5bb936c1f with identifier: LS65332
2026-03-27 11:15:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47fe9947-cd6a-512d-b2d3-1ca5bb936c1f with identifier: LS65332
2026-03-27 11:15:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47fe9947-cd6a-512d-b2d3-1ca5bb936c1f with identifier: LS65332 to the API
2026-03-27 11:15:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-27T17:00:00Z',
 'fuel_type': 'petrol',
 'id': '47fe9947-cd6a-512d-b2d3-1ca5bb936c1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS65332',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 93833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-05',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.6 Comfort 4x2',
 'transmission': 'manual',
 'trim': 'Comfort 4x2',
 'year': 2017}
2026-03-27 11:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS65332%27 HTTP/1.1" 200 None
2026-03-27 11:15:29 [auto1.de] INFO: Saving data for LS65332: {'auction_closing_time': 1774630800.0, 'created_time': 1774522154.803756, 'last_price_update_time': 1774610129.15926}
2026-03-27 11:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS65332') HTTP/1.1" 204 0
2026-03-27 11:15:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc99452c-87b0-5d0f-b0c1-95573163e5ef with identifier: WM76389
2026-03-27 11:15:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc99452c-87b0-5d0f-b0c1-95573163e5ef with identifier: WM76389
2026-03-27 11:15:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc99452c-87b0-5d0f-b0c1-95573163e5ef with identifier: WM76389 to the API
2026-03-27 11:15:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:18:30Z',
 'fuel_type': 'diesel',
 'id': 'dc99452c-87b0-5d0f-b0c1-95573163e5ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM76389',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 207146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-21',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-27 11:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM76389%27 HTTP/1.1" 200 None
2026-03-27 11:15:29 [auto1.de] INFO: Saving data for WM76389: {'auction_closing_time': 1774628310.0, 'created_time': 1774522072.16326, 'last_price_update_time': 1774610129.507177}
2026-03-27 11:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM76389') HTTP/1.1" 204 0
2026-03-27 11:15:29 [auto1.de] INFO: Found listing with ID: GE16975
2026-03-27 11:15:29 [auto1.de] INFO: Found listing with ID: FT18987
2026-03-27 11:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT18987%27 HTTP/1.1" 200 None
2026-03-27 11:15:29 [auto1.de] INFO: Scrape type for FT18987: 2
2026-03-27 11:15:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 173a31b5-f1c0-5133-b206-6441c04b711e with identifier: FT18987
2026-03-27 11:15:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 173a31b5-f1c0-5133-b206-6441c04b711e with scrape type 2
2026-03-27 11:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 173a31b5-f1c0-5133-b206-6441c04b711e with scrape type 2
2026-03-27 11:15:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 173a31b5-f1c0-5133-b206-6441c04b711e, identifier: FT18987
2026-03-27 11:15:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 173a31b5-f1c0-5133-b206-6441c04b711e with identifier: FT18987
2026-03-27 11:15:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 173a31b5-f1c0-5133-b206-6441c04b711e with identifier: FT18987
2026-03-27 11:15:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 173a31b5-f1c0-5133-b206-6441c04b711e with identifier: FT18987 to the API
2026-03-27 11:15:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-27T16:51:44Z',
 'fuel_type': 'petrol',
 'id': '173a31b5-f1c0-5133-b206-6441c04b711e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT18987',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 30704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
 'transmission': 'automatic',
 'trim': 'GTI Clubsport',
 'year': 2022}
2026-03-27 11:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT18987%27 HTTP/1.1" 200 None
2026-03-27 11:15:29 [auto1.de] INFO: Saving data for FT18987: {'auction_closing_time': 1774630304.0, 'created_time': 1774522073.727935, 'last_price_update_time': 1774610129.982923}
2026-03-27 11:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT18987') HTTP/1.1" 204 0
2026-03-27 11:15:30 [auto1.de] INFO: Found listing with ID: MF56816
2026-03-27 11:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF56816%27 HTTP/1.1" 200 None
2026-03-27 11:15:30 [auto1.de] INFO: Scrape type for MF56816: 2
2026-03-27 11:15:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8d0ebea-faf1-51a4-bbb9-707001d8db27 with identifier: MF56816
2026-03-27 11:15:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8d0ebea-faf1-51a4-bbb9-707001d8db27 with scrape type 2
2026-03-27 11:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8d0ebea-faf1-51a4-bbb9-707001d8db27 with scrape type 2
2026-03-27 11:15:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8d0ebea-faf1-51a4-bbb9-707001d8db27, identifier: MF56816
2026-03-27 11:15:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8d0ebea-faf1-51a4-bbb9-707001d8db27 with identifier: MF56816
2026-03-27 11:15:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8d0ebea-faf1-51a4-bbb9-707001d8db27 with identifier: MF56816
2026-03-27 11:15:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8d0ebea-faf1-51a4-bbb9-707001d8db27 with identifier: MF56816 to the API
2026-03-27 11:15:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-27T16:59:55Z',
 'fuel_type': 'diesel',
 'id': 'e8d0ebea-faf1-51a4-bbb9-707001d8db27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF56816',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 165894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-28',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-27 11:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF56816%27 HTTP/1.1" 200 None
2026-03-27 11:15:30 [auto1.de] INFO: Saving data for MF56816: {'auction_closing_time': 1774630795.0, 'created_time': 1774522036.277938, 'last_price_update_time': 1774610130.454359}
2026-03-27 11:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF56816') HTTP/1.1" 204 0
2026-03-27 11:15:30 [auto1.de] INFO: Found listing with ID: DV41165
2026-03-27 11:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41165%27 HTTP/1.1" 200 None
2026-03-27 11:15:30 [auto1.de] INFO: Scrape type for DV41165: 2
2026-03-27 11:15:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c203b7fd-e636-5306-ad1a-d5d21fa78650 with identifier: DV41165
2026-03-27 11:15:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c203b7fd-e636-5306-ad1a-d5d21fa78650 with scrape type 2
2026-03-27 11:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c203b7fd-e636-5306-ad1a-d5d21fa78650 with scrape type 2
2026-03-27 11:15:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c203b7fd-e636-5306-ad1a-d5d21fa78650, identifier: DV41165
2026-03-27 11:15:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c203b7fd-e636-5306-ad1a-d5d21fa78650 with identifier: DV41165
2026-03-27 11:15:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c203b7fd-e636-5306-ad1a-d5d21fa78650 with identifier: DV41165
2026-03-27 11:15:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c203b7fd-e636-5306-ad1a-d5d21fa78650 with identifier: DV41165 to the API
2026-03-27 11:15:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-27T16:37:22Z',
 'fuel_type': 'petrol',
 'id': 'c203b7fd-e636-5306-ad1a-d5d21fa78650',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV41165',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 48581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-04',
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI Roadster',
 'transmission': 'manual',
 'trim': 'Roadster',
 'year': 2007}
2026-03-27 11:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41165%27 HTTP/1.1" 200 None
2026-03-27 11:15:30 [auto1.de] INFO: Saving data for DV41165: {'auction_closing_time': 1774629442.0, 'created_time': 1774522080.573693, 'last_price_update_time': 1774610130.943806}
2026-03-27 11:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV41165') HTTP/1.1" 204 0
2026-03-27 11:15:30 [auto1.de] INFO: Found listing with ID: KF98082
2026-03-27 11:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF98082%27 HTTP/1.1" 200 None
2026-03-27 11:15:30 [auto1.de] INFO: Scrape type for KF98082: 2
2026-03-27 11:15:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f162d6f-6e38-554d-b98e-c5a0cf2c9762 with identifier: KF98082
2026-03-27 11:15:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f162d6f-6e38-554d-b98e-c5a0cf2c9762 with scrape type 2
2026-03-27 11:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f162d6f-6e38-554d-b98e-c5a0cf2c9762 with scrape type 2
2026-03-27 11:15:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f162d6f-6e38-554d-b98e-c5a0cf2c9762, identifier: KF98082
2026-03-27 11:15:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f162d6f-6e38-554d-b98e-c5a0cf2c9762 with identifier: KF98082
2026-03-27 11:15:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f162d6f-6e38-554d-b98e-c5a0cf2c9762 with identifier: KF98082
2026-03-27 11:15:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f162d6f-6e38-554d-b98e-c5a0cf2c9762 with identifier: KF98082 to the API
2026-03-27 11:15:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:07:37Z',
 'fuel_type': 'petrol',
 'id': '1f162d6f-6e38-554d-b98e-c5a0cf2c9762',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF98082',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 73254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2009}
2026-03-27 11:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF98082%27 HTTP/1.1" 200 None
2026-03-27 11:15:32 [auto1.de] INFO: Saving data for KF98082: {'auction_closing_time': 1774627657.0, 'created_time': 1774522152.056699, 'last_price_update_time': 1774610132.333925}
2026-03-27 11:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF98082') HTTP/1.1" 204 0
2026-03-27 11:15:32 [auto1.de] INFO: Found listing with ID: EU27466
2026-03-27 11:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU27466%27 HTTP/1.1" 200 None
2026-03-27 11:15:32 [auto1.de] INFO: Scrape type for EU27466: 2
2026-03-27 11:15:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7 with identifier: EU27466
2026-03-27 11:15:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7 with scrape type 2
2026-03-27 11:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7 with scrape type 2
2026-03-27 11:15:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7, identifier: EU27466
2026-03-27 11:15:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7 with identifier: EU27466
2026-03-27 11:15:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7 with identifier: EU27466
2026-03-27 11:15:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7 with identifier: EU27466 to the API
2026-03-27 11:15:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:12:10Z',
 'fuel_type': 'petrol',
 'id': 'ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU27466',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf III',
 'odometer': 192141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1995-03-20',
 'seller_name': None,
 'title': 'Volkswagen Golf III 2.0',
 'transmission': 'manual',
 'trim': '',
 'year': 1995}
2026-03-27 11:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU27466%27 HTTP/1.1" 200 None
2026-03-27 11:15:32 [auto1.de] INFO: Saving data for EU27466: {'auction_closing_time': 1774627930.0, 'created_time': 1774522125.880616, 'last_price_update_time': 1774610132.901918}
2026-03-27 11:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU27466') HTTP/1.1" 204 0
2026-03-27 11:15:32 [auto1.de] INFO: Found listing with ID: XP66514
2026-03-27 11:15:32 [auto1.de] INFO: Found listing with ID: CL98622
2026-03-27 11:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL98622%27 HTTP/1.1" 200 None
2026-03-27 11:15:32 [auto1.de] INFO: Scrape type for CL98622: 2
2026-03-27 11:15:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 867db7d9-aaf2-5d90-a6e3-fd69de6bbcee with identifier: CL98622
2026-03-27 11:15:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 867db7d9-aaf2-5d90-a6e3-fd69de6bbcee with scrape type 2
2026-03-27 11:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 867db7d9-aaf2-5d90-a6e3-fd69de6bbcee with scrape type 2
2026-03-27 11:15:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 867db7d9-aaf2-5d90-a6e3-fd69de6bbcee, identifier: CL98622
2026-03-27 11:15:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 867db7d9-aaf2-5d90-a6e3-fd69de6bbcee with identifier: CL98622
2026-03-27 11:15:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 867db7d9-aaf2-5d90-a6e3-fd69de6bbcee with identifier: CL98622
2026-03-27 11:15:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 867db7d9-aaf2-5d90-a6e3-fd69de6bbcee with identifier: CL98622 to the API
2026-03-27 11:15:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-27T16:18:57Z',
 'fuel_type': 'hybrid',
 'id': '867db7d9-aaf2-5d90-a6e3-fd69de6bbcee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL98622',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 45664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-18',
 'seller_name': None,
 'title': 'Toyota Auris 1.8 Hybrid Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2015}
2026-03-27 11:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL98622%27 HTTP/1.1" 200 None
2026-03-27 11:15:33 [auto1.de] INFO: Saving data for CL98622: {'auction_closing_time': 1774628337.0, 'created_time': 1774522158.264978, 'last_price_update_time': 1774610133.325772}
2026-03-27 11:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL98622') HTTP/1.1" 204 0
2026-03-27 11:15:33 [auto1.de] INFO: Found listing with ID: VY29907
2026-03-27 11:15:33 [auto1.de] INFO: Found listing with ID: SG95649
2026-03-27 11:15:33 [auto1.de] INFO: Found listing with ID: AF53783
2026-03-27 11:15:33 [auto1.de] INFO: Found listing with ID: GA42145
2026-03-27 11:15:33 [auto1.de] INFO: Found listing with ID: XY04556
2026-03-27 11:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY04556%27 HTTP/1.1" 200 None
2026-03-27 11:15:33 [auto1.de] INFO: Scrape type for XY04556: 2
2026-03-27 11:15:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eaad85e8-427c-5ec3-b283-067a4aae5fd2 with identifier: XY04556
2026-03-27 11:15:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eaad85e8-427c-5ec3-b283-067a4aae5fd2 with scrape type 2
2026-03-27 11:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eaad85e8-427c-5ec3-b283-067a4aae5fd2 with scrape type 2
2026-03-27 11:15:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eaad85e8-427c-5ec3-b283-067a4aae5fd2, identifier: XY04556
2026-03-27 11:15:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eaad85e8-427c-5ec3-b283-067a4aae5fd2 with identifier: XY04556
2026-03-27 11:15:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eaad85e8-427c-5ec3-b283-067a4aae5fd2 with identifier: XY04556
2026-03-27 11:15:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eaad85e8-427c-5ec3-b283-067a4aae5fd2 with identifier: XY04556 to the API
2026-03-27 11:15:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-27T16:56:32Z',
 'fuel_type': 'diesel',
 'id': 'eaad85e8-427c-5ec3-b283-067a4aae5fd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY04556',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 208851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-14',
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2018}
2026-03-27 11:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY04556%27 HTTP/1.1" 200 None
2026-03-27 11:15:33 [auto1.de] INFO: Saving data for XY04556: {'auction_closing_time': 1774630592.0, 'created_time': 1773686843.770074, 'last_price_update_time': 1774610133.932889}
2026-03-27 11:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY04556') HTTP/1.1" 204 0
2026-03-27 11:15:33 [auto1.de] INFO: Found listing with ID: GK12376
2026-03-27 11:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK12376%27 HTTP/1.1" 200 None
2026-03-27 11:15:33 [auto1.de] INFO: Scrape type for GK12376: 2
2026-03-27 11:15:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f5d219e-1849-5a32-828a-72ee0dec9a1f with identifier: GK12376
2026-03-27 11:15:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f5d219e-1849-5a32-828a-72ee0dec9a1f with scrape type 2
2026-03-27 11:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f5d219e-1849-5a32-828a-72ee0dec9a1f with scrape type 2
2026-03-27 11:15:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f5d219e-1849-5a32-828a-72ee0dec9a1f, identifier: GK12376
2026-03-27 11:15:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f5d219e-1849-5a32-828a-72ee0dec9a1f with identifier: GK12376
2026-03-27 11:15:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f5d219e-1849-5a32-828a-72ee0dec9a1f with identifier: GK12376
2026-03-27 11:15:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f5d219e-1849-5a32-828a-72ee0dec9a1f with identifier: GK12376 to the API
2026-03-27 11:15:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-27T16:08:54Z',
 'fuel_type': 'diesel',
 'id': '4f5d219e-1849-5a32-828a-72ee0dec9a1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK12376',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 265248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-31',
 'seller_name': None,
 'title': 'Opel Insignia 2.0 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2013}
2026-03-27 11:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK12376%27 HTTP/1.1" 200 None
2026-03-27 11:15:34 [auto1.de] INFO: Saving data for GK12376: {'auction_closing_time': 1774627734.0, 'created_time': 1773138628.89174, 'last_price_update_time': 1774610134.527178}
2026-03-27 11:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK12376') HTTP/1.1" 204 0
2026-03-27 11:15:34 [auto1.de] INFO: Found listing with ID: AE64290
2026-03-27 11:15:34 [auto1.de] INFO: Found listing with ID: DC45609
2026-03-27 11:15:34 [auto1.de] INFO: Found listing with ID: VT43931
2026-03-27 11:15:34 [auto1.de] INFO: Found listing with ID: AJ16531
2026-03-27 11:15:34 [auto1.de] INFO: Found listing with ID: YC02535
2026-03-27 11:15:34 [auto1.de] INFO: Found listing with ID: ME72354
2026-03-27 11:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME72354%27 HTTP/1.1" 200 None
2026-03-27 11:15:34 [auto1.de] INFO: Scrape type for ME72354: 2
2026-03-27 11:15:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25e41024-7e1d-5e66-ba7a-72a80db254ec with identifier: ME72354
2026-03-27 11:15:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25e41024-7e1d-5e66-ba7a-72a80db254ec with scrape type 2
2026-03-27 11:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25e41024-7e1d-5e66-ba7a-72a80db254ec with scrape type 2
2026-03-27 11:15:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25e41024-7e1d-5e66-ba7a-72a80db254ec, identifier: ME72354
2026-03-27 11:15:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25e41024-7e1d-5e66-ba7a-72a80db254ec with identifier: ME72354
2026-03-27 11:15:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25e41024-7e1d-5e66-ba7a-72a80db254ec with identifier: ME72354
2026-03-27 11:15:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25e41024-7e1d-5e66-ba7a-72a80db254ec with identifier: ME72354 to the API
2026-03-27 11:15:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:11:42Z',
 'fuel_type': 'petrol',
 'id': '25e41024-7e1d-5e66-ba7a-72a80db254ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME72354',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 167119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-28',
 'seller_name': None,
 'title': 'Skoda Octavia 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2019}
2026-03-27 11:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME72354%27 HTTP/1.1" 200 None
2026-03-27 11:15:35 [auto1.de] INFO: Saving data for ME72354: {'auction_closing_time': 1774627902.0, 'created_time': 1774522028.888157, 'last_price_update_time': 1774610135.177852}
2026-03-27 11:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME72354') HTTP/1.1" 204 0
2026-03-27 11:15:35 [auto1.de] INFO: Found listing with ID: XP10598
2026-03-27 11:15:35 [auto1.de] INFO: Found listing with ID: BY14877
2026-03-27 11:15:35 [auto1.de] INFO: Found listing with ID: TE18178
2026-03-27 11:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE18178%27 HTTP/1.1" 200 None
2026-03-27 11:15:35 [auto1.de] INFO: Scrape type for TE18178: 2
2026-03-27 11:15:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79dffafe-0f64-5b51-9798-089d607e652c with identifier: TE18178
2026-03-27 11:15:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79dffafe-0f64-5b51-9798-089d607e652c with scrape type 2
2026-03-27 11:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79dffafe-0f64-5b51-9798-089d607e652c with scrape type 2
2026-03-27 11:15:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79dffafe-0f64-5b51-9798-089d607e652c, identifier: TE18178
2026-03-27 11:15:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79dffafe-0f64-5b51-9798-089d607e652c with identifier: TE18178
2026-03-27 11:15:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79dffafe-0f64-5b51-9798-089d607e652c with identifier: TE18178
2026-03-27 11:15:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79dffafe-0f64-5b51-9798-089d607e652c with identifier: TE18178 to the API
2026-03-27 11:15:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-27T16:31:50Z',
 'fuel_type': 'diesel',
 'id': '79dffafe-0f64-5b51-9798-089d607e652c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE18178',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 165027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-27',
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Allure L1',
 'transmission': 'manual',
 'trim': 'Allure L1',
 'year': 2020}
2026-03-27 11:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE18178%27 HTTP/1.1" 200 None
2026-03-27 11:15:35 [auto1.de] INFO: Saving data for TE18178: {'auction_closing_time': 1774629110.0, 'created_time': 1774522019.192393, 'last_price_update_time': 1774610135.747803}
2026-03-27 11:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE18178') HTTP/1.1" 204 0
2026-03-27 11:15:35 [auto1.de] INFO: Found listing with ID: LV79000
2026-03-27 11:15:35 [auto1.de] INFO: Found listing with ID: UC41280
2026-03-27 11:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC41280%27 HTTP/1.1" 200 None
2026-03-27 11:15:35 [auto1.de] INFO: Scrape type for UC41280: 2
2026-03-27 11:15:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be5aa737-c5eb-5789-98a4-6242d4aab2b7 with identifier: UC41280
2026-03-27 11:15:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be5aa737-c5eb-5789-98a4-6242d4aab2b7 with scrape type 2
2026-03-27 11:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be5aa737-c5eb-5789-98a4-6242d4aab2b7 with scrape type 2
2026-03-27 11:15:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be5aa737-c5eb-5789-98a4-6242d4aab2b7, identifier: UC41280
2026-03-27 11:15:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be5aa737-c5eb-5789-98a4-6242d4aab2b7 with identifier: UC41280
2026-03-27 11:15:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be5aa737-c5eb-5789-98a4-6242d4aab2b7 with identifier: UC41280
2026-03-27 11:15:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be5aa737-c5eb-5789-98a4-6242d4aab2b7 with identifier: UC41280 to the API
2026-03-27 11:15:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-27T16:54:24Z',
 'fuel_type': 'diesel',
 'id': 'be5aa737-c5eb-5789-98a4-6242d4aab2b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC41280',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 93319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Shine M',
 'transmission': 'manual',
 'trim': 'Shine M',
 'year': 2019}
2026-03-27 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC41280%27 HTTP/1.1" 200 None
2026-03-27 11:15:36 [auto1.de] INFO: Saving data for UC41280: {'auction_closing_time': 1774630464.0, 'created_time': 1774522140.104033, 'last_price_update_time': 1774610136.221977}
2026-03-27 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC41280') HTTP/1.1" 204 0
2026-03-27 11:15:36 [auto1.de] INFO: Found listing with ID: AZ46556
2026-03-27 11:15:36 [auto1.de] INFO: Found listing with ID: LL44743
2026-03-27 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL44743%27 HTTP/1.1" 200 None
2026-03-27 11:15:36 [auto1.de] INFO: Scrape type for LL44743: 2
2026-03-27 11:15:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96a593ff-d3f8-5b76-a477-5ef5c12523e7 with identifier: LL44743
2026-03-27 11:15:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a593ff-d3f8-5b76-a477-5ef5c12523e7 with scrape type 2
2026-03-27 11:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96a593ff-d3f8-5b76-a477-5ef5c12523e7 with scrape type 2
2026-03-27 11:15:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96a593ff-d3f8-5b76-a477-5ef5c12523e7, identifier: LL44743
2026-03-27 11:15:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96a593ff-d3f8-5b76-a477-5ef5c12523e7 with identifier: LL44743
2026-03-27 11:15:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96a593ff-d3f8-5b76-a477-5ef5c12523e7 with identifier: LL44743
2026-03-27 11:15:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96a593ff-d3f8-5b76-a477-5ef5c12523e7 with identifier: LL44743 to the API
2026-03-27 11:15:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:29:43Z',
 'fuel_type': 'diesel',
 'id': '96a593ff-d3f8-5b76-a477-5ef5c12523e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL44743',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 298382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-31',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Freestyle',
 'transmission': 'manual',
 'trim': 'Freestyle',
 'year': 2010}
2026-03-27 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL44743%27 HTTP/1.1" 200 None
2026-03-27 11:15:36 [auto1.de] INFO: Saving data for LL44743: {'auction_closing_time': 1774628983.0, 'created_time': 1774522139.411291, 'last_price_update_time': 1774610136.677259}
2026-03-27 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL44743') HTTP/1.1" 204 0
2026-03-27 11:15:36 [auto1.de] INFO: Found listing with ID: VB85046
2026-03-27 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB85046%27 HTTP/1.1" 200 None
2026-03-27 11:15:36 [auto1.de] INFO: Scrape type for VB85046: 2
2026-03-27 11:15:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6804e18f-e856-5b3a-96b4-1a2cb1d9d1ee with identifier: VB85046
2026-03-27 11:15:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6804e18f-e856-5b3a-96b4-1a2cb1d9d1ee with scrape type 2
2026-03-27 11:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6804e18f-e856-5b3a-96b4-1a2cb1d9d1ee with scrape type 2
2026-03-27 11:15:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6804e18f-e856-5b3a-96b4-1a2cb1d9d1ee, identifier: VB85046
2026-03-27 11:15:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6804e18f-e856-5b3a-96b4-1a2cb1d9d1ee with identifier: VB85046
2026-03-27 11:15:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6804e18f-e856-5b3a-96b4-1a2cb1d9d1ee with identifier: VB85046
2026-03-27 11:15:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6804e18f-e856-5b3a-96b4-1a2cb1d9d1ee with identifier: VB85046 to the API
2026-03-27 11:15:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-27T16:57:13Z',
 'fuel_type': 'petrol',
 'id': '6804e18f-e856-5b3a-96b4-1a2cb1d9d1ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB85046',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 119685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-12-08',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Kompressor T Classic',
 'transmission': 'automatic',
 'trim': 'T Classic',
 'year': 2004}
2026-03-27 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB85046%27 HTTP/1.1" 200 None
2026-03-27 11:15:37 [auto1.de] INFO: Saving data for VB85046: {'auction_closing_time': 1774630633.0, 'created_time': 1774522114.544487, 'last_price_update_time': 1774610137.097868}
2026-03-27 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VB85046') HTTP/1.1" 204 0
2026-03-27 11:15:37 [auto1.de] INFO: Found listing with ID: UP40831
2026-03-27 11:15:37 [auto1.de] INFO: Found listing with ID: JF43262
2026-03-27 11:15:37 [auto1.de] INFO: Found listing with ID: MV77064
2026-03-27 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV77064%27 HTTP/1.1" 200 None
2026-03-27 11:15:37 [auto1.de] INFO: Scrape type for MV77064: 2
2026-03-27 11:15:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713 with identifier: MV77064
2026-03-27 11:15:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713 with scrape type 2
2026-03-27 11:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713 with scrape type 2
2026-03-27 11:15:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713, identifier: MV77064
2026-03-27 11:15:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713 with identifier: MV77064
2026-03-27 11:15:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713 with identifier: MV77064
2026-03-27 11:15:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713 with identifier: MV77064 to the API
2026-03-27 11:15:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-27T16:04:46Z',
 'fuel_type': 'petrol',
 'id': '7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV77064',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 96524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-02',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-27 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV77064%27 HTTP/1.1" 200 None
2026-03-27 11:15:37 [auto1.de] INFO: Saving data for MV77064: {'auction_closing_time': 1774627486.0, 'created_time': 1774522109.583671, 'last_price_update_time': 1774610137.698117}
2026-03-27 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV77064') HTTP/1.1" 204 0
2026-03-27 11:15:37 [auto1.de] INFO: Found listing with ID: LX58961
2026-03-27 11:15:37 [auto1.de] INFO: Found listing with ID: PA34269
2026-03-27 11:15:37 [auto1.de] INFO: Found listing with ID: VG14564
2026-03-27 11:15:37 [auto1.de] INFO: Found listing with ID: RN76811
2026-03-27 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN76811%27 HTTP/1.1" 200 None
2026-03-27 11:15:37 [auto1.de] INFO: Scrape type for RN76811: 2
2026-03-27 11:15:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: defde70b-87fb-5f07-bd25-d0c1a415c0a0 with identifier: RN76811
2026-03-27 11:15:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item defde70b-87fb-5f07-bd25-d0c1a415c0a0 with scrape type 2
2026-03-27 11:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item defde70b-87fb-5f07-bd25-d0c1a415c0a0 with scrape type 2
2026-03-27 11:15:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: defde70b-87fb-5f07-bd25-d0c1a415c0a0, identifier: RN76811
2026-03-27 11:15:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: defde70b-87fb-5f07-bd25-d0c1a415c0a0 with identifier: RN76811
2026-03-27 11:15:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: defde70b-87fb-5f07-bd25-d0c1a415c0a0 with identifier: RN76811
2026-03-27 11:15:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: defde70b-87fb-5f07-bd25-d0c1a415c0a0 with identifier: RN76811 to the API
2026-03-27 11:15:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-27T16:09:02Z',
 'fuel_type': 'petrol',
 'id': 'defde70b-87fb-5f07-bd25-d0c1a415c0a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN76811',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 129177,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Sound BlueMotion',
 'transmission': 'manual',
 'trim': 'Sound BlueMotion',
 'year': 2017}
2026-03-27 11:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN76811%27 HTTP/1.1" 200 None
2026-03-27 11:15:38 [auto1.de] INFO: Saving data for RN76811: {'auction_closing_time': 1774627742.0, 'created_time': 1774522116.957744, 'last_price_update_time': 1774610138.48075}
2026-03-27 11:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN76811') HTTP/1.1" 204 0
2026-03-27 11:15:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:15:39 [auto1.de] INFO: Channel: 24h | Page: 253 | totalHits: 10683 | hits on page: 40
2026-03-27 11:15:39 [auto1.de] INFO: Found listing with ID: RN76811
2026-03-27 11:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN76811%27 HTTP/1.1" 200 None
2026-03-27 11:15:39 [auto1.de] INFO: Scrape type for RN76811: 0
2026-03-27 11:15:39 [auto1.de] INFO: Found listing with ID: SP68179
2026-03-27 11:15:39 [auto1.de] INFO: Found listing with ID: CF52360
2026-03-27 11:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF52360%27 HTTP/1.1" 200 None
2026-03-27 11:15:39 [auto1.de] INFO: Scrape type for CF52360: 2
2026-03-27 11:15:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03d7d54a-51ea-593a-a5d6-454435d0587a with identifier: CF52360
2026-03-27 11:15:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03d7d54a-51ea-593a-a5d6-454435d0587a with scrape type 2
2026-03-27 11:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03d7d54a-51ea-593a-a5d6-454435d0587a with scrape type 2
2026-03-27 11:15:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03d7d54a-51ea-593a-a5d6-454435d0587a, identifier: CF52360
2026-03-27 11:15:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03d7d54a-51ea-593a-a5d6-454435d0587a with identifier: CF52360
2026-03-27 11:15:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03d7d54a-51ea-593a-a5d6-454435d0587a with identifier: CF52360
2026-03-27 11:15:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03d7d54a-51ea-593a-a5d6-454435d0587a with identifier: CF52360 to the API
2026-03-27 11:15:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:49:51Z',
 'fuel_type': 'diesel',
 'id': '03d7d54a-51ea-593a-a5d6-454435d0587a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF52360',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 82936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-26',
 'seller_name': None,
 'title': 'Skoda Yeti 2.0 TDI Adventure 4x4',
 'transmission': 'manual',
 'trim': 'Adventure 4x4',
 'year': 2014}
2026-03-27 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF52360%27 HTTP/1.1" 200 None
2026-03-27 11:15:40 [auto1.de] INFO: Saving data for CF52360: {'auction_closing_time': 1774630191.0, 'created_time': 1774522162.370804, 'last_price_update_time': 1774610140.173669}
2026-03-27 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF52360') HTTP/1.1" 204 0
2026-03-27 11:15:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:15:40 [auto1.de] INFO: Found listing with ID: PE09652
2026-03-27 11:15:40 [auto1.de] INFO: Found listing with ID: VC70075
2026-03-27 11:15:40 [auto1.de] INFO: Found listing with ID: VS05622
2026-03-27 11:15:40 [auto1.de] INFO: Found listing with ID: HT55268
2026-03-27 11:15:40 [auto1.de] INFO: Found listing with ID: ZC42699
2026-03-27 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC42699%27 HTTP/1.1" 200 None
2026-03-27 11:15:40 [auto1.de] INFO: Scrape type for ZC42699: 2
2026-03-27 11:15:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acbb90e9-eade-513d-8eb4-35cf6804cc04 with identifier: ZC42699
2026-03-27 11:15:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acbb90e9-eade-513d-8eb4-35cf6804cc04 with scrape type 2
2026-03-27 11:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acbb90e9-eade-513d-8eb4-35cf6804cc04 with scrape type 2
2026-03-27 11:15:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acbb90e9-eade-513d-8eb4-35cf6804cc04, identifier: ZC42699
2026-03-27 11:15:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acbb90e9-eade-513d-8eb4-35cf6804cc04 with identifier: ZC42699
2026-03-27 11:15:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acbb90e9-eade-513d-8eb4-35cf6804cc04 with identifier: ZC42699
2026-03-27 11:15:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acbb90e9-eade-513d-8eb4-35cf6804cc04 with identifier: ZC42699 to the API
2026-03-27 11:15:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 440,
 'expiration_date': '2026-03-27T16:24:35Z',
 'fuel_type': 'petrol',
 'id': 'acbb90e9-eade-513d-8eb4-35cf6804cc04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC42699',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Panamera Sport Turismo',
 'odometer': 134297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-12',
 'seller_name': None,
 'title': 'Porsche Panamera Sport Turismo 4S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-27 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC42699%27 HTTP/1.1" 200 None
2026-03-27 11:15:40 [auto1.de] INFO: Saving data for ZC42699: {'auction_closing_time': 1774628675.0, 'created_time': 1774522119.593599, 'last_price_update_time': 1774610140.686976}
2026-03-27 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC42699') HTTP/1.1" 204 0
2026-03-27 11:15:40 [auto1.de] INFO: Found listing with ID: AH30629
2026-03-27 11:15:40 [auto1.de] INFO: Found listing with ID: ED86837
2026-03-27 11:15:40 [auto1.de] INFO: Found listing with ID: NH12576
2026-03-27 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH12576%27 HTTP/1.1" 200 None
2026-03-27 11:15:40 [auto1.de] INFO: Scrape type for NH12576: 2
2026-03-27 11:15:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e88df9d-87de-5d25-92dd-741ecc203953 with identifier: NH12576
2026-03-27 11:15:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e88df9d-87de-5d25-92dd-741ecc203953 with scrape type 2
2026-03-27 11:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e88df9d-87de-5d25-92dd-741ecc203953 with scrape type 2
2026-03-27 11:15:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e88df9d-87de-5d25-92dd-741ecc203953, identifier: NH12576
2026-03-27 11:15:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e88df9d-87de-5d25-92dd-741ecc203953 with identifier: NH12576
2026-03-27 11:15:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e88df9d-87de-5d25-92dd-741ecc203953 with identifier: NH12576
2026-03-27 11:15:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e88df9d-87de-5d25-92dd-741ecc203953 with identifier: NH12576 to the API
2026-03-27 11:15:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:24:46Z',
 'fuel_type': 'petrol',
 'id': '9e88df9d-87de-5d25-92dd-741ecc203953',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH12576',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 142994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-09-17',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2001}
2026-03-27 11:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH12576%27 HTTP/1.1" 200 None
2026-03-27 11:15:41 [auto1.de] INFO: Saving data for NH12576: {'auction_closing_time': 1774628686.0, 'created_time': 1774522110.729333, 'last_price_update_time': 1774610141.355917}
2026-03-27 11:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH12576') HTTP/1.1" 204 0
2026-03-27 11:15:41 [auto1.de] INFO: Found listing with ID: WW96945
2026-03-27 11:15:41 [auto1.de] INFO: Found listing with ID: EU37880
2026-03-27 11:15:41 [auto1.de] INFO: Found listing with ID: YE53774
2026-03-27 11:15:41 [auto1.de] INFO: Found listing with ID: BB78660
2026-03-27 11:15:41 [auto1.de] INFO: Found listing with ID: PX79754
2026-03-27 11:15:41 [auto1.de] INFO: Found listing with ID: AH65486
2026-03-27 11:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65486%27 HTTP/1.1" 200 None
2026-03-27 11:15:41 [auto1.de] INFO: Scrape type for AH65486: 2
2026-03-27 11:15:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcae66b3-402f-5baa-b5b9-f5dea7b03047 with identifier: AH65486
2026-03-27 11:15:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcae66b3-402f-5baa-b5b9-f5dea7b03047 with scrape type 2
2026-03-27 11:15:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcae66b3-402f-5baa-b5b9-f5dea7b03047 with scrape type 2
2026-03-27 11:15:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bcae66b3-402f-5baa-b5b9-f5dea7b03047, identifier: AH65486
2026-03-27 11:15:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bcae66b3-402f-5baa-b5b9-f5dea7b03047 with identifier: AH65486
2026-03-27 11:15:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bcae66b3-402f-5baa-b5b9-f5dea7b03047 with identifier: AH65486
2026-03-27 11:15:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bcae66b3-402f-5baa-b5b9-f5dea7b03047 with identifier: AH65486 to the API
2026-03-27 11:15:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 335,
 'expiration_date': '2026-03-27T16:45:42Z',
 'fuel_type': 'petrol',
 'id': 'bcae66b3-402f-5baa-b5b9-f5dea7b03047',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH65486',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Phaeton',
 'odometer': 148377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-16',
 'seller_name': None,
 'title': 'Volkswagen Phaeton 4.2 V8 4Motion',
 'transmission': 'automatic',
 'trim': '4Motion',
 'year': 2009}
2026-03-27 11:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65486%27 HTTP/1.1" 200 None
2026-03-27 11:15:41 [auto1.de] INFO: Saving data for AH65486: {'auction_closing_time': 1774629942.0, 'created_time': 1774522095.997701, 'last_price_update_time': 1774610141.845461}
2026-03-27 11:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH65486') HTTP/1.1" 204 0
2026-03-27 11:15:41 [auto1.de] INFO: Found listing with ID: RN84486
2026-03-27 11:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN84486%27 HTTP/1.1" 200 None
2026-03-27 11:15:41 [auto1.de] INFO: Scrape type for RN84486: 2
2026-03-27 11:15:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a72d3156-6b82-5078-99f6-76c8850b5177 with identifier: RN84486
2026-03-27 11:15:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a72d3156-6b82-5078-99f6-76c8850b5177 with scrape type 2
2026-03-27 11:15:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a72d3156-6b82-5078-99f6-76c8850b5177 with scrape type 2
2026-03-27 11:15:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a72d3156-6b82-5078-99f6-76c8850b5177, identifier: RN84486
2026-03-27 11:15:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a72d3156-6b82-5078-99f6-76c8850b5177 with identifier: RN84486
2026-03-27 11:15:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a72d3156-6b82-5078-99f6-76c8850b5177 with identifier: RN84486
2026-03-27 11:15:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a72d3156-6b82-5078-99f6-76c8850b5177 with identifier: RN84486 to the API
2026-03-27 11:15:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-27T16:09:29Z',
 'fuel_type': 'petrol',
 'id': 'a72d3156-6b82-5078-99f6-76c8850b5177',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN84486',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 200666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-30',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Satellite',
 'transmission': 'manual',
 'trim': 'Satellite',
 'year': 2011}
2026-03-27 11:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN84486%27 HTTP/1.1" 200 None
2026-03-27 11:15:42 [auto1.de] INFO: Saving data for RN84486: {'auction_closing_time': 1774627769.0, 'created_time': 1774522092.095282, 'last_price_update_time': 1774610142.591923}
2026-03-27 11:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN84486') HTTP/1.1" 204 0
2026-03-27 11:15:42 [auto1.de] INFO: Found listing with ID: NE74286
2026-03-27 11:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE74286%27 HTTP/1.1" 200 None
2026-03-27 11:15:42 [auto1.de] INFO: Scrape type for NE74286: 2
2026-03-27 11:15:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fffbbe34-7db5-56c9-b937-9b4385b4acdd with identifier: NE74286
2026-03-27 11:15:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fffbbe34-7db5-56c9-b937-9b4385b4acdd with scrape type 2
2026-03-27 11:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fffbbe34-7db5-56c9-b937-9b4385b4acdd with scrape type 2
2026-03-27 11:15:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fffbbe34-7db5-56c9-b937-9b4385b4acdd, identifier: NE74286
2026-03-27 11:15:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fffbbe34-7db5-56c9-b937-9b4385b4acdd with identifier: NE74286
2026-03-27 11:15:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fffbbe34-7db5-56c9-b937-9b4385b4acdd with identifier: NE74286
2026-03-27 11:15:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fffbbe34-7db5-56c9-b937-9b4385b4acdd with identifier: NE74286 to the API
2026-03-27 11:15:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-27T16:54:29Z',
 'fuel_type': 'petrol',
 'id': 'fffbbe34-7db5-56c9-b937-9b4385b4acdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE74286',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Tonale',
 'odometer': 17610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-19',
 'seller_name': None,
 'title': 'Alfa Romeo Tonale 1.5 Mild-Hybrid Sprint',
 'transmission': 'automatic',
 'trim': 'Sprint',
 'year': 2022}
2026-03-27 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE74286%27 HTTP/1.1" 200 None
2026-03-27 11:15:43 [auto1.de] INFO: Saving data for NE74286: {'auction_closing_time': 1774630469.0, 'created_time': 1774522089.061562, 'last_price_update_time': 1774610143.093589}
2026-03-27 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE74286') HTTP/1.1" 204 0
2026-03-27 11:15:43 [auto1.de] INFO: Found listing with ID: MH20468
2026-03-27 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH20468%27 HTTP/1.1" 200 None
2026-03-27 11:15:43 [auto1.de] INFO: Scrape type for MH20468: 2
2026-03-27 11:15:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c352e107-2b72-519c-86d3-e21931e56e57 with identifier: MH20468
2026-03-27 11:15:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c352e107-2b72-519c-86d3-e21931e56e57 with scrape type 2
2026-03-27 11:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c352e107-2b72-519c-86d3-e21931e56e57 with scrape type 2
2026-03-27 11:15:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c352e107-2b72-519c-86d3-e21931e56e57, identifier: MH20468
2026-03-27 11:15:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c352e107-2b72-519c-86d3-e21931e56e57 with identifier: MH20468
2026-03-27 11:15:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c352e107-2b72-519c-86d3-e21931e56e57 with identifier: MH20468
2026-03-27 11:15:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c352e107-2b72-519c-86d3-e21931e56e57 with identifier: MH20468 to the API
2026-03-27 11:15:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 156,
 'expiration_date': '2026-03-27T16:53:02Z',
 'fuel_type': 'petrol',
 'id': 'c352e107-2b72-519c-86d3-e21931e56e57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH20468',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 51593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-28',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-27 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH20468%27 HTTP/1.1" 200 None
2026-03-27 11:15:43 [auto1.de] INFO: Saving data for MH20468: {'auction_closing_time': 1774630382.0, 'created_time': 1773946254.387335, 'last_price_update_time': 1774610143.747361}
2026-03-27 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH20468') HTTP/1.1" 204 0
2026-03-27 11:15:43 [auto1.de] INFO: Found listing with ID: RZ48384
2026-03-27 11:15:43 [auto1.de] INFO: Found listing with ID: AR72060
2026-03-27 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR72060%27 HTTP/1.1" 200 None
2026-03-27 11:15:43 [auto1.de] INFO: Scrape type for AR72060: 2
2026-03-27 11:15:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8306150f-da16-5cd2-8527-3d2bfc7f92f4 with identifier: AR72060
2026-03-27 11:15:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8306150f-da16-5cd2-8527-3d2bfc7f92f4 with scrape type 2
2026-03-27 11:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8306150f-da16-5cd2-8527-3d2bfc7f92f4 with scrape type 2
2026-03-27 11:15:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8306150f-da16-5cd2-8527-3d2bfc7f92f4, identifier: AR72060
2026-03-27 11:15:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8306150f-da16-5cd2-8527-3d2bfc7f92f4 with identifier: AR72060
2026-03-27 11:15:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8306150f-da16-5cd2-8527-3d2bfc7f92f4 with identifier: AR72060
2026-03-27 11:15:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8306150f-da16-5cd2-8527-3d2bfc7f92f4 with identifier: AR72060 to the API
2026-03-27 11:15:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:28:59Z',
 'fuel_type': 'diesel',
 'id': '8306150f-da16-5cd2-8527-3d2bfc7f92f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR72060',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 141659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-15',
 'seller_name': None,
 'title': 'BMW 2er 220d Gran Tourer Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2015}
2026-03-27 11:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR72060%27 HTTP/1.1" 200 None
2026-03-27 11:15:44 [auto1.de] INFO: Saving data for AR72060: {'auction_closing_time': 1774628939.0, 'created_time': 1774522108.18799, 'last_price_update_time': 1774610144.183827}
2026-03-27 11:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR72060') HTTP/1.1" 204 0
2026-03-27 11:15:44 [auto1.de] INFO: Found listing with ID: LK79875
2026-03-27 11:15:44 [auto1.de] INFO: Found listing with ID: HU72855
2026-03-27 11:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU72855%27 HTTP/1.1" 200 None
2026-03-27 11:15:44 [auto1.de] INFO: Scrape type for HU72855: 2
2026-03-27 11:15:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe27f486-eb45-5680-94fb-0d6d8272d5e2 with identifier: HU72855
2026-03-27 11:15:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe27f486-eb45-5680-94fb-0d6d8272d5e2 with scrape type 2
2026-03-27 11:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe27f486-eb45-5680-94fb-0d6d8272d5e2 with scrape type 2
2026-03-27 11:15:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe27f486-eb45-5680-94fb-0d6d8272d5e2, identifier: HU72855
2026-03-27 11:15:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe27f486-eb45-5680-94fb-0d6d8272d5e2 with identifier: HU72855
2026-03-27 11:15:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe27f486-eb45-5680-94fb-0d6d8272d5e2 with identifier: HU72855
2026-03-27 11:15:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe27f486-eb45-5680-94fb-0d6d8272d5e2 with identifier: HU72855 to the API
2026-03-27 11:15:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:27:15Z',
 'fuel_type': 'diesel',
 'id': 'fe27f486-eb45-5680-94fb-0d6d8272d5e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU72855',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 144713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-04',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport & Style 4Motion',
 'year': 2012}
2026-03-27 11:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU72855%27 HTTP/1.1" 200 None
2026-03-27 11:15:44 [auto1.de] INFO: Saving data for HU72855: {'auction_closing_time': 1774628835.0, 'created_time': 1774522094.453723, 'last_price_update_time': 1774610144.669499}
2026-03-27 11:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU72855') HTTP/1.1" 204 0
2026-03-27 11:15:44 [auto1.de] INFO: Found listing with ID: AG84988
2026-03-27 11:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG84988%27 HTTP/1.1" 200 None
2026-03-27 11:15:44 [auto1.de] INFO: Scrape type for AG84988: 2
2026-03-27 11:15:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1171a299-2a06-56f8-b36d-7f7af785b8eb with identifier: AG84988
2026-03-27 11:15:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1171a299-2a06-56f8-b36d-7f7af785b8eb with scrape type 2
2026-03-27 11:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1171a299-2a06-56f8-b36d-7f7af785b8eb with scrape type 2
2026-03-27 11:15:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1171a299-2a06-56f8-b36d-7f7af785b8eb, identifier: AG84988
2026-03-27 11:15:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1171a299-2a06-56f8-b36d-7f7af785b8eb with identifier: AG84988
2026-03-27 11:15:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1171a299-2a06-56f8-b36d-7f7af785b8eb with identifier: AG84988
2026-03-27 11:15:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1171a299-2a06-56f8-b36d-7f7af785b8eb with identifier: AG84988 to the API
2026-03-27 11:15:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:45:35Z',
 'fuel_type': 'diesel',
 'id': '1171a299-2a06-56f8-b36d-7f7af785b8eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG84988',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 121035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2018}
2026-03-27 11:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG84988%27 HTTP/1.1" 200 None
2026-03-27 11:15:45 [auto1.de] INFO: Saving data for AG84988: {'auction_closing_time': 1774629935.0, 'created_time': 1774522102.330151, 'last_price_update_time': 1774610145.157082}
2026-03-27 11:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG84988') HTTP/1.1" 204 0
2026-03-27 11:15:45 [auto1.de] INFO: Found listing with ID: YT57989
2026-03-27 11:15:45 [auto1.de] INFO: Found listing with ID: FL94183
2026-03-27 11:15:45 [auto1.de] INFO: Found listing with ID: GF22355
2026-03-27 11:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF22355%27 HTTP/1.1" 200 None
2026-03-27 11:15:45 [auto1.de] INFO: Scrape type for GF22355: 2
2026-03-27 11:15:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edb78511-0c26-52d0-8d27-fec6274b8337 with identifier: GF22355
2026-03-27 11:15:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edb78511-0c26-52d0-8d27-fec6274b8337 with scrape type 2
2026-03-27 11:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edb78511-0c26-52d0-8d27-fec6274b8337 with scrape type 2
2026-03-27 11:15:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edb78511-0c26-52d0-8d27-fec6274b8337, identifier: GF22355
2026-03-27 11:15:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edb78511-0c26-52d0-8d27-fec6274b8337 with identifier: GF22355
2026-03-27 11:15:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edb78511-0c26-52d0-8d27-fec6274b8337 with identifier: GF22355
2026-03-27 11:15:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edb78511-0c26-52d0-8d27-fec6274b8337 with identifier: GF22355 to the API
2026-03-27 11:15:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:37:53Z',
 'fuel_type': 'petrol',
 'id': 'edb78511-0c26-52d0-8d27-fec6274b8337',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF22355',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 98008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-20',
 'seller_name': None,
 'title': 'Seat Leon 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2020}
2026-03-27 11:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF22355%27 HTTP/1.1" 200 None
2026-03-27 11:15:45 [auto1.de] INFO: Saving data for GF22355: {'auction_closing_time': 1774629473.0, 'created_time': 1773302775.974224, 'last_price_update_time': 1774610145.713335}
2026-03-27 11:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF22355') HTTP/1.1" 204 0
2026-03-27 11:15:45 [auto1.de] INFO: Found listing with ID: KN80130
2026-03-27 11:15:45 [auto1.de] INFO: Found listing with ID: TJ74948
2026-03-27 11:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ74948%27 HTTP/1.1" 200 None
2026-03-27 11:15:45 [auto1.de] INFO: Scrape type for TJ74948: 2
2026-03-27 11:15:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04ecb0dc-27f2-520f-bdf5-b80e13c95af0 with identifier: TJ74948
2026-03-27 11:15:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04ecb0dc-27f2-520f-bdf5-b80e13c95af0 with scrape type 2
2026-03-27 11:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04ecb0dc-27f2-520f-bdf5-b80e13c95af0 with scrape type 2
2026-03-27 11:15:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04ecb0dc-27f2-520f-bdf5-b80e13c95af0, identifier: TJ74948
2026-03-27 11:15:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04ecb0dc-27f2-520f-bdf5-b80e13c95af0 with identifier: TJ74948
2026-03-27 11:15:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04ecb0dc-27f2-520f-bdf5-b80e13c95af0 with identifier: TJ74948
2026-03-27 11:15:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04ecb0dc-27f2-520f-bdf5-b80e13c95af0 with identifier: TJ74948 to the API
2026-03-27 11:15:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:53:07Z',
 'fuel_type': 'diesel',
 'id': '04ecb0dc-27f2-520f-bdf5-b80e13c95af0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ74948',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 225698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-28',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-27 11:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ74948%27 HTTP/1.1" 200 None
2026-03-27 11:15:46 [auto1.de] INFO: Saving data for TJ74948: {'auction_closing_time': 1774630387.0, 'created_time': 1774522093.063191, 'last_price_update_time': 1774610146.447258}
2026-03-27 11:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ74948') HTTP/1.1" 204 0
2026-03-27 11:15:46 [auto1.de] INFO: Found listing with ID: RB81159
2026-03-27 11:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81159%27 HTTP/1.1" 200 None
2026-03-27 11:15:46 [auto1.de] INFO: Scrape type for RB81159: 2
2026-03-27 11:15:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed8f2f89-2bc1-533c-9f00-6ee8c5decfa8 with identifier: RB81159
2026-03-27 11:15:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed8f2f89-2bc1-533c-9f00-6ee8c5decfa8 with scrape type 2
2026-03-27 11:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed8f2f89-2bc1-533c-9f00-6ee8c5decfa8 with scrape type 2
2026-03-27 11:15:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed8f2f89-2bc1-533c-9f00-6ee8c5decfa8, identifier: RB81159
2026-03-27 11:15:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed8f2f89-2bc1-533c-9f00-6ee8c5decfa8 with identifier: RB81159
2026-03-27 11:15:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed8f2f89-2bc1-533c-9f00-6ee8c5decfa8 with identifier: RB81159
2026-03-27 11:15:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed8f2f89-2bc1-533c-9f00-6ee8c5decfa8 with identifier: RB81159 to the API
2026-03-27 11:15:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:52:18Z',
 'fuel_type': 'petrol',
 'id': 'ed8f2f89-2bc1-533c-9f00-6ee8c5decfa8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB81159',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 259090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-30',
 'seller_name': None,
 'title': 'Audi A3 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-27 11:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81159%27 HTTP/1.1" 200 None
2026-03-27 11:15:47 [auto1.de] INFO: Saving data for RB81159: {'auction_closing_time': 1774630338.0, 'created_time': 1773226445.702709, 'last_price_update_time': 1774610147.107593}
2026-03-27 11:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB81159') HTTP/1.1" 204 0
2026-03-27 11:15:47 [auto1.de] INFO: Found listing with ID: ET23804
2026-03-27 11:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET23804%27 HTTP/1.1" 200 None
2026-03-27 11:15:47 [auto1.de] INFO: Scrape type for ET23804: 2
2026-03-27 11:15:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d231d52e-7650-57a0-bcba-4ce9774fcb0c with identifier: ET23804
2026-03-27 11:15:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d231d52e-7650-57a0-bcba-4ce9774fcb0c with scrape type 2
2026-03-27 11:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d231d52e-7650-57a0-bcba-4ce9774fcb0c with scrape type 2
2026-03-27 11:15:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d231d52e-7650-57a0-bcba-4ce9774fcb0c, identifier: ET23804
2026-03-27 11:15:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d231d52e-7650-57a0-bcba-4ce9774fcb0c with identifier: ET23804
2026-03-27 11:15:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d231d52e-7650-57a0-bcba-4ce9774fcb0c with identifier: ET23804
2026-03-27 11:15:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d231d52e-7650-57a0-bcba-4ce9774fcb0c with identifier: ET23804 to the API
2026-03-27 11:15:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-27T16:40:41Z',
 'fuel_type': 'petrol',
 'id': 'd231d52e-7650-57a0-bcba-4ce9774fcb0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET23804',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 113136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-04',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 THP Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2014}
2026-03-27 11:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET23804%27 HTTP/1.1" 200 None
2026-03-27 11:15:47 [auto1.de] INFO: Saving data for ET23804: {'auction_closing_time': 1774629641.0, 'created_time': 1773946964.963343, 'last_price_update_time': 1774610147.601622}
2026-03-27 11:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET23804') HTTP/1.1" 204 0
2026-03-27 11:15:47 [auto1.de] INFO: Found listing with ID: PK98843
2026-03-27 11:15:47 [auto1.de] INFO: Found listing with ID: JJ90967
2026-03-27 11:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ90967%27 HTTP/1.1" 200 None
2026-03-27 11:15:47 [auto1.de] INFO: Scrape type for JJ90967: 2
2026-03-27 11:15:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef26d279-a85b-5aa6-bdc1-faff4f306f50 with identifier: JJ90967
2026-03-27 11:15:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef26d279-a85b-5aa6-bdc1-faff4f306f50 with scrape type 2
2026-03-27 11:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef26d279-a85b-5aa6-bdc1-faff4f306f50 with scrape type 2
2026-03-27 11:15:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef26d279-a85b-5aa6-bdc1-faff4f306f50, identifier: JJ90967
2026-03-27 11:15:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef26d279-a85b-5aa6-bdc1-faff4f306f50 with identifier: JJ90967
2026-03-27 11:15:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef26d279-a85b-5aa6-bdc1-faff4f306f50 with identifier: JJ90967
2026-03-27 11:15:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef26d279-a85b-5aa6-bdc1-faff4f306f50 with identifier: JJ90967 to the API
2026-03-27 11:15:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:32:43Z',
 'fuel_type': 'petrol',
 'id': 'ef26d279-a85b-5aa6-bdc1-faff4f306f50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ90967',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 188785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-13',
 'seller_name': None,
 'title': 'Audi Q2 1.4 TFSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2017}
2026-03-27 11:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ90967%27 HTTP/1.1" 200 None
2026-03-27 11:15:48 [auto1.de] INFO: Saving data for JJ90967: {'auction_closing_time': 1774629163.0, 'created_time': 1774522143.059001, 'last_price_update_time': 1774610148.265598}
2026-03-27 11:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ90967') HTTP/1.1" 204 0
2026-03-27 11:15:48 [auto1.de] INFO: Found listing with ID: LK22324
2026-03-27 11:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK22324%27 HTTP/1.1" 200 None
2026-03-27 11:15:48 [auto1.de] INFO: Scrape type for LK22324: 2
2026-03-27 11:15:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11cc94e2-4801-5caf-a1f1-9fec030d50f8 with identifier: LK22324
2026-03-27 11:15:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11cc94e2-4801-5caf-a1f1-9fec030d50f8 with scrape type 2
2026-03-27 11:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11cc94e2-4801-5caf-a1f1-9fec030d50f8 with scrape type 2
2026-03-27 11:15:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11cc94e2-4801-5caf-a1f1-9fec030d50f8, identifier: LK22324
2026-03-27 11:15:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11cc94e2-4801-5caf-a1f1-9fec030d50f8 with identifier: LK22324
2026-03-27 11:15:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11cc94e2-4801-5caf-a1f1-9fec030d50f8 with identifier: LK22324
2026-03-27 11:15:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11cc94e2-4801-5caf-a1f1-9fec030d50f8 with identifier: LK22324 to the API
2026-03-27 11:15:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:49:08Z',
 'fuel_type': 'petrol',
 'id': '11cc94e2-4801-5caf-a1f1-9fec030d50f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK22324',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 106454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-21',
 'seller_name': None,
 'title': 'Skoda Octavia 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2019}
2026-03-27 11:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK22324%27 HTTP/1.1" 200 None
2026-03-27 11:15:48 [auto1.de] INFO: Saving data for LK22324: {'auction_closing_time': 1774630148.0, 'created_time': 1774522145.882392, 'last_price_update_time': 1774610148.696234}
2026-03-27 11:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK22324') HTTP/1.1" 204 0
2026-03-27 11:15:48 [auto1.de] INFO: Found listing with ID: FG01299
2026-03-27 11:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG01299%27 HTTP/1.1" 200 None
2026-03-27 11:15:48 [auto1.de] INFO: Scrape type for FG01299: 2
2026-03-27 11:15:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce51b7c8-365b-5bca-87a3-d6997ee936df with identifier: FG01299
2026-03-27 11:15:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce51b7c8-365b-5bca-87a3-d6997ee936df with scrape type 2
2026-03-27 11:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce51b7c8-365b-5bca-87a3-d6997ee936df with scrape type 2
2026-03-27 11:15:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce51b7c8-365b-5bca-87a3-d6997ee936df, identifier: FG01299
2026-03-27 11:15:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce51b7c8-365b-5bca-87a3-d6997ee936df with identifier: FG01299
2026-03-27 11:15:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce51b7c8-365b-5bca-87a3-d6997ee936df with identifier: FG01299
2026-03-27 11:15:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce51b7c8-365b-5bca-87a3-d6997ee936df with identifier: FG01299 to the API
2026-03-27 11:15:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:17:04Z',
 'fuel_type': 'petrol',
 'id': 'ce51b7c8-365b-5bca-87a3-d6997ee936df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG01299',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 197731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-29',
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2009}
2026-03-27 11:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG01299%27 HTTP/1.1" 200 None
2026-03-27 11:15:49 [auto1.de] INFO: Saving data for FG01299: {'auction_closing_time': 1774628224.0, 'created_time': 1774522140.954486, 'last_price_update_time': 1774610149.149452}
2026-03-27 11:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG01299') HTTP/1.1" 204 0
2026-03-27 11:15:49 [auto1.de] INFO: Found listing with ID: CF13779
2026-03-27 11:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF13779%27 HTTP/1.1" 200 None
2026-03-27 11:15:49 [auto1.de] INFO: Scrape type for CF13779: 2
2026-03-27 11:15:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b613ac74-59d9-582c-b680-fd1f6c91be69 with identifier: CF13779
2026-03-27 11:15:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b613ac74-59d9-582c-b680-fd1f6c91be69 with scrape type 2
2026-03-27 11:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b613ac74-59d9-582c-b680-fd1f6c91be69 with scrape type 2
2026-03-27 11:15:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b613ac74-59d9-582c-b680-fd1f6c91be69, identifier: CF13779
2026-03-27 11:15:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b613ac74-59d9-582c-b680-fd1f6c91be69 with identifier: CF13779
2026-03-27 11:15:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b613ac74-59d9-582c-b680-fd1f6c91be69 with identifier: CF13779
2026-03-27 11:15:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b613ac74-59d9-582c-b680-fd1f6c91be69 with identifier: CF13779 to the API
2026-03-27 11:15:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-27T16:59:37Z',
 'fuel_type': 'petrol',
 'id': 'b613ac74-59d9-582c-b680-fd1f6c91be69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF13779',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 89814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-05',
 'seller_name': None,
 'title': 'BMW 2er 220i Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2015}
2026-03-27 11:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF13779%27 HTTP/1.1" 200 None
2026-03-27 11:15:49 [auto1.de] INFO: Saving data for CF13779: {'auction_closing_time': 1774630777.0, 'created_time': 1774522149.69483, 'last_price_update_time': 1774610149.628871}
2026-03-27 11:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF13779') HTTP/1.1" 204 0
2026-03-27 11:15:49 [auto1.de] INFO: Found listing with ID: ML58643
2026-03-27 11:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML58643%27 HTTP/1.1" 200 None
2026-03-27 11:15:49 [auto1.de] INFO: Scrape type for ML58643: 2
2026-03-27 11:15:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ac18bf9-98c1-5f3c-a09d-e16d0242ede8 with identifier: ML58643
2026-03-27 11:15:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ac18bf9-98c1-5f3c-a09d-e16d0242ede8 with scrape type 2
2026-03-27 11:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ac18bf9-98c1-5f3c-a09d-e16d0242ede8 with scrape type 2
2026-03-27 11:15:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ac18bf9-98c1-5f3c-a09d-e16d0242ede8, identifier: ML58643
2026-03-27 11:15:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ac18bf9-98c1-5f3c-a09d-e16d0242ede8 with identifier: ML58643
2026-03-27 11:15:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ac18bf9-98c1-5f3c-a09d-e16d0242ede8 with identifier: ML58643
2026-03-27 11:15:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ac18bf9-98c1-5f3c-a09d-e16d0242ede8 with identifier: ML58643 to the API
2026-03-27 11:15:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:47:50Z',
 'fuel_type': 'petrol',
 'id': '4ac18bf9-98c1-5f3c-a09d-e16d0242ede8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML58643',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 105935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-02',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-27 11:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML58643%27 HTTP/1.1" 200 None
2026-03-27 11:15:50 [auto1.de] INFO: Saving data for ML58643: {'auction_closing_time': 1774630070.0, 'created_time': 1773303498.323015, 'last_price_update_time': 1774610150.102904}
2026-03-27 11:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML58643') HTTP/1.1" 204 0
2026-03-27 11:15:50 [auto1.de] INFO: Found listing with ID: SM97641
2026-03-27 11:15:50 [auto1.de] INFO: Found listing with ID: WA11116
2026-03-27 11:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA11116%27 HTTP/1.1" 200 None
2026-03-27 11:15:50 [auto1.de] INFO: Scrape type for WA11116: 2
2026-03-27 11:15:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfc1e672-b986-5a2a-9615-b2133ac2a571 with identifier: WA11116
2026-03-27 11:15:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfc1e672-b986-5a2a-9615-b2133ac2a571 with scrape type 2
2026-03-27 11:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfc1e672-b986-5a2a-9615-b2133ac2a571 with scrape type 2
2026-03-27 11:15:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dfc1e672-b986-5a2a-9615-b2133ac2a571, identifier: WA11116
2026-03-27 11:15:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dfc1e672-b986-5a2a-9615-b2133ac2a571 with identifier: WA11116
2026-03-27 11:15:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dfc1e672-b986-5a2a-9615-b2133ac2a571 with identifier: WA11116
2026-03-27 11:15:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dfc1e672-b986-5a2a-9615-b2133ac2a571 with identifier: WA11116 to the API
2026-03-27 11:15:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-27T16:40:57Z',
 'fuel_type': 'diesel',
 'id': 'dfc1e672-b986-5a2a-9615-b2133ac2a571',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA11116',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 89037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-19',
 'seller_name': None,
 'title': 'BMW X4 M40d Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-27 11:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA11116%27 HTTP/1.1" 200 None
2026-03-27 11:15:50 [auto1.de] INFO: Saving data for WA11116: {'auction_closing_time': 1774629657.0, 'created_time': 1774522150.192558, 'last_price_update_time': 1774610150.588436}
2026-03-27 11:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA11116') HTTP/1.1" 204 0
2026-03-27 11:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:15:51 [auto1.de] INFO: Channel: 24h | Page: 254 | totalHits: 10685 | hits on page: 40
2026-03-27 11:15:51 [auto1.de] INFO: Found listing with ID: SM97641
2026-03-27 11:15:51 [auto1.de] INFO: Found listing with ID: WA11116
2026-03-27 11:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA11116%27 HTTP/1.1" 200 None
2026-03-27 11:15:51 [auto1.de] INFO: Scrape type for WA11116: 0
2026-03-27 11:15:51 [auto1.de] INFO: Found listing with ID: WA19353
2026-03-27 11:15:51 [auto1.de] INFO: Found listing with ID: RX54400
2026-03-27 11:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX54400%27 HTTP/1.1" 200 None
2026-03-27 11:15:51 [auto1.de] INFO: Scrape type for RX54400: 2
2026-03-27 11:15:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a650bb91-356b-54f9-888b-86a427365679 with identifier: RX54400
2026-03-27 11:15:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a650bb91-356b-54f9-888b-86a427365679 with scrape type 2
2026-03-27 11:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a650bb91-356b-54f9-888b-86a427365679 with scrape type 2
2026-03-27 11:15:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a650bb91-356b-54f9-888b-86a427365679, identifier: RX54400
2026-03-27 11:15:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a650bb91-356b-54f9-888b-86a427365679 with identifier: RX54400
2026-03-27 11:15:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a650bb91-356b-54f9-888b-86a427365679 with identifier: RX54400
2026-03-27 11:15:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a650bb91-356b-54f9-888b-86a427365679 with identifier: RX54400 to the API
2026-03-27 11:15:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-27T16:59:49Z',
 'fuel_type': 'electro',
 'id': 'a650bb91-356b-54f9-888b-86a427365679',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX54400',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 22,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-12-18',
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-27 11:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX54400%27 HTTP/1.1" 200 None
2026-03-27 11:15:52 [auto1.de] INFO: Saving data for RX54400: {'auction_closing_time': 1774630789.0, 'created_time': 1774522153.666697, 'last_price_update_time': 1774610152.198669}
2026-03-27 11:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX54400') HTTP/1.1" 204 0
2026-03-27 11:15:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:15:52 [auto1.de] INFO: Found listing with ID: AP07103
2026-03-27 11:15:52 [auto1.de] INFO: Found listing with ID: BG13835
2026-03-27 11:15:52 [auto1.de] INFO: Found listing with ID: KM43405
2026-03-27 11:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM43405%27 HTTP/1.1" 200 None
2026-03-27 11:15:52 [auto1.de] INFO: Scrape type for KM43405: 2
2026-03-27 11:15:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf042f6d-96b1-596b-babe-df609d9f7fa1 with identifier: KM43405
2026-03-27 11:15:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf042f6d-96b1-596b-babe-df609d9f7fa1 with scrape type 2
2026-03-27 11:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf042f6d-96b1-596b-babe-df609d9f7fa1 with scrape type 2
2026-03-27 11:15:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf042f6d-96b1-596b-babe-df609d9f7fa1, identifier: KM43405
2026-03-27 11:15:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf042f6d-96b1-596b-babe-df609d9f7fa1 with identifier: KM43405
2026-03-27 11:15:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf042f6d-96b1-596b-babe-df609d9f7fa1 with identifier: KM43405
2026-03-27 11:15:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf042f6d-96b1-596b-babe-df609d9f7fa1 with identifier: KM43405 to the API
2026-03-27 11:15:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-27T16:16:37Z',
 'fuel_type': 'petrol',
 'id': 'cf042f6d-96b1-596b-babe-df609d9f7fa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM43405',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 58638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-02',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Advantage 2WD',
 'transmission': 'manual',
 'trim': 'Advantage 2WD',
 'year': 2020}
2026-03-27 11:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM43405%27 HTTP/1.1" 200 None
2026-03-27 11:15:52 [auto1.de] INFO: Saving data for KM43405: {'auction_closing_time': 1774628197.0, 'created_time': 1773307998.478078, 'last_price_update_time': 1774610152.959716}
2026-03-27 11:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM43405') HTTP/1.1" 204 0
2026-03-27 11:15:52 [auto1.de] INFO: Found listing with ID: CH88206
2026-03-27 11:15:52 [auto1.de] INFO: Found listing with ID: WM25973
2026-03-27 11:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM25973%27 HTTP/1.1" 200 None
2026-03-27 11:15:53 [auto1.de] INFO: Scrape type for WM25973: 2
2026-03-27 11:15:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 828493f4-149b-5f65-9081-0d8bd3bb8631 with identifier: WM25973
2026-03-27 11:15:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 828493f4-149b-5f65-9081-0d8bd3bb8631 with scrape type 2
2026-03-27 11:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 828493f4-149b-5f65-9081-0d8bd3bb8631 with scrape type 2
2026-03-27 11:15:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 828493f4-149b-5f65-9081-0d8bd3bb8631, identifier: WM25973
2026-03-27 11:15:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 828493f4-149b-5f65-9081-0d8bd3bb8631 with identifier: WM25973
2026-03-27 11:15:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 828493f4-149b-5f65-9081-0d8bd3bb8631 with identifier: WM25973
2026-03-27 11:15:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 828493f4-149b-5f65-9081-0d8bd3bb8631 with identifier: WM25973 to the API
2026-03-27 11:15:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 400,
 'expiration_date': '2026-03-27T16:52:51Z',
 'fuel_type': 'petrol',
 'id': '828493f4-149b-5f65-9081-0d8bd3bb8631',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM25973',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS 3 Sportback',
 'odometer': 64073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-20',
 'seller_name': None,
 'title': 'Audi RS 3 Sportback 2.5 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-27 11:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM25973%27 HTTP/1.1" 200 None
2026-03-27 11:15:53 [auto1.de] INFO: Saving data for WM25973: {'auction_closing_time': 1774630371.0, 'created_time': 1774522154.120559, 'last_price_update_time': 1774610153.56119}
2026-03-27 11:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM25973') HTTP/1.1" 204 0
2026-03-27 11:15:53 [auto1.de] INFO: Found listing with ID: HL11639
2026-03-27 11:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL11639%27 HTTP/1.1" 200 None
2026-03-27 11:15:53 [auto1.de] INFO: Scrape type for HL11639: 2
2026-03-27 11:15:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4ef86ec-d0a9-5318-9363-7cb8788d5981 with identifier: HL11639
2026-03-27 11:15:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4ef86ec-d0a9-5318-9363-7cb8788d5981 with scrape type 2
2026-03-27 11:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4ef86ec-d0a9-5318-9363-7cb8788d5981 with scrape type 2
2026-03-27 11:15:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4ef86ec-d0a9-5318-9363-7cb8788d5981, identifier: HL11639
2026-03-27 11:15:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4ef86ec-d0a9-5318-9363-7cb8788d5981 with identifier: HL11639
2026-03-27 11:15:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4ef86ec-d0a9-5318-9363-7cb8788d5981 with identifier: HL11639
2026-03-27 11:15:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4ef86ec-d0a9-5318-9363-7cb8788d5981 with identifier: HL11639 to the API
2026-03-27 11:15:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:17:47Z',
 'fuel_type': 'petrol',
 'id': 'b4ef86ec-d0a9-5318-9363-7cb8788d5981',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL11639',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 98170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-29',
 'seller_name': None,
 'title': 'Kia XCeed 1.4 TGDI Platinum Edition',
 'transmission': 'automatic',
 'trim': 'Platinum Edition',
 'year': 2020}
2026-03-27 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL11639%27 HTTP/1.1" 200 None
2026-03-27 11:15:54 [auto1.de] INFO: Saving data for HL11639: {'auction_closing_time': 1774628267.0, 'created_time': 1773228676.373926, 'last_price_update_time': 1774610154.041}
2026-03-27 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL11639') HTTP/1.1" 204 0
2026-03-27 11:15:54 [auto1.de] INFO: Found listing with ID: RN08070
2026-03-27 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN08070%27 HTTP/1.1" 200 None
2026-03-27 11:15:54 [auto1.de] INFO: Scrape type for RN08070: 2
2026-03-27 11:15:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70f55b0f-b150-51bd-965f-bd17a9b565ed with identifier: RN08070
2026-03-27 11:15:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70f55b0f-b150-51bd-965f-bd17a9b565ed with scrape type 2
2026-03-27 11:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70f55b0f-b150-51bd-965f-bd17a9b565ed with scrape type 2
2026-03-27 11:15:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70f55b0f-b150-51bd-965f-bd17a9b565ed, identifier: RN08070
2026-03-27 11:15:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70f55b0f-b150-51bd-965f-bd17a9b565ed with identifier: RN08070
2026-03-27 11:15:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70f55b0f-b150-51bd-965f-bd17a9b565ed with identifier: RN08070
2026-03-27 11:15:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70f55b0f-b150-51bd-965f-bd17a9b565ed with identifier: RN08070 to the API
2026-03-27 11:15:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-27T16:15:09Z',
 'fuel_type': 'petrol',
 'id': '70f55b0f-b150-51bd-965f-bd17a9b565ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN08070',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 28635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2022}
2026-03-27 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN08070%27 HTTP/1.1" 200 None
2026-03-27 11:15:54 [auto1.de] INFO: Saving data for RN08070: {'auction_closing_time': 1774628109.0, 'created_time': 1774522195.27435, 'last_price_update_time': 1774610154.515689}
2026-03-27 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN08070') HTTP/1.1" 204 0
2026-03-27 11:15:54 [auto1.de] INFO: Found listing with ID: TA61960
2026-03-27 11:15:54 [auto1.de] INFO: Found listing with ID: JL56859
2026-03-27 11:15:54 [auto1.de] INFO: Found listing with ID: AG00767
2026-03-27 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG00767%27 HTTP/1.1" 200 None
2026-03-27 11:15:54 [auto1.de] INFO: Scrape type for AG00767: 2
2026-03-27 11:15:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9dd55b3-0518-5c58-81b6-7b4f616a5452 with identifier: AG00767
2026-03-27 11:15:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9dd55b3-0518-5c58-81b6-7b4f616a5452 with scrape type 2
2026-03-27 11:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9dd55b3-0518-5c58-81b6-7b4f616a5452 with scrape type 2
2026-03-27 11:15:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9dd55b3-0518-5c58-81b6-7b4f616a5452, identifier: AG00767
2026-03-27 11:15:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9dd55b3-0518-5c58-81b6-7b4f616a5452 with identifier: AG00767
2026-03-27 11:15:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9dd55b3-0518-5c58-81b6-7b4f616a5452 with identifier: AG00767
2026-03-27 11:15:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9dd55b3-0518-5c58-81b6-7b4f616a5452 with identifier: AG00767 to the API
2026-03-27 11:15:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:52:27Z',
 'fuel_type': 'diesel',
 'id': 'b9dd55b3-0518-5c58-81b6-7b4f616a5452',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG00767',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 306188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-08',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2013}
2026-03-27 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG00767%27 HTTP/1.1" 200 None
2026-03-27 11:15:54 [auto1.de] INFO: Saving data for AG00767: {'auction_closing_time': 1774630347.0, 'created_time': 1774522199.405294, 'last_price_update_time': 1774610154.980988}
2026-03-27 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG00767') HTTP/1.1" 204 0
2026-03-27 11:15:55 [auto1.de] INFO: Found listing with ID: LJ68235
2026-03-27 11:15:55 [auto1.de] INFO: Found listing with ID: GJ77265
2026-03-27 11:15:55 [auto1.de] INFO: Found listing with ID: MG81975
2026-03-27 11:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG81975%27 HTTP/1.1" 200 None
2026-03-27 11:15:55 [auto1.de] INFO: Scrape type for MG81975: 2
2026-03-27 11:15:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79f41c08-e1c8-54ef-820c-82ae5030fff1 with identifier: MG81975
2026-03-27 11:15:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79f41c08-e1c8-54ef-820c-82ae5030fff1 with scrape type 2
2026-03-27 11:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79f41c08-e1c8-54ef-820c-82ae5030fff1 with scrape type 2
2026-03-27 11:15:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79f41c08-e1c8-54ef-820c-82ae5030fff1, identifier: MG81975
2026-03-27 11:15:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79f41c08-e1c8-54ef-820c-82ae5030fff1 with identifier: MG81975
2026-03-27 11:15:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79f41c08-e1c8-54ef-820c-82ae5030fff1 with identifier: MG81975
2026-03-27 11:15:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79f41c08-e1c8-54ef-820c-82ae5030fff1 with identifier: MG81975 to the API
2026-03-27 11:15:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:05:32Z',
 'fuel_type': 'petrol',
 'id': '79f41c08-e1c8-54ef-820c-82ae5030fff1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG81975',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 131228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-06',
 'seller_name': None,
 'title': 'Mazda 3 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2012}
2026-03-27 11:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG81975%27 HTTP/1.1" 200 None
2026-03-27 11:15:55 [auto1.de] INFO: Saving data for MG81975: {'auction_closing_time': 1774627532.0, 'created_time': 1774522189.849585, 'last_price_update_time': 1774610155.468314}
2026-03-27 11:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG81975') HTTP/1.1" 204 0
2026-03-27 11:15:55 [auto1.de] INFO: Found listing with ID: AL74517
2026-03-27 11:15:55 [auto1.de] INFO: Found listing with ID: EL15513
2026-03-27 11:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL15513%27 HTTP/1.1" 200 None
2026-03-27 11:15:55 [auto1.de] INFO: Scrape type for EL15513: 2
2026-03-27 11:15:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f006a16-8817-5735-8416-713c79e81536 with identifier: EL15513
2026-03-27 11:15:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f006a16-8817-5735-8416-713c79e81536 with scrape type 2
2026-03-27 11:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f006a16-8817-5735-8416-713c79e81536 with scrape type 2
2026-03-27 11:15:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f006a16-8817-5735-8416-713c79e81536, identifier: EL15513
2026-03-27 11:15:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f006a16-8817-5735-8416-713c79e81536 with identifier: EL15513
2026-03-27 11:15:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f006a16-8817-5735-8416-713c79e81536 with identifier: EL15513
2026-03-27 11:15:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f006a16-8817-5735-8416-713c79e81536 with identifier: EL15513 to the API
2026-03-27 11:15:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:35:32Z',
 'fuel_type': 'diesel',
 'id': '8f006a16-8817-5735-8416-713c79e81536',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL15513',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 184203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-17',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-27 11:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL15513%27 HTTP/1.1" 200 None
2026-03-27 11:15:56 [auto1.de] INFO: Saving data for EL15513: {'auction_closing_time': 1774629332.0, 'created_time': 1774522205.902894, 'last_price_update_time': 1774610156.125539}
2026-03-27 11:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL15513') HTTP/1.1" 204 0
2026-03-27 11:15:56 [auto1.de] INFO: Found listing with ID: XV15906
2026-03-27 11:15:56 [auto1.de] INFO: Found listing with ID: BA95413
2026-03-27 11:15:56 [auto1.de] INFO: Found listing with ID: ML37224
2026-03-27 11:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML37224%27 HTTP/1.1" 200 None
2026-03-27 11:15:56 [auto1.de] INFO: Scrape type for ML37224: 2
2026-03-27 11:15:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6ac4084-1beb-50d9-9cc0-26a81dfedd74 with identifier: ML37224
2026-03-27 11:15:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6ac4084-1beb-50d9-9cc0-26a81dfedd74 with scrape type 2
2026-03-27 11:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6ac4084-1beb-50d9-9cc0-26a81dfedd74 with scrape type 2
2026-03-27 11:15:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6ac4084-1beb-50d9-9cc0-26a81dfedd74, identifier: ML37224
2026-03-27 11:15:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6ac4084-1beb-50d9-9cc0-26a81dfedd74 with identifier: ML37224
2026-03-27 11:15:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6ac4084-1beb-50d9-9cc0-26a81dfedd74 with identifier: ML37224
2026-03-27 11:15:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6ac4084-1beb-50d9-9cc0-26a81dfedd74 with identifier: ML37224 to the API
2026-03-27 11:15:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-27T16:47:28Z',
 'fuel_type': 'electro',
 'id': 'a6ac4084-1beb-50d9-9cc0-26a81dfedd74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML37224',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.5',
 'odometer': 33719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-09',
 'seller_name': None,
 'title': 'Volkswagen ID.5 electric drive 220 kW GTX 4Motion',
 'transmission': 'automatic',
 'trim': 'GTX 4Motion',
 'year': 2022}
2026-03-27 11:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML37224%27 HTTP/1.1" 200 None
2026-03-27 11:15:56 [auto1.de] INFO: Saving data for ML37224: {'auction_closing_time': 1774630048.0, 'created_time': 1774522198.765551, 'last_price_update_time': 1774610156.629757}
2026-03-27 11:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML37224') HTTP/1.1" 204 0
2026-03-27 11:15:56 [auto1.de] INFO: Found listing with ID: LX22574
2026-03-27 11:15:56 [auto1.de] INFO: Found listing with ID: CC99000
2026-03-27 11:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC99000%27 HTTP/1.1" 200 None
2026-03-27 11:15:56 [auto1.de] INFO: Scrape type for CC99000: 2
2026-03-27 11:15:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da322c59-9334-52c4-a80a-21c9badf40d4 with identifier: CC99000
2026-03-27 11:15:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da322c59-9334-52c4-a80a-21c9badf40d4 with scrape type 2
2026-03-27 11:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da322c59-9334-52c4-a80a-21c9badf40d4 with scrape type 2
2026-03-27 11:15:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da322c59-9334-52c4-a80a-21c9badf40d4, identifier: CC99000
2026-03-27 11:15:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da322c59-9334-52c4-a80a-21c9badf40d4 with identifier: CC99000
2026-03-27 11:15:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da322c59-9334-52c4-a80a-21c9badf40d4 with identifier: CC99000
2026-03-27 11:15:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da322c59-9334-52c4-a80a-21c9badf40d4 with identifier: CC99000 to the API
2026-03-27 11:15:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-27T16:27:36Z',
 'fuel_type': 'petrol',
 'id': 'da322c59-9334-52c4-a80a-21c9badf40d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC99000',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 96033,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-26',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2010}
2026-03-27 11:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC99000%27 HTTP/1.1" 200 None
2026-03-27 11:15:57 [auto1.de] INFO: Saving data for CC99000: {'auction_closing_time': 1774628856.0, 'created_time': 1774522187.993582, 'last_price_update_time': 1774610157.176285}
2026-03-27 11:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC99000') HTTP/1.1" 204 0
2026-03-27 11:15:57 [auto1.de] INFO: Found listing with ID: EM65900
2026-03-27 11:15:57 [auto1.de] INFO: Found listing with ID: LN93862
2026-03-27 11:15:57 [auto1.de] INFO: Found listing with ID: BF92726
2026-03-27 11:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF92726%27 HTTP/1.1" 200 None
2026-03-27 11:15:57 [auto1.de] INFO: Scrape type for BF92726: 2
2026-03-27 11:15:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a9afe3d-340a-57f2-a386-501cee4d9c04 with identifier: BF92726
2026-03-27 11:15:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a9afe3d-340a-57f2-a386-501cee4d9c04 with scrape type 2
2026-03-27 11:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a9afe3d-340a-57f2-a386-501cee4d9c04 with scrape type 2
2026-03-27 11:15:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a9afe3d-340a-57f2-a386-501cee4d9c04, identifier: BF92726
2026-03-27 11:15:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a9afe3d-340a-57f2-a386-501cee4d9c04 with identifier: BF92726
2026-03-27 11:15:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a9afe3d-340a-57f2-a386-501cee4d9c04 with identifier: BF92726
2026-03-27 11:15:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a9afe3d-340a-57f2-a386-501cee4d9c04 with identifier: BF92726 to the API
2026-03-27 11:15:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-27T16:16:55Z',
 'fuel_type': 'petrol',
 'id': '9a9afe3d-340a-57f2-a386-501cee4d9c04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF92726',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 214051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-22',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-27 11:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF92726%27 HTTP/1.1" 200 None
2026-03-27 11:15:57 [auto1.de] INFO: Saving data for BF92726: {'auction_closing_time': 1774628215.0, 'created_time': 1774522180.070826, 'last_price_update_time': 1774610157.887614}
2026-03-27 11:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF92726') HTTP/1.1" 204 0
2026-03-27 11:15:57 [auto1.de] INFO: Found listing with ID: YU70640
2026-03-27 11:15:57 [auto1.de] INFO: Found listing with ID: MX86281
2026-03-27 11:15:57 [auto1.de] INFO: Found listing with ID: TN24608
2026-03-27 11:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN24608%27 HTTP/1.1" 200 None
2026-03-27 11:15:57 [auto1.de] INFO: Scrape type for TN24608: 2
2026-03-27 11:15:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06c38a0a-6c60-5762-9944-f3756a021120 with identifier: TN24608
2026-03-27 11:15:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06c38a0a-6c60-5762-9944-f3756a021120 with scrape type 2
2026-03-27 11:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06c38a0a-6c60-5762-9944-f3756a021120 with scrape type 2
2026-03-27 11:15:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06c38a0a-6c60-5762-9944-f3756a021120, identifier: TN24608
2026-03-27 11:15:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06c38a0a-6c60-5762-9944-f3756a021120 with identifier: TN24608
2026-03-27 11:15:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06c38a0a-6c60-5762-9944-f3756a021120 with identifier: TN24608
2026-03-27 11:15:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06c38a0a-6c60-5762-9944-f3756a021120 with identifier: TN24608 to the API
2026-03-27 11:15:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-27T16:00:53Z',
 'fuel_type': 'diesel',
 'id': '06c38a0a-6c60-5762-9944-f3756a021120',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN24608',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 155207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-28',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi N-Connecta 4x4',
 'transmission': 'manual',
 'trim': 'N-Connecta 4x4',
 'year': 2016}
2026-03-27 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN24608%27 HTTP/1.1" 200 None
2026-03-27 11:15:58 [auto1.de] INFO: Saving data for TN24608: {'auction_closing_time': 1774627253.0, 'created_time': 1774522190.94557, 'last_price_update_time': 1774610158.678876}
2026-03-27 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN24608') HTTP/1.1" 204 0
2026-03-27 11:15:58 [auto1.de] INFO: Found listing with ID: SR78379
2026-03-27 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR78379%27 HTTP/1.1" 200 None
2026-03-27 11:15:58 [auto1.de] INFO: Scrape type for SR78379: 0
2026-03-27 11:15:58 [auto1.de] INFO: Found listing with ID: CD46180
2026-03-27 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD46180%27 HTTP/1.1" 200 None
2026-03-27 11:15:58 [auto1.de] INFO: Scrape type for CD46180: 2
2026-03-27 11:15:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b49f084-7cc8-54ba-9639-6cdef663c5cd with identifier: CD46180
2026-03-27 11:15:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b49f084-7cc8-54ba-9639-6cdef663c5cd with scrape type 2
2026-03-27 11:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b49f084-7cc8-54ba-9639-6cdef663c5cd with scrape type 2
2026-03-27 11:15:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b49f084-7cc8-54ba-9639-6cdef663c5cd, identifier: CD46180
2026-03-27 11:15:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b49f084-7cc8-54ba-9639-6cdef663c5cd with identifier: CD46180
2026-03-27 11:15:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b49f084-7cc8-54ba-9639-6cdef663c5cd with identifier: CD46180
2026-03-27 11:15:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b49f084-7cc8-54ba-9639-6cdef663c5cd with identifier: CD46180 to the API
2026-03-27 11:15:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-27T16:40:03Z',
 'fuel_type': 'petrol',
 'id': '2b49f084-7cc8-54ba-9639-6cdef663c5cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD46180',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 25422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-24',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS',
 'transmission': 'manual',
 'trim': 'GS',
 'year': 2024}
2026-03-27 11:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD46180%27 HTTP/1.1" 200 None
2026-03-27 11:15:59 [auto1.de] INFO: Saving data for CD46180: {'auction_closing_time': 1774629603.0, 'created_time': 1774522170.684875, 'last_price_update_time': 1774610159.28288}
2026-03-27 11:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD46180') HTTP/1.1" 204 0
2026-03-27 11:15:59 [auto1.de] INFO: Found listing with ID: FC58368
2026-03-27 11:15:59 [auto1.de] INFO: Found listing with ID: VF37611
2026-03-27 11:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF37611%27 HTTP/1.1" 200 None
2026-03-27 11:15:59 [auto1.de] INFO: Scrape type for VF37611: 2
2026-03-27 11:15:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57a0f6cd-3f7a-5ed5-a643-3f52e072451f with identifier: VF37611
2026-03-27 11:15:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57a0f6cd-3f7a-5ed5-a643-3f52e072451f with scrape type 2
2026-03-27 11:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57a0f6cd-3f7a-5ed5-a643-3f52e072451f with scrape type 2
2026-03-27 11:15:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57a0f6cd-3f7a-5ed5-a643-3f52e072451f, identifier: VF37611
2026-03-27 11:15:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57a0f6cd-3f7a-5ed5-a643-3f52e072451f with identifier: VF37611
2026-03-27 11:15:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57a0f6cd-3f7a-5ed5-a643-3f52e072451f with identifier: VF37611
2026-03-27 11:15:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57a0f6cd-3f7a-5ed5-a643-3f52e072451f with identifier: VF37611 to the API
2026-03-27 11:15:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:15:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:15:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:39:35Z',
 'fuel_type': 'petrol',
 'id': '57a0f6cd-3f7a-5ed5-a643-3f52e072451f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF37611',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 155495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-25',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo 150 Jahre Opel',
 'transmission': 'manual',
 'trim': '150 Jahre',
 'year': 2012}
2026-03-27 11:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF37611%27 HTTP/1.1" 200 None
2026-03-27 11:15:59 [auto1.de] INFO: Saving data for VF37611: {'auction_closing_time': 1774629575.0, 'created_time': 1773305150.441688, 'last_price_update_time': 1774610159.761448}
2026-03-27 11:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF37611') HTTP/1.1" 204 0
2026-03-27 11:15:59 [auto1.de] INFO: Found listing with ID: KS83999
2026-03-27 11:15:59 [auto1.de] INFO: Found listing with ID: BF60432
2026-03-27 11:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF60432%27 HTTP/1.1" 200 None
2026-03-27 11:15:59 [auto1.de] INFO: Scrape type for BF60432: 2
2026-03-27 11:15:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a55ccf1c-3266-5baa-a7db-a2c0acf4c4f2 with identifier: BF60432
2026-03-27 11:15:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a55ccf1c-3266-5baa-a7db-a2c0acf4c4f2 with scrape type 2
2026-03-27 11:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a55ccf1c-3266-5baa-a7db-a2c0acf4c4f2 with scrape type 2
2026-03-27 11:15:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a55ccf1c-3266-5baa-a7db-a2c0acf4c4f2, identifier: BF60432
2026-03-27 11:15:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a55ccf1c-3266-5baa-a7db-a2c0acf4c4f2 with identifier: BF60432
2026-03-27 11:15:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a55ccf1c-3266-5baa-a7db-a2c0acf4c4f2 with identifier: BF60432
2026-03-27 11:16:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a55ccf1c-3266-5baa-a7db-a2c0acf4c4f2 with identifier: BF60432 to the API
2026-03-27 11:16:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-27T16:19:37Z',
 'fuel_type': 'petrol',
 'id': 'a55ccf1c-3266-5baa-a7db-a2c0acf4c4f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF60432',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 15451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-26',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo GS',
 'transmission': 'automatic',
 'trim': 'GS',
 'year': 2024}
2026-03-27 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF60432%27 HTTP/1.1" 200 None
2026-03-27 11:16:00 [auto1.de] INFO: Saving data for BF60432: {'auction_closing_time': 1774628377.0, 'created_time': 1774522191.563788, 'last_price_update_time': 1774610160.448477}
2026-03-27 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF60432') HTTP/1.1" 204 0
2026-03-27 11:16:00 [auto1.de] INFO: Found listing with ID: YM60509
2026-03-27 11:16:00 [auto1.de] INFO: Found listing with ID: DZ31601
2026-03-27 11:16:00 [auto1.de] INFO: Found listing with ID: DC65924
2026-03-27 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC65924%27 HTTP/1.1" 200 None
2026-03-27 11:16:00 [auto1.de] INFO: Scrape type for DC65924: 2
2026-03-27 11:16:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 827f2c57-666c-54de-980d-9eaac553ef79 with identifier: DC65924
2026-03-27 11:16:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 827f2c57-666c-54de-980d-9eaac553ef79 with scrape type 2
2026-03-27 11:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 827f2c57-666c-54de-980d-9eaac553ef79 with scrape type 2
2026-03-27 11:16:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 827f2c57-666c-54de-980d-9eaac553ef79, identifier: DC65924
2026-03-27 11:16:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 827f2c57-666c-54de-980d-9eaac553ef79 with identifier: DC65924
2026-03-27 11:16:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 827f2c57-666c-54de-980d-9eaac553ef79 with identifier: DC65924
2026-03-27 11:16:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 827f2c57-666c-54de-980d-9eaac553ef79 with identifier: DC65924 to the API
2026-03-27 11:16:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-27T16:14:39Z',
 'fuel_type': 'petrol',
 'id': '827f2c57-666c-54de-980d-9eaac553ef79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC65924',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 19339,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-29',
 'seller_name': None,
 'title': 'Citroen C4 1.2 PureTech Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2024}
2026-03-27 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC65924%27 HTTP/1.1" 200 None
2026-03-27 11:16:00 [auto1.de] INFO: Saving data for DC65924: {'auction_closing_time': 1774628079.0, 'created_time': 1774522181.661936, 'last_price_update_time': 1774610160.918179}
2026-03-27 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC65924') HTTP/1.1" 204 0
2026-03-27 11:16:00 [auto1.de] INFO: Found listing with ID: EC90314
2026-03-27 11:16:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:16:01 [auto1.de] INFO: Channel: 24h | Page: 255 | totalHits: 10685 | hits on page: 40
2026-03-27 11:16:01 [auto1.de] INFO: Found listing with ID: NS86162
2026-03-27 11:16:01 [auto1.de] INFO: Found listing with ID: MB08927
2026-03-27 11:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB08927%27 HTTP/1.1" 200 None
2026-03-27 11:16:01 [auto1.de] INFO: Scrape type for MB08927: 2
2026-03-27 11:16:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4202ac89-9b17-5be0-ba22-a104919c1920 with identifier: MB08927
2026-03-27 11:16:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4202ac89-9b17-5be0-ba22-a104919c1920 with scrape type 2
2026-03-27 11:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4202ac89-9b17-5be0-ba22-a104919c1920 with scrape type 2
2026-03-27 11:16:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4202ac89-9b17-5be0-ba22-a104919c1920, identifier: MB08927
2026-03-27 11:16:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4202ac89-9b17-5be0-ba22-a104919c1920 with identifier: MB08927
2026-03-27 11:16:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4202ac89-9b17-5be0-ba22-a104919c1920 with identifier: MB08927
2026-03-27 11:16:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4202ac89-9b17-5be0-ba22-a104919c1920 with identifier: MB08927 to the API
2026-03-27 11:16:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:26:14Z',
 'fuel_type': 'diesel',
 'id': '4202ac89-9b17-5be0-ba22-a104919c1920',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB08927',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 127535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-27',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2018}
2026-03-27 11:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB08927%27 HTTP/1.1" 200 None
2026-03-27 11:16:01 [auto1.de] INFO: Saving data for MB08927: {'auction_closing_time': 1774628774.0, 'created_time': 1774522166.613032, 'last_price_update_time': 1774610161.57441}
2026-03-27 11:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB08927') HTTP/1.1" 204 0
2026-03-27 11:16:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:16:01 [auto1.de] INFO: Found listing with ID: XP54469
2026-03-27 11:16:01 [auto1.de] INFO: Found listing with ID: VA54074
2026-03-27 11:16:01 [auto1.de] INFO: Found listing with ID: TX77816
2026-03-27 11:16:01 [auto1.de] INFO: Found listing with ID: FJ73550
2026-03-27 11:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ73550%27 HTTP/1.1" 200 None
2026-03-27 11:16:01 [auto1.de] INFO: Scrape type for FJ73550: 2
2026-03-27 11:16:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 584b9b61-3530-55ea-87c1-53cecdb46367 with identifier: FJ73550
2026-03-27 11:16:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 584b9b61-3530-55ea-87c1-53cecdb46367 with scrape type 2
2026-03-27 11:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 584b9b61-3530-55ea-87c1-53cecdb46367 with scrape type 2
2026-03-27 11:16:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 584b9b61-3530-55ea-87c1-53cecdb46367, identifier: FJ73550
2026-03-27 11:16:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 584b9b61-3530-55ea-87c1-53cecdb46367 with identifier: FJ73550
2026-03-27 11:16:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 584b9b61-3530-55ea-87c1-53cecdb46367 with identifier: FJ73550
2026-03-27 11:16:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 584b9b61-3530-55ea-87c1-53cecdb46367 with identifier: FJ73550 to the API
2026-03-27 11:16:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-27T16:49:14Z',
 'fuel_type': 'diesel',
 'id': '584b9b61-3530-55ea-87c1-53cecdb46367',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ73550',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 16480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-08',
 'seller_name': None,
 'title': 'Opel Astra 1.5 CDTI GS',
 'transmission': 'automatic',
 'trim': 'GS',
 'year': 2024}
2026-03-27 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ73550%27 HTTP/1.1" 200 None
2026-03-27 11:16:02 [auto1.de] INFO: Saving data for FJ73550: {'auction_closing_time': 1774630154.0, 'created_time': 1774522182.462748, 'last_price_update_time': 1774610162.205448}
2026-03-27 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ73550') HTTP/1.1" 204 0
2026-03-27 11:16:02 [auto1.de] INFO: Found listing with ID: FL35891
2026-03-27 11:16:02 [auto1.de] INFO: Found listing with ID: PG89057
2026-03-27 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG89057%27 HTTP/1.1" 200 None
2026-03-27 11:16:02 [auto1.de] INFO: Scrape type for PG89057: 2
2026-03-27 11:16:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bf63dec-7624-5d16-a296-6bc096e156d0 with identifier: PG89057
2026-03-27 11:16:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bf63dec-7624-5d16-a296-6bc096e156d0 with scrape type 2
2026-03-27 11:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bf63dec-7624-5d16-a296-6bc096e156d0 with scrape type 2
2026-03-27 11:16:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0bf63dec-7624-5d16-a296-6bc096e156d0, identifier: PG89057
2026-03-27 11:16:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0bf63dec-7624-5d16-a296-6bc096e156d0 with identifier: PG89057
2026-03-27 11:16:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0bf63dec-7624-5d16-a296-6bc096e156d0 with identifier: PG89057
2026-03-27 11:16:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0bf63dec-7624-5d16-a296-6bc096e156d0 with identifier: PG89057 to the API
2026-03-27 11:16:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 209,
 'expiration_date': '2026-03-27T16:14:03Z',
 'fuel_type': 'diesel',
 'id': '0bf63dec-7624-5d16-a296-6bc096e156d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG89057',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 51827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-18',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Veloce Q4',
 'transmission': 'automatic',
 'trim': 'Veloce Q4',
 'year': 2023}
2026-03-27 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG89057%27 HTTP/1.1" 200 None
2026-03-27 11:16:02 [auto1.de] INFO: Saving data for PG89057: {'auction_closing_time': 1774628043.0, 'created_time': 1774522217.380196, 'last_price_update_time': 1774610162.730699}
2026-03-27 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG89057') HTTP/1.1" 204 0
2026-03-27 11:16:02 [auto1.de] INFO: Found listing with ID: WC33273
2026-03-27 11:16:02 [auto1.de] INFO: Found listing with ID: RF88070
2026-03-27 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF88070%27 HTTP/1.1" 200 None
2026-03-27 11:16:02 [auto1.de] INFO: Scrape type for RF88070: 2
2026-03-27 11:16:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d68e0992-b4dc-572b-8dd6-a4cb89340033 with identifier: RF88070
2026-03-27 11:16:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d68e0992-b4dc-572b-8dd6-a4cb89340033 with scrape type 2
2026-03-27 11:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d68e0992-b4dc-572b-8dd6-a4cb89340033 with scrape type 2
2026-03-27 11:16:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d68e0992-b4dc-572b-8dd6-a4cb89340033, identifier: RF88070
2026-03-27 11:16:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d68e0992-b4dc-572b-8dd6-a4cb89340033 with identifier: RF88070
2026-03-27 11:16:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d68e0992-b4dc-572b-8dd6-a4cb89340033 with identifier: RF88070
2026-03-27 11:16:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d68e0992-b4dc-572b-8dd6-a4cb89340033 with identifier: RF88070 to the API
2026-03-27 11:16:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-27T16:35:41Z',
 'fuel_type': 'petrol',
 'id': 'd68e0992-b4dc-572b-8dd6-a4cb89340033',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF88070',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 28661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-13',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2024}
2026-03-27 11:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF88070%27 HTTP/1.1" 200 None
2026-03-27 11:16:03 [auto1.de] INFO: Saving data for RF88070: {'auction_closing_time': 1774629341.0, 'created_time': 1774522302.015839, 'last_price_update_time': 1774610163.245381}
2026-03-27 11:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF88070') HTTP/1.1" 204 0
2026-03-27 11:16:03 [auto1.de] INFO: Found listing with ID: SW60945
2026-03-27 11:16:03 [auto1.de] INFO: Found listing with ID: ZS06789
2026-03-27 11:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS06789%27 HTTP/1.1" 200 None
2026-03-27 11:16:03 [auto1.de] INFO: Scrape type for ZS06789: 2
2026-03-27 11:16:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65e14c2b-bc5f-56c9-89d7-98c6e66d0ecf with identifier: ZS06789
2026-03-27 11:16:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65e14c2b-bc5f-56c9-89d7-98c6e66d0ecf with scrape type 2
2026-03-27 11:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65e14c2b-bc5f-56c9-89d7-98c6e66d0ecf with scrape type 2
2026-03-27 11:16:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65e14c2b-bc5f-56c9-89d7-98c6e66d0ecf, identifier: ZS06789
2026-03-27 11:16:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65e14c2b-bc5f-56c9-89d7-98c6e66d0ecf with identifier: ZS06789
2026-03-27 11:16:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65e14c2b-bc5f-56c9-89d7-98c6e66d0ecf with identifier: ZS06789
2026-03-27 11:16:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65e14c2b-bc5f-56c9-89d7-98c6e66d0ecf with identifier: ZS06789 to the API
2026-03-27 11:16:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-27T16:08:03Z',
 'fuel_type': 'petrol',
 'id': '65e14c2b-bc5f-56c9-89d7-98c6e66d0ecf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS06789',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS4',
 'odometer': 35229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-14',
 'seller_name': None,
 'title': 'DS Automobiles DS4 1.2 PureTech Performance Line+',
 'transmission': 'automatic',
 'trim': 'Performance Line+',
 'year': 2024}
2026-03-27 11:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS06789%27 HTTP/1.1" 200 None
2026-03-27 11:16:03 [auto1.de] INFO: Saving data for ZS06789: {'auction_closing_time': 1774627683.0, 'created_time': 1774522167.658993, 'last_price_update_time': 1774610163.672304}
2026-03-27 11:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS06789') HTTP/1.1" 204 0
2026-03-27 11:16:03 [auto1.de] INFO: Found listing with ID: WA42384
2026-03-27 11:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA42384%27 HTTP/1.1" 200 None
2026-03-27 11:16:03 [auto1.de] INFO: Scrape type for WA42384: 2
2026-03-27 11:16:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9526d42-f1fe-5cdb-a85b-96087e793b12 with identifier: WA42384
2026-03-27 11:16:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9526d42-f1fe-5cdb-a85b-96087e793b12 with scrape type 2
2026-03-27 11:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9526d42-f1fe-5cdb-a85b-96087e793b12 with scrape type 2
2026-03-27 11:16:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9526d42-f1fe-5cdb-a85b-96087e793b12, identifier: WA42384
2026-03-27 11:16:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9526d42-f1fe-5cdb-a85b-96087e793b12 with identifier: WA42384
2026-03-27 11:16:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9526d42-f1fe-5cdb-a85b-96087e793b12 with identifier: WA42384
2026-03-27 11:16:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9526d42-f1fe-5cdb-a85b-96087e793b12 with identifier: WA42384 to the API
2026-03-27 11:16:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:49:04Z',
 'fuel_type': 'diesel',
 'id': 'b9526d42-f1fe-5cdb-a85b-96087e793b12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA42384',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 16263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-03',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2024}
2026-03-27 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA42384%27 HTTP/1.1" 200 None
2026-03-27 11:16:04 [auto1.de] INFO: Saving data for WA42384: {'auction_closing_time': 1774630144.0, 'created_time': 1774522197.946207, 'last_price_update_time': 1774610164.194774}
2026-03-27 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA42384') HTTP/1.1" 204 0
2026-03-27 11:16:04 [auto1.de] INFO: Found listing with ID: TV49922
2026-03-27 11:16:04 [auto1.de] INFO: Found listing with ID: XR35422
2026-03-27 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR35422%27 HTTP/1.1" 200 None
2026-03-27 11:16:04 [auto1.de] INFO: Scrape type for XR35422: 2
2026-03-27 11:16:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85b330f9-f1d1-5127-a99f-20ca7c287f2b with identifier: XR35422
2026-03-27 11:16:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85b330f9-f1d1-5127-a99f-20ca7c287f2b with scrape type 2
2026-03-27 11:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85b330f9-f1d1-5127-a99f-20ca7c287f2b with scrape type 2
2026-03-27 11:16:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85b330f9-f1d1-5127-a99f-20ca7c287f2b, identifier: XR35422
2026-03-27 11:16:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85b330f9-f1d1-5127-a99f-20ca7c287f2b with identifier: XR35422
2026-03-27 11:16:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85b330f9-f1d1-5127-a99f-20ca7c287f2b with identifier: XR35422
2026-03-27 11:16:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85b330f9-f1d1-5127-a99f-20ca7c287f2b with identifier: XR35422 to the API
2026-03-27 11:16:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 118,
 'expiration_date': '2026-03-27T16:11:29Z',
 'fuel_type': 'electro',
 'id': '85b330f9-f1d1-5127-a99f-20ca7c287f2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR35422',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500e',
 'odometer': 12238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-05',
 'seller_name': None,
 'title': 'Fiat 500e electric drive 87 kW',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-27 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR35422%27 HTTP/1.1" 200 None
2026-03-27 11:16:04 [auto1.de] INFO: Saving data for XR35422: {'auction_closing_time': 1774627889.0, 'created_time': 1774522153.171409, 'last_price_update_time': 1774610164.773069}
2026-03-27 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR35422') HTTP/1.1" 204 0
2026-03-27 11:16:04 [auto1.de] INFO: Found listing with ID: AJ18698
2026-03-27 11:16:04 [auto1.de] INFO: Found listing with ID: TN09859
2026-03-27 11:16:04 [auto1.de] INFO: Found listing with ID: BM17164
2026-03-27 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM17164%27 HTTP/1.1" 200 None
2026-03-27 11:16:04 [auto1.de] INFO: Scrape type for BM17164: 2
2026-03-27 11:16:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98091e3c-838b-5e41-b095-59ec8bf64ee2 with identifier: BM17164
2026-03-27 11:16:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98091e3c-838b-5e41-b095-59ec8bf64ee2 with scrape type 2
2026-03-27 11:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98091e3c-838b-5e41-b095-59ec8bf64ee2 with scrape type 2
2026-03-27 11:16:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98091e3c-838b-5e41-b095-59ec8bf64ee2, identifier: BM17164
2026-03-27 11:16:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98091e3c-838b-5e41-b095-59ec8bf64ee2 with identifier: BM17164
2026-03-27 11:16:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98091e3c-838b-5e41-b095-59ec8bf64ee2 with identifier: BM17164
2026-03-27 11:16:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98091e3c-838b-5e41-b095-59ec8bf64ee2 with identifier: BM17164 to the API
2026-03-27 11:16:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-27T16:27:21Z',
 'fuel_type': 'diesel',
 'id': '98091e3c-838b-5e41-b095-59ec8bf64ee2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM17164',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Grand Vitara',
 'odometer': 188039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-12',
 'seller_name': None,
 'title': 'Suzuki Grand Vitara 1.9 DDiS DDIS Comfort',
 'transmission': 'manual',
 'trim': 'DDIS Comfort',
 'year': 2012}
2026-03-27 11:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM17164%27 HTTP/1.1" 200 None
2026-03-27 11:16:05 [auto1.de] INFO: Saving data for BM17164: {'auction_closing_time': 1774628841.0, 'created_time': 1774522156.282366, 'last_price_update_time': 1774610165.220736}
2026-03-27 11:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM17164') HTTP/1.1" 204 0
2026-03-27 11:16:05 [auto1.de] INFO: Found listing with ID: XA54655
2026-03-27 11:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA54655%27 HTTP/1.1" 200 None
2026-03-27 11:16:05 [auto1.de] INFO: Scrape type for XA54655: 2
2026-03-27 11:16:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a72215d9-4b10-55e2-8d68-63bf15d209e1 with identifier: XA54655
2026-03-27 11:16:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a72215d9-4b10-55e2-8d68-63bf15d209e1 with scrape type 2
2026-03-27 11:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a72215d9-4b10-55e2-8d68-63bf15d209e1 with scrape type 2
2026-03-27 11:16:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a72215d9-4b10-55e2-8d68-63bf15d209e1, identifier: XA54655
2026-03-27 11:16:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a72215d9-4b10-55e2-8d68-63bf15d209e1 with identifier: XA54655
2026-03-27 11:16:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a72215d9-4b10-55e2-8d68-63bf15d209e1 with identifier: XA54655
2026-03-27 11:16:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a72215d9-4b10-55e2-8d68-63bf15d209e1 with identifier: XA54655 to the API
2026-03-27 11:16:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-27T16:37:52Z',
 'fuel_type': 'petrol',
 'id': 'a72215d9-4b10-55e2-8d68-63bf15d209e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA54655',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 219861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-29',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2005}
2026-03-27 11:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA54655%27 HTTP/1.1" 200 None
2026-03-27 11:16:05 [auto1.de] INFO: Saving data for XA54655: {'auction_closing_time': 1774629472.0, 'created_time': 1774522147.247987, 'last_price_update_time': 1774610165.858661}
2026-03-27 11:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA54655') HTTP/1.1" 204 0
2026-03-27 11:16:05 [auto1.de] INFO: Found listing with ID: TJ52471
2026-03-27 11:16:05 [auto1.de] INFO: Found listing with ID: EW11176
2026-03-27 11:16:05 [auto1.de] INFO: Found listing with ID: MH20651
2026-03-27 11:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH20651%27 HTTP/1.1" 200 None
2026-03-27 11:16:05 [auto1.de] INFO: Scrape type for MH20651: 2
2026-03-27 11:16:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1039684-162c-5c12-8629-c23c529465c1 with identifier: MH20651
2026-03-27 11:16:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1039684-162c-5c12-8629-c23c529465c1 with scrape type 2
2026-03-27 11:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1039684-162c-5c12-8629-c23c529465c1 with scrape type 2
2026-03-27 11:16:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1039684-162c-5c12-8629-c23c529465c1, identifier: MH20651
2026-03-27 11:16:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1039684-162c-5c12-8629-c23c529465c1 with identifier: MH20651
2026-03-27 11:16:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1039684-162c-5c12-8629-c23c529465c1 with identifier: MH20651
2026-03-27 11:16:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1039684-162c-5c12-8629-c23c529465c1 with identifier: MH20651 to the API
2026-03-27 11:16:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:01:27Z',
 'fuel_type': 'diesel',
 'id': 'f1039684-162c-5c12-8629-c23c529465c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH20651',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 209190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-28',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Laurin & Klement 4x4',
 'transmission': 'automatic',
 'trim': 'Laurin & Klement 4x4',
 'year': 2020}
2026-03-27 11:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH20651%27 HTTP/1.1" 200 None
2026-03-27 11:16:06 [auto1.de] INFO: Saving data for MH20651: {'auction_closing_time': 1774627287.0, 'created_time': 1774264953.59331, 'last_price_update_time': 1774610166.361659}
2026-03-27 11:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH20651') HTTP/1.1" 204 0
2026-03-27 11:16:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:16:06 [auto1.de] INFO: Found listing with ID: TH77412
2026-03-27 11:16:06 [auto1.de] INFO: Found listing with ID: AN05892
2026-03-27 11:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN05892%27 HTTP/1.1" 200 None
2026-03-27 11:16:06 [auto1.de] INFO: Scrape type for AN05892: 2
2026-03-27 11:16:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d5d5559-cb98-5cd3-a5b7-05e2caea77fb with identifier: AN05892
2026-03-27 11:16:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d5d5559-cb98-5cd3-a5b7-05e2caea77fb with scrape type 2
2026-03-27 11:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d5d5559-cb98-5cd3-a5b7-05e2caea77fb with scrape type 2
2026-03-27 11:16:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d5d5559-cb98-5cd3-a5b7-05e2caea77fb, identifier: AN05892
2026-03-27 11:16:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d5d5559-cb98-5cd3-a5b7-05e2caea77fb with identifier: AN05892
2026-03-27 11:16:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d5d5559-cb98-5cd3-a5b7-05e2caea77fb with identifier: AN05892
2026-03-27 11:16:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d5d5559-cb98-5cd3-a5b7-05e2caea77fb with identifier: AN05892 to the API
2026-03-27 11:16:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:07:29Z',
 'fuel_type': 'petrol',
 'id': '2d5d5559-cb98-5cd3-a5b7-05e2caea77fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN05892',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 136421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-27 11:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN05892%27 HTTP/1.1" 200 None
2026-03-27 11:16:06 [auto1.de] INFO: Saving data for AN05892: {'auction_closing_time': 1774627649.0, 'created_time': 1774522219.014535, 'last_price_update_time': 1774610166.873704}
2026-03-27 11:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN05892') HTTP/1.1" 204 0
2026-03-27 11:16:06 [auto1.de] INFO: Found listing with ID: DZ38540
2026-03-27 11:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ38540%27 HTTP/1.1" 200 None
2026-03-27 11:16:07 [auto1.de] INFO: Scrape type for DZ38540: 2
2026-03-27 11:16:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5913f35-9307-5a3c-bc15-2576acd9021d with identifier: DZ38540
2026-03-27 11:16:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5913f35-9307-5a3c-bc15-2576acd9021d with scrape type 2
2026-03-27 11:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5913f35-9307-5a3c-bc15-2576acd9021d with scrape type 2
2026-03-27 11:16:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5913f35-9307-5a3c-bc15-2576acd9021d, identifier: DZ38540
2026-03-27 11:16:07 [scrapy.extensions.logstats] INFO: Crawled 724 pages (at 4 pages/min), scraped 1253 items (at 74 items/min)
2026-03-27 11:16:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 11:16:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5913f35-9307-5a3c-bc15-2576acd9021d with identifier: DZ38540
2026-03-27 11:16:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5913f35-9307-5a3c-bc15-2576acd9021d with identifier: DZ38540
2026-03-27 11:16:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5913f35-9307-5a3c-bc15-2576acd9021d with identifier: DZ38540 to the API
2026-03-27 11:16:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-27T16:38:28Z',
 'fuel_type': 'petrol',
 'id': 'd5913f35-9307-5a3c-bc15-2576acd9021d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ38540',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 185402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-30',
 'seller_name': None,
 'title': 'Ford C-Max 1.6 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2007}
2026-03-27 11:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ38540%27 HTTP/1.1" 200 None
2026-03-27 11:16:07 [auto1.de] INFO: Saving data for DZ38540: {'auction_closing_time': 1774629508.0, 'created_time': 1774522196.066596, 'last_price_update_time': 1774610167.504037}
2026-03-27 11:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ38540') HTTP/1.1" 204 0
2026-03-27 11:16:07 [auto1.de] INFO: Channel: 24h | Page: 256 | totalHits: 10686 | hits on page: 40
2026-03-27 11:16:07 [auto1.de] INFO: Found listing with ID: UK52286
2026-03-27 11:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK52286%27 HTTP/1.1" 200 None
2026-03-27 11:16:07 [auto1.de] INFO: Scrape type for UK52286: 2
2026-03-27 11:16:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae5c3948-cac5-5680-8af5-311903ebdecc with identifier: UK52286
2026-03-27 11:16:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae5c3948-cac5-5680-8af5-311903ebdecc with scrape type 2
2026-03-27 11:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae5c3948-cac5-5680-8af5-311903ebdecc with scrape type 2
2026-03-27 11:16:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae5c3948-cac5-5680-8af5-311903ebdecc, identifier: UK52286
2026-03-27 11:16:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae5c3948-cac5-5680-8af5-311903ebdecc with identifier: UK52286
2026-03-27 11:16:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae5c3948-cac5-5680-8af5-311903ebdecc with identifier: UK52286
2026-03-27 11:16:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae5c3948-cac5-5680-8af5-311903ebdecc with identifier: UK52286 to the API
2026-03-27 11:16:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:47:52Z',
 'fuel_type': 'diesel',
 'id': 'ae5c3948-cac5-5680-8af5-311903ebdecc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK52286',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 196212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-22',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2015}
2026-03-27 11:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK52286%27 HTTP/1.1" 200 None
2026-03-27 11:16:08 [auto1.de] INFO: Saving data for UK52286: {'auction_closing_time': 1774630072.0, 'created_time': 1774522248.292621, 'last_price_update_time': 1774610168.097918}
2026-03-27 11:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK52286') HTTP/1.1" 204 0
2026-03-27 11:16:08 [auto1.de] INFO: Found listing with ID: TE75572
2026-03-27 11:16:08 [auto1.de] INFO: Found listing with ID: TB87278
2026-03-27 11:16:08 [auto1.de] INFO: Found listing with ID: WZ05010
2026-03-27 11:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ05010%27 HTTP/1.1" 200 None
2026-03-27 11:16:08 [auto1.de] INFO: Scrape type for WZ05010: 0
2026-03-27 11:16:08 [auto1.de] INFO: Found listing with ID: SX85367
2026-03-27 11:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX85367%27 HTTP/1.1" 200 None
2026-03-27 11:16:08 [auto1.de] INFO: Scrape type for SX85367: 2
2026-03-27 11:16:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9ac1045-435c-5da7-a577-e451a7325fa4 with identifier: SX85367
2026-03-27 11:16:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9ac1045-435c-5da7-a577-e451a7325fa4 with scrape type 2
2026-03-27 11:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9ac1045-435c-5da7-a577-e451a7325fa4 with scrape type 2
2026-03-27 11:16:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9ac1045-435c-5da7-a577-e451a7325fa4, identifier: SX85367
2026-03-27 11:16:08 [auto1.de] INFO: Found listing with ID: VD25373
2026-03-27 11:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD25373%27 HTTP/1.1" 200 None
2026-03-27 11:16:08 [auto1.de] INFO: Scrape type for VD25373: 2
2026-03-27 11:16:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 852da84b-e542-5b7b-88f0-7e820977fdb6 with identifier: VD25373
2026-03-27 11:16:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 852da84b-e542-5b7b-88f0-7e820977fdb6 with scrape type 2
2026-03-27 11:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 852da84b-e542-5b7b-88f0-7e820977fdb6 with scrape type 2
2026-03-27 11:16:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 852da84b-e542-5b7b-88f0-7e820977fdb6, identifier: VD25373
2026-03-27 11:16:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9ac1045-435c-5da7-a577-e451a7325fa4 with identifier: SX85367
2026-03-27 11:16:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9ac1045-435c-5da7-a577-e451a7325fa4 with identifier: SX85367
2026-03-27 11:16:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9ac1045-435c-5da7-a577-e451a7325fa4 with identifier: SX85367 to the API
2026-03-27 11:16:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-27T16:45:25Z',
 'fuel_type': 'petrol',
 'id': 'a9ac1045-435c-5da7-a577-e451a7325fa4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX85367',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 78206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-02',
 'seller_name': None,
 'title': 'Opel Insignia 2.0 SIDI Turbo Business Innovation 4x4',
 'transmission': 'automatic',
 'trim': 'Business Innovation 4x4',
 'year': 2016}
2026-03-27 11:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX85367%27 HTTP/1.1" 200 None
2026-03-27 11:16:08 [auto1.de] INFO: Saving data for SX85367: {'auction_closing_time': 1774629925.0, 'created_time': 1774522214.001102, 'last_price_update_time': 1774610168.766687}
2026-03-27 11:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX85367') HTTP/1.1" 204 0
2026-03-27 11:16:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:16:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 852da84b-e542-5b7b-88f0-7e820977fdb6 with identifier: VD25373
2026-03-27 11:16:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 852da84b-e542-5b7b-88f0-7e820977fdb6 with identifier: VD25373
2026-03-27 11:16:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 852da84b-e542-5b7b-88f0-7e820977fdb6 with identifier: VD25373 to the API
2026-03-27 11:16:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-27T16:08:18Z',
 'fuel_type': 'diesel',
 'id': '852da84b-e542-5b7b-88f0-7e820977fdb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD25373',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 243307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-25',
 'seller_name': None,
 'title': 'BMW 5er 525d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-27 11:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD25373%27 HTTP/1.1" 200 None
2026-03-27 11:16:09 [auto1.de] INFO: Saving data for VD25373: {'auction_closing_time': 1774627698.0, 'created_time': 1772727732.051352, 'last_price_update_time': 1774610169.10027}
2026-03-27 11:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VD25373') HTTP/1.1" 204 0
2026-03-27 11:16:09 [auto1.de] INFO: Found listing with ID: BP99192
2026-03-27 11:16:09 [auto1.de] INFO: Found listing with ID: NE31655
2026-03-27 11:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE31655%27 HTTP/1.1" 200 None
2026-03-27 11:16:09 [auto1.de] INFO: Scrape type for NE31655: 2
2026-03-27 11:16:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b9c770a-d0dd-558e-8d16-30e7b056e931 with identifier: NE31655
2026-03-27 11:16:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b9c770a-d0dd-558e-8d16-30e7b056e931 with scrape type 2
2026-03-27 11:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b9c770a-d0dd-558e-8d16-30e7b056e931 with scrape type 2
2026-03-27 11:16:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b9c770a-d0dd-558e-8d16-30e7b056e931, identifier: NE31655
2026-03-27 11:16:09 [auto1.de] INFO: Found listing with ID: PU90892
2026-03-27 11:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU90892%27 HTTP/1.1" 200 None
2026-03-27 11:16:09 [auto1.de] INFO: Scrape type for PU90892: 2
2026-03-27 11:16:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3b46849-aab4-5f9b-b020-8533bb792ad0 with identifier: PU90892
2026-03-27 11:16:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3b46849-aab4-5f9b-b020-8533bb792ad0 with scrape type 2
2026-03-27 11:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3b46849-aab4-5f9b-b020-8533bb792ad0 with scrape type 2
2026-03-27 11:16:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3b46849-aab4-5f9b-b020-8533bb792ad0, identifier: PU90892
2026-03-27 11:16:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b9c770a-d0dd-558e-8d16-30e7b056e931 with identifier: NE31655
2026-03-27 11:16:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b9c770a-d0dd-558e-8d16-30e7b056e931 with identifier: NE31655
2026-03-27 11:16:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b9c770a-d0dd-558e-8d16-30e7b056e931 with identifier: NE31655 to the API
2026-03-27 11:16:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:30:28Z',
 'fuel_type': 'diesel',
 'id': '7b9c770a-d0dd-558e-8d16-30e7b056e931',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE31655',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 258524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-13',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2016}
2026-03-27 11:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE31655%27 HTTP/1.1" 200 None
2026-03-27 11:16:09 [auto1.de] INFO: Saving data for NE31655: {'auction_closing_time': 1774629028.0, 'created_time': 1774522221.054731, 'last_price_update_time': 1774610169.672908}
2026-03-27 11:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE31655') HTTP/1.1" 204 0
2026-03-27 11:16:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3b46849-aab4-5f9b-b020-8533bb792ad0 with identifier: PU90892
2026-03-27 11:16:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3b46849-aab4-5f9b-b020-8533bb792ad0 with identifier: PU90892
2026-03-27 11:16:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3b46849-aab4-5f9b-b020-8533bb792ad0 with identifier: PU90892 to the API
2026-03-27 11:16:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-27T16:18:24Z',
 'fuel_type': 'petrol',
 'id': 'd3b46849-aab4-5f9b-b020-8533bb792ad0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU90892',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 98605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 Edition 19 Progressive',
 'transmission': 'automatic',
 'trim': 'Edition 19 Progressive',
 'year': 2019}
2026-03-27 11:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU90892%27 HTTP/1.1" 200 None
2026-03-27 11:16:10 [auto1.de] INFO: Saving data for PU90892: {'auction_closing_time': 1774628304.0, 'created_time': 1774522214.393852, 'last_price_update_time': 1774610170.004211}
2026-03-27 11:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU90892') HTTP/1.1" 204 0
2026-03-27 11:16:10 [auto1.de] INFO: Found listing with ID: KB32538
2026-03-27 11:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB32538%27 HTTP/1.1" 200 None
2026-03-27 11:16:10 [auto1.de] INFO: Scrape type for KB32538: 2
2026-03-27 11:16:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 071cb01b-3ab6-5913-99bf-5cfcde11d767 with identifier: KB32538
2026-03-27 11:16:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 071cb01b-3ab6-5913-99bf-5cfcde11d767 with scrape type 2
2026-03-27 11:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 071cb01b-3ab6-5913-99bf-5cfcde11d767 with scrape type 2
2026-03-27 11:16:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 071cb01b-3ab6-5913-99bf-5cfcde11d767, identifier: KB32538
2026-03-27 11:16:10 [auto1.de] INFO: Found listing with ID: DD95746
2026-03-27 11:16:10 [auto1.de] INFO: Found listing with ID: JY24308
2026-03-27 11:16:10 [auto1.de] INFO: Found listing with ID: FV18875
2026-03-27 11:16:10 [auto1.de] INFO: Found listing with ID: AZ18703
2026-03-27 11:16:10 [auto1.de] INFO: Found listing with ID: YZ97143
2026-03-27 11:16:10 [auto1.de] INFO: Found listing with ID: KJ44451
2026-03-27 11:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ44451%27 HTTP/1.1" 200 None
2026-03-27 11:16:10 [auto1.de] INFO: Scrape type for KJ44451: 2
2026-03-27 11:16:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03087a0d-cbd5-5c0f-9334-24c662e83c9f with identifier: KJ44451
2026-03-27 11:16:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03087a0d-cbd5-5c0f-9334-24c662e83c9f with scrape type 2
2026-03-27 11:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03087a0d-cbd5-5c0f-9334-24c662e83c9f with scrape type 2
2026-03-27 11:16:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03087a0d-cbd5-5c0f-9334-24c662e83c9f, identifier: KJ44451
2026-03-27 11:16:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 071cb01b-3ab6-5913-99bf-5cfcde11d767 with identifier: KB32538
2026-03-27 11:16:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 071cb01b-3ab6-5913-99bf-5cfcde11d767 with identifier: KB32538
2026-03-27 11:16:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 071cb01b-3ab6-5913-99bf-5cfcde11d767 with identifier: KB32538 to the API
2026-03-27 11:16:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:46:34Z',
 'fuel_type': 'petrol',
 'id': '071cb01b-3ab6-5913-99bf-5cfcde11d767',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB32538',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 113398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-17',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2017}
2026-03-27 11:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB32538%27 HTTP/1.1" 200 None
2026-03-27 11:16:10 [auto1.de] INFO: Saving data for KB32538: {'auction_closing_time': 1774629994.0, 'created_time': 1774522249.387904, 'last_price_update_time': 1774610170.594054}
2026-03-27 11:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB32538') HTTP/1.1" 204 0
2026-03-27 11:16:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03087a0d-cbd5-5c0f-9334-24c662e83c9f with identifier: KJ44451
2026-03-27 11:16:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03087a0d-cbd5-5c0f-9334-24c662e83c9f with identifier: KJ44451
2026-03-27 11:16:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03087a0d-cbd5-5c0f-9334-24c662e83c9f with identifier: KJ44451 to the API
2026-03-27 11:16:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:12:25Z',
 'fuel_type': 'diesel',
 'id': '03087a0d-cbd5-5c0f-9334-24c662e83c9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ44451',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 204410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-27',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2008}
2026-03-27 11:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ44451%27 HTTP/1.1" 200 None
2026-03-27 11:16:11 [auto1.de] INFO: Saving data for KJ44451: {'auction_closing_time': 1774627945.0, 'created_time': 1774522220.252579, 'last_price_update_time': 1774610171.096154}
2026-03-27 11:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ44451') HTTP/1.1" 204 0
2026-03-27 11:16:11 [auto1.de] INFO: Found listing with ID: TT75700
2026-03-27 11:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT75700%27 HTTP/1.1" 200 None
2026-03-27 11:16:11 [auto1.de] INFO: Scrape type for TT75700: 2
2026-03-27 11:16:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 588e648b-8ac8-5361-9048-15eef4d1b12f with identifier: TT75700
2026-03-27 11:16:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 588e648b-8ac8-5361-9048-15eef4d1b12f with scrape type 2
2026-03-27 11:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 588e648b-8ac8-5361-9048-15eef4d1b12f with scrape type 2
2026-03-27 11:16:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 588e648b-8ac8-5361-9048-15eef4d1b12f, identifier: TT75700
2026-03-27 11:16:11 [auto1.de] INFO: Found listing with ID: XM41105
2026-03-27 11:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM41105%27 HTTP/1.1" 200 None
2026-03-27 11:16:11 [auto1.de] INFO: Scrape type for XM41105: 2
2026-03-27 11:16:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c230b3e-6004-55d5-ac15-263613e0f2cb with identifier: XM41105
2026-03-27 11:16:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c230b3e-6004-55d5-ac15-263613e0f2cb with scrape type 2
2026-03-27 11:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c230b3e-6004-55d5-ac15-263613e0f2cb with scrape type 2
2026-03-27 11:16:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c230b3e-6004-55d5-ac15-263613e0f2cb, identifier: XM41105
2026-03-27 11:16:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 588e648b-8ac8-5361-9048-15eef4d1b12f with identifier: TT75700
2026-03-27 11:16:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 588e648b-8ac8-5361-9048-15eef4d1b12f with identifier: TT75700
2026-03-27 11:16:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 588e648b-8ac8-5361-9048-15eef4d1b12f with identifier: TT75700 to the API
2026-03-27 11:16:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:40:27Z',
 'fuel_type': 'diesel',
 'id': '588e648b-8ac8-5361-9048-15eef4d1b12f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT75700',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 122498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-19',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 DI-D Plus 4WD',
 'transmission': 'manual',
 'trim': 'Plus 4WD',
 'year': 2017}
2026-03-27 11:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT75700%27 HTTP/1.1" 200 None
2026-03-27 11:16:11 [auto1.de] INFO: Saving data for TT75700: {'auction_closing_time': 1774629627.0, 'created_time': 1772545282.107078, 'last_price_update_time': 1774610171.731535}
2026-03-27 11:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT75700') HTTP/1.1" 204 0
2026-03-27 11:16:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c230b3e-6004-55d5-ac15-263613e0f2cb with identifier: XM41105
2026-03-27 11:16:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c230b3e-6004-55d5-ac15-263613e0f2cb with identifier: XM41105
2026-03-27 11:16:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c230b3e-6004-55d5-ac15-263613e0f2cb with identifier: XM41105 to the API
2026-03-27 11:16:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-27T16:45:27Z',
 'fuel_type': 'petrol',
 'id': '3c230b3e-6004-55d5-ac15-263613e0f2cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM41105',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 138564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-10',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Move up!',
 'transmission': 'manual',
 'trim': 'Move',
 'year': 2013}
2026-03-27 11:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM41105%27 HTTP/1.1" 200 None
2026-03-27 11:16:12 [auto1.de] INFO: Saving data for XM41105: {'auction_closing_time': 1774629927.0, 'created_time': 1774522234.996516, 'last_price_update_time': 1774610172.086318}
2026-03-27 11:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM41105') HTTP/1.1" 204 0
2026-03-27 11:16:12 [auto1.de] INFO: Found listing with ID: NR41937
2026-03-27 11:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR41937%27 HTTP/1.1" 200 None
2026-03-27 11:16:12 [auto1.de] INFO: Scrape type for NR41937: 0
2026-03-27 11:16:12 [auto1.de] INFO: Found listing with ID: HZ75916
2026-03-27 11:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ75916%27 HTTP/1.1" 200 None
2026-03-27 11:16:12 [auto1.de] INFO: Scrape type for HZ75916: 2
2026-03-27 11:16:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f265c99f-1ac1-5457-9655-682c09b8d4b1 with identifier: HZ75916
2026-03-27 11:16:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f265c99f-1ac1-5457-9655-682c09b8d4b1 with scrape type 2
2026-03-27 11:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f265c99f-1ac1-5457-9655-682c09b8d4b1 with scrape type 2
2026-03-27 11:16:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f265c99f-1ac1-5457-9655-682c09b8d4b1, identifier: HZ75916
2026-03-27 11:16:12 [auto1.de] INFO: Found listing with ID: LN76006
2026-03-27 11:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN76006%27 HTTP/1.1" 200 None
2026-03-27 11:16:12 [auto1.de] INFO: Scrape type for LN76006: 2
2026-03-27 11:16:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 827e53f6-71f1-56d4-836d-e4df1f3968a1 with identifier: LN76006
2026-03-27 11:16:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 827e53f6-71f1-56d4-836d-e4df1f3968a1 with scrape type 2
2026-03-27 11:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 827e53f6-71f1-56d4-836d-e4df1f3968a1 with scrape type 2
2026-03-27 11:16:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 827e53f6-71f1-56d4-836d-e4df1f3968a1, identifier: LN76006
2026-03-27 11:16:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f265c99f-1ac1-5457-9655-682c09b8d4b1 with identifier: HZ75916
2026-03-27 11:16:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f265c99f-1ac1-5457-9655-682c09b8d4b1 with identifier: HZ75916
2026-03-27 11:16:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f265c99f-1ac1-5457-9655-682c09b8d4b1 with identifier: HZ75916 to the API
2026-03-27 11:16:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-27T16:30:32Z',
 'fuel_type': 'diesel',
 'id': 'f265c99f-1ac1-5457-9655-682c09b8d4b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ75916',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 207260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-27',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 3.0 CRD Overland',
 'transmission': 'automatic',
 'trim': 'Overland',
 'year': 2012}
2026-03-27 11:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ75916%27 HTTP/1.1" 200 None
2026-03-27 11:16:12 [auto1.de] INFO: Saving data for HZ75916: {'auction_closing_time': 1774629032.0, 'created_time': 1773228719.270931, 'last_price_update_time': 1774610172.804155}
2026-03-27 11:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ75916') HTTP/1.1" 204 0
2026-03-27 11:16:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 827e53f6-71f1-56d4-836d-e4df1f3968a1 with identifier: LN76006
2026-03-27 11:16:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 827e53f6-71f1-56d4-836d-e4df1f3968a1 with identifier: LN76006
2026-03-27 11:16:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 827e53f6-71f1-56d4-836d-e4df1f3968a1 with identifier: LN76006 to the API
2026-03-27 11:16:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-27T16:25:38Z',
 'fuel_type': 'petrol',
 'id': '827e53f6-71f1-56d4-836d-e4df1f3968a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN76006',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 42146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-05',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-27 11:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN76006%27 HTTP/1.1" 200 None
2026-03-27 11:16:13 [auto1.de] INFO: Saving data for LN76006: {'auction_closing_time': 1774628738.0, 'created_time': 1774522260.039164, 'last_price_update_time': 1774610173.163224}
2026-03-27 11:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN76006') HTTP/1.1" 204 0
2026-03-27 11:16:13 [auto1.de] INFO: Found listing with ID: NG94121
2026-03-27 11:16:13 [auto1.de] INFO: Found listing with ID: KX98673
2026-03-27 11:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX98673%27 HTTP/1.1" 200 None
2026-03-27 11:16:13 [auto1.de] INFO: Scrape type for KX98673: 2
2026-03-27 11:16:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf599741-5528-5135-989d-a5fed44ea21d with identifier: KX98673
2026-03-27 11:16:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf599741-5528-5135-989d-a5fed44ea21d with scrape type 2
2026-03-27 11:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf599741-5528-5135-989d-a5fed44ea21d with scrape type 2
2026-03-27 11:16:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf599741-5528-5135-989d-a5fed44ea21d, identifier: KX98673
2026-03-27 11:16:13 [auto1.de] INFO: Found listing with ID: JC18235
2026-03-27 11:16:13 [auto1.de] INFO: Found listing with ID: RD90003
2026-03-27 11:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD90003%27 HTTP/1.1" 200 None
2026-03-27 11:16:13 [auto1.de] INFO: Scrape type for RD90003: 2
2026-03-27 11:16:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e28ca1b8-ac01-5dd1-8a88-c297b1710988 with identifier: RD90003
2026-03-27 11:16:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e28ca1b8-ac01-5dd1-8a88-c297b1710988 with scrape type 2
2026-03-27 11:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e28ca1b8-ac01-5dd1-8a88-c297b1710988 with scrape type 2
2026-03-27 11:16:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e28ca1b8-ac01-5dd1-8a88-c297b1710988, identifier: RD90003
2026-03-27 11:16:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf599741-5528-5135-989d-a5fed44ea21d with identifier: KX98673
2026-03-27 11:16:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf599741-5528-5135-989d-a5fed44ea21d with identifier: KX98673
2026-03-27 11:16:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf599741-5528-5135-989d-a5fed44ea21d with identifier: KX98673 to the API
2026-03-27 11:16:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:16:54Z',
 'fuel_type': 'diesel',
 'id': 'cf599741-5528-5135-989d-a5fed44ea21d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX98673',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 115872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-15',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Tour',
 'transmission': 'automatic',
 'trim': 'Tour',
 'year': 2022}
2026-03-27 11:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX98673%27 HTTP/1.1" 200 None
2026-03-27 11:16:13 [auto1.de] INFO: Saving data for KX98673: {'auction_closing_time': 1774628214.0, 'created_time': 1774522202.768531, 'last_price_update_time': 1774610173.774241}
2026-03-27 11:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX98673') HTTP/1.1" 204 0
2026-03-27 11:16:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e28ca1b8-ac01-5dd1-8a88-c297b1710988 with identifier: RD90003
2026-03-27 11:16:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e28ca1b8-ac01-5dd1-8a88-c297b1710988 with identifier: RD90003
2026-03-27 11:16:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e28ca1b8-ac01-5dd1-8a88-c297b1710988 with identifier: RD90003 to the API
2026-03-27 11:16:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-27T16:42:12Z',
 'fuel_type': 'petrol',
 'id': 'e28ca1b8-ac01-5dd1-8a88-c297b1710988',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD90003',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 76273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-25',
 'seller_name': None,
 'title': 'BMW 3er 335i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-27 11:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD90003%27 HTTP/1.1" 200 None
2026-03-27 11:16:14 [auto1.de] INFO: Saving data for RD90003: {'auction_closing_time': 1774629732.0, 'created_time': 1773945959.49454, 'last_price_update_time': 1774610174.112849}
2026-03-27 11:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD90003') HTTP/1.1" 204 0
2026-03-27 11:16:14 [auto1.de] INFO: Found listing with ID: ZR95965
2026-03-27 11:16:14 [auto1.de] INFO: Found listing with ID: LE91288
2026-03-27 11:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE91288%27 HTTP/1.1" 200 None
2026-03-27 11:16:14 [auto1.de] INFO: Scrape type for LE91288: 2
2026-03-27 11:16:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50d673af-550e-50ce-8687-3e43e5030c66 with identifier: LE91288
2026-03-27 11:16:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50d673af-550e-50ce-8687-3e43e5030c66 with scrape type 2
2026-03-27 11:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50d673af-550e-50ce-8687-3e43e5030c66 with scrape type 2
2026-03-27 11:16:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50d673af-550e-50ce-8687-3e43e5030c66, identifier: LE91288
2026-03-27 11:16:14 [auto1.de] INFO: Found listing with ID: LY63644
2026-03-27 11:16:14 [auto1.de] INFO: Found listing with ID: TE75572
2026-03-27 11:16:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50d673af-550e-50ce-8687-3e43e5030c66 with identifier: LE91288
2026-03-27 11:16:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50d673af-550e-50ce-8687-3e43e5030c66 with identifier: LE91288
2026-03-27 11:16:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50d673af-550e-50ce-8687-3e43e5030c66 with identifier: LE91288 to the API
2026-03-27 11:16:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-27T16:51:18Z',
 'fuel_type': 'hybrid',
 'id': '50d673af-550e-50ce-8687-3e43e5030c66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE91288',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 104726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-31',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2022}
2026-03-27 11:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE91288%27 HTTP/1.1" 200 None
2026-03-27 11:16:14 [auto1.de] INFO: Saving data for LE91288: {'auction_closing_time': 1774630278.0, 'created_time': 1774522209.491797, 'last_price_update_time': 1774610174.561135}
2026-03-27 11:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE91288') HTTP/1.1" 204 0
2026-03-27 11:16:14 [auto1.de] INFO: Found listing with ID: NE51682
2026-03-27 11:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE51682%27 HTTP/1.1" 200 None
2026-03-27 11:16:14 [auto1.de] INFO: Scrape type for NE51682: 2
2026-03-27 11:16:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6a35d96-ca20-502e-99f2-c4a08ab1f53d with identifier: NE51682
2026-03-27 11:16:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6a35d96-ca20-502e-99f2-c4a08ab1f53d with scrape type 2
2026-03-27 11:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6a35d96-ca20-502e-99f2-c4a08ab1f53d with scrape type 2
2026-03-27 11:16:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6a35d96-ca20-502e-99f2-c4a08ab1f53d, identifier: NE51682
2026-03-27 11:16:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6a35d96-ca20-502e-99f2-c4a08ab1f53d with identifier: NE51682
2026-03-27 11:16:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6a35d96-ca20-502e-99f2-c4a08ab1f53d with identifier: NE51682
2026-03-27 11:16:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6a35d96-ca20-502e-99f2-c4a08ab1f53d with identifier: NE51682 to the API
2026-03-27 11:16:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-27T16:15:59Z',
 'fuel_type': 'petrol',
 'id': 'd6a35d96-ca20-502e-99f2-c4a08ab1f53d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE51682',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 182301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-27 11:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE51682%27 HTTP/1.1" 200 None
2026-03-27 11:16:15 [auto1.de] INFO: Saving data for NE51682: {'auction_closing_time': 1774628159.0, 'created_time': 1774522242.905815, 'last_price_update_time': 1774610175.093207}
2026-03-27 11:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE51682') HTTP/1.1" 204 0
2026-03-27 11:16:15 [auto1.de] INFO: Found listing with ID: WP48993
2026-03-27 11:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48993%27 HTTP/1.1" 200 None
2026-03-27 11:16:15 [auto1.de] INFO: Scrape type for WP48993: 2
2026-03-27 11:16:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49459b97-75bf-558e-9c7e-010c02ad240e with identifier: WP48993
2026-03-27 11:16:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49459b97-75bf-558e-9c7e-010c02ad240e with scrape type 2
2026-03-27 11:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49459b97-75bf-558e-9c7e-010c02ad240e with scrape type 2
2026-03-27 11:16:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49459b97-75bf-558e-9c7e-010c02ad240e, identifier: WP48993
2026-03-27 11:16:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49459b97-75bf-558e-9c7e-010c02ad240e with identifier: WP48993
2026-03-27 11:16:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49459b97-75bf-558e-9c7e-010c02ad240e with identifier: WP48993
2026-03-27 11:16:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49459b97-75bf-558e-9c7e-010c02ad240e with identifier: WP48993 to the API
2026-03-27 11:16:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-27T16:32:56Z',
 'fuel_type': 'hybrid',
 'id': '49459b97-75bf-558e-9c7e-010c02ad240e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP48993',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 82247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-04',
 'seller_name': None,
 'title': 'BMW 5er 530e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-27 11:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48993%27 HTTP/1.1" 200 None
2026-03-27 11:16:15 [auto1.de] INFO: Saving data for WP48993: {'auction_closing_time': 1774629176.0, 'created_time': 1774522244.533686, 'last_price_update_time': 1774610175.54305}
2026-03-27 11:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP48993') HTTP/1.1" 204 0
2026-03-27 11:16:15 [auto1.de] INFO: Found listing with ID: RK13717
2026-03-27 11:16:15 [auto1.de] INFO: Found listing with ID: DE70516
2026-03-27 11:16:15 [auto1.de] INFO: Found listing with ID: BX19940
2026-03-27 11:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX19940%27 HTTP/1.1" 200 None
2026-03-27 11:16:15 [auto1.de] INFO: Scrape type for BX19940: 2
2026-03-27 11:16:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6120ca4d-e562-5530-917a-baaf953ba8b2 with identifier: BX19940
2026-03-27 11:16:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6120ca4d-e562-5530-917a-baaf953ba8b2 with scrape type 2
2026-03-27 11:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6120ca4d-e562-5530-917a-baaf953ba8b2 with scrape type 2
2026-03-27 11:16:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6120ca4d-e562-5530-917a-baaf953ba8b2, identifier: BX19940
2026-03-27 11:16:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6120ca4d-e562-5530-917a-baaf953ba8b2 with identifier: BX19940
2026-03-27 11:16:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6120ca4d-e562-5530-917a-baaf953ba8b2 with identifier: BX19940
2026-03-27 11:16:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6120ca4d-e562-5530-917a-baaf953ba8b2 with identifier: BX19940 to the API
2026-03-27 11:16:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:44:11Z',
 'fuel_type': 'petrol',
 'id': '6120ca4d-e562-5530-917a-baaf953ba8b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX19940',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 117789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-12',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 Avantage',
 'transmission': 'automatic',
 'trim': 'Avantage',
 'year': 2006}
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX19940%27 HTTP/1.1" 200 None
2026-03-27 11:16:16 [auto1.de] INFO: Saving data for BX19940: {'auction_closing_time': 1774629851.0, 'created_time': 1774522260.547889, 'last_price_update_time': 1774610176.023258}
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX19940') HTTP/1.1" 204 0
2026-03-27 11:16:16 [auto1.de] INFO: Found listing with ID: VK72696
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK72696%27 HTTP/1.1" 200 None
2026-03-27 11:16:16 [auto1.de] INFO: Scrape type for VK72696: 2
2026-03-27 11:16:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee7b2695-032f-51d1-bde1-61a1644069a6 with identifier: VK72696
2026-03-27 11:16:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee7b2695-032f-51d1-bde1-61a1644069a6 with scrape type 2
2026-03-27 11:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee7b2695-032f-51d1-bde1-61a1644069a6 with scrape type 2
2026-03-27 11:16:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee7b2695-032f-51d1-bde1-61a1644069a6, identifier: VK72696
2026-03-27 11:16:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee7b2695-032f-51d1-bde1-61a1644069a6 with identifier: VK72696
2026-03-27 11:16:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee7b2695-032f-51d1-bde1-61a1644069a6 with identifier: VK72696
2026-03-27 11:16:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee7b2695-032f-51d1-bde1-61a1644069a6 with identifier: VK72696 to the API
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:34:10Z',
 'fuel_type': 'petrol',
 'id': 'ee7b2695-032f-51d1-bde1-61a1644069a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK72696',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 80065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK72696%27 HTTP/1.1" 200 None
2026-03-27 11:16:16 [auto1.de] INFO: Saving data for VK72696: {'auction_closing_time': 1774629250.0, 'created_time': 1774522252.557076, 'last_price_update_time': 1774610176.46052}
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK72696') HTTP/1.1" 204 0
2026-03-27 11:16:16 [auto1.de] INFO: Found listing with ID: RR96346
2026-03-27 11:16:16 [auto1.de] INFO: Found listing with ID: NN97430
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN97430%27 HTTP/1.1" 200 None
2026-03-27 11:16:16 [auto1.de] INFO: Scrape type for NN97430: 2
2026-03-27 11:16:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04706d00-e14a-5fae-a008-fd257fb3b7ba with identifier: NN97430
2026-03-27 11:16:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04706d00-e14a-5fae-a008-fd257fb3b7ba with scrape type 2
2026-03-27 11:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04706d00-e14a-5fae-a008-fd257fb3b7ba with scrape type 2
2026-03-27 11:16:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04706d00-e14a-5fae-a008-fd257fb3b7ba, identifier: NN97430
2026-03-27 11:16:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04706d00-e14a-5fae-a008-fd257fb3b7ba with identifier: NN97430
2026-03-27 11:16:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04706d00-e14a-5fae-a008-fd257fb3b7ba with identifier: NN97430
2026-03-27 11:16:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04706d00-e14a-5fae-a008-fd257fb3b7ba with identifier: NN97430 to the API
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:24:35Z',
 'fuel_type': 'diesel',
 'id': '04706d00-e14a-5fae-a008-fd257fb3b7ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN97430',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 283241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-14',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 111 CDI Lang',
 'transmission': 'automatic',
 'trim': 'Lang',
 'year': 2016}
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN97430%27 HTTP/1.1" 200 None
2026-03-27 11:16:16 [auto1.de] INFO: Saving data for NN97430: {'auction_closing_time': 1774628675.0, 'created_time': 1774522263.444154, 'last_price_update_time': 1774610176.951301}
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN97430') HTTP/1.1" 204 0
2026-03-27 11:16:16 [auto1.de] INFO: Found listing with ID: MY83234
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY83234%27 HTTP/1.1" 200 None
2026-03-27 11:16:16 [auto1.de] INFO: Scrape type for MY83234: 2
2026-03-27 11:16:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc16493e-3936-5578-8512-34337db0bb10 with identifier: MY83234
2026-03-27 11:16:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc16493e-3936-5578-8512-34337db0bb10 with scrape type 2
2026-03-27 11:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc16493e-3936-5578-8512-34337db0bb10 with scrape type 2
2026-03-27 11:16:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc16493e-3936-5578-8512-34337db0bb10, identifier: MY83234
2026-03-27 11:16:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc16493e-3936-5578-8512-34337db0bb10 with identifier: MY83234
2026-03-27 11:16:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc16493e-3936-5578-8512-34337db0bb10 with identifier: MY83234
2026-03-27 11:16:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc16493e-3936-5578-8512-34337db0bb10 with identifier: MY83234 to the API
2026-03-27 11:16:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-27T16:21:30Z',
 'fuel_type': 'diesel',
 'id': 'bc16493e-3936-5578-8512-34337db0bb10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY83234',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 133649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-22',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 D5 Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2016}
2026-03-27 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY83234%27 HTTP/1.1" 200 None
2026-03-27 11:16:17 [auto1.de] INFO: Saving data for MY83234: {'auction_closing_time': 1774628490.0, 'created_time': 1774522241.212123, 'last_price_update_time': 1774610177.406274}
2026-03-27 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY83234') HTTP/1.1" 204 0
2026-03-27 11:16:17 [auto1.de] INFO: Found listing with ID: DG23161
2026-03-27 11:16:17 [auto1.de] INFO: Found listing with ID: AJ08508
2026-03-27 11:16:17 [auto1.de] INFO: Found listing with ID: ED91782
2026-03-27 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED91782%27 HTTP/1.1" 200 None
2026-03-27 11:16:17 [auto1.de] INFO: Scrape type for ED91782: 2
2026-03-27 11:16:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0295c5d7-fb95-550a-847b-28b21e0b69a1 with identifier: ED91782
2026-03-27 11:16:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0295c5d7-fb95-550a-847b-28b21e0b69a1 with scrape type 2
2026-03-27 11:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0295c5d7-fb95-550a-847b-28b21e0b69a1 with scrape type 2
2026-03-27 11:16:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0295c5d7-fb95-550a-847b-28b21e0b69a1, identifier: ED91782
2026-03-27 11:16:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0295c5d7-fb95-550a-847b-28b21e0b69a1 with identifier: ED91782
2026-03-27 11:16:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0295c5d7-fb95-550a-847b-28b21e0b69a1 with identifier: ED91782
2026-03-27 11:16:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0295c5d7-fb95-550a-847b-28b21e0b69a1 with identifier: ED91782 to the API
2026-03-27 11:16:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:22:04Z',
 'fuel_type': 'petrol',
 'id': '0295c5d7-fb95-550a-847b-28b21e0b69a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED91782',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 121759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-20',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI ACT Trendline 4Motion BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline 4Motion BlueMotion',
 'year': 2017}
2026-03-27 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED91782%27 HTTP/1.1" 200 None
2026-03-27 11:16:17 [auto1.de] INFO: Saving data for ED91782: {'auction_closing_time': 1774628524.0, 'created_time': 1774522265.655727, 'last_price_update_time': 1774610177.881301}
2026-03-27 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED91782') HTTP/1.1" 204 0
2026-03-27 11:16:18 [auto1.de] INFO: Found listing with ID: HH56316
2026-03-27 11:16:18 [auto1.de] INFO: Found listing with ID: AG08443
2026-03-27 11:16:18 [auto1.de] INFO: Found listing with ID: MM33078
2026-03-27 11:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33078%27 HTTP/1.1" 200 None
2026-03-27 11:16:18 [auto1.de] INFO: Scrape type for MM33078: 2
2026-03-27 11:16:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0 with identifier: MM33078
2026-03-27 11:16:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0 with scrape type 2
2026-03-27 11:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0 with scrape type 2
2026-03-27 11:16:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0, identifier: MM33078
2026-03-27 11:16:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0 with identifier: MM33078
2026-03-27 11:16:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0 with identifier: MM33078
2026-03-27 11:16:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0 with identifier: MM33078 to the API
2026-03-27 11:16:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:40:23Z',
 'fuel_type': 'diesel',
 'id': 'bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM33078',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 174518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-21',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2013}
2026-03-27 11:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33078%27 HTTP/1.1" 200 None
2026-03-27 11:16:19 [auto1.de] INFO: Saving data for MM33078: {'auction_closing_time': 1774629623.0, 'created_time': 1774522279.14601, 'last_price_update_time': 1774610179.079544}
2026-03-27 11:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM33078') HTTP/1.1" 204 0
2026-03-27 11:16:19 [auto1.de] INFO: Found listing with ID: RB67874
2026-03-27 11:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB67874%27 HTTP/1.1" 200 None
2026-03-27 11:16:19 [auto1.de] INFO: Scrape type for RB67874: 2
2026-03-27 11:16:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ecac9bc-d704-58bc-8d24-3c42448ef0a5 with identifier: RB67874
2026-03-27 11:16:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ecac9bc-d704-58bc-8d24-3c42448ef0a5 with scrape type 2
2026-03-27 11:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ecac9bc-d704-58bc-8d24-3c42448ef0a5 with scrape type 2
2026-03-27 11:16:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ecac9bc-d704-58bc-8d24-3c42448ef0a5, identifier: RB67874
2026-03-27 11:16:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ecac9bc-d704-58bc-8d24-3c42448ef0a5 with identifier: RB67874
2026-03-27 11:16:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ecac9bc-d704-58bc-8d24-3c42448ef0a5 with identifier: RB67874
2026-03-27 11:16:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ecac9bc-d704-58bc-8d24-3c42448ef0a5 with identifier: RB67874 to the API
2026-03-27 11:16:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-27T16:58:32Z',
 'fuel_type': 'diesel',
 'id': '9ecac9bc-d704-58bc-8d24-3c42448ef0a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB67874',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 276338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-16',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2010}
2026-03-27 11:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB67874%27 HTTP/1.1" 200 None
2026-03-27 11:16:19 [auto1.de] INFO: Saving data for RB67874: {'auction_closing_time': 1774630712.0, 'created_time': 1773945943.794316, 'last_price_update_time': 1774610179.583379}
2026-03-27 11:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB67874') HTTP/1.1" 204 0
2026-03-27 11:16:19 [auto1.de] INFO: Found listing with ID: XP46424
2026-03-27 11:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP46424%27 HTTP/1.1" 200 None
2026-03-27 11:16:19 [auto1.de] INFO: Scrape type for XP46424: 2
2026-03-27 11:16:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fa0a3de-1deb-55a6-8945-192640326273 with identifier: XP46424
2026-03-27 11:16:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fa0a3de-1deb-55a6-8945-192640326273 with scrape type 2
2026-03-27 11:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fa0a3de-1deb-55a6-8945-192640326273 with scrape type 2
2026-03-27 11:16:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fa0a3de-1deb-55a6-8945-192640326273, identifier: XP46424
2026-03-27 11:16:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fa0a3de-1deb-55a6-8945-192640326273 with identifier: XP46424
2026-03-27 11:16:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fa0a3de-1deb-55a6-8945-192640326273 with identifier: XP46424
2026-03-27 11:16:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fa0a3de-1deb-55a6-8945-192640326273 with identifier: XP46424 to the API
2026-03-27 11:16:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:16:24Z',
 'fuel_type': 'petrol',
 'id': '6fa0a3de-1deb-55a6-8945-192640326273',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP46424',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 257574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-02',
 'seller_name': None,
 'title': 'Skoda Yeti 1.2 TSI Active Plus Edition',
 'transmission': 'manual',
 'trim': 'Active Plus Edition',
 'year': 2012}
2026-03-27 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP46424%27 HTTP/1.1" 200 None
2026-03-27 11:16:20 [auto1.de] INFO: Saving data for XP46424: {'auction_closing_time': 1774628184.0, 'created_time': 1774522233.907532, 'last_price_update_time': 1774610180.481623}
2026-03-27 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP46424') HTTP/1.1" 204 0
2026-03-27 11:16:20 [auto1.de] INFO: Found listing with ID: AC69838
2026-03-27 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC69838%27 HTTP/1.1" 200 None
2026-03-27 11:16:20 [auto1.de] INFO: Scrape type for AC69838: 2
2026-03-27 11:16:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae with identifier: AC69838
2026-03-27 11:16:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae with scrape type 2
2026-03-27 11:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae with scrape type 2
2026-03-27 11:16:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae, identifier: AC69838
2026-03-27 11:16:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae with identifier: AC69838
2026-03-27 11:16:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae with identifier: AC69838
2026-03-27 11:16:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae with identifier: AC69838 to the API
2026-03-27 11:16:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-27T16:25:34Z',
 'fuel_type': 'petrol',
 'id': '4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC69838',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 201671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-30',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2011}
2026-03-27 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC69838%27 HTTP/1.1" 200 None
2026-03-27 11:16:20 [auto1.de] INFO: Saving data for AC69838: {'auction_closing_time': 1774628734.0, 'created_time': 1774522242.16, 'last_price_update_time': 1774610180.921568}
2026-03-27 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC69838') HTTP/1.1" 204 0
2026-03-27 11:16:20 [auto1.de] INFO: Found listing with ID: PL26194
2026-03-27 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL26194%27 HTTP/1.1" 200 None
2026-03-27 11:16:20 [auto1.de] INFO: Scrape type for PL26194: 2
2026-03-27 11:16:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adf60191-9413-54d2-b424-cc9e3355ac51 with identifier: PL26194
2026-03-27 11:16:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adf60191-9413-54d2-b424-cc9e3355ac51 with scrape type 2
2026-03-27 11:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adf60191-9413-54d2-b424-cc9e3355ac51 with scrape type 2
2026-03-27 11:16:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: adf60191-9413-54d2-b424-cc9e3355ac51, identifier: PL26194
2026-03-27 11:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:16:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: adf60191-9413-54d2-b424-cc9e3355ac51 with identifier: PL26194
2026-03-27 11:16:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: adf60191-9413-54d2-b424-cc9e3355ac51 with identifier: PL26194
2026-03-27 11:16:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: adf60191-9413-54d2-b424-cc9e3355ac51 with identifier: PL26194 to the API
2026-03-27 11:16:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-27T16:58:37Z',
 'fuel_type': 'petrol',
 'id': 'adf60191-9413-54d2-b424-cc9e3355ac51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL26194',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 184727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-24',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Multispace',
 'transmission': 'manual',
 'trim': 'Multispace',
 'year': 2010}
2026-03-27 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL26194%27 HTTP/1.1" 200 None
2026-03-27 11:16:21 [auto1.de] INFO: Saving data for PL26194: {'auction_closing_time': 1774630717.0, 'created_time': 1774522368.597877, 'last_price_update_time': 1774610181.471279}
2026-03-27 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL26194') HTTP/1.1" 204 0
2026-03-27 11:16:21 [auto1.de] INFO: Found listing with ID: MA20018
2026-03-27 11:16:21 [auto1.de] INFO: Found listing with ID: ZX95459
2026-03-27 11:16:21 [auto1.de] INFO: Found listing with ID: LJ39551
2026-03-27 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ39551%27 HTTP/1.1" 200 None
2026-03-27 11:16:21 [auto1.de] INFO: Scrape type for LJ39551: 2
2026-03-27 11:16:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bafad74d-0159-5389-a6c8-70089e10eb93 with identifier: LJ39551
2026-03-27 11:16:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bafad74d-0159-5389-a6c8-70089e10eb93 with scrape type 2
2026-03-27 11:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bafad74d-0159-5389-a6c8-70089e10eb93 with scrape type 2
2026-03-27 11:16:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bafad74d-0159-5389-a6c8-70089e10eb93, identifier: LJ39551
2026-03-27 11:16:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bafad74d-0159-5389-a6c8-70089e10eb93 with identifier: LJ39551
2026-03-27 11:16:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bafad74d-0159-5389-a6c8-70089e10eb93 with identifier: LJ39551
2026-03-27 11:16:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bafad74d-0159-5389-a6c8-70089e10eb93 with identifier: LJ39551 to the API
2026-03-27 11:16:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-27T16:43:41Z',
 'fuel_type': 'petrol',
 'id': 'bafad74d-0159-5389-a6c8-70089e10eb93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ39551',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 64916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
 'transmission': 'automatic',
 'trim': 'GTI Clubsport',
 'year': 2021}
2026-03-27 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ39551%27 HTTP/1.1" 200 None
2026-03-27 11:16:21 [auto1.de] INFO: Saving data for LJ39551: {'auction_closing_time': 1774629821.0, 'created_time': 1774522247.521105, 'last_price_update_time': 1774610181.914537}
2026-03-27 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ39551') HTTP/1.1" 204 0
2026-03-27 11:16:21 [auto1.de] INFO: Found listing with ID: WK89431
2026-03-27 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK89431%27 HTTP/1.1" 200 None
2026-03-27 11:16:21 [auto1.de] INFO: Scrape type for WK89431: 0
2026-03-27 11:16:21 [auto1.de] INFO: Found listing with ID: NZ84353
2026-03-27 11:16:21 [auto1.de] INFO: Found listing with ID: EU22008
2026-03-27 11:16:21 [auto1.de] INFO: Found listing with ID: NX98723
2026-03-27 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX98723%27 HTTP/1.1" 200 None
2026-03-27 11:16:21 [auto1.de] INFO: Scrape type for NX98723: 2
2026-03-27 11:16:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd45d8f3-fc64-5cd6-856d-506911708464 with identifier: NX98723
2026-03-27 11:16:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd45d8f3-fc64-5cd6-856d-506911708464 with scrape type 2
2026-03-27 11:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd45d8f3-fc64-5cd6-856d-506911708464 with scrape type 2
2026-03-27 11:16:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd45d8f3-fc64-5cd6-856d-506911708464, identifier: NX98723
2026-03-27 11:16:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd45d8f3-fc64-5cd6-856d-506911708464 with identifier: NX98723
2026-03-27 11:16:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd45d8f3-fc64-5cd6-856d-506911708464 with identifier: NX98723
2026-03-27 11:16:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd45d8f3-fc64-5cd6-856d-506911708464 with identifier: NX98723 to the API
2026-03-27 11:16:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:40:23Z',
 'fuel_type': 'diesel',
 'id': 'cd45d8f3-fc64-5cd6-856d-506911708464',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX98723',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 168500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-07',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2016}
2026-03-27 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX98723%27 HTTP/1.1" 200 None
2026-03-27 11:16:22 [auto1.de] INFO: Saving data for NX98723: {'auction_closing_time': 1774629623.0, 'created_time': 1774522246.687834, 'last_price_update_time': 1774610182.383533}
2026-03-27 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX98723') HTTP/1.1" 204 0
2026-03-27 11:16:22 [auto1.de] INFO: Channel: 24h | Page: 257 | totalHits: 10689 | hits on page: 40
2026-03-27 11:16:22 [auto1.de] INFO: Found listing with ID: NZ84353
2026-03-27 11:16:22 [auto1.de] INFO: Found listing with ID: EU22008
2026-03-27 11:16:22 [auto1.de] INFO: Found listing with ID: NX98723
2026-03-27 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX98723%27 HTTP/1.1" 200 None
2026-03-27 11:16:22 [auto1.de] INFO: Scrape type for NX98723: 0
2026-03-27 11:16:22 [auto1.de] INFO: Found listing with ID: JY21775
2026-03-27 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY21775%27 HTTP/1.1" 200 None
2026-03-27 11:16:22 [auto1.de] INFO: Scrape type for JY21775: 2
2026-03-27 11:16:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5debbf9e-e055-55b0-8ebc-dd5881b8b2a9 with identifier: JY21775
2026-03-27 11:16:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5debbf9e-e055-55b0-8ebc-dd5881b8b2a9 with scrape type 2
2026-03-27 11:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5debbf9e-e055-55b0-8ebc-dd5881b8b2a9 with scrape type 2
2026-03-27 11:16:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5debbf9e-e055-55b0-8ebc-dd5881b8b2a9, identifier: JY21775
2026-03-27 11:16:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5debbf9e-e055-55b0-8ebc-dd5881b8b2a9 with identifier: JY21775
2026-03-27 11:16:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5debbf9e-e055-55b0-8ebc-dd5881b8b2a9 with identifier: JY21775
2026-03-27 11:16:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5debbf9e-e055-55b0-8ebc-dd5881b8b2a9 with identifier: JY21775 to the API
2026-03-27 11:16:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:36:39Z',
 'fuel_type': 'diesel',
 'id': '5debbf9e-e055-55b0-8ebc-dd5881b8b2a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY21775',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 254371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-05',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.6 TDCi Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2014}
2026-03-27 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY21775%27 HTTP/1.1" 200 None
2026-03-27 11:16:23 [auto1.de] INFO: Saving data for JY21775: {'auction_closing_time': 1774629399.0, 'created_time': 1774522250.937504, 'last_price_update_time': 1774610183.009463}
2026-03-27 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY21775') HTTP/1.1" 204 0
2026-03-27 11:16:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:16:23 [auto1.de] INFO: Found listing with ID: YS87471
2026-03-27 11:16:23 [auto1.de] INFO: Found listing with ID: RW82332
2026-03-27 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW82332%27 HTTP/1.1" 200 None
2026-03-27 11:16:23 [auto1.de] INFO: Scrape type for RW82332: 2
2026-03-27 11:16:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b80cd1b-b103-5c3f-8aa8-1e961a218e33 with identifier: RW82332
2026-03-27 11:16:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b80cd1b-b103-5c3f-8aa8-1e961a218e33 with scrape type 2
2026-03-27 11:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b80cd1b-b103-5c3f-8aa8-1e961a218e33 with scrape type 2
2026-03-27 11:16:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b80cd1b-b103-5c3f-8aa8-1e961a218e33, identifier: RW82332
2026-03-27 11:16:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b80cd1b-b103-5c3f-8aa8-1e961a218e33 with identifier: RW82332
2026-03-27 11:16:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b80cd1b-b103-5c3f-8aa8-1e961a218e33 with identifier: RW82332
2026-03-27 11:16:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b80cd1b-b103-5c3f-8aa8-1e961a218e33 with identifier: RW82332 to the API
2026-03-27 11:16:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-27T16:45:07Z',
 'fuel_type': 'petrol',
 'id': '6b80cd1b-b103-5c3f-8aa8-1e961a218e33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW82332',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 64132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-12',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2015}
2026-03-27 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW82332%27 HTTP/1.1" 200 None
2026-03-27 11:16:23 [auto1.de] INFO: Saving data for RW82332: {'auction_closing_time': 1774629907.0, 'created_time': 1774522296.620677, 'last_price_update_time': 1774610183.490705}
2026-03-27 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW82332') HTTP/1.1" 204 0
2026-03-27 11:16:23 [auto1.de] INFO: Found listing with ID: FE63930
2026-03-27 11:16:23 [auto1.de] INFO: Found listing with ID: BL42626
2026-03-27 11:16:23 [auto1.de] INFO: Found listing with ID: FF39586
2026-03-27 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF39586%27 HTTP/1.1" 200 None
2026-03-27 11:16:23 [auto1.de] INFO: Scrape type for FF39586: 2
2026-03-27 11:16:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e60c8e2-9151-5dde-8e0e-10f649360f5f with identifier: FF39586
2026-03-27 11:16:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e60c8e2-9151-5dde-8e0e-10f649360f5f with scrape type 2
2026-03-27 11:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e60c8e2-9151-5dde-8e0e-10f649360f5f with scrape type 2
2026-03-27 11:16:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e60c8e2-9151-5dde-8e0e-10f649360f5f, identifier: FF39586
2026-03-27 11:16:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e60c8e2-9151-5dde-8e0e-10f649360f5f with identifier: FF39586
2026-03-27 11:16:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e60c8e2-9151-5dde-8e0e-10f649360f5f with identifier: FF39586
2026-03-27 11:16:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e60c8e2-9151-5dde-8e0e-10f649360f5f with identifier: FF39586 to the API
2026-03-27 11:16:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-27T16:35:50Z',
 'fuel_type': 'diesel',
 'id': '3e60c8e2-9151-5dde-8e0e-10f649360f5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF39586',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 180689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-11',
 'seller_name': None,
 'title': 'Audi A6 Allroad 3.0 V6 TDI clean diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-27 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF39586%27 HTTP/1.1" 200 None
2026-03-27 11:16:24 [auto1.de] INFO: Saving data for FF39586: {'auction_closing_time': 1774629350.0, 'created_time': 1773301779.583936, 'last_price_update_time': 1774610184.049624}
2026-03-27 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF39586') HTTP/1.1" 204 0
2026-03-27 11:16:24 [auto1.de] INFO: Found listing with ID: BY42207
2026-03-27 11:16:24 [auto1.de] INFO: Found listing with ID: CK59033
2026-03-27 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK59033%27 HTTP/1.1" 200 None
2026-03-27 11:16:24 [auto1.de] INFO: Scrape type for CK59033: 2
2026-03-27 11:16:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7e79539-dad3-54b0-bbb2-a0517f5a3682 with identifier: CK59033
2026-03-27 11:16:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7e79539-dad3-54b0-bbb2-a0517f5a3682 with scrape type 2
2026-03-27 11:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7e79539-dad3-54b0-bbb2-a0517f5a3682 with scrape type 2
2026-03-27 11:16:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7e79539-dad3-54b0-bbb2-a0517f5a3682, identifier: CK59033
2026-03-27 11:16:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7e79539-dad3-54b0-bbb2-a0517f5a3682 with identifier: CK59033
2026-03-27 11:16:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7e79539-dad3-54b0-bbb2-a0517f5a3682 with identifier: CK59033
2026-03-27 11:16:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7e79539-dad3-54b0-bbb2-a0517f5a3682 with identifier: CK59033 to the API
2026-03-27 11:16:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-27T16:18:14Z',
 'fuel_type': 'diesel',
 'id': 'e7e79539-dad3-54b0-bbb2-a0517f5a3682',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK59033',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 114303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-16',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2018}
2026-03-27 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK59033%27 HTTP/1.1" 200 None
2026-03-27 11:16:24 [auto1.de] INFO: Saving data for CK59033: {'auction_closing_time': 1774628294.0, 'created_time': 1773426942.174199, 'last_price_update_time': 1774610184.495091}
2026-03-27 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK59033') HTTP/1.1" 204 0
2026-03-27 11:16:24 [auto1.de] INFO: Found listing with ID: DS83303
2026-03-27 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS83303%27 HTTP/1.1" 200 None
2026-03-27 11:16:24 [auto1.de] INFO: Scrape type for DS83303: 2
2026-03-27 11:16:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b258be5e-8168-55f6-a194-9b14c580add6 with identifier: DS83303
2026-03-27 11:16:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b258be5e-8168-55f6-a194-9b14c580add6 with scrape type 2
2026-03-27 11:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b258be5e-8168-55f6-a194-9b14c580add6 with scrape type 2
2026-03-27 11:16:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b258be5e-8168-55f6-a194-9b14c580add6, identifier: DS83303
2026-03-27 11:16:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b258be5e-8168-55f6-a194-9b14c580add6 with identifier: DS83303
2026-03-27 11:16:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b258be5e-8168-55f6-a194-9b14c580add6 with identifier: DS83303
2026-03-27 11:16:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b258be5e-8168-55f6-a194-9b14c580add6 with identifier: DS83303 to the API
2026-03-27 11:16:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-27T16:51:06Z',
 'fuel_type': 'petrol',
 'id': 'b258be5e-8168-55f6-a194-9b14c580add6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS83303',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 85343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-13',
 'seller_name': None,
 'title': "Kia cee'd 1.0 TGDI Vision",
 'transmission': 'manual',
 'trim': 'Vision',
 'year': 2020}
2026-03-27 11:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS83303%27 HTTP/1.1" 200 None
2026-03-27 11:16:25 [auto1.de] INFO: Saving data for DS83303: {'auction_closing_time': 1774630266.0, 'created_time': 1774522252.98181, 'last_price_update_time': 1774610185.267069}
2026-03-27 11:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS83303') HTTP/1.1" 204 0
2026-03-27 11:16:25 [auto1.de] INFO: Found listing with ID: LU05399
2026-03-27 11:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU05399%27 HTTP/1.1" 200 None
2026-03-27 11:16:25 [auto1.de] INFO: Scrape type for LU05399: 2
2026-03-27 11:16:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4c8b30f-3e4e-5ee3-9431-89b2335b9551 with identifier: LU05399
2026-03-27 11:16:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4c8b30f-3e4e-5ee3-9431-89b2335b9551 with scrape type 2
2026-03-27 11:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4c8b30f-3e4e-5ee3-9431-89b2335b9551 with scrape type 2
2026-03-27 11:16:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4c8b30f-3e4e-5ee3-9431-89b2335b9551, identifier: LU05399
2026-03-27 11:16:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4c8b30f-3e4e-5ee3-9431-89b2335b9551 with identifier: LU05399
2026-03-27 11:16:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4c8b30f-3e4e-5ee3-9431-89b2335b9551 with identifier: LU05399
2026-03-27 11:16:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4c8b30f-3e4e-5ee3-9431-89b2335b9551 with identifier: LU05399 to the API
2026-03-27 11:16:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-27T16:21:40Z',
 'fuel_type': 'petrol',
 'id': 'c4c8b30f-3e4e-5ee3-9431-89b2335b9551',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU05399',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 144678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-08',
 'seller_name': None,
 'title': 'Renault Espace 2.0 Turbo Dynamique',
 'transmission': 'automatic',
 'trim': 'Dynamique',
 'year': 2006}
2026-03-27 11:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU05399%27 HTTP/1.1" 200 None
2026-03-27 11:16:25 [auto1.de] INFO: Saving data for LU05399: {'auction_closing_time': 1774628500.0, 'created_time': 1774034620.095612, 'last_price_update_time': 1774610185.686186}
2026-03-27 11:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU05399') HTTP/1.1" 204 0
2026-03-27 11:16:25 [auto1.de] INFO: Found listing with ID: TB03254
2026-03-27 11:16:25 [auto1.de] INFO: Found listing with ID: SB28206
2026-03-27 11:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB28206%27 HTTP/1.1" 200 None
2026-03-27 11:16:25 [auto1.de] INFO: Scrape type for SB28206: 2
2026-03-27 11:16:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99764afe-bacb-5dcb-9d8b-3e41dfeabf33 with identifier: SB28206
2026-03-27 11:16:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99764afe-bacb-5dcb-9d8b-3e41dfeabf33 with scrape type 2
2026-03-27 11:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99764afe-bacb-5dcb-9d8b-3e41dfeabf33 with scrape type 2
2026-03-27 11:16:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99764afe-bacb-5dcb-9d8b-3e41dfeabf33, identifier: SB28206
2026-03-27 11:16:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99764afe-bacb-5dcb-9d8b-3e41dfeabf33 with identifier: SB28206
2026-03-27 11:16:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99764afe-bacb-5dcb-9d8b-3e41dfeabf33 with identifier: SB28206
2026-03-27 11:16:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99764afe-bacb-5dcb-9d8b-3e41dfeabf33 with identifier: SB28206 to the API
2026-03-27 11:16:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 460,
 'expiration_date': '2026-03-27T16:20:36Z',
 'fuel_type': 'petrol',
 'id': '99764afe-bacb-5dcb-9d8b-3e41dfeabf33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB28206',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Panamera',
 'odometer': 96205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-05',
 'seller_name': None,
 'title': 'Porsche Panamera GTS',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-27 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB28206%27 HTTP/1.1" 200 None
2026-03-27 11:16:26 [auto1.de] INFO: Saving data for SB28206: {'auction_closing_time': 1774628436.0, 'created_time': 1773427608.849925, 'last_price_update_time': 1774610186.196138}
2026-03-27 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB28206') HTTP/1.1" 204 0
2026-03-27 11:16:26 [auto1.de] INFO: Found listing with ID: BL21282
2026-03-27 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL21282%27 HTTP/1.1" 200 None
2026-03-27 11:16:26 [auto1.de] INFO: Scrape type for BL21282: 2
2026-03-27 11:16:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b10da27-c2e5-5c37-a066-a925fbd813c8 with identifier: BL21282
2026-03-27 11:16:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b10da27-c2e5-5c37-a066-a925fbd813c8 with scrape type 2
2026-03-27 11:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b10da27-c2e5-5c37-a066-a925fbd813c8 with scrape type 2
2026-03-27 11:16:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b10da27-c2e5-5c37-a066-a925fbd813c8, identifier: BL21282
2026-03-27 11:16:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b10da27-c2e5-5c37-a066-a925fbd813c8 with identifier: BL21282
2026-03-27 11:16:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b10da27-c2e5-5c37-a066-a925fbd813c8 with identifier: BL21282
2026-03-27 11:16:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b10da27-c2e5-5c37-a066-a925fbd813c8 with identifier: BL21282 to the API
2026-03-27 11:16:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-27T16:19:55Z',
 'fuel_type': 'diesel',
 'id': '9b10da27-c2e5-5c37-a066-a925fbd813c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL21282',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 123482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-21',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2015}
2026-03-27 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL21282%27 HTTP/1.1" 200 None
2026-03-27 11:16:26 [auto1.de] INFO: Saving data for BL21282: {'auction_closing_time': 1774628395.0, 'created_time': 1773341511.72998, 'last_price_update_time': 1774610186.672094}
2026-03-27 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BL21282') HTTP/1.1" 204 0
2026-03-27 11:16:26 [auto1.de] INFO: Found listing with ID: ZE36621
2026-03-27 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE36621%27 HTTP/1.1" 200 None
2026-03-27 11:16:26 [auto1.de] INFO: Scrape type for ZE36621: 2
2026-03-27 11:16:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e609153-b640-5eba-a52a-66dc06e6e251 with identifier: ZE36621
2026-03-27 11:16:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e609153-b640-5eba-a52a-66dc06e6e251 with scrape type 2
2026-03-27 11:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e609153-b640-5eba-a52a-66dc06e6e251 with scrape type 2
2026-03-27 11:16:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e609153-b640-5eba-a52a-66dc06e6e251, identifier: ZE36621
2026-03-27 11:16:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e609153-b640-5eba-a52a-66dc06e6e251 with identifier: ZE36621
2026-03-27 11:16:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e609153-b640-5eba-a52a-66dc06e6e251 with identifier: ZE36621
2026-03-27 11:16:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e609153-b640-5eba-a52a-66dc06e6e251 with identifier: ZE36621 to the API
2026-03-27 11:16:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 381,
 'expiration_date': '2026-03-27T16:26:43Z',
 'fuel_type': 'hybrid',
 'id': '3e609153-b640-5eba-a52a-66dc06e6e251',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE36621',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 9299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-02',
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.0 4xe Plug-in Hybrid Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2023}
2026-03-27 11:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE36621%27 HTTP/1.1" 200 None
2026-03-27 11:16:27 [auto1.de] INFO: Saving data for ZE36621: {'auction_closing_time': 1774628803.0, 'created_time': 1774522255.372006, 'last_price_update_time': 1774610187.125694}
2026-03-27 11:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE36621') HTTP/1.1" 204 0
2026-03-27 11:16:27 [auto1.de] INFO: Found listing with ID: ZU01908
2026-03-27 11:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU01908%27 HTTP/1.1" 200 None
2026-03-27 11:16:27 [auto1.de] INFO: Scrape type for ZU01908: 2
2026-03-27 11:16:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00472d49-e3ef-5ccf-a895-64e77d225ac9 with identifier: ZU01908
2026-03-27 11:16:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00472d49-e3ef-5ccf-a895-64e77d225ac9 with scrape type 2
2026-03-27 11:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00472d49-e3ef-5ccf-a895-64e77d225ac9 with scrape type 2
2026-03-27 11:16:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00472d49-e3ef-5ccf-a895-64e77d225ac9, identifier: ZU01908
2026-03-27 11:16:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00472d49-e3ef-5ccf-a895-64e77d225ac9 with identifier: ZU01908
2026-03-27 11:16:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00472d49-e3ef-5ccf-a895-64e77d225ac9 with identifier: ZU01908
2026-03-27 11:16:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00472d49-e3ef-5ccf-a895-64e77d225ac9 with identifier: ZU01908 to the API
2026-03-27 11:16:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-27T16:41:39Z',
 'fuel_type': 'diesel',
 'id': '00472d49-e3ef-5ccf-a895-64e77d225ac9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU01908',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 140140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2018}
2026-03-27 11:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU01908%27 HTTP/1.1" 200 None
2026-03-27 11:16:27 [auto1.de] INFO: Saving data for ZU01908: {'auction_closing_time': 1774629699.0, 'created_time': 1773138353.474004, 'last_price_update_time': 1774610187.565034}
2026-03-27 11:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU01908') HTTP/1.1" 204 0
2026-03-27 11:16:27 [auto1.de] INFO: Found listing with ID: FW15462
2026-03-27 11:16:27 [auto1.de] INFO: Found listing with ID: DN16791
2026-03-27 11:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN16791%27 HTTP/1.1" 200 None
2026-03-27 11:16:27 [auto1.de] INFO: Scrape type for DN16791: 2
2026-03-27 11:16:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73e2dfc3-223d-5805-bd7a-0940daf6e1a6 with identifier: DN16791
2026-03-27 11:16:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73e2dfc3-223d-5805-bd7a-0940daf6e1a6 with scrape type 2
2026-03-27 11:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73e2dfc3-223d-5805-bd7a-0940daf6e1a6 with scrape type 2
2026-03-27 11:16:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73e2dfc3-223d-5805-bd7a-0940daf6e1a6, identifier: DN16791
2026-03-27 11:16:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73e2dfc3-223d-5805-bd7a-0940daf6e1a6 with identifier: DN16791
2026-03-27 11:16:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73e2dfc3-223d-5805-bd7a-0940daf6e1a6 with identifier: DN16791
2026-03-27 11:16:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73e2dfc3-223d-5805-bd7a-0940daf6e1a6 with identifier: DN16791 to the API
2026-03-27 11:16:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:25:58Z',
 'fuel_type': 'petrol',
 'id': '73e2dfc3-223d-5805-bd7a-0940daf6e1a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN16791',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 132811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-04-30',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4',
 'transmission': 'manual',
 'trim': '',
 'year': 2000}
2026-03-27 11:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN16791%27 HTTP/1.1" 200 None
2026-03-27 11:16:28 [auto1.de] INFO: Saving data for DN16791: {'auction_closing_time': 1774628758.0, 'created_time': 1774034584.438723, 'last_price_update_time': 1774610188.020982}
2026-03-27 11:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN16791') HTTP/1.1" 204 0
2026-03-27 11:16:28 [auto1.de] INFO: Found listing with ID: LJ93781
2026-03-27 11:16:28 [auto1.de] INFO: Found listing with ID: VU78858
2026-03-27 11:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU78858%27 HTTP/1.1" 200 None
2026-03-27 11:16:28 [auto1.de] INFO: Scrape type for VU78858: 2
2026-03-27 11:16:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2d06068-3d41-5928-991b-389acebe8d54 with identifier: VU78858
2026-03-27 11:16:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2d06068-3d41-5928-991b-389acebe8d54 with scrape type 2
2026-03-27 11:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2d06068-3d41-5928-991b-389acebe8d54 with scrape type 2
2026-03-27 11:16:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2d06068-3d41-5928-991b-389acebe8d54, identifier: VU78858
2026-03-27 11:16:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2d06068-3d41-5928-991b-389acebe8d54 with identifier: VU78858
2026-03-27 11:16:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2d06068-3d41-5928-991b-389acebe8d54 with identifier: VU78858
2026-03-27 11:16:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2d06068-3d41-5928-991b-389acebe8d54 with identifier: VU78858 to the API
2026-03-27 11:16:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-27T16:20:06Z',
 'fuel_type': 'petrol',
 'id': 'f2d06068-3d41-5928-991b-389acebe8d54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU78858',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 90405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-25',
 'seller_name': None,
 'title': 'BMW X3 xDrive 28i Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-27 11:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU78858%27 HTTP/1.1" 200 None
2026-03-27 11:16:28 [auto1.de] INFO: Saving data for VU78858: {'auction_closing_time': 1774628406.0, 'created_time': 1774522303.965304, 'last_price_update_time': 1774610188.537016}
2026-03-27 11:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU78858') HTTP/1.1" 204 0
2026-03-27 11:16:28 [auto1.de] INFO: Found listing with ID: HX92939
2026-03-27 11:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX92939%27 HTTP/1.1" 200 None
2026-03-27 11:16:28 [auto1.de] INFO: Scrape type for HX92939: 2
2026-03-27 11:16:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6539662d-8c7b-5bda-a193-4d3fef8bb4e9 with identifier: HX92939
2026-03-27 11:16:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6539662d-8c7b-5bda-a193-4d3fef8bb4e9 with scrape type 2
2026-03-27 11:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6539662d-8c7b-5bda-a193-4d3fef8bb4e9 with scrape type 2
2026-03-27 11:16:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6539662d-8c7b-5bda-a193-4d3fef8bb4e9, identifier: HX92939
2026-03-27 11:16:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6539662d-8c7b-5bda-a193-4d3fef8bb4e9 with identifier: HX92939
2026-03-27 11:16:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6539662d-8c7b-5bda-a193-4d3fef8bb4e9 with identifier: HX92939
2026-03-27 11:16:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6539662d-8c7b-5bda-a193-4d3fef8bb4e9 with identifier: HX92939 to the API
2026-03-27 11:16:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-27T16:51:52Z',
 'fuel_type': 'petrol',
 'id': '6539662d-8c7b-5bda-a193-4d3fef8bb4e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX92939',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 184324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-30',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Champions Edition',
 'transmission': 'manual',
 'trim': 'Champions Edition',
 'year': 2012}
2026-03-27 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX92939%27 HTTP/1.1" 200 None
2026-03-27 11:16:29 [auto1.de] INFO: Saving data for HX92939: {'auction_closing_time': 1774630312.0, 'created_time': 1774522548.282944, 'last_price_update_time': 1774610189.090059}
2026-03-27 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX92939') HTTP/1.1" 204 0
2026-03-27 11:16:29 [auto1.de] INFO: Found listing with ID: ZJ64916
2026-03-27 11:16:29 [auto1.de] INFO: Found listing with ID: BB70854
2026-03-27 11:16:29 [auto1.de] INFO: Found listing with ID: MM36361
2026-03-27 11:16:29 [auto1.de] INFO: Found listing with ID: ZC43990
2026-03-27 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC43990%27 HTTP/1.1" 200 None
2026-03-27 11:16:29 [auto1.de] INFO: Scrape type for ZC43990: 2
2026-03-27 11:16:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6a322c4-87d2-50a9-aa69-6b9ffd087780 with identifier: ZC43990
2026-03-27 11:16:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6a322c4-87d2-50a9-aa69-6b9ffd087780 with scrape type 2
2026-03-27 11:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6a322c4-87d2-50a9-aa69-6b9ffd087780 with scrape type 2
2026-03-27 11:16:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6a322c4-87d2-50a9-aa69-6b9ffd087780, identifier: ZC43990
2026-03-27 11:16:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6a322c4-87d2-50a9-aa69-6b9ffd087780 with identifier: ZC43990
2026-03-27 11:16:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6a322c4-87d2-50a9-aa69-6b9ffd087780 with identifier: ZC43990
2026-03-27 11:16:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6a322c4-87d2-50a9-aa69-6b9ffd087780 with identifier: ZC43990 to the API
2026-03-27 11:16:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:21:04Z',
 'fuel_type': 'diesel',
 'id': 'f6a322c4-87d2-50a9-aa69-6b9ffd087780',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC43990',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 75089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-07',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi EcoBlue Mild-Hybrid ST-Line X',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2021}
2026-03-27 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC43990%27 HTTP/1.1" 200 None
2026-03-27 11:16:29 [auto1.de] INFO: Saving data for ZC43990: {'auction_closing_time': 1774628464.0, 'created_time': 1774118992.997021, 'last_price_update_time': 1774610189.539297}
2026-03-27 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC43990') HTTP/1.1" 204 0
2026-03-27 11:16:29 [auto1.de] INFO: Found listing with ID: ZL93076
2026-03-27 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL93076%27 HTTP/1.1" 200 None
2026-03-27 11:16:29 [auto1.de] INFO: Scrape type for ZL93076: 2
2026-03-27 11:16:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e44ba27-5ba7-56c1-81c6-12c4e967603f with identifier: ZL93076
2026-03-27 11:16:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e44ba27-5ba7-56c1-81c6-12c4e967603f with scrape type 2
2026-03-27 11:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e44ba27-5ba7-56c1-81c6-12c4e967603f with scrape type 2
2026-03-27 11:16:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e44ba27-5ba7-56c1-81c6-12c4e967603f, identifier: ZL93076
2026-03-27 11:16:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e44ba27-5ba7-56c1-81c6-12c4e967603f with identifier: ZL93076
2026-03-27 11:16:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e44ba27-5ba7-56c1-81c6-12c4e967603f with identifier: ZL93076
2026-03-27 11:16:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e44ba27-5ba7-56c1-81c6-12c4e967603f with identifier: ZL93076 to the API
2026-03-27 11:16:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-27T16:00:37Z',
 'fuel_type': 'petrol',
 'id': '4e44ba27-5ba7-56c1-81c6-12c4e967603f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL93076',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 119717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-16',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2014}
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL93076%27 HTTP/1.1" 200 None
2026-03-27 11:16:30 [auto1.de] INFO: Saving data for ZL93076: {'auction_closing_time': 1774627237.0, 'created_time': 1773137086.815491, 'last_price_update_time': 1774610190.058641}
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL93076') HTTP/1.1" 204 0
2026-03-27 11:16:30 [auto1.de] INFO: Found listing with ID: JJ29192
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ29192%27 HTTP/1.1" 200 None
2026-03-27 11:16:30 [auto1.de] INFO: Scrape type for JJ29192: 2
2026-03-27 11:16:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd with identifier: JJ29192
2026-03-27 11:16:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd with scrape type 2
2026-03-27 11:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd with scrape type 2
2026-03-27 11:16:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd, identifier: JJ29192
2026-03-27 11:16:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:16:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd with identifier: JJ29192
2026-03-27 11:16:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd with identifier: JJ29192
2026-03-27 11:16:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd with identifier: JJ29192 to the API
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:21:36Z',
 'fuel_type': 'petrol',
 'id': '8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ29192',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 186438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-09',
 'seller_name': None,
 'title': 'BMW 1er 116i Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2008}
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ29192%27 HTTP/1.1" 200 None
2026-03-27 11:16:30 [auto1.de] INFO: Saving data for JJ29192: {'auction_closing_time': 1774628496.0, 'created_time': 1773382596.543345, 'last_price_update_time': 1774610190.480501}
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ29192') HTTP/1.1" 204 0
2026-03-27 11:16:30 [auto1.de] INFO: Found listing with ID: MF99655
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF99655%27 HTTP/1.1" 200 None
2026-03-27 11:16:30 [auto1.de] INFO: Scrape type for MF99655: 2
2026-03-27 11:16:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd347382-8e00-50df-b2d4-8334e389d1f8 with identifier: MF99655
2026-03-27 11:16:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd347382-8e00-50df-b2d4-8334e389d1f8 with scrape type 2
2026-03-27 11:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd347382-8e00-50df-b2d4-8334e389d1f8 with scrape type 2
2026-03-27 11:16:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd347382-8e00-50df-b2d4-8334e389d1f8, identifier: MF99655
2026-03-27 11:16:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd347382-8e00-50df-b2d4-8334e389d1f8 with identifier: MF99655
2026-03-27 11:16:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd347382-8e00-50df-b2d4-8334e389d1f8 with identifier: MF99655
2026-03-27 11:16:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd347382-8e00-50df-b2d4-8334e389d1f8 with identifier: MF99655 to the API
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:59:10Z',
 'fuel_type': 'petrol',
 'id': 'cd347382-8e00-50df-b2d4-8334e389d1f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF99655',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 100525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-30',
 'seller_name': None,
 'title': 'Audi A3 Limousine 35 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF99655%27 HTTP/1.1" 200 None
2026-03-27 11:16:30 [auto1.de] INFO: Saving data for MF99655: {'auction_closing_time': 1774630750.0, 'created_time': 1773429474.619849, 'last_price_update_time': 1774610190.946448}
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF99655') HTTP/1.1" 204 0
2026-03-27 11:16:30 [auto1.de] INFO: Found listing with ID: VA96509
2026-03-27 11:16:30 [auto1.de] INFO: Found listing with ID: JC14398
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC14398%27 HTTP/1.1" 200 None
2026-03-27 11:16:30 [auto1.de] INFO: Scrape type for JC14398: 2
2026-03-27 11:16:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f with identifier: JC14398
2026-03-27 11:16:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f with scrape type 2
2026-03-27 11:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f with scrape type 2
2026-03-27 11:16:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f, identifier: JC14398
2026-03-27 11:16:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f with identifier: JC14398
2026-03-27 11:16:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f with identifier: JC14398
2026-03-27 11:16:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f with identifier: JC14398 to the API
2026-03-27 11:16:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-27T16:38:02Z',
 'fuel_type': 'diesel',
 'id': 'aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC14398',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 125673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-26',
 'seller_name': None,
 'title': 'BMW 5er 525d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-27 11:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC14398%27 HTTP/1.1" 200 None
2026-03-27 11:16:31 [auto1.de] INFO: Saving data for JC14398: {'auction_closing_time': 1774629482.0, 'created_time': 1773861772.827467, 'last_price_update_time': 1774610191.768048}
2026-03-27 11:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC14398') HTTP/1.1" 204 0
2026-03-27 11:16:31 [auto1.de] INFO: Channel: 24h | Page: 258 | totalHits: 10691 | hits on page: 40
2026-03-27 11:16:31 [auto1.de] INFO: Found listing with ID: XR03491
2026-03-27 11:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR03491%27 HTTP/1.1" 200 None
2026-03-27 11:16:31 [auto1.de] INFO: Scrape type for XR03491: 2
2026-03-27 11:16:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 899682ef-c254-5499-b932-e863f69dfc08 with identifier: XR03491
2026-03-27 11:16:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 899682ef-c254-5499-b932-e863f69dfc08 with scrape type 2
2026-03-27 11:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 899682ef-c254-5499-b932-e863f69dfc08 with scrape type 2
2026-03-27 11:16:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 899682ef-c254-5499-b932-e863f69dfc08, identifier: XR03491
2026-03-27 11:16:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 899682ef-c254-5499-b932-e863f69dfc08 with identifier: XR03491
2026-03-27 11:16:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 899682ef-c254-5499-b932-e863f69dfc08 with identifier: XR03491
2026-03-27 11:16:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 899682ef-c254-5499-b932-e863f69dfc08 with identifier: XR03491 to the API
2026-03-27 11:16:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-27T16:40:31Z',
 'fuel_type': 'petrol',
 'id': '899682ef-c254-5499-b932-e863f69dfc08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR03491',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 83508,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-15',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-27 11:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR03491%27 HTTP/1.1" 200 None
2026-03-27 11:16:32 [auto1.de] INFO: Saving data for XR03491: {'auction_closing_time': 1774629631.0, 'created_time': 1774035527.929562, 'last_price_update_time': 1774610192.357335}
2026-03-27 11:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR03491') HTTP/1.1" 204 0
2026-03-27 11:16:32 [auto1.de] INFO: Found listing with ID: MN48285
2026-03-27 11:16:32 [auto1.de] INFO: Found listing with ID: YS52920
2026-03-27 11:16:32 [auto1.de] INFO: Found listing with ID: BR02529
2026-03-27 11:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02529%27 HTTP/1.1" 200 None
2026-03-27 11:16:32 [auto1.de] INFO: Scrape type for BR02529: 2
2026-03-27 11:16:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 919a610f-0423-5d5d-88ba-e207de3af9ba with identifier: BR02529
2026-03-27 11:16:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 919a610f-0423-5d5d-88ba-e207de3af9ba with scrape type 2
2026-03-27 11:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 919a610f-0423-5d5d-88ba-e207de3af9ba with scrape type 2
2026-03-27 11:16:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 919a610f-0423-5d5d-88ba-e207de3af9ba, identifier: BR02529
2026-03-27 11:16:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:16:32 [auto1.de] INFO: Found listing with ID: DV40482
2026-03-27 11:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV40482%27 HTTP/1.1" 200 None
2026-03-27 11:16:32 [auto1.de] INFO: Scrape type for DV40482: 2
2026-03-27 11:16:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b33532ed-a453-51fc-9477-ddf7a51c9373 with identifier: DV40482
2026-03-27 11:16:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b33532ed-a453-51fc-9477-ddf7a51c9373 with scrape type 2
2026-03-27 11:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b33532ed-a453-51fc-9477-ddf7a51c9373 with scrape type 2
2026-03-27 11:16:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b33532ed-a453-51fc-9477-ddf7a51c9373, identifier: DV40482
2026-03-27 11:16:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 919a610f-0423-5d5d-88ba-e207de3af9ba with identifier: BR02529
2026-03-27 11:16:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 919a610f-0423-5d5d-88ba-e207de3af9ba with identifier: BR02529
2026-03-27 11:16:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 919a610f-0423-5d5d-88ba-e207de3af9ba with identifier: BR02529 to the API
2026-03-27 11:16:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-27T16:37:15Z',
 'fuel_type': 'diesel',
 'id': '919a610f-0423-5d5d-88ba-e207de3af9ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR02529',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 198985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-25',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'manual',
 'trim': 'RS',
 'year': 2015}
2026-03-27 11:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02529%27 HTTP/1.1" 200 None
2026-03-27 11:16:33 [auto1.de] INFO: Saving data for BR02529: {'auction_closing_time': 1774629435.0, 'created_time': 1773428791.887474, 'last_price_update_time': 1774610193.097746}
2026-03-27 11:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR02529') HTTP/1.1" 204 0
2026-03-27 11:16:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b33532ed-a453-51fc-9477-ddf7a51c9373 with identifier: DV40482
2026-03-27 11:16:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b33532ed-a453-51fc-9477-ddf7a51c9373 with identifier: DV40482
2026-03-27 11:16:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b33532ed-a453-51fc-9477-ddf7a51c9373 with identifier: DV40482 to the API
2026-03-27 11:16:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-27T16:37:16Z',
 'fuel_type': 'petrol',
 'id': 'b33532ed-a453-51fc-9477-ddf7a51c9373',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV40482',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '407',
 'odometer': 168257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-30',
 'seller_name': None,
 'title': 'Peugeot 407 2.0 Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2005}
2026-03-27 11:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV40482%27 HTTP/1.1" 200 None
2026-03-27 11:16:33 [auto1.de] INFO: Saving data for DV40482: {'auction_closing_time': 1774629436.0, 'created_time': 1774033885.275249, 'last_price_update_time': 1774610193.472638}
2026-03-27 11:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV40482') HTTP/1.1" 204 0
2026-03-27 11:16:33 [auto1.de] INFO: Found listing with ID: BR45511
2026-03-27 11:16:33 [auto1.de] INFO: Found listing with ID: PK47596
2026-03-27 11:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK47596%27 HTTP/1.1" 200 None
2026-03-27 11:16:33 [auto1.de] INFO: Scrape type for PK47596: 2
2026-03-27 11:16:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baab9b2f-039a-52fb-abf3-07c3f721100b with identifier: PK47596
2026-03-27 11:16:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baab9b2f-039a-52fb-abf3-07c3f721100b with scrape type 2
2026-03-27 11:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item baab9b2f-039a-52fb-abf3-07c3f721100b with scrape type 2
2026-03-27 11:16:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: baab9b2f-039a-52fb-abf3-07c3f721100b, identifier: PK47596
2026-03-27 11:16:33 [auto1.de] INFO: Found listing with ID: GZ66698
2026-03-27 11:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ66698%27 HTTP/1.1" 200 None
2026-03-27 11:16:33 [auto1.de] INFO: Scrape type for GZ66698: 2
2026-03-27 11:16:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4598c9c4-cba5-5b19-8a51-f17a4ba0d396 with identifier: GZ66698
2026-03-27 11:16:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4598c9c4-cba5-5b19-8a51-f17a4ba0d396 with scrape type 2
2026-03-27 11:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4598c9c4-cba5-5b19-8a51-f17a4ba0d396 with scrape type 2
2026-03-27 11:16:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4598c9c4-cba5-5b19-8a51-f17a4ba0d396, identifier: GZ66698
2026-03-27 11:16:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: baab9b2f-039a-52fb-abf3-07c3f721100b with identifier: PK47596
2026-03-27 11:16:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: baab9b2f-039a-52fb-abf3-07c3f721100b with identifier: PK47596
2026-03-27 11:16:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: baab9b2f-039a-52fb-abf3-07c3f721100b with identifier: PK47596 to the API
2026-03-27 11:16:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-27T16:15:42Z',
 'fuel_type': 'petrol',
 'id': 'baab9b2f-039a-52fb-abf3-07c3f721100b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK47596',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 137780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-08',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2011}
2026-03-27 11:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK47596%27 HTTP/1.1" 200 None
2026-03-27 11:16:34 [auto1.de] INFO: Saving data for PK47596: {'auction_closing_time': 1774628142.0, 'created_time': 1773382550.999582, 'last_price_update_time': 1774610194.056753}
2026-03-27 11:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK47596') HTTP/1.1" 204 0
2026-03-27 11:16:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4598c9c4-cba5-5b19-8a51-f17a4ba0d396 with identifier: GZ66698
2026-03-27 11:16:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4598c9c4-cba5-5b19-8a51-f17a4ba0d396 with identifier: GZ66698
2026-03-27 11:16:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4598c9c4-cba5-5b19-8a51-f17a4ba0d396 with identifier: GZ66698 to the API
2026-03-27 11:16:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-27T16:14:44Z',
 'fuel_type': 'petrol',
 'id': '4598c9c4-cba5-5b19-8a51-f17a4ba0d396',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ66698',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 173712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-29',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-27 11:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ66698%27 HTTP/1.1" 200 None
2026-03-27 11:16:34 [auto1.de] INFO: Saving data for GZ66698: {'auction_closing_time': 1774628084.0, 'created_time': 1772728733.649049, 'last_price_update_time': 1774610194.391716}
2026-03-27 11:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ66698') HTTP/1.1" 204 0
2026-03-27 11:16:34 [auto1.de] INFO: Found listing with ID: ZN11262
2026-03-27 11:16:34 [auto1.de] INFO: Found listing with ID: PT66900
2026-03-27 11:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT66900%27 HTTP/1.1" 200 None
2026-03-27 11:16:34 [auto1.de] INFO: Scrape type for PT66900: 2
2026-03-27 11:16:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7066d314-3649-51ae-a7f8-aad35ba14b02 with identifier: PT66900
2026-03-27 11:16:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7066d314-3649-51ae-a7f8-aad35ba14b02 with scrape type 2
2026-03-27 11:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7066d314-3649-51ae-a7f8-aad35ba14b02 with scrape type 2
2026-03-27 11:16:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7066d314-3649-51ae-a7f8-aad35ba14b02, identifier: PT66900
2026-03-27 11:16:34 [auto1.de] INFO: Found listing with ID: NC31400
2026-03-27 11:16:34 [auto1.de] INFO: Found listing with ID: ZA98026
2026-03-27 11:16:34 [auto1.de] INFO: Found listing with ID: KL26301
2026-03-27 11:16:34 [auto1.de] INFO: Found listing with ID: MN48285
2026-03-27 11:16:34 [auto1.de] INFO: Found listing with ID: YS52920
2026-03-27 11:16:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7066d314-3649-51ae-a7f8-aad35ba14b02 with identifier: PT66900
2026-03-27 11:16:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7066d314-3649-51ae-a7f8-aad35ba14b02 with identifier: PT66900
2026-03-27 11:16:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7066d314-3649-51ae-a7f8-aad35ba14b02 with identifier: PT66900 to the API
2026-03-27 11:16:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-27T16:21:38Z',
 'fuel_type': 'petrol',
 'id': '7066d314-3649-51ae-a7f8-aad35ba14b02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT66900',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 19834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-11',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS',
 'transmission': 'manual',
 'trim': 'GS',
 'year': 2025}
2026-03-27 11:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT66900%27 HTTP/1.1" 200 None
2026-03-27 11:16:34 [auto1.de] INFO: Saving data for PT66900: {'auction_closing_time': 1774628498.0, 'created_time': 1774522321.145503, 'last_price_update_time': 1774610194.861308}
2026-03-27 11:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT66900') HTTP/1.1" 204 0
2026-03-27 11:16:34 [auto1.de] INFO: Found listing with ID: PC67993
2026-03-27 11:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC67993%27 HTTP/1.1" 200 None
2026-03-27 11:16:35 [auto1.de] INFO: Scrape type for PC67993: 2
2026-03-27 11:16:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a9dd63b-601b-58b1-8d37-652a2b0e1343 with identifier: PC67993
2026-03-27 11:16:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a9dd63b-601b-58b1-8d37-652a2b0e1343 with scrape type 2
2026-03-27 11:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a9dd63b-601b-58b1-8d37-652a2b0e1343 with scrape type 2
2026-03-27 11:16:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a9dd63b-601b-58b1-8d37-652a2b0e1343, identifier: PC67993
2026-03-27 11:16:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a9dd63b-601b-58b1-8d37-652a2b0e1343 with identifier: PC67993
2026-03-27 11:16:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a9dd63b-601b-58b1-8d37-652a2b0e1343 with identifier: PC67993
2026-03-27 11:16:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a9dd63b-601b-58b1-8d37-652a2b0e1343 with identifier: PC67993 to the API
2026-03-27 11:16:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:04:27Z',
 'fuel_type': 'petrol',
 'id': '4a9dd63b-601b-58b1-8d37-652a2b0e1343',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC67993',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 122839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-22',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-27 11:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC67993%27 HTTP/1.1" 200 None
2026-03-27 11:16:35 [auto1.de] INFO: Saving data for PC67993: {'auction_closing_time': 1774627467.0, 'created_time': 1773426946.145049, 'last_price_update_time': 1774610195.406511}
2026-03-27 11:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC67993') HTTP/1.1" 204 0
2026-03-27 11:16:35 [auto1.de] INFO: Found listing with ID: EC79499
2026-03-27 11:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC79499%27 HTTP/1.1" 200 None
2026-03-27 11:16:35 [auto1.de] INFO: Scrape type for EC79499: 2
2026-03-27 11:16:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 017920df-c4ca-50ce-aed5-5ece6de669f9 with identifier: EC79499
2026-03-27 11:16:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 017920df-c4ca-50ce-aed5-5ece6de669f9 with scrape type 2
2026-03-27 11:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 017920df-c4ca-50ce-aed5-5ece6de669f9 with scrape type 2
2026-03-27 11:16:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 017920df-c4ca-50ce-aed5-5ece6de669f9, identifier: EC79499
2026-03-27 11:16:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 017920df-c4ca-50ce-aed5-5ece6de669f9 with identifier: EC79499
2026-03-27 11:16:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 017920df-c4ca-50ce-aed5-5ece6de669f9 with identifier: EC79499
2026-03-27 11:16:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 017920df-c4ca-50ce-aed5-5ece6de669f9 with identifier: EC79499 to the API
2026-03-27 11:16:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-27T16:01:06Z',
 'fuel_type': 'diesel',
 'id': '017920df-c4ca-50ce-aed5-5ece6de669f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC79499',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 12092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-16',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid T',
 'transmission': 'automatic',
 'trim': 'T',
 'year': 2023}
2026-03-27 11:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC79499%27 HTTP/1.1" 200 None
2026-03-27 11:16:35 [auto1.de] INFO: Saving data for EC79499: {'auction_closing_time': 1774627266.0, 'created_time': 1774522322.973769, 'last_price_update_time': 1774610195.860703}
2026-03-27 11:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC79499') HTTP/1.1" 204 0
2026-03-27 11:16:35 [auto1.de] INFO: Found listing with ID: AH96089
2026-03-27 11:16:35 [auto1.de] INFO: Found listing with ID: AF84640
2026-03-27 11:16:35 [auto1.de] INFO: Found listing with ID: ZP33674
2026-03-27 11:16:35 [auto1.de] INFO: Found listing with ID: PW24553
2026-03-27 11:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW24553%27 HTTP/1.1" 200 None
2026-03-27 11:16:35 [auto1.de] INFO: Scrape type for PW24553: 2
2026-03-27 11:16:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 720434b4-fd12-53b1-8b8b-e86fb2d369b3 with identifier: PW24553
2026-03-27 11:16:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 720434b4-fd12-53b1-8b8b-e86fb2d369b3 with scrape type 2
2026-03-27 11:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 720434b4-fd12-53b1-8b8b-e86fb2d369b3 with scrape type 2
2026-03-27 11:16:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 720434b4-fd12-53b1-8b8b-e86fb2d369b3, identifier: PW24553
2026-03-27 11:16:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 720434b4-fd12-53b1-8b8b-e86fb2d369b3 with identifier: PW24553
2026-03-27 11:16:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 720434b4-fd12-53b1-8b8b-e86fb2d369b3 with identifier: PW24553
2026-03-27 11:16:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 720434b4-fd12-53b1-8b8b-e86fb2d369b3 with identifier: PW24553 to the API
2026-03-27 11:16:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:28:03Z',
 'fuel_type': 'diesel',
 'id': '720434b4-fd12-53b1-8b8b-e86fb2d369b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW24553',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 311732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-26',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.3 JTD Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2009}
2026-03-27 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW24553%27 HTTP/1.1" 200 None
2026-03-27 11:16:36 [auto1.de] INFO: Saving data for PW24553: {'auction_closing_time': 1774628883.0, 'created_time': 1774034001.452598, 'last_price_update_time': 1774610196.344294}
2026-03-27 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW24553') HTTP/1.1" 204 0
2026-03-27 11:16:36 [auto1.de] INFO: Found listing with ID: NV55491
2026-03-27 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV55491%27 HTTP/1.1" 200 None
2026-03-27 11:16:36 [auto1.de] INFO: Scrape type for NV55491: 2
2026-03-27 11:16:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3730c216-94c7-5629-a368-98b5f8f9c004 with identifier: NV55491
2026-03-27 11:16:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3730c216-94c7-5629-a368-98b5f8f9c004 with scrape type 2
2026-03-27 11:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3730c216-94c7-5629-a368-98b5f8f9c004 with scrape type 2
2026-03-27 11:16:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3730c216-94c7-5629-a368-98b5f8f9c004, identifier: NV55491
2026-03-27 11:16:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3730c216-94c7-5629-a368-98b5f8f9c004 with identifier: NV55491
2026-03-27 11:16:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3730c216-94c7-5629-a368-98b5f8f9c004 with identifier: NV55491
2026-03-27 11:16:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3730c216-94c7-5629-a368-98b5f8f9c004 with identifier: NV55491 to the API
2026-03-27 11:16:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:02:20Z',
 'fuel_type': 'petrol',
 'id': '3730c216-94c7-5629-a368-98b5f8f9c004',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV55491',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 59975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2019}
2026-03-27 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV55491%27 HTTP/1.1" 200 None
2026-03-27 11:16:36 [auto1.de] INFO: Saving data for NV55491: {'auction_closing_time': 1774627340.0, 'created_time': 1773426927.878645, 'last_price_update_time': 1774610196.786465}
2026-03-27 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV55491') HTTP/1.1" 204 0
2026-03-27 11:16:36 [auto1.de] INFO: Found listing with ID: BW06132
2026-03-27 11:16:36 [auto1.de] INFO: Found listing with ID: DE35783
2026-03-27 11:16:36 [auto1.de] INFO: Found listing with ID: DM54367
2026-03-27 11:16:36 [auto1.de] INFO: Found listing with ID: GZ29273
2026-03-27 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ29273%27 HTTP/1.1" 200 None
2026-03-27 11:16:36 [auto1.de] INFO: Scrape type for GZ29273: 2
2026-03-27 11:16:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c38b3cea-9a6f-505c-b1bf-316318f42f2d with identifier: GZ29273
2026-03-27 11:16:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c38b3cea-9a6f-505c-b1bf-316318f42f2d with scrape type 2
2026-03-27 11:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c38b3cea-9a6f-505c-b1bf-316318f42f2d with scrape type 2
2026-03-27 11:16:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c38b3cea-9a6f-505c-b1bf-316318f42f2d, identifier: GZ29273
2026-03-27 11:16:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c38b3cea-9a6f-505c-b1bf-316318f42f2d with identifier: GZ29273
2026-03-27 11:16:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c38b3cea-9a6f-505c-b1bf-316318f42f2d with identifier: GZ29273
2026-03-27 11:16:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c38b3cea-9a6f-505c-b1bf-316318f42f2d with identifier: GZ29273 to the API
2026-03-27 11:16:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-27T16:50:23Z',
 'fuel_type': 'diesel',
 'id': 'c38b3cea-9a6f-505c-b1bf-316318f42f2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ29273',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 112275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-26',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2016}
2026-03-27 11:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ29273%27 HTTP/1.1" 200 None
2026-03-27 11:16:37 [auto1.de] INFO: Saving data for GZ29273: {'auction_closing_time': 1774630223.0, 'created_time': 1774522350.299571, 'last_price_update_time': 1774610197.232832}
2026-03-27 11:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ29273') HTTP/1.1" 204 0
2026-03-27 11:16:37 [auto1.de] INFO: Found listing with ID: BS49761
2026-03-27 11:16:37 [auto1.de] INFO: Found listing with ID: HY08427
2026-03-27 11:16:37 [auto1.de] INFO: Found listing with ID: NF88064
2026-03-27 11:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF88064%27 HTTP/1.1" 200 None
2026-03-27 11:16:37 [auto1.de] INFO: Scrape type for NF88064: 2
2026-03-27 11:16:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92de2b6d-5010-5db3-ad16-9b4571e94f00 with identifier: NF88064
2026-03-27 11:16:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92de2b6d-5010-5db3-ad16-9b4571e94f00 with scrape type 2
2026-03-27 11:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92de2b6d-5010-5db3-ad16-9b4571e94f00 with scrape type 2
2026-03-27 11:16:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92de2b6d-5010-5db3-ad16-9b4571e94f00, identifier: NF88064
2026-03-27 11:16:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92de2b6d-5010-5db3-ad16-9b4571e94f00 with identifier: NF88064
2026-03-27 11:16:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92de2b6d-5010-5db3-ad16-9b4571e94f00 with identifier: NF88064
2026-03-27 11:16:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92de2b6d-5010-5db3-ad16-9b4571e94f00 with identifier: NF88064 to the API
2026-03-27 11:16:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-27T16:51:53Z',
 'fuel_type': 'petrol',
 'id': '92de2b6d-5010-5db3-ad16-9b4571e94f00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF88064',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 142808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-08',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TSI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2018}
2026-03-27 11:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF88064%27 HTTP/1.1" 200 None
2026-03-27 11:16:37 [auto1.de] INFO: Saving data for NF88064: {'auction_closing_time': 1774630313.0, 'created_time': 1773381630.819834, 'last_price_update_time': 1774610197.774366}
2026-03-27 11:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF88064') HTTP/1.1" 204 0
2026-03-27 11:16:37 [auto1.de] INFO: Found listing with ID: MP44977
2026-03-27 11:16:37 [auto1.de] INFO: Found listing with ID: EG77695
2026-03-27 11:16:37 [auto1.de] INFO: Found listing with ID: DJ81890
2026-03-27 11:16:37 [auto1.de] INFO: Found listing with ID: PU08613
2026-03-27 11:16:37 [auto1.de] INFO: Found listing with ID: VS80969
2026-03-27 11:16:37 [auto1.de] INFO: Found listing with ID: YD66830
2026-03-27 11:16:37 [auto1.de] INFO: Found listing with ID: SG38319
2026-03-27 11:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG38319%27 HTTP/1.1" 200 None
2026-03-27 11:16:37 [auto1.de] INFO: Scrape type for SG38319: 0
2026-03-27 11:16:37 [auto1.de] INFO: Found listing with ID: BJ03735
2026-03-27 11:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ03735%27 HTTP/1.1" 200 None
2026-03-27 11:16:37 [auto1.de] INFO: Scrape type for BJ03735: 2
2026-03-27 11:16:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04a1e422-a5cd-5456-8399-66876d1c76e0 with identifier: BJ03735
2026-03-27 11:16:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04a1e422-a5cd-5456-8399-66876d1c76e0 with scrape type 2
2026-03-27 11:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04a1e422-a5cd-5456-8399-66876d1c76e0 with scrape type 2
2026-03-27 11:16:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04a1e422-a5cd-5456-8399-66876d1c76e0, identifier: BJ03735
2026-03-27 11:16:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04a1e422-a5cd-5456-8399-66876d1c76e0 with identifier: BJ03735
2026-03-27 11:16:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04a1e422-a5cd-5456-8399-66876d1c76e0 with identifier: BJ03735
2026-03-27 11:16:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04a1e422-a5cd-5456-8399-66876d1c76e0 with identifier: BJ03735 to the API
2026-03-27 11:16:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:53:13Z',
 'fuel_type': 'diesel',
 'id': '04a1e422-a5cd-5456-8399-66876d1c76e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ03735',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 391418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-30',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Standard',
 'transmission': 'manual',
 'trim': 'Standard',
 'year': 2007}
2026-03-27 11:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ03735%27 HTTP/1.1" 200 None
2026-03-27 11:16:38 [auto1.de] INFO: Saving data for BJ03735: {'auction_closing_time': 1774630393.0, 'created_time': 1774001921.519897, 'last_price_update_time': 1774610198.248777}
2026-03-27 11:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ03735') HTTP/1.1" 204 0
2026-03-27 11:16:38 [auto1.de] INFO: Found listing with ID: UK63954
2026-03-27 11:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK63954%27 HTTP/1.1" 200 None
2026-03-27 11:16:38 [auto1.de] INFO: Scrape type for UK63954: 2
2026-03-27 11:16:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fed63697-20ff-502a-a518-a6e3ed065080 with identifier: UK63954
2026-03-27 11:16:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fed63697-20ff-502a-a518-a6e3ed065080 with scrape type 2
2026-03-27 11:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fed63697-20ff-502a-a518-a6e3ed065080 with scrape type 2
2026-03-27 11:16:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fed63697-20ff-502a-a518-a6e3ed065080, identifier: UK63954
2026-03-27 11:16:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fed63697-20ff-502a-a518-a6e3ed065080 with identifier: UK63954
2026-03-27 11:16:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fed63697-20ff-502a-a518-a6e3ed065080 with identifier: UK63954
2026-03-27 11:16:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fed63697-20ff-502a-a518-a6e3ed065080 with identifier: UK63954 to the API
2026-03-27 11:16:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-27T16:50:46Z',
 'fuel_type': 'diesel',
 'id': 'fed63697-20ff-502a-a518-a6e3ed065080',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK63954',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 156224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-27',
 'seller_name': None,
 'title': 'BMW 5er 540d xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2018}
2026-03-27 11:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK63954%27 HTTP/1.1" 200 None
2026-03-27 11:16:38 [auto1.de] INFO: Saving data for UK63954: {'auction_closing_time': 1774630246.0, 'created_time': 1774522466.489692, 'last_price_update_time': 1774610198.789724}
2026-03-27 11:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK63954') HTTP/1.1" 204 0
2026-03-27 11:16:38 [auto1.de] INFO: Found listing with ID: KV18345
2026-03-27 11:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV18345%27 HTTP/1.1" 200 None
2026-03-27 11:16:38 [auto1.de] INFO: Scrape type for KV18345: 2
2026-03-27 11:16:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7061eccb-bcde-5f92-8794-faa4bd88fcc5 with identifier: KV18345
2026-03-27 11:16:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7061eccb-bcde-5f92-8794-faa4bd88fcc5 with scrape type 2
2026-03-27 11:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7061eccb-bcde-5f92-8794-faa4bd88fcc5 with scrape type 2
2026-03-27 11:16:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7061eccb-bcde-5f92-8794-faa4bd88fcc5, identifier: KV18345
2026-03-27 11:16:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:16:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7061eccb-bcde-5f92-8794-faa4bd88fcc5 with identifier: KV18345
2026-03-27 11:16:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7061eccb-bcde-5f92-8794-faa4bd88fcc5 with identifier: KV18345
2026-03-27 11:16:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7061eccb-bcde-5f92-8794-faa4bd88fcc5 with identifier: KV18345 to the API
2026-03-27 11:16:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-27T16:08:28Z',
 'fuel_type': 'petrol',
 'id': '7061eccb-bcde-5f92-8794-faa4bd88fcc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV18345',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 109253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-07',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2016}
2026-03-27 11:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV18345%27 HTTP/1.1" 200 None
2026-03-27 11:16:39 [auto1.de] INFO: Saving data for KV18345: {'auction_closing_time': 1774627708.0, 'created_time': 1773400237.049561, 'last_price_update_time': 1774610199.233299}
2026-03-27 11:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV18345') HTTP/1.1" 204 0
2026-03-27 11:16:39 [auto1.de] INFO: Found listing with ID: FT81619
2026-03-27 11:16:39 [auto1.de] INFO: Found listing with ID: AW26108
2026-03-27 11:16:39 [auto1.de] INFO: Found listing with ID: GV67460
2026-03-27 11:16:39 [auto1.de] INFO: Found listing with ID: LN92590
2026-03-27 11:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN92590%27 HTTP/1.1" 200 None
2026-03-27 11:16:39 [auto1.de] INFO: Scrape type for LN92590: 2
2026-03-27 11:16:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b90e1bb0-d68d-51ed-81fd-a660fe52cdf9 with identifier: LN92590
2026-03-27 11:16:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b90e1bb0-d68d-51ed-81fd-a660fe52cdf9 with scrape type 2
2026-03-27 11:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b90e1bb0-d68d-51ed-81fd-a660fe52cdf9 with scrape type 2
2026-03-27 11:16:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b90e1bb0-d68d-51ed-81fd-a660fe52cdf9, identifier: LN92590
2026-03-27 11:16:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b90e1bb0-d68d-51ed-81fd-a660fe52cdf9 with identifier: LN92590
2026-03-27 11:16:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b90e1bb0-d68d-51ed-81fd-a660fe52cdf9 with identifier: LN92590
2026-03-27 11:16:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b90e1bb0-d68d-51ed-81fd-a660fe52cdf9 with identifier: LN92590 to the API
2026-03-27 11:16:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-27T16:56:18Z',
 'fuel_type': 'diesel',
 'id': 'b90e1bb0-d68d-51ed-81fd-a660fe52cdf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN92590',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 259899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-01',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Individual',
 'transmission': 'automatic',
 'trim': 'Individual',
 'year': 2016}
2026-03-27 11:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN92590%27 HTTP/1.1" 200 None
2026-03-27 11:16:39 [auto1.de] INFO: Saving data for LN92590: {'auction_closing_time': 1774630578.0, 'created_time': 1774522519.204727, 'last_price_update_time': 1774610199.690029}
2026-03-27 11:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN92590') HTTP/1.1" 204 0
2026-03-27 11:16:39 [auto1.de] INFO: Found listing with ID: KZ47858
2026-03-27 11:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ47858%27 HTTP/1.1" 200 None
2026-03-27 11:16:39 [auto1.de] INFO: Scrape type for KZ47858: 2
2026-03-27 11:16:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d with identifier: KZ47858
2026-03-27 11:16:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d with scrape type 2
2026-03-27 11:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d with scrape type 2
2026-03-27 11:16:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d, identifier: KZ47858
2026-03-27 11:16:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d with identifier: KZ47858
2026-03-27 11:16:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d with identifier: KZ47858
2026-03-27 11:16:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d with identifier: KZ47858 to the API
2026-03-27 11:16:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:52:23Z',
 'fuel_type': 'petrol',
 'id': '2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ47858',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 213087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-27 11:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ47858%27 HTTP/1.1" 200 None
2026-03-27 11:16:40 [auto1.de] INFO: Saving data for KZ47858: {'auction_closing_time': 1774630343.0, 'created_time': 1773341316.25608, 'last_price_update_time': 1774610200.10145}
2026-03-27 11:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ47858') HTTP/1.1" 204 0
2026-03-27 11:16:40 [auto1.de] INFO: Channel: 24h | Page: 259 | totalHits: 10691 | hits on page: 40
2026-03-27 11:16:40 [auto1.de] INFO: Found listing with ID: MM04684
2026-03-27 11:16:40 [auto1.de] INFO: Found listing with ID: ZC74579
2026-03-27 11:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC74579%27 HTTP/1.1" 200 None
2026-03-27 11:16:40 [auto1.de] INFO: Scrape type for ZC74579: 2
2026-03-27 11:16:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d101a3f-2f4d-589b-a54e-e053addbf7af with identifier: ZC74579
2026-03-27 11:16:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d101a3f-2f4d-589b-a54e-e053addbf7af with scrape type 2
2026-03-27 11:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d101a3f-2f4d-589b-a54e-e053addbf7af with scrape type 2
2026-03-27 11:16:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d101a3f-2f4d-589b-a54e-e053addbf7af, identifier: ZC74579
2026-03-27 11:16:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d101a3f-2f4d-589b-a54e-e053addbf7af with identifier: ZC74579
2026-03-27 11:16:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d101a3f-2f4d-589b-a54e-e053addbf7af with identifier: ZC74579
2026-03-27 11:16:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d101a3f-2f4d-589b-a54e-e053addbf7af with identifier: ZC74579 to the API
2026-03-27 11:16:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:10:14Z',
 'fuel_type': 'diesel',
 'id': '8d101a3f-2f4d-589b-a54e-e053addbf7af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC74579',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 87250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-14',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-27 11:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC74579%27 HTTP/1.1" 200 None
2026-03-27 11:16:40 [auto1.de] INFO: Saving data for ZC74579: {'auction_closing_time': 1774627814.0, 'created_time': 1774522358.07144, 'last_price_update_time': 1774610200.55228}
2026-03-27 11:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC74579') HTTP/1.1" 204 0
2026-03-27 11:16:40 [auto1.de] INFO: Found listing with ID: JE00015
2026-03-27 11:16:40 [auto1.de] INFO: Found listing with ID: VK29322
2026-03-27 11:16:40 [auto1.de] INFO: Found listing with ID: CC27418
2026-03-27 11:16:40 [auto1.de] INFO: Found listing with ID: AP34925
2026-03-27 11:16:40 [auto1.de] INFO: Found listing with ID: GJ26621
2026-03-27 11:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ26621%27 HTTP/1.1" 200 None
2026-03-27 11:16:40 [auto1.de] INFO: Scrape type for GJ26621: 2
2026-03-27 11:16:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 319f1e69-4a71-5eb0-ba79-cf27219264b2 with identifier: GJ26621
2026-03-27 11:16:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 319f1e69-4a71-5eb0-ba79-cf27219264b2 with scrape type 2
2026-03-27 11:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 319f1e69-4a71-5eb0-ba79-cf27219264b2 with scrape type 2
2026-03-27 11:16:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 319f1e69-4a71-5eb0-ba79-cf27219264b2, identifier: GJ26621
2026-03-27 11:16:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:16:40 [auto1.de] INFO: Found listing with ID: ZC46474
2026-03-27 11:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC46474%27 HTTP/1.1" 200 None
2026-03-27 11:16:40 [auto1.de] INFO: Scrape type for ZC46474: 2
2026-03-27 11:16:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47fe68f0-819e-5086-ae22-e304773452dc with identifier: ZC46474
2026-03-27 11:16:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47fe68f0-819e-5086-ae22-e304773452dc with scrape type 2
2026-03-27 11:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47fe68f0-819e-5086-ae22-e304773452dc with scrape type 2
2026-03-27 11:16:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47fe68f0-819e-5086-ae22-e304773452dc, identifier: ZC46474
2026-03-27 11:16:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 319f1e69-4a71-5eb0-ba79-cf27219264b2 with identifier: GJ26621
2026-03-27 11:16:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 319f1e69-4a71-5eb0-ba79-cf27219264b2 with identifier: GJ26621
2026-03-27 11:16:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 319f1e69-4a71-5eb0-ba79-cf27219264b2 with identifier: GJ26621 to the API
2026-03-27 11:16:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:34:38Z',
 'fuel_type': 'petrol',
 'id': '319f1e69-4a71-5eb0-ba79-cf27219264b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ26621',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 158933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-04',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Rip Curl',
 'transmission': 'manual',
 'trim': 'Rip Curl',
 'year': 2007}
2026-03-27 11:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ26621%27 HTTP/1.1" 200 None
2026-03-27 11:16:41 [auto1.de] INFO: Saving data for GJ26621: {'auction_closing_time': 1774629278.0, 'created_time': 1773428533.767207, 'last_price_update_time': 1774610201.225639}
2026-03-27 11:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ26621') HTTP/1.1" 204 0
2026-03-27 11:16:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47fe68f0-819e-5086-ae22-e304773452dc with identifier: ZC46474
2026-03-27 11:16:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47fe68f0-819e-5086-ae22-e304773452dc with identifier: ZC46474
2026-03-27 11:16:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47fe68f0-819e-5086-ae22-e304773452dc with identifier: ZC46474 to the API
2026-03-27 11:16:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-27T16:02:25Z',
 'fuel_type': 'petrol',
 'id': '47fe68f0-819e-5086-ae22-e304773452dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC46474',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 201684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-27',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 Futura X',
 'transmission': 'manual',
 'trim': 'Futura X',
 'year': 2006}
2026-03-27 11:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC46474%27 HTTP/1.1" 200 None
2026-03-27 11:16:41 [auto1.de] INFO: Saving data for ZC46474: {'auction_closing_time': 1774627345.0, 'created_time': 1774034542.096155, 'last_price_update_time': 1774610201.665144}
2026-03-27 11:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC46474') HTTP/1.1" 204 0
2026-03-27 11:16:41 [auto1.de] INFO: Found listing with ID: WZ86962
2026-03-27 11:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ86962%27 HTTP/1.1" 200 None
2026-03-27 11:16:41 [auto1.de] INFO: Scrape type for WZ86962: 2
2026-03-27 11:16:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf87a281-581b-55a7-b337-f760e7e20505 with identifier: WZ86962
2026-03-27 11:16:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf87a281-581b-55a7-b337-f760e7e20505 with scrape type 2
2026-03-27 11:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf87a281-581b-55a7-b337-f760e7e20505 with scrape type 2
2026-03-27 11:16:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf87a281-581b-55a7-b337-f760e7e20505, identifier: WZ86962
2026-03-27 11:16:41 [auto1.de] INFO: Found listing with ID: LV09393
2026-03-27 11:16:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf87a281-581b-55a7-b337-f760e7e20505 with identifier: WZ86962
2026-03-27 11:16:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf87a281-581b-55a7-b337-f760e7e20505 with identifier: WZ86962
2026-03-27 11:16:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf87a281-581b-55a7-b337-f760e7e20505 with identifier: WZ86962 to the API
2026-03-27 11:16:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:53:37Z',
 'fuel_type': 'diesel',
 'id': 'cf87a281-581b-55a7-b337-f760e7e20505',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ86962',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 150943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-03',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2022}
2026-03-27 11:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ86962%27 HTTP/1.1" 200 None
2026-03-27 11:16:42 [auto1.de] INFO: Saving data for WZ86962: {'auction_closing_time': 1774630417.0, 'created_time': 1773427330.107369, 'last_price_update_time': 1774610202.157767}
2026-03-27 11:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ86962') HTTP/1.1" 204 0
2026-03-27 11:16:42 [auto1.de] INFO: Found listing with ID: GU64592
2026-03-27 11:16:42 [auto1.de] INFO: Found listing with ID: KD53590
2026-03-27 11:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD53590%27 HTTP/1.1" 200 None
2026-03-27 11:16:42 [auto1.de] INFO: Scrape type for KD53590: 2
2026-03-27 11:16:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 272942b6-2f4b-5344-aae6-80943da4d3bf with identifier: KD53590
2026-03-27 11:16:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 272942b6-2f4b-5344-aae6-80943da4d3bf with scrape type 2
2026-03-27 11:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 272942b6-2f4b-5344-aae6-80943da4d3bf with scrape type 2
2026-03-27 11:16:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 272942b6-2f4b-5344-aae6-80943da4d3bf, identifier: KD53590
2026-03-27 11:16:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 272942b6-2f4b-5344-aae6-80943da4d3bf with identifier: KD53590
2026-03-27 11:16:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 272942b6-2f4b-5344-aae6-80943da4d3bf with identifier: KD53590
2026-03-27 11:16:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 272942b6-2f4b-5344-aae6-80943da4d3bf with identifier: KD53590 to the API
2026-03-27 11:16:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 58,
 'expiration_date': '2026-03-27T16:44:37Z',
 'fuel_type': 'petrol',
 'id': '272942b6-2f4b-5344-aae6-80943da4d3bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD53590',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 105495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-03-12',
 'seller_name': None,
 'title': 'Opel Corsa 1.0 Fresh',
 'transmission': 'manual',
 'trim': 'Fresh',
 'year': 2002}
2026-03-27 11:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD53590%27 HTTP/1.1" 200 None
2026-03-27 11:16:42 [auto1.de] INFO: Saving data for KD53590: {'auction_closing_time': 1774629877.0, 'created_time': 1774033903.950529, 'last_price_update_time': 1774610202.707907}
2026-03-27 11:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD53590') HTTP/1.1" 204 0
2026-03-27 11:16:42 [auto1.de] INFO: Found listing with ID: VH78915
2026-03-27 11:16:42 [auto1.de] INFO: Found listing with ID: YT53234
2026-03-27 11:16:42 [auto1.de] INFO: Found listing with ID: NX89323
2026-03-27 11:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX89323%27 HTTP/1.1" 200 None
2026-03-27 11:16:42 [auto1.de] INFO: Scrape type for NX89323: 2
2026-03-27 11:16:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09a0c0bf-ed2f-58d6-b33f-0d2d4d173cc9 with identifier: NX89323
2026-03-27 11:16:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09a0c0bf-ed2f-58d6-b33f-0d2d4d173cc9 with scrape type 2
2026-03-27 11:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09a0c0bf-ed2f-58d6-b33f-0d2d4d173cc9 with scrape type 2
2026-03-27 11:16:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09a0c0bf-ed2f-58d6-b33f-0d2d4d173cc9, identifier: NX89323
2026-03-27 11:16:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09a0c0bf-ed2f-58d6-b33f-0d2d4d173cc9 with identifier: NX89323
2026-03-27 11:16:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09a0c0bf-ed2f-58d6-b33f-0d2d4d173cc9 with identifier: NX89323
2026-03-27 11:16:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09a0c0bf-ed2f-58d6-b33f-0d2d4d173cc9 with identifier: NX89323 to the API
2026-03-27 11:16:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-27T16:17:04Z',
 'fuel_type': 'petrol',
 'id': '09a0c0bf-ed2f-58d6-b33f-0d2d4d173cc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX89323',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 168712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-31',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2009}
2026-03-27 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX89323%27 HTTP/1.1" 200 None
2026-03-27 11:16:43 [auto1.de] INFO: Saving data for NX89323: {'auction_closing_time': 1774628224.0, 'created_time': 1774034013.444185, 'last_price_update_time': 1774610203.155332}
2026-03-27 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX89323') HTTP/1.1" 204 0
2026-03-27 11:16:43 [auto1.de] INFO: Found listing with ID: YY05460
2026-03-27 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY05460%27 HTTP/1.1" 200 None
2026-03-27 11:16:43 [auto1.de] INFO: Scrape type for YY05460: 2
2026-03-27 11:16:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f280128-7797-549f-9758-b1c564f3987f with identifier: YY05460
2026-03-27 11:16:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f280128-7797-549f-9758-b1c564f3987f with scrape type 2
2026-03-27 11:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f280128-7797-549f-9758-b1c564f3987f with scrape type 2
2026-03-27 11:16:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f280128-7797-549f-9758-b1c564f3987f, identifier: YY05460
2026-03-27 11:16:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f280128-7797-549f-9758-b1c564f3987f with identifier: YY05460
2026-03-27 11:16:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f280128-7797-549f-9758-b1c564f3987f with identifier: YY05460
2026-03-27 11:16:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f280128-7797-549f-9758-b1c564f3987f with identifier: YY05460 to the API
2026-03-27 11:16:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-27T16:26:41Z',
 'fuel_type': 'petrol',
 'id': '9f280128-7797-549f-9758-b1c564f3987f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY05460',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 88876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'GTI BlueMotion Tech',
 'year': 2016}
2026-03-27 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY05460%27 HTTP/1.1" 200 None
2026-03-27 11:16:43 [auto1.de] INFO: Saving data for YY05460: {'auction_closing_time': 1774628801.0, 'created_time': 1774522409.421409, 'last_price_update_time': 1774610203.570505}
2026-03-27 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY05460') HTTP/1.1" 204 0
2026-03-27 11:16:43 [auto1.de] INFO: Found listing with ID: JB50627
2026-03-27 11:16:43 [auto1.de] INFO: Found listing with ID: SN89547
2026-03-27 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN89547%27 HTTP/1.1" 200 None
2026-03-27 11:16:43 [auto1.de] INFO: Scrape type for SN89547: 2
2026-03-27 11:16:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e15b47bc-3bbd-5eb8-b0c6-db0ce57a79ec with identifier: SN89547
2026-03-27 11:16:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e15b47bc-3bbd-5eb8-b0c6-db0ce57a79ec with scrape type 2
2026-03-27 11:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e15b47bc-3bbd-5eb8-b0c6-db0ce57a79ec with scrape type 2
2026-03-27 11:16:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e15b47bc-3bbd-5eb8-b0c6-db0ce57a79ec, identifier: SN89547
2026-03-27 11:16:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e15b47bc-3bbd-5eb8-b0c6-db0ce57a79ec with identifier: SN89547
2026-03-27 11:16:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e15b47bc-3bbd-5eb8-b0c6-db0ce57a79ec with identifier: SN89547
2026-03-27 11:16:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e15b47bc-3bbd-5eb8-b0c6-db0ce57a79ec with identifier: SN89547 to the API
2026-03-27 11:16:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-27T16:36:07Z',
 'fuel_type': 'diesel',
 'id': 'e15b47bc-3bbd-5eb8-b0c6-db0ce57a79ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN89547',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 145838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-07',
 'seller_name': None,
 'title': 'Audi A6 50 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2026-03-27 11:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN89547%27 HTTP/1.1" 200 None
2026-03-27 11:16:44 [auto1.de] INFO: Saving data for SN89547: {'auction_closing_time': 1774629367.0, 'created_time': 1774522320.317044, 'last_price_update_time': 1774610204.167616}
2026-03-27 11:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN89547') HTTP/1.1" 204 0
2026-03-27 11:16:44 [auto1.de] INFO: Found listing with ID: MU50288
2026-03-27 11:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU50288%27 HTTP/1.1" 200 None
2026-03-27 11:16:44 [auto1.de] INFO: Scrape type for MU50288: 2
2026-03-27 11:16:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48c2b4a3-802d-59a1-8a39-6aea083e2e61 with identifier: MU50288
2026-03-27 11:16:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48c2b4a3-802d-59a1-8a39-6aea083e2e61 with scrape type 2
2026-03-27 11:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48c2b4a3-802d-59a1-8a39-6aea083e2e61 with scrape type 2
2026-03-27 11:16:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48c2b4a3-802d-59a1-8a39-6aea083e2e61, identifier: MU50288
2026-03-27 11:16:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48c2b4a3-802d-59a1-8a39-6aea083e2e61 with identifier: MU50288
2026-03-27 11:16:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48c2b4a3-802d-59a1-8a39-6aea083e2e61 with identifier: MU50288
2026-03-27 11:16:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48c2b4a3-802d-59a1-8a39-6aea083e2e61 with identifier: MU50288 to the API
2026-03-27 11:16:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-27T16:26:59Z',
 'fuel_type': 'petrol',
 'id': '48c2b4a3-802d-59a1-8a39-6aea083e2e61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU50288',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 84113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Dacia Dokker 1.6 SCe Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2016}
2026-03-27 11:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU50288%27 HTTP/1.1" 200 None
2026-03-27 11:16:44 [auto1.de] INFO: Saving data for MU50288: {'auction_closing_time': 1774628819.0, 'created_time': 1773382817.353215, 'last_price_update_time': 1774610204.634912}
2026-03-27 11:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU50288') HTTP/1.1" 204 0
2026-03-27 11:16:44 [auto1.de] INFO: Found listing with ID: WC68946
2026-03-27 11:16:44 [auto1.de] INFO: Found listing with ID: JS09258
2026-03-27 11:16:44 [auto1.de] INFO: Found listing with ID: HW53715
2026-03-27 11:16:44 [auto1.de] INFO: Found listing with ID: LN58071
2026-03-27 11:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN58071%27 HTTP/1.1" 200 None
2026-03-27 11:16:44 [auto1.de] INFO: Scrape type for LN58071: 2
2026-03-27 11:16:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a14ae77a-a810-5a6f-a38f-55123f125b3a with identifier: LN58071
2026-03-27 11:16:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a14ae77a-a810-5a6f-a38f-55123f125b3a with scrape type 2
2026-03-27 11:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a14ae77a-a810-5a6f-a38f-55123f125b3a with scrape type 2
2026-03-27 11:16:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a14ae77a-a810-5a6f-a38f-55123f125b3a, identifier: LN58071
2026-03-27 11:16:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a14ae77a-a810-5a6f-a38f-55123f125b3a with identifier: LN58071
2026-03-27 11:16:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a14ae77a-a810-5a6f-a38f-55123f125b3a with identifier: LN58071
2026-03-27 11:16:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a14ae77a-a810-5a6f-a38f-55123f125b3a with identifier: LN58071 to the API
2026-03-27 11:16:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:46:33Z',
 'fuel_type': 'diesel',
 'id': 'a14ae77a-a810-5a6f-a38f-55123f125b3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN58071',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 132952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2022}
2026-03-27 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN58071%27 HTTP/1.1" 200 None
2026-03-27 11:16:45 [auto1.de] INFO: Saving data for LN58071: {'auction_closing_time': 1774629993.0, 'created_time': 1773381909.19982, 'last_price_update_time': 1774610205.159354}
2026-03-27 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN58071') HTTP/1.1" 204 0
2026-03-27 11:16:45 [auto1.de] INFO: Found listing with ID: KA83953
2026-03-27 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83953%27 HTTP/1.1" 200 None
2026-03-27 11:16:45 [auto1.de] INFO: Scrape type for KA83953: 2
2026-03-27 11:16:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41e5a093-2934-5d5f-b48d-ce9d9510874d with identifier: KA83953
2026-03-27 11:16:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41e5a093-2934-5d5f-b48d-ce9d9510874d with scrape type 2
2026-03-27 11:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41e5a093-2934-5d5f-b48d-ce9d9510874d with scrape type 2
2026-03-27 11:16:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41e5a093-2934-5d5f-b48d-ce9d9510874d, identifier: KA83953
2026-03-27 11:16:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41e5a093-2934-5d5f-b48d-ce9d9510874d with identifier: KA83953
2026-03-27 11:16:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41e5a093-2934-5d5f-b48d-ce9d9510874d with identifier: KA83953
2026-03-27 11:16:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41e5a093-2934-5d5f-b48d-ce9d9510874d with identifier: KA83953 to the API
2026-03-27 11:16:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:58:07Z',
 'fuel_type': 'petrol',
 'id': '41e5a093-2934-5d5f-b48d-ce9d9510874d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA83953',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 226093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-18',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-27 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83953%27 HTTP/1.1" 200 None
2026-03-27 11:16:45 [auto1.de] INFO: Saving data for KA83953: {'auction_closing_time': 1774630687.0, 'created_time': 1773381403.085771, 'last_price_update_time': 1774610205.585249}
2026-03-27 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA83953') HTTP/1.1" 204 0
2026-03-27 11:16:45 [auto1.de] INFO: Found listing with ID: MH69607
2026-03-27 11:16:45 [auto1.de] INFO: Found listing with ID: LG97713
2026-03-27 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG97713%27 HTTP/1.1" 200 None
2026-03-27 11:16:45 [auto1.de] INFO: Scrape type for LG97713: 2
2026-03-27 11:16:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b35e4167-adde-526d-894f-cb321b7beb29 with identifier: LG97713
2026-03-27 11:16:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b35e4167-adde-526d-894f-cb321b7beb29 with scrape type 2
2026-03-27 11:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b35e4167-adde-526d-894f-cb321b7beb29 with scrape type 2
2026-03-27 11:16:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b35e4167-adde-526d-894f-cb321b7beb29, identifier: LG97713
2026-03-27 11:16:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b35e4167-adde-526d-894f-cb321b7beb29 with identifier: LG97713
2026-03-27 11:16:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b35e4167-adde-526d-894f-cb321b7beb29 with identifier: LG97713
2026-03-27 11:16:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b35e4167-adde-526d-894f-cb321b7beb29 with identifier: LG97713 to the API
2026-03-27 11:16:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:16:26Z',
 'fuel_type': 'petrol',
 'id': 'b35e4167-adde-526d-894f-cb321b7beb29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG97713',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 178105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-21',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-27 11:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG97713%27 HTTP/1.1" 200 None
2026-03-27 11:16:46 [auto1.de] INFO: Saving data for LG97713: {'auction_closing_time': 1774628186.0, 'created_time': 1773383640.909864, 'last_price_update_time': 1774610206.099337}
2026-03-27 11:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG97713') HTTP/1.1" 204 0
2026-03-27 11:16:46 [auto1.de] INFO: Found listing with ID: CM53141
2026-03-27 11:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM53141%27 HTTP/1.1" 200 None
2026-03-27 11:16:46 [auto1.de] INFO: Scrape type for CM53141: 2
2026-03-27 11:16:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2510d610-bf60-580d-b089-6f452162088d with identifier: CM53141
2026-03-27 11:16:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2510d610-bf60-580d-b089-6f452162088d with scrape type 2
2026-03-27 11:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2510d610-bf60-580d-b089-6f452162088d with scrape type 2
2026-03-27 11:16:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2510d610-bf60-580d-b089-6f452162088d, identifier: CM53141
2026-03-27 11:16:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2510d610-bf60-580d-b089-6f452162088d with identifier: CM53141
2026-03-27 11:16:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2510d610-bf60-580d-b089-6f452162088d with identifier: CM53141
2026-03-27 11:16:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2510d610-bf60-580d-b089-6f452162088d with identifier: CM53141 to the API
2026-03-27 11:16:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:34:37Z',
 'fuel_type': 'petrol',
 'id': '2510d610-bf60-580d-b089-6f452162088d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM53141',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 92159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-15',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2017}
2026-03-27 11:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM53141%27 HTTP/1.1" 200 None
2026-03-27 11:16:46 [auto1.de] INFO: Saving data for CM53141: {'auction_closing_time': 1774629277.0, 'created_time': 1773381185.275353, 'last_price_update_time': 1774610206.55835}
2026-03-27 11:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM53141') HTTP/1.1" 204 0
2026-03-27 11:16:46 [auto1.de] INFO: Found listing with ID: FG57535
2026-03-27 11:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG57535%27 HTTP/1.1" 200 None
2026-03-27 11:16:46 [auto1.de] INFO: Scrape type for FG57535: 2
2026-03-27 11:16:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 670081e0-851f-5f7e-8ea5-38d9be4fadb8 with identifier: FG57535
2026-03-27 11:16:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 670081e0-851f-5f7e-8ea5-38d9be4fadb8 with scrape type 2
2026-03-27 11:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 670081e0-851f-5f7e-8ea5-38d9be4fadb8 with scrape type 2
2026-03-27 11:16:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 670081e0-851f-5f7e-8ea5-38d9be4fadb8, identifier: FG57535
2026-03-27 11:16:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 670081e0-851f-5f7e-8ea5-38d9be4fadb8 with identifier: FG57535
2026-03-27 11:16:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 670081e0-851f-5f7e-8ea5-38d9be4fadb8 with identifier: FG57535
2026-03-27 11:16:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 670081e0-851f-5f7e-8ea5-38d9be4fadb8 with identifier: FG57535 to the API
2026-03-27 11:16:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 63,
 'expiration_date': '2026-03-27T16:02:31Z',
 'fuel_type': 'petrol',
 'id': '670081e0-851f-5f7e-8ea5-38d9be4fadb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG57535',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'Demio',
 'odometer': 175185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-11-28',
 'seller_name': None,
 'title': 'Mazda Demio 1.4',
 'transmission': 'manual',
 'trim': '',
 'year': 2000}
2026-03-27 11:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG57535%27 HTTP/1.1" 200 None
2026-03-27 11:16:46 [auto1.de] INFO: Saving data for FG57535: {'auction_closing_time': 1774627351.0, 'created_time': 1774035479.151851, 'last_price_update_time': 1774610206.980701}
2026-03-27 11:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG57535') HTTP/1.1" 204 0
2026-03-27 11:16:46 [auto1.de] INFO: Found listing with ID: GC30737
2026-03-27 11:16:46 [auto1.de] INFO: Found listing with ID: RG95107
2026-03-27 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG95107%27 HTTP/1.1" 200 None
2026-03-27 11:16:47 [auto1.de] INFO: Scrape type for RG95107: 2
2026-03-27 11:16:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56a92588-96dc-568d-8b35-e12fb26e50a0 with identifier: RG95107
2026-03-27 11:16:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56a92588-96dc-568d-8b35-e12fb26e50a0 with scrape type 2
2026-03-27 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56a92588-96dc-568d-8b35-e12fb26e50a0 with scrape type 2
2026-03-27 11:16:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56a92588-96dc-568d-8b35-e12fb26e50a0, identifier: RG95107
2026-03-27 11:16:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56a92588-96dc-568d-8b35-e12fb26e50a0 with identifier: RG95107
2026-03-27 11:16:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56a92588-96dc-568d-8b35-e12fb26e50a0 with identifier: RG95107
2026-03-27 11:16:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56a92588-96dc-568d-8b35-e12fb26e50a0 with identifier: RG95107 to the API
2026-03-27 11:16:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-27T16:51:34Z',
 'fuel_type': 'petrol',
 'id': '56a92588-96dc-568d-8b35-e12fb26e50a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG95107',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 62529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-16',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-27 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG95107%27 HTTP/1.1" 200 None
2026-03-27 11:16:47 [auto1.de] INFO: Saving data for RG95107: {'auction_closing_time': 1774630294.0, 'created_time': 1773382713.457011, 'last_price_update_time': 1774610207.415919}
2026-03-27 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG95107') HTTP/1.1" 204 0
2026-03-27 11:16:47 [auto1.de] INFO: Found listing with ID: BS93461
2026-03-27 11:16:47 [auto1.de] INFO: Found listing with ID: HK22779
2026-03-27 11:16:47 [auto1.de] INFO: Found listing with ID: CM78973
2026-03-27 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM78973%27 HTTP/1.1" 200 None
2026-03-27 11:16:47 [auto1.de] INFO: Scrape type for CM78973: 2
2026-03-27 11:16:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c71af1f0-6c73-54a3-a5d1-652370f79286 with identifier: CM78973
2026-03-27 11:16:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c71af1f0-6c73-54a3-a5d1-652370f79286 with scrape type 2
2026-03-27 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c71af1f0-6c73-54a3-a5d1-652370f79286 with scrape type 2
2026-03-27 11:16:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c71af1f0-6c73-54a3-a5d1-652370f79286, identifier: CM78973
2026-03-27 11:16:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c71af1f0-6c73-54a3-a5d1-652370f79286 with identifier: CM78973
2026-03-27 11:16:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c71af1f0-6c73-54a3-a5d1-652370f79286 with identifier: CM78973
2026-03-27 11:16:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c71af1f0-6c73-54a3-a5d1-652370f79286 with identifier: CM78973 to the API
2026-03-27 11:16:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:04:47Z',
 'fuel_type': 'diesel',
 'id': 'c71af1f0-6c73-54a3-a5d1-652370f79286',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM78973',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 212016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-28',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-27 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM78973%27 HTTP/1.1" 200 None
2026-03-27 11:16:47 [auto1.de] INFO: Saving data for CM78973: {'auction_closing_time': 1774627487.0, 'created_time': 1773429234.930424, 'last_price_update_time': 1774610207.936542}
2026-03-27 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM78973') HTTP/1.1" 204 0
2026-03-27 11:16:47 [auto1.de] INFO: Found listing with ID: GH07682
2026-03-27 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH07682%27 HTTP/1.1" 200 None
2026-03-27 11:16:47 [auto1.de] INFO: Scrape type for GH07682: 2
2026-03-27 11:16:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fed9becb-58eb-5e5d-ab29-1f07305abc6e with identifier: GH07682
2026-03-27 11:16:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fed9becb-58eb-5e5d-ab29-1f07305abc6e with scrape type 2
2026-03-27 11:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fed9becb-58eb-5e5d-ab29-1f07305abc6e with scrape type 2
2026-03-27 11:16:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fed9becb-58eb-5e5d-ab29-1f07305abc6e, identifier: GH07682
2026-03-27 11:16:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fed9becb-58eb-5e5d-ab29-1f07305abc6e with identifier: GH07682
2026-03-27 11:16:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fed9becb-58eb-5e5d-ab29-1f07305abc6e with identifier: GH07682
2026-03-27 11:16:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fed9becb-58eb-5e5d-ab29-1f07305abc6e with identifier: GH07682 to the API
2026-03-27 11:16:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 440,
 'expiration_date': '2026-03-27T16:10:59Z',
 'fuel_type': 'petrol',
 'id': 'fed9becb-58eb-5e5d-ab29-1f07305abc6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH07682',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 109980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-24',
 'seller_name': None,
 'title': 'Porsche Cayenne GTS',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-27 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH07682%27 HTTP/1.1" 200 None
2026-03-27 11:16:48 [auto1.de] INFO: Saving data for GH07682: {'auction_closing_time': 1774627859.0, 'created_time': 1773402275.523204, 'last_price_update_time': 1774610208.369673}
2026-03-27 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH07682') HTTP/1.1" 204 0
2026-03-27 11:16:48 [auto1.de] INFO: Found listing with ID: ZM52655
2026-03-27 11:16:48 [auto1.de] INFO: Found listing with ID: SS86318
2026-03-27 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS86318%27 HTTP/1.1" 200 None
2026-03-27 11:16:48 [auto1.de] INFO: Scrape type for SS86318: 2
2026-03-27 11:16:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 584eede6-04c5-5c0b-a222-3a476e832d8e with identifier: SS86318
2026-03-27 11:16:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 584eede6-04c5-5c0b-a222-3a476e832d8e with scrape type 2
2026-03-27 11:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 584eede6-04c5-5c0b-a222-3a476e832d8e with scrape type 2
2026-03-27 11:16:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 584eede6-04c5-5c0b-a222-3a476e832d8e, identifier: SS86318
2026-03-27 11:16:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 584eede6-04c5-5c0b-a222-3a476e832d8e with identifier: SS86318
2026-03-27 11:16:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 584eede6-04c5-5c0b-a222-3a476e832d8e with identifier: SS86318
2026-03-27 11:16:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 584eede6-04c5-5c0b-a222-3a476e832d8e with identifier: SS86318 to the API
2026-03-27 11:16:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:54:24Z',
 'fuel_type': 'diesel',
 'id': '584eede6-04c5-5c0b-a222-3a476e832d8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS86318',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 307127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-08-20',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.9 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2007}
2026-03-27 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS86318%27 HTTP/1.1" 200 None
2026-03-27 11:16:48 [auto1.de] INFO: Saving data for SS86318: {'auction_closing_time': 1774630464.0, 'created_time': 1773429695.937796, 'last_price_update_time': 1774610208.79884}
2026-03-27 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS86318') HTTP/1.1" 204 0
2026-03-27 11:16:48 [auto1.de] INFO: Found listing with ID: LN00500
2026-03-27 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN00500%27 HTTP/1.1" 200 None
2026-03-27 11:16:48 [auto1.de] INFO: Scrape type for LN00500: 2
2026-03-27 11:16:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1795443-6f64-5d64-9db7-0bfe75c19a6d with identifier: LN00500
2026-03-27 11:16:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1795443-6f64-5d64-9db7-0bfe75c19a6d with scrape type 2
2026-03-27 11:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1795443-6f64-5d64-9db7-0bfe75c19a6d with scrape type 2
2026-03-27 11:16:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1795443-6f64-5d64-9db7-0bfe75c19a6d, identifier: LN00500
2026-03-27 11:16:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1795443-6f64-5d64-9db7-0bfe75c19a6d with identifier: LN00500
2026-03-27 11:16:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1795443-6f64-5d64-9db7-0bfe75c19a6d with identifier: LN00500
2026-03-27 11:16:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1795443-6f64-5d64-9db7-0bfe75c19a6d with identifier: LN00500 to the API
2026-03-27 11:16:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:09:30Z',
 'fuel_type': 'petrol',
 'id': 'b1795443-6f64-5d64-9db7-0bfe75c19a6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN00500',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 46400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-05',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T4 R Design 2WD',
 'transmission': 'automatic',
 'trim': 'R Design 2WD',
 'year': 2020}
2026-03-27 11:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN00500%27 HTTP/1.1" 200 None
2026-03-27 11:16:49 [auto1.de] INFO: Saving data for LN00500: {'auction_closing_time': 1774627770.0, 'created_time': 1774522348.752975, 'last_price_update_time': 1774610209.218175}
2026-03-27 11:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN00500') HTTP/1.1" 204 0
2026-03-27 11:16:49 [auto1.de] INFO: Found listing with ID: PH21708
2026-03-27 11:16:49 [auto1.de] INFO: Found listing with ID: XA15787
2026-03-27 11:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA15787%27 HTTP/1.1" 200 None
2026-03-27 11:16:49 [auto1.de] INFO: Scrape type for XA15787: 2
2026-03-27 11:16:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e078c114-4301-5eca-8554-b012db12e2ee with identifier: XA15787
2026-03-27 11:16:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e078c114-4301-5eca-8554-b012db12e2ee with scrape type 2
2026-03-27 11:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e078c114-4301-5eca-8554-b012db12e2ee with scrape type 2
2026-03-27 11:16:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e078c114-4301-5eca-8554-b012db12e2ee, identifier: XA15787
2026-03-27 11:16:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e078c114-4301-5eca-8554-b012db12e2ee with identifier: XA15787
2026-03-27 11:16:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e078c114-4301-5eca-8554-b012db12e2ee with identifier: XA15787
2026-03-27 11:16:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e078c114-4301-5eca-8554-b012db12e2ee with identifier: XA15787 to the API
2026-03-27 11:16:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-27T16:44:16Z',
 'fuel_type': 'diesel',
 'id': 'e078c114-4301-5eca-8554-b012db12e2ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA15787',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 244780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-15',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-27 11:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA15787%27 HTTP/1.1" 200 None
2026-03-27 11:16:49 [auto1.de] INFO: Saving data for XA15787: {'auction_closing_time': 1774629856.0, 'created_time': 1773428740.461163, 'last_price_update_time': 1774610209.640555}
2026-03-27 11:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA15787') HTTP/1.1" 204 0
2026-03-27 11:16:49 [auto1.de] INFO: Found listing with ID: UA56207
2026-03-27 11:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA56207%27 HTTP/1.1" 200 None
2026-03-27 11:16:49 [auto1.de] INFO: Scrape type for UA56207: 2
2026-03-27 11:16:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f060cc35-4113-5f3f-9eb8-57f7ad02ea75 with identifier: UA56207
2026-03-27 11:16:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f060cc35-4113-5f3f-9eb8-57f7ad02ea75 with scrape type 2
2026-03-27 11:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f060cc35-4113-5f3f-9eb8-57f7ad02ea75 with scrape type 2
2026-03-27 11:16:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f060cc35-4113-5f3f-9eb8-57f7ad02ea75, identifier: UA56207
2026-03-27 11:16:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f060cc35-4113-5f3f-9eb8-57f7ad02ea75 with identifier: UA56207
2026-03-27 11:16:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f060cc35-4113-5f3f-9eb8-57f7ad02ea75 with identifier: UA56207
2026-03-27 11:16:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f060cc35-4113-5f3f-9eb8-57f7ad02ea75 with identifier: UA56207 to the API
2026-03-27 11:16:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-27T16:40:25Z',
 'fuel_type': 'diesel',
 'id': 'f060cc35-4113-5f3f-9eb8-57f7ad02ea75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA56207',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 38847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-19',
 'seller_name': None,
 'title': 'Ford Transit 1.5 TDCi Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2018}
2026-03-27 11:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA56207%27 HTTP/1.1" 200 None
2026-03-27 11:16:50 [auto1.de] INFO: Saving data for UA56207: {'auction_closing_time': 1774629625.0, 'created_time': 1773345212.34461, 'last_price_update_time': 1774610210.064088}
2026-03-27 11:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA56207') HTTP/1.1" 204 0
2026-03-27 11:16:50 [auto1.de] INFO: Found listing with ID: VZ53815
2026-03-27 11:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ53815%27 HTTP/1.1" 200 None
2026-03-27 11:16:50 [auto1.de] INFO: Scrape type for VZ53815: 2
2026-03-27 11:16:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01108ae5-919a-5fcc-9c44-aba621086f73 with identifier: VZ53815
2026-03-27 11:16:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01108ae5-919a-5fcc-9c44-aba621086f73 with scrape type 2
2026-03-27 11:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01108ae5-919a-5fcc-9c44-aba621086f73 with scrape type 2
2026-03-27 11:16:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01108ae5-919a-5fcc-9c44-aba621086f73, identifier: VZ53815
2026-03-27 11:16:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01108ae5-919a-5fcc-9c44-aba621086f73 with identifier: VZ53815
2026-03-27 11:16:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01108ae5-919a-5fcc-9c44-aba621086f73 with identifier: VZ53815
2026-03-27 11:16:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01108ae5-919a-5fcc-9c44-aba621086f73 with identifier: VZ53815 to the API
2026-03-27 11:16:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:41:45Z',
 'fuel_type': 'petrol',
 'id': '01108ae5-919a-5fcc-9c44-aba621086f73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ53815',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 189216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1996-07-22',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.8 Pacific',
 'transmission': 'manual',
 'trim': 'Pacific',
 'year': 1996}
2026-03-27 11:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ53815%27 HTTP/1.1" 200 None
2026-03-27 11:16:50 [auto1.de] INFO: Saving data for VZ53815: {'auction_closing_time': 1774629705.0, 'created_time': 1774034603.878871, 'last_price_update_time': 1774610210.481547}
2026-03-27 11:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ53815') HTTP/1.1" 204 0
2026-03-27 11:16:50 [auto1.de] INFO: Found listing with ID: KW68340
2026-03-27 11:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68340%27 HTTP/1.1" 200 None
2026-03-27 11:16:50 [auto1.de] INFO: Scrape type for KW68340: 2
2026-03-27 11:16:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f4acaef-f5e5-589e-bd99-a729fe0f1b86 with identifier: KW68340
2026-03-27 11:16:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f4acaef-f5e5-589e-bd99-a729fe0f1b86 with scrape type 2
2026-03-27 11:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f4acaef-f5e5-589e-bd99-a729fe0f1b86 with scrape type 2
2026-03-27 11:16:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f4acaef-f5e5-589e-bd99-a729fe0f1b86, identifier: KW68340
2026-03-27 11:16:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f4acaef-f5e5-589e-bd99-a729fe0f1b86 with identifier: KW68340
2026-03-27 11:16:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f4acaef-f5e5-589e-bd99-a729fe0f1b86 with identifier: KW68340
2026-03-27 11:16:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f4acaef-f5e5-589e-bd99-a729fe0f1b86 with identifier: KW68340 to the API
2026-03-27 11:16:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-27T16:47:52Z',
 'fuel_type': 'diesel',
 'id': '3f4acaef-f5e5-589e-bd99-a729fe0f1b86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW68340',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 131624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-27',
 'seller_name': None,
 'title': 'Renault Megane 1.6 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-03-27 11:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68340%27 HTTP/1.1" 200 None
2026-03-27 11:16:51 [auto1.de] INFO: Saving data for KW68340: {'auction_closing_time': 1774630072.0, 'created_time': 1773427052.657912, 'last_price_update_time': 1774610210.999999}
2026-03-27 11:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW68340') HTTP/1.1" 204 0
2026-03-27 11:16:51 [auto1.de] INFO: Found listing with ID: BT37883
2026-03-27 11:16:51 [auto1.de] INFO: Found listing with ID: WF16279
2026-03-27 11:16:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:16:51 [auto1.de] INFO: Channel: 24h | Page: 260 | totalHits: 10694 | hits on page: 40
2026-03-27 11:16:51 [auto1.de] INFO: Found listing with ID: KW68340
2026-03-27 11:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68340%27 HTTP/1.1" 200 None
2026-03-27 11:16:51 [auto1.de] INFO: Scrape type for KW68340: 0
2026-03-27 11:16:51 [auto1.de] INFO: Found listing with ID: BT37883
2026-03-27 11:16:51 [auto1.de] INFO: Found listing with ID: WF16279
2026-03-27 11:16:51 [auto1.de] INFO: Found listing with ID: SB35470
2026-03-27 11:16:51 [auto1.de] INFO: Found listing with ID: EW37787
2026-03-27 11:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW37787%27 HTTP/1.1" 200 None
2026-03-27 11:16:51 [auto1.de] INFO: Scrape type for EW37787: 2
2026-03-27 11:16:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30840ba6-ab32-5a63-a268-b91665de409f with identifier: EW37787
2026-03-27 11:16:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30840ba6-ab32-5a63-a268-b91665de409f with scrape type 2
2026-03-27 11:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30840ba6-ab32-5a63-a268-b91665de409f with scrape type 2
2026-03-27 11:16:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30840ba6-ab32-5a63-a268-b91665de409f, identifier: EW37787
2026-03-27 11:16:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30840ba6-ab32-5a63-a268-b91665de409f with identifier: EW37787
2026-03-27 11:16:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30840ba6-ab32-5a63-a268-b91665de409f with identifier: EW37787
2026-03-27 11:16:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30840ba6-ab32-5a63-a268-b91665de409f with identifier: EW37787 to the API
2026-03-27 11:16:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-27T16:21:46Z',
 'fuel_type': 'petrol',
 'id': '30840ba6-ab32-5a63-a268-b91665de409f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW37787',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 101070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-17',
 'seller_name': None,
 'title': 'Porsche Macan S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-27 11:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW37787%27 HTTP/1.1" 200 None
2026-03-27 11:16:51 [auto1.de] INFO: Saving data for EW37787: {'auction_closing_time': 1774628506.0, 'created_time': 1773382930.846707, 'last_price_update_time': 1774610211.588766}
2026-03-27 11:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW37787') HTTP/1.1" 204 0
2026-03-27 11:16:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:16:51 [auto1.de] INFO: Found listing with ID: VN96863
2026-03-27 11:16:51 [auto1.de] INFO: Found listing with ID: NC93129
2026-03-27 11:16:51 [auto1.de] INFO: Found listing with ID: LW43520
2026-03-27 11:16:51 [auto1.de] INFO: Found listing with ID: WA68072
2026-03-27 11:16:51 [auto1.de] INFO: Found listing with ID: WS28240
2026-03-27 11:16:51 [auto1.de] INFO: Found listing with ID: TU73668
2026-03-27 11:16:51 [auto1.de] INFO: Found listing with ID: LX73205
2026-03-27 11:16:51 [auto1.de] INFO: Found listing with ID: HP20359
2026-03-27 11:16:51 [auto1.de] INFO: Found listing with ID: PA80529
2026-03-27 11:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA80529%27 HTTP/1.1" 200 None
2026-03-27 11:16:51 [auto1.de] INFO: Scrape type for PA80529: 2
2026-03-27 11:16:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b7b4436-b416-58bd-b4d1-2ec5f70e65e1 with identifier: PA80529
2026-03-27 11:16:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b7b4436-b416-58bd-b4d1-2ec5f70e65e1 with scrape type 2
2026-03-27 11:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b7b4436-b416-58bd-b4d1-2ec5f70e65e1 with scrape type 2
2026-03-27 11:16:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b7b4436-b416-58bd-b4d1-2ec5f70e65e1, identifier: PA80529
2026-03-27 11:16:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b7b4436-b416-58bd-b4d1-2ec5f70e65e1 with identifier: PA80529
2026-03-27 11:16:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b7b4436-b416-58bd-b4d1-2ec5f70e65e1 with identifier: PA80529
2026-03-27 11:16:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b7b4436-b416-58bd-b4d1-2ec5f70e65e1 with identifier: PA80529 to the API
2026-03-27 11:16:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-27T16:10:37Z',
 'fuel_type': 'petrol',
 'id': '0b7b4436-b416-58bd-b4d1-2ec5f70e65e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA80529',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 113105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-06',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2010}
2026-03-27 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA80529%27 HTTP/1.1" 200 None
2026-03-27 11:16:52 [auto1.de] INFO: Saving data for PA80529: {'auction_closing_time': 1774627837.0, 'created_time': 1773429674.845522, 'last_price_update_time': 1774610212.138653}
2026-03-27 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA80529') HTTP/1.1" 204 0
2026-03-27 11:16:52 [auto1.de] INFO: Found listing with ID: MU06950
2026-03-27 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU06950%27 HTTP/1.1" 200 None
2026-03-27 11:16:52 [auto1.de] INFO: Scrape type for MU06950: 2
2026-03-27 11:16:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2299530c-78ab-5931-b673-286890b4cf7f with identifier: MU06950
2026-03-27 11:16:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2299530c-78ab-5931-b673-286890b4cf7f with scrape type 2
2026-03-27 11:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2299530c-78ab-5931-b673-286890b4cf7f with scrape type 2
2026-03-27 11:16:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2299530c-78ab-5931-b673-286890b4cf7f, identifier: MU06950
2026-03-27 11:16:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2299530c-78ab-5931-b673-286890b4cf7f with identifier: MU06950
2026-03-27 11:16:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2299530c-78ab-5931-b673-286890b4cf7f with identifier: MU06950
2026-03-27 11:16:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2299530c-78ab-5931-b673-286890b4cf7f with identifier: MU06950 to the API
2026-03-27 11:16:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:11:53Z',
 'fuel_type': 'petrol',
 'id': '2299530c-78ab-5931-b673-286890b4cf7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU06950',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 181699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-30',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.2 MyLife',
 'transmission': 'manual',
 'trim': 'MyLife',
 'year': 2011}
2026-03-27 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU06950%27 HTTP/1.1" 200 None
2026-03-27 11:16:52 [auto1.de] INFO: Saving data for MU06950: {'auction_closing_time': 1774627913.0, 'created_time': 1774034667.759479, 'last_price_update_time': 1774610212.72715}
2026-03-27 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU06950') HTTP/1.1" 204 0
2026-03-27 11:16:52 [auto1.de] INFO: Found listing with ID: BV43700
2026-03-27 11:16:52 [auto1.de] INFO: Found listing with ID: PK45675
2026-03-27 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK45675%27 HTTP/1.1" 200 None
2026-03-27 11:16:52 [auto1.de] INFO: Scrape type for PK45675: 2
2026-03-27 11:16:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9927601-b027-57a0-ab5e-d6e4476d9d3a with identifier: PK45675
2026-03-27 11:16:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9927601-b027-57a0-ab5e-d6e4476d9d3a with scrape type 2
2026-03-27 11:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9927601-b027-57a0-ab5e-d6e4476d9d3a with scrape type 2
2026-03-27 11:16:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9927601-b027-57a0-ab5e-d6e4476d9d3a, identifier: PK45675
2026-03-27 11:16:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9927601-b027-57a0-ab5e-d6e4476d9d3a with identifier: PK45675
2026-03-27 11:16:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9927601-b027-57a0-ab5e-d6e4476d9d3a with identifier: PK45675
2026-03-27 11:16:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9927601-b027-57a0-ab5e-d6e4476d9d3a with identifier: PK45675 to the API
2026-03-27 11:16:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-27T16:52:26Z',
 'fuel_type': 'diesel',
 'id': 'a9927601-b027-57a0-ab5e-d6e4476d9d3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK45675',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 158328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-22',
 'seller_name': None,
 'title': 'Fiat Doblo 1.6 JTDM SX Kasten',
 'transmission': 'manual',
 'trim': 'SX Kasten',
 'year': 2022}
2026-03-27 11:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK45675%27 HTTP/1.1" 200 None
2026-03-27 11:16:53 [auto1.de] INFO: Saving data for PK45675: {'auction_closing_time': 1774630346.0, 'created_time': 1773341079.141209, 'last_price_update_time': 1774610213.177979}
2026-03-27 11:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK45675') HTTP/1.1" 204 0
2026-03-27 11:16:53 [auto1.de] INFO: Found listing with ID: NL36228
2026-03-27 11:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL36228%27 HTTP/1.1" 200 None
2026-03-27 11:16:53 [auto1.de] INFO: Scrape type for NL36228: 2
2026-03-27 11:16:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4caa522a-fecf-53c2-876e-e1d9cd2c25b6 with identifier: NL36228
2026-03-27 11:16:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4caa522a-fecf-53c2-876e-e1d9cd2c25b6 with scrape type 2
2026-03-27 11:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4caa522a-fecf-53c2-876e-e1d9cd2c25b6 with scrape type 2
2026-03-27 11:16:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4caa522a-fecf-53c2-876e-e1d9cd2c25b6, identifier: NL36228
2026-03-27 11:16:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4caa522a-fecf-53c2-876e-e1d9cd2c25b6 with identifier: NL36228
2026-03-27 11:16:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4caa522a-fecf-53c2-876e-e1d9cd2c25b6 with identifier: NL36228
2026-03-27 11:16:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4caa522a-fecf-53c2-876e-e1d9cd2c25b6 with identifier: NL36228 to the API
2026-03-27 11:16:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:19:38Z',
 'fuel_type': 'petrol',
 'id': '4caa522a-fecf-53c2-876e-e1d9cd2c25b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL36228',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 86197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-06',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-27 11:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL36228%27 HTTP/1.1" 200 None
2026-03-27 11:16:53 [auto1.de] INFO: Saving data for NL36228: {'auction_closing_time': 1774628378.0, 'created_time': 1773429458.45857, 'last_price_update_time': 1774610213.639603}
2026-03-27 11:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL36228') HTTP/1.1" 204 0
2026-03-27 11:16:53 [auto1.de] INFO: Found listing with ID: TM90896
2026-03-27 11:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM90896%27 HTTP/1.1" 200 None
2026-03-27 11:16:53 [auto1.de] INFO: Scrape type for TM90896: 2
2026-03-27 11:16:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 194a6cb9-e19d-5594-9143-dc8cb05a8f4c with identifier: TM90896
2026-03-27 11:16:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 194a6cb9-e19d-5594-9143-dc8cb05a8f4c with scrape type 2
2026-03-27 11:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 194a6cb9-e19d-5594-9143-dc8cb05a8f4c with scrape type 2
2026-03-27 11:16:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 194a6cb9-e19d-5594-9143-dc8cb05a8f4c, identifier: TM90896
2026-03-27 11:16:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 194a6cb9-e19d-5594-9143-dc8cb05a8f4c with identifier: TM90896
2026-03-27 11:16:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 194a6cb9-e19d-5594-9143-dc8cb05a8f4c with identifier: TM90896
2026-03-27 11:16:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 194a6cb9-e19d-5594-9143-dc8cb05a8f4c with identifier: TM90896 to the API
2026-03-27 11:16:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:08:44Z',
 'fuel_type': 'petrol',
 'id': '194a6cb9-e19d-5594-9143-dc8cb05a8f4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM90896',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 252488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-08',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 170',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-27 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM90896%27 HTTP/1.1" 200 None
2026-03-27 11:16:54 [auto1.de] INFO: Saving data for TM90896: {'auction_closing_time': 1774627724.0, 'created_time': 1773426994.796645, 'last_price_update_time': 1774610214.1385}
2026-03-27 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM90896') HTTP/1.1" 204 0
2026-03-27 11:16:54 [auto1.de] INFO: Found listing with ID: NW39371
2026-03-27 11:16:54 [auto1.de] INFO: Found listing with ID: VS29167
2026-03-27 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS29167%27 HTTP/1.1" 200 None
2026-03-27 11:16:54 [auto1.de] INFO: Scrape type for VS29167: 2
2026-03-27 11:16:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e4208fa-1de6-5fb1-8351-2835eb660bdd with identifier: VS29167
2026-03-27 11:16:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e4208fa-1de6-5fb1-8351-2835eb660bdd with scrape type 2
2026-03-27 11:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e4208fa-1de6-5fb1-8351-2835eb660bdd with scrape type 2
2026-03-27 11:16:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e4208fa-1de6-5fb1-8351-2835eb660bdd, identifier: VS29167
2026-03-27 11:16:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e4208fa-1de6-5fb1-8351-2835eb660bdd with identifier: VS29167
2026-03-27 11:16:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e4208fa-1de6-5fb1-8351-2835eb660bdd with identifier: VS29167
2026-03-27 11:16:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e4208fa-1de6-5fb1-8351-2835eb660bdd with identifier: VS29167 to the API
2026-03-27 11:16:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:53:14Z',
 'fuel_type': 'petrol',
 'id': '5e4208fa-1de6-5fb1-8351-2835eb660bdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS29167',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 159154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-02',
 'seller_name': None,
 'title': 'Audi Q3 1.4 TFSI ACT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-27 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS29167%27 HTTP/1.1" 200 None
2026-03-27 11:16:54 [auto1.de] INFO: Saving data for VS29167: {'auction_closing_time': 1774630394.0, 'created_time': 1774522369.407583, 'last_price_update_time': 1774610214.56825}
2026-03-27 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS29167') HTTP/1.1" 204 0
2026-03-27 11:16:54 [auto1.de] INFO: Found listing with ID: PW08848
2026-03-27 11:16:54 [auto1.de] INFO: Found listing with ID: LD40864
2026-03-27 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD40864%27 HTTP/1.1" 200 None
2026-03-27 11:16:54 [auto1.de] INFO: Scrape type for LD40864: 2
2026-03-27 11:16:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c34da886-d60b-5a15-b04d-2f2ca673fa3c with identifier: LD40864
2026-03-27 11:16:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c34da886-d60b-5a15-b04d-2f2ca673fa3c with scrape type 2
2026-03-27 11:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c34da886-d60b-5a15-b04d-2f2ca673fa3c with scrape type 2
2026-03-27 11:16:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c34da886-d60b-5a15-b04d-2f2ca673fa3c, identifier: LD40864
2026-03-27 11:16:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c34da886-d60b-5a15-b04d-2f2ca673fa3c with identifier: LD40864
2026-03-27 11:16:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c34da886-d60b-5a15-b04d-2f2ca673fa3c with identifier: LD40864
2026-03-27 11:16:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c34da886-d60b-5a15-b04d-2f2ca673fa3c with identifier: LD40864 to the API
2026-03-27 11:16:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:16:37Z',
 'fuel_type': 'diesel',
 'id': 'c34da886-d60b-5a15-b04d-2f2ca673fa3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD40864',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 118719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-24',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2014}
2026-03-27 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD40864%27 HTTP/1.1" 200 None
2026-03-27 11:16:54 [auto1.de] INFO: Saving data for LD40864: {'auction_closing_time': 1774628197.0, 'created_time': 1774522388.039543, 'last_price_update_time': 1774610214.994076}
2026-03-27 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD40864') HTTP/1.1" 204 0
2026-03-27 11:16:55 [auto1.de] INFO: Found listing with ID: RG99680
2026-03-27 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG99680%27 HTTP/1.1" 200 None
2026-03-27 11:16:55 [auto1.de] INFO: Scrape type for RG99680: 2
2026-03-27 11:16:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ccaf1c8-72f5-51d5-a41d-d46666037cee with identifier: RG99680
2026-03-27 11:16:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ccaf1c8-72f5-51d5-a41d-d46666037cee with scrape type 2
2026-03-27 11:16:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ccaf1c8-72f5-51d5-a41d-d46666037cee with scrape type 2
2026-03-27 11:16:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ccaf1c8-72f5-51d5-a41d-d46666037cee, identifier: RG99680
2026-03-27 11:16:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ccaf1c8-72f5-51d5-a41d-d46666037cee with identifier: RG99680
2026-03-27 11:16:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ccaf1c8-72f5-51d5-a41d-d46666037cee with identifier: RG99680
2026-03-27 11:16:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ccaf1c8-72f5-51d5-a41d-d46666037cee with identifier: RG99680 to the API
2026-03-27 11:16:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 400,
 'expiration_date': '2026-03-27T16:12:00Z',
 'fuel_type': 'petrol',
 'id': '4ccaf1c8-72f5-51d5-a41d-d46666037cee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG99680',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS 3 Sportback',
 'odometer': 57692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-06',
 'seller_name': None,
 'title': 'Audi RS 3 Sportback 2.5 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2026-03-27 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG99680%27 HTTP/1.1" 200 None
2026-03-27 11:16:55 [auto1.de] INFO: Saving data for RG99680: {'auction_closing_time': 1774627920.0, 'created_time': 1774522365.26713, 'last_price_update_time': 1774610215.453799}
2026-03-27 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG99680') HTTP/1.1" 204 0
2026-03-27 11:16:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:16:55 [auto1.de] INFO: Found listing with ID: MH03365
2026-03-27 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH03365%27 HTTP/1.1" 200 None
2026-03-27 11:16:55 [auto1.de] INFO: Scrape type for MH03365: 2
2026-03-27 11:16:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67c06ff0-b109-55ed-974b-feef205979f2 with identifier: MH03365
2026-03-27 11:16:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67c06ff0-b109-55ed-974b-feef205979f2 with scrape type 2
2026-03-27 11:16:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67c06ff0-b109-55ed-974b-feef205979f2 with scrape type 2
2026-03-27 11:16:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67c06ff0-b109-55ed-974b-feef205979f2, identifier: MH03365
2026-03-27 11:16:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67c06ff0-b109-55ed-974b-feef205979f2 with identifier: MH03365
2026-03-27 11:16:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67c06ff0-b109-55ed-974b-feef205979f2 with identifier: MH03365
2026-03-27 11:16:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67c06ff0-b109-55ed-974b-feef205979f2 with identifier: MH03365 to the API
2026-03-27 11:16:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:51:45Z',
 'fuel_type': 'petrol',
 'id': '67c06ff0-b109-55ed-974b-feef205979f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH03365',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 119893,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-26',
 'seller_name': None,
 'title': 'Seat Alhambra 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2014}
2026-03-27 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH03365%27 HTTP/1.1" 200 None
2026-03-27 11:16:55 [auto1.de] INFO: Saving data for MH03365: {'auction_closing_time': 1774630305.0, 'created_time': 1773429467.988775, 'last_price_update_time': 1774610215.935091}
2026-03-27 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH03365') HTTP/1.1" 204 0
2026-03-27 11:16:56 [auto1.de] INFO: Found listing with ID: LZ76677
2026-03-27 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ76677%27 HTTP/1.1" 200 None
2026-03-27 11:16:56 [auto1.de] INFO: Scrape type for LZ76677: 2
2026-03-27 11:16:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d6aec58-f7f1-5cca-8c3a-82f082984758 with identifier: LZ76677
2026-03-27 11:16:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d6aec58-f7f1-5cca-8c3a-82f082984758 with scrape type 2
2026-03-27 11:16:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d6aec58-f7f1-5cca-8c3a-82f082984758 with scrape type 2
2026-03-27 11:16:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d6aec58-f7f1-5cca-8c3a-82f082984758, identifier: LZ76677
2026-03-27 11:16:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d6aec58-f7f1-5cca-8c3a-82f082984758 with identifier: LZ76677
2026-03-27 11:16:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d6aec58-f7f1-5cca-8c3a-82f082984758 with identifier: LZ76677
2026-03-27 11:16:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d6aec58-f7f1-5cca-8c3a-82f082984758 with identifier: LZ76677 to the API
2026-03-27 11:16:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:02:55Z',
 'fuel_type': 'petrol',
 'id': '3d6aec58-f7f1-5cca-8c3a-82f082984758',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ76677',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 55169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-15',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2021}
2026-03-27 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ76677%27 HTTP/1.1" 200 None
2026-03-27 11:16:56 [auto1.de] INFO: Saving data for LZ76677: {'auction_closing_time': 1774627375.0, 'created_time': 1774118537.302577, 'last_price_update_time': 1774610216.529546}
2026-03-27 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ76677') HTTP/1.1" 204 0
2026-03-27 11:16:56 [auto1.de] INFO: Channel: 24h | Page: 261 | totalHits: 10694 | hits on page: 40
2026-03-27 11:16:56 [auto1.de] INFO: Found listing with ID: SX00358
2026-03-27 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX00358%27 HTTP/1.1" 200 None
2026-03-27 11:16:56 [auto1.de] INFO: Scrape type for SX00358: 2
2026-03-27 11:16:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd7fca5a-e71b-5516-b06f-9727b6f6ed3b with identifier: SX00358
2026-03-27 11:16:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd7fca5a-e71b-5516-b06f-9727b6f6ed3b with scrape type 2
2026-03-27 11:16:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd7fca5a-e71b-5516-b06f-9727b6f6ed3b with scrape type 2
2026-03-27 11:16:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd7fca5a-e71b-5516-b06f-9727b6f6ed3b, identifier: SX00358
2026-03-27 11:16:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd7fca5a-e71b-5516-b06f-9727b6f6ed3b with identifier: SX00358
2026-03-27 11:16:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd7fca5a-e71b-5516-b06f-9727b6f6ed3b with identifier: SX00358
2026-03-27 11:16:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd7fca5a-e71b-5516-b06f-9727b6f6ed3b with identifier: SX00358 to the API
2026-03-27 11:16:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:41:34Z',
 'fuel_type': 'petrol',
 'id': 'fd7fca5a-e71b-5516-b06f-9727b6f6ed3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX00358',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 17146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-08',
 'seller_name': None,
 'title': 'Renault Captur 0.9 Energy Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2015}
2026-03-27 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX00358%27 HTTP/1.1" 200 None
2026-03-27 11:16:56 [auto1.de] INFO: Saving data for SX00358: {'auction_closing_time': 1774629694.0, 'created_time': 1773305128.981592, 'last_price_update_time': 1774610216.982549}
2026-03-27 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX00358') HTTP/1.1" 204 0
2026-03-27 11:16:57 [auto1.de] INFO: Found listing with ID: UT62176
2026-03-27 11:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT62176%27 HTTP/1.1" 200 None
2026-03-27 11:16:57 [auto1.de] INFO: Scrape type for UT62176: 2
2026-03-27 11:16:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc43f429-af49-5355-95cd-3beb3c03d311 with identifier: UT62176
2026-03-27 11:16:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc43f429-af49-5355-95cd-3beb3c03d311 with scrape type 2
2026-03-27 11:16:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc43f429-af49-5355-95cd-3beb3c03d311 with scrape type 2
2026-03-27 11:16:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc43f429-af49-5355-95cd-3beb3c03d311, identifier: UT62176
2026-03-27 11:16:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:16:57 [auto1.de] INFO: Found listing with ID: AH63803
2026-03-27 11:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH63803%27 HTTP/1.1" 200 None
2026-03-27 11:16:57 [auto1.de] INFO: Scrape type for AH63803: 2
2026-03-27 11:16:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a47f394-e3ba-5d30-a3d7-e9db3eca4fd2 with identifier: AH63803
2026-03-27 11:16:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a47f394-e3ba-5d30-a3d7-e9db3eca4fd2 with scrape type 2
2026-03-27 11:16:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a47f394-e3ba-5d30-a3d7-e9db3eca4fd2 with scrape type 2
2026-03-27 11:16:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a47f394-e3ba-5d30-a3d7-e9db3eca4fd2, identifier: AH63803
2026-03-27 11:16:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc43f429-af49-5355-95cd-3beb3c03d311 with identifier: UT62176
2026-03-27 11:16:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc43f429-af49-5355-95cd-3beb3c03d311 with identifier: UT62176
2026-03-27 11:16:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc43f429-af49-5355-95cd-3beb3c03d311 with identifier: UT62176 to the API
2026-03-27 11:16:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:57:34Z',
 'fuel_type': 'gas',
 'id': 'cc43f429-af49-5355-95cd-3beb3c03d311',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT62176',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 90831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-06',
 'seller_name': None,
 'title': 'Dacia Duster 1.6 Ambiance 4x2',
 'transmission': 'manual',
 'trim': 'Ambiance 4x2',
 'year': 2013}
2026-03-27 11:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT62176%27 HTTP/1.1" 200 None
2026-03-27 11:16:57 [auto1.de] INFO: Saving data for UT62176: {'auction_closing_time': 1774630654.0, 'created_time': 1773137541.617299, 'last_price_update_time': 1774610217.593426}
2026-03-27 11:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT62176') HTTP/1.1" 204 0
2026-03-27 11:16:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a47f394-e3ba-5d30-a3d7-e9db3eca4fd2 with identifier: AH63803
2026-03-27 11:16:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a47f394-e3ba-5d30-a3d7-e9db3eca4fd2 with identifier: AH63803
2026-03-27 11:16:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a47f394-e3ba-5d30-a3d7-e9db3eca4fd2 with identifier: AH63803 to the API
2026-03-27 11:16:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-27T16:18:27Z',
 'fuel_type': 'petrol',
 'id': '2a47f394-e3ba-5d30-a3d7-e9db3eca4fd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH63803',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 19588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-13',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 43 AMG Mild-Hybrid T 4Matic',
 'transmission': 'automatic',
 'trim': 'T 4Matic',
 'year': 2022}
2026-03-27 11:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH63803%27 HTTP/1.1" 200 None
2026-03-27 11:16:57 [auto1.de] INFO: Saving data for AH63803: {'auction_closing_time': 1774628307.0, 'created_time': 1773776341.863112, 'last_price_update_time': 1774610217.931076}
2026-03-27 11:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH63803') HTTP/1.1" 204 0
2026-03-27 11:16:57 [auto1.de] INFO: Found listing with ID: VN57759
2026-03-27 11:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN57759%27 HTTP/1.1" 200 None
2026-03-27 11:16:57 [auto1.de] INFO: Scrape type for VN57759: 2
2026-03-27 11:16:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3da7ca9-5a68-51f4-a7b6-df20363fdadb with identifier: VN57759
2026-03-27 11:16:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3da7ca9-5a68-51f4-a7b6-df20363fdadb with scrape type 2
2026-03-27 11:16:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3da7ca9-5a68-51f4-a7b6-df20363fdadb with scrape type 2
2026-03-27 11:16:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3da7ca9-5a68-51f4-a7b6-df20363fdadb, identifier: VN57759
2026-03-27 11:16:58 [auto1.de] INFO: Found listing with ID: UV62797
2026-03-27 11:16:58 [auto1.de] INFO: Found listing with ID: CV06251
2026-03-27 11:16:58 [auto1.de] INFO: Found listing with ID: JU32018
2026-03-27 11:16:58 [auto1.de] INFO: Found listing with ID: VR87804
2026-03-27 11:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR87804%27 HTTP/1.1" 200 None
2026-03-27 11:16:58 [auto1.de] INFO: Scrape type for VR87804: 2
2026-03-27 11:16:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c009cb3-7de6-5840-b53c-8392af19a386 with identifier: VR87804
2026-03-27 11:16:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c009cb3-7de6-5840-b53c-8392af19a386 with scrape type 2
2026-03-27 11:16:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c009cb3-7de6-5840-b53c-8392af19a386 with scrape type 2
2026-03-27 11:16:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c009cb3-7de6-5840-b53c-8392af19a386, identifier: VR87804
2026-03-27 11:16:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3da7ca9-5a68-51f4-a7b6-df20363fdadb with identifier: VN57759
2026-03-27 11:16:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3da7ca9-5a68-51f4-a7b6-df20363fdadb with identifier: VN57759
2026-03-27 11:16:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3da7ca9-5a68-51f4-a7b6-df20363fdadb with identifier: VN57759 to the API
2026-03-27 11:16:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-27T16:07:20Z',
 'fuel_type': 'petrol',
 'id': 'f3da7ca9-5a68-51f4-a7b6-df20363fdadb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN57759',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'StreetKa',
 'odometer': 55881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-30',
 'seller_name': None,
 'title': 'Ford StreetKa 1.6 Elegance Roadster',
 'transmission': 'manual',
 'trim': 'Elegance Roadster',
 'year': 2005}
2026-03-27 11:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN57759%27 HTTP/1.1" 200 None
2026-03-27 11:16:58 [auto1.de] INFO: Saving data for VN57759: {'auction_closing_time': 1774627640.0, 'created_time': 1773402787.604239, 'last_price_update_time': 1774610218.593932}
2026-03-27 11:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN57759') HTTP/1.1" 204 0
2026-03-27 11:16:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c009cb3-7de6-5840-b53c-8392af19a386 with identifier: VR87804
2026-03-27 11:16:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c009cb3-7de6-5840-b53c-8392af19a386 with identifier: VR87804
2026-03-27 11:16:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c009cb3-7de6-5840-b53c-8392af19a386 with identifier: VR87804 to the API
2026-03-27 11:16:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-27T16:57:14Z',
 'fuel_type': 'petrol',
 'id': '3c009cb3-7de6-5840-b53c-8392af19a386',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR87804',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 146442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-23',
 'seller_name': None,
 'title': 'Citroen C1 1.0 Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2012}
2026-03-27 11:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR87804%27 HTTP/1.1" 200 None
2026-03-27 11:16:58 [auto1.de] INFO: Saving data for VR87804: {'auction_closing_time': 1774630634.0, 'created_time': 1774377995.985666, 'last_price_update_time': 1774610218.916567}
2026-03-27 11:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR87804') HTTP/1.1" 204 0
2026-03-27 11:16:58 [auto1.de] INFO: Found listing with ID: WN92632
2026-03-27 11:16:58 [auto1.de] INFO: Found listing with ID: GP94559
2026-03-27 11:16:58 [auto1.de] INFO: Found listing with ID: WT92496
2026-03-27 11:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT92496%27 HTTP/1.1" 200 None
2026-03-27 11:16:58 [auto1.de] INFO: Scrape type for WT92496: 2
2026-03-27 11:16:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86adff88-dfec-50bb-b3b9-d6bbf5eb3da4 with identifier: WT92496
2026-03-27 11:16:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86adff88-dfec-50bb-b3b9-d6bbf5eb3da4 with scrape type 2
2026-03-27 11:16:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86adff88-dfec-50bb-b3b9-d6bbf5eb3da4 with scrape type 2
2026-03-27 11:16:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86adff88-dfec-50bb-b3b9-d6bbf5eb3da4, identifier: WT92496
2026-03-27 11:16:59 [auto1.de] INFO: Found listing with ID: HB62696
2026-03-27 11:16:59 [auto1.de] INFO: Found listing with ID: YR73965
2026-03-27 11:16:59 [auto1.de] INFO: Found listing with ID: UP16968
2026-03-27 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP16968%27 HTTP/1.1" 200 None
2026-03-27 11:16:59 [auto1.de] INFO: Scrape type for UP16968: 2
2026-03-27 11:16:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d41dcc3-3c03-5e8c-b493-26f6384c2f73 with identifier: UP16968
2026-03-27 11:16:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d41dcc3-3c03-5e8c-b493-26f6384c2f73 with scrape type 2
2026-03-27 11:16:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d41dcc3-3c03-5e8c-b493-26f6384c2f73 with scrape type 2
2026-03-27 11:16:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d41dcc3-3c03-5e8c-b493-26f6384c2f73, identifier: UP16968
2026-03-27 11:16:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86adff88-dfec-50bb-b3b9-d6bbf5eb3da4 with identifier: WT92496
2026-03-27 11:16:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86adff88-dfec-50bb-b3b9-d6bbf5eb3da4 with identifier: WT92496
2026-03-27 11:16:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86adff88-dfec-50bb-b3b9-d6bbf5eb3da4 with identifier: WT92496 to the API
2026-03-27 11:16:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:16:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:16:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-27T16:12:54Z',
 'fuel_type': 'diesel',
 'id': '86adff88-dfec-50bb-b3b9-d6bbf5eb3da4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT92496',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 27410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-08-05',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi Mild-Hybrid Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2024}
2026-03-27 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT92496%27 HTTP/1.1" 200 None
2026-03-27 11:16:59 [auto1.de] INFO: Saving data for WT92496: {'auction_closing_time': 1774627974.0, 'created_time': 1774003282.651985, 'last_price_update_time': 1774610219.856563}
2026-03-27 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT92496') HTTP/1.1" 204 0
2026-03-27 11:16:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d41dcc3-3c03-5e8c-b493-26f6384c2f73 with identifier: UP16968
2026-03-27 11:16:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d41dcc3-3c03-5e8c-b493-26f6384c2f73 with identifier: UP16968
2026-03-27 11:17:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d41dcc3-3c03-5e8c-b493-26f6384c2f73 with identifier: UP16968 to the API
2026-03-27 11:17:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-27T16:03:36Z',
 'fuel_type': 'petrol',
 'id': '5d41dcc3-3c03-5e8c-b493-26f6384c2f73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP16968',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 101052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-10',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-27 11:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP16968%27 HTTP/1.1" 200 None
2026-03-27 11:17:00 [auto1.de] INFO: Saving data for UP16968: {'auction_closing_time': 1774627416.0, 'created_time': 1774522366.212166, 'last_price_update_time': 1774610220.327062}
2026-03-27 11:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP16968') HTTP/1.1" 204 0
2026-03-27 11:17:00 [auto1.de] INFO: Found listing with ID: NW09041
2026-03-27 11:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW09041%27 HTTP/1.1" 200 None
2026-03-27 11:17:00 [auto1.de] INFO: Scrape type for NW09041: 2
2026-03-27 11:17:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6824c22-dce1-5798-af56-b3b846f01d38 with identifier: NW09041
2026-03-27 11:17:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6824c22-dce1-5798-af56-b3b846f01d38 with scrape type 2
2026-03-27 11:17:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6824c22-dce1-5798-af56-b3b846f01d38 with scrape type 2
2026-03-27 11:17:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6824c22-dce1-5798-af56-b3b846f01d38, identifier: NW09041
2026-03-27 11:17:00 [auto1.de] INFO: Found listing with ID: PG10773
2026-03-27 11:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG10773%27 HTTP/1.1" 200 None
2026-03-27 11:17:00 [auto1.de] INFO: Scrape type for PG10773: 2
2026-03-27 11:17:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8131aa0-22fe-5633-b850-4cb0cfd7d9d9 with identifier: PG10773
2026-03-27 11:17:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8131aa0-22fe-5633-b850-4cb0cfd7d9d9 with scrape type 2
2026-03-27 11:17:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8131aa0-22fe-5633-b850-4cb0cfd7d9d9 with scrape type 2
2026-03-27 11:17:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8131aa0-22fe-5633-b850-4cb0cfd7d9d9, identifier: PG10773
2026-03-27 11:17:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6824c22-dce1-5798-af56-b3b846f01d38 with identifier: NW09041
2026-03-27 11:17:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6824c22-dce1-5798-af56-b3b846f01d38 with identifier: NW09041
2026-03-27 11:17:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6824c22-dce1-5798-af56-b3b846f01d38 with identifier: NW09041 to the API
2026-03-27 11:17:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:56:55Z',
 'fuel_type': 'petrol',
 'id': 'f6824c22-dce1-5798-af56-b3b846f01d38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW09041',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 102462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-12-14',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2005}
2026-03-27 11:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW09041%27 HTTP/1.1" 200 None
2026-03-27 11:17:00 [auto1.de] INFO: Saving data for NW09041: {'auction_closing_time': 1774630615.0, 'created_time': 1774033776.579546, 'last_price_update_time': 1774610220.86496}
2026-03-27 11:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW09041') HTTP/1.1" 204 0
2026-03-27 11:17:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8131aa0-22fe-5633-b850-4cb0cfd7d9d9 with identifier: PG10773
2026-03-27 11:17:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8131aa0-22fe-5633-b850-4cb0cfd7d9d9 with identifier: PG10773
2026-03-27 11:17:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8131aa0-22fe-5633-b850-4cb0cfd7d9d9 with identifier: PG10773 to the API
2026-03-27 11:17:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-27T16:40:37Z',
 'fuel_type': 'diesel',
 'id': 'a8131aa0-22fe-5633-b850-4cb0cfd7d9d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG10773',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 138353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-08',
 'seller_name': None,
 'title': 'Audi Q5 40 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-27 11:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG10773%27 HTTP/1.1" 200 None
2026-03-27 11:17:01 [auto1.de] INFO: Saving data for PG10773: {'auction_closing_time': 1774629637.0, 'created_time': 1774522367.872201, 'last_price_update_time': 1774610221.188061}
2026-03-27 11:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG10773') HTTP/1.1" 204 0
2026-03-27 11:17:01 [auto1.de] INFO: Found listing with ID: AC92366
2026-03-27 11:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC92366%27 HTTP/1.1" 200 None
2026-03-27 11:17:01 [auto1.de] INFO: Scrape type for AC92366: 2
2026-03-27 11:17:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 574ab418-ac0d-594a-810b-d4b8e3b255c9 with identifier: AC92366
2026-03-27 11:17:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 574ab418-ac0d-594a-810b-d4b8e3b255c9 with scrape type 2
2026-03-27 11:17:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 574ab418-ac0d-594a-810b-d4b8e3b255c9 with scrape type 2
2026-03-27 11:17:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 574ab418-ac0d-594a-810b-d4b8e3b255c9, identifier: AC92366
2026-03-27 11:17:01 [auto1.de] INFO: Found listing with ID: WZ38880
2026-03-27 11:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ38880%27 HTTP/1.1" 200 None
2026-03-27 11:17:01 [auto1.de] INFO: Scrape type for WZ38880: 2
2026-03-27 11:17:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 363faf73-5150-5013-84e6-228bffc04801 with identifier: WZ38880
2026-03-27 11:17:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 363faf73-5150-5013-84e6-228bffc04801 with scrape type 2
2026-03-27 11:17:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 363faf73-5150-5013-84e6-228bffc04801 with scrape type 2
2026-03-27 11:17:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 363faf73-5150-5013-84e6-228bffc04801, identifier: WZ38880
2026-03-27 11:17:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 574ab418-ac0d-594a-810b-d4b8e3b255c9 with identifier: AC92366
2026-03-27 11:17:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 574ab418-ac0d-594a-810b-d4b8e3b255c9 with identifier: AC92366
2026-03-27 11:17:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 574ab418-ac0d-594a-810b-d4b8e3b255c9 with identifier: AC92366 to the API
2026-03-27 11:17:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-27T16:41:38Z',
 'fuel_type': 'petrol',
 'id': '574ab418-ac0d-594a-810b-d4b8e3b255c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC92366',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 115274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-27 11:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC92366%27 HTTP/1.1" 200 None
2026-03-27 11:17:01 [auto1.de] INFO: Saving data for AC92366: {'auction_closing_time': 1774629698.0, 'created_time': 1774522514.911213, 'last_price_update_time': 1774610221.789378}
2026-03-27 11:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC92366') HTTP/1.1" 204 0
2026-03-27 11:17:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 363faf73-5150-5013-84e6-228bffc04801 with identifier: WZ38880
2026-03-27 11:17:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 363faf73-5150-5013-84e6-228bffc04801 with identifier: WZ38880
2026-03-27 11:17:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 363faf73-5150-5013-84e6-228bffc04801 with identifier: WZ38880 to the API
2026-03-27 11:17:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-27T16:31:18Z',
 'fuel_type': 'petrol',
 'id': '363faf73-5150-5013-84e6-228bffc04801',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ38880',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 79015,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI R BlueMotion 4Motion',
 'transmission': 'automatic',
 'trim': 'R BlueMotion 4Motion',
 'year': 2019}
2026-03-27 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ38880%27 HTTP/1.1" 200 None
2026-03-27 11:17:02 [auto1.de] INFO: Saving data for WZ38880: {'auction_closing_time': 1774629078.0, 'created_time': 1774522388.823202, 'last_price_update_time': 1774610222.163261}
2026-03-27 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ38880') HTTP/1.1" 204 0
2026-03-27 11:17:02 [auto1.de] INFO: Found listing with ID: EG31023
2026-03-27 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG31023%27 HTTP/1.1" 200 None
2026-03-27 11:17:02 [auto1.de] INFO: Scrape type for EG31023: 2
2026-03-27 11:17:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d2d629e-f7bd-5759-a148-41bc07909644 with identifier: EG31023
2026-03-27 11:17:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d2d629e-f7bd-5759-a148-41bc07909644 with scrape type 2
2026-03-27 11:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d2d629e-f7bd-5759-a148-41bc07909644 with scrape type 2
2026-03-27 11:17:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d2d629e-f7bd-5759-a148-41bc07909644, identifier: EG31023
2026-03-27 11:17:02 [auto1.de] INFO: Found listing with ID: VY57936
2026-03-27 11:17:02 [auto1.de] INFO: Found listing with ID: AG42548
2026-03-27 11:17:02 [auto1.de] INFO: Found listing with ID: VJ59637
2026-03-27 11:17:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d2d629e-f7bd-5759-a148-41bc07909644 with identifier: EG31023
2026-03-27 11:17:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d2d629e-f7bd-5759-a148-41bc07909644 with identifier: EG31023
2026-03-27 11:17:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d2d629e-f7bd-5759-a148-41bc07909644 with identifier: EG31023 to the API
2026-03-27 11:17:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 389,
 'expiration_date': '2026-03-27T16:51:57Z',
 'fuel_type': 'petrol',
 'id': '3d2d629e-f7bd-5759-a148-41bc07909644',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG31023',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 145862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-14',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 450 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-27 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG31023%27 HTTP/1.1" 200 None
2026-03-27 11:17:02 [auto1.de] INFO: Saving data for EG31023: {'auction_closing_time': 1774630317.0, 'created_time': 1773686325.407926, 'last_price_update_time': 1774610222.639497}
2026-03-27 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG31023') HTTP/1.1" 204 0
2026-03-27 11:17:02 [auto1.de] INFO: Found listing with ID: UV96065
2026-03-27 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV96065%27 HTTP/1.1" 200 None
2026-03-27 11:17:02 [auto1.de] INFO: Scrape type for UV96065: 2
2026-03-27 11:17:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94934c2b-4fbc-5dcf-98e7-82868985d99b with identifier: UV96065
2026-03-27 11:17:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94934c2b-4fbc-5dcf-98e7-82868985d99b with scrape type 2
2026-03-27 11:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94934c2b-4fbc-5dcf-98e7-82868985d99b with scrape type 2
2026-03-27 11:17:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94934c2b-4fbc-5dcf-98e7-82868985d99b, identifier: UV96065
2026-03-27 11:17:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94934c2b-4fbc-5dcf-98e7-82868985d99b with identifier: UV96065
2026-03-27 11:17:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94934c2b-4fbc-5dcf-98e7-82868985d99b with identifier: UV96065
2026-03-27 11:17:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94934c2b-4fbc-5dcf-98e7-82868985d99b with identifier: UV96065 to the API
2026-03-27 11:17:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-27T16:46:33Z',
 'fuel_type': 'petrol',
 'id': '94934c2b-4fbc-5dcf-98e7-82868985d99b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV96065',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Tonale',
 'odometer': 18745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-23',
 'seller_name': None,
 'title': 'Alfa Romeo Tonale 1.5 Mild-Hybrid Sprint',
 'transmission': 'automatic',
 'trim': 'Sprint',
 'year': 2023}
2026-03-27 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV96065%27 HTTP/1.1" 200 None
2026-03-27 11:17:03 [auto1.de] INFO: Saving data for UV96065: {'auction_closing_time': 1774629993.0, 'created_time': 1773402859.648963, 'last_price_update_time': 1774610223.113477}
2026-03-27 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV96065') HTTP/1.1" 204 0
2026-03-27 11:17:03 [auto1.de] INFO: Found listing with ID: SR59541
2026-03-27 11:17:03 [auto1.de] INFO: Found listing with ID: NU04580
2026-03-27 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU04580%27 HTTP/1.1" 200 None
2026-03-27 11:17:03 [auto1.de] INFO: Scrape type for NU04580: 2
2026-03-27 11:17:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 515d0a17-cd83-5781-b362-9ea184b1f5df with identifier: NU04580
2026-03-27 11:17:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 515d0a17-cd83-5781-b362-9ea184b1f5df with scrape type 2
2026-03-27 11:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 515d0a17-cd83-5781-b362-9ea184b1f5df with scrape type 2
2026-03-27 11:17:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 515d0a17-cd83-5781-b362-9ea184b1f5df, identifier: NU04580
2026-03-27 11:17:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 515d0a17-cd83-5781-b362-9ea184b1f5df with identifier: NU04580
2026-03-27 11:17:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 515d0a17-cd83-5781-b362-9ea184b1f5df with identifier: NU04580
2026-03-27 11:17:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 515d0a17-cd83-5781-b362-9ea184b1f5df with identifier: NU04580 to the API
2026-03-27 11:17:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-27T16:59:45Z',
 'fuel_type': 'diesel',
 'id': '515d0a17-cd83-5781-b362-9ea184b1f5df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU04580',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 243220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-02',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC',
 'transmission': 'manual',
 'trim': 'T BlueTEC',
 'year': 2016}
2026-03-27 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU04580%27 HTTP/1.1" 200 None
2026-03-27 11:17:03 [auto1.de] INFO: Saving data for NU04580: {'auction_closing_time': 1774630785.0, 'created_time': 1773341063.311142, 'last_price_update_time': 1774610223.565867}
2026-03-27 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU04580') HTTP/1.1" 204 0
2026-03-27 11:17:03 [auto1.de] INFO: Found listing with ID: LH30739
2026-03-27 11:17:03 [auto1.de] INFO: Found listing with ID: BB98458
2026-03-27 11:17:03 [auto1.de] INFO: Found listing with ID: VX06445
2026-03-27 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06445%27 HTTP/1.1" 200 None
2026-03-27 11:17:03 [auto1.de] INFO: Scrape type for VX06445: 2
2026-03-27 11:17:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f08dc822-4b4c-5c84-b321-2e726280e311 with identifier: VX06445
2026-03-27 11:17:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f08dc822-4b4c-5c84-b321-2e726280e311 with scrape type 2
2026-03-27 11:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f08dc822-4b4c-5c84-b321-2e726280e311 with scrape type 2
2026-03-27 11:17:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f08dc822-4b4c-5c84-b321-2e726280e311, identifier: VX06445
2026-03-27 11:17:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f08dc822-4b4c-5c84-b321-2e726280e311 with identifier: VX06445
2026-03-27 11:17:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f08dc822-4b4c-5c84-b321-2e726280e311 with identifier: VX06445
2026-03-27 11:17:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f08dc822-4b4c-5c84-b321-2e726280e311 with identifier: VX06445 to the API
2026-03-27 11:17:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-27T16:21:40Z',
 'fuel_type': 'hybrid',
 'id': 'f08dc822-4b4c-5c84-b321-2e726280e311',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX06445',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse Limousine',
 'odometer': 55456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse Limousine A 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-27 11:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06445%27 HTTP/1.1" 200 None
2026-03-27 11:17:04 [auto1.de] INFO: Saving data for VX06445: {'auction_closing_time': 1774628500.0, 'created_time': 1773382805.309694, 'last_price_update_time': 1774610224.115048}
2026-03-27 11:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX06445') HTTP/1.1" 204 0
2026-03-27 11:17:04 [auto1.de] INFO: Found listing with ID: CY25945
2026-03-27 11:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY25945%27 HTTP/1.1" 200 None
2026-03-27 11:17:04 [auto1.de] INFO: Scrape type for CY25945: 2
2026-03-27 11:17:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df25dfcc-c940-5b2c-b541-9ecfda37a889 with identifier: CY25945
2026-03-27 11:17:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df25dfcc-c940-5b2c-b541-9ecfda37a889 with scrape type 2
2026-03-27 11:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df25dfcc-c940-5b2c-b541-9ecfda37a889 with scrape type 2
2026-03-27 11:17:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df25dfcc-c940-5b2c-b541-9ecfda37a889, identifier: CY25945
2026-03-27 11:17:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df25dfcc-c940-5b2c-b541-9ecfda37a889 with identifier: CY25945
2026-03-27 11:17:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df25dfcc-c940-5b2c-b541-9ecfda37a889 with identifier: CY25945
2026-03-27 11:17:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df25dfcc-c940-5b2c-b541-9ecfda37a889 with identifier: CY25945 to the API
2026-03-27 11:17:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-27T16:10:47Z',
 'fuel_type': 'petrol',
 'id': 'df25dfcc-c940-5b2c-b541-9ecfda37a889',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY25945',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 68696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-12-18',
 'seller_name': None,
 'title': 'Opel Corsa 1.0 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2005}
2026-03-27 11:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY25945%27 HTTP/1.1" 200 None
2026-03-27 11:17:04 [auto1.de] INFO: Saving data for CY25945: {'auction_closing_time': 1774627847.0, 'created_time': 1774001890.007442, 'last_price_update_time': 1774610224.65821}
2026-03-27 11:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY25945') HTTP/1.1" 204 0
2026-03-27 11:17:04 [auto1.de] INFO: Found listing with ID: FP97739
2026-03-27 11:17:04 [auto1.de] INFO: Found listing with ID: MP68485
2026-03-27 11:17:04 [auto1.de] INFO: Found listing with ID: HX41069
2026-03-27 11:17:04 [auto1.de] INFO: Found listing with ID: GV24790
2026-03-27 11:17:04 [auto1.de] INFO: Found listing with ID: ZX03854
2026-03-27 11:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX03854%27 HTTP/1.1" 200 None
2026-03-27 11:17:04 [auto1.de] INFO: Scrape type for ZX03854: 2
2026-03-27 11:17:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13dbc212-3c65-5578-b2a3-e2db7606b4f5 with identifier: ZX03854
2026-03-27 11:17:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13dbc212-3c65-5578-b2a3-e2db7606b4f5 with scrape type 2
2026-03-27 11:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13dbc212-3c65-5578-b2a3-e2db7606b4f5 with scrape type 2
2026-03-27 11:17:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13dbc212-3c65-5578-b2a3-e2db7606b4f5, identifier: ZX03854
2026-03-27 11:17:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13dbc212-3c65-5578-b2a3-e2db7606b4f5 with identifier: ZX03854
2026-03-27 11:17:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13dbc212-3c65-5578-b2a3-e2db7606b4f5 with identifier: ZX03854
2026-03-27 11:17:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13dbc212-3c65-5578-b2a3-e2db7606b4f5 with identifier: ZX03854 to the API
2026-03-27 11:17:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:23:41Z',
 'fuel_type': 'petrol',
 'id': '13dbc212-3c65-5578-b2a3-e2db7606b4f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX03854',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 14018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-25',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.5 TSI ACT Monte Carlo',
 'transmission': 'automatic',
 'trim': 'Monte Carlo',
 'year': 2023}
2026-03-27 11:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX03854%27 HTTP/1.1" 200 None
2026-03-27 11:17:05 [auto1.de] INFO: Saving data for ZX03854: {'auction_closing_time': 1774628621.0, 'created_time': 1773380121.556792, 'last_price_update_time': 1774610225.110166}
2026-03-27 11:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX03854') HTTP/1.1" 204 0
2026-03-27 11:17:05 [auto1.de] INFO: Found listing with ID: WZ32773
2026-03-27 11:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ32773%27 HTTP/1.1" 200 None
2026-03-27 11:17:05 [auto1.de] INFO: Scrape type for WZ32773: 2
2026-03-27 11:17:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 339c61d7-3eb8-5336-9ec8-e791c28e59e5 with identifier: WZ32773
2026-03-27 11:17:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 339c61d7-3eb8-5336-9ec8-e791c28e59e5 with scrape type 2
2026-03-27 11:17:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 339c61d7-3eb8-5336-9ec8-e791c28e59e5 with scrape type 2
2026-03-27 11:17:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 339c61d7-3eb8-5336-9ec8-e791c28e59e5, identifier: WZ32773
2026-03-27 11:17:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 339c61d7-3eb8-5336-9ec8-e791c28e59e5 with identifier: WZ32773
2026-03-27 11:17:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 339c61d7-3eb8-5336-9ec8-e791c28e59e5 with identifier: WZ32773
2026-03-27 11:17:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 339c61d7-3eb8-5336-9ec8-e791c28e59e5 with identifier: WZ32773 to the API
2026-03-27 11:17:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-27T16:47:58Z',
 'fuel_type': 'petrol',
 'id': '339c61d7-3eb8-5336-9ec8-e791c28e59e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ32773',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 153049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-04-02',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2003}
2026-03-27 11:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ32773%27 HTTP/1.1" 200 None
2026-03-27 11:17:05 [auto1.de] INFO: Saving data for WZ32773: {'auction_closing_time': 1774630078.0, 'created_time': 1774034715.107828, 'last_price_update_time': 1774610225.633372}
2026-03-27 11:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ32773') HTTP/1.1" 204 0
2026-03-27 11:17:05 [auto1.de] INFO: Found listing with ID: TL55671
2026-03-27 11:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL55671%27 HTTP/1.1" 200 None
2026-03-27 11:17:05 [auto1.de] INFO: Scrape type for TL55671: 2
2026-03-27 11:17:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d40ecb4f-2171-581c-beec-fda0cb51aa62 with identifier: TL55671
2026-03-27 11:17:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d40ecb4f-2171-581c-beec-fda0cb51aa62 with scrape type 2
2026-03-27 11:17:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d40ecb4f-2171-581c-beec-fda0cb51aa62 with scrape type 2
2026-03-27 11:17:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d40ecb4f-2171-581c-beec-fda0cb51aa62, identifier: TL55671
2026-03-27 11:17:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d40ecb4f-2171-581c-beec-fda0cb51aa62 with identifier: TL55671
2026-03-27 11:17:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d40ecb4f-2171-581c-beec-fda0cb51aa62 with identifier: TL55671
2026-03-27 11:17:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d40ecb4f-2171-581c-beec-fda0cb51aa62 with identifier: TL55671 to the API
2026-03-27 11:17:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:22:36Z',
 'fuel_type': 'petrol',
 'id': 'd40ecb4f-2171-581c-beec-fda0cb51aa62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL55671',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 137958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-12',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Sound',
 'transmission': 'manual',
 'trim': 'Sound',
 'year': 2018}
2026-03-27 11:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL55671%27 HTTP/1.1" 200 None
2026-03-27 11:17:06 [auto1.de] INFO: Saving data for TL55671: {'auction_closing_time': 1774628556.0, 'created_time': 1773381704.504219, 'last_price_update_time': 1774610226.219012}
2026-03-27 11:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL55671') HTTP/1.1" 204 0
2026-03-27 11:17:06 [auto1.de] INFO: Found listing with ID: HA91024
2026-03-27 11:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA91024%27 HTTP/1.1" 200 None
2026-03-27 11:17:06 [auto1.de] INFO: Scrape type for HA91024: 2
2026-03-27 11:17:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f64602ff-fd85-51d2-909c-91fd23602e31 with identifier: HA91024
2026-03-27 11:17:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f64602ff-fd85-51d2-909c-91fd23602e31 with scrape type 2
2026-03-27 11:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f64602ff-fd85-51d2-909c-91fd23602e31 with scrape type 2
2026-03-27 11:17:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f64602ff-fd85-51d2-909c-91fd23602e31, identifier: HA91024
2026-03-27 11:17:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f64602ff-fd85-51d2-909c-91fd23602e31 with identifier: HA91024
2026-03-27 11:17:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f64602ff-fd85-51d2-909c-91fd23602e31 with identifier: HA91024
2026-03-27 11:17:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f64602ff-fd85-51d2-909c-91fd23602e31 with identifier: HA91024 to the API
2026-03-27 11:17:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:02:15Z',
 'fuel_type': 'petrol',
 'id': 'f64602ff-fd85-51d2-909c-91fd23602e31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA91024',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 97823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-23',
 'seller_name': None,
 'title': 'Renault Megane 1.3 TCe Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2019}
2026-03-27 11:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA91024%27 HTTP/1.1" 200 None
2026-03-27 11:17:06 [auto1.de] INFO: Saving data for HA91024: {'auction_closing_time': 1774627335.0, 'created_time': 1773426992.937684, 'last_price_update_time': 1774610226.844982}
2026-03-27 11:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA91024') HTTP/1.1" 204 0
2026-03-27 11:17:06 [auto1.de] INFO: Found listing with ID: PC62162
2026-03-27 11:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC62162%27 HTTP/1.1" 200 None
2026-03-27 11:17:06 [auto1.de] INFO: Scrape type for PC62162: 2
2026-03-27 11:17:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06f70dc4-02f3-59c4-a674-1241957d46b7 with identifier: PC62162
2026-03-27 11:17:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06f70dc4-02f3-59c4-a674-1241957d46b7 with scrape type 2
2026-03-27 11:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06f70dc4-02f3-59c4-a674-1241957d46b7 with scrape type 2
2026-03-27 11:17:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06f70dc4-02f3-59c4-a674-1241957d46b7, identifier: PC62162
2026-03-27 11:17:07 [scrapy.extensions.logstats] INFO: Crawled 729 pages (at 5 pages/min), scraped 1371 items (at 118 items/min)
2026-03-27 11:17:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 11:17:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06f70dc4-02f3-59c4-a674-1241957d46b7 with identifier: PC62162
2026-03-27 11:17:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06f70dc4-02f3-59c4-a674-1241957d46b7 with identifier: PC62162
2026-03-27 11:17:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06f70dc4-02f3-59c4-a674-1241957d46b7 with identifier: PC62162 to the API
2026-03-27 11:17:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:17:55Z',
 'fuel_type': 'electro',
 'id': '06f70dc4-02f3-59c4-a674-1241957d46b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC62162',
 'listing': 'auction',
 'make': 'Renault',
 'model': '5 E-Tech',
 'odometer': 7,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-19',
 'seller_name': None,
 'title': 'Renault 5 E-Tech electric drive 110 kW Comfort Range Techno',
 'transmission': 'automatic',
 'trim': 'Comfort Range Techno',
 'year': 2025}
2026-03-27 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC62162%27 HTTP/1.1" 200 None
2026-03-27 11:17:07 [auto1.de] INFO: Saving data for PC62162: {'auction_closing_time': 1774628275.0, 'created_time': 1774522382.294507, 'last_price_update_time': 1774610227.460103}
2026-03-27 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC62162') HTTP/1.1" 204 0
2026-03-27 11:17:07 [auto1.de] INFO: Found listing with ID: LN26385
2026-03-27 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN26385%27 HTTP/1.1" 200 None
2026-03-27 11:17:07 [auto1.de] INFO: Scrape type for LN26385: 2
2026-03-27 11:17:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0392d03b-208c-5ef2-ac0d-78c8ae66361d with identifier: LN26385
2026-03-27 11:17:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0392d03b-208c-5ef2-ac0d-78c8ae66361d with scrape type 2
2026-03-27 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0392d03b-208c-5ef2-ac0d-78c8ae66361d with scrape type 2
2026-03-27 11:17:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0392d03b-208c-5ef2-ac0d-78c8ae66361d, identifier: LN26385
2026-03-27 11:17:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0392d03b-208c-5ef2-ac0d-78c8ae66361d with identifier: LN26385
2026-03-27 11:17:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0392d03b-208c-5ef2-ac0d-78c8ae66361d with identifier: LN26385
2026-03-27 11:17:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0392d03b-208c-5ef2-ac0d-78c8ae66361d with identifier: LN26385 to the API
2026-03-27 11:17:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:19:51Z',
 'fuel_type': 'petrol',
 'id': '0392d03b-208c-5ef2-ac0d-78c8ae66361d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN26385',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 127777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-31',
 'seller_name': None,
 'title': 'Skoda Yeti 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN26385%27 HTTP/1.1" 200 None
2026-03-27 11:17:08 [auto1.de] INFO: Saving data for LN26385: {'auction_closing_time': 1774628391.0, 'created_time': 1772727927.185611, 'last_price_update_time': 1774610228.032623}
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN26385') HTTP/1.1" 204 0
2026-03-27 11:17:08 [auto1.de] INFO: Found listing with ID: TY15640
2026-03-27 11:17:08 [auto1.de] INFO: Found listing with ID: HS15462
2026-03-27 11:17:08 [auto1.de] INFO: Found listing with ID: GY49475
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY49475%27 HTTP/1.1" 200 None
2026-03-27 11:17:08 [auto1.de] INFO: Scrape type for GY49475: 2
2026-03-27 11:17:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dca7d81a-3126-5f52-bcf8-175ccbb1e6ae with identifier: GY49475
2026-03-27 11:17:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dca7d81a-3126-5f52-bcf8-175ccbb1e6ae with scrape type 2
2026-03-27 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dca7d81a-3126-5f52-bcf8-175ccbb1e6ae with scrape type 2
2026-03-27 11:17:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dca7d81a-3126-5f52-bcf8-175ccbb1e6ae, identifier: GY49475
2026-03-27 11:17:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dca7d81a-3126-5f52-bcf8-175ccbb1e6ae with identifier: GY49475
2026-03-27 11:17:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dca7d81a-3126-5f52-bcf8-175ccbb1e6ae with identifier: GY49475
2026-03-27 11:17:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dca7d81a-3126-5f52-bcf8-175ccbb1e6ae with identifier: GY49475 to the API
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:09:06Z',
 'fuel_type': 'petrol',
 'id': 'dca7d81a-3126-5f52-bcf8-175ccbb1e6ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY49475',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 201796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-07-15',
 'seller_name': None,
 'title': 'Honda Civic 1.4 LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2001}
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY49475%27 HTTP/1.1" 200 None
2026-03-27 11:17:08 [auto1.de] INFO: Saving data for GY49475: {'auction_closing_time': 1774627746.0, 'created_time': 1774002727.549319, 'last_price_update_time': 1774610228.463731}
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY49475') HTTP/1.1" 204 0
2026-03-27 11:17:08 [auto1.de] INFO: Found listing with ID: VU06993
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU06993%27 HTTP/1.1" 200 None
2026-03-27 11:17:08 [auto1.de] INFO: Scrape type for VU06993: 2
2026-03-27 11:17:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 282c5bf3-6ed6-5a9b-b6d8-c17759e784fa with identifier: VU06993
2026-03-27 11:17:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 282c5bf3-6ed6-5a9b-b6d8-c17759e784fa with scrape type 2
2026-03-27 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 282c5bf3-6ed6-5a9b-b6d8-c17759e784fa with scrape type 2
2026-03-27 11:17:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 282c5bf3-6ed6-5a9b-b6d8-c17759e784fa, identifier: VU06993
2026-03-27 11:17:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 282c5bf3-6ed6-5a9b-b6d8-c17759e784fa with identifier: VU06993
2026-03-27 11:17:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 282c5bf3-6ed6-5a9b-b6d8-c17759e784fa with identifier: VU06993
2026-03-27 11:17:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 282c5bf3-6ed6-5a9b-b6d8-c17759e784fa with identifier: VU06993 to the API
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:26:32Z',
 'fuel_type': 'petrol',
 'id': '282c5bf3-6ed6-5a9b-b6d8-c17759e784fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU06993',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 151876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-01',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 FSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2006}
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU06993%27 HTTP/1.1" 200 None
2026-03-27 11:17:08 [auto1.de] INFO: Saving data for VU06993: {'auction_closing_time': 1774628792.0, 'created_time': 1774034890.655815, 'last_price_update_time': 1774610228.913946}
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU06993') HTTP/1.1" 204 0
2026-03-27 11:17:08 [auto1.de] INFO: Found listing with ID: KL68094
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL68094%27 HTTP/1.1" 200 None
2026-03-27 11:17:08 [auto1.de] INFO: Scrape type for KL68094: 2
2026-03-27 11:17:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2 with identifier: KL68094
2026-03-27 11:17:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2 with scrape type 2
2026-03-27 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2 with scrape type 2
2026-03-27 11:17:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2, identifier: KL68094
2026-03-27 11:17:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2 with identifier: KL68094
2026-03-27 11:17:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2 with identifier: KL68094
2026-03-27 11:17:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2 with identifier: KL68094 to the API
2026-03-27 11:17:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:04:29Z',
 'fuel_type': 'petrol',
 'id': 'fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL68094',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 255845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-03-06',
 'seller_name': None,
 'title': 'Audi A4 1.8 Turbo',
 'transmission': 'manual',
 'trim': '',
 'year': 2000}
2026-03-27 11:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL68094%27 HTTP/1.1" 200 None
2026-03-27 11:17:09 [auto1.de] INFO: Saving data for KL68094: {'auction_closing_time': 1774627469.0, 'created_time': 1774035153.734983, 'last_price_update_time': 1774610229.378028}
2026-03-27 11:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL68094') HTTP/1.1" 204 0
2026-03-27 11:17:09 [auto1.de] INFO: Found listing with ID: JH64089
2026-03-27 11:17:09 [auto1.de] INFO: Found listing with ID: TG47191
2026-03-27 11:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG47191%27 HTTP/1.1" 200 None
2026-03-27 11:17:09 [auto1.de] INFO: Scrape type for TG47191: 2
2026-03-27 11:17:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1 with identifier: TG47191
2026-03-27 11:17:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1 with scrape type 2
2026-03-27 11:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1 with scrape type 2
2026-03-27 11:17:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1, identifier: TG47191
2026-03-27 11:17:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:17:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1 with identifier: TG47191
2026-03-27 11:17:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1 with identifier: TG47191
2026-03-27 11:17:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1 with identifier: TG47191 to the API
2026-03-27 11:17:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:27:19Z',
 'fuel_type': 'petrol',
 'id': 'fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG47191',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 208620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-31',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2008}
2026-03-27 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG47191%27 HTTP/1.1" 200 None
2026-03-27 11:17:10 [auto1.de] INFO: Saving data for TG47191: {'auction_closing_time': 1774628839.0, 'created_time': 1774034980.84504, 'last_price_update_time': 1774610230.560463}
2026-03-27 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG47191') HTTP/1.1" 204 0
2026-03-27 11:17:10 [auto1.de] INFO: Found listing with ID: DU86117
2026-03-27 11:17:10 [auto1.de] INFO: Found listing with ID: DS47068
2026-03-27 11:17:10 [auto1.de] INFO: Found listing with ID: BX26482
2026-03-27 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX26482%27 HTTP/1.1" 200 None
2026-03-27 11:17:10 [auto1.de] INFO: Scrape type for BX26482: 2
2026-03-27 11:17:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aabf142f-a197-52d1-b793-4cde5c00fb96 with identifier: BX26482
2026-03-27 11:17:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aabf142f-a197-52d1-b793-4cde5c00fb96 with scrape type 2
2026-03-27 11:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aabf142f-a197-52d1-b793-4cde5c00fb96 with scrape type 2
2026-03-27 11:17:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aabf142f-a197-52d1-b793-4cde5c00fb96, identifier: BX26482
2026-03-27 11:17:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aabf142f-a197-52d1-b793-4cde5c00fb96 with identifier: BX26482
2026-03-27 11:17:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aabf142f-a197-52d1-b793-4cde5c00fb96 with identifier: BX26482
2026-03-27 11:17:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aabf142f-a197-52d1-b793-4cde5c00fb96 with identifier: BX26482 to the API
2026-03-27 11:17:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-27T16:43:35Z',
 'fuel_type': 'diesel',
 'id': 'aabf142f-a197-52d1-b793-4cde5c00fb96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX26482',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 142514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-29',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 220 CDI BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2014}
2026-03-27 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX26482%27 HTTP/1.1" 200 None
2026-03-27 11:17:10 [auto1.de] INFO: Saving data for BX26482: {'auction_closing_time': 1774629815.0, 'created_time': 1773946491.170855, 'last_price_update_time': 1774610230.988042}
2026-03-27 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX26482') HTTP/1.1" 204 0
2026-03-27 11:17:11 [auto1.de] INFO: Found listing with ID: UL11229
2026-03-27 11:17:11 [auto1.de] INFO: Found listing with ID: KA18219
2026-03-27 11:17:11 [auto1.de] INFO: Found listing with ID: SW13301
2026-03-27 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW13301%27 HTTP/1.1" 200 None
2026-03-27 11:17:11 [auto1.de] INFO: Scrape type for SW13301: 2
2026-03-27 11:17:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d880e6f2-28da-5561-8baf-8ededeb56ad6 with identifier: SW13301
2026-03-27 11:17:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d880e6f2-28da-5561-8baf-8ededeb56ad6 with scrape type 2
2026-03-27 11:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d880e6f2-28da-5561-8baf-8ededeb56ad6 with scrape type 2
2026-03-27 11:17:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d880e6f2-28da-5561-8baf-8ededeb56ad6, identifier: SW13301
2026-03-27 11:17:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d880e6f2-28da-5561-8baf-8ededeb56ad6 with identifier: SW13301
2026-03-27 11:17:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d880e6f2-28da-5561-8baf-8ededeb56ad6 with identifier: SW13301
2026-03-27 11:17:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d880e6f2-28da-5561-8baf-8ededeb56ad6 with identifier: SW13301 to the API
2026-03-27 11:17:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-27T16:42:32Z',
 'fuel_type': 'diesel',
 'id': 'd880e6f2-28da-5561-8baf-8ededeb56ad6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW13301',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 109395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-11',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2017}
2026-03-27 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW13301%27 HTTP/1.1" 200 None
2026-03-27 11:17:11 [auto1.de] INFO: Saving data for SW13301: {'auction_closing_time': 1774629752.0, 'created_time': 1773427596.809157, 'last_price_update_time': 1774610231.528044}
2026-03-27 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW13301') HTTP/1.1" 204 0
2026-03-27 11:17:11 [auto1.de] INFO: Channel: 24h | Page: 262 | totalHits: 10698 | hits on page: 40
2026-03-27 11:17:11 [auto1.de] INFO: Found listing with ID: SM55936
2026-03-27 11:17:11 [auto1.de] INFO: Found listing with ID: CM15300
2026-03-27 11:17:11 [auto1.de] INFO: Found listing with ID: KA18219
2026-03-27 11:17:11 [auto1.de] INFO: Found listing with ID: SW13301
2026-03-27 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW13301%27 HTTP/1.1" 200 None
2026-03-27 11:17:11 [auto1.de] INFO: Scrape type for SW13301: 0
2026-03-27 11:17:11 [auto1.de] INFO: Found listing with ID: SM55936
2026-03-27 11:17:11 [auto1.de] INFO: Found listing with ID: CM15300
2026-03-27 11:17:11 [auto1.de] INFO: Found listing with ID: YH26863
2026-03-27 11:17:11 [auto1.de] INFO: Found listing with ID: SJ83553
2026-03-27 11:17:11 [auto1.de] INFO: Found listing with ID: AA40394
2026-03-27 11:17:11 [auto1.de] INFO: Found listing with ID: NX86319
2026-03-27 11:17:11 [auto1.de] INFO: Found listing with ID: VS20151
2026-03-27 11:17:11 [auto1.de] INFO: Found listing with ID: GW59315
2026-03-27 11:17:11 [auto1.de] INFO: Found listing with ID: RS40797
2026-03-27 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS40797%27 HTTP/1.1" 200 None
2026-03-27 11:17:11 [auto1.de] INFO: Scrape type for RS40797: 2
2026-03-27 11:17:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d06fb22-cffa-5565-b5ae-77a553a08762 with identifier: RS40797
2026-03-27 11:17:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d06fb22-cffa-5565-b5ae-77a553a08762 with scrape type 2
2026-03-27 11:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d06fb22-cffa-5565-b5ae-77a553a08762 with scrape type 2
2026-03-27 11:17:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d06fb22-cffa-5565-b5ae-77a553a08762, identifier: RS40797
2026-03-27 11:17:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:17:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d06fb22-cffa-5565-b5ae-77a553a08762 with identifier: RS40797
2026-03-27 11:17:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d06fb22-cffa-5565-b5ae-77a553a08762 with identifier: RS40797
2026-03-27 11:17:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d06fb22-cffa-5565-b5ae-77a553a08762 with identifier: RS40797 to the API
2026-03-27 11:17:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-27T16:27:01Z',
 'fuel_type': 'diesel',
 'id': '8d06fb22-cffa-5565-b5ae-77a553a08762',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS40797',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 154137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-29',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI BlueEfficiency Elegance',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Elegance',
 'year': 2014}
2026-03-27 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS40797%27 HTTP/1.1" 200 None
2026-03-27 11:17:12 [auto1.de] INFO: Saving data for RS40797: {'auction_closing_time': 1774628821.0, 'created_time': 1773946769.728992, 'last_price_update_time': 1774610232.030644}
2026-03-27 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS40797') HTTP/1.1" 204 0
2026-03-27 11:17:12 [auto1.de] INFO: Found listing with ID: XY94981
2026-03-27 11:17:12 [auto1.de] INFO: Found listing with ID: SD51082
2026-03-27 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD51082%27 HTTP/1.1" 200 None
2026-03-27 11:17:12 [auto1.de] INFO: Scrape type for SD51082: 2
2026-03-27 11:17:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f9c0557-9752-58f0-95f7-02dee6c8151d with identifier: SD51082
2026-03-27 11:17:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f9c0557-9752-58f0-95f7-02dee6c8151d with scrape type 2
2026-03-27 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f9c0557-9752-58f0-95f7-02dee6c8151d with scrape type 2
2026-03-27 11:17:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f9c0557-9752-58f0-95f7-02dee6c8151d, identifier: SD51082
2026-03-27 11:17:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f9c0557-9752-58f0-95f7-02dee6c8151d with identifier: SD51082
2026-03-27 11:17:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f9c0557-9752-58f0-95f7-02dee6c8151d with identifier: SD51082
2026-03-27 11:17:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f9c0557-9752-58f0-95f7-02dee6c8151d with identifier: SD51082 to the API
2026-03-27 11:17:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:46:17Z',
 'fuel_type': 'diesel',
 'id': '0f9c0557-9752-58f0-95f7-02dee6c8151d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD51082',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 202210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-22',
 'seller_name': None,
 'title': 'BMW 1er 120d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2016}
2026-03-27 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD51082%27 HTTP/1.1" 200 None
2026-03-27 11:17:12 [auto1.de] INFO: Saving data for SD51082: {'auction_closing_time': 1774629977.0, 'created_time': 1774522389.859817, 'last_price_update_time': 1774610232.67893}
2026-03-27 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD51082') HTTP/1.1" 204 0
2026-03-27 11:17:12 [auto1.de] INFO: Found listing with ID: GC11605
2026-03-27 11:17:12 [auto1.de] INFO: Found listing with ID: FD93722
2026-03-27 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD93722%27 HTTP/1.1" 200 None
2026-03-27 11:17:12 [auto1.de] INFO: Scrape type for FD93722: 2
2026-03-27 11:17:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 667e67f9-2345-593f-8877-e7b6129f7d00 with identifier: FD93722
2026-03-27 11:17:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 667e67f9-2345-593f-8877-e7b6129f7d00 with scrape type 2
2026-03-27 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 667e67f9-2345-593f-8877-e7b6129f7d00 with scrape type 2
2026-03-27 11:17:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 667e67f9-2345-593f-8877-e7b6129f7d00, identifier: FD93722
2026-03-27 11:17:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 667e67f9-2345-593f-8877-e7b6129f7d00 with identifier: FD93722
2026-03-27 11:17:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 667e67f9-2345-593f-8877-e7b6129f7d00 with identifier: FD93722
2026-03-27 11:17:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 667e67f9-2345-593f-8877-e7b6129f7d00 with identifier: FD93722 to the API
2026-03-27 11:17:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-27T16:21:22Z',
 'fuel_type': 'petrol',
 'id': '667e67f9-2345-593f-8877-e7b6129f7d00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD93722',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 153238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-26',
 'seller_name': None,
 'title': 'BMW 1er 118i Edition M Sport Shadow',
 'transmission': 'automatic',
 'trim': 'Edition M Sport Shadow',
 'year': 2017}
2026-03-27 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD93722%27 HTTP/1.1" 200 None
2026-03-27 11:17:13 [auto1.de] INFO: Saving data for FD93722: {'auction_closing_time': 1774628482.0, 'created_time': 1774119122.962841, 'last_price_update_time': 1774610233.154736}
2026-03-27 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD93722') HTTP/1.1" 204 0
2026-03-27 11:17:13 [auto1.de] INFO: Found listing with ID: TA95211
2026-03-27 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA95211%27 HTTP/1.1" 200 None
2026-03-27 11:17:13 [auto1.de] INFO: Scrape type for TA95211: 2
2026-03-27 11:17:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56cd4d27-6c7f-5503-a757-8d729027e732 with identifier: TA95211
2026-03-27 11:17:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56cd4d27-6c7f-5503-a757-8d729027e732 with scrape type 2
2026-03-27 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56cd4d27-6c7f-5503-a757-8d729027e732 with scrape type 2
2026-03-27 11:17:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56cd4d27-6c7f-5503-a757-8d729027e732, identifier: TA95211
2026-03-27 11:17:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56cd4d27-6c7f-5503-a757-8d729027e732 with identifier: TA95211
2026-03-27 11:17:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56cd4d27-6c7f-5503-a757-8d729027e732 with identifier: TA95211
2026-03-27 11:17:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56cd4d27-6c7f-5503-a757-8d729027e732 with identifier: TA95211 to the API
2026-03-27 11:17:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:00:54Z',
 'fuel_type': 'petrol',
 'id': '56cd4d27-6c7f-5503-a757-8d729027e732',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA95211',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 187428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-16',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-27 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA95211%27 HTTP/1.1" 200 None
2026-03-27 11:17:13 [auto1.de] INFO: Saving data for TA95211: {'auction_closing_time': 1774627254.0, 'created_time': 1774522386.291722, 'last_price_update_time': 1774610233.616217}
2026-03-27 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA95211') HTTP/1.1" 204 0
2026-03-27 11:17:13 [auto1.de] INFO: Found listing with ID: TS29154
2026-03-27 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS29154%27 HTTP/1.1" 200 None
2026-03-27 11:17:13 [auto1.de] INFO: Scrape type for TS29154: 2
2026-03-27 11:17:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5b293cd-7184-5a29-a7a3-d154506e9252 with identifier: TS29154
2026-03-27 11:17:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5b293cd-7184-5a29-a7a3-d154506e9252 with scrape type 2
2026-03-27 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5b293cd-7184-5a29-a7a3-d154506e9252 with scrape type 2
2026-03-27 11:17:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5b293cd-7184-5a29-a7a3-d154506e9252, identifier: TS29154
2026-03-27 11:17:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5b293cd-7184-5a29-a7a3-d154506e9252 with identifier: TS29154
2026-03-27 11:17:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5b293cd-7184-5a29-a7a3-d154506e9252 with identifier: TS29154
2026-03-27 11:17:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5b293cd-7184-5a29-a7a3-d154506e9252 with identifier: TS29154 to the API
2026-03-27 11:17:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-27T16:23:52Z',
 'fuel_type': 'petrol',
 'id': 'e5b293cd-7184-5a29-a7a3-d154506e9252',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS29154',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 44592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
 'transmission': 'automatic',
 'trim': 'GTI Clubsport',
 'year': 2023}
2026-03-27 11:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS29154%27 HTTP/1.1" 200 None
2026-03-27 11:17:14 [auto1.de] INFO: Saving data for TS29154: {'auction_closing_time': 1774628632.0, 'created_time': 1773137016.42725, 'last_price_update_time': 1774610234.083905}
2026-03-27 11:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS29154') HTTP/1.1" 204 0
2026-03-27 11:17:14 [auto1.de] INFO: Found listing with ID: DH60406
2026-03-27 11:17:14 [auto1.de] INFO: Found listing with ID: ZD16653
2026-03-27 11:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD16653%27 HTTP/1.1" 200 None
2026-03-27 11:17:14 [auto1.de] INFO: Scrape type for ZD16653: 2
2026-03-27 11:17:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d8c867f-748d-5af3-9826-7953364c7b8c with identifier: ZD16653
2026-03-27 11:17:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d8c867f-748d-5af3-9826-7953364c7b8c with scrape type 2
2026-03-27 11:17:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d8c867f-748d-5af3-9826-7953364c7b8c with scrape type 2
2026-03-27 11:17:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d8c867f-748d-5af3-9826-7953364c7b8c, identifier: ZD16653
2026-03-27 11:17:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d8c867f-748d-5af3-9826-7953364c7b8c with identifier: ZD16653
2026-03-27 11:17:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d8c867f-748d-5af3-9826-7953364c7b8c with identifier: ZD16653
2026-03-27 11:17:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d8c867f-748d-5af3-9826-7953364c7b8c with identifier: ZD16653 to the API
2026-03-27 11:17:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-27T16:52:53Z',
 'fuel_type': 'diesel',
 'id': '0d8c867f-748d-5af3-9826-7953364c7b8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD16653',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 186581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-19',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten lang EcoProfi',
 'transmission': 'manual',
 'trim': 'Kasten lang EcoProfi',
 'year': 2019}
2026-03-27 11:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD16653%27 HTTP/1.1" 200 None
2026-03-27 11:17:14 [auto1.de] INFO: Saving data for ZD16653: {'auction_closing_time': 1774630373.0, 'created_time': 1773382170.152582, 'last_price_update_time': 1774610234.53784}
2026-03-27 11:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD16653') HTTP/1.1" 204 0
2026-03-27 11:17:14 [auto1.de] INFO: Found listing with ID: BH21613
2026-03-27 11:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH21613%27 HTTP/1.1" 200 None
2026-03-27 11:17:14 [auto1.de] INFO: Scrape type for BH21613: 2
2026-03-27 11:17:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39d2b4b5-6ff9-5f5e-945e-cb10f714a909 with identifier: BH21613
2026-03-27 11:17:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39d2b4b5-6ff9-5f5e-945e-cb10f714a909 with scrape type 2
2026-03-27 11:17:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39d2b4b5-6ff9-5f5e-945e-cb10f714a909 with scrape type 2
2026-03-27 11:17:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39d2b4b5-6ff9-5f5e-945e-cb10f714a909, identifier: BH21613
2026-03-27 11:17:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39d2b4b5-6ff9-5f5e-945e-cb10f714a909 with identifier: BH21613
2026-03-27 11:17:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39d2b4b5-6ff9-5f5e-945e-cb10f714a909 with identifier: BH21613
2026-03-27 11:17:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39d2b4b5-6ff9-5f5e-945e-cb10f714a909 with identifier: BH21613 to the API
2026-03-27 11:17:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-27T16:26:58Z',
 'fuel_type': 'petrol',
 'id': '39d2b4b5-6ff9-5f5e-945e-cb10f714a909',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH21613',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 150812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-04',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2014}
2026-03-27 11:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH21613%27 HTTP/1.1" 200 None
2026-03-27 11:17:15 [auto1.de] INFO: Saving data for BH21613: {'auction_closing_time': 1774628818.0, 'created_time': 1773429673.28189, 'last_price_update_time': 1774610235.005004}
2026-03-27 11:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH21613') HTTP/1.1" 204 0
2026-03-27 11:17:15 [auto1.de] INFO: Found listing with ID: KM40443
2026-03-27 11:17:15 [auto1.de] INFO: Found listing with ID: RS40485
2026-03-27 11:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS40485%27 HTTP/1.1" 200 None
2026-03-27 11:17:15 [auto1.de] INFO: Scrape type for RS40485: 2
2026-03-27 11:17:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76b9b278-bbcc-58a8-9c0a-36292b7fd2a2 with identifier: RS40485
2026-03-27 11:17:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76b9b278-bbcc-58a8-9c0a-36292b7fd2a2 with scrape type 2
2026-03-27 11:17:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76b9b278-bbcc-58a8-9c0a-36292b7fd2a2 with scrape type 2
2026-03-27 11:17:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76b9b278-bbcc-58a8-9c0a-36292b7fd2a2, identifier: RS40485
2026-03-27 11:17:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76b9b278-bbcc-58a8-9c0a-36292b7fd2a2 with identifier: RS40485
2026-03-27 11:17:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76b9b278-bbcc-58a8-9c0a-36292b7fd2a2 with identifier: RS40485
2026-03-27 11:17:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76b9b278-bbcc-58a8-9c0a-36292b7fd2a2 with identifier: RS40485 to the API
2026-03-27 11:17:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-27T16:46:13Z',
 'fuel_type': 'petrol',
 'id': '76b9b278-bbcc-58a8-9c0a-36292b7fd2a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS40485',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 194739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TFSI GTI "Performance" BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI "Performance" BlueMotion',
 'year': 2016}
2026-03-27 11:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS40485%27 HTTP/1.1" 200 None
2026-03-27 11:17:15 [auto1.de] INFO: Saving data for RS40485: {'auction_closing_time': 1774629973.0, 'created_time': 1774118528.496655, 'last_price_update_time': 1774610235.470797}
2026-03-27 11:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS40485') HTTP/1.1" 204 0
2026-03-27 11:17:15 [auto1.de] INFO: Found listing with ID: YY11140
2026-03-27 11:17:15 [auto1.de] INFO: Found listing with ID: YJ21289
2026-03-27 11:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ21289%27 HTTP/1.1" 200 None
2026-03-27 11:17:15 [auto1.de] INFO: Scrape type for YJ21289: 2
2026-03-27 11:17:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78c6cb8d-c293-525b-9df6-2e4ef86ba37d with identifier: YJ21289
2026-03-27 11:17:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78c6cb8d-c293-525b-9df6-2e4ef86ba37d with scrape type 2
2026-03-27 11:17:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78c6cb8d-c293-525b-9df6-2e4ef86ba37d with scrape type 2
2026-03-27 11:17:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78c6cb8d-c293-525b-9df6-2e4ef86ba37d, identifier: YJ21289
2026-03-27 11:17:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78c6cb8d-c293-525b-9df6-2e4ef86ba37d with identifier: YJ21289
2026-03-27 11:17:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78c6cb8d-c293-525b-9df6-2e4ef86ba37d with identifier: YJ21289
2026-03-27 11:17:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78c6cb8d-c293-525b-9df6-2e4ef86ba37d with identifier: YJ21289 to the API
2026-03-27 11:17:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-27T16:02:52Z',
 'fuel_type': 'petrol',
 'id': '78c6cb8d-c293-525b-9df6-2e4ef86ba37d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ21289',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 66791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-29',
 'seller_name': None,
 'title': 'Audi A5 45 TFSI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-27 11:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ21289%27 HTTP/1.1" 200 None
2026-03-27 11:17:16 [auto1.de] INFO: Saving data for YJ21289: {'auction_closing_time': 1774627372.0, 'created_time': 1773382195.103127, 'last_price_update_time': 1774610236.082897}
2026-03-27 11:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ21289') HTTP/1.1" 204 0
2026-03-27 11:17:16 [auto1.de] INFO: Found listing with ID: LW85167
2026-03-27 11:17:16 [auto1.de] INFO: Found listing with ID: RY72669
2026-03-27 11:17:16 [auto1.de] INFO: Found listing with ID: BB98508
2026-03-27 11:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB98508%27 HTTP/1.1" 200 None
2026-03-27 11:17:16 [auto1.de] INFO: Scrape type for BB98508: 2
2026-03-27 11:17:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3014cef-c2f0-5c00-bf69-b8c6e9433806 with identifier: BB98508
2026-03-27 11:17:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3014cef-c2f0-5c00-bf69-b8c6e9433806 with scrape type 2
2026-03-27 11:17:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3014cef-c2f0-5c00-bf69-b8c6e9433806 with scrape type 2
2026-03-27 11:17:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3014cef-c2f0-5c00-bf69-b8c6e9433806, identifier: BB98508
2026-03-27 11:17:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3014cef-c2f0-5c00-bf69-b8c6e9433806 with identifier: BB98508
2026-03-27 11:17:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3014cef-c2f0-5c00-bf69-b8c6e9433806 with identifier: BB98508
2026-03-27 11:17:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3014cef-c2f0-5c00-bf69-b8c6e9433806 with identifier: BB98508 to the API
2026-03-27 11:17:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-27T16:57:36Z',
 'fuel_type': 'petrol',
 'id': 'a3014cef-c2f0-5c00-bf69-b8c6e9433806',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB98508',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 85246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-07',
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ 4Drive',
 'year': 2021}
2026-03-27 11:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB98508%27 HTTP/1.1" 200 None
2026-03-27 11:17:16 [auto1.de] INFO: Saving data for BB98508: {'auction_closing_time': 1774630656.0, 'created_time': 1774522407.517418, 'last_price_update_time': 1774610236.580548}
2026-03-27 11:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB98508') HTTP/1.1" 204 0
2026-03-27 11:17:16 [auto1.de] INFO: Found listing with ID: WW27642
2026-03-27 11:17:16 [auto1.de] INFO: Found listing with ID: WM09546
2026-03-27 11:17:16 [auto1.de] INFO: Found listing with ID: NR99017
2026-03-27 11:17:16 [auto1.de] INFO: Found listing with ID: GH26905
2026-03-27 11:17:16 [auto1.de] INFO: Found listing with ID: FL13933
2026-03-27 11:17:16 [auto1.de] INFO: Found listing with ID: UV59464
2026-03-27 11:17:16 [auto1.de] INFO: Found listing with ID: SP00408
2026-03-27 11:17:16 [auto1.de] INFO: Found listing with ID: KT21278
2026-03-27 11:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT21278%27 HTTP/1.1" 200 None
2026-03-27 11:17:16 [auto1.de] INFO: Scrape type for KT21278: 2
2026-03-27 11:17:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa19068a-47ae-5428-a87d-12588a51a103 with identifier: KT21278
2026-03-27 11:17:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa19068a-47ae-5428-a87d-12588a51a103 with scrape type 2
2026-03-27 11:17:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa19068a-47ae-5428-a87d-12588a51a103 with scrape type 2
2026-03-27 11:17:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa19068a-47ae-5428-a87d-12588a51a103, identifier: KT21278
2026-03-27 11:17:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa19068a-47ae-5428-a87d-12588a51a103 with identifier: KT21278
2026-03-27 11:17:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa19068a-47ae-5428-a87d-12588a51a103 with identifier: KT21278
2026-03-27 11:17:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa19068a-47ae-5428-a87d-12588a51a103 with identifier: KT21278 to the API
2026-03-27 11:17:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-27T16:01:55Z',
 'fuel_type': 'diesel',
 'id': 'fa19068a-47ae-5428-a87d-12588a51a103',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT21278',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 240033,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-12',
 'seller_name': None,
 'title': 'Suzuki SX4 1.6 DDiS Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2015}
2026-03-27 11:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT21278%27 HTTP/1.1" 200 None
2026-03-27 11:17:17 [auto1.de] INFO: Saving data for KT21278: {'auction_closing_time': 1774627315.0, 'created_time': 1774522481.556691, 'last_price_update_time': 1774610237.181625}
2026-03-27 11:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT21278') HTTP/1.1" 204 0
2026-03-27 11:17:17 [auto1.de] INFO: Found listing with ID: SZ20941
2026-03-27 11:17:17 [auto1.de] INFO: Found listing with ID: RC89302
2026-03-27 11:17:17 [auto1.de] INFO: Found listing with ID: DB61618
2026-03-27 11:17:17 [auto1.de] INFO: Found listing with ID: AL04579
2026-03-27 11:17:17 [auto1.de] INFO: Found listing with ID: JU26227
2026-03-27 11:17:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:17:26 [auto1.de] INFO: Channel: 24h | Page: 263 | totalHits: 10697 | hits on page: 40
2026-03-27 11:17:26 [auto1.de] INFO: Found listing with ID: AW92068
2026-03-27 11:17:26 [auto1.de] INFO: Found listing with ID: ZA60248
2026-03-27 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA60248%27 HTTP/1.1" 200 None
2026-03-27 11:17:26 [auto1.de] INFO: Scrape type for ZA60248: 2
2026-03-27 11:17:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05737405-74fe-59e4-9ff4-72278f6053ef with identifier: ZA60248
2026-03-27 11:17:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05737405-74fe-59e4-9ff4-72278f6053ef with scrape type 2
2026-03-27 11:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05737405-74fe-59e4-9ff4-72278f6053ef with scrape type 2
2026-03-27 11:17:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05737405-74fe-59e4-9ff4-72278f6053ef, identifier: ZA60248
2026-03-27 11:17:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05737405-74fe-59e4-9ff4-72278f6053ef with identifier: ZA60248
2026-03-27 11:17:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05737405-74fe-59e4-9ff4-72278f6053ef with identifier: ZA60248
2026-03-27 11:17:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05737405-74fe-59e4-9ff4-72278f6053ef with identifier: ZA60248 to the API
2026-03-27 11:17:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-27T16:04:22Z',
 'fuel_type': 'petrol',
 'id': '05737405-74fe-59e4-9ff4-72278f6053ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA60248',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 60565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ 4Drive',
 'year': 2020}
2026-03-27 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA60248%27 HTTP/1.1" 200 None
2026-03-27 11:17:26 [auto1.de] INFO: Saving data for ZA60248: {'auction_closing_time': 1774627462.0, 'created_time': 1773858955.103501, 'last_price_update_time': 1774610246.535331}
2026-03-27 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA60248') HTTP/1.1" 204 0
2026-03-27 11:17:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:17:26 [auto1.de] INFO: Found listing with ID: EC15325
2026-03-27 11:17:26 [auto1.de] INFO: Found listing with ID: SC87676
2026-03-27 11:17:26 [auto1.de] INFO: Found listing with ID: PU21802
2026-03-27 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU21802%27 HTTP/1.1" 200 None
2026-03-27 11:17:26 [auto1.de] INFO: Scrape type for PU21802: 2
2026-03-27 11:17:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e93b6f7-81f1-51a0-827c-96c1fbd4d55d with identifier: PU21802
2026-03-27 11:17:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e93b6f7-81f1-51a0-827c-96c1fbd4d55d with scrape type 2
2026-03-27 11:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e93b6f7-81f1-51a0-827c-96c1fbd4d55d with scrape type 2
2026-03-27 11:17:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e93b6f7-81f1-51a0-827c-96c1fbd4d55d, identifier: PU21802
2026-03-27 11:17:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e93b6f7-81f1-51a0-827c-96c1fbd4d55d with identifier: PU21802
2026-03-27 11:17:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e93b6f7-81f1-51a0-827c-96c1fbd4d55d with identifier: PU21802
2026-03-27 11:17:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e93b6f7-81f1-51a0-827c-96c1fbd4d55d with identifier: PU21802 to the API
2026-03-27 11:17:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:13:16Z',
 'fuel_type': 'petrol',
 'id': '8e93b6f7-81f1-51a0-827c-96c1fbd4d55d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU21802',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '323',
 'odometer': 203339,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-05-15',
 'seller_name': None,
 'title': 'Mazda 323 1.9 F Automatik',
 'transmission': 'automatic',
 'trim': 'F Automatik',
 'year': 2000}
2026-03-27 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU21802%27 HTTP/1.1" 200 None
2026-03-27 11:17:26 [auto1.de] INFO: Saving data for PU21802: {'auction_closing_time': 1774627996.0, 'created_time': 1774034328.509607, 'last_price_update_time': 1774610246.946059}
2026-03-27 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU21802') HTTP/1.1" 204 0
2026-03-27 11:17:26 [auto1.de] INFO: Found listing with ID: HG88240
2026-03-27 11:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG88240%27 HTTP/1.1" 200 None
2026-03-27 11:17:27 [auto1.de] INFO: Scrape type for HG88240: 2
2026-03-27 11:17:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b09b65b3-0f90-5917-b51a-c5d54b1addba with identifier: HG88240
2026-03-27 11:17:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b09b65b3-0f90-5917-b51a-c5d54b1addba with scrape type 2
2026-03-27 11:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b09b65b3-0f90-5917-b51a-c5d54b1addba with scrape type 2
2026-03-27 11:17:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b09b65b3-0f90-5917-b51a-c5d54b1addba, identifier: HG88240
2026-03-27 11:17:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b09b65b3-0f90-5917-b51a-c5d54b1addba with identifier: HG88240
2026-03-27 11:17:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b09b65b3-0f90-5917-b51a-c5d54b1addba with identifier: HG88240
2026-03-27 11:17:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b09b65b3-0f90-5917-b51a-c5d54b1addba with identifier: HG88240 to the API
2026-03-27 11:17:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-27T16:58:18Z',
 'fuel_type': 'diesel',
 'id': 'b09b65b3-0f90-5917-b51a-c5d54b1addba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG88240',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 259510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-14',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2026-03-27 11:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG88240%27 HTTP/1.1" 200 None
2026-03-27 11:17:27 [auto1.de] INFO: Saving data for HG88240: {'auction_closing_time': 1774630698.0, 'created_time': 1773383377.325067, 'last_price_update_time': 1774610247.442152}
2026-03-27 11:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG88240') HTTP/1.1" 204 0
2026-03-27 11:17:27 [auto1.de] INFO: Found listing with ID: NZ56847
2026-03-27 11:17:27 [auto1.de] INFO: Found listing with ID: DP00162
2026-03-27 11:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP00162%27 HTTP/1.1" 200 None
2026-03-27 11:17:27 [auto1.de] INFO: Scrape type for DP00162: 2
2026-03-27 11:17:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8245bdf6-662b-5846-b1e5-6f9dacfbf7d1 with identifier: DP00162
2026-03-27 11:17:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8245bdf6-662b-5846-b1e5-6f9dacfbf7d1 with scrape type 2
2026-03-27 11:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8245bdf6-662b-5846-b1e5-6f9dacfbf7d1 with scrape type 2
2026-03-27 11:17:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8245bdf6-662b-5846-b1e5-6f9dacfbf7d1, identifier: DP00162
2026-03-27 11:17:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8245bdf6-662b-5846-b1e5-6f9dacfbf7d1 with identifier: DP00162
2026-03-27 11:17:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8245bdf6-662b-5846-b1e5-6f9dacfbf7d1 with identifier: DP00162
2026-03-27 11:17:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8245bdf6-662b-5846-b1e5-6f9dacfbf7d1 with identifier: DP00162 to the API
2026-03-27 11:17:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:23:18Z',
 'fuel_type': 'diesel',
 'id': '8245bdf6-662b-5846-b1e5-6f9dacfbf7d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP00162',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 237483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-05',
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 TDCi Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2017}
2026-03-27 11:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP00162%27 HTTP/1.1" 200 None
2026-03-27 11:17:28 [auto1.de] INFO: Saving data for DP00162: {'auction_closing_time': 1774628598.0, 'created_time': 1773427075.494201, 'last_price_update_time': 1774610248.004687}
2026-03-27 11:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP00162') HTTP/1.1" 204 0
2026-03-27 11:17:28 [auto1.de] INFO: Found listing with ID: CF84548
2026-03-27 11:17:28 [auto1.de] INFO: Found listing with ID: XA52388
2026-03-27 11:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA52388%27 HTTP/1.1" 200 None
2026-03-27 11:17:28 [auto1.de] INFO: Scrape type for XA52388: 2
2026-03-27 11:17:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c730986c-403f-50a4-a5fc-c49eb0d394fb with identifier: XA52388
2026-03-27 11:17:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c730986c-403f-50a4-a5fc-c49eb0d394fb with scrape type 2
2026-03-27 11:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c730986c-403f-50a4-a5fc-c49eb0d394fb with scrape type 2
2026-03-27 11:17:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c730986c-403f-50a4-a5fc-c49eb0d394fb, identifier: XA52388
2026-03-27 11:17:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c730986c-403f-50a4-a5fc-c49eb0d394fb with identifier: XA52388
2026-03-27 11:17:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c730986c-403f-50a4-a5fc-c49eb0d394fb with identifier: XA52388
2026-03-27 11:17:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c730986c-403f-50a4-a5fc-c49eb0d394fb with identifier: XA52388 to the API
2026-03-27 11:17:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-27T16:07:49Z',
 'fuel_type': 'petrol',
 'id': 'c730986c-403f-50a4-a5fc-c49eb0d394fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA52388',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 90767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-20',
 'seller_name': None,
 'title': 'BMW X2 xDrive 20i M Sport X',
 'transmission': 'automatic',
 'trim': 'M Sport X',
 'year': 2018}
2026-03-27 11:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA52388%27 HTTP/1.1" 200 None
2026-03-27 11:17:28 [auto1.de] INFO: Saving data for XA52388: {'auction_closing_time': 1774627669.0, 'created_time': 1773429443.888774, 'last_price_update_time': 1774610248.46897}
2026-03-27 11:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA52388') HTTP/1.1" 204 0
2026-03-27 11:17:28 [auto1.de] INFO: Found listing with ID: SB41879
2026-03-27 11:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB41879%27 HTTP/1.1" 200 None
2026-03-27 11:17:28 [auto1.de] INFO: Scrape type for SB41879: 2
2026-03-27 11:17:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04b17f29-b97f-5502-bb75-13706cd02cf3 with identifier: SB41879
2026-03-27 11:17:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04b17f29-b97f-5502-bb75-13706cd02cf3 with scrape type 2
2026-03-27 11:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04b17f29-b97f-5502-bb75-13706cd02cf3 with scrape type 2
2026-03-27 11:17:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04b17f29-b97f-5502-bb75-13706cd02cf3, identifier: SB41879
2026-03-27 11:17:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04b17f29-b97f-5502-bb75-13706cd02cf3 with identifier: SB41879
2026-03-27 11:17:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:17:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-27 11:17:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:17:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04b17f29-b97f-5502-bb75-13706cd02cf3 with identifier: SB41879
2026-03-27 11:17:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04b17f29-b97f-5502-bb75-13706cd02cf3 with identifier: SB41879 to the API
2026-03-27 11:17:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-27T16:56:20Z',
 'fuel_type': 'petrol',
 'id': '04b17f29-b97f-5502-bb75-13706cd02cf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB41879',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 39080,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-03',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2019}
2026-03-27 11:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB41879%27 HTTP/1.1" 200 None
2026-03-27 11:17:29 [auto1.de] INFO: Saving data for SB41879: {'auction_closing_time': 1774630580.0, 'created_time': 1774522405.815155, 'last_price_update_time': 1774610249.104319}
2026-03-27 11:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB41879') HTTP/1.1" 204 0
2026-03-27 11:17:29 [auto1.de] INFO: Found listing with ID: FZ49091
2026-03-27 11:17:29 [auto1.de] INFO: Found listing with ID: KY27003
2026-03-27 11:17:29 [auto1.de] INFO: Found listing with ID: YB33433
2026-03-27 11:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB33433%27 HTTP/1.1" 200 None
2026-03-27 11:17:29 [auto1.de] INFO: Scrape type for YB33433: 2
2026-03-27 11:17:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0846965c-2334-5c45-b444-e75737492cc1 with identifier: YB33433
2026-03-27 11:17:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0846965c-2334-5c45-b444-e75737492cc1 with scrape type 2
2026-03-27 11:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0846965c-2334-5c45-b444-e75737492cc1 with scrape type 2
2026-03-27 11:17:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0846965c-2334-5c45-b444-e75737492cc1, identifier: YB33433
2026-03-27 11:17:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0846965c-2334-5c45-b444-e75737492cc1 with identifier: YB33433
2026-03-27 11:17:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0846965c-2334-5c45-b444-e75737492cc1 with identifier: YB33433
2026-03-27 11:17:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0846965c-2334-5c45-b444-e75737492cc1 with identifier: YB33433 to the API
2026-03-27 11:17:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-27T16:39:16Z',
 'fuel_type': 'diesel',
 'id': '0846965c-2334-5c45-b444-e75737492cc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB33433',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 154420,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-06',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2019}
2026-03-27 11:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB33433%27 HTTP/1.1" 200 None
2026-03-27 11:17:29 [auto1.de] INFO: Saving data for YB33433: {'auction_closing_time': 1774629556.0, 'created_time': 1774522431.332214, 'last_price_update_time': 1774610249.590744}
2026-03-27 11:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB33433') HTTP/1.1" 204 0
2026-03-27 11:17:29 [auto1.de] INFO: Found listing with ID: GW76676
2026-03-27 11:17:29 [auto1.de] INFO: Found listing with ID: LB09285
2026-03-27 11:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB09285%27 HTTP/1.1" 200 None
2026-03-27 11:17:29 [auto1.de] INFO: Scrape type for LB09285: 2
2026-03-27 11:17:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94ff4c94-711f-5ae2-a959-4f29f4edd9c5 with identifier: LB09285
2026-03-27 11:17:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94ff4c94-711f-5ae2-a959-4f29f4edd9c5 with scrape type 2
2026-03-27 11:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94ff4c94-711f-5ae2-a959-4f29f4edd9c5 with scrape type 2
2026-03-27 11:17:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94ff4c94-711f-5ae2-a959-4f29f4edd9c5, identifier: LB09285
2026-03-27 11:17:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94ff4c94-711f-5ae2-a959-4f29f4edd9c5 with identifier: LB09285
2026-03-27 11:17:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94ff4c94-711f-5ae2-a959-4f29f4edd9c5 with identifier: LB09285
2026-03-27 11:17:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94ff4c94-711f-5ae2-a959-4f29f4edd9c5 with identifier: LB09285 to the API
2026-03-27 11:17:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-27T16:16:19Z',
 'fuel_type': 'diesel',
 'id': '94ff4c94-711f-5ae2-a959-4f29f4edd9c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB09285',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 147747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-13',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 CRDi GT Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line 4WD',
 'year': 2017}
2026-03-27 11:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB09285%27 HTTP/1.1" 200 None
2026-03-27 11:17:30 [auto1.de] INFO: Saving data for LB09285: {'auction_closing_time': 1774628179.0, 'created_time': 1773429571.823721, 'last_price_update_time': 1774610250.039033}
2026-03-27 11:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB09285') HTTP/1.1" 204 0
2026-03-27 11:17:30 [auto1.de] INFO: Found listing with ID: BH40486
2026-03-27 11:17:30 [auto1.de] INFO: Found listing with ID: GB19657
2026-03-27 11:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB19657%27 HTTP/1.1" 200 None
2026-03-27 11:17:30 [auto1.de] INFO: Scrape type for GB19657: 2
2026-03-27 11:17:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6eb3ecf-0385-5581-9ea6-c3c495d3066b with identifier: GB19657
2026-03-27 11:17:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6eb3ecf-0385-5581-9ea6-c3c495d3066b with scrape type 2
2026-03-27 11:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6eb3ecf-0385-5581-9ea6-c3c495d3066b with scrape type 2
2026-03-27 11:17:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6eb3ecf-0385-5581-9ea6-c3c495d3066b, identifier: GB19657
2026-03-27 11:17:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6eb3ecf-0385-5581-9ea6-c3c495d3066b with identifier: GB19657
2026-03-27 11:17:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6eb3ecf-0385-5581-9ea6-c3c495d3066b with identifier: GB19657
2026-03-27 11:17:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6eb3ecf-0385-5581-9ea6-c3c495d3066b with identifier: GB19657 to the API
2026-03-27 11:17:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-27T16:54:55Z',
 'fuel_type': 'petrol',
 'id': 'a6eb3ecf-0385-5581-9ea6-c3c495d3066b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB19657',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 118632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-24',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-27 11:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB19657%27 HTTP/1.1" 200 None
2026-03-27 11:17:30 [auto1.de] INFO: Saving data for GB19657: {'auction_closing_time': 1774630495.0, 'created_time': 1773402151.748617, 'last_price_update_time': 1774610250.450605}
2026-03-27 11:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB19657') HTTP/1.1" 204 0
2026-03-27 11:17:30 [auto1.de] INFO: Found listing with ID: GJ17165
2026-03-27 11:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ17165%27 HTTP/1.1" 200 None
2026-03-27 11:17:30 [auto1.de] INFO: Scrape type for GJ17165: 2
2026-03-27 11:17:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3312acc6-51f5-5b01-a8b7-fa7ebd2513ed with identifier: GJ17165
2026-03-27 11:17:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3312acc6-51f5-5b01-a8b7-fa7ebd2513ed with scrape type 2
2026-03-27 11:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3312acc6-51f5-5b01-a8b7-fa7ebd2513ed with scrape type 2
2026-03-27 11:17:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3312acc6-51f5-5b01-a8b7-fa7ebd2513ed, identifier: GJ17165
2026-03-27 11:17:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3312acc6-51f5-5b01-a8b7-fa7ebd2513ed with identifier: GJ17165
2026-03-27 11:17:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3312acc6-51f5-5b01-a8b7-fa7ebd2513ed with identifier: GJ17165
2026-03-27 11:17:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3312acc6-51f5-5b01-a8b7-fa7ebd2513ed with identifier: GJ17165 to the API
2026-03-27 11:17:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-27T16:24:49Z',
 'fuel_type': 'petrol',
 'id': '3312acc6-51f5-5b01-a8b7-fa7ebd2513ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ17165',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 89105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-12',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 Diamant Edition+ 2WD',
 'transmission': 'manual',
 'trim': 'Diamant Edition+ 2WD',
 'year': 2018}
2026-03-27 11:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ17165%27 HTTP/1.1" 200 None
2026-03-27 11:17:31 [auto1.de] INFO: Saving data for GJ17165: {'auction_closing_time': 1774628689.0, 'created_time': 1773380668.996596, 'last_price_update_time': 1774610251.077213}
2026-03-27 11:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ17165') HTTP/1.1" 204 0
2026-03-27 11:17:31 [auto1.de] INFO: Found listing with ID: SZ10404
2026-03-27 11:17:31 [auto1.de] INFO: Found listing with ID: CK66212
2026-03-27 11:17:31 [auto1.de] INFO: Found listing with ID: PK14357
2026-03-27 11:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK14357%27 HTTP/1.1" 200 None
2026-03-27 11:17:31 [auto1.de] INFO: Scrape type for PK14357: 2
2026-03-27 11:17:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d720d235-71f7-554a-a721-5a1a8e01991c with identifier: PK14357
2026-03-27 11:17:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d720d235-71f7-554a-a721-5a1a8e01991c with scrape type 2
2026-03-27 11:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d720d235-71f7-554a-a721-5a1a8e01991c with scrape type 2
2026-03-27 11:17:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d720d235-71f7-554a-a721-5a1a8e01991c, identifier: PK14357
2026-03-27 11:17:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d720d235-71f7-554a-a721-5a1a8e01991c with identifier: PK14357
2026-03-27 11:17:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d720d235-71f7-554a-a721-5a1a8e01991c with identifier: PK14357
2026-03-27 11:17:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d720d235-71f7-554a-a721-5a1a8e01991c with identifier: PK14357 to the API
2026-03-27 11:17:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 209,
 'expiration_date': '2026-03-27T16:06:41Z',
 'fuel_type': 'diesel',
 'id': 'd720d235-71f7-554a-a721-5a1a8e01991c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK14357',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 104659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-01',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Veloce Q4',
 'transmission': 'automatic',
 'trim': 'Veloce Q4',
 'year': 2023}
2026-03-27 11:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK14357%27 HTTP/1.1" 200 None
2026-03-27 11:17:31 [auto1.de] INFO: Saving data for PK14357: {'auction_closing_time': 1774627601.0, 'created_time': 1774522431.802071, 'last_price_update_time': 1774610251.769016}
2026-03-27 11:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK14357') HTTP/1.1" 204 0
2026-03-27 11:17:31 [auto1.de] INFO: Found listing with ID: XK64077
2026-03-27 11:17:31 [auto1.de] INFO: Found listing with ID: CC01959
2026-03-27 11:17:31 [auto1.de] INFO: Found listing with ID: RW26653
2026-03-27 11:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW26653%27 HTTP/1.1" 200 None
2026-03-27 11:17:31 [auto1.de] INFO: Scrape type for RW26653: 2
2026-03-27 11:17:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a7e1c8e-d4dd-5f99-93e8-9e8989116883 with identifier: RW26653
2026-03-27 11:17:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a7e1c8e-d4dd-5f99-93e8-9e8989116883 with scrape type 2
2026-03-27 11:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a7e1c8e-d4dd-5f99-93e8-9e8989116883 with scrape type 2
2026-03-27 11:17:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a7e1c8e-d4dd-5f99-93e8-9e8989116883, identifier: RW26653
2026-03-27 11:17:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a7e1c8e-d4dd-5f99-93e8-9e8989116883 with identifier: RW26653
2026-03-27 11:17:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a7e1c8e-d4dd-5f99-93e8-9e8989116883 with identifier: RW26653
2026-03-27 11:17:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a7e1c8e-d4dd-5f99-93e8-9e8989116883 with identifier: RW26653 to the API
2026-03-27 11:17:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:13:58Z',
 'fuel_type': 'petrol',
 'id': '8a7e1c8e-d4dd-5f99-93e8-9e8989116883',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW26653',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 28147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-29',
 'seller_name': None,
 'title': 'Cupra Formentor 1.5 TSI ACT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-27 11:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW26653%27 HTTP/1.1" 200 None
2026-03-27 11:17:32 [auto1.de] INFO: Saving data for RW26653: {'auction_closing_time': 1774628038.0, 'created_time': 1773341713.150887, 'last_price_update_time': 1774610252.243349}
2026-03-27 11:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW26653') HTTP/1.1" 204 0
2026-03-27 11:17:32 [auto1.de] INFO: Found listing with ID: LC91411
2026-03-27 11:17:32 [auto1.de] INFO: Found listing with ID: LC02400
2026-03-27 11:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC02400%27 HTTP/1.1" 200 None
2026-03-27 11:17:32 [auto1.de] INFO: Scrape type for LC02400: 2
2026-03-27 11:17:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ce864a3-6bfc-5ff2-bcdb-01efb0e30763 with identifier: LC02400
2026-03-27 11:17:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ce864a3-6bfc-5ff2-bcdb-01efb0e30763 with scrape type 2
2026-03-27 11:17:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ce864a3-6bfc-5ff2-bcdb-01efb0e30763 with scrape type 2
2026-03-27 11:17:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ce864a3-6bfc-5ff2-bcdb-01efb0e30763, identifier: LC02400
2026-03-27 11:17:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ce864a3-6bfc-5ff2-bcdb-01efb0e30763 with identifier: LC02400
2026-03-27 11:17:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ce864a3-6bfc-5ff2-bcdb-01efb0e30763 with identifier: LC02400
2026-03-27 11:17:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ce864a3-6bfc-5ff2-bcdb-01efb0e30763 with identifier: LC02400 to the API
2026-03-27 11:17:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-27T16:38:20Z',
 'fuel_type': 'diesel',
 'id': '7ce864a3-6bfc-5ff2-bcdb-01efb0e30763',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC02400',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 201549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-19',
 'seller_name': None,
 'title': 'BMW 3er 320d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2012}
2026-03-27 11:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC02400%27 HTTP/1.1" 200 None
2026-03-27 11:17:32 [auto1.de] INFO: Saving data for LC02400: {'auction_closing_time': 1774629500.0, 'created_time': 1773226612.44419, 'last_price_update_time': 1774610252.695101}
2026-03-27 11:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC02400') HTTP/1.1" 204 0
2026-03-27 11:17:32 [auto1.de] INFO: Found listing with ID: LA66980
2026-03-27 11:17:32 [auto1.de] INFO: Found listing with ID: DU61724
2026-03-27 11:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU61724%27 HTTP/1.1" 200 None
2026-03-27 11:17:32 [auto1.de] INFO: Scrape type for DU61724: 2
2026-03-27 11:17:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 927723de-63d3-55a0-83bc-2af62e798cbc with identifier: DU61724
2026-03-27 11:17:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 927723de-63d3-55a0-83bc-2af62e798cbc with scrape type 2
2026-03-27 11:17:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 927723de-63d3-55a0-83bc-2af62e798cbc with scrape type 2
2026-03-27 11:17:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 927723de-63d3-55a0-83bc-2af62e798cbc, identifier: DU61724
2026-03-27 11:17:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 927723de-63d3-55a0-83bc-2af62e798cbc with identifier: DU61724
2026-03-27 11:17:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 927723de-63d3-55a0-83bc-2af62e798cbc with identifier: DU61724
2026-03-27 11:17:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 927723de-63d3-55a0-83bc-2af62e798cbc with identifier: DU61724 to the API
2026-03-27 11:17:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-27T16:47:38Z',
 'fuel_type': 'diesel',
 'id': '927723de-63d3-55a0-83bc-2af62e798cbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU61724',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 212801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-02',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-27 11:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU61724%27 HTTP/1.1" 200 None
2026-03-27 11:17:33 [auto1.de] INFO: Saving data for DU61724: {'auction_closing_time': 1774630058.0, 'created_time': 1773340864.194598, 'last_price_update_time': 1774610253.120437}
2026-03-27 11:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU61724') HTTP/1.1" 204 0
2026-03-27 11:17:33 [auto1.de] INFO: Found listing with ID: DA66634
2026-03-27 11:17:33 [auto1.de] INFO: Found listing with ID: CS88634
2026-03-27 11:17:33 [auto1.de] INFO: Found listing with ID: FH98757
2026-03-27 11:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH98757%27 HTTP/1.1" 200 None
2026-03-27 11:17:33 [auto1.de] INFO: Scrape type for FH98757: 2
2026-03-27 11:17:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 558baaeb-a376-5287-927d-0b0dba5a804e with identifier: FH98757
2026-03-27 11:17:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 558baaeb-a376-5287-927d-0b0dba5a804e with scrape type 2
2026-03-27 11:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 558baaeb-a376-5287-927d-0b0dba5a804e with scrape type 2
2026-03-27 11:17:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 558baaeb-a376-5287-927d-0b0dba5a804e, identifier: FH98757
2026-03-27 11:17:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 558baaeb-a376-5287-927d-0b0dba5a804e with identifier: FH98757
2026-03-27 11:17:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 558baaeb-a376-5287-927d-0b0dba5a804e with identifier: FH98757
2026-03-27 11:17:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 558baaeb-a376-5287-927d-0b0dba5a804e with identifier: FH98757 to the API
2026-03-27 11:17:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:33:04Z',
 'fuel_type': 'diesel',
 'id': '558baaeb-a376-5287-927d-0b0dba5a804e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH98757',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'CC',
 'odometer': 179423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-14',
 'seller_name': None,
 'title': 'Volkswagen CC 2.0 TDI BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'BlueMotion Tech',
 'year': 2013}
2026-03-27 11:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH98757%27 HTTP/1.1" 200 None
2026-03-27 11:17:33 [auto1.de] INFO: Saving data for FH98757: {'auction_closing_time': 1774629184.0, 'created_time': 1773429394.454008, 'last_price_update_time': 1774610253.669014}
2026-03-27 11:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH98757') HTTP/1.1" 204 0
2026-03-27 11:17:33 [auto1.de] INFO: Found listing with ID: DP55195
2026-03-27 11:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP55195%27 HTTP/1.1" 200 None
2026-03-27 11:17:33 [auto1.de] INFO: Scrape type for DP55195: 2
2026-03-27 11:17:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03c75654-15b0-5492-911c-3408f638ccf3 with identifier: DP55195
2026-03-27 11:17:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03c75654-15b0-5492-911c-3408f638ccf3 with scrape type 2
2026-03-27 11:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03c75654-15b0-5492-911c-3408f638ccf3 with scrape type 2
2026-03-27 11:17:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03c75654-15b0-5492-911c-3408f638ccf3, identifier: DP55195
2026-03-27 11:17:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03c75654-15b0-5492-911c-3408f638ccf3 with identifier: DP55195
2026-03-27 11:17:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03c75654-15b0-5492-911c-3408f638ccf3 with identifier: DP55195
2026-03-27 11:17:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03c75654-15b0-5492-911c-3408f638ccf3 with identifier: DP55195 to the API
2026-03-27 11:17:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-27T16:02:29Z',
 'fuel_type': 'diesel',
 'id': '03c75654-15b0-5492-911c-3408f638ccf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP55195',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 109329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-23',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2020}
2026-03-27 11:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP55195%27 HTTP/1.1" 200 None
2026-03-27 11:17:34 [auto1.de] INFO: Saving data for DP55195: {'auction_closing_time': 1774627349.0, 'created_time': 1773427167.223173, 'last_price_update_time': 1774610254.170137}
2026-03-27 11:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP55195') HTTP/1.1" 204 0
2026-03-27 11:17:34 [auto1.de] INFO: Found listing with ID: HM36828
2026-03-27 11:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM36828%27 HTTP/1.1" 200 None
2026-03-27 11:17:34 [auto1.de] INFO: Scrape type for HM36828: 2
2026-03-27 11:17:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdd0b695-89da-5fec-9f8a-0f89bf536b3e with identifier: HM36828
2026-03-27 11:17:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdd0b695-89da-5fec-9f8a-0f89bf536b3e with scrape type 2
2026-03-27 11:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdd0b695-89da-5fec-9f8a-0f89bf536b3e with scrape type 2
2026-03-27 11:17:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdd0b695-89da-5fec-9f8a-0f89bf536b3e, identifier: HM36828
2026-03-27 11:17:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdd0b695-89da-5fec-9f8a-0f89bf536b3e with identifier: HM36828
2026-03-27 11:17:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdd0b695-89da-5fec-9f8a-0f89bf536b3e with identifier: HM36828
2026-03-27 11:17:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdd0b695-89da-5fec-9f8a-0f89bf536b3e with identifier: HM36828 to the API
2026-03-27 11:17:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:03:50Z',
 'fuel_type': 'diesel',
 'id': 'bdd0b695-89da-5fec-9f8a-0f89bf536b3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM36828',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 119372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-16',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 119 CDI lang 4Matic',
 'transmission': 'automatic',
 'trim': 'lang 4Matic',
 'year': 2017}
2026-03-27 11:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM36828%27 HTTP/1.1" 200 None
2026-03-27 11:17:34 [auto1.de] INFO: Saving data for HM36828: {'auction_closing_time': 1774627430.0, 'created_time': 1773861769.99404, 'last_price_update_time': 1774610254.636085}
2026-03-27 11:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM36828') HTTP/1.1" 204 0
2026-03-27 11:17:34 [auto1.de] INFO: Found listing with ID: UW10679
2026-03-27 11:17:34 [auto1.de] INFO: Found listing with ID: FR53329
2026-03-27 11:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR53329%27 HTTP/1.1" 200 None
2026-03-27 11:17:34 [auto1.de] INFO: Scrape type for FR53329: 0
2026-03-27 11:17:34 [auto1.de] INFO: Found listing with ID: RS09713
2026-03-27 11:17:34 [auto1.de] INFO: Found listing with ID: AD30182
2026-03-27 11:17:34 [auto1.de] INFO: Found listing with ID: CH96061
2026-03-27 11:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH96061%27 HTTP/1.1" 200 None
2026-03-27 11:17:34 [auto1.de] INFO: Scrape type for CH96061: 2
2026-03-27 11:17:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f6346dd-c240-5c93-b8eb-47bdf5fadaee with identifier: CH96061
2026-03-27 11:17:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f6346dd-c240-5c93-b8eb-47bdf5fadaee with scrape type 2
2026-03-27 11:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f6346dd-c240-5c93-b8eb-47bdf5fadaee with scrape type 2
2026-03-27 11:17:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f6346dd-c240-5c93-b8eb-47bdf5fadaee, identifier: CH96061
2026-03-27 11:17:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f6346dd-c240-5c93-b8eb-47bdf5fadaee with identifier: CH96061
2026-03-27 11:17:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f6346dd-c240-5c93-b8eb-47bdf5fadaee with identifier: CH96061
2026-03-27 11:17:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f6346dd-c240-5c93-b8eb-47bdf5fadaee with identifier: CH96061 to the API
2026-03-27 11:17:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:17:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:17:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-27T16:07:23Z',
 'fuel_type': 'diesel',
 'id': '7f6346dd-c240-5c93-b8eb-47bdf5fadaee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH96061',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce Verso',
 'odometer': 13639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-15',
 'seller_name': None,
 'title': 'Toyota ProAce Verso 2.0 D-4D L2 Team D',
 'transmission': 'automatic',
 'trim': 'L2 Team D',
 'year': 2024}
2026-03-27 11:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH96061%27 HTTP/1.1" 200 None
2026-03-27 11:17:35 [auto1.de] INFO: Saving data for CH96061: {'auction_closing_time': 1774627643.0, 'created_time': 1773136596.475226, 'last_price_update_time': 1774610255.090993}
2026-03-27 11:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH96061') HTTP/1.1" 204 0
2026-03-27 11:17:35 [auto1.de] INFO: Found listing with ID: DF33717
2026-03-27 11:18:06 [scrapy.extensions.logstats] INFO: Crawled 731 pages (at 2 pages/min), scraped 1408 items (at 37 items/min)
2026-03-27 11:18:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 11:18:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:18:33 [auto1.de] INFO: Channel: 24h | Page: 264 | totalHits: 10720 | hits on page: 40
2026-03-27 11:18:33 [auto1.de] INFO: Found listing with ID: GB19657
2026-03-27 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB19657%27 HTTP/1.1" 200 None
2026-03-27 11:18:33 [auto1.de] INFO: Scrape type for GB19657: 0
2026-03-27 11:18:33 [auto1.de] INFO: Found listing with ID: GJ17165
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ17165%27 HTTP/1.1" 200 None
2026-03-27 11:18:34 [auto1.de] INFO: Scrape type for GJ17165: 0
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: SZ10404
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: CK66212
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: PK14357
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK14357%27 HTTP/1.1" 200 None
2026-03-27 11:18:34 [auto1.de] INFO: Scrape type for PK14357: 0
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: XK64077
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: CC01959
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: RW26653
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW26653%27 HTTP/1.1" 200 None
2026-03-27 11:18:34 [auto1.de] INFO: Scrape type for RW26653: 0
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: LC91411
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: LC02400
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC02400%27 HTTP/1.1" 200 None
2026-03-27 11:18:34 [auto1.de] INFO: Scrape type for LC02400: 0
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: LA66980
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: DU61724
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU61724%27 HTTP/1.1" 200 None
2026-03-27 11:18:34 [auto1.de] INFO: Scrape type for DU61724: 0
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: DA66634
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: CS88634
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: FH98757
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH98757%27 HTTP/1.1" 200 None
2026-03-27 11:18:34 [auto1.de] INFO: Scrape type for FH98757: 0
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: DP55195
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP55195%27 HTTP/1.1" 200 None
2026-03-27 11:18:34 [auto1.de] INFO: Scrape type for DP55195: 0
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: HM36828
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM36828%27 HTTP/1.1" 200 None
2026-03-27 11:18:34 [auto1.de] INFO: Scrape type for HM36828: 0
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: UW10679
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: FR53329
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR53329%27 HTTP/1.1" 200 None
2026-03-27 11:18:34 [auto1.de] INFO: Scrape type for FR53329: 0
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: RS09713
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: AD30182
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: CH96061
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH96061%27 HTTP/1.1" 200 None
2026-03-27 11:18:34 [auto1.de] INFO: Scrape type for CH96061: 0
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: DF33717
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: EX27277
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX27277%27 HTTP/1.1" 200 None
2026-03-27 11:18:34 [auto1.de] INFO: Scrape type for EX27277: 2
2026-03-27 11:18:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a53456ef-07da-57e0-8532-8606bba5fcf4 with identifier: EX27277
2026-03-27 11:18:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a53456ef-07da-57e0-8532-8606bba5fcf4 with scrape type 2
2026-03-27 11:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a53456ef-07da-57e0-8532-8606bba5fcf4 with scrape type 2
2026-03-27 11:18:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a53456ef-07da-57e0-8532-8606bba5fcf4, identifier: EX27277
2026-03-27 11:18:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a53456ef-07da-57e0-8532-8606bba5fcf4 with identifier: EX27277
2026-03-27 11:18:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a53456ef-07da-57e0-8532-8606bba5fcf4 with identifier: EX27277
2026-03-27 11:18:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a53456ef-07da-57e0-8532-8606bba5fcf4 with identifier: EX27277 to the API
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:47:55Z',
 'fuel_type': 'petrol',
 'id': 'a53456ef-07da-57e0-8532-8606bba5fcf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX27277',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 190703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-12-22',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 Kombi',
 'transmission': 'manual',
 'trim': 'Kombi',
 'year': 2004}
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX27277%27 HTTP/1.1" 200 None
2026-03-27 11:18:34 [auto1.de] INFO: Saving data for EX27277: {'auction_closing_time': 1774630075.0, 'created_time': 1773387366.282428, 'last_price_update_time': 1774610314.639496}
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX27277') HTTP/1.1" 204 0
2026-03-27 11:18:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:18:34 [auto1.de] INFO: Found listing with ID: AH38821
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH38821%27 HTTP/1.1" 200 None
2026-03-27 11:18:34 [auto1.de] INFO: Scrape type for AH38821: 2
2026-03-27 11:18:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cff92bc-7630-5cd0-9978-5f92ab76c302 with identifier: AH38821
2026-03-27 11:18:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cff92bc-7630-5cd0-9978-5f92ab76c302 with scrape type 2
2026-03-27 11:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cff92bc-7630-5cd0-9978-5f92ab76c302 with scrape type 2
2026-03-27 11:18:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4cff92bc-7630-5cd0-9978-5f92ab76c302, identifier: AH38821
2026-03-27 11:18:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4cff92bc-7630-5cd0-9978-5f92ab76c302 with identifier: AH38821
2026-03-27 11:18:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4cff92bc-7630-5cd0-9978-5f92ab76c302 with identifier: AH38821
2026-03-27 11:18:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4cff92bc-7630-5cd0-9978-5f92ab76c302 with identifier: AH38821 to the API
2026-03-27 11:18:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:00:29Z',
 'fuel_type': 'petrol',
 'id': '4cff92bc-7630-5cd0-9978-5f92ab76c302',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH38821',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 30204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-28',
 'seller_name': None,
 'title': 'Renault Captur 0.9 TCe Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2015}
2026-03-27 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH38821%27 HTTP/1.1" 200 None
2026-03-27 11:18:35 [auto1.de] INFO: Saving data for AH38821: {'auction_closing_time': 1774627229.0, 'created_time': 1774118545.112776, 'last_price_update_time': 1774610315.175642}
2026-03-27 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH38821') HTTP/1.1" 204 0
2026-03-27 11:18:35 [auto1.de] INFO: Found listing with ID: NH67676
2026-03-27 11:18:35 [auto1.de] INFO: Found listing with ID: AN97204
2026-03-27 11:18:35 [auto1.de] INFO: Found listing with ID: ZR25455
2026-03-27 11:18:35 [auto1.de] INFO: Found listing with ID: AJ62547
2026-03-27 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ62547%27 HTTP/1.1" 200 None
2026-03-27 11:18:35 [auto1.de] INFO: Scrape type for AJ62547: 2
2026-03-27 11:18:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd962045-a104-51c0-a1b3-aa3c90ceebfe with identifier: AJ62547
2026-03-27 11:18:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd962045-a104-51c0-a1b3-aa3c90ceebfe with scrape type 2
2026-03-27 11:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd962045-a104-51c0-a1b3-aa3c90ceebfe with scrape type 2
2026-03-27 11:18:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd962045-a104-51c0-a1b3-aa3c90ceebfe, identifier: AJ62547
2026-03-27 11:18:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd962045-a104-51c0-a1b3-aa3c90ceebfe with identifier: AJ62547
2026-03-27 11:18:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd962045-a104-51c0-a1b3-aa3c90ceebfe with identifier: AJ62547
2026-03-27 11:18:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd962045-a104-51c0-a1b3-aa3c90ceebfe with identifier: AJ62547 to the API
2026-03-27 11:18:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-27T16:24:37Z',
 'fuel_type': 'diesel',
 'id': 'cd962045-a104-51c0-a1b3-aa3c90ceebfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ62547',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 212372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'GTD BlueMotion Tech',
 'year': 2016}
2026-03-27 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ62547%27 HTTP/1.1" 200 None
2026-03-27 11:18:35 [auto1.de] INFO: Saving data for AJ62547: {'auction_closing_time': 1774628677.0, 'created_time': 1773387326.317656, 'last_price_update_time': 1774610315.622686}
2026-03-27 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ62547') HTTP/1.1" 204 0
2026-03-27 11:18:35 [auto1.de] INFO: Found listing with ID: HG94589
2026-03-27 11:18:35 [auto1.de] INFO: Found listing with ID: WD16900
2026-03-27 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD16900%27 HTTP/1.1" 200 None
2026-03-27 11:18:35 [auto1.de] INFO: Scrape type for WD16900: 2
2026-03-27 11:18:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c9a156-4810-50b1-bd13-4614942f55f9 with identifier: WD16900
2026-03-27 11:18:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c9a156-4810-50b1-bd13-4614942f55f9 with scrape type 2
2026-03-27 11:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2c9a156-4810-50b1-bd13-4614942f55f9 with scrape type 2
2026-03-27 11:18:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2c9a156-4810-50b1-bd13-4614942f55f9, identifier: WD16900
2026-03-27 11:18:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2c9a156-4810-50b1-bd13-4614942f55f9 with identifier: WD16900
2026-03-27 11:18:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2c9a156-4810-50b1-bd13-4614942f55f9 with identifier: WD16900
2026-03-27 11:18:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2c9a156-4810-50b1-bd13-4614942f55f9 with identifier: WD16900 to the API
2026-03-27 11:18:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:47:16Z',
 'fuel_type': 'diesel',
 'id': 'b2c9a156-4810-50b1-bd13-4614942f55f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD16900',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 212953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD16900%27 HTTP/1.1" 200 None
2026-03-27 11:18:36 [auto1.de] INFO: Saving data for WD16900: {'auction_closing_time': 1774630036.0, 'created_time': 1774522543.871373, 'last_price_update_time': 1774610316.053318}
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD16900') HTTP/1.1" 204 0
2026-03-27 11:18:36 [auto1.de] INFO: Found listing with ID: BJ61709
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ61709%27 HTTP/1.1" 200 None
2026-03-27 11:18:36 [auto1.de] INFO: Scrape type for BJ61709: 2
2026-03-27 11:18:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b184cfe8-ea6a-5c86-8466-def13625ecc4 with identifier: BJ61709
2026-03-27 11:18:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b184cfe8-ea6a-5c86-8466-def13625ecc4 with scrape type 2
2026-03-27 11:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b184cfe8-ea6a-5c86-8466-def13625ecc4 with scrape type 2
2026-03-27 11:18:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b184cfe8-ea6a-5c86-8466-def13625ecc4, identifier: BJ61709
2026-03-27 11:18:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b184cfe8-ea6a-5c86-8466-def13625ecc4 with identifier: BJ61709
2026-03-27 11:18:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b184cfe8-ea6a-5c86-8466-def13625ecc4 with identifier: BJ61709
2026-03-27 11:18:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b184cfe8-ea6a-5c86-8466-def13625ecc4 with identifier: BJ61709 to the API
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 457,
 'expiration_date': '2026-03-27T16:22:08Z',
 'fuel_type': 'hybrid',
 'id': 'b184cfe8-ea6a-5c86-8466-def13625ecc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ61709',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Explorer',
 'odometer': 73885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-30',
 'seller_name': None,
 'title': 'Ford Explorer 3.0 Plug-in Hybrid 4x4 ST-Line',
 'transmission': 'automatic',
 'trim': '4x4 ST-Line',
 'year': 2021}
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ61709%27 HTTP/1.1" 200 None
2026-03-27 11:18:36 [auto1.de] INFO: Saving data for BJ61709: {'auction_closing_time': 1774628528.0, 'created_time': 1774522724.969923, 'last_price_update_time': 1774610316.55507}
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ61709') HTTP/1.1" 204 0
2026-03-27 11:18:36 [auto1.de] INFO: Found listing with ID: AV40802
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV40802%27 HTTP/1.1" 200 None
2026-03-27 11:18:36 [auto1.de] INFO: Scrape type for AV40802: 2
2026-03-27 11:18:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f1e5439-69a0-583a-ab1a-f64ba770b286 with identifier: AV40802
2026-03-27 11:18:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f1e5439-69a0-583a-ab1a-f64ba770b286 with scrape type 2
2026-03-27 11:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f1e5439-69a0-583a-ab1a-f64ba770b286 with scrape type 2
2026-03-27 11:18:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f1e5439-69a0-583a-ab1a-f64ba770b286, identifier: AV40802
2026-03-27 11:18:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f1e5439-69a0-583a-ab1a-f64ba770b286 with identifier: AV40802
2026-03-27 11:18:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f1e5439-69a0-583a-ab1a-f64ba770b286 with identifier: AV40802
2026-03-27 11:18:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f1e5439-69a0-583a-ab1a-f64ba770b286 with identifier: AV40802 to the API
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:30:23Z',
 'fuel_type': 'diesel',
 'id': '4f1e5439-69a0-583a-ab1a-f64ba770b286',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV40802',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 191544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-03',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2015}
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV40802%27 HTTP/1.1" 200 None
2026-03-27 11:18:36 [auto1.de] INFO: Saving data for AV40802: {'auction_closing_time': 1774629023.0, 'created_time': 1774003057.35564, 'last_price_update_time': 1774610316.948987}
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV40802') HTTP/1.1" 204 0
2026-03-27 11:18:36 [auto1.de] INFO: Found listing with ID: SF18058
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF18058%27 HTTP/1.1" 200 None
2026-03-27 11:18:36 [auto1.de] INFO: Scrape type for SF18058: 2
2026-03-27 11:18:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a01a64ee-8578-5d3f-a2e2-83053d8ba8de with identifier: SF18058
2026-03-27 11:18:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a01a64ee-8578-5d3f-a2e2-83053d8ba8de with scrape type 2
2026-03-27 11:18:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a01a64ee-8578-5d3f-a2e2-83053d8ba8de with scrape type 2
2026-03-27 11:18:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a01a64ee-8578-5d3f-a2e2-83053d8ba8de, identifier: SF18058
2026-03-27 11:18:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a01a64ee-8578-5d3f-a2e2-83053d8ba8de with identifier: SF18058
2026-03-27 11:18:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a01a64ee-8578-5d3f-a2e2-83053d8ba8de with identifier: SF18058
2026-03-27 11:18:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a01a64ee-8578-5d3f-a2e2-83053d8ba8de with identifier: SF18058 to the API
2026-03-27 11:18:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-27T16:30:10Z',
 'fuel_type': 'petrol',
 'id': 'a01a64ee-8578-5d3f-a2e2-83053d8ba8de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF18058',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 13839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-28',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2023}
2026-03-27 11:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF18058%27 HTTP/1.1" 200 None
2026-03-27 11:18:37 [auto1.de] INFO: Saving data for SF18058: {'auction_closing_time': 1774629010.0, 'created_time': 1774522443.050662, 'last_price_update_time': 1774610317.389693}
2026-03-27 11:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF18058') HTTP/1.1" 204 0
2026-03-27 11:18:37 [auto1.de] INFO: Found listing with ID: YZ03964
2026-03-27 11:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ03964%27 HTTP/1.1" 200 None
2026-03-27 11:18:37 [auto1.de] INFO: Scrape type for YZ03964: 2
2026-03-27 11:18:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 556411f9-e0ae-5b77-b203-76680d81cadf with identifier: YZ03964
2026-03-27 11:18:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 556411f9-e0ae-5b77-b203-76680d81cadf with scrape type 2
2026-03-27 11:18:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 556411f9-e0ae-5b77-b203-76680d81cadf with scrape type 2
2026-03-27 11:18:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 556411f9-e0ae-5b77-b203-76680d81cadf, identifier: YZ03964
2026-03-27 11:18:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 556411f9-e0ae-5b77-b203-76680d81cadf with identifier: YZ03964
2026-03-27 11:18:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 556411f9-e0ae-5b77-b203-76680d81cadf with identifier: YZ03964
2026-03-27 11:18:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 556411f9-e0ae-5b77-b203-76680d81cadf with identifier: YZ03964 to the API
2026-03-27 11:18:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-27T16:22:06Z',
 'fuel_type': 'diesel',
 'id': '556411f9-e0ae-5b77-b203-76680d81cadf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ03964',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 185890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-11',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2017}
2026-03-27 11:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ03964%27 HTTP/1.1" 200 None
2026-03-27 11:18:37 [auto1.de] INFO: Saving data for YZ03964: {'auction_closing_time': 1774628526.0, 'created_time': 1774522430.192459, 'last_price_update_time': 1774610317.821793}
2026-03-27 11:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ03964') HTTP/1.1" 204 0
2026-03-27 11:18:37 [auto1.de] INFO: Found listing with ID: HP87515
2026-03-27 11:18:37 [auto1.de] INFO: Found listing with ID: PV08556
2026-03-27 11:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV08556%27 HTTP/1.1" 200 None
2026-03-27 11:18:37 [auto1.de] INFO: Scrape type for PV08556: 2
2026-03-27 11:18:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08bfe621-7ebf-58f3-a703-7b10f708ddbd with identifier: PV08556
2026-03-27 11:18:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08bfe621-7ebf-58f3-a703-7b10f708ddbd with scrape type 2
2026-03-27 11:18:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08bfe621-7ebf-58f3-a703-7b10f708ddbd with scrape type 2
2026-03-27 11:18:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08bfe621-7ebf-58f3-a703-7b10f708ddbd, identifier: PV08556
2026-03-27 11:18:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08bfe621-7ebf-58f3-a703-7b10f708ddbd with identifier: PV08556
2026-03-27 11:18:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08bfe621-7ebf-58f3-a703-7b10f708ddbd with identifier: PV08556
2026-03-27 11:18:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08bfe621-7ebf-58f3-a703-7b10f708ddbd with identifier: PV08556 to the API
2026-03-27 11:18:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-27T16:28:04Z',
 'fuel_type': 'diesel',
 'id': '08bfe621-7ebf-58f3-a703-7b10f708ddbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV08556',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 275172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-21',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 320 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-27 11:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV08556%27 HTTP/1.1" 200 None
2026-03-27 11:18:38 [auto1.de] INFO: Saving data for PV08556: {'auction_closing_time': 1774628884.0, 'created_time': 1774522419.671148, 'last_price_update_time': 1774610318.384498}
2026-03-27 11:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV08556') HTTP/1.1" 204 0
2026-03-27 11:18:38 [auto1.de] INFO: Found listing with ID: GZ27207
2026-03-27 11:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ27207%27 HTTP/1.1" 200 None
2026-03-27 11:18:38 [auto1.de] INFO: Scrape type for GZ27207: 2
2026-03-27 11:18:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75a17c8b-e13b-58cd-b618-b32a3d5c1d05 with identifier: GZ27207
2026-03-27 11:18:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75a17c8b-e13b-58cd-b618-b32a3d5c1d05 with scrape type 2
2026-03-27 11:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75a17c8b-e13b-58cd-b618-b32a3d5c1d05 with scrape type 2
2026-03-27 11:18:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75a17c8b-e13b-58cd-b618-b32a3d5c1d05, identifier: GZ27207
2026-03-27 11:18:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75a17c8b-e13b-58cd-b618-b32a3d5c1d05 with identifier: GZ27207
2026-03-27 11:18:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75a17c8b-e13b-58cd-b618-b32a3d5c1d05 with identifier: GZ27207
2026-03-27 11:18:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75a17c8b-e13b-58cd-b618-b32a3d5c1d05 with identifier: GZ27207 to the API
2026-03-27 11:18:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:10:35Z',
 'fuel_type': 'diesel',
 'id': '75a17c8b-e13b-58cd-b618-b32a3d5c1d05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ27207',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 192671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-10',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Life BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Life BlueMotion Tech',
 'year': 2013}
2026-03-27 11:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ27207%27 HTTP/1.1" 200 None
2026-03-27 11:18:38 [auto1.de] INFO: Saving data for GZ27207: {'auction_closing_time': 1774627835.0, 'created_time': 1773305905.717253, 'last_price_update_time': 1774610318.969047}
2026-03-27 11:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ27207') HTTP/1.1" 204 0
2026-03-27 11:18:38 [auto1.de] INFO: Found listing with ID: VZ47534
2026-03-27 11:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ47534%27 HTTP/1.1" 200 None
2026-03-27 11:18:39 [auto1.de] INFO: Scrape type for VZ47534: 2
2026-03-27 11:18:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20656b3a-b6f0-5048-927e-47f70916c1c6 with identifier: VZ47534
2026-03-27 11:18:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20656b3a-b6f0-5048-927e-47f70916c1c6 with scrape type 2
2026-03-27 11:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20656b3a-b6f0-5048-927e-47f70916c1c6 with scrape type 2
2026-03-27 11:18:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20656b3a-b6f0-5048-927e-47f70916c1c6, identifier: VZ47534
2026-03-27 11:18:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20656b3a-b6f0-5048-927e-47f70916c1c6 with identifier: VZ47534
2026-03-27 11:18:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20656b3a-b6f0-5048-927e-47f70916c1c6 with identifier: VZ47534
2026-03-27 11:18:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20656b3a-b6f0-5048-927e-47f70916c1c6 with identifier: VZ47534 to the API
2026-03-27 11:18:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-27T16:39:50Z',
 'fuel_type': 'petrol',
 'id': '20656b3a-b6f0-5048-927e-47f70916c1c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ47534',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 47161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-21',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200',
 'transmission': 'manual',
 'trim': '',
 'year': 2019}
2026-03-27 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ47534%27 HTTP/1.1" 200 None
2026-03-27 11:18:39 [auto1.de] INFO: Saving data for VZ47534: {'auction_closing_time': 1774629590.0, 'created_time': 1772729073.117724, 'last_price_update_time': 1774610319.435217}
2026-03-27 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ47534') HTTP/1.1" 204 0
2026-03-27 11:18:39 [auto1.de] INFO: Found listing with ID: YW50653
2026-03-27 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW50653%27 HTTP/1.1" 200 None
2026-03-27 11:18:39 [auto1.de] INFO: Scrape type for YW50653: 2
2026-03-27 11:18:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 675677bf-3e44-50d8-8159-14bd4eca7707 with identifier: YW50653
2026-03-27 11:18:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 675677bf-3e44-50d8-8159-14bd4eca7707 with scrape type 2
2026-03-27 11:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 675677bf-3e44-50d8-8159-14bd4eca7707 with scrape type 2
2026-03-27 11:18:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 675677bf-3e44-50d8-8159-14bd4eca7707, identifier: YW50653
2026-03-27 11:18:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 675677bf-3e44-50d8-8159-14bd4eca7707 with identifier: YW50653
2026-03-27 11:18:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 675677bf-3e44-50d8-8159-14bd4eca7707 with identifier: YW50653
2026-03-27 11:18:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 675677bf-3e44-50d8-8159-14bd4eca7707 with identifier: YW50653 to the API
2026-03-27 11:18:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-27T16:26:06Z',
 'fuel_type': 'petrol',
 'id': '675677bf-3e44-50d8-8159-14bd4eca7707',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW50653',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 233261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-31',
 'seller_name': None,
 'title': 'Toyota Yaris 1.3 VVT-i Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2007}
2026-03-27 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW50653%27 HTTP/1.1" 200 None
2026-03-27 11:18:39 [auto1.de] INFO: Saving data for YW50653: {'auction_closing_time': 1774628766.0, 'created_time': 1774522443.96113, 'last_price_update_time': 1774610319.85288}
2026-03-27 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW50653') HTTP/1.1" 204 0
2026-03-27 11:18:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:18:48 [auto1.de] INFO: Channel: 24h | Page: 265 | totalHits: 10726 | hits on page: 40
2026-03-27 11:18:48 [auto1.de] INFO: Found listing with ID: YZ03964
2026-03-27 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ03964%27 HTTP/1.1" 200 None
2026-03-27 11:18:48 [auto1.de] INFO: Scrape type for YZ03964: 0
2026-03-27 11:18:48 [auto1.de] INFO: Found listing with ID: HP87515
2026-03-27 11:18:48 [auto1.de] INFO: Found listing with ID: PV08556
2026-03-27 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV08556%27 HTTP/1.1" 200 None
2026-03-27 11:18:48 [auto1.de] INFO: Scrape type for PV08556: 0
2026-03-27 11:18:48 [auto1.de] INFO: Found listing with ID: GZ27207
2026-03-27 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ27207%27 HTTP/1.1" 200 None
2026-03-27 11:18:48 [auto1.de] INFO: Scrape type for GZ27207: 0
2026-03-27 11:18:48 [auto1.de] INFO: Found listing with ID: VZ47534
2026-03-27 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ47534%27 HTTP/1.1" 200 None
2026-03-27 11:18:48 [auto1.de] INFO: Scrape type for VZ47534: 0
2026-03-27 11:18:48 [auto1.de] INFO: Found listing with ID: YW50653
2026-03-27 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW50653%27 HTTP/1.1" 200 None
2026-03-27 11:18:48 [auto1.de] INFO: Scrape type for YW50653: 0
2026-03-27 11:18:48 [auto1.de] INFO: Found listing with ID: GX75432
2026-03-27 11:18:48 [auto1.de] INFO: Found listing with ID: HB06049
2026-03-27 11:18:48 [auto1.de] INFO: Found listing with ID: SD32112
2026-03-27 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD32112%27 HTTP/1.1" 200 None
2026-03-27 11:18:48 [auto1.de] INFO: Scrape type for SD32112: 2
2026-03-27 11:18:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba08164a-5096-5f5d-9ef4-a1ab7885dfc4 with identifier: SD32112
2026-03-27 11:18:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba08164a-5096-5f5d-9ef4-a1ab7885dfc4 with scrape type 2
2026-03-27 11:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba08164a-5096-5f5d-9ef4-a1ab7885dfc4 with scrape type 2
2026-03-27 11:18:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba08164a-5096-5f5d-9ef4-a1ab7885dfc4, identifier: SD32112
2026-03-27 11:18:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba08164a-5096-5f5d-9ef4-a1ab7885dfc4 with identifier: SD32112
2026-03-27 11:18:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba08164a-5096-5f5d-9ef4-a1ab7885dfc4 with identifier: SD32112
2026-03-27 11:18:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba08164a-5096-5f5d-9ef4-a1ab7885dfc4 with identifier: SD32112 to the API
2026-03-27 11:18:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-27T16:43:29Z',
 'fuel_type': 'petrol',
 'id': 'ba08164a-5096-5f5d-9ef4-a1ab7885dfc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD32112',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 95218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-30',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Active Colourline',
 'transmission': 'manual',
 'trim': 'Active Colourline',
 'year': 2019}
2026-03-27 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD32112%27 HTTP/1.1" 200 None
2026-03-27 11:18:49 [auto1.de] INFO: Saving data for SD32112: {'auction_closing_time': 1774629809.0, 'created_time': 1773945524.213484, 'last_price_update_time': 1774610329.135596}
2026-03-27 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD32112') HTTP/1.1" 204 0
2026-03-27 11:18:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:18:49 [auto1.de] INFO: Found listing with ID: LZ56052
2026-03-27 11:18:49 [auto1.de] INFO: Found listing with ID: TE07006
2026-03-27 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE07006%27 HTTP/1.1" 200 None
2026-03-27 11:18:49 [auto1.de] INFO: Scrape type for TE07006: 2
2026-03-27 11:18:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 286f6afd-b19a-5c75-9fe3-ae17bc758dbd with identifier: TE07006
2026-03-27 11:18:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 286f6afd-b19a-5c75-9fe3-ae17bc758dbd with scrape type 2
2026-03-27 11:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 286f6afd-b19a-5c75-9fe3-ae17bc758dbd with scrape type 2
2026-03-27 11:18:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 286f6afd-b19a-5c75-9fe3-ae17bc758dbd, identifier: TE07006
2026-03-27 11:18:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 286f6afd-b19a-5c75-9fe3-ae17bc758dbd with identifier: TE07006
2026-03-27 11:18:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 286f6afd-b19a-5c75-9fe3-ae17bc758dbd with identifier: TE07006
2026-03-27 11:18:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 286f6afd-b19a-5c75-9fe3-ae17bc758dbd with identifier: TE07006 to the API
2026-03-27 11:18:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:18:32Z',
 'fuel_type': 'diesel',
 'id': '286f6afd-b19a-5c75-9fe3-ae17bc758dbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE07006',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 141703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-29',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-27 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE07006%27 HTTP/1.1" 200 None
2026-03-27 11:18:49 [auto1.de] INFO: Saving data for TE07006: {'auction_closing_time': 1774628312.0, 'created_time': 1774522570.894017, 'last_price_update_time': 1774610329.667022}
2026-03-27 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE07006') HTTP/1.1" 204 0
2026-03-27 11:18:49 [auto1.de] INFO: Found listing with ID: VL50005
2026-03-27 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL50005%27 HTTP/1.1" 200 None
2026-03-27 11:18:49 [auto1.de] INFO: Scrape type for VL50005: 2
2026-03-27 11:18:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a7ac99b-5265-5002-b0ca-93a2fade221a with identifier: VL50005
2026-03-27 11:18:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a7ac99b-5265-5002-b0ca-93a2fade221a with scrape type 2
2026-03-27 11:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a7ac99b-5265-5002-b0ca-93a2fade221a with scrape type 2
2026-03-27 11:18:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a7ac99b-5265-5002-b0ca-93a2fade221a, identifier: VL50005
2026-03-27 11:18:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a7ac99b-5265-5002-b0ca-93a2fade221a with identifier: VL50005
2026-03-27 11:18:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a7ac99b-5265-5002-b0ca-93a2fade221a with identifier: VL50005
2026-03-27 11:18:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a7ac99b-5265-5002-b0ca-93a2fade221a with identifier: VL50005 to the API
2026-03-27 11:18:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:08:45Z',
 'fuel_type': 'petrol',
 'id': '6a7ac99b-5265-5002-b0ca-93a2fade221a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL50005',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 95969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-04',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT IQ.DRIVE',
 'transmission': 'manual',
 'trim': 'IQ.DRIVE',
 'year': 2019}
2026-03-27 11:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL50005%27 HTTP/1.1" 200 None
2026-03-27 11:18:50 [auto1.de] INFO: Saving data for VL50005: {'auction_closing_time': 1774627725.0, 'created_time': 1774522563.185792, 'last_price_update_time': 1774610330.116113}
2026-03-27 11:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL50005') HTTP/1.1" 204 0
2026-03-27 11:18:50 [auto1.de] INFO: Found listing with ID: SJ63454
2026-03-27 11:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ63454%27 HTTP/1.1" 200 None
2026-03-27 11:18:50 [auto1.de] INFO: Scrape type for SJ63454: 2
2026-03-27 11:18:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3 with identifier: SJ63454
2026-03-27 11:18:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3 with scrape type 2
2026-03-27 11:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3 with scrape type 2
2026-03-27 11:18:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3, identifier: SJ63454
2026-03-27 11:18:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3 with identifier: SJ63454
2026-03-27 11:18:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3 with identifier: SJ63454
2026-03-27 11:18:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3 with identifier: SJ63454 to the API
2026-03-27 11:18:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-27T16:20:59Z',
 'fuel_type': 'petrol',
 'id': '5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ63454',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 182944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-23',
 'seller_name': None,
 'title': 'BMW 2er 220i Gran Tourer Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2017}
2026-03-27 11:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ63454%27 HTTP/1.1" 200 None
2026-03-27 11:18:50 [auto1.de] INFO: Saving data for SJ63454: {'auction_closing_time': 1774628459.0, 'created_time': 1773946199.319927, 'last_price_update_time': 1774610330.582563}
2026-03-27 11:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ63454') HTTP/1.1" 204 0
2026-03-27 11:18:50 [auto1.de] INFO: Found listing with ID: MC04391
2026-03-27 11:18:50 [auto1.de] INFO: Found listing with ID: TY49191
2026-03-27 11:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY49191%27 HTTP/1.1" 200 None
2026-03-27 11:18:50 [auto1.de] INFO: Scrape type for TY49191: 2
2026-03-27 11:18:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f2b5721-2072-52e6-b19a-ea3eafd23440 with identifier: TY49191
2026-03-27 11:18:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f2b5721-2072-52e6-b19a-ea3eafd23440 with scrape type 2
2026-03-27 11:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f2b5721-2072-52e6-b19a-ea3eafd23440 with scrape type 2
2026-03-27 11:18:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f2b5721-2072-52e6-b19a-ea3eafd23440, identifier: TY49191
2026-03-27 11:18:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f2b5721-2072-52e6-b19a-ea3eafd23440 with identifier: TY49191
2026-03-27 11:18:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f2b5721-2072-52e6-b19a-ea3eafd23440 with identifier: TY49191
2026-03-27 11:18:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f2b5721-2072-52e6-b19a-ea3eafd23440 with identifier: TY49191 to the API
2026-03-27 11:18:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:50:49Z',
 'fuel_type': 'diesel',
 'id': '8f2b5721-2072-52e6-b19a-ea3eafd23440',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY49191',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 116897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-04',
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TDI Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2019}
2026-03-27 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY49191%27 HTTP/1.1" 200 None
2026-03-27 11:18:51 [auto1.de] INFO: Saving data for TY49191: {'auction_closing_time': 1774630249.0, 'created_time': 1774522553.177865, 'last_price_update_time': 1774610331.173247}
2026-03-27 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY49191') HTTP/1.1" 204 0
2026-03-27 11:18:51 [auto1.de] INFO: Found listing with ID: TF78396
2026-03-27 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF78396%27 HTTP/1.1" 200 None
2026-03-27 11:18:51 [auto1.de] INFO: Scrape type for TF78396: 2
2026-03-27 11:18:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f83c4bd-65c9-5c1b-9b78-947c5914a304 with identifier: TF78396
2026-03-27 11:18:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f83c4bd-65c9-5c1b-9b78-947c5914a304 with scrape type 2
2026-03-27 11:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f83c4bd-65c9-5c1b-9b78-947c5914a304 with scrape type 2
2026-03-27 11:18:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f83c4bd-65c9-5c1b-9b78-947c5914a304, identifier: TF78396
2026-03-27 11:18:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f83c4bd-65c9-5c1b-9b78-947c5914a304 with identifier: TF78396
2026-03-27 11:18:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f83c4bd-65c9-5c1b-9b78-947c5914a304 with identifier: TF78396
2026-03-27 11:18:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f83c4bd-65c9-5c1b-9b78-947c5914a304 with identifier: TF78396 to the API
2026-03-27 11:18:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:59:01Z',
 'fuel_type': 'electro',
 'id': '8f83c4bd-65c9-5c1b-9b78-947c5914a304',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF78396',
 'listing': 'auction',
 'make': 'Renault',
 'model': '5 E-Tech',
 'odometer': 32,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-03-26',
 'seller_name': None,
 'title': 'Renault 5 E-Tech electric drive 110 kW Comfort Range Iconic Five',
 'transmission': 'automatic',
 'trim': 'Comfort Range Iconic Five',
 'year': 2025}
2026-03-27 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF78396%27 HTTP/1.1" 200 None
2026-03-27 11:18:51 [auto1.de] INFO: Saving data for TF78396: {'auction_closing_time': 1774630741.0, 'created_time': 1774522560.245898, 'last_price_update_time': 1774610331.608413}
2026-03-27 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF78396') HTTP/1.1" 204 0
2026-03-27 11:18:51 [auto1.de] INFO: Found listing with ID: DT00101
2026-03-27 11:18:51 [auto1.de] INFO: Found listing with ID: UW93361
2026-03-27 11:18:51 [auto1.de] INFO: Found listing with ID: HV61220
2026-03-27 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV61220%27 HTTP/1.1" 200 None
2026-03-27 11:18:51 [auto1.de] INFO: Scrape type for HV61220: 2
2026-03-27 11:18:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75c2f4fc-e803-5bcb-839c-39a4178e3206 with identifier: HV61220
2026-03-27 11:18:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75c2f4fc-e803-5bcb-839c-39a4178e3206 with scrape type 2
2026-03-27 11:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75c2f4fc-e803-5bcb-839c-39a4178e3206 with scrape type 2
2026-03-27 11:18:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75c2f4fc-e803-5bcb-839c-39a4178e3206, identifier: HV61220
2026-03-27 11:18:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75c2f4fc-e803-5bcb-839c-39a4178e3206 with identifier: HV61220
2026-03-27 11:18:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75c2f4fc-e803-5bcb-839c-39a4178e3206 with identifier: HV61220
2026-03-27 11:18:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75c2f4fc-e803-5bcb-839c-39a4178e3206 with identifier: HV61220 to the API
2026-03-27 11:18:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-27T16:49:04Z',
 'fuel_type': 'diesel',
 'id': '75c2f4fc-e803-5bcb-839c-39a4178e3206',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV61220',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 301391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-01',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.5 TDI Atlantis',
 'transmission': 'manual',
 'trim': 'Atlantis',
 'year': 2007}
2026-03-27 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV61220%27 HTTP/1.1" 200 None
2026-03-27 11:18:52 [auto1.de] INFO: Saving data for HV61220: {'auction_closing_time': 1774630144.0, 'created_time': 1774522614.141366, 'last_price_update_time': 1774610332.053626}
2026-03-27 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV61220') HTTP/1.1" 204 0
2026-03-27 11:18:52 [auto1.de] INFO: Found listing with ID: LA13205
2026-03-27 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA13205%27 HTTP/1.1" 200 None
2026-03-27 11:18:52 [auto1.de] INFO: Scrape type for LA13205: 2
2026-03-27 11:18:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e3a79fc-f092-5a6f-9873-aa603862f30e with identifier: LA13205
2026-03-27 11:18:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e3a79fc-f092-5a6f-9873-aa603862f30e with scrape type 2
2026-03-27 11:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e3a79fc-f092-5a6f-9873-aa603862f30e with scrape type 2
2026-03-27 11:18:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e3a79fc-f092-5a6f-9873-aa603862f30e, identifier: LA13205
2026-03-27 11:18:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e3a79fc-f092-5a6f-9873-aa603862f30e with identifier: LA13205
2026-03-27 11:18:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e3a79fc-f092-5a6f-9873-aa603862f30e with identifier: LA13205
2026-03-27 11:18:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e3a79fc-f092-5a6f-9873-aa603862f30e with identifier: LA13205 to the API
2026-03-27 11:18:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:06:07Z',
 'fuel_type': 'petrol',
 'id': '3e3a79fc-f092-5a6f-9873-aa603862f30e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA13205',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 28601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-23',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 MyLive',
 'transmission': 'manual',
 'trim': 'MyLive',
 'year': 2011}
2026-03-27 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA13205%27 HTTP/1.1" 200 None
2026-03-27 11:18:52 [auto1.de] INFO: Saving data for LA13205: {'auction_closing_time': 1774627567.0, 'created_time': 1774522544.785169, 'last_price_update_time': 1774610332.511718}
2026-03-27 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA13205') HTTP/1.1" 204 0
2026-03-27 11:18:52 [auto1.de] INFO: Found listing with ID: LR77482
2026-03-27 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR77482%27 HTTP/1.1" 200 None
2026-03-27 11:18:52 [auto1.de] INFO: Scrape type for LR77482: 2
2026-03-27 11:18:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0163e5f9-410f-5357-af44-2b28a30b4122 with identifier: LR77482
2026-03-27 11:18:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0163e5f9-410f-5357-af44-2b28a30b4122 with scrape type 2
2026-03-27 11:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0163e5f9-410f-5357-af44-2b28a30b4122 with scrape type 2
2026-03-27 11:18:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0163e5f9-410f-5357-af44-2b28a30b4122, identifier: LR77482
2026-03-27 11:18:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0163e5f9-410f-5357-af44-2b28a30b4122 with identifier: LR77482
2026-03-27 11:18:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0163e5f9-410f-5357-af44-2b28a30b4122 with identifier: LR77482
2026-03-27 11:18:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0163e5f9-410f-5357-af44-2b28a30b4122 with identifier: LR77482 to the API
2026-03-27 11:18:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-27T16:46:33Z',
 'fuel_type': 'diesel',
 'id': '0163e5f9-410f-5357-af44-2b28a30b4122',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR77482',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 203285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-08',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Business-Line',
 'transmission': 'manual',
 'trim': 'Business-Line',
 'year': 2014}
2026-03-27 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR77482%27 HTTP/1.1" 200 None
2026-03-27 11:18:53 [auto1.de] INFO: Saving data for LR77482: {'auction_closing_time': 1774629993.0, 'created_time': 1774522547.569284, 'last_price_update_time': 1774610333.075962}
2026-03-27 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR77482') HTTP/1.1" 204 0
2026-03-27 11:18:53 [auto1.de] INFO: Found listing with ID: CZ36938
2026-03-27 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ36938%27 HTTP/1.1" 200 None
2026-03-27 11:18:53 [auto1.de] INFO: Scrape type for CZ36938: 2
2026-03-27 11:18:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71200441-6566-5c38-8a15-efb2f15c56dd with identifier: CZ36938
2026-03-27 11:18:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71200441-6566-5c38-8a15-efb2f15c56dd with scrape type 2
2026-03-27 11:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71200441-6566-5c38-8a15-efb2f15c56dd with scrape type 2
2026-03-27 11:18:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71200441-6566-5c38-8a15-efb2f15c56dd, identifier: CZ36938
2026-03-27 11:18:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71200441-6566-5c38-8a15-efb2f15c56dd with identifier: CZ36938
2026-03-27 11:18:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71200441-6566-5c38-8a15-efb2f15c56dd with identifier: CZ36938
2026-03-27 11:18:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71200441-6566-5c38-8a15-efb2f15c56dd with identifier: CZ36938 to the API
2026-03-27 11:18:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 420,
 'expiration_date': '2026-03-27T16:47:25Z',
 'fuel_type': 'petrol',
 'id': '71200441-6566-5c38-8a15-efb2f15c56dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ36938',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mustang',
 'odometer': 29880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-08',
 'seller_name': None,
 'title': 'Ford Mustang 5.0 Ti-VCT V8 GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2018}
2026-03-27 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ36938%27 HTTP/1.1" 200 None
2026-03-27 11:18:54 [auto1.de] INFO: Saving data for CZ36938: {'auction_closing_time': 1774630045.0, 'created_time': 1774522562.375157, 'last_price_update_time': 1774610334.143971}
2026-03-27 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ36938') HTTP/1.1" 204 0
2026-03-27 11:18:54 [auto1.de] INFO: Found listing with ID: VG52459
2026-03-27 11:18:54 [auto1.de] INFO: Found listing with ID: US20964
2026-03-27 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US20964%27 HTTP/1.1" 200 None
2026-03-27 11:18:54 [auto1.de] INFO: Scrape type for US20964: 2
2026-03-27 11:18:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11e2490e-4a6a-5d8f-b951-2c88e46ae07e with identifier: US20964
2026-03-27 11:18:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11e2490e-4a6a-5d8f-b951-2c88e46ae07e with scrape type 2
2026-03-27 11:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11e2490e-4a6a-5d8f-b951-2c88e46ae07e with scrape type 2
2026-03-27 11:18:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11e2490e-4a6a-5d8f-b951-2c88e46ae07e, identifier: US20964
2026-03-27 11:18:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:18:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11e2490e-4a6a-5d8f-b951-2c88e46ae07e with identifier: US20964
2026-03-27 11:18:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11e2490e-4a6a-5d8f-b951-2c88e46ae07e with identifier: US20964
2026-03-27 11:18:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11e2490e-4a6a-5d8f-b951-2c88e46ae07e with identifier: US20964 to the API
2026-03-27 11:18:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-27T16:16:49Z',
 'fuel_type': 'petrol',
 'id': '11e2490e-4a6a-5d8f-b951-2c88e46ae07e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US20964',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 29143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-03',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake Mild-Hybrid AMG '
          'Line Edition',
 'transmission': 'automatic',
 'trim': 'AMG Line Edition',
 'year': 2023}
2026-03-27 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US20964%27 HTTP/1.1" 200 None
2026-03-27 11:18:54 [auto1.de] INFO: Saving data for US20964: {'auction_closing_time': 1774628209.0, 'created_time': 1773306406.337176, 'last_price_update_time': 1774610334.634451}
2026-03-27 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US20964') HTTP/1.1" 204 0
2026-03-27 11:18:54 [auto1.de] INFO: Found listing with ID: WC28645
2026-03-27 11:18:54 [auto1.de] INFO: Found listing with ID: DZ61875
2026-03-27 11:18:54 [auto1.de] INFO: Found listing with ID: HP37567
2026-03-27 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP37567%27 HTTP/1.1" 200 None
2026-03-27 11:18:54 [auto1.de] INFO: Scrape type for HP37567: 2
2026-03-27 11:18:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25d3d63c-9514-5cea-9df5-dd64be066daf with identifier: HP37567
2026-03-27 11:18:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25d3d63c-9514-5cea-9df5-dd64be066daf with scrape type 2
2026-03-27 11:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25d3d63c-9514-5cea-9df5-dd64be066daf with scrape type 2
2026-03-27 11:18:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25d3d63c-9514-5cea-9df5-dd64be066daf, identifier: HP37567
2026-03-27 11:18:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25d3d63c-9514-5cea-9df5-dd64be066daf with identifier: HP37567
2026-03-27 11:18:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25d3d63c-9514-5cea-9df5-dd64be066daf with identifier: HP37567
2026-03-27 11:18:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25d3d63c-9514-5cea-9df5-dd64be066daf with identifier: HP37567 to the API
2026-03-27 11:18:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:39:21Z',
 'fuel_type': 'petrol',
 'id': '25d3d63c-9514-5cea-9df5-dd64be066daf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP37567',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 188603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-28',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-03-27 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP37567%27 HTTP/1.1" 200 None
2026-03-27 11:18:55 [auto1.de] INFO: Saving data for HP37567: {'auction_closing_time': 1774629561.0, 'created_time': 1774522545.479878, 'last_price_update_time': 1774610335.303275}
2026-03-27 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP37567') HTTP/1.1" 204 0
2026-03-27 11:18:55 [auto1.de] INFO: Found listing with ID: TB37654
2026-03-27 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB37654%27 HTTP/1.1" 200 None
2026-03-27 11:18:55 [auto1.de] INFO: Scrape type for TB37654: 2
2026-03-27 11:18:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2edb494e-f9d4-53f6-9321-c8c7a3e42653 with identifier: TB37654
2026-03-27 11:18:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2edb494e-f9d4-53f6-9321-c8c7a3e42653 with scrape type 2
2026-03-27 11:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2edb494e-f9d4-53f6-9321-c8c7a3e42653 with scrape type 2
2026-03-27 11:18:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2edb494e-f9d4-53f6-9321-c8c7a3e42653, identifier: TB37654
2026-03-27 11:18:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2edb494e-f9d4-53f6-9321-c8c7a3e42653 with identifier: TB37654
2026-03-27 11:18:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2edb494e-f9d4-53f6-9321-c8c7a3e42653 with identifier: TB37654
2026-03-27 11:18:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2edb494e-f9d4-53f6-9321-c8c7a3e42653 with identifier: TB37654 to the API
2026-03-27 11:18:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-27T16:02:19Z',
 'fuel_type': 'petrol',
 'id': '2edb494e-f9d4-53f6-9321-c8c7a3e42653',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB37654',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 81108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-09',
 'seller_name': None,
 'title': 'Volvo V40 1.6 T2 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2014}
2026-03-27 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB37654%27 HTTP/1.1" 200 None
2026-03-27 11:18:55 [auto1.de] INFO: Saving data for TB37654: {'auction_closing_time': 1774627339.0, 'created_time': 1774522476.640558, 'last_price_update_time': 1774610335.736975}
2026-03-27 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB37654') HTTP/1.1" 204 0
2026-03-27 11:18:55 [auto1.de] INFO: Channel: 24h | Page: 266 | totalHits: 10727 | hits on page: 40
2026-03-27 11:18:55 [auto1.de] INFO: Found listing with ID: AM19734
2026-03-27 11:18:55 [auto1.de] INFO: Found listing with ID: AN17735
2026-03-27 11:18:55 [auto1.de] INFO: Found listing with ID: JG35367
2026-03-27 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35367%27 HTTP/1.1" 200 None
2026-03-27 11:18:55 [auto1.de] INFO: Scrape type for JG35367: 2
2026-03-27 11:18:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ada5c644-2419-50f4-b949-34d24b688f4a with identifier: JG35367
2026-03-27 11:18:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ada5c644-2419-50f4-b949-34d24b688f4a with scrape type 2
2026-03-27 11:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ada5c644-2419-50f4-b949-34d24b688f4a with scrape type 2
2026-03-27 11:18:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ada5c644-2419-50f4-b949-34d24b688f4a, identifier: JG35367
2026-03-27 11:18:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ada5c644-2419-50f4-b949-34d24b688f4a with identifier: JG35367
2026-03-27 11:18:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ada5c644-2419-50f4-b949-34d24b688f4a with identifier: JG35367
2026-03-27 11:18:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ada5c644-2419-50f4-b949-34d24b688f4a with identifier: JG35367 to the API
2026-03-27 11:18:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-27T16:23:21Z',
 'fuel_type': 'diesel',
 'id': 'ada5c644-2419-50f4-b949-34d24b688f4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG35367',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 94727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-22',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2016}
2026-03-27 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35367%27 HTTP/1.1" 200 None
2026-03-27 11:18:56 [auto1.de] INFO: Saving data for JG35367: {'auction_closing_time': 1774628601.0, 'created_time': 1774522444.803613, 'last_price_update_time': 1774610336.181722}
2026-03-27 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG35367') HTTP/1.1" 204 0
2026-03-27 11:18:56 [auto1.de] INFO: Found listing with ID: XZ69134
2026-03-27 11:18:56 [auto1.de] INFO: Found listing with ID: JZ29670
2026-03-27 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ29670%27 HTTP/1.1" 200 None
2026-03-27 11:18:56 [auto1.de] INFO: Scrape type for JZ29670: 2
2026-03-27 11:18:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 871f16ee-8e4d-5a5b-a4dc-ba63d80a16d0 with identifier: JZ29670
2026-03-27 11:18:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 871f16ee-8e4d-5a5b-a4dc-ba63d80a16d0 with scrape type 2
2026-03-27 11:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 871f16ee-8e4d-5a5b-a4dc-ba63d80a16d0 with scrape type 2
2026-03-27 11:18:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 871f16ee-8e4d-5a5b-a4dc-ba63d80a16d0, identifier: JZ29670
2026-03-27 11:18:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:18:56 [auto1.de] INFO: Found listing with ID: XT00440
2026-03-27 11:18:56 [auto1.de] INFO: Found listing with ID: JR91951
2026-03-27 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR91951%27 HTTP/1.1" 200 None
2026-03-27 11:18:56 [auto1.de] INFO: Scrape type for JR91951: 2
2026-03-27 11:18:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7d8c10b-09d9-55e5-9a7d-94513112af44 with identifier: JR91951
2026-03-27 11:18:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7d8c10b-09d9-55e5-9a7d-94513112af44 with scrape type 2
2026-03-27 11:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7d8c10b-09d9-55e5-9a7d-94513112af44 with scrape type 2
2026-03-27 11:18:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7d8c10b-09d9-55e5-9a7d-94513112af44, identifier: JR91951
2026-03-27 11:18:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 871f16ee-8e4d-5a5b-a4dc-ba63d80a16d0 with identifier: JZ29670
2026-03-27 11:18:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 871f16ee-8e4d-5a5b-a4dc-ba63d80a16d0 with identifier: JZ29670
2026-03-27 11:18:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 871f16ee-8e4d-5a5b-a4dc-ba63d80a16d0 with identifier: JZ29670 to the API
2026-03-27 11:18:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:16:09Z',
 'fuel_type': 'diesel',
 'id': '871f16ee-8e4d-5a5b-a4dc-ba63d80a16d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ29670',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 393697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-15',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'S line Sportpaket plus',
 'year': 2012}
2026-03-27 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ29670%27 HTTP/1.1" 200 None
2026-03-27 11:18:56 [auto1.de] INFO: Saving data for JZ29670: {'auction_closing_time': 1774628169.0, 'created_time': 1773228937.512191, 'last_price_update_time': 1774610336.903761}
2026-03-27 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ29670') HTTP/1.1" 204 0
2026-03-27 11:18:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7d8c10b-09d9-55e5-9a7d-94513112af44 with identifier: JR91951
2026-03-27 11:18:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7d8c10b-09d9-55e5-9a7d-94513112af44 with identifier: JR91951
2026-03-27 11:18:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7d8c10b-09d9-55e5-9a7d-94513112af44 with identifier: JR91951 to the API
2026-03-27 11:18:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-27T16:00:50Z',
 'fuel_type': 'diesel',
 'id': 'd7d8c10b-09d9-55e5-9a7d-94513112af44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR91951',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 95238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-09',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-27 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR91951%27 HTTP/1.1" 200 None
2026-03-27 11:18:57 [auto1.de] INFO: Saving data for JR91951: {'auction_closing_time': 1774627250.0, 'created_time': 1773345565.766472, 'last_price_update_time': 1774610337.200217}
2026-03-27 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR91951') HTTP/1.1" 204 0
2026-03-27 11:18:57 [auto1.de] INFO: Found listing with ID: PG58570
2026-03-27 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG58570%27 HTTP/1.1" 200 None
2026-03-27 11:18:57 [auto1.de] INFO: Scrape type for PG58570: 2
2026-03-27 11:18:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d38fb5a-07dd-5f2b-87a1-649695015f5e with identifier: PG58570
2026-03-27 11:18:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d38fb5a-07dd-5f2b-87a1-649695015f5e with scrape type 2
2026-03-27 11:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d38fb5a-07dd-5f2b-87a1-649695015f5e with scrape type 2
2026-03-27 11:18:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d38fb5a-07dd-5f2b-87a1-649695015f5e, identifier: PG58570
2026-03-27 11:18:57 [auto1.de] INFO: Found listing with ID: FL79995
2026-03-27 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL79995%27 HTTP/1.1" 200 None
2026-03-27 11:18:57 [auto1.de] INFO: Scrape type for FL79995: 2
2026-03-27 11:18:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 753e7f57-036c-5a75-a3ea-bf48be584fc4 with identifier: FL79995
2026-03-27 11:18:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 753e7f57-036c-5a75-a3ea-bf48be584fc4 with scrape type 2
2026-03-27 11:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 753e7f57-036c-5a75-a3ea-bf48be584fc4 with scrape type 2
2026-03-27 11:18:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 753e7f57-036c-5a75-a3ea-bf48be584fc4, identifier: FL79995
2026-03-27 11:18:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d38fb5a-07dd-5f2b-87a1-649695015f5e with identifier: PG58570
2026-03-27 11:18:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d38fb5a-07dd-5f2b-87a1-649695015f5e with identifier: PG58570
2026-03-27 11:18:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d38fb5a-07dd-5f2b-87a1-649695015f5e with identifier: PG58570 to the API
2026-03-27 11:18:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-27T16:28:15Z',
 'fuel_type': 'diesel',
 'id': '7d38fb5a-07dd-5f2b-87a1-649695015f5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG58570',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 150140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-18',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-27 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG58570%27 HTTP/1.1" 200 None
2026-03-27 11:18:57 [auto1.de] INFO: Saving data for PG58570: {'auction_closing_time': 1774628895.0, 'created_time': 1774522473.570053, 'last_price_update_time': 1774610337.896595}
2026-03-27 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG58570') HTTP/1.1" 204 0
2026-03-27 11:18:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 753e7f57-036c-5a75-a3ea-bf48be584fc4 with identifier: FL79995
2026-03-27 11:18:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 753e7f57-036c-5a75-a3ea-bf48be584fc4 with identifier: FL79995
2026-03-27 11:18:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 753e7f57-036c-5a75-a3ea-bf48be584fc4 with identifier: FL79995 to the API
2026-03-27 11:18:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-27T16:33:19Z',
 'fuel_type': 'petrol',
 'id': '753e7f57-036c-5a75-a3ea-bf48be584fc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL79995',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 64809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-12',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 250 CGI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-27 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL79995%27 HTTP/1.1" 200 None
2026-03-27 11:18:58 [auto1.de] INFO: Saving data for FL79995: {'auction_closing_time': 1774629199.0, 'created_time': 1774522509.1848, 'last_price_update_time': 1774610338.24349}
2026-03-27 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL79995') HTTP/1.1" 204 0
2026-03-27 11:18:58 [auto1.de] INFO: Found listing with ID: SY11611
2026-03-27 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY11611%27 HTTP/1.1" 200 None
2026-03-27 11:18:58 [auto1.de] INFO: Scrape type for SY11611: 2
2026-03-27 11:18:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adfb3519-6ed5-5d2c-a088-086b690ffc3c with identifier: SY11611
2026-03-27 11:18:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adfb3519-6ed5-5d2c-a088-086b690ffc3c with scrape type 2
2026-03-27 11:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adfb3519-6ed5-5d2c-a088-086b690ffc3c with scrape type 2
2026-03-27 11:18:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: adfb3519-6ed5-5d2c-a088-086b690ffc3c, identifier: SY11611
2026-03-27 11:18:58 [auto1.de] INFO: Found listing with ID: AX08023
2026-03-27 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX08023%27 HTTP/1.1" 200 None
2026-03-27 11:18:58 [auto1.de] INFO: Scrape type for AX08023: 2
2026-03-27 11:18:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a12a14e-b05d-5016-a566-77e4c8abff50 with identifier: AX08023
2026-03-27 11:18:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a12a14e-b05d-5016-a566-77e4c8abff50 with scrape type 2
2026-03-27 11:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a12a14e-b05d-5016-a566-77e4c8abff50 with scrape type 2
2026-03-27 11:18:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a12a14e-b05d-5016-a566-77e4c8abff50, identifier: AX08023
2026-03-27 11:18:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: adfb3519-6ed5-5d2c-a088-086b690ffc3c with identifier: SY11611
2026-03-27 11:18:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: adfb3519-6ed5-5d2c-a088-086b690ffc3c with identifier: SY11611
2026-03-27 11:18:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: adfb3519-6ed5-5d2c-a088-086b690ffc3c with identifier: SY11611 to the API
2026-03-27 11:18:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:28:42Z',
 'fuel_type': 'petrol',
 'id': 'adfb3519-6ed5-5d2c-a088-086b690ffc3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY11611',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 105670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-07',
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Celebration',
 'transmission': 'manual',
 'trim': 'Stepway Celebration',
 'year': 2018}
2026-03-27 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY11611%27 HTTP/1.1" 200 None
2026-03-27 11:18:58 [auto1.de] INFO: Saving data for SY11611: {'auction_closing_time': 1774628922.0, 'created_time': 1773946563.199743, 'last_price_update_time': 1774610338.797769}
2026-03-27 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY11611') HTTP/1.1" 204 0
2026-03-27 11:18:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a12a14e-b05d-5016-a566-77e4c8abff50 with identifier: AX08023
2026-03-27 11:18:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a12a14e-b05d-5016-a566-77e4c8abff50 with identifier: AX08023
2026-03-27 11:18:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a12a14e-b05d-5016-a566-77e4c8abff50 with identifier: AX08023 to the API
2026-03-27 11:18:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-27T16:26:31Z',
 'fuel_type': 'diesel',
 'id': '4a12a14e-b05d-5016-a566-77e4c8abff50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX08023',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque Cabriolet',
 'odometer': 99243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'Land Rover Evoque Cabriolet 2.0 Td4 HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2017}
2026-03-27 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX08023%27 HTTP/1.1" 200 None
2026-03-27 11:18:59 [auto1.de] INFO: Saving data for AX08023: {'auction_closing_time': 1774628791.0, 'created_time': 1774522440.648222, 'last_price_update_time': 1774610339.130702}
2026-03-27 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX08023') HTTP/1.1" 204 0
2026-03-27 11:18:59 [auto1.de] INFO: Found listing with ID: NT04254
2026-03-27 11:18:59 [auto1.de] INFO: Found listing with ID: GW15546
2026-03-27 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW15546%27 HTTP/1.1" 200 None
2026-03-27 11:18:59 [auto1.de] INFO: Scrape type for GW15546: 2
2026-03-27 11:18:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0823fb9e-2485-54fe-9110-63f89db137d2 with identifier: GW15546
2026-03-27 11:18:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0823fb9e-2485-54fe-9110-63f89db137d2 with scrape type 2
2026-03-27 11:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0823fb9e-2485-54fe-9110-63f89db137d2 with scrape type 2
2026-03-27 11:18:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0823fb9e-2485-54fe-9110-63f89db137d2, identifier: GW15546
2026-03-27 11:18:59 [auto1.de] INFO: Found listing with ID: KE01468
2026-03-27 11:18:59 [auto1.de] INFO: Found listing with ID: FU28651
2026-03-27 11:18:59 [auto1.de] INFO: Found listing with ID: FL81153
2026-03-27 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL81153%27 HTTP/1.1" 200 None
2026-03-27 11:18:59 [auto1.de] INFO: Scrape type for FL81153: 0
2026-03-27 11:18:59 [auto1.de] INFO: Found listing with ID: WR51622
2026-03-27 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR51622%27 HTTP/1.1" 200 None
2026-03-27 11:18:59 [auto1.de] INFO: Scrape type for WR51622: 0
2026-03-27 11:18:59 [auto1.de] INFO: Found listing with ID: XZ69134
2026-03-27 11:18:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0823fb9e-2485-54fe-9110-63f89db137d2 with identifier: GW15546
2026-03-27 11:18:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0823fb9e-2485-54fe-9110-63f89db137d2 with identifier: GW15546
2026-03-27 11:18:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0823fb9e-2485-54fe-9110-63f89db137d2 with identifier: GW15546 to the API
2026-03-27 11:18:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:18:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:18:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-27T16:50:07Z',
 'fuel_type': 'diesel',
 'id': '0823fb9e-2485-54fe-9110-63f89db137d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW15546',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 142925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-13',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 320 L2 Tourneo Titanium X',
 'transmission': 'automatic',
 'trim': '320 L2 Tourneo Titanium X',
 'year': 2021}
2026-03-27 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW15546%27 HTTP/1.1" 200 None
2026-03-27 11:18:59 [auto1.de] INFO: Saving data for GW15546: {'auction_closing_time': 1774630207.0, 'created_time': 1774522506.929775, 'last_price_update_time': 1774610339.617641}
2026-03-27 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW15546') HTTP/1.1" 204 0
2026-03-27 11:18:59 [auto1.de] INFO: Found listing with ID: MU90710
2026-03-27 11:18:59 [auto1.de] INFO: Found listing with ID: WB86036
2026-03-27 11:18:59 [auto1.de] INFO: Found listing with ID: JG07802
2026-03-27 11:18:59 [auto1.de] INFO: Found listing with ID: SJ86823
2026-03-27 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ86823%27 HTTP/1.1" 200 None
2026-03-27 11:18:59 [auto1.de] INFO: Scrape type for SJ86823: 2
2026-03-27 11:18:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9297d829-353a-5eb4-b002-6e205d63a332 with identifier: SJ86823
2026-03-27 11:18:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9297d829-353a-5eb4-b002-6e205d63a332 with scrape type 2
2026-03-27 11:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9297d829-353a-5eb4-b002-6e205d63a332 with scrape type 2
2026-03-27 11:19:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9297d829-353a-5eb4-b002-6e205d63a332, identifier: SJ86823
2026-03-27 11:19:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9297d829-353a-5eb4-b002-6e205d63a332 with identifier: SJ86823
2026-03-27 11:19:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9297d829-353a-5eb4-b002-6e205d63a332 with identifier: SJ86823
2026-03-27 11:19:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9297d829-353a-5eb4-b002-6e205d63a332 with identifier: SJ86823 to the API
2026-03-27 11:19:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-27T16:35:26Z',
 'fuel_type': 'petrol',
 'id': '9297d829-353a-5eb4-b002-6e205d63a332',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ86823',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 64358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-25',
 'seller_name': None,
 'title': 'Toyota Yaris 1.33 Dual VVT-i Edition 2014',
 'transmission': 'manual',
 'trim': 'Edition 2014',
 'year': 2014}
2026-03-27 11:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ86823%27 HTTP/1.1" 200 None
2026-03-27 11:19:00 [auto1.de] INFO: Saving data for SJ86823: {'auction_closing_time': 1774629326.0, 'created_time': 1773347032.544867, 'last_price_update_time': 1774610340.470188}
2026-03-27 11:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ86823') HTTP/1.1" 204 0
2026-03-27 11:19:00 [auto1.de] INFO: Found listing with ID: WL38814
2026-03-27 11:19:00 [auto1.de] INFO: Found listing with ID: SW40365
2026-03-27 11:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW40365%27 HTTP/1.1" 200 None
2026-03-27 11:19:00 [auto1.de] INFO: Scrape type for SW40365: 2
2026-03-27 11:19:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17940e68-d952-5e43-bfa2-8b7fd02ca307 with identifier: SW40365
2026-03-27 11:19:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17940e68-d952-5e43-bfa2-8b7fd02ca307 with scrape type 2
2026-03-27 11:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17940e68-d952-5e43-bfa2-8b7fd02ca307 with scrape type 2
2026-03-27 11:19:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17940e68-d952-5e43-bfa2-8b7fd02ca307, identifier: SW40365
2026-03-27 11:19:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17940e68-d952-5e43-bfa2-8b7fd02ca307 with identifier: SW40365
2026-03-27 11:19:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17940e68-d952-5e43-bfa2-8b7fd02ca307 with identifier: SW40365
2026-03-27 11:19:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17940e68-d952-5e43-bfa2-8b7fd02ca307 with identifier: SW40365 to the API
2026-03-27 11:19:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-27T16:00:27Z',
 'fuel_type': 'diesel',
 'id': '17940e68-d952-5e43-bfa2-8b7fd02ca307',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW40365',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 175452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-18',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Shooting Brake Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2021}
2026-03-27 11:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW40365%27 HTTP/1.1" 200 None
2026-03-27 11:19:00 [auto1.de] INFO: Saving data for SW40365: {'auction_closing_time': 1774627227.0, 'created_time': 1773380950.550579, 'last_price_update_time': 1774610340.954639}
2026-03-27 11:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW40365') HTTP/1.1" 204 0
2026-03-27 11:19:00 [auto1.de] INFO: Found listing with ID: TJ20795
2026-03-27 11:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ20795%27 HTTP/1.1" 200 None
2026-03-27 11:19:00 [auto1.de] INFO: Scrape type for TJ20795: 2
2026-03-27 11:19:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85741e5a-37a3-560e-b20b-461fec280f9a with identifier: TJ20795
2026-03-27 11:19:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85741e5a-37a3-560e-b20b-461fec280f9a with scrape type 2
2026-03-27 11:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85741e5a-37a3-560e-b20b-461fec280f9a with scrape type 2
2026-03-27 11:19:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85741e5a-37a3-560e-b20b-461fec280f9a, identifier: TJ20795
2026-03-27 11:19:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85741e5a-37a3-560e-b20b-461fec280f9a with identifier: TJ20795
2026-03-27 11:19:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85741e5a-37a3-560e-b20b-461fec280f9a with identifier: TJ20795
2026-03-27 11:19:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85741e5a-37a3-560e-b20b-461fec280f9a with identifier: TJ20795 to the API
2026-03-27 11:19:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:54:16Z',
 'fuel_type': 'petrol',
 'id': '85741e5a-37a3-560e-b20b-461fec280f9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ20795',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 193370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-19',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-03-27 11:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ20795%27 HTTP/1.1" 200 None
2026-03-27 11:19:01 [auto1.de] INFO: Saving data for TJ20795: {'auction_closing_time': 1774630456.0, 'created_time': 1774522498.830778, 'last_price_update_time': 1774610341.461297}
2026-03-27 11:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ20795') HTTP/1.1" 204 0
2026-03-27 11:19:01 [auto1.de] INFO: Found listing with ID: YN37721
2026-03-27 11:19:01 [auto1.de] INFO: Found listing with ID: UC09176
2026-03-27 11:19:01 [auto1.de] INFO: Found listing with ID: AM35234
2026-03-27 11:19:01 [auto1.de] INFO: Found listing with ID: LF76340
2026-03-27 11:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF76340%27 HTTP/1.1" 200 None
2026-03-27 11:19:01 [auto1.de] INFO: Scrape type for LF76340: 2
2026-03-27 11:19:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ae4c973-a17d-5587-a02b-7d9ea7fbe57f with identifier: LF76340
2026-03-27 11:19:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ae4c973-a17d-5587-a02b-7d9ea7fbe57f with scrape type 2
2026-03-27 11:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ae4c973-a17d-5587-a02b-7d9ea7fbe57f with scrape type 2
2026-03-27 11:19:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ae4c973-a17d-5587-a02b-7d9ea7fbe57f, identifier: LF76340
2026-03-27 11:19:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:19:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ae4c973-a17d-5587-a02b-7d9ea7fbe57f with identifier: LF76340
2026-03-27 11:19:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ae4c973-a17d-5587-a02b-7d9ea7fbe57f with identifier: LF76340
2026-03-27 11:19:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ae4c973-a17d-5587-a02b-7d9ea7fbe57f with identifier: LF76340 to the API
2026-03-27 11:19:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:25:00Z',
 'fuel_type': 'petrol',
 'id': '8ae4c973-a17d-5587-a02b-7d9ea7fbe57f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF76340',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 171488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-26',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Design Edition',
 'transmission': 'manual',
 'trim': 'Design Edition',
 'year': 2011}
2026-03-27 11:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF76340%27 HTTP/1.1" 200 None
2026-03-27 11:19:01 [auto1.de] INFO: Saving data for LF76340: {'auction_closing_time': 1774628700.0, 'created_time': 1774522499.579679, 'last_price_update_time': 1774610341.906391}
2026-03-27 11:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF76340') HTTP/1.1" 204 0
2026-03-27 11:19:02 [auto1.de] INFO: Found listing with ID: UW12612
2026-03-27 11:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW12612%27 HTTP/1.1" 200 None
2026-03-27 11:19:02 [auto1.de] INFO: Scrape type for UW12612: 2
2026-03-27 11:19:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de1cf38f-3434-515f-a864-ed303f5dc0c3 with identifier: UW12612
2026-03-27 11:19:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de1cf38f-3434-515f-a864-ed303f5dc0c3 with scrape type 2
2026-03-27 11:19:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de1cf38f-3434-515f-a864-ed303f5dc0c3 with scrape type 2
2026-03-27 11:19:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de1cf38f-3434-515f-a864-ed303f5dc0c3, identifier: UW12612
2026-03-27 11:19:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de1cf38f-3434-515f-a864-ed303f5dc0c3 with identifier: UW12612
2026-03-27 11:19:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de1cf38f-3434-515f-a864-ed303f5dc0c3 with identifier: UW12612
2026-03-27 11:19:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de1cf38f-3434-515f-a864-ed303f5dc0c3 with identifier: UW12612 to the API
2026-03-27 11:19:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 76,
 'expiration_date': '2026-03-27T16:30:09Z',
 'fuel_type': 'diesel',
 'id': 'de1cf38f-3434-515f-a864-ed303f5dc0c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW12612',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 30394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-29',
 'seller_name': None,
 'title': 'Opel Combo 1.5 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2018}
2026-03-27 11:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW12612%27 HTTP/1.1" 200 None
2026-03-27 11:19:02 [auto1.de] INFO: Saving data for UW12612: {'auction_closing_time': 1774629009.0, 'created_time': 1774522491.527599, 'last_price_update_time': 1774610342.477936}
2026-03-27 11:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW12612') HTTP/1.1" 204 0
2026-03-27 11:19:02 [auto1.de] INFO: Found listing with ID: LM42473
2026-03-27 11:19:02 [auto1.de] INFO: Found listing with ID: EB09552
2026-03-27 11:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB09552%27 HTTP/1.1" 200 None
2026-03-27 11:19:02 [auto1.de] INFO: Scrape type for EB09552: 2
2026-03-27 11:19:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd352567-47ca-5310-b242-b528880f452b with identifier: EB09552
2026-03-27 11:19:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd352567-47ca-5310-b242-b528880f452b with scrape type 2
2026-03-27 11:19:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd352567-47ca-5310-b242-b528880f452b with scrape type 2
2026-03-27 11:19:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd352567-47ca-5310-b242-b528880f452b, identifier: EB09552
2026-03-27 11:19:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd352567-47ca-5310-b242-b528880f452b with identifier: EB09552
2026-03-27 11:19:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd352567-47ca-5310-b242-b528880f452b with identifier: EB09552
2026-03-27 11:19:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd352567-47ca-5310-b242-b528880f452b with identifier: EB09552 to the API
2026-03-27 11:19:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-27T16:48:02Z',
 'fuel_type': 'petrol',
 'id': 'dd352567-47ca-5310-b242-b528880f452b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB09552',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 152649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-03',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2006}
2026-03-27 11:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB09552%27 HTTP/1.1" 200 None
2026-03-27 11:19:02 [auto1.de] INFO: Saving data for EB09552: {'auction_closing_time': 1774630082.0, 'created_time': 1774522483.392692, 'last_price_update_time': 1774610342.952867}
2026-03-27 11:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB09552') HTTP/1.1" 204 0
2026-03-27 11:19:02 [auto1.de] INFO: Found listing with ID: VJ57746
2026-03-27 11:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57746%27 HTTP/1.1" 200 None
2026-03-27 11:19:03 [auto1.de] INFO: Scrape type for VJ57746: 2
2026-03-27 11:19:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 156d4b01-0253-5152-be00-3ba89d411dd7 with identifier: VJ57746
2026-03-27 11:19:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 156d4b01-0253-5152-be00-3ba89d411dd7 with scrape type 2
2026-03-27 11:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 156d4b01-0253-5152-be00-3ba89d411dd7 with scrape type 2
2026-03-27 11:19:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 156d4b01-0253-5152-be00-3ba89d411dd7, identifier: VJ57746
2026-03-27 11:19:03 [auto1.de] INFO: Channel: 24h | Page: 267 | totalHits: 10730 | hits on page: 40
2026-03-27 11:19:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 156d4b01-0253-5152-be00-3ba89d411dd7 with identifier: VJ57746
2026-03-27 11:19:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 156d4b01-0253-5152-be00-3ba89d411dd7 with identifier: VJ57746
2026-03-27 11:19:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 156d4b01-0253-5152-be00-3ba89d411dd7 with identifier: VJ57746 to the API
2026-03-27 11:19:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:45:48Z',
 'fuel_type': 'diesel',
 'id': '156d4b01-0253-5152-be00-3ba89d411dd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ57746',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 111995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-06',
 'seller_name': None,
 'title': 'BMW 1er 118d M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2016}
2026-03-27 11:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57746%27 HTTP/1.1" 200 None
2026-03-27 11:19:03 [auto1.de] INFO: Saving data for VJ57746: {'auction_closing_time': 1774629948.0, 'created_time': 1774522496.847732, 'last_price_update_time': 1774610343.418207}
2026-03-27 11:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ57746') HTTP/1.1" 204 0
2026-03-27 11:19:03 [auto1.de] INFO: Found listing with ID: ZP12024
2026-03-27 11:19:03 [auto1.de] INFO: Found listing with ID: BF45527
2026-03-27 11:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF45527%27 HTTP/1.1" 200 None
2026-03-27 11:19:03 [auto1.de] INFO: Scrape type for BF45527: 2
2026-03-27 11:19:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59b5a4e1-3b28-58b4-962c-c7d376d88eab with identifier: BF45527
2026-03-27 11:19:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59b5a4e1-3b28-58b4-962c-c7d376d88eab with scrape type 2
2026-03-27 11:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59b5a4e1-3b28-58b4-962c-c7d376d88eab with scrape type 2
2026-03-27 11:19:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59b5a4e1-3b28-58b4-962c-c7d376d88eab, identifier: BF45527
2026-03-27 11:19:03 [auto1.de] INFO: Found listing with ID: AP01247
2026-03-27 11:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP01247%27 HTTP/1.1" 200 None
2026-03-27 11:19:03 [auto1.de] INFO: Scrape type for AP01247: 0
2026-03-27 11:19:03 [auto1.de] INFO: Found listing with ID: ZC34825
2026-03-27 11:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC34825%27 HTTP/1.1" 200 None
2026-03-27 11:19:03 [auto1.de] INFO: Scrape type for ZC34825: 2
2026-03-27 11:19:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f33dd2de-6de9-5bad-a15b-7cd2db20fbc3 with identifier: ZC34825
2026-03-27 11:19:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f33dd2de-6de9-5bad-a15b-7cd2db20fbc3 with scrape type 2
2026-03-27 11:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f33dd2de-6de9-5bad-a15b-7cd2db20fbc3 with scrape type 2
2026-03-27 11:19:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f33dd2de-6de9-5bad-a15b-7cd2db20fbc3, identifier: ZC34825
2026-03-27 11:19:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59b5a4e1-3b28-58b4-962c-c7d376d88eab with identifier: BF45527
2026-03-27 11:19:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59b5a4e1-3b28-58b4-962c-c7d376d88eab with identifier: BF45527
2026-03-27 11:19:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59b5a4e1-3b28-58b4-962c-c7d376d88eab with identifier: BF45527 to the API
2026-03-27 11:19:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:38:39Z',
 'fuel_type': 'diesel',
 'id': '59b5a4e1-3b28-58b4-962c-c7d376d88eab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF45527',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 173864,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-15',
 'seller_name': None,
 'title': 'Hyundai i40 1.7 CRDi Style Blue',
 'transmission': 'manual',
 'trim': 'Style Blue',
 'year': 2016}
2026-03-27 11:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF45527%27 HTTP/1.1" 200 None
2026-03-27 11:19:03 [auto1.de] INFO: Saving data for BF45527: {'auction_closing_time': 1774629519.0, 'created_time': 1773380876.213027, 'last_price_update_time': 1774610343.990533}
2026-03-27 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF45527') HTTP/1.1" 204 0
2026-03-27 11:19:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f33dd2de-6de9-5bad-a15b-7cd2db20fbc3 with identifier: ZC34825
2026-03-27 11:19:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f33dd2de-6de9-5bad-a15b-7cd2db20fbc3 with identifier: ZC34825
2026-03-27 11:19:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f33dd2de-6de9-5bad-a15b-7cd2db20fbc3 with identifier: ZC34825 to the API
2026-03-27 11:19:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:32:23Z',
 'fuel_type': 'diesel',
 'id': 'f33dd2de-6de9-5bad-a15b-7cd2db20fbc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC34825',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 98098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-06',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-03-27 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC34825%27 HTTP/1.1" 200 None
2026-03-27 11:19:04 [auto1.de] INFO: Saving data for ZC34825: {'auction_closing_time': 1774629143.0, 'created_time': 1774522588.811304, 'last_price_update_time': 1774610344.434597}
2026-03-27 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC34825') HTTP/1.1" 204 0
2026-03-27 11:19:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:19:04 [auto1.de] INFO: Found listing with ID: WG27498
2026-03-27 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG27498%27 HTTP/1.1" 200 None
2026-03-27 11:19:04 [auto1.de] INFO: Scrape type for WG27498: 2
2026-03-27 11:19:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab57346c-902d-5270-9bcf-0bc1117b2856 with identifier: WG27498
2026-03-27 11:19:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab57346c-902d-5270-9bcf-0bc1117b2856 with scrape type 2
2026-03-27 11:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab57346c-902d-5270-9bcf-0bc1117b2856 with scrape type 2
2026-03-27 11:19:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab57346c-902d-5270-9bcf-0bc1117b2856, identifier: WG27498
2026-03-27 11:19:04 [auto1.de] INFO: Found listing with ID: YR18351
2026-03-27 11:19:04 [auto1.de] INFO: Found listing with ID: PB87695
2026-03-27 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB87695%27 HTTP/1.1" 200 None
2026-03-27 11:19:04 [auto1.de] INFO: Scrape type for PB87695: 2
2026-03-27 11:19:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 555ce9cf-a8ef-58e5-a3fd-88ce2b5bf287 with identifier: PB87695
2026-03-27 11:19:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 555ce9cf-a8ef-58e5-a3fd-88ce2b5bf287 with scrape type 2
2026-03-27 11:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 555ce9cf-a8ef-58e5-a3fd-88ce2b5bf287 with scrape type 2
2026-03-27 11:19:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 555ce9cf-a8ef-58e5-a3fd-88ce2b5bf287, identifier: PB87695
2026-03-27 11:19:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab57346c-902d-5270-9bcf-0bc1117b2856 with identifier: WG27498
2026-03-27 11:19:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab57346c-902d-5270-9bcf-0bc1117b2856 with identifier: WG27498
2026-03-27 11:19:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab57346c-902d-5270-9bcf-0bc1117b2856 with identifier: WG27498 to the API
2026-03-27 11:19:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-27T16:12:43Z',
 'fuel_type': 'petrol',
 'id': 'ab57346c-902d-5270-9bcf-0bc1117b2856',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG27498',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 107790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-29',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2004}
2026-03-27 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG27498%27 HTTP/1.1" 200 None
2026-03-27 11:19:05 [auto1.de] INFO: Saving data for WG27498: {'auction_closing_time': 1774627963.0, 'created_time': 1774522478.641982, 'last_price_update_time': 1774610345.047804}
2026-03-27 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG27498') HTTP/1.1" 204 0
2026-03-27 11:19:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 555ce9cf-a8ef-58e5-a3fd-88ce2b5bf287 with identifier: PB87695
2026-03-27 11:19:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 555ce9cf-a8ef-58e5-a3fd-88ce2b5bf287 with identifier: PB87695
2026-03-27 11:19:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 555ce9cf-a8ef-58e5-a3fd-88ce2b5bf287 with identifier: PB87695 to the API
2026-03-27 11:19:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-27T16:11:52Z',
 'fuel_type': 'diesel',
 'id': '555ce9cf-a8ef-58e5-a3fd-88ce2b5bf287',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB87695',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Crafter',
 'odometer': 98876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-07',
 'seller_name': None,
 'title': 'Volkswagen Crafter 2.0 TDI Kasten 35 mittellang Hochdach FWD',
 'transmission': 'manual',
 'trim': 'Kasten 35 mittellang Hochdach FWD',
 'year': 2021}
2026-03-27 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB87695%27 HTTP/1.1" 200 None
2026-03-27 11:19:05 [auto1.de] INFO: Saving data for PB87695: {'auction_closing_time': 1774627912.0, 'created_time': 1774522464.544244, 'last_price_update_time': 1774610345.493974}
2026-03-27 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB87695') HTTP/1.1" 204 0
2026-03-27 11:19:05 [auto1.de] INFO: Found listing with ID: KM84276
2026-03-27 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM84276%27 HTTP/1.1" 200 None
2026-03-27 11:19:05 [auto1.de] INFO: Scrape type for KM84276: 2
2026-03-27 11:19:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91220869-0932-5dfc-97c3-f6b0fb8c17ca with identifier: KM84276
2026-03-27 11:19:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91220869-0932-5dfc-97c3-f6b0fb8c17ca with scrape type 2
2026-03-27 11:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91220869-0932-5dfc-97c3-f6b0fb8c17ca with scrape type 2
2026-03-27 11:19:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91220869-0932-5dfc-97c3-f6b0fb8c17ca, identifier: KM84276
2026-03-27 11:19:05 [auto1.de] INFO: Found listing with ID: VH48686
2026-03-27 11:19:05 [auto1.de] INFO: Found listing with ID: FR72780
2026-03-27 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR72780%27 HTTP/1.1" 200 None
2026-03-27 11:19:05 [auto1.de] INFO: Scrape type for FR72780: 2
2026-03-27 11:19:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95f5ba30-c955-51c1-8002-569a7b5664c9 with identifier: FR72780
2026-03-27 11:19:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95f5ba30-c955-51c1-8002-569a7b5664c9 with scrape type 2
2026-03-27 11:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95f5ba30-c955-51c1-8002-569a7b5664c9 with scrape type 2
2026-03-27 11:19:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95f5ba30-c955-51c1-8002-569a7b5664c9, identifier: FR72780
2026-03-27 11:19:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91220869-0932-5dfc-97c3-f6b0fb8c17ca with identifier: KM84276
2026-03-27 11:19:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91220869-0932-5dfc-97c3-f6b0fb8c17ca with identifier: KM84276
2026-03-27 11:19:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91220869-0932-5dfc-97c3-f6b0fb8c17ca with identifier: KM84276 to the API
2026-03-27 11:19:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-27T16:41:29Z',
 'fuel_type': 'diesel',
 'id': '91220869-0932-5dfc-97c3-f6b0fb8c17ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM84276',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 76412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-25',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-27 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM84276%27 HTTP/1.1" 200 None
2026-03-27 11:19:06 [auto1.de] INFO: Saving data for KM84276: {'auction_closing_time': 1774629689.0, 'created_time': 1773227654.686068, 'last_price_update_time': 1774610346.13286}
2026-03-27 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM84276') HTTP/1.1" 204 0
2026-03-27 11:19:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95f5ba30-c955-51c1-8002-569a7b5664c9 with identifier: FR72780
2026-03-27 11:19:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95f5ba30-c955-51c1-8002-569a7b5664c9 with identifier: FR72780
2026-03-27 11:19:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95f5ba30-c955-51c1-8002-569a7b5664c9 with identifier: FR72780 to the API
2026-03-27 11:19:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-27T16:17:45Z',
 'fuel_type': 'diesel',
 'id': '95f5ba30-c955-51c1-8002-569a7b5664c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR72780',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 279557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-10',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 316 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-27 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR72780%27 HTTP/1.1" 200 None
2026-03-27 11:19:06 [auto1.de] INFO: Saving data for FR72780: {'auction_closing_time': 1774628265.0, 'created_time': 1774381207.235093, 'last_price_update_time': 1774610346.491959}
2026-03-27 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR72780') HTTP/1.1" 204 0
2026-03-27 11:19:06 [auto1.de] INFO: Found listing with ID: EA07160
2026-03-27 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA07160%27 HTTP/1.1" 200 None
2026-03-27 11:19:06 [auto1.de] INFO: Scrape type for EA07160: 2
2026-03-27 11:19:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d831d3c5-504a-56e5-aefb-c068d82c1691 with identifier: EA07160
2026-03-27 11:19:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d831d3c5-504a-56e5-aefb-c068d82c1691 with scrape type 2
2026-03-27 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d831d3c5-504a-56e5-aefb-c068d82c1691 with scrape type 2
2026-03-27 11:19:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d831d3c5-504a-56e5-aefb-c068d82c1691, identifier: EA07160
2026-03-27 11:19:06 [auto1.de] INFO: Found listing with ID: DP71871
2026-03-27 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP71871%27 HTTP/1.1" 200 None
2026-03-27 11:19:06 [auto1.de] INFO: Scrape type for DP71871: 0
2026-03-27 11:19:06 [auto1.de] INFO: Found listing with ID: XG79069
2026-03-27 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG79069%27 HTTP/1.1" 200 None
2026-03-27 11:19:06 [auto1.de] INFO: Scrape type for XG79069: 2
2026-03-27 11:19:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b7192c6-66af-5e19-8f44-8e3a483d0632 with identifier: XG79069
2026-03-27 11:19:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b7192c6-66af-5e19-8f44-8e3a483d0632 with scrape type 2
2026-03-27 11:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b7192c6-66af-5e19-8f44-8e3a483d0632 with scrape type 2
2026-03-27 11:19:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b7192c6-66af-5e19-8f44-8e3a483d0632, identifier: XG79069
2026-03-27 11:19:06 [scrapy.extensions.logstats] INFO: Crawled 735 pages (at 4 pages/min), scraped 1454 items (at 46 items/min)
2026-03-27 11:19:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-27 11:19:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d831d3c5-504a-56e5-aefb-c068d82c1691 with identifier: EA07160
2026-03-27 11:19:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d831d3c5-504a-56e5-aefb-c068d82c1691 with identifier: EA07160
2026-03-27 11:19:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d831d3c5-504a-56e5-aefb-c068d82c1691 with identifier: EA07160 to the API
2026-03-27 11:19:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:07:10Z',
 'fuel_type': 'petrol',
 'id': 'd831d3c5-504a-56e5-aefb-c068d82c1691',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA07160',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 52498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-15',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2010}
2026-03-27 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA07160%27 HTTP/1.1" 200 None
2026-03-27 11:19:07 [auto1.de] INFO: Saving data for EA07160: {'auction_closing_time': 1774627630.0, 'created_time': 1774522463.055979, 'last_price_update_time': 1774610347.084579}
2026-03-27 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA07160') HTTP/1.1" 204 0
2026-03-27 11:19:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b7192c6-66af-5e19-8f44-8e3a483d0632 with identifier: XG79069
2026-03-27 11:19:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b7192c6-66af-5e19-8f44-8e3a483d0632 with identifier: XG79069
2026-03-27 11:19:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b7192c6-66af-5e19-8f44-8e3a483d0632 with identifier: XG79069 to the API
2026-03-27 11:19:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:48:35Z',
 'fuel_type': 'diesel',
 'id': '2b7192c6-66af-5e19-8f44-8e3a483d0632',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG79069',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 128479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-22',
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2011}
2026-03-27 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG79069%27 HTTP/1.1" 200 None
2026-03-27 11:19:07 [auto1.de] INFO: Saving data for XG79069: {'auction_closing_time': 1774630115.0, 'created_time': 1774522629.400188, 'last_price_update_time': 1774610347.413444}
2026-03-27 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG79069') HTTP/1.1" 204 0
2026-03-27 11:19:07 [auto1.de] INFO: Found listing with ID: NZ51315
2026-03-27 11:19:07 [auto1.de] INFO: Found listing with ID: MU38011
2026-03-27 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU38011%27 HTTP/1.1" 200 None
2026-03-27 11:19:07 [auto1.de] INFO: Scrape type for MU38011: 2
2026-03-27 11:19:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bba69ba-5742-5f33-ba34-24ea153f5869 with identifier: MU38011
2026-03-27 11:19:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bba69ba-5742-5f33-ba34-24ea153f5869 with scrape type 2
2026-03-27 11:19:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bba69ba-5742-5f33-ba34-24ea153f5869 with scrape type 2
2026-03-27 11:19:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6bba69ba-5742-5f33-ba34-24ea153f5869, identifier: MU38011
2026-03-27 11:19:07 [auto1.de] INFO: Found listing with ID: FX01006
2026-03-27 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX01006%27 HTTP/1.1" 200 None
2026-03-27 11:19:07 [auto1.de] INFO: Scrape type for FX01006: 2
2026-03-27 11:19:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce27b9d4-36f6-5d0c-82a4-7c92466a5889 with identifier: FX01006
2026-03-27 11:19:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce27b9d4-36f6-5d0c-82a4-7c92466a5889 with scrape type 2
2026-03-27 11:19:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce27b9d4-36f6-5d0c-82a4-7c92466a5889 with scrape type 2
2026-03-27 11:19:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce27b9d4-36f6-5d0c-82a4-7c92466a5889, identifier: FX01006
2026-03-27 11:19:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6bba69ba-5742-5f33-ba34-24ea153f5869 with identifier: MU38011
2026-03-27 11:19:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6bba69ba-5742-5f33-ba34-24ea153f5869 with identifier: MU38011
2026-03-27 11:19:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6bba69ba-5742-5f33-ba34-24ea153f5869 with identifier: MU38011 to the API
2026-03-27 11:19:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-27T16:12:33Z',
 'fuel_type': 'petrol',
 'id': '6bba69ba-5742-5f33-ba34-24ea153f5869',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU38011',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 20333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-30',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 B3 Mild-Hybrid Core 2WD',
 'transmission': 'automatic',
 'trim': 'Core 2WD',
 'year': 2024}
2026-03-27 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU38011%27 HTTP/1.1" 200 None
2026-03-27 11:19:08 [auto1.de] INFO: Saving data for MU38011: {'auction_closing_time': 1774627953.0, 'created_time': 1773132368.796141, 'last_price_update_time': 1774610348.081185}
2026-03-27 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU38011') HTTP/1.1" 204 0
2026-03-27 11:19:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce27b9d4-36f6-5d0c-82a4-7c92466a5889 with identifier: FX01006
2026-03-27 11:19:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce27b9d4-36f6-5d0c-82a4-7c92466a5889 with identifier: FX01006
2026-03-27 11:19:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce27b9d4-36f6-5d0c-82a4-7c92466a5889 with identifier: FX01006 to the API
2026-03-27 11:19:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-27T16:49:12Z',
 'fuel_type': 'hybrid',
 'id': 'ce27b9d4-36f6-5d0c-82a4-7c92466a5889',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX01006',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 42131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-19',
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID VZ',
 'transmission': 'automatic',
 'trim': 'VZ',
 'year': 2022}
2026-03-27 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX01006%27 HTTP/1.1" 200 None
2026-03-27 11:19:08 [auto1.de] INFO: Saving data for FX01006: {'auction_closing_time': 1774630152.0, 'created_time': 1774522636.754868, 'last_price_update_time': 1774610348.438819}
2026-03-27 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX01006') HTTP/1.1" 204 0
2026-03-27 11:19:08 [auto1.de] INFO: Found listing with ID: YN89750
2026-03-27 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN89750%27 HTTP/1.1" 200 None
2026-03-27 11:19:08 [auto1.de] INFO: Scrape type for YN89750: 2
2026-03-27 11:19:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79a47bd5-99b9-5db8-8e30-4bdb6b1b570e with identifier: YN89750
2026-03-27 11:19:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79a47bd5-99b9-5db8-8e30-4bdb6b1b570e with scrape type 2
2026-03-27 11:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79a47bd5-99b9-5db8-8e30-4bdb6b1b570e with scrape type 2
2026-03-27 11:19:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79a47bd5-99b9-5db8-8e30-4bdb6b1b570e, identifier: YN89750
2026-03-27 11:19:08 [auto1.de] INFO: Found listing with ID: NS17757
2026-03-27 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS17757%27 HTTP/1.1" 200 None
2026-03-27 11:19:08 [auto1.de] INFO: Scrape type for NS17757: 2
2026-03-27 11:19:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12239576-3b7e-5993-be8c-0a0bfcb2f8f0 with identifier: NS17757
2026-03-27 11:19:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12239576-3b7e-5993-be8c-0a0bfcb2f8f0 with scrape type 2
2026-03-27 11:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12239576-3b7e-5993-be8c-0a0bfcb2f8f0 with scrape type 2
2026-03-27 11:19:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12239576-3b7e-5993-be8c-0a0bfcb2f8f0, identifier: NS17757
2026-03-27 11:19:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79a47bd5-99b9-5db8-8e30-4bdb6b1b570e with identifier: YN89750
2026-03-27 11:19:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79a47bd5-99b9-5db8-8e30-4bdb6b1b570e with identifier: YN89750
2026-03-27 11:19:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79a47bd5-99b9-5db8-8e30-4bdb6b1b570e with identifier: YN89750 to the API
2026-03-27 11:19:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-27T16:26:10Z',
 'fuel_type': 'petrol',
 'id': '79a47bd5-99b9-5db8-8e30-4bdb6b1b570e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN89750',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 114662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-29',
 'seller_name': None,
 'title': 'Toyota Auris 1.6 Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'year': 2013}
2026-03-27 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN89750%27 HTTP/1.1" 200 None
2026-03-27 11:19:08 [auto1.de] INFO: Saving data for YN89750: {'auction_closing_time': 1774628770.0, 'created_time': 1774522477.898804, 'last_price_update_time': 1774610348.989621}
2026-03-27 11:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN89750') HTTP/1.1" 204 0
2026-03-27 11:19:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12239576-3b7e-5993-be8c-0a0bfcb2f8f0 with identifier: NS17757
2026-03-27 11:19:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12239576-3b7e-5993-be8c-0a0bfcb2f8f0 with identifier: NS17757
2026-03-27 11:19:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12239576-3b7e-5993-be8c-0a0bfcb2f8f0 with identifier: NS17757 to the API
2026-03-27 11:19:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-27T16:00:39Z',
 'fuel_type': 'diesel',
 'id': '12239576-3b7e-5993-be8c-0a0bfcb2f8f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS17757',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 67014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'automatic',
 'trim': '350 L3 Trend',
 'year': 2021}
2026-03-27 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS17757%27 HTTP/1.1" 200 None
2026-03-27 11:19:09 [auto1.de] INFO: Saving data for NS17757: {'auction_closing_time': 1774627239.0, 'created_time': 1774522631.747538, 'last_price_update_time': 1774610349.420208}
2026-03-27 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS17757') HTTP/1.1" 204 0
2026-03-27 11:19:09 [auto1.de] INFO: Found listing with ID: RV27706
2026-03-27 11:19:09 [auto1.de] INFO: Found listing with ID: YT31718
2026-03-27 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT31718%27 HTTP/1.1" 200 None
2026-03-27 11:19:09 [auto1.de] INFO: Scrape type for YT31718: 2
2026-03-27 11:19:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab3c1070-36f4-51fb-97b1-4cd4b3cb1033 with identifier: YT31718
2026-03-27 11:19:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab3c1070-36f4-51fb-97b1-4cd4b3cb1033 with scrape type 2
2026-03-27 11:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab3c1070-36f4-51fb-97b1-4cd4b3cb1033 with scrape type 2
2026-03-27 11:19:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab3c1070-36f4-51fb-97b1-4cd4b3cb1033, identifier: YT31718
2026-03-27 11:19:09 [auto1.de] INFO: Found listing with ID: RT25924
2026-03-27 11:19:09 [auto1.de] INFO: Found listing with ID: AP20693
2026-03-27 11:19:09 [auto1.de] INFO: Found listing with ID: DR32988
2026-03-27 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR32988%27 HTTP/1.1" 200 None
2026-03-27 11:19:09 [auto1.de] INFO: Scrape type for DR32988: 2
2026-03-27 11:19:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 463d34e4-9930-532b-9770-8a78e8b016c5 with identifier: DR32988
2026-03-27 11:19:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 463d34e4-9930-532b-9770-8a78e8b016c5 with scrape type 2
2026-03-27 11:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 463d34e4-9930-532b-9770-8a78e8b016c5 with scrape type 2
2026-03-27 11:19:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 463d34e4-9930-532b-9770-8a78e8b016c5, identifier: DR32988
2026-03-27 11:19:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab3c1070-36f4-51fb-97b1-4cd4b3cb1033 with identifier: YT31718
2026-03-27 11:19:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab3c1070-36f4-51fb-97b1-4cd4b3cb1033 with identifier: YT31718
2026-03-27 11:19:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab3c1070-36f4-51fb-97b1-4cd4b3cb1033 with identifier: YT31718 to the API
2026-03-27 11:19:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-27T16:47:42Z',
 'fuel_type': 'petrol',
 'id': 'ab3c1070-36f4-51fb-97b1-4cd4b3cb1033',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT31718',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 115289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-20',
 'seller_name': None,
 'title': 'BMW 3er 325i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2012}
2026-03-27 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT31718%27 HTTP/1.1" 200 None
2026-03-27 11:19:09 [auto1.de] INFO: Saving data for YT31718: {'auction_closing_time': 1774630062.0, 'created_time': 1774522480.458332, 'last_price_update_time': 1774610349.980618}
2026-03-27 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT31718') HTTP/1.1" 204 0
2026-03-27 11:19:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 463d34e4-9930-532b-9770-8a78e8b016c5 with identifier: DR32988
2026-03-27 11:19:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 463d34e4-9930-532b-9770-8a78e8b016c5 with identifier: DR32988
2026-03-27 11:19:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 463d34e4-9930-532b-9770-8a78e8b016c5 with identifier: DR32988 to the API
2026-03-27 11:19:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-27T16:37:19Z',
 'fuel_type': 'diesel',
 'id': '463d34e4-9930-532b-9770-8a78e8b016c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR32988',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 90227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-20',
 'seller_name': None,
 'title': 'Ford Ranger 2.2 TDCi Doppelkabine 4x4 XLT',
 'transmission': 'manual',
 'trim': 'Doppelkabine 4x4 XLT',
 'year': 2017}
2026-03-27 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR32988%27 HTTP/1.1" 200 None
2026-03-27 11:19:10 [auto1.de] INFO: Saving data for DR32988: {'auction_closing_time': 1774629439.0, 'created_time': 1774522694.248073, 'last_price_update_time': 1774610350.27521}
2026-03-27 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR32988') HTTP/1.1" 204 0
2026-03-27 11:19:10 [auto1.de] INFO: Found listing with ID: TP63692
2026-03-27 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63692%27 HTTP/1.1" 200 None
2026-03-27 11:19:10 [auto1.de] INFO: Scrape type for TP63692: 2
2026-03-27 11:19:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3742e63d-7217-51cc-a9eb-cd0e9a90cbe4 with identifier: TP63692
2026-03-27 11:19:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3742e63d-7217-51cc-a9eb-cd0e9a90cbe4 with scrape type 2
2026-03-27 11:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3742e63d-7217-51cc-a9eb-cd0e9a90cbe4 with scrape type 2
2026-03-27 11:19:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3742e63d-7217-51cc-a9eb-cd0e9a90cbe4, identifier: TP63692
2026-03-27 11:19:10 [auto1.de] INFO: Found listing with ID: WV53584
2026-03-27 11:19:10 [auto1.de] INFO: Found listing with ID: JB33429
2026-03-27 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB33429%27 HTTP/1.1" 200 None
2026-03-27 11:19:10 [auto1.de] INFO: Scrape type for JB33429: 2
2026-03-27 11:19:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ea037ab-8aa6-5e60-963b-ffd280e343a9 with identifier: JB33429
2026-03-27 11:19:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ea037ab-8aa6-5e60-963b-ffd280e343a9 with scrape type 2
2026-03-27 11:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ea037ab-8aa6-5e60-963b-ffd280e343a9 with scrape type 2
2026-03-27 11:19:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ea037ab-8aa6-5e60-963b-ffd280e343a9, identifier: JB33429
2026-03-27 11:19:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3742e63d-7217-51cc-a9eb-cd0e9a90cbe4 with identifier: TP63692
2026-03-27 11:19:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3742e63d-7217-51cc-a9eb-cd0e9a90cbe4 with identifier: TP63692
2026-03-27 11:19:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3742e63d-7217-51cc-a9eb-cd0e9a90cbe4 with identifier: TP63692 to the API
2026-03-27 11:19:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-27T16:37:22Z',
 'fuel_type': 'diesel',
 'id': '3742e63d-7217-51cc-a9eb-cd0e9a90cbe4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP63692',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 186748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-27',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-27 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63692%27 HTTP/1.1" 200 None
2026-03-27 11:19:10 [auto1.de] INFO: Saving data for TP63692: {'auction_closing_time': 1774629442.0, 'created_time': 1773945770.31255, 'last_price_update_time': 1774610350.802771}
2026-03-27 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP63692') HTTP/1.1" 204 0
2026-03-27 11:19:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ea037ab-8aa6-5e60-963b-ffd280e343a9 with identifier: JB33429
2026-03-27 11:19:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ea037ab-8aa6-5e60-963b-ffd280e343a9 with identifier: JB33429
2026-03-27 11:19:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ea037ab-8aa6-5e60-963b-ffd280e343a9 with identifier: JB33429 to the API
2026-03-27 11:19:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-27T16:16:41Z',
 'fuel_type': 'petrol',
 'id': '9ea037ab-8aa6-5e60-963b-ffd280e343a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB33429',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 51287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-20',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Experience',
 'transmission': 'automatic',
 'trim': 'Experience',
 'year': 2017}
2026-03-27 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB33429%27 HTTP/1.1" 200 None
2026-03-27 11:19:11 [auto1.de] INFO: Saving data for JB33429: {'auction_closing_time': 1774628201.0, 'created_time': 1774522628.154338, 'last_price_update_time': 1774610351.097365}
2026-03-27 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB33429') HTTP/1.1" 204 0
2026-03-27 11:19:11 [auto1.de] INFO: Found listing with ID: HA16942
2026-03-27 11:19:11 [auto1.de] INFO: Found listing with ID: AN60754
2026-03-27 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN60754%27 HTTP/1.1" 200 None
2026-03-27 11:19:11 [auto1.de] INFO: Scrape type for AN60754: 2
2026-03-27 11:19:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f27633e-4392-52f5-a025-6c743447e407 with identifier: AN60754
2026-03-27 11:19:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f27633e-4392-52f5-a025-6c743447e407 with scrape type 2
2026-03-27 11:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f27633e-4392-52f5-a025-6c743447e407 with scrape type 2
2026-03-27 11:19:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f27633e-4392-52f5-a025-6c743447e407, identifier: AN60754
2026-03-27 11:19:11 [auto1.de] INFO: Found listing with ID: GT24864
2026-03-27 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT24864%27 HTTP/1.1" 200 None
2026-03-27 11:19:11 [auto1.de] INFO: Scrape type for GT24864: 2
2026-03-27 11:19:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d78ae10-c22e-5193-8245-4e06fddae7d3 with identifier: GT24864
2026-03-27 11:19:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d78ae10-c22e-5193-8245-4e06fddae7d3 with scrape type 2
2026-03-27 11:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d78ae10-c22e-5193-8245-4e06fddae7d3 with scrape type 2
2026-03-27 11:19:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d78ae10-c22e-5193-8245-4e06fddae7d3, identifier: GT24864
2026-03-27 11:19:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f27633e-4392-52f5-a025-6c743447e407 with identifier: AN60754
2026-03-27 11:19:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f27633e-4392-52f5-a025-6c743447e407 with identifier: AN60754
2026-03-27 11:19:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f27633e-4392-52f5-a025-6c743447e407 with identifier: AN60754 to the API
2026-03-27 11:19:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-27T16:43:53Z',
 'fuel_type': 'diesel',
 'id': '4f27633e-4392-52f5-a025-6c743447e407',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN60754',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 215679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-11',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline 4Motion',
 'transmission': 'automatic',
 'trim': 'Comfortline 4Motion',
 'year': 2017}
2026-03-27 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN60754%27 HTTP/1.1" 200 None
2026-03-27 11:19:11 [auto1.de] INFO: Saving data for AN60754: {'auction_closing_time': 1774629833.0, 'created_time': 1773303102.493248, 'last_price_update_time': 1774610351.662571}
2026-03-27 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN60754') HTTP/1.1" 204 0
2026-03-27 11:19:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d78ae10-c22e-5193-8245-4e06fddae7d3 with identifier: GT24864
2026-03-27 11:19:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d78ae10-c22e-5193-8245-4e06fddae7d3 with identifier: GT24864
2026-03-27 11:19:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d78ae10-c22e-5193-8245-4e06fddae7d3 with identifier: GT24864 to the API
2026-03-27 11:19:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:13:23Z',
 'fuel_type': 'petrol',
 'id': '8d78ae10-c22e-5193-8245-4e06fddae7d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT24864',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 38158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-17',
 'seller_name': None,
 'title': 'Audi Q2 35 TFSI advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2021}
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT24864%27 HTTP/1.1" 200 None
2026-03-27 11:19:12 [auto1.de] INFO: Saving data for GT24864: {'auction_closing_time': 1774628003.0, 'created_time': 1774522648.065157, 'last_price_update_time': 1774610352.089765}
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT24864') HTTP/1.1" 204 0
2026-03-27 11:19:12 [auto1.de] INFO: Found listing with ID: VA68941
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA68941%27 HTTP/1.1" 200 None
2026-03-27 11:19:12 [auto1.de] INFO: Scrape type for VA68941: 2
2026-03-27 11:19:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24307c37-8236-5e7d-b26e-342326dcd533 with identifier: VA68941
2026-03-27 11:19:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24307c37-8236-5e7d-b26e-342326dcd533 with scrape type 2
2026-03-27 11:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24307c37-8236-5e7d-b26e-342326dcd533 with scrape type 2
2026-03-27 11:19:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24307c37-8236-5e7d-b26e-342326dcd533, identifier: VA68941
2026-03-27 11:19:12 [auto1.de] INFO: Found listing with ID: ZJ67008
2026-03-27 11:19:12 [auto1.de] INFO: Found listing with ID: HE47974
2026-03-27 11:19:12 [auto1.de] INFO: Found listing with ID: UB19219
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19219%27 HTTP/1.1" 200 None
2026-03-27 11:19:12 [auto1.de] INFO: Scrape type for UB19219: 2
2026-03-27 11:19:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92e1e110-d5b0-59c9-835e-be4d808854d9 with identifier: UB19219
2026-03-27 11:19:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92e1e110-d5b0-59c9-835e-be4d808854d9 with scrape type 2
2026-03-27 11:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92e1e110-d5b0-59c9-835e-be4d808854d9 with scrape type 2
2026-03-27 11:19:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92e1e110-d5b0-59c9-835e-be4d808854d9, identifier: UB19219
2026-03-27 11:19:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24307c37-8236-5e7d-b26e-342326dcd533 with identifier: VA68941
2026-03-27 11:19:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24307c37-8236-5e7d-b26e-342326dcd533 with identifier: VA68941
2026-03-27 11:19:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24307c37-8236-5e7d-b26e-342326dcd533 with identifier: VA68941 to the API
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:05:50Z',
 'fuel_type': 'petrol',
 'id': '24307c37-8236-5e7d-b26e-342326dcd533',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA68941',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf II',
 'odometer': 77360,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1986-10-31',
 'seller_name': None,
 'title': 'Volkswagen Golf II 1.6 CL',
 'transmission': 'automatic',
 'trim': 'CL',
 'year': 1986}
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA68941%27 HTTP/1.1" 200 None
2026-03-27 11:19:12 [auto1.de] INFO: Saving data for VA68941: {'auction_closing_time': 1774627550.0, 'created_time': 1773230636.96414, 'last_price_update_time': 1774610352.618137}
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VA68941') HTTP/1.1" 204 0
2026-03-27 11:19:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92e1e110-d5b0-59c9-835e-be4d808854d9 with identifier: UB19219
2026-03-27 11:19:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92e1e110-d5b0-59c9-835e-be4d808854d9 with identifier: UB19219
2026-03-27 11:19:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92e1e110-d5b0-59c9-835e-be4d808854d9 with identifier: UB19219 to the API
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-27T16:23:34Z',
 'fuel_type': 'petrol',
 'id': '92e1e110-d5b0-59c9-835e-be4d808854d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB19219',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 58419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-27',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19219%27 HTTP/1.1" 200 None
2026-03-27 11:19:12 [auto1.de] INFO: Saving data for UB19219: {'auction_closing_time': 1774628614.0, 'created_time': 1773380823.13447, 'last_price_update_time': 1774610352.937049}
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB19219') HTTP/1.1" 204 0
2026-03-27 11:19:12 [auto1.de] INFO: Found listing with ID: JR00588
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR00588%27 HTTP/1.1" 200 None
2026-03-27 11:19:12 [auto1.de] INFO: Scrape type for JR00588: 2
2026-03-27 11:19:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d2a26ac-c1ca-56d5-95f8-38936e81dde1 with identifier: JR00588
2026-03-27 11:19:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d2a26ac-c1ca-56d5-95f8-38936e81dde1 with scrape type 2
2026-03-27 11:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d2a26ac-c1ca-56d5-95f8-38936e81dde1 with scrape type 2
2026-03-27 11:19:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d2a26ac-c1ca-56d5-95f8-38936e81dde1, identifier: JR00588
2026-03-27 11:19:13 [auto1.de] INFO: Found listing with ID: VJ43142
2026-03-27 11:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ43142%27 HTTP/1.1" 200 None
2026-03-27 11:19:13 [auto1.de] INFO: Scrape type for VJ43142: 2
2026-03-27 11:19:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 406b3bbd-2e71-53bf-8730-52f7f46bba54 with identifier: VJ43142
2026-03-27 11:19:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 406b3bbd-2e71-53bf-8730-52f7f46bba54 with scrape type 2
2026-03-27 11:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 406b3bbd-2e71-53bf-8730-52f7f46bba54 with scrape type 2
2026-03-27 11:19:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 406b3bbd-2e71-53bf-8730-52f7f46bba54, identifier: VJ43142
2026-03-27 11:19:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d2a26ac-c1ca-56d5-95f8-38936e81dde1 with identifier: JR00588
2026-03-27 11:19:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d2a26ac-c1ca-56d5-95f8-38936e81dde1 with identifier: JR00588
2026-03-27 11:19:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d2a26ac-c1ca-56d5-95f8-38936e81dde1 with identifier: JR00588 to the API
2026-03-27 11:19:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-27T16:44:40Z',
 'fuel_type': 'diesel',
 'id': '5d2a26ac-c1ca-56d5-95f8-38936e81dde1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR00588',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 130422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-11',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2014}
2026-03-27 11:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR00588%27 HTTP/1.1" 200 None
2026-03-27 11:19:13 [auto1.de] INFO: Saving data for JR00588: {'auction_closing_time': 1774629880.0, 'created_time': 1773132325.657625, 'last_price_update_time': 1774610353.575018}
2026-03-27 11:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR00588') HTTP/1.1" 204 0
2026-03-27 11:19:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 406b3bbd-2e71-53bf-8730-52f7f46bba54 with identifier: VJ43142
2026-03-27 11:19:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 406b3bbd-2e71-53bf-8730-52f7f46bba54 with identifier: VJ43142
2026-03-27 11:19:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 406b3bbd-2e71-53bf-8730-52f7f46bba54 with identifier: VJ43142 to the API
2026-03-27 11:19:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-27T16:44:13Z',
 'fuel_type': 'petrol',
 'id': '406b3bbd-2e71-53bf-8730-52f7f46bba54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ43142',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 8500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-21',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2023}
2026-03-27 11:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ43142%27 HTTP/1.1" 200 None
2026-03-27 11:19:13 [auto1.de] INFO: Saving data for VJ43142: {'auction_closing_time': 1774629853.0, 'created_time': 1774522649.588899, 'last_price_update_time': 1774610353.881074}
2026-03-27 11:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ43142') HTTP/1.1" 204 0
2026-03-27 11:19:13 [auto1.de] INFO: Found listing with ID: VC17090
2026-03-27 11:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC17090%27 HTTP/1.1" 200 None
2026-03-27 11:19:13 [auto1.de] INFO: Scrape type for VC17090: 2
2026-03-27 11:19:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d24f388-8b55-55dc-b75e-e034b462ad9f with identifier: VC17090
2026-03-27 11:19:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d24f388-8b55-55dc-b75e-e034b462ad9f with scrape type 2
2026-03-27 11:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d24f388-8b55-55dc-b75e-e034b462ad9f with scrape type 2
2026-03-27 11:19:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d24f388-8b55-55dc-b75e-e034b462ad9f, identifier: VC17090
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: UA25928
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA25928%27 HTTP/1.1" 200 None
2026-03-27 11:19:14 [auto1.de] INFO: Scrape type for UA25928: 2
2026-03-27 11:19:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62b3fb57-2898-58b7-b0a6-a3d5520b4883 with identifier: UA25928
2026-03-27 11:19:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62b3fb57-2898-58b7-b0a6-a3d5520b4883 with scrape type 2
2026-03-27 11:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62b3fb57-2898-58b7-b0a6-a3d5520b4883 with scrape type 2
2026-03-27 11:19:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62b3fb57-2898-58b7-b0a6-a3d5520b4883, identifier: UA25928
2026-03-27 11:19:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d24f388-8b55-55dc-b75e-e034b462ad9f with identifier: VC17090
2026-03-27 11:19:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d24f388-8b55-55dc-b75e-e034b462ad9f with identifier: VC17090
2026-03-27 11:19:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d24f388-8b55-55dc-b75e-e034b462ad9f with identifier: VC17090 to the API
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-27T16:32:32Z',
 'fuel_type': 'petrol',
 'id': '8d24f388-8b55-55dc-b75e-e034b462ad9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC17090',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 124625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-27',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Visia First',
 'transmission': 'manual',
 'trim': 'Visia First',
 'year': 2015}
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC17090%27 HTTP/1.1" 200 None
2026-03-27 11:19:14 [auto1.de] INFO: Saving data for VC17090: {'auction_closing_time': 1774629152.0, 'created_time': 1774522644.288711, 'last_price_update_time': 1774610354.502503}
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC17090') HTTP/1.1" 204 0
2026-03-27 11:19:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62b3fb57-2898-58b7-b0a6-a3d5520b4883 with identifier: UA25928
2026-03-27 11:19:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62b3fb57-2898-58b7-b0a6-a3d5520b4883 with identifier: UA25928
2026-03-27 11:19:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62b3fb57-2898-58b7-b0a6-a3d5520b4883 with identifier: UA25928 to the API
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:19:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-27T16:01:12Z',
 'fuel_type': 'petrol',
 'id': '62b3fb57-2898-58b7-b0a6-a3d5520b4883',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA25928',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 131658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-30',
 'seller_name': None,
 'title': 'BMW 3er 325i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2006}
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA25928%27 HTTP/1.1" 200 None
2026-03-27 11:19:14 [auto1.de] INFO: Saving data for UA25928: {'auction_closing_time': 1774627272.0, 'created_time': 1774522813.919324, 'last_price_update_time': 1774610354.815754}
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA25928') HTTP/1.1" 204 0
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: AP01247
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP01247%27 HTTP/1.1" 200 None
2026-03-27 11:19:14 [auto1.de] INFO: Scrape type for AP01247: 0
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: ZC34825
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC34825%27 HTTP/1.1" 200 None
2026-03-27 11:19:14 [auto1.de] INFO: Scrape type for ZC34825: 0
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: YR18351
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: RN81514
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: SS51493
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS51493%27 HTTP/1.1" 200 None
2026-03-27 11:19:14 [auto1.de] INFO: Scrape type for SS51493: 0
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: GY36946
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: ZU15284
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU15284%27 HTTP/1.1" 200 None
2026-03-27 11:19:14 [auto1.de] INFO: Scrape type for ZU15284: 0
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: KS48100
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS48100%27 HTTP/1.1" 200 None
2026-03-27 11:19:14 [auto1.de] INFO: Scrape type for KS48100: 0
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: WG96363
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: TV36332
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV36332%27 HTTP/1.1" 200 None
2026-03-27 11:19:14 [auto1.de] INFO: Scrape type for TV36332: 0
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: UA36533
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: CT75216
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: AM60777
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM60777%27 HTTP/1.1" 200 None
2026-03-27 11:19:14 [auto1.de] INFO: Scrape type for AM60777: 0
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: SV36392
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV36392%27 HTTP/1.1" 200 None
2026-03-27 11:19:14 [auto1.de] INFO: Scrape type for SV36392: 0
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: RA75087
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA75087%27 HTTP/1.1" 200 None
2026-03-27 11:19:14 [auto1.de] INFO: Scrape type for RA75087: 0
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: LC33794
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: HZ51579
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: HA17453
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: YJ03455
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: PN60983
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN60983%27 HTTP/1.1" 200 None
2026-03-27 11:19:14 [auto1.de] INFO: Scrape type for PN60983: 0
2026-03-27 11:19:14 [auto1.de] INFO: Found listing with ID: TC39197
2026-03-27 11:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC39197%27 HTTP/1.1" 200 None
2026-03-27 11:19:15 [auto1.de] INFO: Scrape type for TC39197: 0
2026-03-27 11:19:15 [auto1.de] INFO: Found listing with ID: MB01512
2026-03-27 11:19:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:19:16 [auto1.de] INFO: Channel: 24h | Page: 268 | totalHits: 10732 | hits on page: 40
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: TC39197
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC39197%27 HTTP/1.1" 200 None
2026-03-27 11:19:16 [auto1.de] INFO: Scrape type for TC39197: 0
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: MB01512
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: AN45666
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN45666%27 HTTP/1.1" 200 None
2026-03-27 11:19:16 [auto1.de] INFO: Scrape type for AN45666: 0
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: UP49415
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP49415%27 HTTP/1.1" 200 None
2026-03-27 11:19:16 [auto1.de] INFO: Scrape type for UP49415: 0
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: UB19206
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: PY00065
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY00065%27 HTTP/1.1" 200 None
2026-03-27 11:19:16 [auto1.de] INFO: Scrape type for PY00065: 0
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: LJ58036
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ58036%27 HTTP/1.1" 200 None
2026-03-27 11:19:16 [auto1.de] INFO: Scrape type for LJ58036: 0
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: KL64193
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL64193%27 HTTP/1.1" 200 None
2026-03-27 11:19:16 [auto1.de] INFO: Scrape type for KL64193: 0
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: BN57730
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: EG12940
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: TR13972
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13972%27 HTTP/1.1" 200 None
2026-03-27 11:19:16 [auto1.de] INFO: Scrape type for TR13972: 0
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: AA98436
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA98436%27 HTTP/1.1" 200 None
2026-03-27 11:19:16 [auto1.de] INFO: Scrape type for AA98436: 0
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: NU80618
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU80618%27 HTTP/1.1" 200 None
2026-03-27 11:19:16 [auto1.de] INFO: Scrape type for NU80618: 0
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: FD80734
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD80734%27 HTTP/1.1" 200 None
2026-03-27 11:19:16 [auto1.de] INFO: Scrape type for FD80734: 0
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: RW09760
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: NY19608
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY19608%27 HTTP/1.1" 200 None
2026-03-27 11:19:16 [auto1.de] INFO: Scrape type for NY19608: 0
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: RK25728
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK25728%27 HTTP/1.1" 200 None
2026-03-27 11:19:16 [auto1.de] INFO: Scrape type for RK25728: 0
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: RB24690
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: KE21243
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: CG53828
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: GT84792
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: PA09921
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: ZY58366
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY58366%27 HTTP/1.1" 200 None
2026-03-27 11:19:16 [auto1.de] INFO: Scrape type for ZY58366: 0
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: HS83117
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: ME06173
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME06173%27 HTTP/1.1" 200 None
2026-03-27 11:19:16 [auto1.de] INFO: Scrape type for ME06173: 0
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: LW48006
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: EZ35619
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ35619%27 HTTP/1.1" 200 None
2026-03-27 11:19:16 [auto1.de] INFO: Scrape type for EZ35619: 0
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: XW20375
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: BS00370
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: HC21911
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC21911%27 HTTP/1.1" 200 None
2026-03-27 11:19:16 [auto1.de] INFO: Scrape type for HC21911: 0
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: FP32439
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: YW70204
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: YS02767
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: MA82024
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: WM91773
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM91773%27 HTTP/1.1" 200 None
2026-03-27 11:19:16 [auto1.de] INFO: Scrape type for WM91773: 0
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: HH97697
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH97697%27 HTTP/1.1" 200 None
2026-03-27 11:19:16 [auto1.de] INFO: Scrape type for HH97697: 0
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: RJ73659
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ73659%27 HTTP/1.1" 200 None
2026-03-27 11:19:16 [auto1.de] INFO: Scrape type for RJ73659: 0
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: WJ79239
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ79239%27 HTTP/1.1" 200 None
2026-03-27 11:19:16 [auto1.de] INFO: Scrape type for WJ79239: 0
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: BT69693
2026-03-27 11:19:16 [auto1.de] INFO: Found listing with ID: LK66468
2026-03-27 11:19:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:19:20 [auto1.de] INFO: Channel: 24h | Page: 269 | totalHits: 10732 | hits on page: 12
2026-03-27 11:19:20 [auto1.de] INFO: Found listing with ID: XP03484
2026-03-27 11:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP03484%27 HTTP/1.1" 200 None
2026-03-27 11:19:20 [auto1.de] INFO: Scrape type for XP03484: 0
2026-03-27 11:19:20 [auto1.de] INFO: Found listing with ID: MF03650
2026-03-27 11:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF03650%27 HTTP/1.1" 200 None
2026-03-27 11:19:20 [auto1.de] INFO: Scrape type for MF03650: 0
2026-03-27 11:19:20 [auto1.de] INFO: Found listing with ID: RA95780
2026-03-27 11:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA95780%27 HTTP/1.1" 200 None
2026-03-27 11:19:20 [auto1.de] INFO: Scrape type for RA95780: 0
2026-03-27 11:19:20 [auto1.de] INFO: Found listing with ID: LG94407
2026-03-27 11:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG94407%27 HTTP/1.1" 200 None
2026-03-27 11:19:20 [auto1.de] INFO: Scrape type for LG94407: 0
2026-03-27 11:19:20 [auto1.de] INFO: Found listing with ID: HD15625
2026-03-27 11:19:20 [auto1.de] INFO: Found listing with ID: XB41121
2026-03-27 11:19:20 [auto1.de] INFO: Found listing with ID: SF00681
2026-03-27 11:19:20 [auto1.de] INFO: Found listing with ID: CD02908
2026-03-27 11:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD02908%27 HTTP/1.1" 200 None
2026-03-27 11:19:20 [auto1.de] INFO: Scrape type for CD02908: 0
2026-03-27 11:19:20 [auto1.de] INFO: Found listing with ID: GD21382
2026-03-27 11:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD21382%27 HTTP/1.1" 200 None
2026-03-27 11:19:20 [auto1.de] INFO: Scrape type for GD21382: 0
2026-03-27 11:19:20 [auto1.de] INFO: Found listing with ID: GF47362
2026-03-27 11:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF47362%27 HTTP/1.1" 200 None
2026-03-27 11:19:20 [auto1.de] INFO: Scrape type for GF47362: 0
2026-03-27 11:19:20 [auto1.de] INFO: Found listing with ID: GN55070
2026-03-27 11:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN55070%27 HTTP/1.1" 200 None
2026-03-27 11:19:20 [auto1.de] INFO: Scrape type for GN55070: 0
2026-03-27 11:19:20 [auto1.de] INFO: Found listing with ID: RD02705
2026-03-27 11:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD02705%27 HTTP/1.1" 200 None
2026-03-27 11:19:20 [auto1.de] INFO: Scrape type for RD02705: 0
2026-03-27 11:19:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:19:56 [auto1.de] INFO: Channel: 24h | Page: 270 | totalHits: 10739 | hits on page: 0
2026-03-27 11:19:56 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-27 11:19:56 [auto1.de] INFO: auto1.de Batch config: batch 2/2
2026-03-27 11:19:56 [auto1.de] INFO: auto1.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 6, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 40, <ScrapeType.BATCH_SKIPPED: 5>: 36}
2026-03-27 11:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW30909%27 HTTP/1.1" 200 None
2026-03-27 11:19:56 [auto1.de] INFO: Saving data for JW30909: {'created_time': 1774610396.618112}
2026-03-27 11:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW30909') HTTP/1.1" 204 0
2026-03-27 11:19:56 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (1472 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.de/task_18_2026-03-27T10_35_00.jl
2026-03-27 11:19:56 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 4206683,
 'downloader/request_count': 2345,
 'downloader/request_method_count/GET': 2073,
 'downloader/request_method_count/POST': 272,
 'downloader/response_bytes': 1216831379,
 'downloader/response_count': 2345,
 'downloader/response_status_count/200': 2345,
 'dupefilter/filtered': 25,
 'elapsed_time_seconds': 2689.920943,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 27, 11, 19, 56, 636642, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 1472,
 'log_count/DEBUG': 35294,
 'log_count/INFO': 40368,
 'memusage/max': 204664832,
 'memusage/startup': 149970944,
 'photo_download_count': 1607,
 'request_depth_max': 273,
 'response_received_count': 738,
 'scheduler/dequeued': 2345,
 'scheduler/dequeued/memory': 2345,
 'scheduler/enqueued': 2345,
 'scheduler/enqueued/memory': 2345,
 'scrape_type/batch_skipped': 5392,
 'scrape_type/new': 231,
 'scrape_type/new_duplicate_id': 1,
 'scrape_type/price_update': 1241,
 'scrape_type/skipped': 3882,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 751,
 'scrapy-zyte-api/error_ratio': 0.017310252996005325,
 'scrapy-zyte-api/errors': 13,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 13,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 7.936319551587119,
 'scrapy-zyte-api/mean_response_seconds': 7.989592922891818,
 'scrapy-zyte-api/processed': 738,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 738,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 737,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 738,
 'scrapy-zyte-api/request_args/httpRequestBody': 272,
 'scrapy-zyte-api/request_args/httpRequestMethod': 272,
 'scrapy-zyte-api/request_args/httpResponseBody': 738,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 738,
 'scrapy-zyte-api/request_args/sessionContext': 738,
 'scrapy-zyte-api/request_args/url': 738,
 'scrapy-zyte-api/status_codes/0': 13,
 'scrapy-zyte-api/status_codes/200': 738,
 'scrapy-zyte-api/success': 738,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 10772,
 'source/total_available': 10739,
 'start_time': datetime.datetime(2026, 3, 27, 10, 35, 6, 715699, tzinfo=datetime.timezone.utc)}
2026-03-27 11:19:56 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-27 11:19:56 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fb503adb790>
2026-03-27 11:19:56 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fb5037624d0>